[2025-10-28T17:00:01.675957] [INFO ] [MAIN ] Using last completed trading day: 2025-10-28 [2025-10-28T17:00:01.909109] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-28T17:00:01.909332] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-28T17:00:02.040495] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-28T17:00:02.041173] [WARN ] [STATE ] State set to: RUNNING [2025-10-28T17:00:02.041261] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-28T17:00:02.041331] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-28T17:00:02.041448] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-28T17:00:02.041524] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-28T17:00:02.941485] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-28T17:00:02.941711] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-28T17:00:02.941936] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-28T17:00:02.942454] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-28T17:00:02.942511] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-28T17:00:02.942543] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-28T17:00:02.942600] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-28T17:00:02.942633] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-28T17:00:02.942703] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-28T17:00:02.943102] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-28T17:00:02.943155] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-28T17:00:02.943313] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-28T17:00:02.943346] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-28T17:00:02.943376] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-28T17:00:02.943406] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-28T17:00:02.968556] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-28T17:00:02.993979] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-28T17:00:02.994163] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-28T17:00:02.994204] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-28T17:00:02.994234] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-28T17:00:02.994294] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-28T17:00:02.994686] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-28T17:00:02.994754] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-28T17:00:02.994799] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-28T17:00:02.994831] [INFO ] [MAIN ] Running in parallel mode [2025-10-28T17:00:02.994920] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-28T17:00:03.531560] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.648816] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.721534] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.802730] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.803232] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-28T17:00:03.803309] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-28T17:00:03.803614] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-28T17:00:03.803698] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-28T17:00:03.803758] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-28T17:00:03.803812] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-28T17:00:04.045848] [DEBUG] [LOCAL ] AAMI: Loaded 23916 existing records from primary storage. [2025-10-28T17:00:04.111799] [INFO ] [MAIN ] AAMI: Loaded 23916 existing records. [2025-10-28T17:00:04.125326] [DEBUG] [LOCAL ] A: Loaded 50510 existing records from primary storage. [2025-10-28T17:00:04.190361] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-28T17:00:04.190841] [INFO ] [MAIN ] A: Loaded 50510 existing records. [2025-10-28T17:00:04.300804] [INFO ] [MAIN ] AA: Loaded 53622 existing records. [2025-10-28T17:00:04.694601] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:04.759210] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-28T17:00:04.869853] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:04.887593] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:04.914950] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-28T17:00:04.930769] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-28T17:00:04.930959] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-28T17:00:04.961070] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-28T17:00:04.956316] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-28T17:00:04.961346] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-28T17:00:04.960931] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:04.974216] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-28T17:00:04.974121] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-28T17:00:05.006564] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-28T17:00:05.028083] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-28T17:00:05.093304] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-28T17:00:05.159116] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-28T17:00:05.296771] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T17:00:05.326931] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-28T17:00:05.998343] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:06.023138] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-28T17:00:06.017301] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:00:06.069716] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-28T17:00:06.131919] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:06.141314] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-28T17:00:06.172851] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:06.173386] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-28T17:00:06.753391] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:00:06.754311] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-28T17:00:06.995059] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T17:00:06.998335] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-28T17:00:06.996961] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T17:00:07.003226] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-28T17:00:07.210369] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-28T17:00:07.211444] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-28T17:00:07.451700] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T17:00:07.452900] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-28T17:00:07.594997] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:00:07.608075] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-28T17:00:07.702128] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T17:00:07.713506] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-28T17:00:07.727475] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T17:00:07.732078] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-28T17:00:07.861777] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T17:00:07.862928] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-28T17:00:08.154047] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T17:00:08.155704] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-28T17:00:08.381902] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T17:00:08.382943] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-28T17:00:08.587747] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T17:00:08.593249] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-28T17:00:08.778799] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T17:00:08.779633] [INFO ] [REMOTE ] AAM: Full fetch complete (915 records). [2025-10-28T17:00:08.779735] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-28T17:00:08.780144] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:08.780234] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:08.780278] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:08.780320] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-28T17:00:08.780381] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-28T17:00:08.780419] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-28T17:00:08.780458] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-28T17:00:08.780518] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 5.7s. Estimated remaining: 3h 48m 3s. Rate: 10.4 symbols/min [2025-10-28T17:00:08.983997] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:08.984416] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-10-28T17:00:08.984570] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-10-28T17:00:08.984815] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-28T17:00:08.984895] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-28T17:00:08.985229] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-28T17:00:08.985448] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-28T17:00:09.382849] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:09.384825] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T17:00:09.394791] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-28T17:00:09.398796] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-28T17:00:09.429410] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:00:09.440886] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-28T17:00:09.507250] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T17:00:09.514467] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-28T17:00:10.305633] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T17:00:10.311425] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-28T17:00:10.828949] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:00:10.841278] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-28T17:00:10.940891] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:00:10.952695] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-28T17:00:11.002532] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T17:00:11.012758] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-28T17:00:11.356066] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T17:00:11.361833] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-28T17:00:12.167070] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:00:12.173058] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-28T17:00:12.325171] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T17:00:12.337749] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-28T17:00:12.637479] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:00:12.648977] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-28T17:00:13.045159] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:00:13.050741] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-28T17:00:13.575885] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T17:00:13.587087] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-28T17:00:13.796899] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:00:13.802885] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-28T17:00:14.145839] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T17:00:14.157607] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-28T17:00:14.417524] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-10-28T17:00:14.427491] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-28T17:00:14.714368] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T17:00:14.718969] [INFO ] [REMOTE ] AAMI: Full fetch complete (33126 records). [2025-10-28T17:00:14.719106] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-28T17:00:15.164963] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-28T17:00:15.165200] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-28T17:00:15.165778] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-28T17:00:15.165917] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-28T17:00:15.167239] [DEBUG] [LOCAL ] AAMI: Trimmed 33126 records to 23756 (keeping 200 days of data) [2025-10-28T17:00:15.293306] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-28T17:00:15.339783] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-28T17:00:15.363546] [DEBUG] [LOCAL ] AAMI: Primary data saved (23756 records). [2025-10-28T17:00:15.363710] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-28T17:00:15.363810] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 12.3s. Estimated remaining: 4h 3m 40s. Rate: 9.7 symbols/min [2025-10-28T17:00:15.558904] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:15.588786] [DEBUG] [LOCAL ] AAT: Loaded 29917 existing records from primary storage. [2025-10-28T17:00:15.589071] [INFO ] [MAIN ] AAT: Loaded 29917 existing records. [2025-10-28T17:00:15.769226] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:15.769442] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-28T17:00:15.769677] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-28T17:00:15.770275] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-28T17:00:15.770338] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-28T17:00:16.138909] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:16.139254] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-28T17:00:16.169195] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-28T17:00:16.180847] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-28T17:00:16.309952] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T17:00:16.320631] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-28T17:00:16.736899] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:00:16.747777] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-28T17:00:17.156891] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:00:17.162605] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-28T17:00:18.147955] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T17:00:18.188489] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-28T17:00:18.189722] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-28T17:00:18.217140] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T17:00:18.217568] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-28T17:00:18.224931] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-28T17:00:19.630307] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (3.45 seconds). [2025-10-28T17:00:19.629151] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:00:19.648811] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-28T17:00:19.649889] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-28T17:00:19.789355] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:00:19.801454] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-28T17:00:20.088989] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-28T17:00:20.099984] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-28T17:00:21.153351] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T17:00:21.160974] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-28T17:00:21.412867] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T17:00:21.426955] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-28T17:00:21.653004] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:00:21.670971] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-28T17:00:21.826467] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T17:00:21.840680] [INFO ] [REMOTE ] A: Full fetch complete (73553 records). [2025-10-28T17:00:21.840893] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-28T17:00:22.401749] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-28T17:00:22.401870] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-28T17:00:22.402716] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-28T17:00:22.402854] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-28T17:00:22.405019] [DEBUG] [LOCAL ] A: Trimmed 73553 records to 50460 (keeping 200 days of data) [2025-10-28T17:00:22.488636] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:00:22.532061] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-28T17:00:22.756464] [DEBUG] [LOCAL ] A: Primary data saved (50460 records). [2025-10-28T17:00:22.756601] [INFO ] [MAIN ] A: Full history saved. [2025-10-28T17:00:22.756994] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 19.8s. Estimated remaining: 4h 19m 26s. Rate: 9.1 symbols/min [2025-10-28T17:00:22.937204] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:22.937559] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-28T17:00:22.937707] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-28T17:00:22.937859] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-28T17:00:22.937959] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-28T17:00:22.938031] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-28T17:00:22.938075] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-28T17:00:23.347514] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:23.348241] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-28T17:00:23.351042] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-28T17:00:23.363547] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-28T17:00:23.398506] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T17:00:23.410487] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-28T17:00:23.458723] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:00:23.465409] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-28T17:00:23.529850] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:00:23.530149] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-28T17:00:23.530238] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:00:23.530313] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-28T17:00:23.530379] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:00:23.530451] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-28T17:00:23.530515] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-28T17:00:23.530554] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-28T17:00:23.530605] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-28T17:00:23.530723] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 22m 6s. Rate: 11.7 symbols/min [2025-10-28T17:00:23.711755] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:23.733388] [DEBUG] [LOCAL ] AB: Loaded 24063 existing records from primary storage. [2025-10-28T17:00:23.733671] [INFO ] [MAIN ] AB: Loaded 24063 existing records. [2025-10-28T17:00:23.913348] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:23.913545] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-28T17:00:23.913593] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-28T17:00:23.914179] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-28T17:00:23.914239] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-28T17:00:24.278561] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:24.278882] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-28T17:00:24.473786] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T17:00:24.480924] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-28T17:00:24.715400] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T17:00:24.726249] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-28T17:00:25.329158] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:00:25.337520] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-28T17:00:25.354840] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:00:25.361837] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-28T17:00:25.490352] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T17:00:25.500341] [INFO ] [REMOTE ] AA: Full fetch complete (77349 records). [2025-10-28T17:00:25.500468] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-28T17:00:25.502281] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:25.502391] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:25.502466] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:25.502563] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-28T17:00:25.502670] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-28T17:00:25.502728] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-10-28T17:00:25.502898] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-10-28T17:00:25.503278] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 22.5s. Estimated remaining: 2h 57m 8s. Rate: 13.3 symbols/min [2025-10-28T17:00:25.678336] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:25.733033] [DEBUG] [LOCAL ] ABBV: Loaded 53674 existing records from primary storage. [2025-10-28T17:00:25.733350] [INFO ] [MAIN ] ABBV: Loaded 53674 existing records. [2025-10-28T17:00:25.922249] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:25.922565] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-28T17:00:25.922693] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-28T17:00:25.924030] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-28T17:00:25.924091] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-28T17:00:26.323070] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:00:26.339685] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:26.350963] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-28T17:00:26.353125] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-28T17:00:26.373332] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T17:00:26.380300] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-28T17:00:26.479024] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:00:26.488031] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-28T17:00:27.460876] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T17:00:27.467588] [INFO ] [REMOTE ] AAT: Full fetch complete (43078 records). [2025-10-28T17:00:27.467786] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-28T17:00:27.922411] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-28T17:00:27.923048] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-28T17:00:27.924225] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-28T17:00:27.948783] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-28T17:00:27.966155] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:00:27.978396] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-28T17:00:27.978792] [DEBUG] [LOCAL ] AAT: Trimmed 43078 records to 29902 (keeping 200 days of data) [2025-10-28T17:00:28.122052] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-28T17:00:28.146887] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-28T17:00:28.240120] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T17:00:28.258002] [INFO ] [REMOTE ] AAP: Full fetch complete (74971 records). [2025-10-28T17:00:28.262013] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-28T17:00:28.267564] [DEBUG] [LOCAL ] AAT: Primary data saved (29902 records). [2025-10-28T17:00:28.267810] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-28T17:00:28.336319] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAT took 13.0s. Estimated remaining: 2h 46m 8s. Rate: 14.2 symbols/min [2025-10-28T17:00:28.760178] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:28.911291] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-28T17:00:28.911503] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-28T17:00:28.912329] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-28T17:00:28.912417] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-28T17:00:28.914215] [DEBUG] [LOCAL ] AAP: Trimmed 74971 records to 51543 (keeping 200 days of data) [2025-10-28T17:00:29.025852] [DEBUG] [LOCAL ] ABCB: Loaded 30102 existing records from primary storage. [2025-10-28T17:00:29.041399] [INFO ] [MAIN ] ABCB: Loaded 30102 existing records. [2025-10-28T17:00:29.381748] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:29.387821] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-28T17:00:29.391217] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-28T17:00:29.444341] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-28T17:00:29.465572] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:00:29.465697] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-28T17:00:29.517531] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-28T17:00:29.613891] [DEBUG] [LOCAL ] AAP: Primary data saved (51543 records). [2025-10-28T17:00:29.625716] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-28T17:00:29.641407] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAP took 20.9s. Estimated remaining: 2h 29m 40s. Rate: 15.8 symbols/min [2025-10-28T17:00:30.029710] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:30.096325] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:30.098015] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-28T17:00:30.129430] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-28T17:00:30.141075] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-28T17:00:30.180809] [DEBUG] [LOCAL ] ABEV: Loaded 53283 existing records from primary storage. [2025-10-28T17:00:30.181418] [INFO ] [MAIN ] ABEV: Loaded 53283 existing records. [2025-10-28T17:00:30.379144] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:30.379360] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-28T17:00:30.379420] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-28T17:00:30.379722] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-28T17:00:30.379800] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-28T17:00:30.740229] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T17:00:30.780331] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-28T17:00:30.804007] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:30.804346] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-28T17:00:31.402409] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:00:31.408806] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-28T17:00:31.568274] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:00:31.573226] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-28T17:00:31.712180] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T17:00:31.723363] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-28T17:00:32.220958] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T17:00:32.231841] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-28T17:00:32.249107] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T17:00:32.255448] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-28T17:00:32.305559] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:00:32.311946] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-28T17:00:32.977055] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T17:00:32.982152] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-28T17:00:33.149310] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:00:33.160358] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-28T17:00:33.514723] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T17:00:33.525061] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-28T17:00:33.580311] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:00:33.587946] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-28T17:00:33.764400] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T17:00:33.769780] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-28T17:00:34.726848] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T17:00:34.735323] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-28T17:00:34.814061] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T17:00:34.828034] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-28T17:00:34.855046] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:00:34.860396] [INFO ] [REMOTE ] AB: Full fetch complete (43559 records). [2025-10-28T17:00:34.860506] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-28T17:00:34.861235] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:34.861330] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:34.861382] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:34.861451] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-28T17:00:34.861517] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-28T17:00:34.861555] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-28T17:00:34.861753] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-28T17:00:34.861848] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 11.3s. Estimated remaining: 2h 36m 33s. Rate: 15.1 symbols/min [2025-10-28T17:00:35.040596] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:35.062246] [DEBUG] [LOCAL ] ABG: Loaded 17425 existing records from primary storage. [2025-10-28T17:00:35.062668] [INFO ] [MAIN ] ABG: Loaded 17425 existing records. [2025-10-28T17:00:35.263533] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:35.264079] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-28T17:00:35.264215] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-28T17:00:35.264561] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-28T17:00:35.264776] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-28T17:00:35.470444] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-28T17:00:35.581092] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-28T17:00:35.747477] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:35.764342] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-28T17:00:35.767081] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:00:35.773871] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-28T17:00:36.558037] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:00:36.563957] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-28T17:00:36.673060] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T17:00:36.710693] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-28T17:00:36.714634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-28T17:00:36.726252] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-28T17:00:37.029383] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:00:37.040430] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-28T17:00:37.485181] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:00:37.492266] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-28T17:00:37.597859] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:00:37.601577] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-28T17:00:38.434405] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:00:38.446055] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-28T17:00:38.768375] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-28T17:00:38.780736] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-28T17:00:38.820096] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T17:00:38.826717] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-28T17:00:38.902995] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T17:00:38.907697] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-28T17:00:39.713244] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T17:00:39.736786] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T17:00:39.744169] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-28T17:00:39.744438] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-28T17:00:40.102328] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:00:40.112785] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-28T17:00:40.480883] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T17:00:40.484262] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-28T17:00:40.710552] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:00:40.716780] [INFO ] [REMOTE ] ABCB: Full fetch complete (44612 records). [2025-10-28T17:00:40.716882] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-28T17:00:40.717482] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:40.717563] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:40.717606] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:40.717679] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-28T17:00:40.717770] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-28T17:00:40.717818] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-28T17:00:40.718258] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-10-28T17:00:40.718371] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 12.4s. Estimated remaining: 2h 44m 39s. Rate: 14.3 symbols/min [2025-10-28T17:00:40.917248] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:40.921731] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-28T17:00:40.933633] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-28T17:00:40.962870] [DEBUG] [LOCAL ] ABM: Loaded 31780 existing records from primary storage. [2025-10-28T17:00:40.963118] [INFO ] [MAIN ] ABM: Loaded 31780 existing records. [2025-10-28T17:00:41.141138] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:41.141423] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-28T17:00:41.141529] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-28T17:00:41.150586] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:00:41.153769] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-28T17:00:41.154201] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-28T17:00:41.154458] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-28T17:00:41.543024] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:41.543469] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-28T17:00:41.574840] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:00:41.587008] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-28T17:00:42.048186] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T17:00:42.052944] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-28T17:00:42.259935] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:00:42.273796] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-28T17:00:42.447125] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:00:42.453138] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-28T17:00:42.631287] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T17:00:42.635985] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-28T17:00:42.859138] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:00:42.869611] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-28T17:00:42.869763] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-28T17:00:43.308915] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-28T17:00:43.309702] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-28T17:00:43.310856] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-28T17:00:43.312295] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T17:00:43.312541] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-28T17:00:43.324886] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-28T17:00:43.326457] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 53674 (keeping 200 days of data) [2025-10-28T17:00:43.434411] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T17:00:43.439759] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-28T17:00:43.455553] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:00:43.462050] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-28T17:00:43.693824] [DEBUG] [LOCAL ] ABBV: Primary data saved (53674 records). [2025-10-28T17:00:43.693952] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-28T17:00:43.696349] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABBV took 18.2s. Estimated remaining: 2h 39m 49s. Rate: 14.7 symbols/min [2025-10-28T17:00:43.862734] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:43.862869] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-10-28T17:00:43.862905] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-10-28T17:00:43.863039] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-28T17:00:43.863118] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-28T17:00:43.863166] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-28T17:00:43.863200] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-28T17:00:44.214771] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:44.215043] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-28T17:00:44.249910] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:00:44.253452] [INFO ] [REMOTE ] ABG: Full fetch complete (26610 records). [2025-10-28T17:00:44.253532] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-28T17:00:44.254033] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:44.254108] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:44.254173] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:44.254243] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-28T17:00:44.254303] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-28T17:00:44.254338] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-28T17:00:44.254509] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-28T17:00:44.254598] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABG took 9.4s. Estimated remaining: 2h 27m 13s. Rate: 16.0 symbols/min [2025-10-28T17:00:44.432448] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:44.432703] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-28T17:00:44.432771] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-28T17:00:44.433093] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-28T17:00:44.433167] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-28T17:00:44.433314] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-28T17:00:44.433383] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-28T17:00:44.610460] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:00:44.699713] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-28T17:00:44.826386] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:44.826956] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-28T17:00:44.857457] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T17:00:44.869402] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-28T17:00:46.093350] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-28T17:00:46.103178] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-28T17:00:46.204904] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T17:00:46.212502] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-28T17:00:46.484061] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-28T17:00:46.495042] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-28T17:00:46.526879] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:00:46.538293] [INFO ] [REMOTE ] ABEV: Full fetch complete (77327 records). [2025-10-28T17:00:46.538453] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-28T17:00:46.953397] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-28T17:00:46.953580] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-28T17:00:46.954975] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-28T17:00:46.955159] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-28T17:00:46.957471] [DEBUG] [LOCAL ] ABEV: Trimmed 77327 records to 53276 (keeping 200 days of data) [2025-10-28T17:00:47.212076] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T17:00:47.232038] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-28T17:00:47.311023] [DEBUG] [LOCAL ] ABEV: Primary data saved (53276 records). [2025-10-28T17:00:47.311244] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-28T17:00:47.311370] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABEV took 17.6s. Estimated remaining: 2h 24m 53s. Rate: 16.2 symbols/min [2025-10-28T17:00:47.509342] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:47.535282] [DEBUG] [LOCAL ] ACA: Loaded 22078 existing records from primary storage. [2025-10-28T17:00:47.535679] [INFO ] [MAIN ] ACA: Loaded 22078 existing records. [2025-10-28T17:00:47.748436] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:47.749363] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-28T17:00:47.749522] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-28T17:00:47.750231] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-28T17:00:47.750374] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-28T17:00:47.922125] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:00:48.030615] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-28T17:00:48.171231] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T17:00:48.200964] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:48.201268] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-28T17:00:48.202577] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-28T17:00:48.552327] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:00:48.559470] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-28T17:00:49.161149] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:00:49.166307] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-28T17:00:49.500412] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:00:49.511480] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-28T17:00:49.600093] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:00:49.612735] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-28T17:00:49.799220] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:00:49.808601] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-28T17:00:49.985882] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T17:00:49.990986] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-28T17:00:50.722928] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:00:50.729807] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-28T17:00:50.980707] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:00:50.987204] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-28T17:00:51.289951] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-28T17:00:51.304101] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-28T17:00:51.656555] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-28T17:00:51.838932] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:00:51.890572] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:00:51.959315] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-28T17:00:52.759315] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-28T17:00:52.901504] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:00:53.044887] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:00:53.051149] [INFO ] [REMOTE ] ABM: Full fetch complete (44884 records). [2025-10-28T17:00:53.051247] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-28T17:00:53.051917] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:53.052004] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:53.052071] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:53.052143] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-28T17:00:53.052207] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-28T17:00:53.052243] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-28T17:00:53.052410] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-28T17:00:53.053491] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 12.3s. Estimated remaining: 2h 31m 1s. Rate: 15.6 symbols/min [2025-10-28T17:00:53.223493] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:53.261150] [DEBUG] [LOCAL ] ACCO: Loaded 36287 existing records from primary storage. [2025-10-28T17:00:53.261428] [INFO ] [MAIN ] ACCO: Loaded 36287 existing records. [2025-10-28T17:00:53.444009] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:53.444198] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-28T17:00:53.444245] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-28T17:00:53.444718] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-28T17:00:53.444780] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-28T17:00:53.560478] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-28T17:00:53.856393] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:54.180980] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T17:00:54.286274] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T17:00:54.359352] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-28T17:00:55.159359] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-28T17:00:55.400436] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:00:55.959325] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-28T17:00:56.059876] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T17:00:56.759360] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-28T17:00:57.457578] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:00:57.559331] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-28T17:00:57.746222] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T17:00:58.359412] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-28T17:00:58.841731] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:00:59.159330] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-28T17:00:59.277962] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:00:59.959343] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-28T17:01:00.311272] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:01:00.759379] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-28T17:01:01.012065] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:01:01.559415] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-28T17:01:02.201462] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T17:01:02.359328] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-28T17:01:02.864912] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:01:03.159423] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-28T17:01:03.959417] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-28T17:01:04.184076] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T17:01:04.218062] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:01:04.759329] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-28T17:01:05.387210] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T17:01:05.559327] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-28T17:01:06.229952] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T17:01:06.359382] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-28T17:01:07.159322] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-28T17:01:07.244321] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:01:07.959354] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-28T17:01:08.219418] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T17:01:08.373179] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:01:08.759354] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-28T17:01:09.553009] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:01:09.562570] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-28T17:01:09.564372] [INFO ] [REMOTE ] ABR: Full fetch complete (75324 records). [2025-10-28T17:01:09.564466] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-28T17:01:09.945580] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:01:09.992107] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-28T17:01:09.992027] [INFO ] [REMOTE ] ACA: Full fetch complete (33961 records). [2025-10-28T17:01:09.992210] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-28T17:01:09.992309] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-28T17:01:09.993062] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-28T17:01:09.993310] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-28T17:01:09.994020] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:01:09.994278] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:01:09.994459] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:01:09.994601] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-28T17:01:09.994800] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-28T17:01:09.994953] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-28T17:01:09.995272] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-28T17:01:09.995369] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 22.7s. Estimated remaining: 3h 7m 36s. Rate: 12.5 symbols/min [2025-10-28T17:01:10.028194] [DEBUG] [LOCAL ] ABR: Trimmed 75324 records to 51778 (keeping 200 days of data) [2025-10-28T17:01:10.277612] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:10.360525] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-28T17:01:10.423860] [DEBUG] [LOCAL ] ACEL: Loaded 25768 existing records from primary storage. [2025-10-28T17:01:10.429947] [INFO ] [MAIN ] ACEL: Loaded 25768 existing records. [2025-10-28T17:01:10.585590] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:01:10.680717] [DEBUG] [LOCAL ] ABR: Primary data saved (51778 records). [2025-10-28T17:01:10.681442] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-28T17:01:10.680900] [INFO ] [REMOTE ] ABT: Full fetch complete (77774 records). [2025-10-28T17:01:10.692137] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-28T17:01:10.691989] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 27.0s. Estimated remaining: 2h 56m 50s. Rate: 13.3 symbols/min [2025-10-28T17:01:11.030757] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:11.054882] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-28T17:01:11.076415] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-28T17:01:11.148212] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-28T17:01:11.182384] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:11.200273] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-28T17:01:11.635864] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-28T17:01:11.667829] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-28T17:01:11.688818] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-28T17:01:11.726876] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-28T17:01:11.756316] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-28T17:01:11.756932] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-28T17:01:11.908945] [DEBUG] [LOCAL ] ABT: Trimmed 77774 records to 53625 (keeping 200 days of data) [2025-10-28T17:01:11.945379] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:11.967798] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:01:11.962490] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-28T17:01:12.133187] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-28T17:01:12.162670] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:12.165756] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-28T17:01:12.169100] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-28T17:01:12.170804] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-28T17:01:12.171351] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-28T17:01:12.688808] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:12.761092] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-28T17:01:12.810924] [DEBUG] [LOCAL ] ABT: Primary data saved (53625 records). [2025-10-28T17:01:12.811212] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-28T17:01:12.811328] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 28.6s. Estimated remaining: 2h 50m 54s. Rate: 13.8 symbols/min [2025-10-28T17:01:12.997772] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:13.014869] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:01:13.077865] [DEBUG] [LOCAL ] ACI: Loaded 53285 existing records from primary storage. [2025-10-28T17:01:13.078338] [INFO ] [MAIN ] ACI: Loaded 53285 existing records. [2025-10-28T17:01:13.285341] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:13.285737] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-28T17:01:13.285920] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-28T17:01:13.294112] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-28T17:01:13.307627] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-28T17:01:13.308526] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:01:13.564496] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-28T17:01:13.723232] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:14.359437] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-28T17:01:14.727481] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:01:14.847828] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T17:01:15.159379] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-28T17:01:15.949332] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:01:15.959322] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-28T17:01:16.759335] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-28T17:01:16.796859] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:01:16.984760] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-28T17:01:17.559383] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-28T17:01:18.359328] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-28T17:01:18.535577] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T17:01:18.990748] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:01:19.159363] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-28T17:01:19.959360] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-28T17:01:20.367418] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T17:01:20.374747] [INFO ] [REMOTE ] ACCO: Full fetch complete (53821 records). [2025-10-28T17:01:20.374876] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-28T17:01:20.763320] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-28T17:01:20.763808] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-28T17:01:20.763886] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-28T17:01:20.765432] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-28T17:01:20.765512] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-28T17:01:20.766954] [DEBUG] [LOCAL ] ACCO: Trimmed 53821 records to 36225 (keeping 200 days of data) [2025-10-28T17:01:20.974743] [DEBUG] [LOCAL ] ACCO: Primary data saved (36225 records). [2025-10-28T17:01:20.975120] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-28T17:01:20.976435] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 27.9s. Estimated remaining: 2h 59m 35s. Rate: 13.1 symbols/min [2025-10-28T17:01:21.107307] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:01:21.191197] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:21.191468] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-28T17:01:21.191634] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-28T17:01:21.191959] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-28T17:01:21.192112] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-28T17:01:21.192209] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-28T17:01:21.192370] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-28T17:01:21.612395] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:21.573154] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-28T17:01:21.616011] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-10-28T17:01:22.044839] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:01:22.359340] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-28T17:01:22.482332] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T17:01:23.159393] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-28T17:01:23.959341] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-28T17:01:24.264794] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:01:24.621859] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-28T17:01:24.759330] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-28T17:01:24.957855] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T17:01:25.559330] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-28T17:01:26.359348] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-28T17:01:26.795039] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:01:26.864226] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-28T17:01:27.159359] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-28T17:01:27.959338] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-28T17:01:28.054631] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T17:01:28.762860] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-28T17:01:28.765805] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:01:29.439429] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-28T17:01:29.559321] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-28T17:01:30.359318] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-28T17:01:30.469593] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T17:01:31.109739] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T17:01:31.159344] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-28T17:01:31.959336] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-28T17:01:32.165674] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-28T17:01:32.719622] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:01:32.753060] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:01:32.759284] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-28T17:01:33.559344] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-28T17:01:33.636347] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:01:34.359335] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-28T17:01:34.883469] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T17:01:35.159354] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-28T17:01:35.394571] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:01:35.399453] [INFO ] [REMOTE ] ACEL: Full fetch complete (38658 records). [2025-10-28T17:01:35.399549] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-28T17:01:35.774858] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-28T17:01:35.774943] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-28T17:01:35.775376] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-28T17:01:35.775441] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-28T17:01:35.776519] [DEBUG] [LOCAL ] ACEL: Trimmed 38658 records to 25609 (keeping 200 days of data) [2025-10-28T17:01:35.918940] [DEBUG] [LOCAL ] ACEL: Primary data saved (25609 records). [2025-10-28T17:01:35.919072] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-28T17:01:35.919153] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 25.9s. Estimated remaining: 3h 22m 1s. Rate: 11.6 symbols/min [2025-10-28T17:01:35.964512] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-28T17:01:36.090262] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:36.137311] [DEBUG] [LOCAL ] ACN: Loaded 53433 existing records from primary storage. [2025-10-28T17:01:36.137613] [INFO ] [MAIN ] ACN: Loaded 53433 existing records. [2025-10-28T17:01:36.312352] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:36.312579] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-28T17:01:36.312627] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-28T17:01:36.313518] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-28T17:01:36.313576] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-28T17:01:36.665840] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:36.759293] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-28T17:01:37.254122] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T17:01:37.498485] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T17:01:37.559335] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-28T17:01:38.359346] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-28T17:01:38.463895] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T17:01:38.785899] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:01:39.159364] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-28T17:01:39.511512] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T17:01:39.959403] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-28T17:01:40.510344] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:01:40.759401] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-28T17:01:41.559349] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-28T17:01:42.245085] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-28T17:01:42.359305] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-28T17:01:42.443833] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T17:01:43.083320] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T17:01:43.159422] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-28T17:01:43.959386] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-28T17:01:44.624519] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-28T17:01:44.635365] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-28T17:01:44.635500] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-28T17:01:44.764352] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-28T17:01:45.044795] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-28T17:01:45.044878] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-28T17:01:45.045639] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-28T17:01:45.045726] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-28T17:01:45.047202] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-28T17:01:45.290213] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-28T17:01:45.430948] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-28T17:01:45.431153] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-28T17:01:45.431275] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACHR took 34.7s. Estimated remaining: 3h 30m 54s. Rate: 11.1 symbols/min [2025-10-28T17:01:45.562842] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-28T17:01:45.569942] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T17:01:45.602764] [INFO ] [REMOTE ] ACI: Full fetch complete (76842 records). [2025-10-28T17:01:45.627768] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-28T17:01:45.654100] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:01:45.655754] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:45.655920] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:01:45.656151] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-28T17:01:45.656230] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:01:45.656289] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-28T17:01:45.656400] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-28T17:01:45.656601] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-28T17:01:45.656778] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-28T17:01:45.656870] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-10-28T17:01:45.656979] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-28T17:01:45.657115] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-28T17:01:45.657157] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-10-28T17:01:45.657227] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-28T17:01:45.702562] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACI took 32.9s. Estimated remaining: 3h 20m 48s. Rate: 11.7 symbols/min [2025-10-28T17:01:46.113086] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:46.118417] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-28T17:01:46.141292] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-28T17:01:46.162476] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-28T17:01:46.186668] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-28T17:01:46.200557] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-28T17:01:46.218409] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-28T17:01:46.236885] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:46.363073] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-28T17:01:46.561710] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-28T17:01:46.648363] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:46.964454] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T17:01:47.159376] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-28T17:01:47.568179] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:01:47.959351] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-28T17:01:48.311807] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:01:48.759552] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-28T17:01:48.826201] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T17:01:49.147546] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T17:01:49.559360] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-28T17:01:50.359366] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-28T17:01:50.695380] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:01:50.784314] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T17:01:51.159365] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-28T17:01:51.959307] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-28T17:01:52.109507] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T17:01:52.759330] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-28T17:01:53.564494] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-28T17:01:53.589363] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:01:54.193578] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:01:54.246083] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:01:54.359344] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-28T17:01:54.841397] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:01:55.159365] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-28T17:01:55.959423] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-28T17:01:56.759332] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-28T17:01:56.902406] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:01:56.910454] [INFO ] [REMOTE ] ACM: Full fetch complete (62858 records). [2025-10-28T17:01:56.910607] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-28T17:01:56.911322] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:01:56.911407] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:01:56.911456] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:01:56.911544] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-28T17:01:56.911623] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-28T17:01:56.911712] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-28T17:01:56.911781] [DEBUG] [LOCAL ] ACM: No derivative data file found to delete. [2025-10-28T17:01:56.911857] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACM took 35.9s. Estimated remaining: 3h 32m 1s. Rate: 11.1 symbols/min [2025-10-28T17:01:57.083525] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:57.114772] [DEBUG] [LOCAL ] ACRE: Loaded 32703 existing records from primary storage. [2025-10-28T17:01:57.115115] [INFO ] [MAIN ] ACRE: Loaded 32703 existing records. [2025-10-28T17:01:57.298740] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:57.298959] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-28T17:01:57.299025] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-28T17:01:57.299442] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-28T17:01:57.299500] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-28T17:01:57.566056] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-28T17:01:57.657148] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:57.863098] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-28T17:01:57.899603] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T17:01:58.265461] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:01:58.359336] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-28T17:01:58.997737] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:01:59.159339] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-28T17:01:59.959361] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-28T17:02:00.317359] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:02:00.759344] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-28T17:02:01.559359] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-28T17:02:01.727769] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T17:02:01.821640] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:02:01.990938] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:02:02.359358] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-28T17:02:03.159343] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-28T17:02:03.959321] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-28T17:02:04.118149] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T17:02:04.345117] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-28T17:02:04.521224] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:02:04.759357] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-28T17:02:05.559335] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-28T17:02:05.942180] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T17:02:06.359369] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-28T17:02:06.406043] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T17:02:07.159337] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-28T17:02:07.296326] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T17:02:07.817850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T17:02:07.819267] [INFO ] [REMOTE ] ACR: Full fetch complete (8537 records). [2025-10-28T17:02:07.819356] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-28T17:02:07.970680] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-28T17:02:08.245572] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-28T17:02:08.245679] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-28T17:02:08.245930] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-28T17:02:08.245972] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-28T17:02:08.246446] [DEBUG] [LOCAL ] ACR: Trimmed 8537 records to 5179 (keeping 200 days of data) [2025-10-28T17:02:08.278376] [DEBUG] [LOCAL ] ACR: Primary data saved (5179 records). [2025-10-28T17:02:08.278521] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-28T17:02:08.278602] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACR took 22.6s. Estimated remaining: 3h 42m 28s. Rate: 10.5 symbols/min [2025-10-28T17:02:08.458686] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:08.468226] [DEBUG] [LOCAL ] ACV: Loaded 7257 existing records from primary storage. [2025-10-28T17:02:08.468445] [INFO ] [MAIN ] ACV: Loaded 7257 existing records. [2025-10-28T17:02:08.665587] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:08.665885] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-28T17:02:08.665950] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-28T17:02:08.666268] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-28T17:02:08.666337] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-28T17:02:08.764613] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-28T17:02:09.055775] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:09.523489] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:02:09.559319] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-28T17:02:09.959633] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:02:10.273634] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T17:02:10.359352] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-28T17:02:11.159353] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-28T17:02:11.724312] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:02:11.959371] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-28T17:02:12.759359] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-28T17:02:12.952037] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:02:12.963024] [INFO ] [REMOTE ] ACN: Full fetch complete (77034 records). [2025-10-28T17:02:12.963185] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-28T17:02:12.964042] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:02:12.964137] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:02:12.964184] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:02:12.964263] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-28T17:02:12.964342] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-28T17:02:12.964392] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-28T17:02:12.964588] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-28T17:02:12.965599] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACN took 37.0s. Estimated remaining: 3h 40m 40s. Rate: 10.6 symbols/min [2025-10-28T17:02:13.155100] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:13.210716] [DEBUG] [LOCAL ] ACVA: Loaded 49125 existing records from primary storage. [2025-10-28T17:02:13.211380] [INFO ] [MAIN ] ACVA: Loaded 49125 existing records. [2025-10-28T17:02:13.418591] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:13.419289] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-28T17:02:13.419479] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-28T17:02:13.420576] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-28T17:02:13.420691] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-28T17:02:13.531095] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:02:13.561705] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-28T17:02:13.806951] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T17:02:13.899891] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:14.067898] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T17:02:14.359365] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-28T17:02:15.112950] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:02:15.159355] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-28T17:02:15.959364] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-28T17:02:16.458496] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T17:02:16.535054] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:02:16.541897] [INFO ] [REMOTE ] ACP: Full fetch complete (46465 records). [2025-10-28T17:02:16.542052] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-28T17:02:16.768608] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-28T17:02:16.938790] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-28T17:02:16.938869] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-28T17:02:16.939348] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-28T17:02:16.939389] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-28T17:02:16.940338] [DEBUG] [LOCAL ] ACP: Trimmed 46465 records to 30672 (keeping 200 days of data) [2025-10-28T17:02:17.118066] [DEBUG] [LOCAL ] ACP: Primary data saved (30672 records). [2025-10-28T17:02:17.118205] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-28T17:02:17.118277] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACP took 31.7s. Estimated remaining: 3h 38m 8s. Rate: 10.7 symbols/min [2025-10-28T17:02:17.289626] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:17.289832] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-28T17:02:17.289983] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-28T17:02:17.290135] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-28T17:02:17.296299] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-28T17:02:17.296358] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-28T17:02:17.296395] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-28T17:02:17.297441] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:02:17.564505] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-28T17:02:17.669310] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:18.359378] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-28T17:02:18.871260] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:02:19.159378] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-28T17:02:19.389913] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:02:19.390434] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-28T17:02:19.390556] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:02:19.390622] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-28T17:02:19.390719] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:02:19.390817] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-28T17:02:19.390927] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-28T17:02:19.390982] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-28T17:02:19.391035] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-28T17:02:19.391100] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. AD took 2.3s. Estimated remaining: 3h 32m 52s. Rate: 11.0 symbols/min [2025-10-28T17:02:19.588238] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:19.645551] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-28T17:02:19.675697] [DEBUG] [LOCAL ] ADC: Loaded 46272 existing records from primary storage. [2025-10-28T17:02:19.676946] [INFO ] [MAIN ] ADC: Loaded 46272 existing records. [2025-10-28T17:02:19.906350] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:19.906663] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-28T17:02:19.906731] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-28T17:02:19.908347] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-28T17:02:19.908411] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-28T17:02:19.965563] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-28T17:02:20.322092] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:20.759385] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-28T17:02:21.497494] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:02:21.559361] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-28T17:02:22.359358] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-28T17:02:23.096733] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-28T17:02:23.159361] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-28T17:02:23.345397] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T17:02:23.959369] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-28T17:02:23.985608] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:02:24.079146] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:02:24.759366] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-28T17:02:25.017730] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:02:25.559363] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-28T17:02:25.800782] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:02:26.359352] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-28T17:02:26.797361] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:02:27.159419] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-28T17:02:27.690218] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:02:27.959390] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-28T17:02:28.105035] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:02:28.437782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:02:28.759342] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-28T17:02:29.235932] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T17:02:29.559360] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-28T17:02:30.359378] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-28T17:02:30.606873] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:02:30.609636] [INFO ] [REMOTE ] ACV: Full fetch complete (10653 records). [2025-10-28T17:02:30.609736] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-28T17:02:30.968873] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-28T17:02:30.968965] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-28T17:02:30.969181] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-28T17:02:30.969222] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-28T17:02:30.969761] [DEBUG] [LOCAL ] ACV: Trimmed 10653 records to 7282 (keeping 200 days of data) [2025-10-28T17:02:31.015479] [DEBUG] [LOCAL ] ACV: Primary data saved (7282 records). [2025-10-28T17:02:31.015613] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-28T17:02:31.015721] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. ACV took 22.7s. Estimated remaining: 3h 42m 2s. Rate: 10.5 symbols/min [2025-10-28T17:02:31.164979] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-28T17:02:31.198963] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:31.234765] [DEBUG] [LOCAL ] ADCT: Loaded 35566 existing records from primary storage. [2025-10-28T17:02:31.235073] [INFO ] [MAIN ] ADCT: Loaded 35566 existing records. [2025-10-28T17:02:31.441851] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:31.442066] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-28T17:02:31.442138] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-28T17:02:31.442762] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-28T17:02:31.442823] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-28T17:02:31.807427] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:31.946636] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T17:02:31.959291] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-28T17:02:32.109892] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:02:32.759386] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-28T17:02:33.559321] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-28T17:02:33.769431] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T17:02:34.155540] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:02:34.359435] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-28T17:02:35.159582] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-28T17:02:35.343278] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:02:35.349705] [INFO ] [REMOTE ] ACRE: Full fetch complete (49046 records). [2025-10-28T17:02:35.349799] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-28T17:02:35.730206] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-28T17:02:35.730297] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-28T17:02:35.730850] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-28T17:02:35.730913] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-28T17:02:35.732177] [DEBUG] [LOCAL ] ACRE: Trimmed 49046 records to 32581 (keeping 200 days of data) [2025-10-28T17:02:35.919377] [DEBUG] [LOCAL ] ACRE: Primary data saved (32581 records). [2025-10-28T17:02:35.919522] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-28T17:02:35.920217] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ACRE took 39.0s. Estimated remaining: 3h 40m 48s. Rate: 10.6 symbols/min [2025-10-28T17:02:35.984557] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-28T17:02:36.094231] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:36.146221] [DEBUG] [LOCAL ] ADM: Loaded 53387 existing records from primary storage. [2025-10-28T17:02:36.146627] [INFO ] [MAIN ] ADM: Loaded 53387 existing records. [2025-10-28T17:02:36.340227] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:36.340730] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-28T17:02:36.340882] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-28T17:02:36.356593] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-28T17:02:36.367328] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-28T17:02:36.491350] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-28T17:02:36.767230] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-28T17:02:36.771939] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:36.968354] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T17:02:37.002771] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:02:37.559407] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-28T17:02:37.894943] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:02:38.359553] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-28T17:02:38.872343] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:02:39.159318] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-28T17:02:39.453868] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:02:39.959388] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-28T17:02:40.613858] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:02:40.759354] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-28T17:02:41.559326] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-28T17:02:41.747704] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T17:02:42.011819] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:02:42.359340] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-28T17:02:42.698206] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:02:43.159405] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-28T17:02:43.964461] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-28T17:02:43.987596] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T17:02:44.301115] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:02:44.759349] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-28T17:02:45.448991] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:02:45.559365] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-28T17:02:45.776309] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:02:46.359362] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-28T17:02:47.155087] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:02:47.164794] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-28T17:02:47.959320] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-28T17:02:48.177987] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T17:02:48.187971] [INFO ] [REMOTE ] ADC: Full fetch complete (66735 records). [2025-10-28T17:02:48.188127] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-28T17:02:48.582695] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-28T17:02:48.582807] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-28T17:02:48.583517] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-28T17:02:48.583632] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-28T17:02:48.585246] [DEBUG] [LOCAL ] ADC: Trimmed 66735 records to 46262 (keeping 200 days of data) [2025-10-28T17:02:48.761126] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-28T17:02:48.877596] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T17:02:48.913932] [DEBUG] [LOCAL ] ADC: Primary data saved (46262 records). [2025-10-28T17:02:48.914058] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-28T17:02:48.914150] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ADC took 29.5s. Estimated remaining: 3h 50m 54s. Rate: 10.1 symbols/min [2025-10-28T17:02:49.080483] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:49.080680] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-28T17:02:49.080732] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-28T17:02:49.080879] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-28T17:02:49.080927] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-28T17:02:49.080972] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-28T17:02:49.081011] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-28T17:02:49.463847] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:49.559337] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-28T17:02:49.660134] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T17:02:49.670236] [INFO ] [REMOTE ] ACVA: Full fetch complete (71041 records). [2025-10-28T17:02:49.670382] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-28T17:02:50.063322] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-28T17:02:50.063396] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-28T17:02:50.064055] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-28T17:02:50.064118] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-28T17:02:50.065470] [DEBUG] [LOCAL ] ACVA: Trimmed 71041 records to 49057 (keeping 200 days of data) [2025-10-28T17:02:50.189228] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:02:50.360709] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-28T17:02:50.369979] [DEBUG] [LOCAL ] ACVA: Primary data saved (49057 records). [2025-10-28T17:02:50.370057] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-28T17:02:50.370129] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ACVA took 37.4s. Estimated remaining: 3h 44m 48s. Rate: 10.4 symbols/min [2025-10-28T17:02:50.539729] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:50.585439] [DEBUG] [LOCAL ] ADT: Loaded 53432 existing records from primary storage. [2025-10-28T17:02:50.585758] [INFO ] [MAIN ] ADT: Loaded 53432 existing records. [2025-10-28T17:02:50.761880] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:50.762053] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-28T17:02:50.762099] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-28T17:02:50.763000] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-28T17:02:50.763057] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-28T17:02:51.127780] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:51.154061] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:02:51.163122] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-28T17:02:51.959350] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-28T17:02:52.169763] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T17:02:52.641122] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-28T17:02:52.759346] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-28T17:02:52.955197] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:02:53.559338] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-28T17:02:54.149716] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T17:02:54.359382] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-28T17:02:55.010396] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:02:55.159389] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-28T17:02:55.959307] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-28T17:02:56.003955] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T17:02:56.759407] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-28T17:02:56.884460] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-28T17:02:57.243324] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:02:57.559358] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-28T17:02:58.109234] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T17:02:58.359389] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-28T17:02:58.752678] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T17:02:59.159336] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-28T17:02:59.630604] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T17:02:59.959350] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-28T17:03:00.189230] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:03:00.759394] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-28T17:03:01.559339] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-28T17:03:01.715665] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T17:03:01.834681] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:03:02.359394] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-28T17:03:02.881948] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T17:03:03.159347] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-28T17:03:03.831521] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T17:03:03.959412] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-28T17:03:04.543286] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:03:04.551751] [INFO ] [REMOTE ] ADCT: Full fetch complete (51429 records). [2025-10-28T17:03:04.551855] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-28T17:03:04.770473] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-28T17:03:04.936007] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-28T17:03:04.936099] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-28T17:03:04.936610] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-28T17:03:04.936680] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-28T17:03:04.940812] [DEBUG] [LOCAL ] ADCT: Trimmed 51429 records to 35678 (keeping 200 days of data) [2025-10-28T17:03:05.135294] [DEBUG] [LOCAL ] ADCT: Primary data saved (35678 records). [2025-10-28T17:03:05.135428] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-28T17:03:05.136424] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADCT took 34.1s. Estimated remaining: 3h 56m 23s. Rate: 9.9 symbols/min [2025-10-28T17:03:05.326702] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:05.355315] [DEBUG] [LOCAL ] ADX: Loaded 27465 existing records from primary storage. [2025-10-28T17:03:05.355958] [INFO ] [MAIN ] ADX: Loaded 27465 existing records. [2025-10-28T17:03:05.507027] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:03:05.546363] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:03:05.567621] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-28T17:03:05.612988] [INFO ] [REMOTE ] ADM: Full fetch complete (77467 records). [2025-10-28T17:03:05.623884] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-28T17:03:05.646171] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:05.697153] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-28T17:03:05.719724] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-28T17:03:05.728044] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-28T17:03:05.745381] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-28T17:03:06.365908] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-28T17:03:06.497857] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-28T17:03:06.521221] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:06.521387] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-28T17:03:06.522525] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-28T17:03:06.522593] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-28T17:03:06.524212] [DEBUG] [LOCAL ] ADM: Trimmed 77467 records to 53377 (keeping 200 days of data) [2025-10-28T17:03:06.884747] [DEBUG] [LOCAL ] ADM: Primary data saved (53377 records). [2025-10-28T17:03:06.885107] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-28T17:03:06.886333] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADM took 31.0s. Estimated remaining: 3h 50m 51s. Rate: 10.1 symbols/min [2025-10-28T17:03:07.097219] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:07.127031] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T17:03:07.159342] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-28T17:03:07.179127] [DEBUG] [LOCAL ] AEE: Loaded 49892 existing records from primary storage. [2025-10-28T17:03:07.179448] [INFO ] [MAIN ] AEE: Loaded 49892 existing records. [2025-10-28T17:03:07.361505] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:07.361738] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-28T17:03:07.361793] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-28T17:03:07.362372] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-28T17:03:07.362431] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-28T17:03:07.746308] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:07.866513] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T17:03:07.959306] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-28T17:03:08.538526] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:03:08.759380] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-28T17:03:09.331424] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:03:09.559390] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-28T17:03:10.320680] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:03:10.359385] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-28T17:03:11.155849] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-28T17:03:11.165684] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-28T17:03:11.959339] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-28T17:03:12.107147] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:03:12.270322] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-28T17:03:12.759359] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-28T17:03:13.284600] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T17:03:13.559412] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-28T17:03:13.812044] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T17:03:14.359363] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-28T17:03:15.008002] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:03:15.159325] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-28T17:03:15.709715] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T17:03:15.959417] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-28T17:03:16.759315] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-28T17:03:16.814874] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:03:16.968875] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T17:03:17.559342] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-28T17:03:18.194522] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:03:18.359337] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-28T17:03:18.987053] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T17:03:18.999098] [INFO ] [REMOTE ] ADT: Full fetch complete (76995 records). [2025-10-28T17:03:18.999272] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-28T17:03:19.000065] [FATAL] [VALIDATOR ] ADT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:03:19.000164] [FATAL] [MAIN ] ADT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:03:19.000207] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:03:19.000248] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-28T17:03:19.000329] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-28T17:03:19.000412] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-10-28T17:03:19.000632] [DEBUG] [LOCAL ] ADT: Deleted derivative data file. [2025-10-28T17:03:19.000797] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADT took 28.6s. Estimated remaining: 3h 58m 16s. Rate: 9.8 symbols/min [2025-10-28T17:03:19.172823] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-28T17:03:19.176037] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:19.176122] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-28T17:03:19.176158] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-28T17:03:19.176264] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-28T17:03:19.176305] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-28T17:03:19.176345] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-28T17:03:19.176377] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-28T17:03:19.536976] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:19.959321] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-28T17:03:20.030045] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T17:03:20.609743] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:03:20.759331] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-28T17:03:20.950143] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-28T17:03:21.184397] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:03:21.559336] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-28T17:03:22.359345] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-28T17:03:23.000374] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T17:03:23.159312] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-28T17:03:23.614210] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T17:03:23.745843] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T17:03:23.959318] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-28T17:03:24.759338] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-28T17:03:25.210075] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T17:03:25.559381] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-28T17:03:26.098018] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:03:26.096285] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T17:03:26.359326] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-28T17:03:27.159381] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-28T17:03:27.184684] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T17:03:27.959387] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-28T17:03:28.759344] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-28T17:03:28.829808] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T17:03:28.838717] [INFO ] [REMOTE ] ADNT: Full fetch complete (67625 records). [2025-10-28T17:03:28.838869] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-28T17:03:29.261515] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-28T17:03:29.261668] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-28T17:03:29.262807] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-28T17:03:29.262916] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-28T17:03:29.264905] [DEBUG] [LOCAL ] ADNT: Trimmed 67625 records to 45939 (keeping 200 days of data) [2025-10-28T17:03:29.357768] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:03:29.542796] [DEBUG] [LOCAL ] ADNT: Primary data saved (45939 records). [2025-10-28T17:03:29.543007] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-28T17:03:29.543164] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADNT took 40.6s. Estimated remaining: 4h 3m 22s. Rate: 9.6 symbols/min [2025-10-28T17:03:29.574788] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-28T17:03:29.757131] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:29.753739] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-28T17:03:29.807781] [DEBUG] [LOCAL ] AEG: Loaded 49423 existing records from primary storage. [2025-10-28T17:03:29.808083] [INFO ] [MAIN ] AEG: Loaded 49423 existing records. [2025-10-28T17:03:29.997749] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:29.997938] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-28T17:03:29.998006] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-28T17:03:29.998789] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-28T17:03:29.998848] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-28T17:03:30.372260] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-28T17:03:30.378584] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:30.606455] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:03:30.904583] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:03:31.159348] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-28T17:03:31.648596] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:03:31.959364] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-28T17:03:32.759354] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-28T17:03:33.372314] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:03:33.559323] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-28T17:03:34.116096] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:03:34.359381] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-28T17:03:34.917758] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:03:35.159349] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-28T17:03:35.776387] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T17:03:35.959359] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-28T17:03:36.701102] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T17:03:36.711540] [INFO ] [REMOTE ] AEE: Full fetch complete (72955 records). [2025-10-28T17:03:36.711740] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-28T17:03:36.768092] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-28T17:03:37.147771] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-28T17:03:37.147958] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-28T17:03:37.148853] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-28T17:03:37.149336] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-28T17:03:37.150935] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T17:03:37.159181] [DEBUG] [LOCAL ] AEE: Trimmed 72955 records to 49871 (keeping 200 days of data) [2025-10-28T17:03:37.471369] [DEBUG] [LOCAL ] AEE: Primary data saved (49871 records). [2025-10-28T17:03:37.471504] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-28T17:03:37.472079] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. AEE took 30.6s. Estimated remaining: 4h 5m 11s. Rate: 9.5 symbols/min [2025-10-28T17:03:37.566306] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-28T17:03:37.652488] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:37.703505] [DEBUG] [LOCAL ] AEM: Loaded 53473 existing records from primary storage. [2025-10-28T17:03:37.703867] [INFO ] [MAIN ] AEM: Loaded 53473 existing records. [2025-10-28T17:03:37.884131] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:37.884335] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-28T17:03:37.884382] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-28T17:03:37.885322] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-28T17:03:37.885391] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-28T17:03:38.156143] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:03:38.263414] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:38.324557] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:03:38.359303] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-28T17:03:39.159313] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-28T17:03:39.808318] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:03:39.959304] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-28T17:03:39.999834] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T17:03:40.759337] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-28T17:03:41.191376] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T17:03:41.559369] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-28T17:03:41.994599] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:03:42.177172] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T17:03:42.179068] [INFO ] [REMOTE ] AEFC: Full fetch complete (11572 records). [2025-10-28T17:03:42.179168] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-28T17:03:42.364501] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-28T17:03:42.545133] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-28T17:03:42.545208] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-28T17:03:42.545414] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-28T17:03:42.545454] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-28T17:03:42.545934] [DEBUG] [LOCAL ] AEFC: Trimmed 11572 records to 7433 (keeping 200 days of data) [2025-10-28T17:03:42.589048] [DEBUG] [LOCAL ] AEFC: Primary data saved (7433 records). [2025-10-28T17:03:42.589172] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-28T17:03:42.589245] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEFC took 23.6s. Estimated remaining: 4h 3m 45s. Rate: 9.6 symbols/min [2025-10-28T17:03:42.760790] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:42.809059] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-28T17:03:42.809359] [INFO ] [MAIN ] AEO: Loaded 53563 existing records. [2025-10-28T17:03:42.988397] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:42.988638] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-28T17:03:42.988735] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-28T17:03:42.990353] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-28T17:03:42.990416] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-28T17:03:43.170143] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-28T17:03:43.366854] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:43.965137] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-28T17:03:43.970467] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:03:44.759364] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-28T17:03:45.012845] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-28T17:03:45.114872] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T17:03:45.559389] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-28T17:03:46.062364] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:03:46.359343] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-28T17:03:46.447430] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T17:03:46.453793] [INFO ] [REMOTE ] ADX: Full fetch complete (41495 records). [2025-10-28T17:03:46.453939] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-28T17:03:46.454627] [FATAL] [VALIDATOR ] ADX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:03:46.454736] [FATAL] [MAIN ] ADX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:03:46.454779] [WARN ] [MAIN ] ADX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:03:46.454820] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-28T17:03:46.454881] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-10-28T17:03:46.454917] [INFO ] [LOCAL ] ADX: Starting deletion of derivative data. [2025-10-28T17:03:46.455105] [DEBUG] [LOCAL ] ADX: Deleted derivative data file. [2025-10-28T17:03:46.455181] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. ADX took 41.3s. Estimated remaining: 4h 1m 3s. Rate: 9.7 symbols/min [2025-10-28T17:03:46.622679] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:46.670099] [DEBUG] [LOCAL ] AER: Loaded 47685 existing records from primary storage. [2025-10-28T17:03:46.670390] [INFO ] [MAIN ] AER: Loaded 47685 existing records. [2025-10-28T17:03:46.850087] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:46.850306] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-28T17:03:46.850353] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-28T17:03:46.850944] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-28T17:03:46.851001] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-28T17:03:47.164602] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-28T17:03:47.207946] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:47.704813] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:03:47.959344] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-28T17:03:48.725417] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T17:03:48.759309] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-28T17:03:49.476385] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:03:49.559342] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-28T17:03:49.942720] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T17:03:50.359365] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-28T17:03:50.696038] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T17:03:51.159365] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-28T17:03:51.974535] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-28T17:03:51.998491] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T17:03:52.458321] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T17:03:52.468249] [INFO ] [REMOTE ] AEG: Full fetch complete (70632 records). [2025-10-28T17:03:52.468403] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-28T17:03:52.764816] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-28T17:03:52.879522] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-28T17:03:52.879603] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-28T17:03:52.880282] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-28T17:03:52.880344] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-28T17:03:52.881682] [DEBUG] [LOCAL ] AEG: Trimmed 70632 records to 49393 (keeping 200 days of data) [2025-10-28T17:03:53.157620] [DEBUG] [LOCAL ] AEG: Primary data saved (49393 records). [2025-10-28T17:03:53.157780] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-28T17:03:53.157864] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 23.6s. Estimated remaining: 4h 1m 28s. Rate: 9.6 symbols/min [2025-10-28T17:03:53.559398] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-28T17:03:54.126534] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-28T17:03:54.359488] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-28T17:03:54.401879] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:03:55.021098] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T17:03:55.159380] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-28T17:03:55.685838] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:03:55.959380] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-28T17:03:56.327693] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:03:56.759393] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-28T17:03:57.559505] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-28T17:03:58.196880] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:03:58.359350] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-28T17:03:58.722099] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T17:03:58.758847] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-28T17:03:59.159320] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-28T17:03:59.740885] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T17:03:59.959405] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-28T17:04:00.398512] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:04:00.759360] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-28T17:04:01.559394] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-28T17:04:01.836983] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T17:04:02.359383] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-28T17:04:02.476486] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T17:04:03.150260] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T17:04:03.161046] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-28T17:04:03.959402] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-28T17:04:04.167494] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:04:04.383760] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-28T17:04:04.759361] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-28T17:04:05.555089] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T17:04:05.566039] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-28T17:04:06.359324] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-28T17:04:06.553971] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T17:04:07.159383] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-28T17:04:07.632539] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:04:07.959326] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-28T17:04:08.073281] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T17:04:08.759301] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-28T17:04:08.931565] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:04:08.942310] [INFO ] [REMOTE ] AEM: Full fetch complete (77491 records). [2025-10-28T17:04:08.942459] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-28T17:04:09.335158] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-28T17:04:09.335289] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-28T17:04:09.336098] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-28T17:04:09.336206] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-28T17:04:09.350112] [DEBUG] [LOCAL ] AEM: Trimmed 77491 records to 53472 (keeping 200 days of data) [2025-10-28T17:04:09.368150] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:04:09.560328] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-28T17:04:09.697218] [DEBUG] [LOCAL ] AEM: Primary data saved (53472 records). [2025-10-28T17:04:09.697366] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-28T17:04:09.698022] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEM took 32.2s. Estimated remaining: 4h 11m 54s. Rate: 9.2 symbols/min [2025-10-28T17:04:10.867130] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T17:04:10.877596] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-28T17:04:10.913360] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-28T17:04:10.923894] [INFO ] [REMOTE ] AEO: Full fetch complete (77651 records). [2025-10-28T17:04:10.924023] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-28T17:04:11.317704] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-28T17:04:11.317807] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-28T17:04:11.318516] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-28T17:04:11.318561] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-28T17:04:11.320044] [DEBUG] [LOCAL ] AEO: Trimmed 77651 records to 53563 (keeping 200 days of data) [2025-10-28T17:04:11.639598] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-28T17:04:11.639789] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-28T17:04:11.639891] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEO took 29.1s. Estimated remaining: 4h 7m 16s. Rate: 9.4 symbols/min [2025-10-28T17:04:12.275464] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:04:12.284889] [INFO ] [REMOTE ] AER: Full fetch complete (69903 records). [2025-10-28T17:04:12.285042] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-28T17:04:12.684899] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-28T17:04:12.684981] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-28T17:04:12.685634] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-28T17:04:12.685719] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-28T17:04:12.687105] [DEBUG] [LOCAL ] AER: Trimmed 69903 records to 47659 (keeping 200 days of data) [2025-10-28T17:04:12.983219] [DEBUG] [LOCAL ] AER: Primary data saved (47659 records). [2025-10-28T17:04:12.983415] [INFO ] [MAIN ] AER: Full history saved. [2025-10-28T17:04:12.985177] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 26.5s. Estimated remaining: 4h 2m 17s. Rate: 9.6 symbols/min [2025-10-28T17:04:13.594799] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.729580] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.734912] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.733879] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.735471] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-28T17:04:13.735741] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-28T17:04:13.736122] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-28T17:04:13.736192] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-28T17:04:13.736245] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-28T17:04:13.736325] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-28T17:04:13.859226] [DEBUG] [LOCAL ] AFB: Loaded 10957 existing records from primary storage. [2025-10-28T17:04:13.881861] [INFO ] [MAIN ] AFB: Loaded 10957 existing records. [2025-10-28T17:04:14.206308] [DEBUG] [LOCAL ] AESI: Loaded 49777 existing records from primary storage. [2025-10-28T17:04:14.286977] [INFO ] [MAIN ] AESI: Loaded 49777 existing records. [2025-10-28T17:04:14.280956] [DEBUG] [LOCAL ] AES: Loaded 53663 existing records from primary storage. [2025-10-28T17:04:14.375001] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:14.391303] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-28T17:04:14.380510] [INFO ] [MAIN ] AES: Loaded 53663 existing records. [2025-10-28T17:04:14.429061] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-28T17:04:14.495293] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:14.539961] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-28T17:04:14.529174] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-28T17:04:14.571556] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-28T17:04:14.785319] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:04:14.962235] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-28T17:04:14.991229] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:15.039832] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-28T17:04:15.039720] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:15.049087] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-28T17:04:14.991378] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:04:15.065152] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-28T17:04:15.064933] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-28T17:04:15.073834] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-28T17:04:15.074116] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:04:15.073918] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-28T17:04:15.093791] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-28T17:04:15.094114] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-28T17:04:15.094060] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-28T17:04:15.093922] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-28T17:04:15.215921] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-28T17:04:15.365224] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-28T17:04:15.381306] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-28T17:04:15.470836] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.5s. Estimated remaining: 3h 58m 37s. Rate: 9.7 symbols/min [2025-10-28T17:04:15.479935] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:15.485951] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-28T17:04:16.025596] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:16.090371] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:16.111768] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-28T17:04:16.172767] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:16.180909] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-28T17:04:16.195456] [DEBUG] [LOCAL ] AFG: Loaded 31571 existing records from primary storage. [2025-10-28T17:04:16.195744] [INFO ] [MAIN ] AFG: Loaded 31571 existing records. [2025-10-28T17:04:16.371416] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:16.371670] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-28T17:04:16.371732] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-28T17:04:16.372050] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-28T17:04:16.372091] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-28T17:04:16.719412] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:16.719752] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-28T17:04:16.744138] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T17:04:16.746915] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-28T17:04:17.179154] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:04:17.181866] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-28T17:04:17.358709] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:04:17.368233] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-28T17:04:18.068678] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:04:18.072134] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-28T17:04:18.087040] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:04:18.331476] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-28T17:04:18.359301] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-28T17:04:18.725059] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T17:04:19.003052] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T17:04:19.159345] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-28T17:04:19.542699] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T17:04:19.959360] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-28T17:04:20.320606] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T17:04:20.759367] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-28T17:04:21.449562] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T17:04:21.559343] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-28T17:04:21.713731] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:04:22.359348] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-28T17:04:23.164416] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-28T17:04:23.180571] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T17:04:23.959359] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-28T17:04:24.178381] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:04:24.229379] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:04:24.402320] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T17:04:24.759341] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-28T17:04:25.559325] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-28T17:04:26.316889] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:04:26.359294] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-28T17:04:26.540721] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T17:04:27.159371] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-28T17:04:27.734259] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T17:04:27.959330] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-28T17:04:28.051607] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:04:28.759324] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-28T17:04:29.522993] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T17:04:29.559292] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-28T17:04:30.359383] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-28T17:04:30.467378] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T17:04:30.935318] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T17:04:31.159361] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-28T17:04:31.646060] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T17:04:31.645046] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:04:31.959340] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-28T17:04:32.759347] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-28T17:04:33.326212] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:04:33.326906] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:04:33.559338] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-28T17:04:34.280098] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:04:34.282699] [INFO ] [REMOTE ] AFB: Full fetch complete (16279 records). [2025-10-28T17:04:34.282774] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-28T17:04:34.364540] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-28T17:04:34.643408] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-28T17:04:34.643479] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-28T17:04:34.643734] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-28T17:04:34.643793] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-28T17:04:34.644281] [DEBUG] [LOCAL ] AFB: Trimmed 16279 records to 10993 (keeping 200 days of data) [2025-10-28T17:04:34.710235] [DEBUG] [LOCAL ] AFB: Primary data saved (10993 records). [2025-10-28T17:04:34.710357] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-28T17:04:34.710438] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 21.7s. Estimated remaining: 4h 10m 35s. Rate: 9.3 symbols/min [2025-10-28T17:04:34.882821] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:34.882941] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-28T17:04:34.882977] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-28T17:04:34.883102] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-28T17:04:34.883156] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-28T17:04:34.883198] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-28T17:04:34.883231] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-28T17:04:35.164433] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-28T17:04:35.233251] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:35.650202] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:04:35.959369] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-28T17:04:36.759970] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T17:04:36.760056] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-28T17:04:37.329557] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T17:04:37.443912] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:04:37.559296] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-28T17:04:37.849487] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T17:04:38.359344] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-28T17:04:38.983911] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:04:39.159325] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-28T17:04:39.959429] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-28T17:04:40.564558] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:04:40.759376] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-28T17:04:41.321877] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:04:41.559340] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-28T17:04:42.055255] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T17:04:42.127379] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T17:04:42.359407] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-28T17:04:43.159377] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-28T17:04:43.959322] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-28T17:04:44.143511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:04:44.154472] [INFO ] [REMOTE ] AESI: Full fetch complete (71929 records). [2025-10-28T17:04:44.154859] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-28T17:04:44.285833] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T17:04:44.301294] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:04:44.330421] [INFO ] [REMOTE ] AFG: Full fetch complete (46800 records). [2025-10-28T17:04:44.361209] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-28T17:04:44.763805] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-28T17:04:44.889775] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-28T17:04:44.906639] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-28T17:04:44.907463] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-28T17:04:44.907544] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-28T17:04:44.965774] [DEBUG] [LOCAL ] AESI: Trimmed 71929 records to 49737 (keeping 200 days of data) [2025-10-28T17:04:45.058436] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-28T17:04:45.083574] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-28T17:04:45.084377] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-28T17:04:45.084671] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-28T17:04:45.112577] [DEBUG] [LOCAL ] AFG: Trimmed 46800 records to 31464 (keeping 200 days of data) [2025-10-28T17:04:45.468738] [DEBUG] [LOCAL ] AFG: Primary data saved (31464 records). [2025-10-28T17:04:45.475323] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-28T17:04:45.480712] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AFG took 30.0s. Estimated remaining: 4h 14m 21s. Rate: 9.1 symbols/min [2025-10-28T17:04:45.570096] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-28T17:04:45.559785] [DEBUG] [LOCAL ] AESI: Primary data saved (49737 records). [2025-10-28T17:04:45.571434] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-28T17:04:45.577892] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AESI took 32.6s. Estimated remaining: 4h 8m 33s. Rate: 9.3 symbols/min [2025-10-28T17:04:45.777039] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:45.832816] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:45.834804] [DEBUG] [LOCAL ] AFGC: Loaded 2550 existing records from primary storage. [2025-10-28T17:04:45.834906] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-28T17:04:45.834975] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-28T17:04:45.835116] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-28T17:04:45.835318] [INFO ] [MAIN ] AFGC: Loaded 2550 existing records. [2025-10-28T17:04:45.835183] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-28T17:04:45.835429] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-28T17:04:45.866290] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-28T17:04:45.990818] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T17:04:46.150720] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:46.183019] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-28T17:04:46.184871] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-28T17:04:46.236518] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-28T17:04:46.269522] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-28T17:04:46.375169] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-28T17:04:46.546931] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:46.845608] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:46.876744] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-28T17:04:46.916909] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T17:04:47.159372] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-28T17:04:47.634331] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:04:47.959394] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-28T17:04:48.344429] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T17:04:48.759356] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-28T17:04:49.061324] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T17:04:49.559395] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-28T17:04:49.853927] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T17:04:50.359402] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-28T17:04:50.805387] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:04:50.806690] [INFO ] [REMOTE ] AFGB: Full fetch complete (3390 records). [2025-10-28T17:04:50.806781] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-28T17:04:51.160403] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-28T17:04:51.160193] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-28T17:04:51.160768] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-28T17:04:51.161795] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-28T17:04:51.161859] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-28T17:04:51.162206] [DEBUG] [LOCAL ] AFGB: Trimmed 3390 records to 2112 (keeping 200 days of data) [2025-10-28T17:04:51.175103] [DEBUG] [LOCAL ] AFGB: Primary data saved (2112 records). [2025-10-28T17:04:51.175172] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-28T17:04:51.175236] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AFGB took 16.5s. Estimated remaining: 4h 7m 44s. Rate: 9.4 symbols/min [2025-10-28T17:04:51.344293] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:51.349174] [DEBUG] [LOCAL ] AFGE: Loaded 2214 existing records from primary storage. [2025-10-28T17:04:51.349353] [INFO ] [MAIN ] AFGE: Loaded 2214 existing records. [2025-10-28T17:04:51.529945] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:51.530161] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-28T17:04:51.530209] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-28T17:04:51.530362] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-28T17:04:51.530405] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-28T17:04:51.894715] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:51.959307] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-28T17:04:52.387148] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T17:04:52.507722] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:04:52.759359] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-28T17:04:53.028178] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T17:04:53.559357] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-28T17:04:53.865137] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T17:04:54.359364] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-28T17:04:54.850958] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T17:04:55.159368] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-28T17:04:55.959355] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-28T17:04:56.260839] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:04:56.759326] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-28T17:04:56.805709] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T17:04:57.038984] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:04:57.559346] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-28T17:04:58.359380] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-28T17:04:58.844617] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T17:04:59.159340] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-28T17:04:59.459965] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T17:04:59.470880] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-28T17:04:59.471039] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-28T17:04:59.587777] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:04:59.880056] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-28T17:04:59.880134] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-28T17:04:59.880898] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-28T17:04:59.880964] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-28T17:04:59.882462] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 53663 (keeping 200 days of data) [2025-10-28T17:04:59.969079] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-28T17:05:00.213034] [DEBUG] [LOCAL ] AES: Primary data saved (53663 records). [2025-10-28T17:05:00.213190] [INFO ] [MAIN ] AES: Full history saved. [2025-10-28T17:05:00.213278] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AES took 47.2s. Estimated remaining: 4h 9m 50s. Rate: 9.3 symbols/min [2025-10-28T17:05:00.309316] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T17:05:00.408386] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:00.457018] [DEBUG] [LOCAL ] AFL: Loaded 53160 existing records from primary storage. [2025-10-28T17:05:00.457368] [INFO ] [MAIN ] AFL: Loaded 53160 existing records. [2025-10-28T17:05:00.648553] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:00.648825] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-28T17:05:00.648876] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-28T17:05:00.650039] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-28T17:05:00.650113] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-28T17:05:00.762007] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-28T17:05:01.044435] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:01.081556] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T17:05:01.559340] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-28T17:05:01.937576] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T17:05:02.359389] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-28T17:05:03.159393] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-28T17:05:03.450891] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T17:05:03.959349] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-28T17:05:04.163404] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T17:05:04.441287] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:05:04.759352] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-28T17:05:05.013886] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T17:05:05.559335] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-28T17:05:05.964454] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T17:05:06.359349] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-28T17:05:06.674955] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T17:05:07.159367] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-28T17:05:07.959364] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-28T17:05:08.272734] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T17:05:08.560709] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:05:08.759337] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-28T17:05:09.050778] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T17:05:09.559334] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-28T17:05:10.074071] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T17:05:10.359336] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-28T17:05:10.823234] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T17:05:10.824017] [INFO ] [REMOTE ] AFGD: Full fetch complete (2652 records). [2025-10-28T17:05:10.824086] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-28T17:05:10.824418] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:05:10.824500] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:05:10.824543] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:05:10.824582] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-28T17:05:10.824638] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-28T17:05:10.824731] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-28T17:05:10.824786] [DEBUG] [LOCAL ] AFGD: No derivative data file found to delete. [2025-10-28T17:05:10.824841] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGD took 25.2s. Estimated remaining: 4h 13m 8s. Rate: 9.2 symbols/min [2025-10-28T17:05:10.993260] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:11.054134] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-28T17:05:11.054535] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-28T17:05:11.164540] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-28T17:05:11.254930] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:11.255161] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-28T17:05:11.255210] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-28T17:05:11.255790] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-28T17:05:11.255858] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-28T17:05:11.603208] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:11.885242] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T17:05:11.959310] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-28T17:05:12.201789] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T17:05:12.759357] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-28T17:05:13.559339] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-28T17:05:13.983180] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T17:05:13.984382] [INFO ] [REMOTE ] AFGE: Full fetch complete (3270 records). [2025-10-28T17:05:13.984472] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-28T17:05:14.264578] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:05:14.366678] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-28T17:05:14.391419] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-28T17:05:14.391500] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-28T17:05:14.391617] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-28T17:05:14.391693] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-28T17:05:14.392043] [DEBUG] [LOCAL ] AFGE: Trimmed 3270 records to 2204 (keeping 200 days of data) [2025-10-28T17:05:14.406065] [DEBUG] [LOCAL ] AFGE: Primary data saved (2204 records). [2025-10-28T17:05:14.406247] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-28T17:05:14.406334] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGE took 23.2s. Estimated remaining: 4h 10m 39s. Rate: 9.2 symbols/min [2025-10-28T17:05:14.573841] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:14.619307] [DEBUG] [LOCAL ] AGCO: Loaded 41854 existing records from primary storage. [2025-10-28T17:05:14.619631] [INFO ] [MAIN ] AGCO: Loaded 41854 existing records. [2025-10-28T17:05:14.802503] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:14.802751] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-28T17:05:14.802801] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-28T17:05:14.803292] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-28T17:05:14.803349] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-28T17:05:15.154484] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:15.159301] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-28T17:05:15.959307] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-28T17:05:16.056120] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:05:16.305770] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T17:05:16.346996] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:05:16.759340] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-28T17:05:17.110768] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T17:05:17.559334] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-28T17:05:17.863724] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T17:05:18.359347] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-28T17:05:19.159331] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-28T17:05:19.959310] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-28T17:05:20.040388] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T17:05:20.364382] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:05:20.400314] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:05:20.759332] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-28T17:05:21.210934] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:05:21.212299] [INFO ] [REMOTE ] AFGC: Full fetch complete (3572 records). [2025-10-28T17:05:21.212394] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-28T17:05:21.563713] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-28T17:05:21.568374] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-28T17:05:21.569220] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-28T17:05:21.569338] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-28T17:05:21.569377] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-28T17:05:21.569756] [DEBUG] [LOCAL ] AFGC: Trimmed 3572 records to 2560 (keeping 200 days of data) [2025-10-28T17:05:21.585049] [DEBUG] [LOCAL ] AFGC: Primary data saved (2560 records). [2025-10-28T17:05:21.585110] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-28T17:05:21.585178] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGC took 36.1s. Estimated remaining: 4h 11m 5s. Rate: 9.2 symbols/min [2025-10-28T17:05:21.755731] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:21.774040] [DEBUG] [LOCAL ] AGD: Loaded 19100 existing records from primary storage. [2025-10-28T17:05:21.774282] [INFO ] [MAIN ] AGD: Loaded 19100 existing records. [2025-10-28T17:05:21.949410] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:21.949630] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-28T17:05:21.949711] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-28T17:05:21.950104] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-28T17:05:21.950161] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-28T17:05:22.295227] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:22.359294] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-28T17:05:22.664769] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:05:23.159318] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-28T17:05:23.256726] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:05:23.959405] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-28T17:05:24.644276] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T17:05:24.759331] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-28T17:05:25.271186] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:05:25.292573] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:05:25.559333] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-28T17:05:26.359356] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-28T17:05:27.168833] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-28T17:05:27.174162] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:05:27.771199] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T17:05:27.959346] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-28T17:05:28.060534] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T17:05:28.652518] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:05:28.759384] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-28T17:05:29.453937] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T17:05:29.560688] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-28T17:05:30.133039] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T17:05:30.359367] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-28T17:05:31.159360] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-28T17:05:31.902237] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T17:05:31.959342] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-28T17:05:32.692671] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:05:32.759330] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-28T17:05:32.835795] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T17:05:33.559344] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-28T17:05:34.294014] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:05:34.366629] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-28T17:05:34.372089] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:05:35.159307] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-28T17:05:35.251162] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:05:35.959341] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-28T17:05:36.759414] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-28T17:05:36.843395] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:05:37.481703] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:05:37.487536] [INFO ] [REMOTE ] AGD: Full fetch complete (26512 records). [2025-10-28T17:05:37.487801] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-28T17:05:37.569607] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-28T17:05:37.906869] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-28T17:05:37.906965] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-28T17:05:37.907473] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-28T17:05:37.907541] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-28T17:05:37.908486] [DEBUG] [LOCAL ] AGD: Trimmed 26512 records to 19061 (keeping 200 days of data) [2025-10-28T17:05:38.026962] [DEBUG] [LOCAL ] AGD: Primary data saved (19061 records). [2025-10-28T17:05:38.046768] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-28T17:05:38.059412] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AGD took 16.5s. Estimated remaining: 4h 18m 40s. Rate: 9.0 symbols/min [2025-10-28T17:05:38.111992] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-28T17:05:38.277428] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:38.277681] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-10-28T17:05:38.277736] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-10-28T17:05:38.277850] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-28T17:05:38.277908] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-28T17:05:38.277949] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-28T17:05:38.277981] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-28T17:05:38.364634] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-28T17:05:38.650069] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:39.159351] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-28T17:05:39.359948] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T17:05:39.542876] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:05:39.959346] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-28T17:05:40.441934] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:05:40.759353] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-28T17:05:41.215474] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:05:41.559353] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-28T17:05:42.056796] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T17:05:42.359375] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-28T17:05:43.159303] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-28T17:05:43.654090] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T17:05:43.841987] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T17:05:43.959383] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-28T17:05:44.652213] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:05:44.759326] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-28T17:05:45.406357] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T17:05:45.559336] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-28T17:05:46.207669] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:05:46.218317] [INFO ] [REMOTE ] AFL: Full fetch complete (77056 records). [2025-10-28T17:05:46.218487] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-28T17:05:46.366295] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-28T17:05:46.626738] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-28T17:05:46.626848] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-28T17:05:46.627674] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-28T17:05:46.627740] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-28T17:05:46.629225] [DEBUG] [LOCAL ] AFL: Trimmed 77056 records to 53148 (keeping 200 days of data) [2025-10-28T17:05:46.943536] [DEBUG] [LOCAL ] AFL: Primary data saved (53148 records). [2025-10-28T17:05:46.943702] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-28T17:05:46.943793] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AFL took 46.7s. Estimated remaining: 4h 20m 13s. Rate: 8.9 symbols/min [2025-10-28T17:05:47.114099] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:47.114362] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-28T17:05:47.114531] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-28T17:05:47.114844] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-28T17:05:47.115019] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-28T17:05:47.115277] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-28T17:05:47.115346] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-28T17:05:47.169742] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-28T17:05:47.514532] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T17:05:47.518540] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:47.959308] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-28T17:05:48.137852] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T17:05:48.175859] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-28T17:05:48.759328] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-28T17:05:49.495884] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:05:49.559314] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-28T17:05:50.359367] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-28T17:05:50.529247] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T17:05:50.705235] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:05:51.159342] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-28T17:05:51.959367] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-28T17:05:52.263094] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-28T17:05:52.500830] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T17:05:52.508807] [INFO ] [REMOTE ] AGCO: Full fetch complete (61424 records). [2025-10-28T17:05:52.508912] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-28T17:05:52.766188] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-28T17:05:52.895570] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-28T17:05:52.895658] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-28T17:05:52.896258] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-28T17:05:52.896300] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-28T17:05:52.897494] [DEBUG] [LOCAL ] AGCO: Trimmed 61424 records to 41768 (keeping 200 days of data) [2025-10-28T17:05:53.156852] [DEBUG] [LOCAL ] AGCO: Primary data saved (41768 records). [2025-10-28T17:05:53.157007] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-28T17:05:53.158668] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AGCO took 38.8s. Estimated remaining: 4h 19m 42s. Rate: 8.9 symbols/min [2025-10-28T17:05:53.332702] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:53.364170] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:05:53.379246] [DEBUG] [LOCAL ] AGM: Loaded 10480 existing records from primary storage. [2025-10-28T17:05:53.379429] [INFO ] [MAIN ] AGM: Loaded 10480 existing records. [2025-10-28T17:05:53.554912] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:53.555088] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-28T17:05:53.555134] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-28T17:05:53.555423] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-28T17:05:53.555513] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-28T17:05:53.566700] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-28T17:05:53.912159] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:54.359328] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-28T17:05:54.395032] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:05:55.019209] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T17:05:55.159331] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-28T17:05:55.808290] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:05:55.959366] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-28T17:05:56.759404] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-28T17:05:57.236831] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T17:05:57.368303] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-28T17:05:57.380782] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:05:57.392731] [INFO ] [REMOTE ] AG: Full fetch complete (77792 records). [2025-10-28T17:05:57.392994] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-28T17:05:57.563112] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-28T17:05:57.802982] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-28T17:05:57.803057] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-28T17:05:57.803769] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-28T17:05:57.803830] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-28T17:05:57.805179] [DEBUG] [LOCAL ] AG: Trimmed 77792 records to 53643 (keeping 200 days of data) [2025-10-28T17:05:58.115820] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-28T17:05:58.115951] [INFO ] [MAIN ] AG: Full history saved. [2025-10-28T17:05:58.116731] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AG took 47.3s. Estimated remaining: 4h 18m 18s. Rate: 9.0 symbols/min [2025-10-28T17:05:58.281851] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:58.308395] [DEBUG] [LOCAL ] AGO: Loaded 27300 existing records from primary storage. [2025-10-28T17:05:58.308638] [INFO ] [MAIN ] AGO: Loaded 27300 existing records. [2025-10-28T17:05:58.370236] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-28T17:05:58.484344] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:58.484539] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-28T17:05:58.484585] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-28T17:05:58.485021] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-28T17:05:58.485079] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-28T17:05:58.836898] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:58.869579] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:05:58.955470] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T17:05:59.159328] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-28T17:05:59.959370] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-28T17:06:00.088770] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:06:00.759343] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-28T17:06:01.173147] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T17:06:01.559366] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-28T17:06:02.167755] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T17:06:02.359314] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-28T17:06:02.844226] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T17:06:03.159318] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-28T17:06:03.921416] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:06:03.959304] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-28T17:06:04.289006] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (4.33 seconds). [2025-10-28T17:06:04.759330] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-28T17:06:04.831610] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T17:06:05.559357] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-28T17:06:06.184339] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:06:06.359354] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-28T17:06:06.547117] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T17:06:07.159351] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-28T17:06:07.888712] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:06:07.959359] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-28T17:06:08.759331] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-28T17:06:09.022961] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-28T17:06:09.034091] [INFO ] [REMOTE ] AGI: Full fetch complete (77358 records). [2025-10-28T17:06:09.034220] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-28T17:06:09.472199] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T17:06:09.504055] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-28T17:06:09.504824] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-28T17:06:09.506563] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-28T17:06:09.506961] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-28T17:06:09.516832] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:06:09.521139] [DEBUG] [LOCAL ] AGI: Trimmed 77358 records to 53421 (keeping 200 days of data) [2025-10-28T17:06:09.574691] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-28T17:06:09.840987] [DEBUG] [LOCAL ] AGI: Primary data saved (53421 records). [2025-10-28T17:06:09.841130] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-28T17:06:09.841678] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 31.8s. Estimated remaining: 4h 21m 46s. Rate: 8.8 symbols/min [2025-10-28T17:06:10.064173] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:10.096974] [DEBUG] [LOCAL ] AGRO: Loaded 32070 existing records from primary storage. [2025-10-28T17:06:10.097389] [INFO ] [MAIN ] AGRO: Loaded 32070 existing records. [2025-10-28T17:06:10.299970] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:10.301165] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:06:10.301372] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-28T17:06:10.304037] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-28T17:06:10.305088] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-28T17:06:10.305152] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-28T17:06:10.365709] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-28T17:06:10.659441] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:11.159348] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-28T17:06:11.528186] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:06:11.959341] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-28T17:06:12.198793] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:06:12.759344] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-28T17:06:12.863854] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:06:13.559347] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-28T17:06:13.839173] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:06:14.359345] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-28T17:06:15.121046] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:06:15.159301] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-28T17:06:15.348607] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:06:15.959332] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-28T17:06:16.398035] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:06:16.759346] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-28T17:06:17.028940] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T17:06:17.506798] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:06:17.559347] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-28T17:06:18.359353] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-28T17:06:18.464833] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:06:19.159325] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-28T17:06:19.964460] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-28T17:06:19.990704] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T17:06:19.995240] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T17:06:20.005036] [INFO ] [REMOTE ] AGL: Full fetch complete (76000 records). [2025-10-28T17:06:20.005183] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-28T17:06:20.402689] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-28T17:06:20.402785] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-28T17:06:20.403476] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-28T17:06:20.403518] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-28T17:06:20.404895] [DEBUG] [LOCAL ] AGL: Trimmed 76000 records to 52573 (keeping 200 days of data) [2025-10-28T17:06:20.700699] [DEBUG] [LOCAL ] AGL: Primary data saved (52573 records). [2025-10-28T17:06:20.700841] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-28T17:06:20.700939] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGL took 33.8s. Estimated remaining: 4h 24m 31s. Rate: 8.7 symbols/min [2025-10-28T17:06:20.769689] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-28T17:06:20.890451] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:20.890745] [DEBUG] [LOCAL ] AGX: No existing data file found in primary storage. [2025-10-28T17:06:20.890929] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-10-28T17:06:20.891110] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-28T17:06:20.891238] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-28T17:06:20.891376] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-28T17:06:20.891445] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-28T17:06:20.994623] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:06:21.300381] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:21.559337] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-28T17:06:21.755990] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T17:06:22.359361] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-28T17:06:22.380398] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:06:22.382960] [INFO ] [REMOTE ] AGM: Full fetch complete (13256 records). [2025-10-28T17:06:22.383038] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-28T17:06:22.756546] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-28T17:06:22.756677] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-28T17:06:22.757079] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-28T17:06:22.757129] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-28T17:06:22.758201] [DEBUG] [LOCAL ] AGM: Trimmed 13256 records to 10454 (keeping 200 days of data) [2025-10-28T17:06:22.825463] [DEBUG] [LOCAL ] AGM: Primary data saved (10454 records). [2025-10-28T17:06:22.825620] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-28T17:06:22.825748] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGM took 29.7s. Estimated remaining: 4h 21m 8s. Rate: 8.8 symbols/min [2025-10-28T17:06:22.995371] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:23.036162] [DEBUG] [LOCAL ] AHH: Loaded 39774 existing records from primary storage. [2025-10-28T17:06:23.036439] [INFO ] [MAIN ] AHH: Loaded 39774 existing records. [2025-10-28T17:06:23.164463] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-28T17:06:23.216634] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:23.216911] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-28T17:06:23.216962] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-28T17:06:23.217576] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-28T17:06:23.217635] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-28T17:06:23.539523] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:06:23.650810] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:23.959332] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-28T17:06:24.759382] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-28T17:06:24.943598] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:06:25.321534] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T17:06:25.559309] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-28T17:06:25.666636] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:06:26.359357] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-28T17:06:26.649444] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T17:06:27.159345] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-28T17:06:27.255313] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T17:06:27.959352] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-28T17:06:28.759323] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-28T17:06:28.911705] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T17:06:29.559308] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-28T17:06:29.718033] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:06:29.933394] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-10-28T17:06:30.359371] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-28T17:06:30.775324] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:06:30.781134] [INFO ] [REMOTE ] AGO: Full fetch complete (39623 records). [2025-10-28T17:06:30.781221] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-28T17:06:31.157376] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-28T17:06:31.157454] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-28T17:06:31.157933] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-28T17:06:31.158007] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-28T17:06:31.158875] [DEBUG] [LOCAL ] AGO: Trimmed 39623 records to 27199 (keeping 200 days of data) [2025-10-28T17:06:31.159341] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-28T17:06:31.342294] [DEBUG] [LOCAL ] AGO: Primary data saved (27199 records). [2025-10-28T17:06:31.342520] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-28T17:06:31.342618] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGO took 33.2s. Estimated remaining: 4h 22m 11s. Rate: 8.8 symbols/min [2025-10-28T17:06:31.513816] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:31.514009] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-28T17:06:31.514075] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-28T17:06:31.514237] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-28T17:06:31.514282] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-28T17:06:31.514334] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-28T17:06:31.514365] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-28T17:06:31.675444] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T17:06:31.889097] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:31.959292] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-28T17:06:32.142375] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:06:32.142627] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-28T17:06:32.142746] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:06:32.142796] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-28T17:06:32.142830] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:06:32.142893] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-28T17:06:32.142954] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-28T17:06:32.142990] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-28T17:06:32.143053] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-28T17:06:32.143099] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 0.8s. Estimated remaining: 4h 18m 5s. Rate: 8.9 symbols/min [2025-10-28T17:06:32.310348] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:32.310480] [DEBUG] [LOCAL ] AHR: No existing data file found in primary storage. [2025-10-28T17:06:32.310516] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-10-28T17:06:32.310618] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-28T17:06:32.310692] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-28T17:06:32.310753] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-28T17:06:32.310786] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-28T17:06:32.568003] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:06:32.690241] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:32.759314] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-28T17:06:33.559415] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-28T17:06:33.709598] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:06:34.359350] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-28T17:06:34.575683] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:06:34.581942] [INFO ] [REMOTE ] AGRO: Full fetch complete (48616 records). [2025-10-28T17:06:34.582059] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-28T17:06:34.956588] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-28T17:06:34.956689] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-28T17:06:34.957221] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-28T17:06:34.957295] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-28T17:06:34.958278] [DEBUG] [LOCAL ] AGRO: Trimmed 48616 records to 32033 (keeping 200 days of data) [2025-10-28T17:06:35.134306] [DEBUG] [LOCAL ] AGRO: Primary data saved (32033 records). [2025-10-28T17:06:35.134441] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-28T17:06:35.134522] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AGRO took 25.3s. Estimated remaining: 4h 15m 33s. Rate: 9.0 symbols/min [2025-10-28T17:06:35.167858] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-28T17:06:35.305676] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:35.314409] [DEBUG] [LOCAL ] AHT: Loaded 6347 existing records from primary storage. [2025-10-28T17:06:35.314615] [INFO ] [MAIN ] AHT: Loaded 6347 existing records. [2025-10-28T17:06:35.487258] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:35.487480] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-28T17:06:35.487529] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-28T17:06:35.487799] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-28T17:06:35.487861] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-28T17:06:35.840206] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:35.893172] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:06:35.959319] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-28T17:06:36.404007] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:06:36.759351] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-28T17:06:37.027763] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T17:06:37.559343] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-28T17:06:37.807223] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T17:06:38.359331] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-28T17:06:38.567558] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T17:06:39.159344] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-28T17:06:39.491350] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:06:39.959405] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-28T17:06:40.457797] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T17:06:40.696467] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T17:06:40.759370] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-28T17:06:41.366202] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T17:06:41.559539] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-28T17:06:42.047518] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T17:06:42.359365] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-28T17:06:43.159344] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-28T17:06:43.934481] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:06:43.959297] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-28T17:06:44.341888] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:06:44.759355] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-28T17:06:45.038347] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:06:45.559389] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-28T17:06:45.952587] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:06:46.359354] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-28T17:06:46.806452] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:06:47.159405] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-28T17:06:47.675424] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:06:47.959397] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-28T17:06:48.193719] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T17:06:48.199562] [INFO ] [REMOTE ] AGX: Full fetch complete (48559 records). [2025-10-28T17:06:48.199721] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-28T17:06:48.591294] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-28T17:06:48.591389] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-28T17:06:48.591930] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-28T17:06:48.591994] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-28T17:06:48.593005] [DEBUG] [LOCAL ] AGX: Trimmed 48559 records to 32137 (keeping 200 days of data) [2025-10-28T17:06:48.768613] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-28T17:06:48.795207] [DEBUG] [LOCAL ] AGX: Primary data saved (32137 records). [2025-10-28T17:06:48.795390] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-28T17:06:48.795476] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGX took 28.1s. Estimated remaining: 4h 19m 56s. Rate: 8.9 symbols/min [2025-10-28T17:06:48.965324] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:49.014791] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-28T17:06:49.015148] [INFO ] [MAIN ] AI: Loaded 53764 existing records. [2025-10-28T17:06:49.202345] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:49.202686] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-28T17:06:49.202761] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-28T17:06:49.203660] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-28T17:06:49.203723] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-28T17:06:49.333940] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:06:49.564518] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-28T17:06:49.603495] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:50.034242] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:06:50.043247] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:06:50.359347] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-28T17:06:50.845275] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:06:51.159428] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-28T17:06:51.959387] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-28T17:06:52.759395] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-28T17:06:52.790088] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T17:06:52.819472] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T17:06:53.559363] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-28T17:06:53.876772] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T17:06:53.998074] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T17:06:54.359364] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-28T17:06:54.889859] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:06:55.159336] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-28T17:06:55.627801] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T17:06:55.959394] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-28T17:06:56.759390] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-28T17:06:56.942629] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:06:57.559358] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-28T17:06:58.359349] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-28T17:06:58.737557] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-28T17:06:58.800350] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:06:59.159352] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-28T17:06:59.696010] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:06:59.959366] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-28T17:07:00.693321] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T17:07:00.695288] [INFO ] [REMOTE ] AHT: Full fetch complete (9057 records). [2025-10-28T17:07:00.695356] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-28T17:07:00.764559] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-28T17:07:01.062179] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-28T17:07:01.062328] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-28T17:07:01.062573] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-28T17:07:01.062615] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-28T17:07:01.063076] [DEBUG] [LOCAL ] AHT: Trimmed 9057 records to 6372 (keeping 200 days of data) [2025-10-28T17:07:01.098527] [DEBUG] [LOCAL ] AHT: Primary data saved (6372 records). [2025-10-28T17:07:01.098687] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-28T17:07:01.098787] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AHT took 26.0s. Estimated remaining: 4h 23m 19s. Rate: 8.8 symbols/min [2025-10-28T17:07:01.273375] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:01.319801] [DEBUG] [LOCAL ] AIG: Loaded 53450 existing records from primary storage. [2025-10-28T17:07:01.320123] [INFO ] [MAIN ] AIG: Loaded 53450 existing records. [2025-10-28T17:07:01.503406] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:01.503832] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-28T17:07:01.503996] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-28T17:07:01.513576] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-28T17:07:01.518778] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-28T17:07:01.568535] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-28T17:07:01.610713] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-28T17:07:01.935033] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:01.956432] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:07:01.964161] [INFO ] [REMOTE ] AHH: Full fetch complete (59322 records). [2025-10-28T17:07:01.964303] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-28T17:07:02.346997] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-28T17:07:02.347100] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-28T17:07:02.347790] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-28T17:07:02.347852] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-28T17:07:02.349080] [DEBUG] [LOCAL ] AHH: Trimmed 59322 records to 39694 (keeping 200 days of data) [2025-10-28T17:07:02.397861] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-28T17:07:02.575462] [DEBUG] [LOCAL ] AHH: Primary data saved (39694 records). [2025-10-28T17:07:02.575623] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-28T17:07:02.576513] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHH took 39.8s. Estimated remaining: 4h 19m 52s. Rate: 8.9 symbols/min [2025-10-28T17:07:02.764510] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:02.764790] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-28T17:07:02.764841] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-28T17:07:02.764948] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-28T17:07:02.764989] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-28T17:07:02.765030] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-28T17:07:02.765063] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-28T17:07:03.157422] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:03.166874] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-28T17:07:03.174124] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T17:07:03.185721] [INFO ] [REMOTE ] AHR: Full fetch complete (70469 records). [2025-10-28T17:07:03.185960] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-28T17:07:03.186943] [FATAL] [VALIDATOR ] AHR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:07:03.187034] [FATAL] [MAIN ] AHR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:07:03.187079] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:07:03.187123] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-28T17:07:03.187190] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-28T17:07:03.187228] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-28T17:07:03.187323] [DEBUG] [LOCAL ] AHR: No derivative data file found to delete. [2025-10-28T17:07:03.187433] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AHR took 31.0s. Estimated remaining: 4h 16m 0s. Rate: 9.0 symbols/min [2025-10-28T17:07:03.376783] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:03.400940] [DEBUG] [LOCAL ] AIN: Loaded 24135 existing records from primary storage. [2025-10-28T17:07:03.401264] [INFO ] [MAIN ] AIN: Loaded 24135 existing records. [2025-10-28T17:07:03.651824] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:03.652116] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-28T17:07:03.652169] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-28T17:07:03.652905] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-28T17:07:03.652967] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-28T17:07:03.969088] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-28T17:07:04.093344] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:04.232029] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:07:04.232359] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-28T17:07:04.232455] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:07:04.232504] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-28T17:07:04.232565] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:07:04.232638] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-28T17:07:04.232743] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-28T17:07:04.232784] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-28T17:07:04.232824] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-28T17:07:04.232873] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AII took 1.7s. Estimated remaining: 4h 12m 31s. Rate: 9.1 symbols/min [2025-10-28T17:07:04.412381] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:04.468018] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T17:07:04.488145] [DEBUG] [LOCAL ] AIO: Loaded 12787 existing records from primary storage. [2025-10-28T17:07:04.488508] [INFO ] [MAIN ] AIO: Loaded 12787 existing records. [2025-10-28T17:07:04.644728] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T17:07:04.721630] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:04.721884] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-28T17:07:04.721934] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-28T17:07:04.722256] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-28T17:07:04.722297] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-28T17:07:04.764518] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-28T17:07:05.083941] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:05.559347] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-28T17:07:06.338911] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T17:07:06.359313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-28T17:07:06.580933] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-28T17:07:06.813831] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T17:07:07.159349] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-28T17:07:07.959351] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-28T17:07:08.549494] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T17:07:08.709874] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T17:07:08.759339] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-28T17:07:09.559348] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-28T17:07:10.154702] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T17:07:10.259791] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:07:10.359305] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-28T17:07:11.159356] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-28T17:07:11.667696] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T17:07:11.712459] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:07:11.959327] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-28T17:07:12.543602] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:07:12.759338] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-28T17:07:13.559339] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-28T17:07:14.033762] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T17:07:14.139790] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T17:07:14.359328] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-28T17:07:15.159392] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-28T17:07:15.656033] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:07:15.959342] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-28T17:07:16.570155] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T17:07:16.759338] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-28T17:07:16.857895] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T17:07:17.479575] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T17:07:17.559327] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-28T17:07:18.359326] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-28T17:07:18.960821] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:07:19.159380] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-28T17:07:19.657503] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-28T17:07:19.959346] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-28T17:07:20.498521] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:07:20.759344] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-28T17:07:21.101795] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:07:21.277512] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T17:07:21.559341] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-28T17:07:22.361930] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-28T17:07:22.362788] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T17:07:22.366926] [INFO ] [REMOTE ] AIO: Full fetch complete (20030 records). [2025-10-28T17:07:22.367019] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-28T17:07:22.733604] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-28T17:07:22.733706] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-28T17:07:22.734001] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-28T17:07:22.734060] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-28T17:07:22.734608] [DEBUG] [LOCAL ] AIO: Trimmed 20030 records to 12744 (keeping 200 days of data) [2025-10-28T17:07:22.809346] [DEBUG] [LOCAL ] AIO: Primary data saved (12744 records). [2025-10-28T17:07:22.809475] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-28T17:07:22.809550] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AIO took 18.6s. Estimated remaining: 4h 19m 29s. Rate: 8.9 symbols/min [2025-10-28T17:07:22.984572] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:23.015203] [DEBUG] [LOCAL ] AIR: Loaded 28344 existing records from primary storage. [2025-10-28T17:07:23.015555] [INFO ] [MAIN ] AIR: Loaded 28344 existing records. [2025-10-28T17:07:23.164532] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-28T17:07:23.229843] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:23.230171] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-28T17:07:23.230226] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-28T17:07:23.230830] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-28T17:07:23.230920] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-28T17:07:23.630758] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:23.959351] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-28T17:07:24.446884] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:07:24.572212] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-28T17:07:24.759400] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-28T17:07:25.535063] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:07:25.559303] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-28T17:07:25.692021] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T17:07:26.338397] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:07:26.359347] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-28T17:07:27.159322] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-28T17:07:27.832349] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T17:07:27.959381] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-28T17:07:28.434238] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-28T17:07:28.759303] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-28T17:07:28.785455] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T17:07:29.559413] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-28T17:07:30.330724] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:07:30.359293] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-28T17:07:30.605102] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T17:07:31.159421] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-28T17:07:31.491065] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:07:31.959349] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-28T17:07:32.067146] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:07:32.759376] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-28T17:07:33.559351] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-28T17:07:33.987605] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T17:07:33.998882] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-28T17:07:33.999042] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-28T17:07:34.361552] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-28T17:07:34.468684] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T17:07:34.477969] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-28T17:07:34.479349] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-28T17:07:34.481155] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-28T17:07:34.481312] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-28T17:07:34.537328] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T17:07:34.534073] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53764 (keeping 200 days of data) [2025-10-28T17:07:34.983612] [DEBUG] [LOCAL ] AI: Primary data saved (53764 records). [2025-10-28T17:07:34.983815] [INFO ] [MAIN ] AI: Full history saved. [2025-10-28T17:07:34.983926] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AI took 46.2s. Estimated remaining: 4h 22m 31s. Rate: 8.8 symbols/min [2025-10-28T17:07:35.173758] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-28T17:07:35.212831] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:35.246597] [DEBUG] [LOCAL ] AIT: Loaded 26203 existing records from primary storage. [2025-10-28T17:07:35.246903] [INFO ] [MAIN ] AIT: Loaded 26203 existing records. [2025-10-28T17:07:35.430241] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:35.430507] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-28T17:07:35.430774] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-28T17:07:35.431252] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-28T17:07:35.431356] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-28T17:07:35.572533] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:07:35.822026] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:35.858763] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:07:35.869890] [INFO ] [REMOTE ] AIG: Full fetch complete (77557 records). [2025-10-28T17:07:35.870067] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-28T17:07:35.964720] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-28T17:07:36.269397] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-28T17:07:36.269490] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-28T17:07:36.270248] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-28T17:07:36.270319] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-28T17:07:36.271839] [DEBUG] [LOCAL ] AIG: Trimmed 77557 records to 53447 (keeping 200 days of data) [2025-10-28T17:07:36.588812] [DEBUG] [LOCAL ] AIG: Primary data saved (53447 records). [2025-10-28T17:07:36.588945] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-28T17:07:36.589025] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIG took 35.5s. Estimated remaining: 4h 19m 24s. Rate: 8.9 symbols/min [2025-10-28T17:07:36.765292] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:36.762415] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-28T17:07:36.782751] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T17:07:36.822227] [DEBUG] [LOCAL ] AIV: Loaded 41782 existing records from primary storage. [2025-10-28T17:07:36.822930] [INFO ] [MAIN ] AIV: Loaded 41782 existing records. [2025-10-28T17:07:37.018480] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:37.018810] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-28T17:07:37.018881] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-28T17:07:37.019626] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-28T17:07:37.019732] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-28T17:07:37.418992] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:37.559399] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-28T17:07:37.783940] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:07:38.290914] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T17:07:38.359358] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-28T17:07:39.159298] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-28T17:07:39.247434] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:07:39.959377] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-28T17:07:40.205949] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:07:40.759313] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-28T17:07:40.821878] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T17:07:41.559359] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-28T17:07:41.925984] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T17:07:42.359339] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-28T17:07:42.568410] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T17:07:42.573428] [INFO ] [REMOTE ] AIN: Full fetch complete (33791 records). [2025-10-28T17:07:42.573536] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-28T17:07:42.951199] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-28T17:07:42.951284] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-28T17:07:42.951723] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-28T17:07:42.951801] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-28T17:07:42.952697] [DEBUG] [LOCAL ] AIN: Trimmed 33791 records to 24147 (keeping 200 days of data) [2025-10-28T17:07:43.095057] [DEBUG] [LOCAL ] AIN: Primary data saved (24147 records). [2025-10-28T17:07:43.095206] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-28T17:07:43.095304] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIN took 39.9s. Estimated remaining: 4h 19m 9s. Rate: 8.9 symbols/min [2025-10-28T17:07:43.165527] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-28T17:07:43.279101] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:43.308028] [DEBUG] [LOCAL ] AIZ: Loaded 28903 existing records from primary storage. [2025-10-28T17:07:43.308296] [INFO ] [MAIN ] AIZ: Loaded 28903 existing records. [2025-10-28T17:07:43.493280] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:43.493574] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-28T17:07:43.493726] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-28T17:07:43.494283] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-28T17:07:43.494351] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-28T17:07:43.587596] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:07:43.885277] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:43.959336] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-28T17:07:44.227403] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:07:44.759337] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-28T17:07:44.988004] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:07:45.559328] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-28T17:07:45.659303] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T17:07:46.359387] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-28T17:07:46.635263] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:07:47.159320] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-28T17:07:47.418374] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:07:47.959389] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-28T17:07:48.224122] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:07:48.759359] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-28T17:07:49.028370] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T17:07:49.035268] [INFO ] [REMOTE ] AIR: Full fetch complete (40148 records). [2025-10-28T17:07:49.035364] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-28T17:07:49.416945] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-28T17:07:49.417026] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-28T17:07:49.417485] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-28T17:07:49.417548] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-28T17:07:49.418503] [DEBUG] [LOCAL ] AIR: Trimmed 40148 records to 28331 (keeping 200 days of data) [2025-10-28T17:07:49.568163] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-28T17:07:49.583484] [DEBUG] [LOCAL ] AIR: Primary data saved (28331 records). [2025-10-28T17:07:49.583703] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-28T17:07:49.583810] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIR took 26.8s. Estimated remaining: 4h 18m 53s. Rate: 8.9 symbols/min [2025-10-28T17:07:49.755897] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:49.778567] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:07:49.780855] [DEBUG] [LOCAL ] AIZN: Loaded 3678 existing records from primary storage. [2025-10-28T17:07:49.788327] [INFO ] [MAIN ] AIZN: Loaded 3678 existing records. [2025-10-28T17:07:49.962934] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:49.963130] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-28T17:07:49.963177] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-28T17:07:49.963328] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-28T17:07:49.963368] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-28T17:07:50.319463] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:50.359308] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-28T17:07:50.775685] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:07:50.873929] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:07:51.159341] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-28T17:07:51.959319] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-28T17:07:52.195025] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:07:52.759345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-28T17:07:52.912378] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T17:07:53.277368] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T17:07:53.559347] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-28T17:07:54.359330] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-28T17:07:54.686942] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:07:54.787935] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T17:07:55.159353] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-28T17:07:55.555201] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T17:07:55.959328] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-28T17:07:56.261544] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:07:56.759367] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-28T17:07:57.559295] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-28T17:07:57.818622] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T17:07:58.359377] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-28T17:07:58.666997] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T17:07:59.159325] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-28T17:07:59.492074] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T17:07:59.514523] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T17:07:59.959348] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-28T17:08:00.759345] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-28T17:08:00.933460] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T17:08:01.559334] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-28T17:08:01.894835] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:08:02.002213] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T17:08:02.359351] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-28T17:08:03.159345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-28T17:08:03.282963] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:08:03.513959] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T17:08:03.959355] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-28T17:08:04.759333] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-28T17:08:05.227177] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T17:08:05.559323] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-28T17:08:05.733071] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:08:05.957291] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T17:08:06.359338] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-28T17:08:07.159351] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-28T17:08:07.540531] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T17:08:07.549982] [INFO ] [REMOTE ] AIV: Full fetch complete (60330 records). [2025-10-28T17:08:07.550098] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-28T17:08:07.660188] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T17:08:07.677355] [INFO ] [REMOTE ] AIZN: Full fetch complete (5649 records). [2025-10-28T17:08:07.687697] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-28T17:08:07.966399] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-28T17:08:08.347004] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-28T17:08:08.372006] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-28T17:08:08.371687] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-28T17:08:08.372121] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-28T17:08:08.372878] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-28T17:08:08.373016] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-28T17:08:08.373221] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-28T17:08:08.373508] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-28T17:08:08.374430] [DEBUG] [LOCAL ] AIZN: Trimmed 5649 records to 3629 (keeping 200 days of data) [2025-10-28T17:08:08.384301] [DEBUG] [LOCAL ] AIV: Trimmed 60330 records to 41743 (keeping 200 days of data) [2025-10-28T17:08:08.398685] [DEBUG] [LOCAL ] AIZN: Primary data saved (3629 records). [2025-10-28T17:08:08.399177] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-28T17:08:08.399331] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIZN took 18.8s. Estimated remaining: 4h 25m 21s. Rate: 8.7 symbols/min [2025-10-28T17:08:08.768030] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:08.768098] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-28T17:08:08.857309] [DEBUG] [LOCAL ] AIV: Primary data saved (41743 records). [2025-10-28T17:08:08.857447] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-28T17:08:08.857539] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIV took 32.3s. Estimated remaining: 4h 21m 45s. Rate: 8.8 symbols/min [2025-10-28T17:08:08.984303] [DEBUG] [LOCAL ] AJG: Loaded 46202 existing records from primary storage. [2025-10-28T17:08:08.984876] [INFO ] [MAIN ] AJG: Loaded 46202 existing records. [2025-10-28T17:08:09.142824] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:09.148475] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-28T17:08:09.160856] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-28T17:08:09.172446] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-28T17:08:09.172565] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-28T17:08:09.172731] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-28T17:08:09.173203] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-28T17:08:09.382045] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:09.393675] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-28T17:08:09.399432] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-28T17:08:09.406411] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:08:09.452624] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-28T17:08:09.453152] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-28T17:08:09.563416] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-28T17:08:09.839329] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:10.011803] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:08:10.072526] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:10.359335] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-28T17:08:10.802418] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:08:11.031129] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:08:11.159303] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-28T17:08:11.959340] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-28T17:08:12.229073] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T17:08:12.236260] [INFO ] [REMOTE ] AIT: Full fetch complete (38930 records). [2025-10-28T17:08:12.236356] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-28T17:08:12.351190] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T17:08:12.625977] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-28T17:08:12.626061] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-28T17:08:12.626492] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-28T17:08:12.626534] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-28T17:08:12.627526] [DEBUG] [LOCAL ] AIT: Trimmed 38930 records to 26110 (keeping 200 days of data) [2025-10-28T17:08:12.764056] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-28T17:08:12.790899] [DEBUG] [LOCAL ] AIT: Primary data saved (26110 records). [2025-10-28T17:08:12.791061] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-28T17:08:12.791197] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIT took 37.8s. Estimated remaining: 4h 20m 5s. Rate: 8.8 symbols/min [2025-10-28T17:08:12.958558] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:13.000419] [DEBUG] [LOCAL ] AKR: Loaded 45897 existing records from primary storage. [2025-10-28T17:08:13.000779] [INFO ] [MAIN ] AKR: Loaded 45897 existing records. [2025-10-28T17:08:13.175443] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:13.175693] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-28T17:08:13.175751] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-28T17:08:13.176235] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-28T17:08:13.176277] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-28T17:08:13.542461] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:13.559340] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-28T17:08:13.619512] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T17:08:14.359335] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-28T17:08:14.909739] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:08:15.139198] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:08:15.144351] [INFO ] [REMOTE ] AIZ: Full fetch complete (42612 records). [2025-10-28T17:08:15.144470] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-28T17:08:15.165412] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-28T17:08:15.535531] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-28T17:08:15.535610] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-28T17:08:15.536139] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-28T17:08:15.536217] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-28T17:08:15.537168] [DEBUG] [LOCAL ] AIZ: Trimmed 42612 records to 28784 (keeping 200 days of data) [2025-10-28T17:08:15.627630] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T17:08:15.716011] [DEBUG] [LOCAL ] AIZ: Primary data saved (28784 records). [2025-10-28T17:08:15.716137] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-28T17:08:15.716228] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AIZ took 32.6s. Estimated remaining: 4h 17m 57s. Rate: 8.9 symbols/min [2025-10-28T17:08:15.883682] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:15.929743] [DEBUG] [LOCAL ] AL: Loaded 44745 existing records from primary storage. [2025-10-28T17:08:15.930028] [INFO ] [MAIN ] AL: Loaded 44745 existing records. [2025-10-28T17:08:15.964507] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-28T17:08:16.121051] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:16.121269] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-28T17:08:16.121318] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-28T17:08:16.121983] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-28T17:08:16.122042] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-28T17:08:16.479382] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:16.759332] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-28T17:08:17.362262] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:08:17.559346] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-28T17:08:17.861182] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T17:08:18.359342] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-28T17:08:18.592946] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:08:19.159331] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-28T17:08:19.959411] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-28T17:08:20.278289] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:08:20.355286] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-28T17:08:20.759344] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-28T17:08:20.899374] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:08:21.052500] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T17:08:21.559320] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-28T17:08:22.359341] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-28T17:08:22.662366] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:08:23.159350] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-28T17:08:23.801936] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:08:23.959369] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-28T17:08:24.240068] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:08:24.759386] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-28T17:08:25.163602] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:08:25.559332] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-28T17:08:26.002800] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T17:08:26.359392] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-28T17:08:27.082520] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:08:27.159397] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-28T17:08:27.662891] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:08:27.959362] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-28T17:08:28.759331] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-28T17:08:28.862758] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:08:28.864291] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T17:08:29.559336] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-28T17:08:30.024795] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T17:08:30.359352] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-28T17:08:30.695165] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:08:30.877308] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:08:31.159358] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-28T17:08:31.551093] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T17:08:31.959342] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-28T17:08:32.759352] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-28T17:08:33.109912] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:08:33.559312] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-28T17:08:33.816905] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T17:08:34.241293] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:08:34.359291] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-28T17:08:35.159332] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-28T17:08:35.652372] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:08:35.661864] [INFO ] [REMOTE ] AKR: Full fetch complete (65455 records). [2025-10-28T17:08:35.661972] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-28T17:08:35.963086] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-28T17:08:36.057674] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-28T17:08:36.057753] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-28T17:08:36.058370] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-28T17:08:36.058411] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-28T17:08:36.059551] [DEBUG] [LOCAL ] AKR: Trimmed 65455 records to 45895 (keeping 200 days of data) [2025-10-28T17:08:36.323764] [DEBUG] [LOCAL ] AKR: Primary data saved (45895 records). [2025-10-28T17:08:36.323873] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-28T17:08:36.323944] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AKR took 23.5s. Estimated remaining: 4h 24m 59s. Rate: 8.6 symbols/min [2025-10-28T17:08:36.499988] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:36.551335] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:08:36.577499] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-28T17:08:36.577859] [INFO ] [MAIN ] ALB: Loaded 53362 existing records. [2025-10-28T17:08:36.754273] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:36.754523] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-28T17:08:36.754569] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-28T17:08:36.755574] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-28T17:08:36.755634] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-28T17:08:36.766869] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-28T17:08:37.116498] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:37.143596] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:08:37.186333] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:08:37.559391] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-28T17:08:38.359365] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-28T17:08:38.855846] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:08:39.159337] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-28T17:08:39.773571] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:08:39.959342] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-28T17:08:40.720494] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:08:40.759301] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-28T17:08:41.304472] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:08:41.559353] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-28T17:08:41.885462] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-28T17:08:42.359595] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-28T17:08:42.359527] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T17:08:42.886721] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T17:08:42.888256] [INFO ] [REMOTE ] AKA: Full fetch complete (2838 records). [2025-10-28T17:08:42.888328] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-28T17:08:43.066731] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T17:08:43.066936] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:08:43.067005] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:08:43.067095] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-28T17:08:43.067168] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-28T17:08:43.067207] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-28T17:08:43.067278] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-28T17:08:43.067353] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKA took 34.2s. Estimated remaining: 4h 24m 46s. Rate: 8.7 symbols/min [2025-10-28T17:08:43.164484] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-28T17:08:43.253048] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:43.253220] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-28T17:08:43.253258] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-28T17:08:43.253398] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-28T17:08:43.253464] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-28T17:08:43.253519] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-28T17:08:43.253553] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-28T17:08:43.623783] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:43.959349] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-28T17:08:44.602520] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T17:08:44.759317] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-28T17:08:45.368287] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:08:45.559351] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-28T17:08:46.359380] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-28T17:08:46.812089] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:08:46.828983] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-28T17:08:47.159341] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-28T17:08:47.601594] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:08:47.959388] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-28T17:08:48.543975] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:08:48.759385] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-28T17:08:49.468698] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T17:08:49.559322] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-28T17:08:50.115584] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:08:50.359345] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-28T17:08:50.751905] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T17:08:51.159341] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-28T17:08:51.770128] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T17:08:51.959388] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-28T17:08:52.560640] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:08:52.572339] [INFO ] [REMOTE ] AL: Full fetch complete (63852 records). [2025-10-28T17:08:52.572483] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-28T17:08:52.764679] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-28T17:08:52.959043] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-28T17:08:52.959115] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-28T17:08:52.959741] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-28T17:08:52.959802] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-28T17:08:52.960974] [DEBUG] [LOCAL ] AL: Trimmed 63852 records to 44696 (keeping 200 days of data) [2025-10-28T17:08:53.226404] [DEBUG] [LOCAL ] AL: Primary data saved (44696 records). [2025-10-28T17:08:53.226541] [INFO ] [MAIN ] AL: Full history saved. [2025-10-28T17:08:53.227703] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AL took 37.5s. Estimated remaining: 4h 26m 17s. Rate: 8.6 symbols/min [2025-10-28T17:08:53.396761] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:53.431475] [DEBUG] [LOCAL ] ALE: Loaded 31792 existing records from primary storage. [2025-10-28T17:08:53.431796] [INFO ] [MAIN ] ALE: Loaded 31792 existing records. [2025-10-28T17:08:53.578897] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-28T17:08:53.633624] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:53.634849] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-28T17:08:53.635238] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-28T17:08:53.636499] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:08:53.645382] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-28T17:08:53.645904] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-28T17:08:53.998277] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:54.221782] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T17:08:54.359342] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-28T17:08:54.828227] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T17:08:55.159362] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-28T17:08:55.959359] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-28T17:08:56.543953] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:08:56.553415] [INFO ] [REMOTE ] AJG: Full fetch complete (68703 records). [2025-10-28T17:08:56.553556] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-28T17:08:56.783563] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-28T17:08:56.886664] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-28T17:08:57.051511] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-28T17:08:57.052231] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-28T17:08:57.053008] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-28T17:08:57.053135] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-28T17:08:57.054714] [DEBUG] [LOCAL ] AJG: Trimmed 68703 records to 46201 (keeping 200 days of data) [2025-10-28T17:08:57.315828] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:08:57.384592] [DEBUG] [LOCAL ] AJG: Primary data saved (46201 records). [2025-10-28T17:08:57.384763] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-28T17:08:57.385871] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AJG took 49.0s. Estimated remaining: 4h 24m 46s. Rate: 8.6 symbols/min [2025-10-28T17:08:57.559392] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-28T17:08:57.915155] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:08:58.359446] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-28T17:08:59.007733] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:08:59.036364] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:08:59.159331] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-28T17:08:59.959408] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-28T17:09:00.595546] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T17:09:00.759313] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-28T17:09:01.559312] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-28T17:09:01.699155] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T17:09:02.359369] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-28T17:09:02.401143] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:09:02.607387] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T17:09:02.618552] [INFO ] [REMOTE ] ALC: Full fetch complete (73587 records). [2025-10-28T17:09:02.618790] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-28T17:09:02.620143] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:09:02.620240] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:09:02.620288] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:09:02.620332] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-28T17:09:02.620400] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-28T17:09:02.620439] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-28T17:09:02.620546] [DEBUG] [LOCAL ] ALC: No derivative data file found to delete. [2025-10-28T17:09:02.620621] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALC took 19.6s. Estimated remaining: 4h 23m 49s. Rate: 8.7 symbols/min [2025-10-28T17:09:03.159383] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-28T17:09:03.989407] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:09:04.001096] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-28T17:09:04.032998] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:09:04.759405] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-28T17:09:05.837545] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:09:05.843261] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-28T17:09:06.254561] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-28T17:09:06.265189] [INFO ] [REMOTE ] ALB: Full fetch complete (77120 records). [2025-10-28T17:09:06.265346] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-28T17:09:06.671361] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-28T17:09:06.671518] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-28T17:09:06.672507] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-28T17:09:06.672607] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-28T17:09:06.688079] [DEBUG] [LOCAL ] ALB: Trimmed 77120 records to 53356 (keeping 200 days of data) [2025-10-28T17:09:06.688983] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T17:09:06.695533] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-28T17:09:07.028680] [DEBUG] [LOCAL ] ALB: Primary data saved (53356 records). [2025-10-28T17:09:07.028822] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-28T17:09:07.028902] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALB took 30.7s. Estimated remaining: 4h 22m 29s. Rate: 8.7 symbols/min [2025-10-28T17:09:07.890818] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T17:09:07.898333] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-28T17:09:09.052049] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:09:09.060135] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-28T17:09:10.257960] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T17:09:10.265760] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-28T17:09:11.596264] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:09:11.603549] [INFO ] [REMOTE ] ALE: Full fetch complete (44310 records). [2025-10-28T17:09:11.603634] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-28T17:09:11.973811] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-28T17:09:11.973879] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-28T17:09:11.974392] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-28T17:09:11.974452] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-28T17:09:11.975398] [DEBUG] [LOCAL ] ALE: Trimmed 44310 records to 31763 (keeping 200 days of data) [2025-10-28T17:09:12.158672] [DEBUG] [LOCAL ] ALE: Primary data saved (31763 records). [2025-10-28T17:09:12.158812] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-28T17:09:12.159775] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALE took 18.9s. Estimated remaining: 4h 21m 32s. Rate: 8.7 symbols/min [2025-10-28T17:09:12.750604] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.802824] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-28T17:09:12.862357] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.835074] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-28T17:09:12.882496] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-28T17:09:12.882607] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-28T17:09:12.882322] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.883621] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-28T17:09:12.885261] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.885481] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-28T17:09:13.034458] [DEBUG] [LOCAL ] ALG: Loaded 9543 existing records from primary storage. [2025-10-28T17:09:13.053101] [INFO ] [MAIN ] ALG: Loaded 9543 existing records. [2025-10-28T17:09:13.295266] [DEBUG] [LOCAL ] ALEX: Loaded 30369 existing records from primary storage. [2025-10-28T17:09:13.295681] [INFO ] [MAIN ] ALEX: Loaded 30369 existing records. [2025-10-28T17:09:13.359359] [DEBUG] [LOCAL ] ALIT: Loaded 52760 existing records from primary storage. [2025-10-28T17:09:13.388941] [INFO ] [MAIN ] ALIT: Loaded 52760 existing records. [2025-10-28T17:09:13.724994] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:13.777501] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-28T17:09:13.802770] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-28T17:09:13.830235] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:13.841403] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-28T17:09:13.841772] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-28T17:09:13.847794] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-28T17:09:14.149562] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:09:14.205941] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:14.212539] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:14.229801] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-28T17:09:14.229870] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-28T17:09:14.229525] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-28T17:09:14.230035] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:09:14.230124] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-28T17:09:14.230307] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-28T17:09:14.230512] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:09:14.247213] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-28T17:09:14.247141] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-28T17:09:14.247040] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-28T17:09:14.252830] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-28T17:09:14.261848] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-28T17:09:14.277535] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-28T17:09:14.290302] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-28T17:09:14.295826] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-28T17:09:14.381526] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-28T17:09:14.392236] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.2s. Estimated remaining: 4h 19m 15s. Rate: 8.8 symbols/min [2025-10-28T17:09:15.140314] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:15.372200] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:15.418585] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-28T17:09:15.469583] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:15.480758] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-28T17:09:15.563133] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:15.563478] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-28T17:09:15.581886] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-28T17:09:15.582184] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-28T17:09:15.758525] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:15.758745] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-28T17:09:15.758796] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-28T17:09:15.759549] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-28T17:09:15.759607] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-28T17:09:16.101793] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:16.102059] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-28T17:09:16.306126] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:09:16.309135] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-28T17:09:16.622335] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T17:09:16.628150] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-28T17:09:16.799020] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:09:16.801828] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-28T17:09:17.340530] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:09:17.351495] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-28T17:09:17.384855] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:09:17.391109] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-28T17:09:17.459128] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T17:09:17.559312] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-28T17:09:18.223853] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T17:09:18.359353] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-28T17:09:18.863984] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:09:18.996519] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T17:09:19.159324] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-28T17:09:19.629371] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-28T17:09:19.846440] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:09:19.959348] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-28T17:09:20.268800] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:09:20.512034] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:09:20.759341] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-28T17:09:21.559353] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-28T17:09:22.122414] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:09:22.347151] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T17:09:22.359296] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-28T17:09:23.159342] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-28T17:09:23.519821] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:09:23.672269] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:09:23.959354] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-28T17:09:24.759310] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-28T17:09:24.954528] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T17:09:25.218772] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T17:09:25.559374] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-28T17:09:26.074109] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T17:09:26.359332] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-28T17:09:26.939173] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:09:27.159341] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-28T17:09:27.959309] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-28T17:09:28.548554] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T17:09:28.759324] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-28T17:09:29.236161] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:09:29.317108] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T17:09:29.319197] [INFO ] [REMOTE ] ALG: Full fetch complete (15054 records). [2025-10-28T17:09:29.319271] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-28T17:09:29.565816] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-28T17:09:29.689691] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-28T17:09:29.689771] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-28T17:09:29.690022] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-28T17:09:29.690059] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-28T17:09:29.690516] [DEBUG] [LOCAL ] ALG: Trimmed 15054 records to 9482 (keeping 200 days of data) [2025-10-28T17:09:29.748735] [DEBUG] [LOCAL ] ALG: Primary data saved (9482 records). [2025-10-28T17:09:29.748857] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-28T17:09:29.748946] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 17.6s. Estimated remaining: 4h 23m 6s. Rate: 8.7 symbols/min [2025-10-28T17:09:29.916502] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:29.916680] [DEBUG] [LOCAL ] ALL: No existing data file found in primary storage. [2025-10-28T17:09:29.916732] [WARN ] [MAIN ] ALL: No existing data found, performing full refresh instead. [2025-10-28T17:09:29.916843] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-28T17:09:29.916899] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-28T17:09:29.916940] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-28T17:09:29.916972] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-28T17:09:30.265388] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:30.359345] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-28T17:09:30.493061] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:09:31.159340] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-28T17:09:31.729480] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:09:31.959355] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-28T17:09:32.536800] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:09:32.759315] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-28T17:09:33.374315] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:09:33.559325] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-28T17:09:34.285544] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:09:34.359302] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-28T17:09:34.938220] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:09:35.159331] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-28T17:09:35.710298] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:09:35.959322] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-28T17:09:36.515459] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:09:36.759362] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-28T17:09:37.559392] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-28T17:09:37.750378] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-28T17:09:38.150501] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T17:09:38.359378] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-28T17:09:38.628109] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:09:39.159339] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-28T17:09:39.788249] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:09:39.959329] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-28T17:09:40.206588] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:09:40.213164] [INFO ] [REMOTE ] ALEX: Full fetch complete (44529 records). [2025-10-28T17:09:40.213249] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-28T17:09:40.613017] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-28T17:09:40.613097] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-28T17:09:40.613613] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-28T17:09:40.613684] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-28T17:09:40.614719] [DEBUG] [LOCAL ] ALEX: Trimmed 44529 records to 30222 (keeping 200 days of data) [2025-10-28T17:09:40.769704] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-28T17:09:40.807843] [DEBUG] [LOCAL ] ALEX: Primary data saved (30222 records). [2025-10-28T17:09:40.807964] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-28T17:09:40.808046] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALEX took 28.6s. Estimated remaining: 4h 24m 53s. Rate: 8.6 symbols/min [2025-10-28T17:09:40.987880] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:40.988036] [DEBUG] [LOCAL ] ALLE: No existing data file found in primary storage. [2025-10-28T17:09:40.988075] [WARN ] [MAIN ] ALLE: No existing data found, performing full refresh instead. [2025-10-28T17:09:40.988188] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-28T17:09:40.988232] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-28T17:09:40.988276] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-28T17:09:40.988310] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-28T17:09:41.377489] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:41.453546] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:09:41.559342] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-28T17:09:42.135367] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T17:09:42.359305] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-28T17:09:42.930584] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T17:09:43.159387] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-28T17:09:43.757635] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:09:43.959290] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-28T17:09:44.426958] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:09:44.759340] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-28T17:09:45.329414] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:09:45.559322] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-28T17:09:46.051143] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:09:46.359367] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-28T17:09:46.949798] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:09:47.159315] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-28T17:09:47.457040] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:09:47.959372] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-28T17:09:48.264260] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T17:09:48.759347] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-28T17:09:49.113898] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T17:09:49.559338] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-28T17:09:50.142096] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:09:50.359336] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-28T17:09:50.740306] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:09:51.159333] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-28T17:09:51.604242] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T17:09:51.615317] [INFO ] [REMOTE ] ALIT: Full fetch complete (76616 records). [2025-10-28T17:09:51.615451] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-28T17:09:51.964465] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-28T17:09:52.010672] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-28T17:09:52.010758] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-28T17:09:52.011473] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-28T17:09:52.011515] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-28T17:09:52.012876] [DEBUG] [LOCAL ] ALIT: Trimmed 76616 records to 52756 (keeping 200 days of data) [2025-10-28T17:09:52.326413] [DEBUG] [LOCAL ] ALIT: Primary data saved (52756 records). [2025-10-28T17:09:52.326542] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-28T17:09:52.327109] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALIT took 40.1s. Estimated remaining: 4h 26m 50s. Rate: 8.6 symbols/min [2025-10-28T17:09:52.501462] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:52.501693] [DEBUG] [LOCAL ] ALLY: No existing data file found in primary storage. [2025-10-28T17:09:52.501857] [WARN ] [MAIN ] ALLY: No existing data found, performing full refresh instead. [2025-10-28T17:09:52.502008] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-28T17:09:52.502074] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-28T17:09:52.502200] [DEBUG] [LOCAL ] ALLY: No primary data file found to delete. [2025-10-28T17:09:52.502338] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-28T17:09:52.761687] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-28T17:09:52.829558] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T17:09:52.923866] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:53.533178] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:09:53.559308] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-28T17:09:54.240022] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:09:54.249637] [INFO ] [REMOTE ] ALL: Full fetch complete (72262 records). [2025-10-28T17:09:54.249815] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-28T17:09:54.364533] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-28T17:09:54.629472] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-28T17:09:54.629536] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-28T17:09:54.630242] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-28T17:09:54.630305] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-28T17:09:54.631765] [DEBUG] [LOCAL ] ALL: Trimmed 72262 records to 49407 (keeping 200 days of data) [2025-10-28T17:09:54.891473] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:09:54.969959] [DEBUG] [LOCAL ] ALL: Primary data saved (49407 records). [2025-10-28T17:09:54.970087] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-28T17:09:54.970157] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALL took 25.2s. Estimated remaining: 4h 24m 46s. Rate: 8.6 symbols/min [2025-10-28T17:09:55.140983] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:55.160010] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-28T17:09:55.177156] [DEBUG] [LOCAL ] ALSN: Loaded 43052 existing records from primary storage. [2025-10-28T17:09:55.177450] [INFO ] [MAIN ] ALSN: Loaded 43052 existing records. [2025-10-28T17:09:55.350975] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:55.351169] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-28T17:09:55.351215] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-28T17:09:55.351914] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-28T17:09:55.351970] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-28T17:09:55.692710] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:55.959310] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-28T17:09:56.018312] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T17:09:56.452416] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:09:56.759323] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-28T17:09:57.559321] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-28T17:09:57.765983] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T17:09:57.943724] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:09:58.359356] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-28T17:09:59.159345] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-28T17:09:59.618253] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-28T17:09:59.651174] [INFO ] [REMOTE ] ALK: Full fetch complete (77042 records). [2025-10-28T17:09:59.652752] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:09:59.651862] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-28T17:09:59.962787] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-28T17:10:00.058992] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-28T17:10:00.059183] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-28T17:10:00.059948] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-28T17:10:00.060009] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-28T17:10:00.061380] [DEBUG] [LOCAL ] ALK: Trimmed 77042 records to 53087 (keeping 200 days of data) [2025-10-28T17:10:00.368474] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:10:00.398029] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-28T17:10:00.398145] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-28T17:10:00.398235] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALK took 45.9s. Estimated remaining: 4h 23m 58s. Rate: 8.6 symbols/min [2025-10-28T17:10:00.571049] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:00.592498] [DEBUG] [LOCAL ] ALTG: Loaded 22760 existing records from primary storage. [2025-10-28T17:10:00.592768] [INFO ] [MAIN ] ALTG: Loaded 22760 existing records. [2025-10-28T17:10:00.776930] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:00.771225] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-28T17:10:00.777999] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-28T17:10:00.778059] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-28T17:10:00.778487] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-28T17:10:00.778546] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-28T17:10:01.132675] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:01.438346] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:10:01.446468] [INFO ] [REMOTE ] ALLE: Full fetch complete (64541 records). [2025-10-28T17:10:01.446625] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-28T17:10:01.447391] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:10:01.447497] [FATAL] [MAIN ] ALLE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:10:01.447563] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:10:01.447661] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-28T17:10:01.447760] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-28T17:10:01.447826] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-10-28T17:10:01.447876] [DEBUG] [LOCAL ] ALLE: No derivative data file found to delete. [2025-10-28T17:10:01.447941] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 20.6s. Estimated remaining: 4h 21m 17s. Rate: 8.7 symbols/min [2025-10-28T17:10:01.564467] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-28T17:10:01.633922] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:01.644265] [DEBUG] [LOCAL ] ALUR: Loaded 9135 existing records from primary storage. [2025-10-28T17:10:01.644513] [INFO ] [MAIN ] ALUR: Loaded 9135 existing records. [2025-10-28T17:10:01.865903] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:01.866169] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-28T17:10:01.866245] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-28T17:10:01.866508] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-28T17:10:01.866566] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-28T17:10:02.236721] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:02.276033] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:10:02.359334] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-28T17:10:03.159314] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-28T17:10:03.226588] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T17:10:03.540860] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:10:03.959358] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-28T17:10:04.280843] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T17:10:04.759356] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-28T17:10:05.298961] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:10:05.443806] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:10:05.559340] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-28T17:10:06.359334] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-28T17:10:06.980202] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T17:10:07.159326] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-28T17:10:07.372528] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:10:07.959328] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-28T17:10:08.312352] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:10:08.759346] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-28T17:10:08.872881] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:10:09.559330] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-28T17:10:10.030068] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:10:10.359307] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-28T17:10:10.427538] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T17:10:11.159346] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-28T17:10:11.468630] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:10:11.959337] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-28T17:10:12.541181] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:10:12.736047] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:10:12.759334] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-28T17:10:13.559332] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-28T17:10:14.036627] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:10:14.359335] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-28T17:10:14.696586] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T17:10:14.894815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T17:10:15.159332] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-28T17:10:15.959304] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-28T17:10:16.052224] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T17:10:16.759337] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-28T17:10:17.559340] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-28T17:10:17.840670] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-28T17:10:17.927678] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:10:18.359398] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-28T17:10:18.614843] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:10:19.159332] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-28T17:10:19.718256] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:10:19.959337] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-28T17:10:20.444452] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:10:20.759342] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-28T17:10:21.546489] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:10:21.556520] [INFO ] [REMOTE ] ALSN: Full fetch complete (62826 records). [2025-10-28T17:10:21.556728] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-28T17:10:21.564692] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-28T17:10:21.753917] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T17:10:22.188119] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-28T17:10:22.188215] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-28T17:10:22.188905] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-28T17:10:22.188973] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-28T17:10:22.190520] [DEBUG] [LOCAL ] ALSN: Trimmed 62826 records to 42985 (keeping 200 days of data) [2025-10-28T17:10:22.294096] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T17:10:22.386581] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-28T17:10:22.481830] [DEBUG] [LOCAL ] ALSN: Primary data saved (42985 records). [2025-10-28T17:10:22.481973] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-28T17:10:22.482055] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALSN took 27.5s. Estimated remaining: 4h 27m 16s. Rate: 8.5 symbols/min [2025-10-28T17:10:22.669294] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:22.708037] [DEBUG] [LOCAL ] ALV: Loaded 42134 existing records from primary storage. [2025-10-28T17:10:22.708319] [INFO ] [MAIN ] ALV: Loaded 42134 existing records. [2025-10-28T17:10:22.889863] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:22.890126] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-28T17:10:22.890190] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-28T17:10:22.891044] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-28T17:10:22.891106] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-28T17:10:23.164613] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-28T17:10:23.263693] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:23.872042] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:10:23.951627] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T17:10:23.965731] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-28T17:10:24.487407] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:10:24.759376] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-28T17:10:25.559352] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-28T17:10:26.365135] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-28T17:10:26.378347] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T17:10:26.835854] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:10:27.159341] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-28T17:10:27.459401] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:10:27.734291] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:10:27.959352] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-28T17:10:28.556338] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T17:10:28.559234] [INFO ] [REMOTE ] ALUR: Full fetch complete (18202 records). [2025-10-28T17:10:28.559320] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-28T17:10:28.759346] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-28T17:10:28.935787] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-28T17:10:28.935861] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-28T17:10:28.936140] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-28T17:10:28.936178] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-28T17:10:28.936743] [DEBUG] [LOCAL ] ALUR: Trimmed 18202 records to 9120 (keeping 200 days of data) [2025-10-28T17:10:28.985219] [DEBUG] [LOCAL ] ALUR: Primary data saved (9120 records). [2025-10-28T17:10:28.985340] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-28T17:10:28.985414] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALUR took 27.5s. Estimated remaining: 4h 26m 56s. Rate: 8.5 symbols/min [2025-10-28T17:10:29.152178] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:29.152338] [DEBUG] [LOCAL ] ALX: No existing data file found in primary storage. [2025-10-28T17:10:29.152373] [WARN ] [MAIN ] ALX: No existing data found, performing full refresh instead. [2025-10-28T17:10:29.152482] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-28T17:10:29.152522] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-28T17:10:29.152561] [DEBUG] [LOCAL ] ALX: No primary data file found to delete. [2025-10-28T17:10:29.152592] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-28T17:10:29.501159] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:29.559393] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-28T17:10:30.251714] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:10:30.359308] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-28T17:10:30.900376] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T17:10:31.159331] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-28T17:10:31.959322] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-28T17:10:32.082021] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T17:10:32.092927] [INFO ] [REMOTE ] ALLY: Full fetch complete (77243 records). [2025-10-28T17:10:32.093076] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-28T17:10:32.384244] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:10:32.423133] [INFO ] [REMOTE ] ALTG: Full fetch complete (33293 records). [2025-10-28T17:10:32.428976] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-28T17:10:32.517437] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T17:10:32.634405] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-28T17:10:32.634800] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-28T17:10:32.635588] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-28T17:10:32.635702] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-28T17:10:32.694539] [DEBUG] [LOCAL ] ALLY: Trimmed 77243 records to 53200 (keeping 200 days of data) [2025-10-28T17:10:32.811403] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-28T17:10:33.042270] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-28T17:10:33.042425] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-28T17:10:33.043135] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-28T17:10:33.043230] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-28T17:10:33.129761] [DEBUG] [LOCAL ] ALTG: Trimmed 33293 records to 22694 (keeping 200 days of data) [2025-10-28T17:10:33.271546] [DEBUG] [LOCAL ] ALTG: Primary data saved (22694 records). [2025-10-28T17:10:33.280194] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-28T17:10:33.287310] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALTG took 32.9s. Estimated remaining: 4h 25m 39s. Rate: 8.6 symbols/min [2025-10-28T17:10:33.370086] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T17:10:33.536616] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:33.542313] [DEBUG] [LOCAL ] ALLY: Primary data saved (53200 records). [2025-10-28T17:10:33.542403] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-28T17:10:33.542467] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALLY took 41.2s. Estimated remaining: 4h 22m 44s. Rate: 8.7 symbols/min [2025-10-28T17:10:33.564398] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-28T17:10:33.730690] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:33.754376] [DEBUG] [LOCAL ] AM: Loaded 51802 existing records from primary storage. [2025-10-28T17:10:33.754759] [INFO ] [MAIN ] AM: Loaded 51802 existing records. [2025-10-28T17:10:33.896785] [DEBUG] [LOCAL ] AMBC: Loaded 35502 existing records from primary storage. [2025-10-28T17:10:33.934483] [INFO ] [MAIN ] AMBC: Loaded 35502 existing records. [2025-10-28T17:10:33.996765] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:34.034570] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-28T17:10:34.040386] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-28T17:10:34.056236] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-28T17:10:34.066464] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-28T17:10:34.257975] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:34.278876] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-28T17:10:34.306679] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-28T17:10:34.316379] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-28T17:10:34.366928] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-28T17:10:34.340798] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-28T17:10:34.679964] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:34.804792] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T17:10:34.881312] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:35.049144] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:10:35.159310] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-28T17:10:35.959350] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-28T17:10:36.517525] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:10:36.759318] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-28T17:10:36.918883] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:10:37.559331] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-28T17:10:38.285816] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:10:38.359330] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-28T17:10:38.449431] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:10:39.159319] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-28T17:10:39.938749] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T17:10:39.959297] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-28T17:10:40.765963] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-28T17:10:40.770672] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T17:10:41.123464] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:10:41.559302] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-28T17:10:41.728719] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-28T17:10:42.359337] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-28T17:10:42.711548] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:10:42.883848] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T17:10:43.159373] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-28T17:10:43.959406] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-28T17:10:44.472873] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:10:44.660062] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:10:44.759344] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-28T17:10:45.559353] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-28T17:10:45.873191] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T17:10:46.359333] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-28T17:10:46.838532] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:10:46.988479] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T17:10:47.159334] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-28T17:10:47.959346] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-28T17:10:48.466475] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:10:48.759326] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-28T17:10:49.312419] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:10:49.559319] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-28T17:10:49.960716] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T17:10:50.101087] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T17:10:50.359391] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-28T17:10:50.905034] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:10:51.159338] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-28T17:10:51.959315] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-28T17:10:52.150435] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T17:10:52.759328] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-28T17:10:53.295554] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T17:10:53.559351] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-28T17:10:53.885315] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T17:10:54.359352] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-28T17:10:55.159320] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-28T17:10:55.226827] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T17:10:55.685744] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:10:55.694454] [INFO ] [REMOTE ] ALV: Full fetch complete (62441 records). [2025-10-28T17:10:55.694562] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-28T17:10:55.964528] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-28T17:10:56.077714] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-28T17:10:56.077806] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-28T17:10:56.078442] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-28T17:10:56.078483] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-28T17:10:56.079783] [DEBUG] [LOCAL ] ALV: Trimmed 62441 records to 42070 (keeping 200 days of data) [2025-10-28T17:10:56.323691] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:10:56.378296] [DEBUG] [LOCAL ] ALV: Primary data saved (42070 records). [2025-10-28T17:10:56.378429] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-28T17:10:56.378524] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALV took 33.9s. Estimated remaining: 4h 29m 10s. Rate: 8.4 symbols/min [2025-10-28T17:10:56.546305] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:56.583686] [DEBUG] [LOCAL ] AMBP: Loaded 44283 existing records from primary storage. [2025-10-28T17:10:56.583976] [INFO ] [MAIN ] AMBP: Loaded 44283 existing records. [2025-10-28T17:10:56.779016] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-28T17:10:56.784948] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:56.785950] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-28T17:10:56.786022] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-28T17:10:56.786857] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-28T17:10:56.786914] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-28T17:10:57.153078] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:57.448770] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T17:10:57.559301] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-28T17:10:57.912237] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T17:10:58.359328] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-28T17:10:58.848165] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:10:59.114207] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:10:59.117102] [INFO ] [REMOTE ] ALX: Full fetch complete (8441 records). [2025-10-28T17:10:59.117176] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-28T17:10:59.164456] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-28T17:10:59.510568] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-28T17:10:59.510679] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-28T17:10:59.510934] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-28T17:10:59.510980] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-28T17:10:59.511408] [DEBUG] [LOCAL ] ALX: Trimmed 8441 records to 7568 (keeping 200 days of data) [2025-10-28T17:10:59.558020] [DEBUG] [LOCAL ] ALX: Primary data saved (7568 records). [2025-10-28T17:10:59.558161] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-28T17:10:59.558231] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. ALX took 30.6s. Estimated remaining: 4h 27m 27s. Rate: 8.5 symbols/min [2025-10-28T17:10:59.725256] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:59.725436] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-28T17:10:59.725473] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-28T17:10:59.725580] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-28T17:10:59.725621] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-28T17:10:59.725697] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-28T17:10:59.725743] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-28T17:10:59.964475] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-28T17:11:00.108686] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:00.350849] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T17:11:00.759392] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-28T17:11:01.320435] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:11:01.559367] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-28T17:11:02.364007] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-28T17:11:02.369573] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T17:11:03.159304] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-28T17:11:03.236558] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T17:11:03.243677] [INFO ] [REMOTE ] AMBC: Full fetch complete (51824 records). [2025-10-28T17:11:03.243770] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-28T17:11:03.372685] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:11:03.420808] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-28T17:11:03.426048] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:11:03.441204] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-28T17:11:03.480058] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:11:03.500505] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-28T17:11:03.506159] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-28T17:11:03.511843] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-28T17:11:03.511933] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-28T17:11:03.527832] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. AMBQ took 4.0s. Estimated remaining: 4h 26m 5s. Rate: 8.5 symbols/min [2025-10-28T17:11:03.779219] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-28T17:11:03.794065] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-28T17:11:03.796748] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:03.797328] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-28T17:11:03.797435] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-28T17:11:03.798983] [DEBUG] [LOCAL ] AMBC: Trimmed 51824 records to 35400 (keeping 200 days of data) [2025-10-28T17:11:03.963538] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-28T17:11:04.020708] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-28T17:11:04.024959] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-28T17:11:04.094122] [DEBUG] [LOCAL ] AMBC: Primary data saved (35400 records). [2025-10-28T17:11:04.108806] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-28T17:11:04.133885] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBC took 30.6s. Estimated remaining: 4h 23m 25s. Rate: 8.6 symbols/min [2025-10-28T17:11:04.295925] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:04.351793] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-28T17:11:04.359778] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-28T17:11:04.382183] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-28T17:11:04.382107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T17:11:04.382328] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-28T17:11:04.448544] [INFO ] [REMOTE ] AM: Full fetch complete (75276 records). [2025-10-28T17:11:04.470731] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-28T17:11:04.470619] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:04.490390] [FATAL] [VALIDATOR ] AM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:11:04.505674] [FATAL] [MAIN ] AM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:11:04.522166] [WARN ] [MAIN ] AM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:11:04.539683] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-28T17:11:04.550720] [DEBUG] [LOCAL ] AM: No primary data file found to delete. [2025-10-28T17:11:04.561171] [INFO ] [LOCAL ] AM: Starting deletion of derivative data. [2025-10-28T17:11:04.599473] [DEBUG] [LOCAL ] AM: Deleted derivative data file. [2025-10-28T17:11:04.616444] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AM took 31.3s. Estimated remaining: 4h 20m 45s. Rate: 8.7 symbols/min [2025-10-28T17:11:04.974753] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:05.007114] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:05.026319] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-28T17:11:05.029198] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-28T17:11:05.029858] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-28T17:11:05.217816] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:05.247964] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-28T17:11:05.250659] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-28T17:11:05.252420] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T17:11:05.252538] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-28T17:11:05.261054] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-28T17:11:05.381131] [DEBUG] [LOCAL ] AME: Loaded 48327 existing records from primary storage. [2025-10-28T17:11:05.392068] [INFO ] [MAIN ] AME: Loaded 48327 existing records. [2025-10-28T17:11:05.583179] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-28T17:11:05.780448] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:05.796014] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-28T17:11:05.801198] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-28T17:11:05.827612] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-28T17:11:05.857825] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-28T17:11:05.857770] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:06.204366] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:06.359317] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-28T17:11:06.878142] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:11:07.038222] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-28T17:11:07.159334] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-28T17:11:07.539153] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:11:07.959354] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-28T17:11:08.371738] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:11:08.759366] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-28T17:11:09.559423] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-28T17:11:09.934158] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-28T17:11:10.114996] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:11:10.359344] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-28T17:11:10.869359] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:11:11.159336] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-28T17:11:11.817154] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:11:11.959352] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-28T17:11:12.308516] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:11:12.759346] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-28T17:11:13.434187] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:11:13.559317] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-28T17:11:14.275487] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T17:11:14.359295] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-28T17:11:14.816906] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:11:15.159335] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-28T17:11:15.906771] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T17:11:15.959299] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-28T17:11:16.757027] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T17:11:16.767136] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-28T17:11:17.330445] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:11:17.559355] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-28T17:11:18.359333] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-28T17:11:19.159294] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-28T17:11:19.461464] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-28T17:11:19.675467] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-28T17:11:19.789706] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T17:11:19.959333] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-28T17:11:20.435498] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:11:20.759347] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-28T17:11:21.559334] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-28T17:11:22.113563] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-28T17:11:22.359316] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-28T17:11:22.415607] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T17:11:22.893205] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T17:11:23.159317] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-28T17:11:23.959358] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-28T17:11:24.515809] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-28T17:11:24.542995] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:11:24.759318] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-28T17:11:25.435584] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T17:11:25.559315] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-28T17:11:26.186479] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:11:26.359338] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-28T17:11:26.979030] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:11:27.159354] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-28T17:11:27.959408] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-28T17:11:28.351530] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-28T17:11:28.704268] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T17:11:28.759306] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-28T17:11:29.128352] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T17:11:29.559363] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-28T17:11:30.359317] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-28T17:11:30.400358] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T17:11:30.965816] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T17:11:30.975354] [INFO ] [REMOTE ] AME: Full fetch complete (70263 records). [2025-10-28T17:11:30.975493] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-28T17:11:31.166512] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-28T17:11:31.359276] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-28T17:11:31.359348] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-28T17:11:31.360018] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-28T17:11:31.360081] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-28T17:11:31.361315] [DEBUG] [LOCAL ] AME: Trimmed 70263 records to 48323 (keeping 200 days of data) [2025-10-28T17:11:31.652948] [DEBUG] [LOCAL ] AME: Primary data saved (48323 records). [2025-10-28T17:11:31.653088] [INFO ] [MAIN ] AME: Full history saved. [2025-10-28T17:11:31.653169] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AME took 27.0s. Estimated remaining: 4h 28m 29s. Rate: 8.5 symbols/min [2025-10-28T17:11:31.821447] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:31.842290] [DEBUG] [LOCAL ] AMG: Loaded 19768 existing records from primary storage. [2025-10-28T17:11:31.842502] [INFO ] [MAIN ] AMG: Loaded 19768 existing records. [2025-10-28T17:11:31.964476] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-28T17:11:32.018543] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:32.018723] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-28T17:11:32.018777] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-28T17:11:32.019073] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-28T17:11:32.019131] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-28T17:11:32.371676] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:32.445540] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T17:11:32.759308] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-28T17:11:33.198796] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T17:11:33.209602] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-28T17:11:33.209791] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-28T17:11:33.568818] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-28T17:11:33.641716] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-28T17:11:33.642615] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T17:11:33.642803] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-28T17:11:33.651849] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-28T17:11:33.652232] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-28T17:11:33.652724] [INFO ] [REMOTE ] AMBP: Full fetch complete (64941 records). [2025-10-28T17:11:33.653040] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-28T17:11:33.665562] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-28T17:11:33.830889] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:11:34.298624] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-28T17:11:34.301036] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-28T17:11:34.303583] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-28T17:11:34.303687] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-28T17:11:34.324237] [DEBUG] [LOCAL ] AMBP: Trimmed 64941 records to 44285 (keeping 200 days of data) [2025-10-28T17:11:34.409157] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-28T17:11:34.488023] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-28T17:11:34.491904] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-28T17:11:34.496367] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMCR took 30.4s. Estimated remaining: 4h 26m 43s. Rate: 8.5 symbols/min [2025-10-28T17:11:34.817890] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:34.831059] [DEBUG] [LOCAL ] AMBP: Primary data saved (44285 records). [2025-10-28T17:11:34.831289] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-28T17:11:34.831377] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMBP took 38.5s. Estimated remaining: 4h 24m 2s. Rate: 8.6 symbols/min [2025-10-28T17:11:35.001541] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:35.039016] [DEBUG] [LOCAL ] AMH: Loaded 51793 existing records from primary storage. [2025-10-28T17:11:35.039425] [INFO ] [MAIN ] AMH: Loaded 51793 existing records. [2025-10-28T17:11:35.263195] [DEBUG] [LOCAL ] AMN: Loaded 41409 existing records from primary storage. [2025-10-28T17:11:35.261907] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:35.263467] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-28T17:11:35.263823] [INFO ] [MAIN ] AMN: Loaded 41409 existing records. [2025-10-28T17:11:35.263735] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-28T17:11:35.297933] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-28T17:11:35.298033] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-28T17:11:35.549387] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:35.595541] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-28T17:11:35.628011] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-28T17:11:35.621407] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:11:35.654018] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-28T17:11:35.676156] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-28T17:11:35.676234] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-28T17:11:35.984721] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:35.995373] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-28T17:11:36.240079] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:36.271676] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-28T17:11:36.759337] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-28T17:11:36.829351] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:11:37.432371] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T17:11:37.559340] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-28T17:11:38.359390] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-28T17:11:38.658573] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:11:38.689114] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:11:39.159320] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-28T17:11:39.631418] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T17:11:39.959328] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-28T17:11:40.759323] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-28T17:11:41.443591] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:11:41.486036] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-28T17:11:41.496716] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-28T17:11:41.496849] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-28T17:11:41.564522] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-28T17:11:41.922098] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:11:41.921172] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-28T17:11:41.922341] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-28T17:11:41.928741] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-28T17:11:41.929168] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-28T17:11:41.930832] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-28T17:11:42.228034] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-28T17:11:42.228173] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-28T17:11:42.228252] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AMC took 38.7s. Estimated remaining: 4h 24m 5s. Rate: 8.6 symbols/min [2025-10-28T17:11:42.365624] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-28T17:11:42.396623] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:42.425089] [DEBUG] [LOCAL ] AMP: Loaded 31375 existing records from primary storage. [2025-10-28T17:11:42.425339] [INFO ] [MAIN ] AMP: Loaded 31375 existing records. [2025-10-28T17:11:42.598263] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:42.598440] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-28T17:11:42.598484] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-28T17:11:42.599090] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-28T17:11:42.599146] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-28T17:11:42.955982] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:42.998446] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:11:43.159343] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-28T17:11:43.317384] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:11:43.959327] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-28T17:11:44.362493] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:11:44.759386] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-28T17:11:45.084516] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:11:45.541476] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:11:45.559307] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-28T17:11:46.334190] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T17:11:46.359303] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-28T17:11:47.159383] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-28T17:11:47.403682] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:11:47.959395] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-28T17:11:48.182510] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:11:48.759338] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-28T17:11:49.484524] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:11:49.559379] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-28T17:11:49.946286] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:11:50.359559] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-28T17:11:50.945422] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T17:11:51.029750] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:11:51.159293] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-28T17:11:51.959344] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-28T17:11:52.327681] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:11:52.759303] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-28T17:11:52.773784] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T17:11:53.559334] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-28T17:11:53.890757] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:11:54.359391] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-28T17:11:54.649010] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:11:55.159344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-28T17:11:55.432237] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:11:55.959322] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-28T17:11:56.294430] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T17:11:56.759346] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-28T17:11:57.320849] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T17:11:57.325223] [INFO ] [REMOTE ] AMG: Full fetch complete (29473 records). [2025-10-28T17:11:57.325323] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-28T17:11:57.567316] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-28T17:11:57.687064] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-28T17:11:57.687130] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-28T17:11:57.687507] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-28T17:11:57.687567] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-28T17:11:57.688241] [DEBUG] [LOCAL ] AMG: Trimmed 29473 records to 19679 (keeping 200 days of data) [2025-10-28T17:11:57.808069] [DEBUG] [LOCAL ] AMG: Primary data saved (19679 records). [2025-10-28T17:11:57.808272] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-28T17:11:57.808386] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AMG took 26.2s. Estimated remaining: 4h 27m 10s. Rate: 8.5 symbols/min [2025-10-28T17:11:57.977956] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:57.978178] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-10-28T17:11:57.978251] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-10-28T17:11:57.978426] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-28T17:11:57.978506] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-28T17:11:57.978594] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-28T17:11:57.978671] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-28T17:11:58.102987] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:11:58.364096] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-28T17:11:58.364044] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:59.012257] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:11:59.159318] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-28T17:11:59.529924] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:11:59.959360] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-28T17:12:00.688158] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T17:12:00.759332] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-28T17:12:01.350176] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:12:01.559395] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-28T17:12:02.274860] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T17:12:02.359353] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-28T17:12:02.757008] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:12:03.159345] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-28T17:12:03.967479] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-28T17:12:03.986667] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T17:12:03.997433] [INFO ] [REMOTE ] AMH: Full fetch complete (75137 records). [2025-10-28T17:12:03.997596] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-28T17:12:04.408785] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-28T17:12:04.408914] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-28T17:12:04.409674] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-28T17:12:04.409755] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-28T17:12:04.411265] [DEBUG] [LOCAL ] AMH: Trimmed 75137 records to 51788 (keeping 200 days of data) [2025-10-28T17:12:04.557099] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:12:04.757082] [DEBUG] [LOCAL ] AMH: Primary data saved (51788 records). [2025-10-28T17:12:04.757223] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-28T17:12:04.758063] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMH took 30.3s. Estimated remaining: 4h 27m 0s. Rate: 8.5 symbols/min [2025-10-28T17:12:04.769572] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-28T17:12:04.934169] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:04.972625] [DEBUG] [LOCAL ] AMPY: Loaded 39370 existing records from primary storage. [2025-10-28T17:12:04.972951] [INFO ] [MAIN ] AMPY: Loaded 39370 existing records. [2025-10-28T17:12:05.148152] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:05.148344] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-28T17:12:05.148396] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-28T17:12:05.148903] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-28T17:12:05.148960] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-28T17:12:05.508044] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:05.559326] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-28T17:12:05.753367] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T17:12:05.785976] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T17:12:06.310823] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:12:06.359344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-28T17:12:07.159357] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-28T17:12:07.278954] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T17:12:07.785970] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:12:07.959308] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-28T17:12:08.759337] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-28T17:12:09.019238] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T17:12:09.559336] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-28T17:12:10.168983] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:12:10.359341] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-28T17:12:10.616780] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:12:11.159344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-28T17:12:11.586121] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T17:12:11.594123] [INFO ] [REMOTE ] AMN: Full fetch complete (60183 records). [2025-10-28T17:12:11.594250] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-28T17:12:11.968580] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-28T17:12:11.989707] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-28T17:12:11.990811] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-28T17:12:11.991452] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-28T17:12:11.991501] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-28T17:12:11.993059] [DEBUG] [LOCAL ] AMN: Trimmed 60183 records to 41432 (keeping 200 days of data) [2025-10-28T17:12:12.232455] [DEBUG] [LOCAL ] AMN: Primary data saved (41432 records). [2025-10-28T17:12:12.232623] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-28T17:12:12.232759] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMN took 37.4s. Estimated remaining: 4h 27m 2s. Rate: 8.5 symbols/min [2025-10-28T17:12:12.351714] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:12:12.379232] [INFO ] [REMOTE ] AMP: Full fetch complete (47473 records). [2025-10-28T17:12:12.396809] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-28T17:12:12.462231] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:12.741854] [DEBUG] [LOCAL ] AMR: Loaded 28408 existing records from primary storage. [2025-10-28T17:12:12.742413] [INFO ] [MAIN ] AMR: Loaded 28408 existing records. [2025-10-28T17:12:12.775119] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-28T17:12:12.928854] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-28T17:12:12.940096] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-28T17:12:12.941139] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-28T17:12:12.941240] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-28T17:12:13.021502] [DEBUG] [LOCAL ] AMP: Trimmed 47473 records to 31273 (keeping 200 days of data) [2025-10-28T17:12:13.021360] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:13.022088] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-28T17:12:13.022444] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-28T17:12:13.030568] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-28T17:12:13.114119] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-28T17:12:13.153796] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:12:13.597580] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:13.577012] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-28T17:12:13.651789] [DEBUG] [LOCAL ] AMP: Primary data saved (31273 records). [2025-10-28T17:12:13.651932] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-28T17:12:13.653370] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMP took 31.4s. Estimated remaining: 4h 24m 52s. Rate: 8.5 symbols/min [2025-10-28T17:12:13.821397] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:13.868322] [DEBUG] [LOCAL ] AMRC: Loaded 38274 existing records from primary storage. [2025-10-28T17:12:13.868581] [INFO ] [MAIN ] AMRC: Loaded 38274 existing records. [2025-10-28T17:12:14.040539] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:14.040762] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-28T17:12:14.040812] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-28T17:12:14.041371] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-28T17:12:14.041426] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-28T17:12:14.364591] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-28T17:12:14.415707] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:14.618705] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-28T17:12:14.732284] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:12:15.159345] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-28T17:12:15.282415] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:12:15.959348] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-28T17:12:16.497600] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:12:16.759330] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-28T17:12:17.028752] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T17:12:17.559332] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-28T17:12:18.208248] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T17:12:18.359333] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-28T17:12:18.968413] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:12:19.159310] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-28T17:12:19.294075] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:12:19.959328] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-28T17:12:20.609446] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T17:12:20.759332] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-28T17:12:21.546464] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T17:12:21.559293] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-28T17:12:22.124777] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:12:22.359324] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-28T17:12:23.027435] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T17:12:23.036411] [INFO ] [REMOTE ] AMPY: Full fetch complete (53505 records). [2025-10-28T17:12:23.036531] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-28T17:12:23.037246] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:12:23.037339] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:12:23.037383] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:12:23.037451] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-28T17:12:23.037516] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-28T17:12:23.037552] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-10-28T17:12:23.037765] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-10-28T17:12:23.038310] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPY took 18.3s. Estimated remaining: 4h 25m 36s. Rate: 8.5 symbols/min [2025-10-28T17:12:23.164582] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-28T17:12:23.221934] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:23.222114] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-28T17:12:23.222173] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-28T17:12:23.222318] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-28T17:12:23.222392] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-28T17:12:23.222466] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-28T17:12:23.222516] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-28T17:12:23.585808] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:23.910772] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:12:23.959327] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-28T17:12:24.176916] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:12:24.177289] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-28T17:12:24.177375] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:12:24.177452] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-28T17:12:24.177522] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:12:24.177601] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-28T17:12:24.177715] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-28T17:12:24.177776] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-28T17:12:24.177836] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-28T17:12:24.177898] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 1.1s. Estimated remaining: 4h 23m 23s. Rate: 8.6 symbols/min [2025-10-28T17:12:24.356116] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:24.378255] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:12:24.438203] [DEBUG] [LOCAL ] AMT: Loaded 52406 existing records from primary storage. [2025-10-28T17:12:24.438497] [INFO ] [MAIN ] AMT: Loaded 52406 existing records. [2025-10-28T17:12:24.616629] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:24.616847] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-28T17:12:24.616892] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-28T17:12:24.617755] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-28T17:12:24.617813] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-28T17:12:24.759313] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-28T17:12:24.983208] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:25.559308] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-28T17:12:25.828098] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T17:12:26.359352] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-28T17:12:27.159322] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-28T17:12:27.494898] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-28T17:12:27.720688] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:12:27.959340] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-28T17:12:28.245684] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:12:28.759336] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-28T17:12:29.454366] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:12:29.559362] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-28T17:12:29.641169] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:12:30.359344] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-28T17:12:30.600996] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T17:12:31.159339] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-28T17:12:31.469106] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T17:12:31.959376] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-28T17:12:32.714198] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:12:32.759313] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-28T17:12:33.001986] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:12:33.559330] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-28T17:12:34.323718] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:12:34.359294] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-28T17:12:35.003698] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-28T17:12:35.159339] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-28T17:12:35.476055] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:12:35.959381] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-28T17:12:36.401264] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:12:36.759332] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-28T17:12:37.496451] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T17:12:37.559297] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-28T17:12:38.359334] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-28T17:12:38.772855] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-28T17:12:39.011872] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:12:39.159358] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-28T17:12:39.777057] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:12:39.785249] [INFO ] [REMOTE ] AMRC: Full fetch complete (54692 records). [2025-10-28T17:12:39.785390] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-28T17:12:39.964967] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-28T17:12:40.177784] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-28T17:12:40.177869] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-28T17:12:40.178504] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-28T17:12:40.178547] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-28T17:12:40.179849] [DEBUG] [LOCAL ] AMRC: Trimmed 54692 records to 38167 (keeping 200 days of data) [2025-10-28T17:12:40.395055] [DEBUG] [LOCAL ] AMRC: Primary data saved (38167 records). [2025-10-28T17:12:40.395181] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-28T17:12:40.396471] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMRC took 26.7s. Estimated remaining: 4h 26m 30s. Rate: 8.5 symbols/min [2025-10-28T17:12:40.570479] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:40.595056] [DEBUG] [LOCAL ] AMTB: Loaded 20491 existing records from primary storage. [2025-10-28T17:12:40.595321] [INFO ] [MAIN ] AMTB: Loaded 20491 existing records. [2025-10-28T17:12:40.772255] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-28T17:12:40.816993] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T17:12:40.815207] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:40.817219] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-28T17:12:40.827607] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-28T17:12:40.828458] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-28T17:12:40.828518] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-28T17:12:41.197841] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:41.559327] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-28T17:12:41.859079] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-28T17:12:41.860248] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:12:42.359352] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-28T17:12:42.918907] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:12:43.159319] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-28T17:12:43.219865] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T17:12:43.959336] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-28T17:12:44.728489] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:12:44.759312] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-28T17:12:45.296145] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-28T17:12:45.306805] [INFO ] [REMOTE ] AMPX: Full fetch complete (74879 records). [2025-10-28T17:12:45.306994] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-28T17:12:45.307867] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:12:45.307958] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:12:45.308020] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:12:45.308089] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-28T17:12:45.308156] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-28T17:12:45.308194] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-10-28T17:12:45.308234] [DEBUG] [LOCAL ] AMPX: No derivative data file found to delete. [2025-10-28T17:12:45.308320] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMPX took 47.5s. Estimated remaining: 4h 25m 38s. Rate: 8.5 symbols/min [2025-10-28T17:12:45.506324] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:45.520917] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T17:12:45.528306] [DEBUG] [LOCAL ] AMTD: Loaded 3794 existing records from primary storage. [2025-10-28T17:12:45.528869] [INFO ] [MAIN ] AMTD: Loaded 3794 existing records. [2025-10-28T17:12:45.564448] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-28T17:12:45.744079] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:45.744357] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-28T17:12:45.744415] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-28T17:12:45.744619] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-28T17:12:45.744723] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-28T17:12:46.154864] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:46.359332] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-28T17:12:47.159311] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-28T17:12:47.194415] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:12:47.220370] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:12:47.647722] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T17:12:47.959341] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-28T17:12:48.759404] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-28T17:12:49.559375] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-28T17:12:49.639564] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T17:12:49.776575] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:12:49.951853] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T17:12:50.359318] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-28T17:12:51.159341] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-28T17:12:51.964822] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-28T17:12:51.970174] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:12:52.293972] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T17:12:52.581026] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:12:52.586731] [INFO ] [REMOTE ] AMR: Full fetch complete (40569 records). [2025-10-28T17:12:52.586827] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-28T17:12:52.770856] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-28T17:12:52.985677] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-28T17:12:52.985766] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-28T17:12:52.986256] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-28T17:12:52.986299] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-28T17:12:52.987219] [DEBUG] [LOCAL ] AMR: Trimmed 40569 records to 28338 (keeping 200 days of data) [2025-10-28T17:12:53.157424] [DEBUG] [LOCAL ] AMR: Primary data saved (28338 records). [2025-10-28T17:12:53.157739] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-28T17:12:53.157829] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMR took 40.9s. Estimated remaining: 4h 25m 47s. Rate: 8.5 symbols/min [2025-10-28T17:12:53.250534] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:12:53.350204] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:53.393294] [DEBUG] [LOCAL ] AMTM: Loaded 50131 existing records from primary storage. [2025-10-28T17:12:53.393594] [INFO ] [MAIN ] AMTM: Loaded 50131 existing records. [2025-10-28T17:12:53.563340] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-28T17:12:53.582932] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:53.584280] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-28T17:12:53.584350] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-28T17:12:53.585087] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-28T17:12:53.585147] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-28T17:12:53.937159] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:54.359408] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-28T17:12:55.159400] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-28T17:12:55.218172] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T17:12:55.267969] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T17:12:55.278824] [INFO ] [REMOTE ] AMT: Full fetch complete (76158 records). [2025-10-28T17:12:55.278980] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-28T17:12:55.687343] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-28T17:12:55.687420] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-28T17:12:55.688142] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-28T17:12:55.688203] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-28T17:12:55.689540] [DEBUG] [LOCAL ] AMT: Trimmed 76158 records to 52408 (keeping 200 days of data) [2025-10-28T17:12:55.972069] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-28T17:12:56.016446] [DEBUG] [LOCAL ] AMT: Primary data saved (52408 records). [2025-10-28T17:12:56.017052] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-28T17:12:56.018136] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMT took 31.8s. Estimated remaining: 4h 24m 14s. Rate: 8.5 symbols/min [2025-10-28T17:12:56.183489] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:56.183635] [DEBUG] [LOCAL ] AMWL: No existing data file found in primary storage. [2025-10-28T17:12:56.183708] [WARN ] [MAIN ] AMWL: No existing data found, performing full refresh instead. [2025-10-28T17:12:56.183815] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-28T17:12:56.183856] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-28T17:12:56.183896] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-10-28T17:12:56.183928] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-28T17:12:56.536253] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:56.549190] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:12:56.580466] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T17:12:56.759342] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-28T17:12:57.559360] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-28T17:12:57.994996] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:12:58.201078] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:12:58.359344] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-28T17:12:58.930262] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T17:12:59.159327] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-28T17:12:59.799999] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T17:12:59.959365] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-28T17:13:00.759317] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-28T17:13:00.912492] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T17:13:01.559319] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-28T17:13:02.039381] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T17:13:02.359329] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-28T17:13:02.846012] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T17:13:03.159335] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-28T17:13:03.345878] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-28T17:13:03.959394] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-28T17:13:04.011921] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T17:13:04.353338] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T17:13:04.759378] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-28T17:13:05.559356] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-28T17:13:05.707509] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:13:06.359388] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-28T17:13:07.073876] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:13:07.159315] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-28T17:13:07.242215] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:13:07.959360] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-28T17:13:07.976764] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:13:07.981512] [INFO ] [REMOTE ] AMTB: Full fetch complete (29855 records). [2025-10-28T17:13:07.981589] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-28T17:13:08.345511] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-28T17:13:08.345582] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-28T17:13:08.345958] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-28T17:13:08.346022] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-28T17:13:08.346723] [DEBUG] [LOCAL ] AMTB: Trimmed 29855 records to 20507 (keeping 200 days of data) [2025-10-28T17:13:08.473908] [DEBUG] [LOCAL ] AMTB: Primary data saved (20507 records). [2025-10-28T17:13:08.474042] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-28T17:13:08.474121] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 28.1s. Estimated remaining: 4h 25m 57s. Rate: 8.5 symbols/min [2025-10-28T17:13:08.650194] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:08.693738] [DEBUG] [LOCAL ] AMX: Loaded 49065 existing records from primary storage. [2025-10-28T17:13:08.694028] [INFO ] [MAIN ] AMX: Loaded 49065 existing records. [2025-10-28T17:13:08.768625] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-28T17:13:08.873633] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:08.873825] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-28T17:13:08.873871] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-28T17:13:08.874590] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-28T17:13:08.874676] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-28T17:13:09.246247] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:13:09.251040] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:09.559351] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-28T17:13:09.715563] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T17:13:10.359316] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-28T17:13:10.816857] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T17:13:11.159395] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-28T17:13:11.645502] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T17:13:11.704665] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:13:11.959328] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-28T17:13:12.607349] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T17:13:12.608722] [INFO ] [REMOTE ] AMTD: Full fetch complete (5368 records). [2025-10-28T17:13:12.608792] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-28T17:13:12.764550] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-28T17:13:12.981412] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-28T17:13:12.981488] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-28T17:13:12.981705] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-28T17:13:12.981766] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-28T17:13:12.982201] [DEBUG] [LOCAL ] AMTD: Trimmed 5368 records to 3803 (keeping 200 days of data) [2025-10-28T17:13:13.004036] [DEBUG] [LOCAL ] AMTD: Primary data saved (3803 records). [2025-10-28T17:13:13.004160] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-28T17:13:13.004256] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMTD took 27.7s. Estimated remaining: 4h 24m 59s. Rate: 8.5 symbols/min [2025-10-28T17:13:13.182867] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:13.211665] [DEBUG] [LOCAL ] AN: Loaded 30923 existing records from primary storage. [2025-10-28T17:13:13.211925] [INFO ] [MAIN ] AN: Loaded 30923 existing records. [2025-10-28T17:13:13.384366] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:13.384575] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-28T17:13:13.384621] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-28T17:13:13.385241] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-28T17:13:13.385310] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-28T17:13:13.566693] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-28T17:13:13.607730] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T17:13:13.760284] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:14.359340] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-28T17:13:15.112276] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:13:15.159294] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-28T17:13:15.516012] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:13:15.959338] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-28T17:13:16.335329] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T17:13:16.759325] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-28T17:13:17.128891] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T17:13:17.559310] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-28T17:13:18.359381] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-28T17:13:18.565876] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T17:13:18.819940] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:13:18.986359] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T17:13:19.159328] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-28T17:13:19.648133] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T17:13:19.959323] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-28T17:13:20.759326] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-28T17:13:20.975573] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:13:21.559332] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-28T17:13:22.309169] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:13:22.359326] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-28T17:13:22.916546] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:13:23.084864] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:13:23.098185] [INFO ] [REMOTE ] AMTM: Full fetch complete (73441 records). [2025-10-28T17:13:23.098394] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-28T17:13:23.159393] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-28T17:13:23.551266] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-28T17:13:23.551348] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-28T17:13:23.552143] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-28T17:13:23.552208] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-28T17:13:23.553605] [DEBUG] [LOCAL ] AMTM: Trimmed 73441 records to 50074 (keeping 200 days of data) [2025-10-28T17:13:23.842020] [DEBUG] [LOCAL ] AMTM: Primary data saved (50074 records). [2025-10-28T17:13:23.842153] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-28T17:13:23.842255] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMTM took 30.7s. Estimated remaining: 4h 26m 7s. Rate: 8.5 symbols/min [2025-10-28T17:13:23.964554] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-28T17:13:24.038087] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:24.089271] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-28T17:13:24.089762] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-28T17:13:24.285395] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:24.286021] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-28T17:13:24.286088] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-28T17:13:24.286903] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-28T17:13:24.286959] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-28T17:13:24.649807] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:24.707187] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T17:13:24.759309] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-28T17:13:25.149041] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:13:25.559329] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-28T17:13:25.923914] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:13:26.359406] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-28T17:13:27.064306] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:13:27.159319] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-28T17:13:27.959385] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-28T17:13:28.310550] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T17:13:28.592457] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T17:13:28.734300] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:13:28.759293] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-28T17:13:29.559338] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-28T17:13:29.699767] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T17:13:30.359356] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-28T17:13:31.070327] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T17:13:31.074090] [INFO ] [REMOTE ] AMWL: Full fetch complete (14877 records). [2025-10-28T17:13:31.074174] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-28T17:13:31.164425] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-28T17:13:31.437606] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-28T17:13:31.437708] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-28T17:13:31.437990] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-28T17:13:31.438030] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-28T17:13:31.438497] [DEBUG] [LOCAL ] AMWL: Trimmed 14877 records to 9959 (keeping 200 days of data) [2025-10-28T17:13:31.496977] [DEBUG] [LOCAL ] AMWL: Primary data saved (9959 records). [2025-10-28T17:13:31.497085] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-28T17:13:31.497151] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMWL took 35.5s. Estimated remaining: 4h 26m 11s. Rate: 8.5 symbols/min [2025-10-28T17:13:31.681089] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:31.772722] [DEBUG] [LOCAL ] ANF: Loaded 51990 existing records from primary storage. [2025-10-28T17:13:31.773522] [INFO ] [MAIN ] ANF: Loaded 51990 existing records. [2025-10-28T17:13:31.977819] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-28T17:13:31.978073] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-28T17:13:32.021486] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:32.021900] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-28T17:13:32.021962] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-28T17:13:32.022912] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-28T17:13:32.022975] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-28T17:13:32.408805] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:32.435791] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T17:13:32.759318] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-28T17:13:33.333439] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:13:33.421760] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T17:13:33.559331] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-28T17:13:34.359346] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-28T17:13:35.159354] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-28T17:13:35.480422] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:13:35.599801] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T17:13:35.959324] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-28T17:13:36.743096] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T17:13:36.759297] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-28T17:13:37.282252] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T17:13:37.289313] [INFO ] [REMOTE ] AN: Full fetch complete (47236 records). [2025-10-28T17:13:37.289509] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-28T17:13:37.567707] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-28T17:13:37.689455] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-28T17:13:37.689576] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-28T17:13:37.690287] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-28T17:13:37.690356] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-28T17:13:37.691845] [DEBUG] [LOCAL ] AN: Trimmed 47236 records to 30898 (keeping 200 days of data) [2025-10-28T17:13:37.876590] [DEBUG] [LOCAL ] AN: Primary data saved (30898 records). [2025-10-28T17:13:37.876750] [INFO ] [MAIN ] AN: Full history saved. [2025-10-28T17:13:37.876835] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AN took 24.9s. Estimated remaining: 4h 25m 50s. Rate: 8.5 symbols/min [2025-10-28T17:13:38.054963] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:38.055259] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-28T17:13:38.055414] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-28T17:13:38.055563] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-28T17:13:38.055816] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-28T17:13:38.056021] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-28T17:13:38.056095] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-28T17:13:38.250550] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:13:38.369305] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-28T17:13:38.475588] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:39.159366] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-28T17:13:39.300791] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:13:39.836049] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T17:13:39.846081] [INFO ] [REMOTE ] AMX: Full fetch complete (71010 records). [2025-10-28T17:13:39.846223] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-28T17:13:39.965847] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-28T17:13:40.214525] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:13:40.231430] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-28T17:13:40.235126] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:13:40.252417] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-28T17:13:40.252532] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-28T17:13:40.252608] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-28T17:13:40.253439] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-28T17:13:40.253541] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:13:40.253613] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-28T17:13:40.253926] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-28T17:13:40.254014] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-28T17:13:40.254054] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-28T17:13:40.254095] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-28T17:13:40.254144] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. ANGX took 2.4s. Estimated remaining: 4h 24m 12s. Rate: 8.5 symbols/min [2025-10-28T17:13:40.361359] [DEBUG] [LOCAL ] AMX: Trimmed 71010 records to 49047 (keeping 200 days of data) [2025-10-28T17:13:40.526638] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:40.528137] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-28T17:13:40.529179] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-28T17:13:40.530363] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-28T17:13:40.531717] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-28T17:13:40.532377] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-28T17:13:40.532690] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-28T17:13:40.789240] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-28T17:13:41.137963] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:41.144912] [DEBUG] [LOCAL ] AMX: Primary data saved (49047 records). [2025-10-28T17:13:41.144987] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-28T17:13:41.145876] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. AMX took 32.7s. Estimated remaining: 4h 22m 7s. Rate: 8.6 symbols/min [2025-10-28T17:13:41.283573] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-28T17:13:41.559352] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-28T17:13:42.246252] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T17:13:42.359304] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-28T17:13:42.475254] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:13:43.159394] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-28T17:13:43.730058] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:13:43.959406] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-28T17:13:44.648353] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:13:44.767316] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-28T17:13:44.790458] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:13:45.559366] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-28T17:13:45.608370] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:13:46.359402] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-28T17:13:47.159388] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-28T17:13:47.197724] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T17:13:47.889810] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T17:13:47.959410] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-28T17:13:48.267831] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:13:48.759333] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-28T17:13:49.559337] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-28T17:13:49.725398] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T17:13:50.226405] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T17:13:50.359372] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-28T17:13:50.428558] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T17:13:51.159344] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-28T17:13:51.959396] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-28T17:13:52.324757] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-28T17:13:52.759382] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-28T17:13:52.794474] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T17:13:53.285677] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T17:13:53.559390] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-28T17:13:54.326639] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T17:13:54.359296] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-28T17:13:55.159341] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-28T17:13:55.664839] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-28T17:13:55.876638] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T17:13:55.959353] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-28T17:13:56.107819] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T17:13:56.508961] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T17:13:56.521147] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-28T17:13:56.521332] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-28T17:13:56.761847] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-28T17:13:57.101309] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-28T17:13:57.101438] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-28T17:13:57.102569] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-28T17:13:57.102696] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-28T17:13:57.104610] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-28T17:13:57.459215] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:13:57.495097] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-28T17:13:57.495259] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-28T17:13:57.495353] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANET took 33.7s. Estimated remaining: 4h 24m 58s. Rate: 8.5 symbols/min [2025-10-28T17:13:57.559386] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-28T17:13:58.359364] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-28T17:13:58.845183] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:13:58.864354] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:13:59.159334] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-28T17:13:59.959384] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-28T17:14:00.258755] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:14:00.265959] [INFO ] [REMOTE ] ANRO: Full fetch complete (30769 records). [2025-10-28T17:14:00.266066] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-28T17:14:00.658100] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-28T17:14:00.658240] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-28T17:14:00.659065] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-28T17:14:00.659145] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-28T17:14:00.660405] [DEBUG] [LOCAL ] ANRO: Trimmed 30769 records to 19705 (keeping 200 days of data) [2025-10-28T17:14:00.775261] [DEBUG] [LOCAL ] ANRO: Primary data saved (19705 records). [2025-10-28T17:14:00.775501] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-28T17:14:00.775597] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANRO took 20.5s. Estimated remaining: 4h 23m 39s. Rate: 8.5 symbols/min [2025-10-28T17:14:01.748734] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:14:01.760857] [INFO ] [REMOTE ] ANF: Full fetch complete (75800 records). [2025-10-28T17:14:01.761040] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-28T17:14:02.184385] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-28T17:14:02.184477] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-28T17:14:02.185252] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-28T17:14:02.185324] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-28T17:14:02.186863] [DEBUG] [LOCAL ] ANF: Trimmed 75800 records to 51983 (keeping 200 days of data) [2025-10-28T17:14:02.486052] [DEBUG] [LOCAL ] ANF: Primary data saved (51983 records). [2025-10-28T17:14:02.486187] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-28T17:14:02.488355] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANF took 31.0s. Estimated remaining: 4h 21m 53s. Rate: 8.6 symbols/min [2025-10-28T17:14:03.196371] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.221073] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.277126] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.267833] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-28T17:14:03.320026] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.320211] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-28T17:14:03.321417] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-28T17:14:03.321481] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-28T17:14:03.321535] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-28T17:14:03.321572] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-28T17:14:03.461318] [DEBUG] [LOCAL ] AOMR: Loaded 16054 existing records from primary storage. [2025-10-28T17:14:03.479749] [INFO ] [MAIN ] AOMR: Loaded 16054 existing records. [2025-10-28T17:14:03.534109] [DEBUG] [LOCAL ] ANVS: Loaded 23987 existing records from primary storage. [2025-10-28T17:14:03.580093] [INFO ] [MAIN ] ANVS: Loaded 23987 existing records. [2025-10-28T17:14:03.666062] [DEBUG] [LOCAL ] AOD: Loaded 30589 existing records from primary storage. [2025-10-28T17:14:03.776576] [INFO ] [MAIN ] AOD: Loaded 30589 existing records. [2025-10-28T17:14:04.250121] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:04.272814] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-28T17:14:04.246112] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:04.276245] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-28T17:14:04.281475] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-28T17:14:04.341785] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-28T17:14:04.342037] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-28T17:14:04.362338] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-28T17:14:04.362257] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:04.408782] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:04.420080] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-28T17:14:04.431024] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-28T17:14:04.425670] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-28T17:14:04.448050] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-28T17:14:04.448147] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-28T17:14:04.468408] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-28T17:14:04.542945] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-28T17:14:04.719969] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:14:04.725681] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-28T17:14:04.787057] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:14:04.830489] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-28T17:14:04.841094] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:14:04.891258] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-28T17:14:04.911993] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-28T17:14:04.922412] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-28T17:14:04.958217] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-28T17:14:05.084486] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 20m 24s. Rate: 8.6 symbols/min [2025-10-28T17:14:05.447623] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:05.495570] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-28T17:14:05.750078] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:05.777061] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-28T17:14:05.770728] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:05.799519] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:05.800968] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-28T17:14:05.841355] [DEBUG] [LOCAL ] AON: Loaded 44854 existing records from primary storage. [2025-10-28T17:14:05.841635] [INFO ] [MAIN ] AON: Loaded 44854 existing records. [2025-10-28T17:14:06.023822] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:06.024015] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-28T17:14:06.024062] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-28T17:14:06.024565] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-28T17:14:06.024679] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-28T17:14:06.385269] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:14:06.391700] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:06.394722] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-28T17:14:06.395037] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-28T17:14:06.746003] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:14:06.751633] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-28T17:14:06.937476] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:14:06.944571] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-28T17:14:07.068286] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T17:14:07.159343] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-28T17:14:07.719290] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:14:07.743733] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T17:14:07.791061] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T17:14:07.959331] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-28T17:14:08.167677] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T17:14:08.759351] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-28T17:14:09.204214] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:14:09.485879] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T17:14:09.559338] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-28T17:14:10.359299] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-28T17:14:10.428342] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:14:11.159323] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-28T17:14:11.761548] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:14:11.959304] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-28T17:14:11.988247] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T17:14:12.759328] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-28T17:14:12.816448] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T17:14:13.559332] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-28T17:14:14.228441] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:14:14.359325] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-28T17:14:14.849349] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:14:15.159327] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-28T17:14:15.609491] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:14:15.959330] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-28T17:14:16.074543] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:14:16.759326] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-28T17:14:17.010015] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T17:14:17.559337] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-28T17:14:18.248098] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:14:18.359295] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-28T17:14:18.750469] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:14:19.159317] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-28T17:14:19.275692] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:14:19.799632] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:14:19.959325] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-28T17:14:20.566354] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T17:14:20.759329] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-28T17:14:21.494689] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T17:14:21.559301] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-28T17:14:22.157919] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:14:22.359341] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-28T17:14:23.159406] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-28T17:14:23.524237] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:14:23.959321] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-28T17:14:24.098154] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:14:24.759336] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-28T17:14:25.559306] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-28T17:14:25.615679] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:14:25.849490] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:14:26.188681] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T17:14:26.359365] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-28T17:14:27.159323] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-28T17:14:27.895456] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T17:14:27.959297] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-28T17:14:28.100734] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:14:28.759384] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-28T17:14:29.191737] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:14:29.559304] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-28T17:14:29.880222] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:14:30.359394] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-28T17:14:30.801623] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T17:14:30.807964] [INFO ] [REMOTE ] ANVS: Full fetch complete (36708 records). [2025-10-28T17:14:30.808084] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-28T17:14:31.165499] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-28T17:14:31.182080] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-28T17:14:31.182158] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-28T17:14:31.182876] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-28T17:14:31.182940] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-28T17:14:31.183950] [DEBUG] [LOCAL ] ANVS: Trimmed 36708 records to 24020 (keeping 200 days of data) [2025-10-28T17:14:31.315616] [DEBUG] [LOCAL ] ANVS: Primary data saved (24020 records). [2025-10-28T17:14:31.315775] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-28T17:14:31.315885] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. ANVS took 28.8s. Estimated remaining: 4h 26m 11s. Rate: 8.4 symbols/min [2025-10-28T17:14:31.488782] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:31.508404] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T17:14:31.515559] [INFO ] [REMOTE ] AOD: Full fetch complete (44858 records). [2025-10-28T17:14:31.515730] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-28T17:14:31.710005] [DEBUG] [LOCAL ] AORT: Loaded 28591 existing records from primary storage. [2025-10-28T17:14:31.756094] [INFO ] [MAIN ] AORT: Loaded 28591 existing records. [2025-10-28T17:14:31.959613] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-28T17:14:32.107545] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:32.108961] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-28T17:14:32.108592] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T17:14:32.108856] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-28T17:14:32.111860] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-28T17:14:32.112079] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-28T17:14:32.112685] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-28T17:14:32.113304] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-28T17:14:32.113253] [INFO ] [REMOTE ] AOMR: Full fetch complete (23136 records). [2025-10-28T17:14:32.113587] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-28T17:14:32.113507] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-28T17:14:32.113953] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-28T17:14:32.235778] [DEBUG] [LOCAL ] AOD: Trimmed 44858 records to 30529 (keeping 200 days of data) [2025-10-28T17:14:32.993611] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:32.994978] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-28T17:14:32.996376] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-28T17:14:32.996432] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-28T17:14:33.004505] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-28T17:14:33.004605] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-28T17:14:33.055891] [DEBUG] [LOCAL ] AOMR: Trimmed 23136 records to 16020 (keeping 200 days of data) [2025-10-28T17:14:33.146373] [DEBUG] [LOCAL ] AOD: Primary data saved (30529 records). [2025-10-28T17:14:33.152942] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-28T17:14:33.163374] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. AOD took 30.7s. Estimated remaining: 4h 24m 28s. Rate: 8.5 symbols/min [2025-10-28T17:14:33.228691] [DEBUG] [LOCAL ] AOMR: Primary data saved (16020 records). [2025-10-28T17:14:33.243246] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-28T17:14:33.243420] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. AOMR took 30.7s. Estimated remaining: 4h 22m 15s. Rate: 8.5 symbols/min [2025-10-28T17:14:33.440490] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:33.530120] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:33.564404] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:14:33.595288] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-28T17:14:33.595603] [DEBUG] [LOCAL ] AP: Loaded 7468 existing records from primary storage. [2025-10-28T17:14:33.596394] [INFO ] [MAIN ] AP: Loaded 7468 existing records. [2025-10-28T17:14:33.728548] [DEBUG] [LOCAL ] AOS: Loaded 48566 existing records from primary storage. [2025-10-28T17:14:33.749891] [INFO ] [MAIN ] AOS: Loaded 48566 existing records. [2025-10-28T17:14:33.871744] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:33.888492] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-28T17:14:33.900541] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-28T17:14:33.914987] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-28T17:14:33.924783] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-28T17:14:34.128082] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:34.175659] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-28T17:14:34.231217] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-28T17:14:34.243032] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-28T17:14:34.255880] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-28T17:14:34.545508] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T17:14:34.601035] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:34.612731] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-28T17:14:34.851742] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:34.985120] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T17:14:34.997741] [INFO ] [REMOTE ] AON: Full fetch complete (65234 records). [2025-10-28T17:14:34.997940] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-28T17:14:35.162323] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-28T17:14:35.398055] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-28T17:14:35.398147] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-28T17:14:35.398834] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-28T17:14:35.398924] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-28T17:14:35.400125] [DEBUG] [LOCAL ] AON: Trimmed 65234 records to 44821 (keeping 200 days of data) [2025-10-28T17:14:35.664854] [DEBUG] [LOCAL ] AON: Primary data saved (44821 records). [2025-10-28T17:14:35.665077] [INFO ] [MAIN ] AON: Full history saved. [2025-10-28T17:14:35.665172] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 30.5s. Estimated remaining: 4h 20m 45s. Rate: 8.6 symbols/min [2025-10-28T17:14:35.834681] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:35.856397] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:14:35.893161] [DEBUG] [LOCAL ] APAM: Loaded 35313 existing records from primary storage. [2025-10-28T17:14:35.893512] [INFO ] [MAIN ] APAM: Loaded 35313 existing records. [2025-10-28T17:14:35.965805] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-28T17:14:36.071115] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:36.071343] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-28T17:14:36.071391] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-28T17:14:36.071875] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-28T17:14:36.071935] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-28T17:14:36.418250] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:36.593160] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T17:14:36.759335] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-28T17:14:37.052395] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T17:14:37.168629] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:14:37.559335] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-28T17:14:37.950017] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T17:14:38.359363] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-28T17:14:38.856290] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T17:14:39.159314] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-28T17:14:39.630492] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T17:14:39.959365] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-28T17:14:40.759357] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-28T17:14:41.171443] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:14:41.559337] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-28T17:14:42.049668] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:14:42.202464] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:14:42.359371] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-28T17:14:43.159362] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-28T17:14:43.310504] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:14:43.959394] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-28T17:14:44.389983] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:14:44.464810] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:14:44.759342] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-28T17:14:45.286394] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:14:45.559366] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-28T17:14:46.359416] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-28T17:14:46.687425] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:14:46.807472] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T17:14:47.159371] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-28T17:14:47.780319] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T17:14:47.959378] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-28T17:14:48.759336] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-28T17:14:49.371945] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T17:14:49.559326] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-28T17:14:49.676085] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:14:50.098889] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T17:14:50.100636] [INFO ] [REMOTE ] AP: Full fetch complete (9218 records). [2025-10-28T17:14:50.100730] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-28T17:14:50.364505] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-28T17:14:50.462916] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-28T17:14:50.462991] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-28T17:14:50.463251] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-28T17:14:50.463291] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-28T17:14:50.463784] [DEBUG] [LOCAL ] AP: Trimmed 9218 records to 7489 (keeping 200 days of data) [2025-10-28T17:14:50.504113] [DEBUG] [LOCAL ] AP: Primary data saved (7489 records). [2025-10-28T17:14:50.504227] [INFO ] [MAIN ] AP: Full history saved. [2025-10-28T17:14:50.504302] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AP took 17.3s. Estimated remaining: 4h 22m 58s. Rate: 8.5 symbols/min [2025-10-28T17:14:50.670397] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:50.712566] [DEBUG] [LOCAL ] APD: Loaded 45282 existing records from primary storage. [2025-10-28T17:14:50.712903] [INFO ] [MAIN ] APD: Loaded 45282 existing records. [2025-10-28T17:14:50.890013] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:50.890220] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-28T17:14:50.890286] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-28T17:14:50.890991] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-28T17:14:50.891052] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-28T17:14:51.163603] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-28T17:14:51.243258] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:51.696245] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:14:51.959345] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-28T17:14:52.224938] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:14:52.759429] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-28T17:14:52.942993] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:14:53.559340] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-28T17:14:54.062963] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T17:14:54.359343] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-28T17:14:54.479626] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T17:14:55.159369] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-28T17:14:55.708117] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:14:55.959353] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-28T17:14:56.665534] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T17:14:56.759348] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-28T17:14:57.393007] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T17:14:57.559332] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-28T17:14:57.847730] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:14:57.853216] [INFO ] [REMOTE ] AORT: Full fetch complete (42330 records). [2025-10-28T17:14:57.853321] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-28T17:14:58.243982] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-28T17:14:58.244058] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-28T17:14:58.244511] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-28T17:14:58.244551] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-28T17:14:58.245434] [DEBUG] [LOCAL ] AORT: Trimmed 42330 records to 28553 (keeping 200 days of data) [2025-10-28T17:14:58.374587] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-28T17:14:58.403290] [DEBUG] [LOCAL ] AORT: Primary data saved (28553 records). [2025-10-28T17:14:58.403419] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-28T17:14:58.403515] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AORT took 27.1s. Estimated remaining: 4h 23m 6s. Rate: 8.5 symbols/min [2025-10-28T17:14:58.569602] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:58.569778] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-10-28T17:14:58.569820] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-10-28T17:14:58.569941] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-28T17:14:58.569986] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-28T17:14:58.570029] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-28T17:14:58.570060] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-28T17:14:58.927033] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:58.977550] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:14:59.159328] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-28T17:14:59.489188] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T17:14:59.959348] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-28T17:15:00.426315] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T17:15:00.759341] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-28T17:15:01.369432] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:15:01.559336] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-28T17:15:02.155529] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T17:15:02.359356] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-28T17:15:02.955972] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:15:03.159341] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-28T17:15:03.475881] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:15:03.959338] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-28T17:15:04.346125] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:15:04.759332] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-28T17:15:05.341717] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:15:05.559319] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-28T17:15:06.140362] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:15:06.359317] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-28T17:15:07.141192] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:15:07.151137] [INFO ] [REMOTE ] AOS: Full fetch complete (71106 records). [2025-10-28T17:15:07.151287] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-28T17:15:07.164914] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-28T17:15:07.556421] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-28T17:15:07.556518] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-28T17:15:07.557341] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-28T17:15:07.557405] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-28T17:15:07.558767] [DEBUG] [LOCAL ] AOS: Trimmed 71106 records to 48563 (keeping 200 days of data) [2025-10-28T17:15:07.850237] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T17:15:07.890446] [DEBUG] [LOCAL ] AOS: Primary data saved (48563 records). [2025-10-28T17:15:07.890558] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-28T17:15:07.890631] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AOS took 34.7s. Estimated remaining: 4h 23m 42s. Rate: 8.5 symbols/min [2025-10-28T17:15:07.965258] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-28T17:15:08.061534] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:08.112595] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-28T17:15:08.112912] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-28T17:15:08.296002] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:08.296246] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-28T17:15:08.296375] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-28T17:15:08.303205] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-28T17:15:08.314221] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-28T17:15:08.379466] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T17:15:08.675905] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:08.759321] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-28T17:15:09.564446] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-28T17:15:09.578783] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:15:09.862437] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T17:15:10.359354] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-28T17:15:11.159309] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-28T17:15:11.324465] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T17:15:11.719853] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:15:11.959331] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-28T17:15:12.187388] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:15:12.759374] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-28T17:15:13.506850] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T17:15:13.559305] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-28T17:15:14.366323] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-28T17:15:14.384404] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:15:15.123624] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:15:15.159341] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-28T17:15:15.959305] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-28T17:15:16.099556] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:15:16.452612] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:15:16.759302] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-28T17:15:16.963546] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T17:15:17.559309] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-28T17:15:18.103638] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:15:18.359357] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-28T17:15:18.608200] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:15:18.615388] [INFO ] [REMOTE ] APAM: Full fetch complete (51938 records). [2025-10-28T17:15:18.615542] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-28T17:15:19.030448] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-28T17:15:19.030678] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-28T17:15:19.031910] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-28T17:15:19.032007] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-28T17:15:19.034329] [DEBUG] [LOCAL ] APAM: Trimmed 51938 records to 35260 (keeping 200 days of data) [2025-10-28T17:15:19.161704] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-28T17:15:19.271486] [DEBUG] [LOCAL ] APAM: Primary data saved (35260 records). [2025-10-28T17:15:19.271739] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-28T17:15:19.271858] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 43.6s. Estimated remaining: 4h 24m 49s. Rate: 8.4 symbols/min [2025-10-28T17:15:19.452754] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:19.505455] [DEBUG] [LOCAL ] APLE: Loaded 51909 existing records from primary storage. [2025-10-28T17:15:19.505894] [INFO ] [MAIN ] APLE: Loaded 51909 existing records. [2025-10-28T17:15:19.701717] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:19.702162] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-28T17:15:19.702241] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-28T17:15:19.703329] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-28T17:15:19.703391] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-28T17:15:19.967066] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-28T17:15:20.099291] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:20.131619] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:15:20.141445] [INFO ] [REMOTE ] APD: Full fetch complete (67227 records). [2025-10-28T17:15:20.141626] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-28T17:15:20.538190] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-28T17:15:20.538301] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-28T17:15:20.539094] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-28T17:15:20.539178] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-28T17:15:20.540973] [DEBUG] [LOCAL ] APD: Trimmed 67227 records to 45249 (keeping 200 days of data) [2025-10-28T17:15:20.783692] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-28T17:15:20.789256] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T17:15:20.867849] [DEBUG] [LOCAL ] APD: Primary data saved (45249 records). [2025-10-28T17:15:20.868004] [INFO ] [MAIN ] APD: Full history saved. [2025-10-28T17:15:20.869055] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 30.4s. Estimated remaining: 4h 23m 7s. Rate: 8.5 symbols/min [2025-10-28T17:15:21.051976] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:21.108538] [DEBUG] [LOCAL ] APO: Loaded 53373 existing records from primary storage. [2025-10-28T17:15:21.108952] [INFO ] [MAIN ] APO: Loaded 53373 existing records. [2025-10-28T17:15:21.294587] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:21.294840] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-28T17:15:21.294921] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-28T17:15:21.296264] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-28T17:15:21.296325] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-28T17:15:21.562122] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-28T17:15:21.683593] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:21.712081] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T17:15:22.359327] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-28T17:15:22.897006] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-28T17:15:22.935672] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:15:23.159369] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-28T17:15:23.674799] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:15:23.959351] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-28T17:15:24.599320] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:15:24.759331] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-28T17:15:25.231128] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T17:15:25.559332] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-28T17:15:26.359303] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-28T17:15:26.548189] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T17:15:26.870570] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T17:15:27.159327] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-28T17:15:27.673694] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:15:27.685086] [INFO ] [REMOTE ] APG: Full fetch complete (72266 records). [2025-10-28T17:15:27.685402] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-28T17:15:27.969637] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-28T17:15:28.110475] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-28T17:15:28.110572] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-28T17:15:28.111398] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-28T17:15:28.111466] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-28T17:15:28.112992] [DEBUG] [LOCAL ] APG: Trimmed 72266 records to 50596 (keeping 200 days of data) [2025-10-28T17:15:28.421309] [DEBUG] [LOCAL ] APG: Primary data saved (50596 records). [2025-10-28T17:15:28.421481] [INFO ] [MAIN ] APG: Full history saved. [2025-10-28T17:15:28.421572] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APG took 30.0s. Estimated remaining: 4h 23m 9s. Rate: 8.5 symbols/min [2025-10-28T17:15:28.603991] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:28.612389] [DEBUG] [LOCAL ] APOS: Loaded 6830 existing records from primary storage. [2025-10-28T17:15:28.612627] [INFO ] [MAIN ] APOS: Loaded 6830 existing records. [2025-10-28T17:15:28.760022] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-28T17:15:28.800814] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:28.802026] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-28T17:15:28.802103] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-28T17:15:28.802356] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-28T17:15:28.802419] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-28T17:15:29.166846] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T17:15:29.206168] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:29.559374] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-28T17:15:30.087717] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-28T17:15:30.110131] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:15:30.338524] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:15:30.359289] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-28T17:15:31.159333] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-28T17:15:31.666540] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:15:31.959334] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-28T17:15:32.349689] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T17:15:32.409101] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:15:32.759337] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-28T17:15:33.559316] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-28T17:15:33.641158] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T17:15:34.359340] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-28T17:15:35.086204] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:15:35.122683] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:15:35.159333] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-28T17:15:35.656049] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T17:15:35.959354] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-28T17:15:36.759402] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-28T17:15:37.559323] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-28T17:15:37.931045] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-28T17:15:38.196677] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T17:15:38.359347] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-28T17:15:38.995343] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:15:39.159328] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-28T17:15:39.755662] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:15:39.959363] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-28T17:15:40.046002] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T17:15:40.759340] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-28T17:15:41.493434] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:15:41.559344] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-28T17:15:42.229152] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:15:42.359354] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-28T17:15:42.885303] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T17:15:43.159336] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-28T17:15:43.658402] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T17:15:43.967302] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-28T17:15:43.972823] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T17:15:44.759354] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-28T17:15:45.559383] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-28T17:15:45.678175] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:15:46.000904] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T17:15:46.359314] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-28T17:15:46.403713] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T17:15:47.159319] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-28T17:15:47.838593] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:15:47.959329] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-28T17:15:48.764373] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-28T17:15:48.770212] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:15:49.246943] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T17:15:49.559329] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-28T17:15:49.780685] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T17:15:49.793360] [INFO ] [REMOTE ] APH: Full fetch complete (77871 records). [2025-10-28T17:15:49.793517] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-28T17:15:50.200432] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-28T17:15:50.200548] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-28T17:15:50.201387] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-28T17:15:50.201452] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-28T17:15:50.202941] [DEBUG] [LOCAL ] APH: Trimmed 77871 records to 53691 (keeping 200 days of data) [2025-10-28T17:15:50.382316] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-28T17:15:50.538879] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-28T17:15:50.539021] [INFO ] [MAIN ] APH: Full history saved. [2025-10-28T17:15:50.539097] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 42.6s. Estimated remaining: 4h 27m 16s. Rate: 8.4 symbols/min [2025-10-28T17:15:50.709948] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:50.759368] [DEBUG] [LOCAL ] APTV: Loaded 51758 existing records from primary storage. [2025-10-28T17:15:50.759799] [INFO ] [MAIN ] APTV: Loaded 51758 existing records. [2025-10-28T17:15:50.943615] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:50.943963] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-28T17:15:50.944068] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-28T17:15:50.944781] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-28T17:15:50.944914] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-28T17:15:51.149130] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T17:15:51.164473] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-28T17:15:51.396766] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:51.743346] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T17:15:51.745029] [INFO ] [REMOTE ] APOS: Full fetch complete (10198 records). [2025-10-28T17:15:51.745101] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-28T17:15:51.964488] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-28T17:15:52.119087] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-28T17:15:52.119201] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-28T17:15:52.119446] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-28T17:15:52.119521] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-28T17:15:52.146050] [DEBUG] [LOCAL ] APOS: Trimmed 10198 records to 6792 (keeping 200 days of data) [2025-10-28T17:15:52.148988] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:15:52.188051] [INFO ] [REMOTE ] APLE: Full fetch complete (74777 records). [2025-10-28T17:15:52.192859] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-28T17:15:52.206185] [DEBUG] [LOCAL ] APOS: Primary data saved (6792 records). [2025-10-28T17:15:52.244355] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-28T17:15:52.270130] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APOS took 23.8s. Estimated remaining: 4h 25m 38s. Rate: 8.4 symbols/min [2025-10-28T17:15:52.598434] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:52.652453] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-28T17:15:52.691081] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-28T17:15:52.731760] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-28T17:15:52.731946] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-28T17:15:52.732298] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-28T17:15:52.732367] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-28T17:15:52.770160] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-28T17:15:52.949066] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-28T17:15:52.949181] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-28T17:15:52.949968] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-28T17:15:52.950052] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-28T17:15:53.009898] [DEBUG] [LOCAL ] APLE: Trimmed 74777 records to 51897 (keeping 200 days of data) [2025-10-28T17:15:53.422761] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:53.534015] [DEBUG] [LOCAL ] APLE: Primary data saved (51897 records). [2025-10-28T17:15:53.534140] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-28T17:15:53.534218] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APLE took 34.3s. Estimated remaining: 4h 23m 53s. Rate: 8.5 symbols/min [2025-10-28T17:15:53.565321] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-28T17:15:53.708278] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:53.732829] [DEBUG] [LOCAL ] AQNB: Loaded 3764 existing records from primary storage. [2025-10-28T17:15:53.743827] [INFO ] [MAIN ] AQNB: Loaded 3764 existing records. [2025-10-28T17:15:53.802900] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-28T17:15:53.938188] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:53.938378] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-28T17:15:53.938425] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-28T17:15:53.938597] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-28T17:15:53.938690] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-28T17:15:54.308237] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:54.341076] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T17:15:54.359301] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-28T17:15:54.730343] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T17:15:55.164610] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-28T17:15:55.180916] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:15:55.478746] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T17:15:55.959331] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-28T17:15:56.349616] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:15:56.759394] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-28T17:15:57.559340] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-28T17:15:58.207999] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:15:58.219061] [INFO ] [REMOTE ] APO: Full fetch complete (77451 records). [2025-10-28T17:15:58.219210] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-28T17:15:58.364432] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-28T17:15:58.615923] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-28T17:15:58.616141] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-28T17:15:58.616967] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-28T17:15:58.617035] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-28T17:15:58.618517] [DEBUG] [LOCAL ] APO: Trimmed 77451 records to 53369 (keeping 200 days of data) [2025-10-28T17:15:58.858093] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T17:15:58.977965] [DEBUG] [LOCAL ] APO: Primary data saved (53369 records). [2025-10-28T17:15:58.978081] [INFO ] [MAIN ] APO: Full history saved. [2025-10-28T17:15:58.978572] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 38.1s. Estimated remaining: 4h 23m 19s. Rate: 8.5 symbols/min [2025-10-28T17:15:59.146397] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:59.146533] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-28T17:15:59.146569] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-28T17:15:59.146699] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-28T17:15:59.146751] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-28T17:15:59.146794] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-28T17:15:59.146828] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-28T17:15:59.167164] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-28T17:15:59.509129] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:59.934087] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T17:15:59.959309] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-28T17:16:00.312193] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T17:16:00.759326] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-28T17:16:00.818805] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T17:16:01.559341] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-28T17:16:02.286322] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T17:16:02.359335] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-28T17:16:02.768838] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:16:03.011512] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:16:03.159360] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-28T17:16:03.959402] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-28T17:16:04.379496] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T17:16:04.543477] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:16:04.759357] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-28T17:16:05.559320] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-28T17:16:06.359353] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-28T17:16:06.765672] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T17:16:07.057041] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:16:07.159329] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-28T17:16:07.959343] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-28T17:16:08.375427] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-28T17:16:08.759340] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-28T17:16:08.794876] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T17:16:09.270906] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:16:09.559372] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-28T17:16:10.063997] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T17:16:10.359344] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-28T17:16:10.791327] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:16:11.078096] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T17:16:11.159320] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-28T17:16:11.756887] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:16:11.959324] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-28T17:16:12.759343] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-28T17:16:13.490138] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:16:13.559339] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-28T17:16:13.936290] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:16:14.359359] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-28T17:16:15.017892] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:16:15.159353] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-28T17:16:15.700464] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:16:15.959332] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-28T17:16:16.736067] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T17:16:16.759329] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-28T17:16:17.295725] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:16:17.559338] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-28T17:16:18.254898] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:16:18.359336] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-28T17:16:18.955991] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:16:19.159313] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-28T17:16:19.757380] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:16:19.959342] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-28T17:16:20.503010] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:16:20.759345] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-28T17:16:21.541542] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:16:21.552137] [INFO ] [REMOTE ] AR: Full fetch complete (77346 records). [2025-10-28T17:16:21.552310] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-28T17:16:21.553098] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:16:21.553188] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:16:21.553256] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:16:21.553304] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-28T17:16:21.553363] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-28T17:16:21.553438] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-28T17:16:21.553488] [DEBUG] [LOCAL ] AR: No derivative data file found to delete. [2025-10-28T17:16:21.553546] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. AR took 22.6s. Estimated remaining: 4h 27m 25s. Rate: 8.3 symbols/min [2025-10-28T17:16:21.565556] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-28T17:16:21.751478] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:21.814265] [DEBUG] [LOCAL ] ARCO: Loaded 44014 existing records from primary storage. [2025-10-28T17:16:21.814575] [INFO ] [MAIN ] ARCO: Loaded 44014 existing records. [2025-10-28T17:16:22.010985] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:22.011338] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-28T17:16:22.011446] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-28T17:16:22.012226] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-28T17:16:22.012337] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-28T17:16:22.144883] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:16:22.209971] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:16:22.364417] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-28T17:16:22.435762] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:23.159379] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-28T17:16:23.610865] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:16:23.612273] [INFO ] [REMOTE ] AQNB: Full fetch complete (5344 records). [2025-10-28T17:16:23.612367] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-28T17:16:23.964552] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-28T17:16:24.136042] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:16:24.204543] [INFO ] [REMOTE ] AQN: Full fetch complete (75289 records). [2025-10-28T17:16:24.234893] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-28T17:16:24.269237] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-28T17:16:24.269360] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-28T17:16:24.269698] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-28T17:16:24.275416] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-28T17:16:24.323442] [DEBUG] [LOCAL ] AQNB: Trimmed 5344 records to 3742 (keeping 200 days of data) [2025-10-28T17:16:24.514687] [DEBUG] [LOCAL ] AQNB: Primary data saved (3742 records). [2025-10-28T17:16:24.521146] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-28T17:16:24.542482] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. AQNB took 31.0s. Estimated remaining: 4h 26m 10s. Rate: 8.4 symbols/min [2025-10-28T17:16:24.781480] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-28T17:16:24.933063] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-28T17:16:24.943177] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-28T17:16:24.946533] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-28T17:16:24.962634] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-28T17:16:24.964199] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:24.966271] [DEBUG] [LOCAL ] AQN: Trimmed 75289 records to 51564 (keeping 200 days of data) [2025-10-28T17:16:25.040567] [DEBUG] [LOCAL ] ARDC: Loaded 14965 existing records from primary storage. [2025-10-28T17:16:25.041212] [INFO ] [MAIN ] ARDC: Loaded 14965 existing records. [2025-10-28T17:16:25.288339] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:25.299412] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-28T17:16:25.299549] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-28T17:16:25.299937] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-28T17:16:25.299997] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-28T17:16:25.742771] [DEBUG] [LOCAL ] AQN: Primary data saved (51564 records). [2025-10-28T17:16:25.760426] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-28T17:16:25.779491] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 33.5s. Estimated remaining: 4h 24m 27s. Rate: 8.4 symbols/min [2025-10-28T17:16:25.922998] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:25.976940] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-28T17:16:25.975277] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-28T17:16:26.082559] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:26.115354] [DEBUG] [LOCAL ] ARDT: Loaded 27328 existing records from primary storage. [2025-10-28T17:16:26.115604] [INFO ] [MAIN ] ARDT: Loaded 27328 existing records. [2025-10-28T17:16:26.322906] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:26.323265] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-28T17:16:26.323358] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-28T17:16:26.323870] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-28T17:16:26.323933] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-28T17:16:26.364820] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-28T17:16:26.443915] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:16:26.758101] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T17:16:26.797293] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:27.159387] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-28T17:16:27.355319] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T17:16:27.959310] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-28T17:16:28.135716] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:16:28.716420] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:16:28.759357] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-28T17:16:29.510482] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:16:29.559342] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-28T17:16:30.359340] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-28T17:16:30.587471] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:16:31.159337] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-28T17:16:31.303035] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T17:16:31.768473] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T17:16:31.781095] [INFO ] [REMOTE ] APTV: Full fetch complete (75713 records). [2025-10-28T17:16:31.781285] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-28T17:16:31.963264] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-28T17:16:32.186109] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-28T17:16:32.186205] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-28T17:16:32.186966] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-28T17:16:32.187029] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-28T17:16:32.188414] [DEBUG] [LOCAL ] APTV: Trimmed 75713 records to 51726 (keeping 200 days of data) [2025-10-28T17:16:32.485530] [DEBUG] [LOCAL ] APTV: Primary data saved (51726 records). [2025-10-28T17:16:32.485692] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-28T17:16:32.485788] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. APTV took 41.9s. Estimated remaining: 4h 24m 13s. Rate: 8.4 symbols/min [2025-10-28T17:16:32.659191] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:32.659421] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-28T17:16:32.659492] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-28T17:16:32.659639] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-28T17:16:32.659734] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-28T17:16:32.659821] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-28T17:16:32.659891] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-28T17:16:32.767706] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-28T17:16:33.025922] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:16:33.072263] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:33.559400] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-28T17:16:34.117290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:16:34.359399] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-28T17:16:34.952035] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:16:35.125290] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T17:16:35.159328] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-28T17:16:35.959338] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-28T17:16:36.465032] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:16:36.759371] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-28T17:16:37.349759] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:16:37.559323] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-28T17:16:37.707430] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:16:38.286389] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:16:38.359370] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-28T17:16:39.159338] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-28T17:16:39.715560] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:16:39.959356] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-28T17:16:40.464607] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:16:40.569857] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:16:40.759345] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-28T17:16:41.559351] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-28T17:16:41.940500] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:16:42.359349] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-28T17:16:42.714019] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:16:43.159362] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-28T17:16:43.884249] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T17:16:43.959348] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-28T17:16:44.081111] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T17:16:44.759360] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-28T17:16:45.084896] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T17:16:45.559385] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-28T17:16:45.892385] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T17:16:46.356204] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T17:16:46.360877] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-28T17:16:47.159383] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-28T17:16:47.959357] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-28T17:16:48.155132] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T17:16:48.395535] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:16:48.759362] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-28T17:16:48.918297] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:16:49.559330] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-28T17:16:50.231995] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T17:16:50.283236] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:16:50.293188] [INFO ] [REMOTE ] ARCO: Full fetch complete (64678 records). [2025-10-28T17:16:50.293346] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-28T17:16:50.364468] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-28T17:16:50.682604] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-28T17:16:50.682711] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-28T17:16:50.683845] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-28T17:16:50.683909] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-28T17:16:50.685381] [DEBUG] [LOCAL ] ARCO: Trimmed 64678 records to 43944 (keeping 200 days of data) [2025-10-28T17:16:50.957067] [DEBUG] [LOCAL ] ARCO: Primary data saved (43944 records). [2025-10-28T17:16:50.957189] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-28T17:16:50.959294] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. ARCO took 29.4s. Estimated remaining: 4h 27m 7s. Rate: 8.3 symbols/min [2025-10-28T17:16:51.134420] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:51.159348] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-28T17:16:51.208623] [DEBUG] [LOCAL ] ARES: Loaded 49601 existing records from primary storage. [2025-10-28T17:16:51.208948] [INFO ] [MAIN ] ARES: Loaded 49601 existing records. [2025-10-28T17:16:51.390167] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:51.390387] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-28T17:16:51.390434] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-28T17:16:51.391301] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-28T17:16:51.391359] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-28T17:16:51.747381] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:51.947606] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T17:16:51.959299] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-28T17:16:52.135263] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:16:52.759335] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-28T17:16:53.184400] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:16:53.559331] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-28T17:16:53.641363] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:16:54.359326] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-28T17:16:54.978689] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T17:16:55.142005] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:16:55.146112] [INFO ] [REMOTE ] ARDC: Full fetch complete (21652 records). [2025-10-28T17:16:55.146222] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-28T17:16:55.167412] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-28T17:16:55.513523] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-28T17:16:55.513599] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-28T17:16:55.513915] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-28T17:16:55.513974] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-28T17:16:55.514506] [DEBUG] [LOCAL ] ARDC: Trimmed 21652 records to 14875 (keeping 200 days of data) [2025-10-28T17:16:55.602430] [DEBUG] [LOCAL ] ARDC: Primary data saved (14875 records). [2025-10-28T17:16:55.602553] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-28T17:16:55.602630] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. ARDC took 31.0s. Estimated remaining: 4h 26m 19s. Rate: 8.4 symbols/min [2025-10-28T17:16:55.771491] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:55.807413] [DEBUG] [LOCAL ] ARI: Loaded 43209 existing records from primary storage. [2025-10-28T17:16:55.807727] [INFO ] [MAIN ] ARI: Loaded 43209 existing records. [2025-10-28T17:16:55.967423] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-28T17:16:55.987813] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:55.988616] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-28T17:16:55.988700] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-28T17:16:55.989405] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-28T17:16:55.989464] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-28T17:16:56.350697] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:56.491972] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T17:16:56.759349] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-28T17:16:57.118727] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:16:57.559340] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-28T17:16:57.763790] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:16:57.769702] [INFO ] [REMOTE ] ARDT: Full fetch complete (41627 records). [2025-10-28T17:16:57.769793] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-28T17:16:57.770294] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:16:57.770378] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:16:57.770425] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:16:57.770463] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-28T17:16:57.770539] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-10-28T17:16:57.770583] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-10-28T17:16:57.771494] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-10-28T17:16:57.771582] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 31.9s. Estimated remaining: 4h 24m 53s. Rate: 8.4 symbols/min [2025-10-28T17:16:57.942083] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:57.942245] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-28T17:16:57.942281] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-28T17:16:57.942385] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-28T17:16:57.942425] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-28T17:16:57.942468] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-28T17:16:57.942527] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-28T17:16:58.294439] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:58.359335] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-28T17:16:58.666221] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:16:59.159326] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-28T17:16:59.418801] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T17:16:59.959332] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-28T17:17:00.759311] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-28T17:17:00.810368] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T17:17:01.559329] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-28T17:17:01.942637] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T17:17:01.953342] [INFO ] [REMOTE ] ARE: Full fetch complete (72670 records). [2025-10-28T17:17:01.953491] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-28T17:17:01.954150] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:17:01.954233] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:17:01.954274] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:17:01.954338] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-28T17:17:01.954401] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-28T17:17:01.954436] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-28T17:17:01.954475] [DEBUG] [LOCAL ] ARE: No derivative data file found to delete. [2025-10-28T17:17:01.954530] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 29.5s. Estimated remaining: 4h 24m 0s. Rate: 8.4 symbols/min [2025-10-28T17:17:02.076378] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T17:17:02.152099] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:02.193140] [DEBUG] [LOCAL ] ARMK: Loaded 50218 existing records from primary storage. [2025-10-28T17:17:02.193462] [INFO ] [MAIN ] ARMK: Loaded 50218 existing records. [2025-10-28T17:17:02.364694] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-28T17:17:02.369686] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:17:02.370581] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-28T17:17:02.370674] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-28T17:17:02.371437] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-28T17:17:02.371507] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-28T17:17:02.739846] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:02.763155] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:17:03.159334] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-28T17:17:03.550565] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:17:03.959336] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-28T17:17:04.272813] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:17:04.759374] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-28T17:17:05.032321] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T17:17:05.559333] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-28T17:17:05.959746] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:17:06.359339] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-28T17:17:07.159375] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-28T17:17:07.237025] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:17:07.531230] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:17:07.959350] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-28T17:17:08.621437] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:17:08.759334] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-28T17:17:09.559369] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-28T17:17:09.651958] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T17:17:10.369070] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-28T17:17:10.391173] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T17:17:10.741952] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T17:17:11.159384] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-28T17:17:11.762617] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:17:11.959309] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-28T17:17:12.566985] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:17:12.759329] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-28T17:17:13.180600] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T17:17:13.559335] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-28T17:17:14.157339] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:17:14.359330] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-28T17:17:14.522936] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T17:17:15.159319] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-28T17:17:15.686759] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:17:15.959327] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-28T17:17:16.250475] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:17:16.759333] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-28T17:17:17.276088] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:17:17.559343] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-28T17:17:17.819504] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:17:18.359326] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-28T17:17:18.735510] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:17:19.159338] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-28T17:17:19.443540] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T17:17:19.959374] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-28T17:17:20.514513] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:17:20.759344] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-28T17:17:21.172582] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:17:21.559447] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-28T17:17:22.099846] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:17:22.359317] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-28T17:17:22.685760] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T17:17:23.159404] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-28T17:17:23.691479] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:17:23.959374] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-28T17:17:24.260427] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:17:24.759396] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-28T17:17:25.559320] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-28T17:17:25.842395] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-28T17:17:25.852905] [INFO ] [REMOTE ] ARES: Full fetch complete (71802 records). [2025-10-28T17:17:25.853064] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-28T17:17:26.243398] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-28T17:17:26.243504] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-28T17:17:26.244300] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-28T17:17:26.244380] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-28T17:17:26.253614] [DEBUG] [LOCAL ] ARES: Trimmed 71802 records to 49590 (keeping 200 days of data) [2025-10-28T17:17:26.270841] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:17:26.367781] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-28T17:17:26.373751] [INFO ] [REMOTE ] ARLO: Full fetch complete (63245 records). [2025-10-28T17:17:26.380328] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-28T17:17:27.057862] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-28T17:17:27.064540] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-28T17:17:27.068727] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-28T17:17:27.068823] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-28T17:17:27.079254] [DEBUG] [LOCAL ] ARES: Primary data saved (49590 records). [2025-10-28T17:17:27.079699] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-28T17:17:27.080841] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARES took 36.1s. Estimated remaining: 4h 28m 31s. Rate: 8.3 symbols/min [2025-10-28T17:17:27.126860] [DEBUG] [LOCAL ] ARLO: Trimmed 63245 records to 43466 (keeping 200 days of data) [2025-10-28T17:17:27.370406] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:17:27.398832] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:27.446023] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-28T17:17:27.619013] [DEBUG] [LOCAL ] ARLO: Primary data saved (43466 records). [2025-10-28T17:17:27.619542] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-28T17:17:27.633075] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARLO took 29.9s. Estimated remaining: 4h 26m 41s. Rate: 8.3 symbols/min [2025-10-28T17:17:27.657084] [DEBUG] [LOCAL ] AROC: Loaded 49007 existing records from primary storage. [2025-10-28T17:17:27.675375] [INFO ] [MAIN ] AROC: Loaded 49007 existing records. [2025-10-28T17:17:27.950167] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T17:17:28.017616] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:28.037329] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:17:28.037843] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-28T17:17:28.038381] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-28T17:17:28.038307] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-28T17:17:28.038541] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-28T17:17:28.038714] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-28T17:17:28.038900] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-28T17:17:28.040007] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-28T17:17:28.040101] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-28T17:17:28.040153] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-28T17:17:28.045800] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-28T17:17:28.087391] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-28T17:17:28.732495] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:28.771364] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-28T17:17:28.811700] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:28.859579] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:17:29.369420] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:17:29.377719] [INFO ] [REMOTE ] ARI: Full fetch complete (62136 records). [2025-10-28T17:17:29.377843] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-28T17:17:29.567608] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-28T17:17:29.759208] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-28T17:17:29.759279] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-28T17:17:29.759904] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-28T17:17:29.759964] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-28T17:17:29.761121] [DEBUG] [LOCAL ] ARI: Trimmed 62136 records to 43095 (keeping 200 days of data) [2025-10-28T17:17:30.004732] [DEBUG] [LOCAL ] ARI: Primary data saved (43095 records). [2025-10-28T17:17:30.004851] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-28T17:17:30.004924] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARI took 34.4s. Estimated remaining: 4h 25m 20s. Rate: 8.4 symbols/min [2025-10-28T17:17:30.171034] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:30.171209] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-28T17:17:30.171246] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-28T17:17:30.171351] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-28T17:17:30.171391] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-28T17:17:30.171430] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-28T17:17:30.171461] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-28T17:17:30.376898] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-28T17:17:30.526827] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:30.585141] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T17:17:30.938031] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:17:31.159394] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-28T17:17:31.836669] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:17:31.852433] [INFO ] [REMOTE ] ARMK: Full fetch complete (72919 records). [2025-10-28T17:17:31.852684] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-28T17:17:31.964627] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-28T17:17:32.446242] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-28T17:17:32.446392] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-28T17:17:32.447777] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-28T17:17:32.447865] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-28T17:17:32.449874] [DEBUG] [LOCAL ] ARMK: Trimmed 72919 records to 50219 (keeping 200 days of data) [2025-10-28T17:17:32.741890] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:17:32.760792] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-28T17:17:32.819262] [DEBUG] [LOCAL ] ARMK: Primary data saved (50219 records). [2025-10-28T17:17:32.819369] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-28T17:17:32.819444] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARMK took 30.9s. Estimated remaining: 4h 24m 7s. Rate: 8.4 symbols/min [2025-10-28T17:17:32.986806] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:32.986980] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-28T17:17:32.987060] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-28T17:17:32.987140] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-28T17:17:32.987176] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-28T17:17:32.987243] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-28T17:17:32.987298] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-28T17:17:33.366113] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:33.392992] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T17:17:33.559334] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-28T17:17:33.788031] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:17:33.788314] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-28T17:17:33.788397] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:17:33.788451] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-28T17:17:33.788525] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:17:33.788595] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-28T17:17:33.788681] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-28T17:17:33.788738] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-28T17:17:33.788781] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-28T17:17:33.788827] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. ARX took 1.0s. Estimated remaining: 4h 22m 28s. Rate: 8.5 symbols/min [2025-10-28T17:17:33.962941] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:34.010638] [DEBUG] [LOCAL ] AS: Loaded 53194 existing records from primary storage. [2025-10-28T17:17:34.011003] [INFO ] [MAIN ] AS: Loaded 53194 existing records. [2025-10-28T17:17:34.193230] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:17:34.221473] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-28T17:17:34.222141] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-28T17:17:34.223319] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:17:34.233350] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-28T17:17:34.233824] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-28T17:17:34.373028] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-28T17:17:34.590022] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:35.159351] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-28T17:17:35.959369] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-28T17:17:36.542568] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:17:36.727630] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-28T17:17:36.759292] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-28T17:17:37.393670] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:17:37.559334] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-28T17:17:37.785806] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:17:38.359350] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-28T17:17:39.159325] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-28T17:17:39.514287] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:17:39.959363] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-28T17:17:40.645787] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-10-28T17:17:40.736196] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:17:40.759296] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-28T17:17:41.181807] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:17:41.559331] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-28T17:17:42.359325] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-28T17:17:42.514468] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T17:17:43.159331] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-28T17:17:43.320741] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T17:17:43.691152] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:17:43.959395] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-28T17:17:44.706028] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:17:44.759381] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-28T17:17:44.976631] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:17:45.559344] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-28T17:17:46.068556] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:17:46.359342] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-28T17:17:47.152902] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T17:17:47.163098] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-28T17:17:47.408565] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T17:17:47.959349] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-28T17:17:48.769611] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-28T17:17:48.772987] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T17:17:48.836169] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:17:49.559334] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-28T17:17:50.249588] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T17:17:50.359384] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-28T17:17:51.159332] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-28T17:17:51.279219] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T17:17:51.959301] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-28T17:17:52.037912] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T17:17:52.226558] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-28T17:17:52.759351] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-28T17:17:53.058701] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:17:53.559390] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-28T17:17:54.106857] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T17:17:54.359408] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-28T17:17:54.996583] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:17:55.159355] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-28T17:17:55.943438] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:17:55.953745] [INFO ] [REMOTE ] ARR: Full fetch complete (75152 records). [2025-10-28T17:17:55.953875] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-28T17:17:55.954500] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:17:55.954579] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:17:55.954623] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:17:55.954726] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-28T17:17:55.954803] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-28T17:17:55.954851] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-28T17:17:55.954912] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-10-28T17:17:55.954991] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. ARR took 28.3s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-28T17:17:55.966126] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-28T17:17:56.135774] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:56.136015] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-28T17:17:56.136101] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-28T17:17:56.136435] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-28T17:17:56.136612] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-28T17:17:56.136745] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-28T17:17:56.136969] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-28T17:17:56.263256] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:17:56.521897] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:56.759350] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-28T17:17:57.396453] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:17:57.559318] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-28T17:17:58.165812] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:17:58.359361] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-28T17:17:58.884612] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:17:59.159327] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-28T17:17:59.959318] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-28T17:18:00.027027] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T17:18:00.037424] [INFO ] [REMOTE ] AROC: Full fetch complete (71457 records). [2025-10-28T17:18:00.037569] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-28T17:18:00.439047] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-28T17:18:00.439206] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-28T17:18:00.440013] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-28T17:18:00.440093] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-28T17:18:00.458532] [DEBUG] [LOCAL ] AROC: Trimmed 71457 records to 48992 (keeping 200 days of data) [2025-10-28T17:18:00.472382] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:18:00.541861] [INFO ] [REMOTE ] ARW: Full fetch complete (48704 records). [2025-10-28T17:18:00.569284] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-28T17:18:00.766505] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-28T17:18:01.088099] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-28T17:18:01.088674] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-28T17:18:01.089254] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-28T17:18:01.089330] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-28T17:18:01.122848] [DEBUG] [LOCAL ] ARW: Trimmed 48704 records to 32848 (keeping 200 days of data) [2025-10-28T17:18:01.282186] [DEBUG] [LOCAL ] AROC: Primary data saved (48992 records). [2025-10-28T17:18:01.282924] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-28T17:18:01.283686] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. AROC took 34.2s. Estimated remaining: 4h 25m 30s. Rate: 8.3 symbols/min [2025-10-28T17:18:01.545071] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:01.554531] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-28T17:18:01.556456] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-28T17:18:01.557054] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-28T17:18:01.557192] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-28T17:18:01.556593] [DEBUG] [LOCAL ] ARW: Primary data saved (32848 records). [2025-10-28T17:18:01.557927] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-28T17:18:01.557837] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-28T17:18:01.558226] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-28T17:18:01.563724] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ARW took 31.6s. Estimated remaining: 4h 23m 41s. Rate: 8.4 symbols/min [2025-10-28T17:18:01.631790] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T17:18:01.701020] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-28T17:18:01.996636] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:02.029520] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-28T17:18:02.072240] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-28T17:18:02.102434] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-28T17:18:02.102768] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-28T17:18:02.127331] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-28T17:18:02.114798] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-28T17:18:02.127485] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-28T17:18:02.190663] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:02.362603] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-28T17:18:02.545121] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:02.553709] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T17:18:03.159378] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-28T17:18:03.772143] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T17:18:03.959347] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-28T17:18:04.145850] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:18:04.759380] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-28T17:18:05.445103] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:18:05.559344] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-28T17:18:06.367624] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-28T17:18:06.385478] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T17:18:07.159436] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-28T17:18:07.389102] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-28T17:18:07.914321] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:18:07.959337] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-28T17:18:08.025276] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:18:08.036919] [INFO ] [REMOTE ] AS: Full fetch complete (76944 records). [2025-10-28T17:18:08.037110] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-28T17:18:08.431809] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-28T17:18:08.431899] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-28T17:18:08.432778] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-28T17:18:08.432874] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-28T17:18:08.434413] [DEBUG] [LOCAL ] AS: Trimmed 76944 records to 53194 (keeping 200 days of data) [2025-10-28T17:18:08.738791] [DEBUG] [LOCAL ] AS: Primary data saved (53194 records). [2025-10-28T17:18:08.738939] [INFO ] [MAIN ] AS: Full history saved. [2025-10-28T17:18:08.739061] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. AS took 35.0s. Estimated remaining: 4h 23m 35s. Rate: 8.4 symbols/min [2025-10-28T17:18:08.769334] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-28T17:18:08.906015] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:08.911288] [DEBUG] [LOCAL ] ASBA: Loaded 3407 existing records from primary storage. [2025-10-28T17:18:08.911440] [INFO ] [MAIN ] ASBA: Loaded 3407 existing records. [2025-10-28T17:18:09.085043] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:18:09.085271] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-28T17:18:09.085318] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-28T17:18:09.085469] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-28T17:18:09.085508] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-28T17:18:09.446147] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:09.533552] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T17:18:09.559313] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-28T17:18:10.067676] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:18:10.364137] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-28T17:18:10.365743] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T17:18:10.789961] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:18:11.159339] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-28T17:18:11.778156] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T17:18:11.959345] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-28T17:18:12.759352] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-28T17:18:13.559333] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-28T17:18:13.595076] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T17:18:13.635892] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:18:14.035560] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T17:18:14.359329] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-28T17:18:15.159346] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-28T17:18:15.537325] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T17:18:15.741363] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:18:15.959349] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-28T17:18:16.759315] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-28T17:18:17.086383] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T17:18:17.553999] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T17:18:17.564258] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-28T17:18:18.009562] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:18:18.359267] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-28T17:18:19.159394] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-28T17:18:19.964775] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-28T17:18:19.970962] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:18:20.271383] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:18:20.407535] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T17:18:20.759364] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-28T17:18:21.559337] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-28T17:18:22.228740] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T17:18:22.359308] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-28T17:18:22.660960] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T17:18:23.159336] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-28T17:18:23.860332] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:18:23.959397] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-28T17:18:24.317385] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:18:24.655053] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:18:24.759329] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-28T17:18:25.419989] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T17:18:25.559334] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-28T17:18:26.359363] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-28T17:18:26.694075] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T17:18:27.159352] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-28T17:18:27.527693] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:18:27.959347] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-28T17:18:28.759403] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-28T17:18:29.384348] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:18:29.534619] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T17:18:29.559324] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-28T17:18:30.359360] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-28T17:18:30.672264] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:18:30.677595] [INFO ] [REMOTE ] ASA: Full fetch complete (21057 records). [2025-10-28T17:18:30.677728] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-28T17:18:31.035351] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-28T17:18:31.035442] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-28T17:18:31.035777] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-28T17:18:31.035838] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-28T17:18:31.036419] [DEBUG] [LOCAL ] ASA: Trimmed 21057 records to 15914 (keeping 200 days of data) [2025-10-28T17:18:31.126252] [DEBUG] [LOCAL ] ASA: Primary data saved (15914 records). [2025-10-28T17:18:31.126369] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-28T17:18:31.126453] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. ASA took 35.2s. Estimated remaining: 4h 27m 8s. Rate: 8.3 symbols/min [2025-10-28T17:18:31.169112] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-28T17:18:31.301397] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:31.301531] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-28T17:18:31.301567] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-28T17:18:31.301699] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-28T17:18:31.301753] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-28T17:18:31.301796] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-28T17:18:31.301830] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-28T17:18:31.658616] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:31.663027] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:18:31.796258] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T17:18:31.808177] [INFO ] [REMOTE ] ASB: Full fetch complete (72327 records). [2025-10-28T17:18:31.808375] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-28T17:18:31.973530] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-28T17:18:32.254110] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-28T17:18:32.254188] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-28T17:18:32.254885] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-28T17:18:32.254947] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-28T17:18:32.256277] [DEBUG] [LOCAL ] ASB: Trimmed 72327 records to 49640 (keeping 200 days of data) [2025-10-28T17:18:32.537986] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T17:18:32.541113] [INFO ] [REMOTE ] ASBA: Full fetch complete (5125 records). [2025-10-28T17:18:32.542012] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-28T17:18:32.683947] [DEBUG] [LOCAL ] ASB: Primary data saved (49640 records). [2025-10-28T17:18:32.706994] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-28T17:18:32.723677] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASB took 31.2s. Estimated remaining: 4h 25m 40s. Rate: 8.3 symbols/min [2025-10-28T17:18:32.770815] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-28T17:18:33.100697] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:33.108091] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-28T17:18:33.108164] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-28T17:18:33.108355] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-28T17:18:33.108393] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-28T17:18:33.108800] [DEBUG] [LOCAL ] ASBA: Trimmed 5125 records to 3412 (keeping 200 days of data) [2025-10-28T17:18:33.131136] [DEBUG] [LOCAL ] ASBA: Primary data saved (3412 records). [2025-10-28T17:18:33.136171] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-28T17:18:33.136298] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASBA took 24.4s. Estimated remaining: 4h 23m 56s. Rate: 8.4 symbols/min [2025-10-28T17:18:33.249104] [DEBUG] [LOCAL ] ASG: Loaded 19127 existing records from primary storage. [2025-10-28T17:18:33.260100] [INFO ] [MAIN ] ASG: Loaded 19127 existing records. [2025-10-28T17:18:33.431304] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:33.441740] [DEBUG] [LOCAL ] ASGI: No existing data file found in primary storage. [2025-10-28T17:18:33.459274] [WARN ] [MAIN ] ASGI: No existing data found, performing full refresh instead. [2025-10-28T17:18:33.459417] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-28T17:18:33.469533] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-28T17:18:33.478390] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-28T17:18:33.493752] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-28T17:18:33.531619] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:18:33.570539] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-28T17:18:33.581737] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-28T17:18:33.601412] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-28T17:18:33.604144] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-28T17:18:34.129536] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:34.141451] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-28T17:18:34.235730] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:34.258560] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T17:18:34.359318] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-28T17:18:35.130322] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:18:35.159299] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-28T17:18:35.356882] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:18:35.783255] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T17:18:35.959359] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-28T17:18:36.759337] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-28T17:18:37.531527] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:18:37.559311] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-28T17:18:38.359337] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-28T17:18:38.462161] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T17:18:39.009449] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T17:18:39.159317] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-28T17:18:39.959371] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-28T17:18:40.178109] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T17:18:40.657668] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T17:18:40.759312] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-28T17:18:41.463140] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:18:41.559348] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-28T17:18:42.359327] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-28T17:18:42.425515] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T17:18:42.628891] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (16.27 seconds). [2025-10-28T17:18:43.038064] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:18:43.159325] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-28T17:18:43.767904] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T17:18:43.959322] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-28T17:18:44.759382] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-28T17:18:45.415245] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:18:45.559363] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-28T17:18:46.359413] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-28T17:18:47.368904] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T17:18:47.380097] [INFO ] [REMOTE ] ASAN: Full fetch complete (76615 records). [2025-10-28T17:18:47.380271] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-28T17:18:47.776846] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-28T17:18:47.776927] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-28T17:18:47.777673] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-28T17:18:47.777739] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-28T17:18:47.779325] [DEBUG] [LOCAL ] ASAN: Trimmed 76615 records to 52705 (keeping 200 days of data) [2025-10-28T17:18:48.086480] [DEBUG] [LOCAL ] ASAN: Primary data saved (52705 records). [2025-10-28T17:18:48.086612] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-28T17:18:48.086715] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASAN took 46.8s. Estimated remaining: 4h 25m 39s. Rate: 8.3 symbols/min [2025-10-28T17:18:48.250230] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:48.283254] [DEBUG] [LOCAL ] ASGN: Loaded 36722 existing records from primary storage. [2025-10-28T17:18:48.283555] [INFO ] [MAIN ] ASGN: Loaded 36722 existing records. [2025-10-28T17:18:48.453944] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:18:48.454156] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-28T17:18:48.454203] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-28T17:18:48.454487] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-28T17:18:48.454528] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-28T17:18:48.800003] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:48.800303] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-28T17:18:49.305704] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (13.35 seconds). [2025-10-28T17:18:49.314240] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-28T17:18:49.645271] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:18:49.651947] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-28T17:18:50.305264] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:18:50.318558] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-28T17:18:50.622153] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T17:18:50.630358] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-28T17:18:51.217203] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:18:51.225454] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-28T17:18:51.647253] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:18:51.959347] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-28T17:18:52.241971] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:18:52.759372] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-28T17:18:52.862439] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:18:53.559352] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-28T17:18:54.402325] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T17:18:54.409348] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-28T17:18:55.271981] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T17:18:55.279241] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-28T17:18:56.242008] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T17:18:56.250512] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-28T17:18:57.192431] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:18:57.205414] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-28T17:19:00.820746] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (16.06 seconds). [2025-10-28T17:19:00.826128] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-28T17:19:01.499315] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (15.14 seconds). [2025-10-28T17:19:01.504127] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-28T17:19:01.732279] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:19:01.737884] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-28T17:19:02.442780] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:19:02.448768] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-28T17:19:02.560561] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T17:19:02.564928] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-28T17:19:03.382993] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:19:03.388290] [INFO ] [REMOTE ] ASGI: Full fetch complete (32672 records). [2025-10-28T17:19:03.388459] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-28T17:19:03.589616] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:19:03.683188] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-28T17:19:03.808730] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-28T17:19:03.808830] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-28T17:19:03.809284] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-28T17:19:03.809351] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-28T17:19:03.810402] [DEBUG] [LOCAL ] ASGI: Trimmed 32672 records to 22642 (keeping 200 days of data) [2025-10-28T17:19:03.944474] [DEBUG] [LOCAL ] ASGI: Primary data saved (22642 records). [2025-10-28T17:19:03.944596] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-28T17:19:03.944685] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASGI took 30.8s. Estimated remaining: 4h 27m 33s. Rate: 8.3 symbols/min [2025-10-28T17:19:04.502636] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:19:04.506694] [INFO ] [REMOTE ] ASG: Full fetch complete (30809 records). [2025-10-28T17:19:04.506774] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-28T17:19:04.863507] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-28T17:19:04.863586] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-28T17:19:04.863981] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-28T17:19:04.864042] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-28T17:19:04.864736] [DEBUG] [LOCAL ] ASG: Trimmed 30809 records to 19022 (keeping 200 days of data) [2025-10-28T17:19:04.969747] [DEBUG] [LOCAL ] ASG: Primary data saved (19022 records). [2025-10-28T17:19:04.969894] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-28T17:19:04.969973] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASG took 32.2s. Estimated remaining: 4h 25m 59s. Rate: 8.3 symbols/min [2025-10-28T17:19:06.191249] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (13.43 seconds). [2025-10-28T17:19:06.199433] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-28T17:19:07.650969] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:19:07.682603] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-28T17:19:07.683327] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (10.48 seconds). [2025-10-28T17:19:07.692628] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-28T17:19:08.627761] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:19:08.635754] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-28T17:19:09.139909] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:19:09.148282] [INFO ] [REMOTE ] ASGN: Full fetch complete (53937 records). [2025-10-28T17:19:09.148373] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-28T17:19:09.526143] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-28T17:19:09.526217] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-28T17:19:09.526774] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-28T17:19:09.526835] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-28T17:19:09.527971] [DEBUG] [LOCAL ] ASGN: Trimmed 53937 records to 36761 (keeping 200 days of data) [2025-10-28T17:19:09.738954] [DEBUG] [LOCAL ] ASGN: Primary data saved (36761 records). [2025-10-28T17:19:09.739101] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-28T17:19:09.739267] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASGN took 21.7s. Estimated remaining: 4h 25m 17s. Rate: 8.3 symbols/min [2025-10-28T17:19:09.759858] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:19:09.767562] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-28T17:19:11.053217] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:19:11.060797] [INFO ] [REMOTE ] ASC: Full fetch complete (55843 records). [2025-10-28T17:19:11.060920] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-28T17:19:11.529337] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-28T17:19:11.529457] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-28T17:19:11.530534] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-28T17:19:11.530619] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-28T17:19:11.532382] [DEBUG] [LOCAL ] ASC: Trimmed 55843 records to 36901 (keeping 200 days of data) [2025-10-28T17:19:11.877996] [DEBUG] [LOCAL ] ASC: Primary data saved (36901 records). [2025-10-28T17:19:11.878190] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-28T17:19:11.878301] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASC took 40.8s. Estimated remaining: 4h 24m 0s. Rate: 8.4 symbols/min [2025-10-28T17:19:12.546206] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.563052] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.648421] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.680813] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.707972] [DEBUG] [LOCAL ] ASR: Loaded 9374 existing records from primary storage. [2025-10-28T17:19:12.717096] [DEBUG] [LOCAL ] ASIX: Loaded 22673 existing records from primary storage. [2025-10-28T17:19:12.715875] [INFO ] [MAIN ] ASR: Loaded 9374 existing records. [2025-10-28T17:19:12.717572] [INFO ] [MAIN ] ASIX: Loaded 22673 existing records. [2025-10-28T17:19:12.919215] [DEBUG] [LOCAL ] ASH: Loaded 37142 existing records from primary storage. [2025-10-28T17:19:12.983387] [INFO ] [MAIN ] ASH: Loaded 37142 existing records. [2025-10-28T17:19:13.004864] [DEBUG] [LOCAL ] ASPN: Loaded 49804 existing records from primary storage. [2025-10-28T17:19:13.005801] [INFO ] [MAIN ] ASPN: Loaded 49804 existing records. [2025-10-28T17:19:13.316190] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.369277] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.398635] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.404170] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-28T17:19:13.409808] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.420540] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-28T17:19:13.431161] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-28T17:19:13.455116] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-28T17:19:13.465681] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-28T17:19:13.542751] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-28T17:19:13.595385] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.662178] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.682728] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.694330] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.699601] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-28T17:19:13.755019] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-28T17:19:13.760801] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-28T17:19:13.766149] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-28T17:19:13.776041] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-28T17:19:13.792889] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-28T17:19:14.683196] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:14.732700] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-28T17:19:14.893285] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:14.931970] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-28T17:19:15.018766] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:15.025296] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-28T17:19:15.098463] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:15.098820] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-28T17:19:15.482721] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:19:15.484561] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-28T17:19:15.784012] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:19:15.788006] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-28T17:19:16.310684] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:19:16.312685] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-28T17:19:16.432548] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:19:16.442921] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-28T17:19:16.503303] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:19:16.511277] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-28T17:19:16.537938] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:19:16.541530] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-28T17:19:17.098385] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:19:17.101436] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-28T17:19:17.177999] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T17:19:17.182437] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-28T17:19:17.513496] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:19:17.521202] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-28T17:19:17.705553] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T17:19:17.708941] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-28T17:19:18.022229] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:19:18.032947] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-28T17:19:18.048370] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:19:18.197972] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:19:18.359324] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-28T17:19:18.732096] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:19:18.930563] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T17:19:19.159349] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-28T17:19:19.425738] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:19:19.959458] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-28T17:19:20.239328] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:19:20.759353] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-28T17:19:21.186944] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:19:21.484333] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:19:21.559329] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-28T17:19:22.200777] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:19:22.359350] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-28T17:19:23.120261] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:19:23.159342] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-28T17:19:23.959340] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-28T17:19:24.234036] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:19:24.707941] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T17:19:24.759299] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-28T17:19:25.430233] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:19:25.559330] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-28T17:19:26.359371] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-28T17:19:26.989387] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T17:19:27.159322] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-28T17:19:27.684240] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:19:27.959417] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-28T17:19:28.147276] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:19:28.152122] [INFO ] [REMOTE ] ASIX: Full fetch complete (31110 records). [2025-10-28T17:19:28.152217] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-28T17:19:28.542124] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-28T17:19:28.542241] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-28T17:19:28.542773] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-28T17:19:28.542920] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-28T17:19:28.551985] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T17:19:28.552144] [DEBUG] [LOCAL ] ASIX: Trimmed 31110 records to 22656 (keeping 200 days of data) [2025-10-28T17:19:28.693462] [DEBUG] [LOCAL ] ASIX: Primary data saved (22656 records). [2025-10-28T17:19:28.693595] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-28T17:19:28.693696] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASIX took 16.8s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-28T17:19:28.764522] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-28T17:19:28.871266] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:28.920167] [DEBUG] [LOCAL ] ASX: Loaded 52859 existing records from primary storage. [2025-10-28T17:19:28.920481] [INFO ] [MAIN ] ASX: Loaded 52859 existing records. [2025-10-28T17:19:29.096620] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:29.096866] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-28T17:19:29.096942] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-28T17:19:29.097537] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-28T17:19:29.097595] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-28T17:19:29.451407] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:19:29.456264] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:29.559306] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-28T17:19:30.274131] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:19:30.359343] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-28T17:19:31.002176] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T17:19:31.004272] [INFO ] [REMOTE ] ASR: Full fetch complete (12542 records). [2025-10-28T17:19:31.004342] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-28T17:19:31.004745] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:19:31.004826] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:19:31.004888] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:19:31.004973] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-28T17:19:31.005061] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-28T17:19:31.005111] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-10-28T17:19:31.005304] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-10-28T17:19:31.005402] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASR took 19.1s. Estimated remaining: 4h 24m 51s. Rate: 8.3 symbols/min [2025-10-28T17:19:31.173575] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-28T17:19:31.177722] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:31.216771] [DEBUG] [LOCAL ] ATEN: Loaded 37301 existing records from primary storage. [2025-10-28T17:19:31.217090] [INFO ] [MAIN ] ATEN: Loaded 37301 existing records. [2025-10-28T17:19:31.398412] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:31.398610] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-28T17:19:31.398684] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-28T17:19:31.399123] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-28T17:19:31.399183] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-28T17:19:31.780892] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:31.959310] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-28T17:19:32.637248] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T17:19:32.759402] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-28T17:19:33.030030] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:19:33.559374] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-28T17:19:33.983186] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T17:19:34.359389] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-28T17:19:34.452986] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T17:19:35.159340] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-28T17:19:35.622679] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:19:35.959367] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-28T17:19:36.235030] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:19:36.759344] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-28T17:19:37.420737] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:19:37.559330] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-28T17:19:37.915565] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:19:38.359340] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-28T17:19:39.159395] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-28T17:19:39.253340] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:19:39.515384] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T17:19:39.959328] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-28T17:19:40.740921] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T17:19:40.759310] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-28T17:19:41.236456] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T17:19:41.559389] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-28T17:19:42.226009] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T17:19:42.359306] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-28T17:19:42.956769] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T17:19:43.159321] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-28T17:19:43.780342] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:19:43.959390] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-28T17:19:44.205175] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:19:44.213297] [INFO ] [REMOTE ] ASH: Full fetch complete (55605 records). [2025-10-28T17:19:44.213460] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-28T17:19:44.608323] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-28T17:19:44.608396] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-28T17:19:44.608965] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-28T17:19:44.609025] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-28T17:19:44.610075] [DEBUG] [LOCAL ] ASH: Trimmed 55605 records to 37028 (keeping 200 days of data) [2025-10-28T17:19:44.770405] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-28T17:19:44.827890] [DEBUG] [LOCAL ] ASH: Primary data saved (37028 records). [2025-10-28T17:19:44.828001] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-28T17:19:44.828141] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASH took 32.9s. Estimated remaining: 4h 26m 13s. Rate: 8.3 symbols/min [2025-10-28T17:19:45.002034] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:45.054514] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T17:19:45.053500] [DEBUG] [LOCAL ] ATGE: Loaded 29886 existing records from primary storage. [2025-10-28T17:19:45.063191] [INFO ] [MAIN ] ATGE: Loaded 29886 existing records. [2025-10-28T17:19:45.238353] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:45.238548] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-28T17:19:45.238592] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-28T17:19:45.238932] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-28T17:19:45.238987] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-28T17:19:45.563541] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-28T17:19:45.584422] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:46.297353] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:19:46.307707] [INFO ] [REMOTE ] ASPN: Full fetch complete (72564 records). [2025-10-28T17:19:46.307851] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-28T17:19:46.371323] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-28T17:19:46.707003] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-28T17:19:46.707106] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-28T17:19:46.707855] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-28T17:19:46.708029] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-28T17:19:46.738514] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:19:46.737484] [DEBUG] [LOCAL ] ASPN: Trimmed 72564 records to 49760 (keeping 200 days of data) [2025-10-28T17:19:47.020726] [DEBUG] [LOCAL ] ASPN: Primary data saved (49760 records). [2025-10-28T17:19:47.020902] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-28T17:19:47.021010] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASPN took 35.1s. Estimated remaining: 4h 24m 58s. Rate: 8.3 symbols/min [2025-10-28T17:19:47.165987] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-28T17:19:47.192831] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:47.192997] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-10-28T17:19:47.193051] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-10-28T17:19:47.193157] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-28T17:19:47.193198] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-28T17:19:47.193238] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-28T17:19:47.193269] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-28T17:19:47.549718] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:47.608878] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T17:19:47.959340] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-28T17:19:48.180109] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:19:48.759349] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-28T17:19:49.498889] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T17:19:49.559300] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-28T17:19:49.815472] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T17:19:50.359307] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-28T17:19:51.032772] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T17:19:51.159320] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-28T17:19:51.495181] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:19:51.959384] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-28T17:19:52.071095] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T17:19:52.759351] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-28T17:19:53.088307] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:19:53.559349] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-28T17:19:54.160341] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:19:54.359318] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-28T17:19:54.437428] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:19:55.159310] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-28T17:19:55.508370] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:19:55.959345] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-28T17:19:56.668169] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T17:19:56.759373] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-28T17:19:56.995889] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T17:19:57.559358] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-28T17:19:58.179175] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:19:58.191317] [INFO ] [REMOTE ] ASX: Full fetch complete (76777 records). [2025-10-28T17:19:58.191491] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-28T17:19:58.364452] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-28T17:19:58.653695] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-28T17:19:58.653873] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-28T17:19:58.654961] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-28T17:19:58.655113] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-28T17:19:58.657345] [DEBUG] [LOCAL ] ASX: Trimmed 76777 records to 52851 (keeping 200 days of data) [2025-10-28T17:19:58.800776] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:19:59.109040] [DEBUG] [LOCAL ] ASX: Primary data saved (52851 records). [2025-10-28T17:19:59.109226] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-28T17:19:59.109344] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ASX took 30.4s. Estimated remaining: 4h 25m 55s. Rate: 8.3 symbols/min [2025-10-28T17:19:59.167143] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-28T17:19:59.389269] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:59.389478] [DEBUG] [LOCAL ] ATHS: No existing data file found in primary storage. [2025-10-28T17:19:59.389589] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-10-28T17:19:59.389743] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-28T17:19:59.389807] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-28T17:19:59.389876] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-10-28T17:19:59.389930] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-28T17:19:59.871203] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:59.874110] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:19:59.881815] [INFO ] [REMOTE ] ATEN: Full fetch complete (56506 records). [2025-10-28T17:19:59.881965] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-28T17:19:59.964518] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-28T17:20:00.330713] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-28T17:20:00.330815] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-28T17:20:00.331621] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-28T17:20:00.331739] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-28T17:20:00.333219] [DEBUG] [LOCAL ] ATEN: Trimmed 56506 records to 37208 (keeping 200 days of data) [2025-10-28T17:20:00.619927] [DEBUG] [LOCAL ] ATEN: Primary data saved (37208 records). [2025-10-28T17:20:00.623390] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-28T17:20:00.633128] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATEN took 29.6s. Estimated remaining: 4h 24m 32s. Rate: 8.3 symbols/min [2025-10-28T17:20:00.632936] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:20:00.634137] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:20:00.765970] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-28T17:20:00.851871] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:00.900419] [DEBUG] [LOCAL ] ATI: Loaded 51272 existing records from primary storage. [2025-10-28T17:20:00.900843] [INFO ] [MAIN ] ATI: Loaded 51272 existing records. [2025-10-28T17:20:01.109041] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:01.109255] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-28T17:20:01.109304] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-28T17:20:01.110083] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-28T17:20:01.110143] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-28T17:20:01.516885] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:01.559307] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-28T17:20:02.015430] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:20:02.359395] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-28T17:20:03.159349] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-28T17:20:03.274629] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T17:20:03.486667] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T17:20:03.711270] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T17:20:03.959368] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-28T17:20:04.759313] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-28T17:20:04.812229] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T17:20:05.559339] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-28T17:20:06.359379] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-28T17:20:06.420378] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T17:20:06.963380] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T17:20:07.159341] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-28T17:20:07.616845] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:20:07.652177] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T17:20:07.959362] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-28T17:20:08.759372] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-28T17:20:08.877484] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:20:09.559346] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-28T17:20:10.108669] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T17:20:10.359308] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-28T17:20:10.462147] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T17:20:11.159349] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-28T17:20:11.959347] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-28T17:20:12.349361] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T17:20:12.759331] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-28T17:20:13.059639] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T17:20:13.072538] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-28T17:20:13.559357] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-28T17:20:14.366429] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-28T17:20:14.369674] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:20:14.644952] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:20:14.760393] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T17:20:15.159330] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-28T17:20:15.747233] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T17:20:15.959319] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-28T17:20:16.759328] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-28T17:20:17.558384] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:20:17.568889] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-28T17:20:17.974818] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T17:20:17.985739] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T17:20:18.359334] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-28T17:20:19.159347] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-28T17:20:19.366638] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T17:20:19.372475] [INFO ] [REMOTE ] ATGE: Full fetch complete (45305 records). [2025-10-28T17:20:19.372780] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-28T17:20:19.685885] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:20:19.784003] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-28T17:20:19.784114] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-28T17:20:19.784825] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-28T17:20:19.784922] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-28T17:20:19.786320] [DEBUG] [LOCAL ] ATGE: Trimmed 45305 records to 29751 (keeping 200 days of data) [2025-10-28T17:20:19.959517] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-28T17:20:19.980695] [DEBUG] [LOCAL ] ATGE: Primary data saved (29751 records). [2025-10-28T17:20:19.980962] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-28T17:20:19.981097] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ATGE took 35.2s. Estimated remaining: 4h 27m 5s. Rate: 8.2 symbols/min [2025-10-28T17:20:20.169090] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:20.204518] [DEBUG] [LOCAL ] ATKR: Loaded 34497 existing records from primary storage. [2025-10-28T17:20:20.204964] [INFO ] [MAIN ] ATKR: Loaded 34497 existing records. [2025-10-28T17:20:20.396756] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:20:20.401778] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:20.405227] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-28T17:20:20.405288] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-28T17:20:20.405916] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-28T17:20:20.405974] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-28T17:20:20.759041] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:20.759360] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-28T17:20:21.559369] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-28T17:20:22.070776] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:20:22.087704] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T17:20:22.089608] [INFO ] [REMOTE ] ATHS: Full fetch complete (9520 records). [2025-10-28T17:20:22.089729] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-28T17:20:22.364525] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-28T17:20:22.514824] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-28T17:20:22.514925] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-28T17:20:22.515254] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-28T17:20:22.515297] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-28T17:20:22.515874] [DEBUG] [LOCAL ] ATHS: Trimmed 9520 records to 6279 (keeping 200 days of data) [2025-10-28T17:20:22.556325] [DEBUG] [LOCAL ] ATHS: Primary data saved (6279 records). [2025-10-28T17:20:22.556496] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-28T17:20:22.556583] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHS took 23.4s. Estimated remaining: 4h 25m 56s. Rate: 8.3 symbols/min [2025-10-28T17:20:22.741741] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:22.780865] [DEBUG] [LOCAL ] ATMU: Loaded 38247 existing records from primary storage. [2025-10-28T17:20:22.781234] [INFO ] [MAIN ] ATMU: Loaded 38247 existing records. [2025-10-28T17:20:23.031046] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:23.031375] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-28T17:20:23.031444] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-28T17:20:23.032260] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-28T17:20:23.032321] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-28T17:20:23.164520] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-28T17:20:23.430275] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:23.959329] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-28T17:20:24.187759] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:20:24.197339] [INFO ] [REMOTE ] ATHM: Full fetch complete (48984 records). [2025-10-28T17:20:24.197496] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-28T17:20:24.496568] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-28T17:20:24.658227] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-28T17:20:24.658314] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-28T17:20:24.658918] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-28T17:20:24.658982] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-28T17:20:24.660114] [DEBUG] [LOCAL ] ATHM: Trimmed 48984 records to 30483 (keeping 200 days of data) [2025-10-28T17:20:24.765436] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-28T17:20:24.846514] [DEBUG] [LOCAL ] ATHM: Primary data saved (30483 records). [2025-10-28T17:20:24.846690] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-28T17:20:24.846780] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHM took 37.8s. Estimated remaining: 4h 24m 44s. Rate: 8.3 symbols/min [2025-10-28T17:20:25.033405] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:25.072561] [DEBUG] [LOCAL ] ATO: Loaded 41245 existing records from primary storage. [2025-10-28T17:20:25.072873] [INFO ] [MAIN ] ATO: Loaded 41245 existing records. [2025-10-28T17:20:25.283890] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:25.289501] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T17:20:25.298156] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-28T17:20:25.298612] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-28T17:20:25.299608] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-28T17:20:25.299697] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-28T17:20:25.564569] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-28T17:20:25.674924] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:26.060832] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:20:26.359394] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-28T17:20:26.682022] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T17:20:27.159362] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-28T17:20:27.416017] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T17:20:27.959338] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-28T17:20:28.426928] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T17:20:28.759345] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-28T17:20:28.806550] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T17:20:29.559350] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-28T17:20:30.330943] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T17:20:30.359308] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-28T17:20:30.570150] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T17:20:31.159363] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-28T17:20:31.809497] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T17:20:31.959349] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-28T17:20:32.306750] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T17:20:32.759330] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-28T17:20:33.120867] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:20:33.559297] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-28T17:20:33.594902] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T17:20:34.359319] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-28T17:20:34.947505] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T17:20:34.957692] [INFO ] [REMOTE ] ATI: Full fetch complete (74231 records). [2025-10-28T17:20:34.957856] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-28T17:20:35.164484] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-28T17:20:35.365323] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-28T17:20:35.365438] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-28T17:20:35.366353] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-28T17:20:35.366436] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-28T17:20:35.368050] [DEBUG] [LOCAL ] ATI: Trimmed 74231 records to 51276 (keeping 200 days of data) [2025-10-28T17:20:35.601119] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:20:35.706988] [DEBUG] [LOCAL ] ATI: Primary data saved (51276 records). [2025-10-28T17:20:35.707118] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-28T17:20:35.707217] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATI took 35.1s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-28T17:20:35.875352] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:35.907707] [DEBUG] [LOCAL ] ATR: Loaded 30289 existing records from primary storage. [2025-10-28T17:20:35.907973] [INFO ] [MAIN ] ATR: Loaded 30289 existing records. [2025-10-28T17:20:35.969711] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-28T17:20:36.090308] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:36.090598] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-28T17:20:36.090804] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-28T17:20:36.091273] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-28T17:20:36.091334] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-28T17:20:36.437002] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:20:36.481458] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:36.759346] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-28T17:20:37.189681] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:20:37.559346] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-28T17:20:37.806322] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:20:38.359377] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-28T17:20:38.933721] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:20:39.159315] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-28T17:20:39.208169] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T17:20:39.959373] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-28T17:20:40.270594] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:20:40.759315] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-28T17:20:41.044938] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:20:41.559327] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-28T17:20:41.659283] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:20:42.359342] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-28T17:20:42.598808] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T17:20:43.164511] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-28T17:20:43.175610] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T17:20:43.959362] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-28T17:20:44.250900] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:20:44.759300] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-28T17:20:44.900621] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:20:45.559337] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-28T17:20:46.081329] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:20:46.359329] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-28T17:20:46.653536] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:20:47.159339] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-28T17:20:47.446728] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:20:47.959360] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-28T17:20:48.591041] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:20:48.759337] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-28T17:20:49.082435] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T17:20:49.097766] [INFO ] [REMOTE ] ATMU: Full fetch complete (56582 records). [2025-10-28T17:20:49.097933] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-28T17:20:49.488245] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-28T17:20:49.488337] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-28T17:20:49.488945] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-28T17:20:49.489012] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-28T17:20:49.490275] [DEBUG] [LOCAL ] ATMU: Trimmed 56582 records to 38125 (keeping 200 days of data) [2025-10-28T17:20:49.575199] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-28T17:20:49.718054] [DEBUG] [LOCAL ] ATMU: Primary data saved (38125 records). [2025-10-28T17:20:49.718195] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-28T17:20:49.718279] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATMU took 27.2s. Estimated remaining: 4h 26m 43s. Rate: 8.2 symbols/min [2025-10-28T17:20:49.909943] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:49.933380] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T17:20:49.957131] [DEBUG] [LOCAL ] ATS: Loaded 16610 existing records from primary storage. [2025-10-28T17:20:49.957456] [INFO ] [MAIN ] ATS: Loaded 16610 existing records. [2025-10-28T17:20:50.155106] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:50.155331] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-28T17:20:50.155377] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-28T17:20:50.155638] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-28T17:20:50.155730] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-28T17:20:50.364770] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-28T17:20:50.524053] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:50.617832] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:20:51.159401] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-28T17:20:51.879504] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T17:20:51.964432] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-28T17:20:51.981524] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T17:20:52.759348] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-28T17:20:53.172082] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:20:53.374949] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T17:20:53.559356] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-28T17:20:54.359330] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-28T17:20:54.473222] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T17:20:55.159337] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-28T17:20:55.542988] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:20:55.767038] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T17:20:55.959393] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-28T17:20:56.759364] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-28T17:20:57.069092] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:20:57.076097] [INFO ] [REMOTE ] ATKR: Full fetch complete (52905 records). [2025-10-28T17:20:57.076298] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-28T17:20:57.461389] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-28T17:20:57.461495] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-28T17:20:57.462055] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-28T17:20:57.462117] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-28T17:20:57.463237] [DEBUG] [LOCAL ] ATKR: Trimmed 52905 records to 34337 (keeping 200 days of data) [2025-10-28T17:20:57.568784] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-28T17:20:57.669817] [DEBUG] [LOCAL ] ATKR: Primary data saved (34337 records). [2025-10-28T17:20:57.670032] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-28T17:20:57.670120] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATKR took 37.7s. Estimated remaining: 4h 26m 44s. Rate: 8.2 symbols/min [2025-10-28T17:20:57.844274] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:57.884667] [DEBUG] [LOCAL ] ATUS: Loaded 49931 existing records from primary storage. [2025-10-28T17:20:57.884960] [INFO ] [MAIN ] ATUS: Loaded 49931 existing records. [2025-10-28T17:20:58.070534] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:58.070849] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-28T17:20:58.071014] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-28T17:20:58.071908] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-28T17:20:58.071967] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-28T17:20:58.267684] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:20:58.360132] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-28T17:20:58.382929] [INFO ] [REMOTE ] ATO: Full fetch complete (60549 records). [2025-10-28T17:20:58.391838] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-28T17:20:58.572531] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:58.880215] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-28T17:20:58.880321] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-28T17:20:58.881167] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-28T17:20:58.881315] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-28T17:20:58.899839] [DEBUG] [LOCAL ] ATO: Trimmed 60549 records to 41194 (keeping 200 days of data) [2025-10-28T17:20:58.899720] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:20:59.160972] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-28T17:20:59.166711] [DEBUG] [LOCAL ] ATO: Primary data saved (41194 records). [2025-10-28T17:20:59.166804] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-28T17:20:59.167403] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATO took 34.3s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-28T17:20:59.351206] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:59.364575] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:20:59.414264] [DEBUG] [LOCAL ] AU: Loaded 53079 existing records from primary storage. [2025-10-28T17:20:59.414599] [INFO ] [MAIN ] AU: Loaded 53079 existing records. [2025-10-28T17:20:59.587336] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:59.587535] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-28T17:20:59.587581] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-28T17:20:59.588104] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-28T17:20:59.588161] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-28T17:20:59.933504] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:59.959291] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-28T17:21:00.208588] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:21:00.759375] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-28T17:21:01.559338] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-28T17:21:01.733055] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-28T17:21:02.127585] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T17:21:02.359346] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-28T17:21:02.741299] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:21:03.031789] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:21:03.159335] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-28T17:21:03.841747] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T17:21:03.959360] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-28T17:21:04.759354] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-28T17:21:04.940836] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:21:05.559335] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-28T17:21:06.245416] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T17:21:06.359315] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-28T17:21:06.545566] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:21:06.551970] [INFO ] [REMOTE ] ATR: Full fetch complete (43983 records). [2025-10-28T17:21:06.552131] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-28T17:21:06.940953] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-28T17:21:06.941054] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-28T17:21:06.941633] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-28T17:21:06.941719] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-28T17:21:06.942886] [DEBUG] [LOCAL ] ATR: Trimmed 43983 records to 30316 (keeping 200 days of data) [2025-10-28T17:21:07.178239] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-28T17:21:07.238884] [DEBUG] [LOCAL ] ATR: Primary data saved (30316 records). [2025-10-28T17:21:07.239076] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-28T17:21:07.240754] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATR took 31.5s. Estimated remaining: 4h 25m 27s. Rate: 8.3 symbols/min [2025-10-28T17:21:07.514444] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:07.585021] [DEBUG] [LOCAL ] AUB: Loaded 45688 existing records from primary storage. [2025-10-28T17:21:07.585476] [INFO ] [MAIN ] AUB: Loaded 45688 existing records. [2025-10-28T17:21:07.817027] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:07.818519] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-28T17:21:07.818820] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-28T17:21:07.820087] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-28T17:21:07.820362] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-28T17:21:07.972697] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-28T17:21:07.985089] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:21:08.278236] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-28T17:21:08.364189] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:08.759327] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-28T17:21:09.348670] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:21:09.559333] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-28T17:21:09.701461] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:21:10.359338] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-28T17:21:10.757307] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:21:11.045476] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:21:11.048465] [INFO ] [REMOTE ] ATS: Full fetch complete (25157 records). [2025-10-28T17:21:11.048561] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-28T17:21:11.164526] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-28T17:21:11.432475] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-28T17:21:11.432554] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-28T17:21:11.432985] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-28T17:21:11.433055] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-28T17:21:11.433778] [DEBUG] [LOCAL ] ATS: Trimmed 25157 records to 16453 (keeping 200 days of data) [2025-10-28T17:21:11.525602] [DEBUG] [LOCAL ] ATS: Primary data saved (16453 records). [2025-10-28T17:21:11.525754] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-28T17:21:11.525838] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATS took 21.8s. Estimated remaining: 4h 24m 42s. Rate: 8.3 symbols/min [2025-10-28T17:21:11.696463] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:11.696620] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-10-28T17:21:11.696685] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-10-28T17:21:11.696799] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-28T17:21:11.696841] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-28T17:21:11.696883] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-28T17:21:11.696915] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-28T17:21:11.964690] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-28T17:21:12.059072] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:12.279173] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:21:12.759333] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-28T17:21:13.119609] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:21:13.559330] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-28T17:21:14.359304] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-28T17:21:14.473994] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T17:21:14.872104] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:21:15.159332] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-28T17:21:15.509933] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:21:15.959334] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-28T17:21:16.725039] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:21:16.759319] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-28T17:21:17.125072] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T17:21:17.240026] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T17:21:17.559355] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-28T17:21:17.926144] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T17:21:18.359339] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-28T17:21:18.698445] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T17:21:19.159365] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-28T17:21:19.592238] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:21:19.959334] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-28T17:21:20.328697] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:21:20.759352] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-28T17:21:21.213692] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:21:21.559351] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-28T17:21:22.359391] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-28T17:21:22.700248] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T17:21:22.972103] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:21:23.159337] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-28T17:21:23.959380] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-28T17:21:24.489015] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:21:24.759397] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-28T17:21:25.559337] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-28T17:21:25.913594] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T17:21:26.037182] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:21:26.099556] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-28T17:21:26.359327] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-28T17:21:26.858005] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:21:27.159333] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-28T17:21:27.959360] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-28T17:21:28.232597] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:21:28.625420] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:21:28.627687] [INFO ] [REMOTE ] AUNA: Full fetch complete (7854 records). [2025-10-28T17:21:28.627789] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-28T17:21:28.628425] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:21:28.628506] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:21:28.628574] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:21:28.628666] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-28T17:21:28.628753] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-28T17:21:28.628797] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-10-28T17:21:28.628837] [DEBUG] [LOCAL ] AUNA: No derivative data file found to delete. [2025-10-28T17:21:28.628903] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. AUNA took 17.1s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min [2025-10-28T17:21:28.764419] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-28T17:21:28.840346] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:28.891243] [DEBUG] [LOCAL ] AVA: Loaded 37994 existing records from primary storage. [2025-10-28T17:21:28.891531] [INFO ] [MAIN ] AVA: Loaded 37994 existing records. [2025-10-28T17:21:29.121501] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:29.121769] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-28T17:21:29.121822] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-28T17:21:29.122178] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-28T17:21:29.122238] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-28T17:21:29.548597] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:29.559296] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-28T17:21:29.992732] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:21:30.359392] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-28T17:21:30.876914] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:21:31.159338] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-28T17:21:31.924346] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:21:31.959297] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-28T17:21:32.052323] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:21:32.759335] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-28T17:21:33.450303] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:21:33.559351] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-28T17:21:33.996341] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:21:34.359343] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-28T17:21:34.790902] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T17:21:35.159374] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-28T17:21:35.959407] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-28T17:21:36.517069] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-28T17:21:36.566570] [INFO ] [REMOTE ] AU: Full fetch complete (76650 records). [2025-10-28T17:21:36.566791] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-28T17:21:36.602297] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:21:36.759534] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-28T17:21:37.008667] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-28T17:21:37.008768] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-28T17:21:37.009571] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-28T17:21:37.009634] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-28T17:21:37.011103] [DEBUG] [LOCAL ] AU: Trimmed 76650 records to 53074 (keeping 200 days of data) [2025-10-28T17:21:37.334865] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:21:37.360274] [DEBUG] [LOCAL ] AU: Primary data saved (53074 records). [2025-10-28T17:21:37.360425] [INFO ] [MAIN ] AU: Full history saved. [2025-10-28T17:21:37.360512] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AU took 38.2s. Estimated remaining: 4h 26m 48s. Rate: 8.2 symbols/min [2025-10-28T17:21:37.525283] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:37.535080] [DEBUG] [LOCAL ] AVAL: Loaded 8321 existing records from primary storage. [2025-10-28T17:21:37.535299] [INFO ] [MAIN ] AVAL: Loaded 8321 existing records. [2025-10-28T17:21:37.565447] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-28T17:21:37.712143] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:37.712350] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-28T17:21:37.712395] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-28T17:21:37.712581] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-28T17:21:37.712620] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-28T17:21:38.074820] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:38.101180] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:21:38.359343] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-28T17:21:38.700183] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:21:39.159509] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-28T17:21:39.391105] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T17:21:39.959443] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-28T17:21:40.332276] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:21:40.626079] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:21:40.759379] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-28T17:21:41.531188] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:21:41.559297] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-28T17:21:42.101528] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:21:42.359391] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-28T17:21:43.159404] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-28T17:21:43.572531] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T17:21:43.583179] [INFO ] [REMOTE ] AUB: Full fetch complete (66494 records). [2025-10-28T17:21:43.583371] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-28T17:21:43.924199] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:21:43.964477] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-28T17:21:44.036539] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-28T17:21:44.036698] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-28T17:21:44.037421] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-28T17:21:44.037484] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-28T17:21:44.038769] [DEBUG] [LOCAL ] AUB: Trimmed 66494 records to 45626 (keeping 200 days of data) [2025-10-28T17:21:44.312878] [DEBUG] [LOCAL ] AUB: Primary data saved (45626 records). [2025-10-28T17:21:44.313002] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-28T17:21:44.313078] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. AUB took 37.1s. Estimated remaining: 4h 26m 36s. Rate: 8.2 symbols/min [2025-10-28T17:21:44.500696] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:44.539422] [DEBUG] [LOCAL ] AVB: Loaded 41943 existing records from primary storage. [2025-10-28T17:21:44.539754] [INFO ] [MAIN ] AVB: Loaded 41943 existing records. [2025-10-28T17:21:44.730036] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:44.730255] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-28T17:21:44.730305] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-28T17:21:44.731087] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-28T17:21:44.731152] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-28T17:21:44.766063] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-28T17:21:45.144843] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:45.166256] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:21:45.559379] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-28T17:21:46.015480] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T17:21:46.099117] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:21:46.359331] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-28T17:21:46.755997] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T17:21:47.159334] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-28T17:21:47.959372] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-28T17:21:48.340384] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:21:48.759360] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-28T17:21:49.310556] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T17:21:49.321539] [INFO ] [REMOTE ] ATUS: Full fetch complete (71464 records). [2025-10-28T17:21:49.321733] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-28T17:21:49.564783] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-28T17:21:49.849722] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-28T17:21:49.849921] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-28T17:21:49.850794] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-28T17:21:49.850875] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-28T17:21:49.876121] [DEBUG] [LOCAL ] ATUS: Trimmed 71464 records to 49952 (keeping 200 days of data) [2025-10-28T17:21:49.877034] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T17:21:50.145575] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T17:21:50.219062] [DEBUG] [LOCAL ] ATUS: Primary data saved (49952 records). [2025-10-28T17:21:50.219210] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-28T17:21:50.219293] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. ATUS took 52.5s. Estimated remaining: 4h 26m 12s. Rate: 8.2 symbols/min [2025-10-28T17:21:50.364575] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-28T17:21:50.427409] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:50.427582] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-28T17:21:50.427620] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-28T17:21:50.427752] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-28T17:21:50.427835] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-28T17:21:50.427886] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-28T17:21:50.427935] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-28T17:21:50.797350] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:51.159366] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-28T17:21:51.558362] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:21:51.959352] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-28T17:21:52.107852] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T17:21:52.481959] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:21:52.759359] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-28T17:21:52.903812] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:21:52.904106] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-28T17:21:52.904194] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:21:52.904265] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-28T17:21:52.904336] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:21:52.904408] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-28T17:21:52.904504] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-28T17:21:52.904557] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-28T17:21:52.904602] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-28T17:21:52.904673] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 2.7s. Estimated remaining: 4h 25m 8s. Rate: 8.2 symbols/min [2025-10-28T17:21:53.077558] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:53.096324] [DEBUG] [LOCAL ] AVD: Loaded 20940 existing records from primary storage. [2025-10-28T17:21:53.096556] [INFO ] [MAIN ] AVD: Loaded 20940 existing records. [2025-10-28T17:21:53.279218] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:53.279417] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-28T17:21:53.279462] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-28T17:21:53.279859] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-28T17:21:53.279916] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-28T17:21:53.564446] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-28T17:21:53.652714] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:54.049813] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:21:54.359416] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-28T17:21:55.159350] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-28T17:21:55.414396] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:21:55.421630] [INFO ] [REMOTE ] AVA: Full fetch complete (55404 records). [2025-10-28T17:21:55.421789] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-28T17:21:55.810616] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-28T17:21:55.810722] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-28T17:21:55.811281] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-28T17:21:55.811341] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-28T17:21:55.812403] [DEBUG] [LOCAL ] AVA: Trimmed 55404 records to 37896 (keeping 200 days of data) [2025-10-28T17:21:55.976689] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-28T17:21:56.038279] [DEBUG] [LOCAL ] AVA: Primary data saved (37896 records). [2025-10-28T17:21:56.038394] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-28T17:21:56.038469] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AVA took 27.4s. Estimated remaining: 4h 24m 11s. Rate: 8.3 symbols/min [2025-10-28T17:21:56.231373] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:56.228239] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:21:56.254770] [DEBUG] [LOCAL ] AVK: Loaded 18417 existing records from primary storage. [2025-10-28T17:21:56.255016] [INFO ] [MAIN ] AVK: Loaded 18417 existing records. [2025-10-28T17:21:56.436892] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:56.437130] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-28T17:21:56.437183] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-28T17:21:56.437606] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-28T17:21:56.437705] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-28T17:21:56.769462] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-28T17:21:56.803838] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:57.082153] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:21:57.504223] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T17:21:57.506712] [INFO ] [REMOTE ] AVAL: Full fetch complete (15170 records). [2025-10-28T17:21:57.506781] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-28T17:21:57.568603] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-28T17:21:57.869498] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-28T17:21:57.869563] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-28T17:21:57.870047] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-28T17:21:57.870087] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-28T17:21:57.870532] [DEBUG] [LOCAL ] AVAL: Trimmed 15170 records to 8308 (keeping 200 days of data) [2025-10-28T17:21:57.916866] [DEBUG] [LOCAL ] AVAL: Primary data saved (8308 records). [2025-10-28T17:21:57.916968] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-28T17:21:57.917041] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVAL took 20.6s. Estimated remaining: 4h 22m 59s. Rate: 8.3 symbols/min [2025-10-28T17:21:58.090342] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:58.122046] [DEBUG] [LOCAL ] AVNS: Loaded 33316 existing records from primary storage. [2025-10-28T17:21:58.122297] [INFO ] [MAIN ] AVNS: Loaded 33316 existing records. [2025-10-28T17:21:58.296361] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:58.296579] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-28T17:21:58.296626] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-28T17:21:58.296991] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-28T17:21:58.297037] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-28T17:21:58.364499] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-28T17:21:58.656350] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:58.782998] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:21:59.060438] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:21:59.159336] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-28T17:21:59.959352] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-28T17:22:00.532678] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:22:00.759326] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-28T17:22:01.075724] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T17:22:01.559353] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-28T17:22:02.086800] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:22:02.359378] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-28T17:22:02.418367] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:22:02.936201] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T17:22:03.159355] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-28T17:22:03.959330] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-28T17:22:04.189998] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:22:04.759335] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-28T17:22:05.144454] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:22:05.559331] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-28T17:22:05.924761] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:22:06.140900] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T17:22:06.359338] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-28T17:22:07.159344] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-28T17:22:07.541469] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:22:07.939114] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T17:22:07.959312] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-28T17:22:08.759310] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-28T17:22:08.786465] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:22:09.559332] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-28T17:22:10.174750] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T17:22:10.359343] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-28T17:22:10.376762] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:22:11.159305] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-28T17:22:11.189060] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T17:22:11.959336] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-28T17:22:12.005125] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T17:22:12.759376] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-28T17:22:12.896225] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:22:13.559340] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-28T17:22:14.193883] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T17:22:14.359371] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-28T17:22:15.090298] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:22:15.166522] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-28T17:22:15.169850] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T17:22:15.928817] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T17:22:15.959291] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-28T17:22:16.635964] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:22:16.759335] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-28T17:22:17.461903] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T17:22:17.465489] [INFO ] [REMOTE ] AVD: Full fetch complete (32265 records). [2025-10-28T17:22:17.465569] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-28T17:22:17.564409] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-28T17:22:17.839854] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-28T17:22:17.839964] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-28T17:22:17.840394] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-28T17:22:17.840438] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-28T17:22:17.841208] [DEBUG] [LOCAL ] AVD: Trimmed 32265 records to 20832 (keeping 200 days of data) [2025-10-28T17:22:17.953845] [DEBUG] [LOCAL ] AVD: Primary data saved (20832 records). [2025-10-28T17:22:17.953975] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-28T17:22:17.954080] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVD took 25.0s. Estimated remaining: 4h 25m 25s. Rate: 8.2 symbols/min [2025-10-28T17:22:18.136012] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:18.174998] [DEBUG] [LOCAL ] AVNT: Loaded 38236 existing records from primary storage. [2025-10-28T17:22:18.175265] [INFO ] [MAIN ] AVNT: Loaded 38236 existing records. [2025-10-28T17:22:18.360243] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-28T17:22:18.360175] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:18.373566] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:22:18.374260] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-28T17:22:18.379616] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-28T17:22:18.380359] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-28T17:22:18.380418] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-28T17:22:18.731582] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:19.159318] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-28T17:22:19.418153] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:22:19.959318] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-28T17:22:20.169618] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T17:22:20.506069] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T17:22:20.759406] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-28T17:22:21.559345] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-28T17:22:21.700103] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T17:22:22.325221] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T17:22:22.359361] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-28T17:22:23.159394] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-28T17:22:23.279939] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T17:22:23.284777] [INFO ] [REMOTE ] AVK: Full fetch complete (26771 records). [2025-10-28T17:22:23.284891] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-28T17:22:23.688731] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-28T17:22:23.688823] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-28T17:22:23.689182] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-28T17:22:23.689229] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-28T17:22:23.690276] [DEBUG] [LOCAL ] AVK: Trimmed 26771 records to 18344 (keeping 200 days of data) [2025-10-28T17:22:23.815635] [DEBUG] [LOCAL ] AVK: Primary data saved (18344 records). [2025-10-28T17:22:23.815808] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-28T17:22:23.815891] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVK took 27.8s. Estimated remaining: 4h 25m 0s. Rate: 8.2 symbols/min [2025-10-28T17:22:23.964559] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-28T17:22:23.999781] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:24.057934] [DEBUG] [LOCAL ] AVTR: Loaded 53570 existing records from primary storage. [2025-10-28T17:22:24.058317] [INFO ] [MAIN ] AVTR: Loaded 53570 existing records. [2025-10-28T17:22:24.256596] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:24.257054] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-28T17:22:24.257139] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-28T17:22:24.267170] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-28T17:22:24.273271] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-28T17:22:24.316956] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:22:24.661956] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:24.759313] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-28T17:22:25.091751] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:22:25.559351] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-28T17:22:26.086325] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T17:22:26.359369] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-28T17:22:26.700081] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:22:27.159379] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-28T17:22:27.776890] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T17:22:27.959410] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-28T17:22:28.286384] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T17:22:28.759393] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-28T17:22:29.002297] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:22:29.559366] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-28T17:22:30.363939] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-28T17:22:30.369852] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:22:30.958291] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:22:31.159413] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-28T17:22:31.420768] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:22:31.959381] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-28T17:22:32.135476] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T17:22:32.142763] [INFO ] [REMOTE ] AVNS: Full fetch complete (48161 records). [2025-10-28T17:22:32.142910] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-28T17:22:32.540378] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-28T17:22:32.540459] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-28T17:22:32.540978] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-28T17:22:32.541040] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-28T17:22:32.542119] [DEBUG] [LOCAL ] AVNS: Trimmed 48161 records to 33233 (keeping 200 days of data) [2025-10-28T17:22:32.727979] [DEBUG] [LOCAL ] AVNS: Primary data saved (33233 records). [2025-10-28T17:22:32.728103] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-28T17:22:32.728180] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVNS took 34.8s. Estimated remaining: 4h 25m 12s. Rate: 8.2 symbols/min [2025-10-28T17:22:32.764509] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-28T17:22:32.901477] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:32.935834] [DEBUG] [LOCAL ] AVY: Loaded 37987 existing records from primary storage. [2025-10-28T17:22:32.936098] [INFO ] [MAIN ] AVY: Loaded 37987 existing records. [2025-10-28T17:22:33.111620] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:33.111827] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-28T17:22:33.111875] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-28T17:22:33.112891] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-28T17:22:33.112952] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-28T17:22:33.474203] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:33.497910] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T17:22:33.506392] [INFO ] [REMOTE ] AVB: Full fetch complete (59505 records). [2025-10-28T17:22:33.506561] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-28T17:22:33.569949] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-28T17:22:33.906824] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-28T17:22:33.906900] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-28T17:22:33.907548] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-28T17:22:33.907612] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-28T17:22:33.908870] [DEBUG] [LOCAL ] AVB: Trimmed 59505 records to 41829 (keeping 200 days of data) [2025-10-28T17:22:34.203464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T17:22:34.232615] [DEBUG] [LOCAL ] AVB: Primary data saved (41829 records). [2025-10-28T17:22:34.233190] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-28T17:22:34.234283] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVB took 49.9s. Estimated remaining: 4h 23m 57s. Rate: 8.3 symbols/min [2025-10-28T17:22:34.364543] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-28T17:22:34.426621] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:34.454054] [DEBUG] [LOCAL ] AWF: Loaded 23920 existing records from primary storage. [2025-10-28T17:22:34.454371] [INFO ] [MAIN ] AWF: Loaded 23920 existing records. [2025-10-28T17:22:34.635052] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:34.635297] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-28T17:22:34.635344] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-28T17:22:34.635855] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-28T17:22:34.635914] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-28T17:22:34.999205] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:35.107163] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:22:35.159313] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-28T17:22:35.959392] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-28T17:22:36.356253] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:22:36.759323] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-28T17:22:36.804379] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:22:37.193569] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-28T17:22:37.559332] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-28T17:22:38.048222] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:22:38.359309] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-28T17:22:38.395499] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:22:39.159347] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-28T17:22:39.926517] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:22:39.955354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T17:22:39.961350] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-28T17:22:40.759394] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-28T17:22:40.988416] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T17:22:41.559343] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-28T17:22:41.629458] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:22:42.359336] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-28T17:22:42.813506] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:22:43.156420] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T17:22:43.161184] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-28T17:22:43.959322] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-28T17:22:44.507482] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T17:22:44.759370] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-28T17:22:45.334178] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:22:45.435980] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:22:45.559315] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-28T17:22:46.359430] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-28T17:22:47.033419] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:22:47.159364] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-28T17:22:47.635511] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:22:47.959335] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-28T17:22:48.355595] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T17:22:48.759323] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-28T17:22:48.934002] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:22:49.559347] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-28T17:22:50.075073] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T17:22:50.359384] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-28T17:22:50.673697] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:22:51.159391] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-28T17:22:51.482837] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:22:51.959416] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-28T17:22:52.086869] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:22:52.094253] [INFO ] [REMOTE ] AVNT: Full fetch complete (55889 records). [2025-10-28T17:22:52.094377] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-28T17:22:52.478048] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-28T17:22:52.478127] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-28T17:22:52.478766] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-28T17:22:52.478829] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-28T17:22:52.480000] [DEBUG] [LOCAL ] AVNT: Trimmed 55889 records to 38109 (keeping 200 days of data) [2025-10-28T17:22:52.717260] [DEBUG] [LOCAL ] AVNT: Primary data saved (38109 records). [2025-10-28T17:22:52.717403] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-28T17:22:52.717492] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNT took 34.8s. Estimated remaining: 4h 26m 1s. Rate: 8.2 symbols/min [2025-10-28T17:22:52.764615] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-28T17:22:52.929500] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:22:52.956369] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:52.981485] [DEBUG] [LOCAL ] AWI: Loaded 24899 existing records from primary storage. [2025-10-28T17:22:52.981809] [INFO ] [MAIN ] AWI: Loaded 24899 existing records. [2025-10-28T17:22:53.154878] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:53.155097] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-28T17:22:53.155143] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-28T17:22:53.155629] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-28T17:22:53.155719] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-28T17:22:53.498822] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:53.559307] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-28T17:22:54.327746] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:22:54.359288] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-28T17:22:54.422944] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T17:22:55.159306] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-28T17:22:55.303492] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:22:55.959390] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-28T17:22:56.279002] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T17:22:56.759405] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-28T17:22:56.777454] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T17:22:57.559363] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-28T17:22:57.720071] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T17:22:57.725437] [INFO ] [REMOTE ] AWF: Full fetch complete (35845 records). [2025-10-28T17:22:57.725518] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-28T17:22:58.093743] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-28T17:22:58.093824] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-28T17:22:58.094260] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-28T17:22:58.094320] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-28T17:22:58.095140] [DEBUG] [LOCAL ] AWF: Trimmed 35845 records to 23902 (keeping 200 days of data) [2025-10-28T17:22:58.231875] [DEBUG] [LOCAL ] AWF: Primary data saved (23902 records). [2025-10-28T17:22:58.231991] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-28T17:22:58.232065] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AWF took 24.0s. Estimated remaining: 4h 25m 32s. Rate: 8.2 symbols/min [2025-10-28T17:22:58.371256] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-28T17:22:58.401875] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:58.451277] [DEBUG] [LOCAL ] AWK: Loaded 48248 existing records from primary storage. [2025-10-28T17:22:58.451920] [INFO ] [MAIN ] AWK: Loaded 48248 existing records. [2025-10-28T17:22:58.629183] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:58.629356] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-28T17:22:58.629401] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-28T17:22:58.629946] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-28T17:22:58.630003] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-28T17:22:58.992841] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:59.023563] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:22:59.159299] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-28T17:22:59.959352] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-28T17:23:00.759311] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-28T17:23:04.979988] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (4.22 seconds). [2025-10-28T17:23:04.988192] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-28T17:23:05.325467] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (6.95 seconds). [2025-10-28T17:23:05.331782] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-28T17:23:05.949428] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (6.79 seconds). [2025-10-28T17:23:05.960041] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-28T17:23:06.101126] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:23:06.109553] [INFO ] [REMOTE ] AVY: Full fetch complete (56501 records). [2025-10-28T17:23:06.109753] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-28T17:23:06.110384] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:23:06.110480] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:23:06.110542] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:23:06.110584] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-28T17:23:06.110639] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-28T17:23:06.110723] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-28T17:23:06.110872] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-10-28T17:23:06.111605] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVY took 33.4s. Estimated remaining: 4h 25m 31s. Rate: 8.2 symbols/min [2025-10-28T17:23:06.280164] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:06.280320] [DEBUG] [LOCAL ] AWP: No existing data file found in primary storage. [2025-10-28T17:23:06.280355] [WARN ] [MAIN ] AWP: No existing data found, performing full refresh instead. [2025-10-28T17:23:06.280467] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-28T17:23:06.280514] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-28T17:23:06.280553] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-28T17:23:06.280587] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-28T17:23:06.660042] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:06.660353] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-28T17:23:06.695466] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (6.74 seconds). [2025-10-28T17:23:06.705540] [INFO ] [REMOTE ] AVTR: Full fetch complete (77286 records). [2025-10-28T17:23:06.705734] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-28T17:23:06.706527] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:23:06.706609] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:23:06.706681] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:23:06.706736] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-28T17:23:06.706794] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-28T17:23:06.706828] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-10-28T17:23:06.707000] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-10-28T17:23:06.707098] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AVTR took 42.9s. Estimated remaining: 4h 24m 7s. Rate: 8.2 symbols/min [2025-10-28T17:23:06.878789] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:06.899125] [DEBUG] [LOCAL ] AWR: Loaded 22460 existing records from primary storage. [2025-10-28T17:23:06.899368] [INFO ] [MAIN ] AWR: Loaded 22460 existing records. [2025-10-28T17:23:07.032055] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T17:23:07.085769] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-28T17:23:07.108393] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:07.109553] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-28T17:23:07.109781] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-28T17:23:07.110466] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-28T17:23:07.110540] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-28T17:23:07.497711] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T17:23:07.541589] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:07.542227] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-28T17:23:07.543923] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-28T17:23:07.585911] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:23:07.594394] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-28T17:23:08.144702] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:23:08.150758] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-28T17:23:08.256431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T17:23:08.385765] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:23:08.759524] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-28T17:23:08.894035] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T17:23:09.051284] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:23:09.538920] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:23:09.559310] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-28T17:23:10.359307] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-28T17:23:10.441065] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:23:11.159344] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-28T17:23:11.671362] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:23:11.959330] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-28T17:23:12.115206] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:23:12.759363] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-28T17:23:12.847593] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:23:13.440513] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:23:13.559336] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-28T17:23:14.359344] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-28T17:23:14.790526] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:23:15.159389] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-28T17:23:15.705878] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T17:23:15.959423] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-28T17:23:16.060076] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:23:16.759346] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-28T17:23:16.906302] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T17:23:17.384956] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T17:23:17.559333] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-28T17:23:18.359359] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-28T17:23:18.897701] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T17:23:19.159306] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-28T17:23:19.439633] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:23:19.959363] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-28T17:23:20.474844] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T17:23:20.707811] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:23:20.759335] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-28T17:23:21.550092] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T17:23:21.559289] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-28T17:23:22.353219] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:23:22.359285] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-28T17:23:22.956618] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:23:23.159344] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-28T17:23:23.959308] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-28T17:23:24.124460] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:23:24.133130] [INFO ] [REMOTE ] AWI: Full fetch complete (36322 records). [2025-10-28T17:23:24.133242] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-28T17:23:24.513859] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-28T17:23:24.513926] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-28T17:23:24.514336] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-28T17:23:24.514374] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-28T17:23:24.515129] [DEBUG] [LOCAL ] AWI: Trimmed 36322 records to 24954 (keeping 200 days of data) [2025-10-28T17:23:24.661119] [DEBUG] [LOCAL ] AWI: Primary data saved (24954 records). [2025-10-28T17:23:24.661236] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-28T17:23:24.661309] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWI took 31.9s. Estimated remaining: 4h 26m 1s. Rate: 8.2 symbols/min [2025-10-28T17:23:24.762590] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-28T17:23:24.830839] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:24.854279] [DEBUG] [LOCAL ] AX: Loaded 27347 existing records from primary storage. [2025-10-28T17:23:24.854534] [INFO ] [MAIN ] AX: Loaded 27347 existing records. [2025-10-28T17:23:25.063462] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:25.063702] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-28T17:23:25.063762] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-28T17:23:25.064259] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-28T17:23:25.065119] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-28T17:23:25.454034] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:25.482592] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T17:23:25.559315] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-28T17:23:25.700246] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T17:23:26.359356] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-28T17:23:26.695795] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T17:23:27.159387] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-28T17:23:27.184542] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:23:27.959306] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-28T17:23:28.047369] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:23:28.759353] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-28T17:23:29.334099] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T17:23:29.481920] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T17:23:29.559341] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-28T17:23:30.359363] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-28T17:23:30.799207] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:23:31.159379] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-28T17:23:31.218715] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T17:23:31.941784] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:23:31.945916] [INFO ] [REMOTE ] AWP: Full fetch complete (31414 records). [2025-10-28T17:23:31.945997] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-28T17:23:31.966677] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-28T17:23:32.312343] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-28T17:23:32.312438] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-28T17:23:32.312860] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-28T17:23:32.312919] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-28T17:23:32.313605] [DEBUG] [LOCAL ] AWP: Trimmed 31414 records to 21301 (keeping 200 days of data) [2025-10-28T17:23:32.432076] [DEBUG] [LOCAL ] AWP: Primary data saved (21301 records). [2025-10-28T17:23:32.432191] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-28T17:23:32.432267] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWP took 26.3s. Estimated remaining: 4h 25m 59s. Rate: 8.2 symbols/min [2025-10-28T17:23:32.603811] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:32.647392] [DEBUG] [LOCAL ] AXL: Loaded 50492 existing records from primary storage. [2025-10-28T17:23:32.647702] [INFO ] [MAIN ] AXL: Loaded 50492 existing records. [2025-10-28T17:23:32.764436] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-28T17:23:32.824807] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:32.825120] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-28T17:23:32.825181] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-28T17:23:32.825994] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-28T17:23:32.826051] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-28T17:23:33.183691] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:33.197844] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T17:23:33.202895] [INFO ] [REMOTE ] AWR: Full fetch complete (32585 records). [2025-10-28T17:23:33.203004] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-28T17:23:33.564549] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-28T17:23:33.660277] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-28T17:23:33.660394] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-28T17:23:33.661168] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-28T17:23:33.661251] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-28T17:23:33.662458] [DEBUG] [LOCAL ] AWR: Trimmed 32585 records to 22474 (keeping 200 days of data) [2025-10-28T17:23:33.870245] [DEBUG] [LOCAL ] AWR: Primary data saved (22474 records). [2025-10-28T17:23:33.870701] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-28T17:23:33.870837] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWR took 27.2s. Estimated remaining: 4h 24m 45s. Rate: 8.2 symbols/min [2025-10-28T17:23:33.962317] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T17:23:34.193580] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:34.268782] [DEBUG] [LOCAL ] AXP: Loaded 53134 existing records from primary storage. [2025-10-28T17:23:34.269214] [INFO ] [MAIN ] AXP: Loaded 53134 existing records. [2025-10-28T17:23:34.364562] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-28T17:23:34.470442] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:34.470677] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-28T17:23:34.470737] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-28T17:23:34.471767] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-28T17:23:34.471826] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-28T17:23:34.854508] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:34.958071] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:23:35.159332] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-28T17:23:35.881071] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:23:35.890664] [INFO ] [REMOTE ] AWK: Full fetch complete (70899 records). [2025-10-28T17:23:35.890786] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-28T17:23:35.964634] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-28T17:23:36.289374] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-28T17:23:36.289550] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-28T17:23:36.290299] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-28T17:23:36.290384] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-28T17:23:36.292209] [DEBUG] [LOCAL ] AWK: Trimmed 70899 records to 48235 (keeping 200 days of data) [2025-10-28T17:23:36.531238] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:23:36.625267] [DEBUG] [LOCAL ] AWK: Primary data saved (48235 records). [2025-10-28T17:23:36.625401] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-28T17:23:36.626224] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AWK took 38.4s. Estimated remaining: 4h 23m 47s. Rate: 8.2 symbols/min [2025-10-28T17:23:36.768494] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-28T17:23:36.793259] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:36.798000] [DEBUG] [LOCAL ] AXR: Loaded 2799 existing records from primary storage. [2025-10-28T17:23:36.798171] [INFO ] [MAIN ] AXR: Loaded 2799 existing records. [2025-10-28T17:23:36.973881] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:36.974121] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-28T17:23:36.974169] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-28T17:23:36.974341] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-28T17:23:36.974423] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-28T17:23:37.325393] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:37.559298] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-28T17:23:37.637369] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T17:23:38.043331] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T17:23:38.113802] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:23:38.359330] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-28T17:23:38.703841] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T17:23:39.159336] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-28T17:23:39.959418] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-28T17:23:40.617743] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T17:23:40.641303] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:23:40.759322] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-28T17:23:41.175259] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T17:23:41.559336] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-28T17:23:41.927332] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T17:23:42.359396] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-28T17:23:43.159400] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-28T17:23:43.719942] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:23:43.959338] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-28T17:23:44.759306] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-28T17:23:44.878059] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T17:23:45.055997] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:23:45.339320] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:23:45.559335] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-28T17:23:45.937728] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T17:23:46.359334] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-28T17:23:47.159337] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-28T17:23:47.266847] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:23:47.959384] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-28T17:23:48.546568] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:23:48.759391] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-28T17:23:49.132950] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:23:49.559344] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-28T17:23:49.916068] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:23:50.359337] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-28T17:23:51.159323] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-28T17:23:51.478591] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T17:23:51.591741] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:23:51.633331] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T17:23:51.959338] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-28T17:23:52.759345] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-28T17:23:52.954403] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T17:23:53.559380] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-28T17:23:54.132828] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T17:23:54.359351] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-28T17:23:55.156763] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:23:55.167709] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-28T17:23:55.642726] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:23:55.778911] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:23:55.959333] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-28T17:23:56.759335] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-28T17:23:57.559363] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-28T17:23:57.736378] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:23:57.746726] [INFO ] [REMOTE ] AXL: Full fetch complete (73217 records). [2025-10-28T17:23:57.746866] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-28T17:23:58.018266] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T17:23:58.151344] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-28T17:23:58.151715] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-28T17:23:58.152552] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-28T17:23:58.152812] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-28T17:23:58.154526] [DEBUG] [LOCAL ] AXL: Trimmed 73217 records to 50491 (keeping 200 days of data) [2025-10-28T17:23:58.365730] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-28T17:23:58.419320] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:23:58.488855] [DEBUG] [LOCAL ] AXL: Primary data saved (50491 records). [2025-10-28T17:23:58.489142] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-28T17:23:58.489557] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AXL took 26.1s. Estimated remaining: 4h 26m 22s. Rate: 8.2 symbols/min [2025-10-28T17:23:58.654540] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:58.689977] [DEBUG] [LOCAL ] AXS: Loaded 38703 existing records from primary storage. [2025-10-28T17:23:58.690279] [INFO ] [MAIN ] AXS: Loaded 38703 existing records. [2025-10-28T17:23:58.861981] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:58.862213] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-28T17:23:58.862259] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-28T17:23:58.862953] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-28T17:23:58.863010] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-28T17:23:59.164536] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-28T17:23:59.217357] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:59.352371] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:23:59.358109] [INFO ] [REMOTE ] AX: Full fetch complete (41762 records). [2025-10-28T17:23:59.358282] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-28T17:23:59.747759] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-28T17:23:59.747877] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-28T17:23:59.748528] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-28T17:23:59.748594] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-28T17:23:59.750004] [DEBUG] [LOCAL ] AX: Trimmed 41762 records to 27197 (keeping 200 days of data) [2025-10-28T17:23:59.838755] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:23:59.844768] [INFO ] [REMOTE ] AXR: Full fetch complete (4253 records). [2025-10-28T17:23:59.850692] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-28T17:23:59.961141] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-28T17:24:00.095997] [DEBUG] [LOCAL ] AX: Primary data saved (27197 records). [2025-10-28T17:24:00.118178] [INFO ] [MAIN ] AX: Full history saved. [2025-10-28T17:24:00.138182] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AX took 35.5s. Estimated remaining: 4h 25m 11s. Rate: 8.2 symbols/min [2025-10-28T17:24:00.483477] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-28T17:24:00.496464] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-28T17:24:00.496767] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-28T17:24:00.496853] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-28T17:24:00.504572] [DEBUG] [LOCAL ] AXR: Trimmed 4253 records to 2773 (keeping 200 days of data) [2025-10-28T17:24:00.538537] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:00.558265] [DEBUG] [LOCAL ] AXR: Primary data saved (2773 records). [2025-10-28T17:24:00.558545] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-28T17:24:00.558859] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXR took 23.9s. Estimated remaining: 4h 23m 48s. Rate: 8.2 symbols/min [2025-10-28T17:24:00.623914] [DEBUG] [LOCAL ] AXTA: Loaded 52292 existing records from primary storage. [2025-10-28T17:24:00.624605] [INFO ] [MAIN ] AXTA: Loaded 52292 existing records. [2025-10-28T17:24:00.765533] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-28T17:24:00.857564] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:00.857889] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-28T17:24:00.857945] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-28T17:24:00.858989] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-28T17:24:00.859051] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-28T17:24:01.296348] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:01.320996] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T17:24:01.559403] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-28T17:24:02.327953] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:24:02.359318] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-28T17:24:02.743719] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T17:24:03.159361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-28T17:24:03.587142] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T17:24:03.959353] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-28T17:24:04.639491] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:24:04.759361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-28T17:24:05.241735] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:24:05.559340] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-28T17:24:06.222757] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:24:06.359333] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-28T17:24:06.557057] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:24:07.159370] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-28T17:24:07.959366] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-28T17:24:08.194965] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T17:24:08.206240] [INFO ] [REMOTE ] AXP: Full fetch complete (77077 records). [2025-10-28T17:24:08.206414] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-28T17:24:08.655629] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-28T17:24:08.655814] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-28T17:24:08.656639] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-28T17:24:08.656916] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-28T17:24:08.659125] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:24:08.670075] [DEBUG] [LOCAL ] AXP: Trimmed 77077 records to 53107 (keeping 200 days of data) [2025-10-28T17:24:08.761827] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-28T17:24:09.033692] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:24:09.047021] [DEBUG] [LOCAL ] AXP: Primary data saved (53107 records). [2025-10-28T17:24:09.047125] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-28T17:24:09.047236] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXP took 35.2s. Estimated remaining: 4h 23m 54s. Rate: 8.2 symbols/min [2025-10-28T17:24:09.559328] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-28T17:24:10.156001] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:24:10.359396] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-28T17:24:10.722073] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:24:11.159334] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-28T17:24:11.725099] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:24:11.959376] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-28T17:24:12.358689] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T17:24:12.759323] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-28T17:24:13.416885] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T17:24:13.559305] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-28T17:24:13.813248] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:24:14.359399] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-28T17:24:14.732660] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:24:15.159344] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-28T17:24:15.847341] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:24:15.959322] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-28T17:24:16.430609] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T17:24:16.759367] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-28T17:24:17.225340] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T17:24:17.233978] [INFO ] [REMOTE ] AXS: Full fetch complete (56328 records). [2025-10-28T17:24:17.234134] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-28T17:24:17.628541] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-28T17:24:17.628677] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-28T17:24:17.629328] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-28T17:24:17.629392] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-28T17:24:17.630681] [DEBUG] [LOCAL ] AXS: Trimmed 56328 records to 38711 (keeping 200 days of data) [2025-10-28T17:24:17.869707] [DEBUG] [LOCAL ] AXS: Primary data saved (38711 records). [2025-10-28T17:24:17.869899] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-28T17:24:17.870440] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 19.4s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-10-28T17:24:17.985517] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:24:17.996931] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-28T17:24:19.098115] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:24:19.109513] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-28T17:24:20.476869] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T17:24:20.487686] [INFO ] [REMOTE ] AXTA: Full fetch complete (75526 records). [2025-10-28T17:24:20.487848] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-28T17:24:20.881531] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-28T17:24:20.881625] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-28T17:24:20.882419] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-28T17:24:20.882473] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-28T17:24:20.883994] [DEBUG] [LOCAL ] AXTA: Trimmed 75526 records to 52296 (keeping 200 days of data) [2025-10-28T17:24:21.183309] [DEBUG] [LOCAL ] AXTA: Primary data saved (52296 records). [2025-10-28T17:24:21.183683] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-28T17:24:21.183784] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 21.0s. Estimated remaining: 4h 23m 12s. Rate: 8.2 symbols/min [2025-10-28T17:24:21.888257] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.889139] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.908632] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.931410] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-28T17:24:21.931310] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.932083] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-28T17:24:21.932207] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-28T17:24:21.932249] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-28T17:24:21.932288] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-28T17:24:21.932319] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-28T17:24:22.041755] [DEBUG] [LOCAL ] AZO: Loaded 10621 existing records from primary storage. [2025-10-28T17:24:22.062823] [INFO ] [MAIN ] AZO: Loaded 10621 existing records. [2025-10-28T17:24:22.170588] [DEBUG] [LOCAL ] AYI: Loaded 23636 existing records from primary storage. [2025-10-28T17:24:22.178696] [DEBUG] [LOCAL ] AZZ: Loaded 22861 existing records from primary storage. [2025-10-28T17:24:22.201039] [INFO ] [MAIN ] AYI: Loaded 23636 existing records. [2025-10-28T17:24:22.245998] [INFO ] [MAIN ] AZZ: Loaded 22861 existing records. [2025-10-28T17:24:22.725341] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:22.756702] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:22.736244] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-28T17:24:22.784702] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-28T17:24:22.789921] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-28T17:24:22.863566] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:22.864424] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-28T17:24:22.868290] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-28T17:24:22.867938] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:22.868434] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-28T17:24:22.868385] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-28T17:24:22.888837] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-28T17:24:22.910951] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-28T17:24:22.922668] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-28T17:24:22.936671] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-28T17:24:22.936585] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-28T17:24:22.948257] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-28T17:24:23.853583] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:23.853969] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-28T17:24:23.848574] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:23.891824] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-28T17:24:23.987947] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:23.989071] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:24:23.989315] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-28T17:24:23.995704] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-28T17:24:24.209015] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:24:24.209189] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-28T17:24:24.209268] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:24:24.209352] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-28T17:24:24.209416] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:24:24.209482] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-28T17:24:24.209539] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-28T17:24:24.209573] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-28T17:24:24.209613] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-28T17:24:24.209719] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.0s. Estimated remaining: 4h 22m 19s. Rate: 8.3 symbols/min [2025-10-28T17:24:24.375105] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:24.422795] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-28T17:24:24.423086] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-28T17:24:24.599760] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:24.600076] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-28T17:24:24.600165] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-28T17:24:24.606033] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-28T17:24:24.606171] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-28T17:24:24.638091] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:24:24.699985] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-28T17:24:24.955276] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T17:24:24.988497] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-28T17:24:24.984419] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:24.988812] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-28T17:24:25.012388] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:24:25.295850] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:24:25.559337] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-28T17:24:25.667504] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:24:26.359381] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-28T17:24:26.594811] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:24:26.730344] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T17:24:27.159331] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-28T17:24:27.458245] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:24:27.959319] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-28T17:24:28.098444] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T17:24:28.759381] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-28T17:24:29.559354] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-28T17:24:29.682091] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T17:24:29.761727] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:24:30.359339] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-28T17:24:30.580484] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T17:24:30.950382] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:24:31.159334] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-28T17:24:31.959328] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-28T17:24:32.712961] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T17:24:32.759295] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-28T17:24:32.898798] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T17:24:33.559333] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-28T17:24:33.878217] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:24:34.303675] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T17:24:34.359306] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-28T17:24:35.159317] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-28T17:24:35.268713] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:24:35.959315] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-28T17:24:36.759333] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-28T17:24:37.056211] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:24:37.345489] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-28T17:24:37.559310] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-28T17:24:37.684699] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T17:24:38.359338] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-28T17:24:38.970869] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:24:39.159389] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-28T17:24:39.449089] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T17:24:39.959380] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-28T17:24:40.179027] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T17:24:40.627412] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:24:40.759363] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-28T17:24:41.559348] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-28T17:24:41.583120] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T17:24:42.084155] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T17:24:42.359384] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-28T17:24:43.159402] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-28T17:24:43.959369] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-28T17:24:44.077834] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:24:44.443635] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:24:44.527491] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-28T17:24:44.759346] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-28T17:24:45.559324] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-28T17:24:45.573741] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:24:46.359389] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-28T17:24:47.159333] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-28T17:24:47.438008] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T17:24:47.442613] [INFO ] [REMOTE ] AYI: Full fetch complete (36270 records). [2025-10-28T17:24:47.442719] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-28T17:24:47.844545] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-28T17:24:47.844732] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-28T17:24:47.845361] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-28T17:24:47.845611] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-28T17:24:47.853919] [DEBUG] [LOCAL ] AYI: Trimmed 36270 records to 23511 (keeping 200 days of data) [2025-10-28T17:24:47.854987] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:24:47.962668] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-28T17:24:47.999528] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-28T17:24:48.057066] [DEBUG] [LOCAL ] AYI: Primary data saved (23511 records). [2025-10-28T17:24:48.057229] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-28T17:24:48.057323] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AYI took 26.9s. Estimated remaining: 4h 25m 9s. Rate: 8.2 symbols/min [2025-10-28T17:24:48.224170] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:48.224357] [DEBUG] [LOCAL ] BABA: No existing data file found in primary storage. [2025-10-28T17:24:48.224394] [WARN ] [MAIN ] BABA: No existing data found, performing full refresh instead. [2025-10-28T17:24:48.224524] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-28T17:24:48.224565] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-28T17:24:48.224604] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-28T17:24:48.224634] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-28T17:24:48.576915] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:48.711133] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:24:48.713677] [INFO ] [REMOTE ] AZO: Full fetch complete (16057 records). [2025-10-28T17:24:48.713748] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-28T17:24:48.768899] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-28T17:24:49.097838] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-28T17:24:49.097911] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-28T17:24:49.098173] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-28T17:24:49.098209] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-28T17:24:49.098771] [DEBUG] [LOCAL ] AZO: Trimmed 16057 records to 10576 (keeping 200 days of data) [2025-10-28T17:24:49.162904] [DEBUG] [LOCAL ] AZO: Primary data saved (10576 records). [2025-10-28T17:24:49.163012] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-28T17:24:49.163088] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AZO took 28.0s. Estimated remaining: 4h 23m 55s. Rate: 8.2 symbols/min [2025-10-28T17:24:49.330621] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:49.377776] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-28T17:24:49.378087] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-28T17:24:49.562831] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-28T17:24:49.562724] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:49.564144] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-28T17:24:49.564294] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-28T17:24:49.565113] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-28T17:24:49.565172] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-28T17:24:49.764207] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T17:24:49.960067] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:50.359345] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-28T17:24:51.159300] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-28T17:24:51.366696] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-28T17:24:51.512238] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T17:24:51.518135] [INFO ] [REMOTE ] AZZ: Full fetch complete (32094 records). [2025-10-28T17:24:51.518267] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-28T17:24:51.880746] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-28T17:24:51.880828] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-28T17:24:51.881224] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-28T17:24:51.881264] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-28T17:24:51.882114] [DEBUG] [LOCAL ] AZZ: Trimmed 32094 records to 22835 (keeping 200 days of data) [2025-10-28T17:24:51.969501] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-28T17:24:52.021825] [DEBUG] [LOCAL ] AZZ: Primary data saved (22835 records). [2025-10-28T17:24:52.021935] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-28T17:24:52.022010] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. AZZ took 30.8s. Estimated remaining: 4h 23m 1s. Rate: 8.2 symbols/min [2025-10-28T17:24:52.190282] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:52.240566] [DEBUG] [LOCAL ] BAH: Loaded 51639 existing records from primary storage. [2025-10-28T17:24:52.240887] [INFO ] [MAIN ] BAH: Loaded 51639 existing records. [2025-10-28T17:24:52.414147] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:52.414372] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-28T17:24:52.414419] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-28T17:24:52.415197] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-28T17:24:52.415256] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-28T17:24:52.756820] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:52.759298] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-28T17:24:52.906576] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T17:24:53.559352] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-28T17:24:53.984701] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-28T17:24:54.133629] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:24:54.359344] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-28T17:24:55.160114] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-28T17:24:55.162457] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T17:24:55.731039] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:24:55.959397] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-28T17:24:56.759338] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-28T17:24:57.176839] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-28T17:24:57.335744] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:24:57.559332] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-28T17:24:58.359391] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-28T17:24:58.659283] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:24:58.996698] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:24:59.159336] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-28T17:24:59.959421] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-28T17:25:00.374907] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-28T17:25:00.476471] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:25:00.599223] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T17:25:00.611149] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-28T17:25:00.611379] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-28T17:25:00.768983] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-28T17:25:00.998292] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-28T17:25:00.998373] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-28T17:25:00.999158] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-28T17:25:00.999241] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-28T17:25:01.000791] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-28T17:25:01.322458] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-28T17:25:01.322586] [INFO ] [MAIN ] BA: Full history saved. [2025-10-28T17:25:01.322684] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 37.1s. Estimated remaining: 4h 23m 15s. Rate: 8.2 symbols/min [2025-10-28T17:25:01.489533] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:01.522754] [DEBUG] [LOCAL ] BAK: Loaded 39231 existing records from primary storage. [2025-10-28T17:25:01.523047] [INFO ] [MAIN ] BAK: Loaded 39231 existing records. [2025-10-28T17:25:01.564504] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-28T17:25:01.712192] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:01.712448] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-28T17:25:01.712505] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-28T17:25:01.713400] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-28T17:25:01.713459] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-28T17:25:02.083059] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:02.359340] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-28T17:25:02.896565] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-28T17:25:03.159313] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-28T17:25:03.436007] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:25:03.474045] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-28T17:25:03.959349] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-28T17:25:04.759326] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-28T17:25:05.019724] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:25:05.474480] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-28T17:25:05.559339] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-28T17:25:06.166243] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T17:25:06.359349] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-28T17:25:06.892809] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:25:07.159331] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-28T17:25:07.959345] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-28T17:25:08.536589] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:25:08.659628] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-28T17:25:08.759340] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-28T17:25:09.123925] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:25:09.559341] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-28T17:25:10.359334] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-28T17:25:10.984084] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-28T17:25:11.159376] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-28T17:25:11.390491] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-28T17:25:11.603887] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:25:11.959331] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-28T17:25:12.216062] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:25:12.759393] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-28T17:25:13.559308] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-28T17:25:13.892600] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-28T17:25:13.903040] [INFO ] [REMOTE ] BAH: Full fetch complete (75279 records). [2025-10-28T17:25:13.903184] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-28T17:25:14.293534] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-28T17:25:14.293607] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-28T17:25:14.294407] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-28T17:25:14.294473] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-28T17:25:14.295852] [DEBUG] [LOCAL ] BAH: Trimmed 75279 records to 51644 (keeping 200 days of data) [2025-10-28T17:25:14.359371] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-28T17:25:14.641418] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T17:25:14.640329] [DEBUG] [LOCAL ] BAH: Primary data saved (51644 records). [2025-10-28T17:25:14.652082] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-28T17:25:14.652944] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. BAH took 22.6s. Estimated remaining: 4h 24m 10s. Rate: 8.2 symbols/min [2025-10-28T17:25:14.827244] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:14.849306] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T17:25:14.900205] [DEBUG] [LOCAL ] BALL: Loaded 51906 existing records from primary storage. [2025-10-28T17:25:14.900493] [INFO ] [MAIN ] BALL: Loaded 51906 existing records. [2025-10-28T17:25:15.074965] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:15.075157] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-28T17:25:15.075237] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-28T17:25:15.076069] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-28T17:25:15.076127] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-28T17:25:15.164532] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-28T17:25:15.428889] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:15.959368] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-28T17:25:16.759334] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-28T17:25:16.796236] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T17:25:17.098857] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-28T17:25:17.499735] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:25:17.559302] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-28T17:25:17.813397] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:25:18.359350] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-28T17:25:18.687969] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:25:19.159315] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-28T17:25:19.291250] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:25:19.959337] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-28T17:25:20.759389] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-28T17:25:20.849485] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T17:25:21.115817] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T17:25:21.559348] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-28T17:25:22.359362] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-28T17:25:23.159333] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-28T17:25:23.215128] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-28T17:25:23.535064] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-28T17:25:23.730604] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:25:23.959394] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-28T17:25:24.312344] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T17:25:24.324425] [INFO ] [REMOTE ] BAK: Full fetch complete (56755 records). [2025-10-28T17:25:24.324749] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-28T17:25:24.715819] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-28T17:25:24.715889] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-28T17:25:24.716487] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-28T17:25:24.716526] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-28T17:25:24.717629] [DEBUG] [LOCAL ] BAK: Trimmed 56755 records to 39107 (keeping 200 days of data) [2025-10-28T17:25:24.760494] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-28T17:25:24.930179] [DEBUG] [LOCAL ] BAK: Primary data saved (39107 records). [2025-10-28T17:25:24.930292] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-28T17:25:24.930368] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAK took 23.6s. Estimated remaining: 4h 24m 34s. Rate: 8.2 symbols/min [2025-10-28T17:25:25.104787] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:25.104955] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-28T17:25:25.105004] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-28T17:25:25.105107] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-28T17:25:25.105147] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-28T17:25:25.105205] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-28T17:25:25.105282] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-28T17:25:25.468687] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:25.526362] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T17:25:25.559308] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-28T17:25:26.359338] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-28T17:25:26.754369] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T17:25:26.910054] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-28T17:25:27.122504] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T17:25:27.159307] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-28T17:25:27.584710] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:25:27.959327] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-28T17:25:28.494406] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:25:28.759350] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-28T17:25:29.559361] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-28T17:25:30.359436] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-28T17:25:30.888062] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T17:25:30.901373] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-28T17:25:30.901547] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-28T17:25:31.164563] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-28T17:25:31.366480] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-28T17:25:31.366593] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-28T17:25:31.367522] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-28T17:25:31.367744] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-28T17:25:31.369217] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-28T17:25:31.625691] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-28T17:25:31.746967] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T17:25:31.774389] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-28T17:25:31.774548] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-28T17:25:31.774874] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAC took 42.6s. Estimated remaining: 4h 24m 21s. Rate: 8.2 symbols/min [2025-10-28T17:25:31.948053] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:31.959342] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-28T17:25:32.000194] [DEBUG] [LOCAL ] BAM: Loaded 52063 existing records from primary storage. [2025-10-28T17:25:32.000581] [INFO ] [MAIN ] BAM: Loaded 52063 existing records. [2025-10-28T17:25:32.178377] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:32.178593] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-28T17:25:32.178638] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-28T17:25:32.179184] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-28T17:25:32.179242] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-28T17:25:32.533492] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:32.566113] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-28T17:25:32.759333] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-28T17:25:33.210016] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:25:33.559335] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-28T17:25:33.945887] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:25:34.035707] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T17:25:34.359359] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-28T17:25:35.159353] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-28T17:25:35.566627] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:25:35.644119] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T17:25:35.959345] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-28T17:25:36.737208] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T17:25:36.759325] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-28T17:25:37.213759] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T17:25:37.559346] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-28T17:25:38.359382] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-28T17:25:38.867039] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T17:25:39.159345] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-28T17:25:39.959321] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-28T17:25:40.410811] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:25:40.600614] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-28T17:25:40.611392] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-28T17:25:40.611525] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-28T17:25:40.764145] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-28T17:25:40.995569] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-28T17:25:40.995662] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-28T17:25:40.996410] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-28T17:25:40.996452] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-28T17:25:40.997876] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-28T17:25:41.362094] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-28T17:25:41.365512] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-28T17:25:41.365816] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BABA took 53.3s. Estimated remaining: 4h 24m 37s. Rate: 8.2 symbols/min [2025-10-28T17:25:41.378574] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T17:25:41.429018] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T17:25:41.559736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-28T17:25:41.561192] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:41.610465] [DEBUG] [LOCAL ] BANC: Loaded 51382 existing records from primary storage. [2025-10-28T17:25:41.610882] [INFO ] [MAIN ] BANC: Loaded 51382 existing records. [2025-10-28T17:25:41.790794] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:41.790994] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-28T17:25:41.791041] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-28T17:25:41.791942] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-28T17:25:41.791998] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-28T17:25:42.151022] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:42.359312] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-28T17:25:42.814004] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:25:43.159338] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-28T17:25:43.543143] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:25:43.959322] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-28T17:25:44.605852] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T17:25:44.714107] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:25:44.718417] [INFO ] [REMOTE ] BALY: Full fetch complete (16120 records). [2025-10-28T17:25:44.718496] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-28T17:25:44.764592] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-28T17:25:44.905667] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T17:25:44.905964] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:25:44.906032] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:25:44.906105] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-28T17:25:44.906184] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-28T17:25:44.906238] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-28T17:25:44.906310] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-28T17:25:44.906392] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALY took 20.0s. Estimated remaining: 4h 23m 50s. Rate: 8.2 symbols/min [2025-10-28T17:25:45.082141] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:45.103561] [DEBUG] [LOCAL ] BAP: Loaded 24970 existing records from primary storage. [2025-10-28T17:25:45.103846] [INFO ] [MAIN ] BAP: Loaded 24970 existing records. [2025-10-28T17:25:45.282772] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:45.282966] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-28T17:25:45.283013] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-28T17:25:45.283484] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-28T17:25:45.283540] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-28T17:25:45.560504] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-28T17:25:45.638507] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:46.111565] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:25:46.359334] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-28T17:25:46.696598] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:25:47.159331] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-28T17:25:47.361943] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:25:47.959324] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-28T17:25:48.395220] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:25:48.759323] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-28T17:25:48.851513] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:25:49.559349] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-28T17:25:50.139963] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:25:50.361547] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-28T17:25:50.365781] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:25:51.159395] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-28T17:25:51.705154] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T17:25:51.959354] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-28T17:25:52.446622] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:25:52.759304] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-28T17:25:52.891481] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T17:25:53.559322] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-28T17:25:54.015566] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T17:25:54.359367] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-28T17:25:55.019271] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T17:25:55.159334] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-28T17:25:55.556820] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T17:25:55.959342] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-28T17:25:56.309506] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:25:56.759332] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-28T17:25:57.116186] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T17:25:57.559342] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-28T17:25:57.813130] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:25:58.359374] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-28T17:25:58.441710] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:25:59.159321] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-28T17:25:59.748026] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T17:25:59.760084] [INFO ] [REMOTE ] BALL: Full fetch complete (75614 records). [2025-10-28T17:25:59.760273] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-28T17:25:59.970515] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-28T17:26:00.182135] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-28T17:26:00.190176] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-28T17:26:00.191937] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-28T17:26:00.207936] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-28T17:26:00.209438] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:26:00.217738] [DEBUG] [LOCAL ] BALL: Trimmed 75614 records to 51894 (keeping 200 days of data) [2025-10-28T17:26:00.549453] [DEBUG] [LOCAL ] BALL: Primary data saved (51894 records). [2025-10-28T17:26:00.549598] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-28T17:26:00.550068] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALL took 45.9s. Estimated remaining: 4h 25m 8s. Rate: 8.1 symbols/min [2025-10-28T17:26:00.713915] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:00.749161] [DEBUG] [LOCAL ] BARK: Loaded 37982 existing records from primary storage. [2025-10-28T17:26:00.749459] [INFO ] [MAIN ] BARK: Loaded 37982 existing records. [2025-10-28T17:26:00.769695] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-28T17:26:00.926587] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:00.926804] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-28T17:26:00.926851] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-28T17:26:00.927485] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-28T17:26:00.927542] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-28T17:26:01.293262] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:01.348198] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:26:01.559328] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-28T17:26:02.173335] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:26:02.183427] [INFO ] [REMOTE ] BAM: Full fetch complete (74924 records). [2025-10-28T17:26:02.183589] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-28T17:26:02.184299] [FATAL] [VALIDATOR ] BAM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:26:02.184411] [FATAL] [MAIN ] BAM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:26:02.184476] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:26:02.184525] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-28T17:26:02.184596] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-28T17:26:02.184678] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-10-28T17:26:02.185384] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-10-28T17:26:02.185491] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BAM took 30.4s. Estimated remaining: 4h 24m 2s. Rate: 8.2 symbols/min [2025-10-28T17:26:02.357329] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:02.357498] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-10-28T17:26:02.357535] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-10-28T17:26:02.357674] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-28T17:26:02.357728] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-28T17:26:02.357772] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-28T17:26:02.357805] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-28T17:26:02.368946] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-28T17:26:02.760207] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:02.765762] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:26:03.159392] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-28T17:26:03.518590] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:26:03.959402] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-28T17:26:04.759318] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-28T17:26:04.807458] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T17:26:04.882371] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T17:26:05.559371] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-28T17:26:05.787392] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:26:06.359343] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-28T17:26:06.469528] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T17:26:06.474304] [INFO ] [REMOTE ] BAP: Full fetch complete (37178 records). [2025-10-28T17:26:06.474405] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-28T17:26:06.847693] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-28T17:26:06.847778] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-28T17:26:06.848206] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-28T17:26:06.848243] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-28T17:26:06.849072] [DEBUG] [LOCAL ] BAP: Trimmed 37178 records to 24953 (keeping 200 days of data) [2025-10-28T17:26:06.995881] [DEBUG] [LOCAL ] BAP: Primary data saved (24953 records). [2025-10-28T17:26:06.996002] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-28T17:26:06.996086] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAP took 22.1s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-28T17:26:07.169758] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:07.166503] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-28T17:26:07.218396] [DEBUG] [LOCAL ] BB: Loaded 52860 existing records from primary storage. [2025-10-28T17:26:07.218713] [INFO ] [MAIN ] BB: Loaded 52860 existing records. [2025-10-28T17:26:07.399824] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:07.400101] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-28T17:26:07.400154] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-28T17:26:07.400562] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-28T17:26:07.400617] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-28T17:26:07.758699] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:07.780929] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T17:26:07.959318] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-28T17:26:08.389355] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:26:08.759339] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-28T17:26:09.358075] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:26:09.559332] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-28T17:26:10.051367] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:26:10.359333] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-28T17:26:11.091022] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T17:26:11.159308] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-28T17:26:11.707388] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:26:11.959339] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-28T17:26:12.533617] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:26:12.759313] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-28T17:26:12.898025] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:26:13.559350] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-28T17:26:14.206995] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T17:26:14.359332] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-28T17:26:14.999104] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:26:15.159341] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-28T17:26:15.559287] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:26:15.959329] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-28T17:26:16.424166] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:26:16.759351] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-28T17:26:17.532906] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T17:26:17.543699] [INFO ] [REMOTE ] BANC: Full fetch complete (74659 records). [2025-10-28T17:26:17.543854] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-28T17:26:17.564953] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-28T17:26:17.933934] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-28T17:26:17.934022] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-28T17:26:17.934782] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-28T17:26:17.934845] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-28T17:26:17.936354] [DEBUG] [LOCAL ] BANC: Trimmed 74659 records to 51376 (keeping 200 days of data) [2025-10-28T17:26:18.245270] [DEBUG] [LOCAL ] BANC: Primary data saved (51376 records). [2025-10-28T17:26:18.245409] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-28T17:26:18.245520] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BANC took 36.9s. Estimated remaining: 4h 24m 1s. Rate: 8.2 symbols/min [2025-10-28T17:26:18.359515] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-28T17:26:18.422192] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:18.451572] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T17:26:18.506108] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-28T17:26:18.506499] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-28T17:26:18.702815] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:18.725058] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-28T17:26:18.725208] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-28T17:26:18.726635] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-28T17:26:18.726571] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T17:26:18.726874] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-28T17:26:19.086396] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:19.159307] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-28T17:26:19.825757] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:26:19.959339] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-28T17:26:20.579659] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:26:20.759330] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-28T17:26:21.219624] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T17:26:21.559333] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-28T17:26:22.359392] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-28T17:26:22.664335] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-28T17:26:22.842420] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:26:23.159395] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-28T17:26:23.919965] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T17:26:23.959321] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-28T17:26:24.759380] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-28T17:26:25.116144] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-28T17:26:25.489527] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:26:25.500809] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-10-28T17:26:25.500963] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-28T17:26:25.572957] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-28T17:26:25.927385] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-28T17:26:25.927489] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-28T17:26:25.928357] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-28T17:26:25.928422] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-28T17:26:25.929952] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 53536 (keeping 200 days of data) [2025-10-28T17:26:26.264413] [DEBUG] [LOCAL ] BAX: Primary data saved (53536 records). [2025-10-28T17:26:26.264569] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-28T17:26:26.264870] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BAX took 24.1s. Estimated remaining: 4h 24m 0s. Rate: 8.1 symbols/min [2025-10-28T17:26:26.365031] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-28T17:26:26.440790] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:26.474556] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T17:26:26.518374] [DEBUG] [LOCAL ] BBAR: Loaded 42596 existing records from primary storage. [2025-10-28T17:26:26.518697] [INFO ] [MAIN ] BBAR: Loaded 42596 existing records. [2025-10-28T17:26:26.706565] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:26.706907] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-28T17:26:26.706976] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-28T17:26:26.707845] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-28T17:26:26.707906] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-28T17:26:27.077714] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:27.159348] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-28T17:26:27.726585] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-28T17:26:27.764701] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T17:26:27.959325] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-28T17:26:28.759350] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-28T17:26:28.923630] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-28T17:26:28.934450] [INFO ] [REMOTE ] BB: Full fetch complete (76955 records). [2025-10-28T17:26:28.934577] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-28T17:26:29.305979] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:26:29.382142] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-28T17:26:29.382225] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-28T17:26:29.383062] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-28T17:26:29.383129] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-28T17:26:29.384708] [DEBUG] [LOCAL ] BB: Trimmed 76955 records to 52857 (keeping 200 days of data) [2025-10-28T17:26:29.560706] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-28T17:26:29.705841] [DEBUG] [LOCAL ] BB: Primary data saved (52857 records). [2025-10-28T17:26:29.705991] [INFO ] [MAIN ] BB: Full history saved. [2025-10-28T17:26:29.706102] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BB took 22.7s. Estimated remaining: 4h 23m 14s. Rate: 8.2 symbols/min [2025-10-28T17:26:29.899280] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:29.950098] [DEBUG] [LOCAL ] BBD: Loaded 53275 existing records from primary storage. [2025-10-28T17:26:29.950406] [INFO ] [MAIN ] BBD: Loaded 53275 existing records. [2025-10-28T17:26:30.150949] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:30.151294] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-28T17:26:30.151370] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-28T17:26:30.151745] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-28T17:26:30.151857] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-28T17:26:30.376305] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-28T17:26:30.407285] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T17:26:30.583903] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:30.604964] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T17:26:31.159341] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-28T17:26:31.959339] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-28T17:26:32.190081] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:26:32.248127] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-28T17:26:32.759312] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-28T17:26:32.833310] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:26:33.559338] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-28T17:26:34.370169] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-28T17:26:34.374473] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:26:35.159323] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-28T17:26:35.475218] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T17:26:35.697253] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-28T17:26:35.959328] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-28T17:26:36.382680] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:26:36.759324] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-28T17:26:36.921595] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T17:26:37.559339] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-28T17:26:37.977091] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:26:37.988108] [INFO ] [REMOTE ] BARK: Full fetch complete (55853 records). [2025-10-28T17:26:37.988229] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-28T17:26:38.357386] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-28T17:26:38.357469] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-28T17:26:38.358067] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-28T17:26:38.358129] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-28T17:26:38.359266] [DEBUG] [LOCAL ] BARK: Trimmed 55853 records to 38013 (keeping 200 days of data) [2025-10-28T17:26:38.359601] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-28T17:26:38.571135] [DEBUG] [LOCAL ] BARK: Primary data saved (38013 records). [2025-10-28T17:26:38.571267] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-28T17:26:38.571817] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BARK took 38.0s. Estimated remaining: 4h 23m 21s. Rate: 8.2 symbols/min [2025-10-28T17:26:38.736930] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:38.769971] [DEBUG] [LOCAL ] BBDC: Loaded 32408 existing records from primary storage. [2025-10-28T17:26:38.770308] [INFO ] [MAIN ] BBDC: Loaded 32408 existing records. [2025-10-28T17:26:38.942567] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:38.942781] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-28T17:26:38.942827] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-28T17:26:38.943466] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-28T17:26:38.943523] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-28T17:26:39.176209] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-28T17:26:39.287661] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:39.566624] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:26:39.662874] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-28T17:26:39.959331] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-28T17:26:40.759303] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-28T17:26:40.912972] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-28T17:26:41.559317] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-28T17:26:41.745123] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:26:42.031598] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:26:42.359345] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-28T17:26:42.615600] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:26:43.160807] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-28T17:26:43.301597] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:26:43.959357] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-28T17:26:44.443320] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:26:44.759349] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-28T17:26:45.164196] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T17:26:45.559345] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-28T17:26:46.359327] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-28T17:26:46.483609] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T17:26:46.496054] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-28T17:26:47.159382] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-28T17:26:47.420878] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T17:26:47.959409] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-28T17:26:48.306405] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:26:48.759319] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-28T17:26:48.967795] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T17:26:49.559380] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-28T17:26:50.359381] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-28T17:26:50.822288] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:26:50.934081] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-28T17:26:51.159368] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-28T17:26:51.575323] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T17:26:51.959406] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-28T17:26:52.759335] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-28T17:26:53.060877] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:26:53.353967] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T17:26:53.559346] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-28T17:26:54.155396] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:26:54.165561] [INFO ] [REMOTE ] BBAR: Full fetch complete (61276 records). [2025-10-28T17:26:54.165728] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-28T17:26:54.369025] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-28T17:26:54.564174] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-28T17:26:54.564256] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-28T17:26:54.564919] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-28T17:26:54.564981] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-28T17:26:54.566207] [DEBUG] [LOCAL ] BBAR: Trimmed 61276 records to 42680 (keeping 200 days of data) [2025-10-28T17:26:54.818694] [DEBUG] [LOCAL ] BBAR: Primary data saved (42680 records). [2025-10-28T17:26:54.818819] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-28T17:26:54.818936] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAR took 28.6s. Estimated remaining: 4h 24m 42s. Rate: 8.1 symbols/min [2025-10-28T17:26:54.987111] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:54.987390] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-28T17:26:54.987548] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-28T17:26:54.987770] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-28T17:26:54.987868] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-28T17:26:54.987982] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-28T17:26:54.988049] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-28T17:26:55.161317] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-28T17:26:55.324061] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-28T17:26:55.401634] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:55.959391] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-28T17:26:56.251050] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T17:26:56.509541] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:26:56.759316] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-28T17:26:56.863153] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-28T17:26:56.874163] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-28T17:26:56.874327] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-28T17:26:57.259541] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-28T17:26:57.259615] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-28T17:26:57.260321] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-28T17:26:57.260378] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-28T17:26:57.261739] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-28T17:26:57.560541] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-28T17:26:57.570312] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-28T17:26:57.570413] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-28T17:26:57.570511] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAI took 39.3s. Estimated remaining: 4h 23m 49s. Rate: 8.1 symbols/min [2025-10-28T17:26:57.758350] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:57.758800] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-28T17:26:57.758860] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-28T17:26:57.777786] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-28T17:26:57.777911] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-28T17:26:57.777998] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-28T17:26:57.778599] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-28T17:26:57.779358] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T17:26:58.090572] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:26:58.172178] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:58.359356] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-28T17:26:59.159324] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-28T17:26:59.409209] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:26:59.959325] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-28T17:27:00.470476] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:27:00.481114] [INFO ] [REMOTE ] BBD: Full fetch complete (77272 records). [2025-10-28T17:27:00.481230] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-28T17:27:00.765500] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-28T17:27:00.870421] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-28T17:27:00.870575] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-28T17:27:00.871351] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-28T17:27:00.871415] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-28T17:27:00.872786] [DEBUG] [LOCAL ] BBD: Trimmed 77272 records to 53278 (keeping 200 days of data) [2025-10-28T17:27:00.994105] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:27:01.202513] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T17:27:01.218089] [DEBUG] [LOCAL ] BBD: Primary data saved (53278 records). [2025-10-28T17:27:01.218231] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-28T17:27:01.218310] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBD took 31.5s. Estimated remaining: 4h 23m 5s. Rate: 8.2 symbols/min [2025-10-28T17:27:01.398382] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:01.398580] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-28T17:27:01.398620] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-28T17:27:01.398753] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-28T17:27:01.398794] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-28T17:27:01.398835] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-28T17:27:01.398868] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-28T17:27:01.573315] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-28T17:27:01.793437] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:02.359332] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-28T17:27:02.450233] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T17:27:03.159348] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-28T17:27:03.448316] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:27:03.542560] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T17:27:03.959336] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-28T17:27:04.181344] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:27:04.181697] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-28T17:27:04.181799] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:27:04.181890] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-28T17:27:04.181973] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:27:04.182063] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-28T17:27:04.182147] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-28T17:27:04.182185] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-28T17:27:04.182223] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-28T17:27:04.182268] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 3.0s. Estimated remaining: 4h 22m 15s. Rate: 8.2 symbols/min [2025-10-28T17:27:04.357599] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:04.364726] [DEBUG] [LOCAL ] BBU: Loaded 5811 existing records from primary storage. [2025-10-28T17:27:04.364880] [INFO ] [MAIN ] BBU: Loaded 5811 existing records. [2025-10-28T17:27:04.536594] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:04.536815] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-28T17:27:04.536875] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-28T17:27:04.537014] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-28T17:27:04.537054] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-28T17:27:04.766328] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-28T17:27:04.881753] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:05.223566] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T17:27:05.559341] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-28T17:27:06.359349] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-28T17:27:06.931479] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T17:27:06.932297] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T17:27:06.942085] [INFO ] [REMOTE ] BBDC: Full fetch complete (48844 records). [2025-10-28T17:27:06.942536] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-28T17:27:07.164481] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-28T17:27:07.318575] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-28T17:27:07.318671] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-28T17:27:07.319193] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-28T17:27:07.319233] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-28T17:27:07.320142] [DEBUG] [LOCAL ] BBDC: Trimmed 48844 records to 32318 (keeping 200 days of data) [2025-10-28T17:27:07.502461] [DEBUG] [LOCAL ] BBDC: Primary data saved (32318 records). [2025-10-28T17:27:07.502587] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-28T17:27:07.503233] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBDC took 28.9s. Estimated remaining: 4h 21m 29s. Rate: 8.2 symbols/min [2025-10-28T17:27:07.618375] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T17:27:07.675683] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:07.691177] [DEBUG] [LOCAL ] BBUC: Loaded 13766 existing records from primary storage. [2025-10-28T17:27:07.691386] [INFO ] [MAIN ] BBUC: Loaded 13766 existing records. [2025-10-28T17:27:07.864240] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:07.864406] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-28T17:27:07.864454] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-28T17:27:07.864670] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-28T17:27:07.864729] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-28T17:27:07.964537] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-28T17:27:08.216450] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:08.331763] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:27:08.759322] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-28T17:27:09.384964] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T17:27:09.559351] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-28T17:27:09.931819] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T17:27:10.359356] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-28T17:27:10.882674] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T17:27:11.159383] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-28T17:27:11.609289] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T17:27:11.959359] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-28T17:27:12.412354] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:27:12.414095] [INFO ] [REMOTE ] BBDO: Full fetch complete (7422 records). [2025-10-28T17:27:12.414169] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-28T17:27:12.769389] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-28T17:27:12.801982] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-28T17:27:12.802039] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-28T17:27:12.802249] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-28T17:27:12.802289] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-28T17:27:12.802692] [DEBUG] [LOCAL ] BBDO: Trimmed 7422 records to 4822 (keeping 200 days of data) [2025-10-28T17:27:12.830043] [DEBUG] [LOCAL ] BBDO: Primary data saved (4822 records). [2025-10-28T17:27:12.830123] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-28T17:27:12.830186] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBDO took 18.0s. Estimated remaining: 4h 21m 2s. Rate: 8.2 symbols/min [2025-10-28T17:27:13.033998] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:13.077113] [DEBUG] [LOCAL ] BBVA: Loaded 48999 existing records from primary storage. [2025-10-28T17:27:13.077444] [INFO ] [MAIN ] BBVA: Loaded 48999 existing records. [2025-10-28T17:27:13.265729] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:13.266072] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-28T17:27:13.266153] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-28T17:27:13.267155] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-28T17:27:13.267248] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-28T17:27:13.564000] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-28T17:27:13.645806] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T17:27:13.645472] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:13.976495] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T17:27:14.359346] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-28T17:27:14.949769] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:27:15.159330] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-28T17:27:15.959352] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-28T17:27:16.238355] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:27:16.759381] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-28T17:27:17.214120] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:27:17.444225] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:27:17.559355] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-28T17:27:18.365361] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-28T17:27:18.368046] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T17:27:18.670940] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T17:27:19.159383] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-28T17:27:19.463966] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T17:27:19.959355] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-28T17:27:20.400825] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T17:27:20.759339] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-28T17:27:21.036635] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-28T17:27:21.559365] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-28T17:27:22.359408] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-28T17:27:22.990716] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T17:27:23.159326] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-28T17:27:23.352773] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T17:27:23.640582] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:27:23.959355] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-28T17:27:24.641371] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:27:24.759383] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-28T17:27:25.312819] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:27:25.559353] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-28T17:27:26.359385] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-28T17:27:26.915733] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:27:26.917306] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:27:27.159347] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-28T17:27:27.959354] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-28T17:27:28.399397] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:27:28.417572] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T17:27:28.759375] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-28T17:27:29.559398] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-28T17:27:29.950390] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:27:30.216973] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T17:27:30.359387] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-28T17:27:31.054102] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:27:31.159341] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-28T17:27:31.959363] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-28T17:27:32.437990] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:27:32.651820] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T17:27:32.759345] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-28T17:27:33.454579] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T17:27:33.559313] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-28T17:27:34.359370] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-28T17:27:35.164406] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-28T17:27:35.184265] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T17:27:35.204104] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T17:27:35.207247] [INFO ] [REMOTE ] BBN: Full fetch complete (24922 records). [2025-10-28T17:27:35.207323] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-28T17:27:35.583507] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-28T17:27:35.583581] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-28T17:27:35.583943] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-28T17:27:35.584003] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-28T17:27:35.584585] [DEBUG] [LOCAL ] BBN: Trimmed 24922 records to 17318 (keeping 200 days of data) [2025-10-28T17:27:35.686176] [DEBUG] [LOCAL ] BBN: Primary data saved (17318 records). [2025-10-28T17:27:35.686309] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-28T17:27:35.686380] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBN took 38.1s. Estimated remaining: 4h 23m 24s. Rate: 8.1 symbols/min [2025-10-28T17:27:35.870901] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:27:35.870550] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:35.899529] [DEBUG] [LOCAL ] BBW: Loaded 26942 existing records from primary storage. [2025-10-28T17:27:35.899794] [INFO ] [MAIN ] BBW: Loaded 26942 existing records. [2025-10-28T17:27:35.964404] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-28T17:27:36.076935] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:36.077142] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-28T17:27:36.079697] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-28T17:27:36.080100] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-28T17:27:36.080170] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-28T17:27:36.432747] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:36.759326] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-28T17:27:36.788127] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:27:36.790975] [INFO ] [REMOTE ] BBU: Full fetch complete (7611 records). [2025-10-28T17:27:36.791056] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-28T17:27:37.156124] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-28T17:27:37.156198] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-28T17:27:37.156389] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-28T17:27:37.156427] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-28T17:27:37.156838] [DEBUG] [LOCAL ] BBU: Trimmed 7611 records to 5867 (keeping 200 days of data) [2025-10-28T17:27:37.190434] [DEBUG] [LOCAL ] BBU: Primary data saved (5867 records). [2025-10-28T17:27:37.190575] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-28T17:27:37.190711] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBU took 33.0s. Estimated remaining: 4h 22m 21s. Rate: 8.2 symbols/min [2025-10-28T17:27:37.360823] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:37.408171] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-28T17:27:37.408460] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-28T17:27:37.562277] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-28T17:27:37.586818] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:37.587059] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-28T17:27:37.587110] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-28T17:27:37.587550] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-28T17:27:37.587608] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-28T17:27:37.944745] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:38.123284] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:27:38.167386] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:27:38.359341] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-28T17:27:39.159318] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-28T17:27:39.813497] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:27:39.833922] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:27:39.959329] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-28T17:27:40.759344] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-28T17:27:41.346064] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T17:27:41.559347] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-28T17:27:41.691344] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:27:42.359350] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-28T17:27:43.023129] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:27:43.159328] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-28T17:27:43.200333] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T17:27:43.204318] [INFO ] [REMOTE ] BBUC: Full fetch complete (19350 records). [2025-10-28T17:27:43.204389] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-28T17:27:43.562720] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-28T17:27:43.562829] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-28T17:27:43.563149] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-28T17:27:43.563226] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-28T17:27:43.563930] [DEBUG] [LOCAL ] BBUC: Trimmed 19350 records to 13766 (keeping 200 days of data) [2025-10-28T17:27:43.644766] [DEBUG] [LOCAL ] BBUC: Primary data saved (13766 records). [2025-10-28T17:27:43.644895] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-28T17:27:43.644971] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 36.1s. Estimated remaining: 4h 22m 5s. Rate: 8.2 symbols/min [2025-10-28T17:27:43.811884] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:43.859733] [DEBUG] [LOCAL ] BBY: Loaded 53430 existing records from primary storage. [2025-10-28T17:27:43.860030] [INFO ] [MAIN ] BBY: Loaded 53430 existing records. [2025-10-28T17:27:43.959779] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-28T17:27:44.044113] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:44.057224] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-28T17:27:44.057430] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-28T17:27:44.058420] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:27:44.058450] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-28T17:27:44.058556] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-28T17:27:44.422009] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:44.759303] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-28T17:27:45.236686] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:27:45.559327] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-28T17:27:46.100252] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:27:46.359326] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-28T17:27:46.401202] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:27:47.159344] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-28T17:27:47.828078] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T17:27:47.959305] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-28T17:27:48.105174] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T17:27:48.759346] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-28T17:27:49.057468] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T17:27:49.559409] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-28T17:27:50.019180] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:27:50.359349] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-28T17:27:50.972482] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:27:51.050910] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T17:27:51.159455] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-28T17:27:51.959350] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-28T17:27:52.738223] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:27:52.759320] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-28T17:27:52.956059] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T17:27:53.487453] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:27:53.559339] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-28T17:27:54.359339] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-28T17:27:54.795385] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:27:55.159402] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-28T17:27:55.875445] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:27:55.888924] [INFO ] [REMOTE ] BBVA: Full fetch complete (71547 records). [2025-10-28T17:27:55.889110] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-28T17:27:55.889867] [FATAL] [VALIDATOR ] BBVA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:27:55.889953] [FATAL] [MAIN ] BBVA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:27:55.890017] [WARN ] [MAIN ] BBVA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:27:55.890065] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-28T17:27:55.890122] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-28T17:27:55.890157] [INFO ] [LOCAL ] BBVA: Starting deletion of derivative data. [2025-10-28T17:27:55.890315] [DEBUG] [LOCAL ] BBVA: Deleted derivative data file. [2025-10-28T17:27:55.890391] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBVA took 43.1s. Estimated remaining: 4h 22m 44s. Rate: 8.1 symbols/min [2025-10-28T17:27:55.964601] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-28T17:27:56.078768] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:56.097094] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:27:56.138097] [DEBUG] [LOCAL ] BC: Loaded 43867 existing records from primary storage. [2025-10-28T17:27:56.138418] [INFO ] [MAIN ] BC: Loaded 43867 existing records. [2025-10-28T17:27:56.321765] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:56.321970] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-28T17:27:56.322016] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-28T17:27:56.322486] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-28T17:27:56.322544] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-28T17:27:56.681504] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:56.759351] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-28T17:27:57.306438] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:27:57.559397] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-28T17:27:58.124778] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:27:58.359488] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-28T17:27:58.633883] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:27:59.159335] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-28T17:27:59.959388] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-28T17:28:00.034177] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T17:28:00.309883] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:28:00.759407] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-28T17:28:01.559332] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-28T17:28:01.682318] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T17:28:01.693506] [INFO ] [REMOTE ] BBWI: Full fetch complete (77636 records). [2025-10-28T17:28:01.693717] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-28T17:28:02.106980] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-28T17:28:02.107157] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-28T17:28:02.108067] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-28T17:28:02.108151] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-28T17:28:02.109817] [DEBUG] [LOCAL ] BBWI: Trimmed 77636 records to 53591 (keeping 200 days of data) [2025-10-28T17:28:02.349771] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T17:28:02.364679] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-28T17:28:02.478242] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-28T17:28:02.478392] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-28T17:28:02.478494] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBWI took 25.3s. Estimated remaining: 4h 22m 29s. Rate: 8.1 symbols/min [2025-10-28T17:28:02.669547] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:02.695685] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:28:02.731122] [DEBUG] [LOCAL ] BCAT: Loaded 34005 existing records from primary storage. [2025-10-28T17:28:02.731404] [INFO ] [MAIN ] BCAT: Loaded 34005 existing records. [2025-10-28T17:28:02.910992] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:02.911137] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-28T17:28:02.911183] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-28T17:28:02.911778] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-28T17:28:02.911834] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-28T17:28:03.164405] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-28T17:28:03.267525] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:03.461626] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:28:03.467880] [INFO ] [REMOTE ] BBW: Full fetch complete (39274 records). [2025-10-28T17:28:03.467962] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-28T17:28:03.831478] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-28T17:28:03.831548] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-28T17:28:03.831999] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-28T17:28:03.832065] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-28T17:28:03.832873] [DEBUG] [LOCAL ] BBW: Trimmed 39274 records to 26874 (keeping 200 days of data) [2025-10-28T17:28:03.966596] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-28T17:28:03.991892] [DEBUG] [LOCAL ] BBW: Primary data saved (26874 records). [2025-10-28T17:28:03.991978] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-28T17:28:03.992050] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBW took 28.3s. Estimated remaining: 4h 21m 27s. Rate: 8.2 symbols/min [2025-10-28T17:28:04.164173] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:04.190572] [DEBUG] [LOCAL ] BCC: Loaded 28474 existing records from primary storage. [2025-10-28T17:28:04.190895] [INFO ] [MAIN ] BCC: Loaded 28474 existing records. [2025-10-28T17:28:04.369260] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:04.369533] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-28T17:28:04.369615] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-28T17:28:04.370329] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-28T17:28:04.370390] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-28T17:28:04.742192] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:04.771722] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-28T17:28:04.777992] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:28:05.359385] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:28:05.559402] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-28T17:28:05.821373] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:28:06.359325] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-28T17:28:06.951681] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T17:28:07.145903] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T17:28:07.159299] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-28T17:28:07.959390] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-28T17:28:08.386132] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:28:08.759305] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-28T17:28:08.884435] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T17:28:09.559379] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-28T17:28:10.018867] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T17:28:10.359323] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-28T17:28:10.687286] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:28:11.159350] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-28T17:28:11.593334] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:28:11.959298] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-28T17:28:11.993933] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:28:12.759494] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-28T17:28:12.959776] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:28:13.559377] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-28T17:28:14.082767] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T17:28:14.359328] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-28T17:28:14.589188] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:28:15.159329] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-28T17:28:15.959340] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-28T17:28:16.018905] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:28:16.030077] [INFO ] [REMOTE ] BBY: Full fetch complete (77412 records). [2025-10-28T17:28:16.030254] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-28T17:28:16.440781] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-28T17:28:16.440937] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-28T17:28:16.441782] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-28T17:28:16.441863] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-28T17:28:16.466424] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:28:16.475164] [DEBUG] [LOCAL ] BBY: Trimmed 77412 records to 53427 (keeping 200 days of data) [2025-10-28T17:28:16.773281] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-28T17:28:16.797435] [DEBUG] [LOCAL ] BBY: Primary data saved (53427 records). [2025-10-28T17:28:16.797715] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-28T17:28:16.798248] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBY took 33.2s. Estimated remaining: 4h 22m 10s. Rate: 8.1 symbols/min [2025-10-28T17:28:16.975487] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:16.992229] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:28:17.039924] [DEBUG] [LOCAL ] BCE: Loaded 52235 existing records from primary storage. [2025-10-28T17:28:17.040214] [INFO ] [MAIN ] BCE: Loaded 52235 existing records. [2025-10-28T17:28:17.221381] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:17.221563] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-28T17:28:17.221611] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-28T17:28:17.222464] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-28T17:28:17.222522] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-28T17:28:17.570276] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-28T17:28:17.574674] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:17.744324] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T17:28:18.359419] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-28T17:28:18.681467] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:28:19.155497] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:28:19.160530] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-28T17:28:19.959371] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-28T17:28:20.062347] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T17:28:20.759348] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-28T17:28:21.008708] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:28:21.559353] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-28T17:28:21.815484] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:28:22.359338] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-28T17:28:22.868394] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:28:23.161917] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-28T17:28:23.173094] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:28:23.959340] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-28T17:28:24.062343] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:28:24.759353] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-28T17:28:25.088515] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T17:28:25.096824] [INFO ] [REMOTE ] BC: Full fetch complete (63879 records). [2025-10-28T17:28:25.096929] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-28T17:28:25.479850] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-28T17:28:25.479922] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-28T17:28:25.480593] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-28T17:28:25.480635] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-28T17:28:25.481879] [DEBUG] [LOCAL ] BC: Trimmed 63879 records to 43774 (keeping 200 days of data) [2025-10-28T17:28:25.568804] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-28T17:28:25.628060] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T17:28:25.789287] [DEBUG] [LOCAL ] BC: Primary data saved (43774 records). [2025-10-28T17:28:25.789420] [INFO ] [MAIN ] BC: Full history saved. [2025-10-28T17:28:25.789503] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BC took 29.9s. Estimated remaining: 4h 22m 18s. Rate: 8.1 symbols/min [2025-10-28T17:28:25.956178] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:25.983386] [DEBUG] [LOCAL ] BCH: Loaded 29646 existing records from primary storage. [2025-10-28T17:28:25.983670] [INFO ] [MAIN ] BCH: Loaded 29646 existing records. [2025-10-28T17:28:26.158799] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:26.159006] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-28T17:28:26.159052] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-28T17:28:26.159604] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-28T17:28:26.159699] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-28T17:28:26.364514] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-28T17:28:26.542102] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:26.559825] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T17:28:27.159369] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-28T17:28:27.601214] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:28:27.959396] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-28T17:28:28.180262] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:28:28.759329] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-28T17:28:29.042068] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T17:28:29.048683] [INFO ] [REMOTE ] BCC: Full fetch complete (41771 records). [2025-10-28T17:28:29.048774] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-28T17:28:29.415897] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-28T17:28:29.415970] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-28T17:28:29.416434] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-28T17:28:29.416474] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-28T17:28:29.417434] [DEBUG] [LOCAL ] BCC: Trimmed 41771 records to 28455 (keeping 200 days of data) [2025-10-28T17:28:29.560109] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-28T17:28:29.590076] [DEBUG] [LOCAL ] BCC: Primary data saved (28455 records). [2025-10-28T17:28:29.590255] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-28T17:28:29.590395] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCC took 25.6s. Estimated remaining: 4h 21m 38s. Rate: 8.2 symbols/min [2025-10-28T17:28:29.749218] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:28:29.776785] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:29.798271] [DEBUG] [LOCAL ] BCO: Loaded 24419 existing records from primary storage. [2025-10-28T17:28:29.798513] [INFO ] [MAIN ] BCO: Loaded 24419 existing records. [2025-10-28T17:28:29.992712] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:29.992905] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-28T17:28:29.992951] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-28T17:28:29.993496] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-28T17:28:29.993553] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-28T17:28:30.341050] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:30.359293] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-28T17:28:31.166506] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-28T17:28:31.173223] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T17:28:31.198890] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:28:31.959370] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-28T17:28:32.122771] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:28:32.759362] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-28T17:28:33.194174] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:28:33.533378] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:28:33.559309] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-28T17:28:34.352996] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:28:34.359297] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-28T17:28:35.159362] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-28T17:28:35.365382] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T17:28:35.959371] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-28T17:28:36.238199] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:28:36.759356] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-28T17:28:37.238199] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:28:37.559337] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-28T17:28:37.670288] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T17:28:38.359390] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-28T17:28:38.575172] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:28:38.582282] [INFO ] [REMOTE ] BCAT: Full fetch complete (50058 records). [2025-10-28T17:28:38.582385] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-28T17:28:38.959243] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-28T17:28:38.959341] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-28T17:28:38.959943] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-28T17:28:38.960004] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-28T17:28:38.961130] [DEBUG] [LOCAL ] BCAT: Trimmed 50058 records to 33937 (keeping 200 days of data) [2025-10-28T17:28:39.167055] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-28T17:28:39.170571] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:28:39.202707] [DEBUG] [LOCAL ] BCAT: Primary data saved (33937 records). [2025-10-28T17:28:39.202858] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-28T17:28:39.202941] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BCAT took 36.7s. Estimated remaining: 4h 21m 51s. Rate: 8.1 symbols/min [2025-10-28T17:28:39.380384] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:39.428680] [DEBUG] [LOCAL ] BCS: Loaded 53437 existing records from primary storage. [2025-10-28T17:28:39.429003] [INFO ] [MAIN ] BCS: Loaded 53437 existing records. [2025-10-28T17:28:39.632531] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:39.632765] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-28T17:28:39.632818] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-28T17:28:39.633686] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-28T17:28:39.633745] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-28T17:28:39.960504] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-28T17:28:40.049896] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:40.064295] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:28:40.759340] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-28T17:28:41.534252] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:28:41.559301] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-28T17:28:41.676973] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:28:42.359388] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-28T17:28:42.653632] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:28:43.159419] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-28T17:28:43.311865] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T17:28:43.959440] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-28T17:28:44.641491] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T17:28:44.759384] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-28T17:28:45.009479] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T17:28:45.554356] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:28:45.560681] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-28T17:28:46.359435] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-28T17:28:46.938922] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:28:47.159335] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-28T17:28:47.190089] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T17:28:47.959347] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-28T17:28:48.426711] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T17:28:48.759375] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-28T17:28:48.855185] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T17:28:48.861987] [INFO ] [REMOTE ] BCH: Full fetch complete (41760 records). [2025-10-28T17:28:48.862135] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-28T17:28:49.236460] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-28T17:28:49.236563] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-28T17:28:49.237146] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-28T17:28:49.237241] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-28T17:28:49.238288] [DEBUG] [LOCAL ] BCH: Trimmed 41760 records to 29555 (keeping 200 days of data) [2025-10-28T17:28:49.417345] [DEBUG] [LOCAL ] BCH: Primary data saved (29555 records). [2025-10-28T17:28:49.417532] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-28T17:28:49.417626] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCH took 23.6s. Estimated remaining: 4h 22m 10s. Rate: 8.1 symbols/min [2025-10-28T17:28:49.560584] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-28T17:28:49.609507] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:49.628588] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T17:28:49.657426] [DEBUG] [LOCAL ] BCSF: Loaded 27770 existing records from primary storage. [2025-10-28T17:28:49.657751] [INFO ] [MAIN ] BCSF: Loaded 27770 existing records. [2025-10-28T17:28:49.837116] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:49.837372] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-28T17:28:49.837419] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-28T17:28:49.837985] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-28T17:28:49.838044] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-28T17:28:50.192784] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:50.359387] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-28T17:28:50.836688] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T17:28:51.159332] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-28T17:28:51.631942] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:28:51.959343] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-28T17:28:52.537948] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:28:52.547923] [INFO ] [REMOTE ] BCE: Full fetch complete (75708 records). [2025-10-28T17:28:52.548056] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-28T17:28:52.548683] [FATAL] [VALIDATOR ] BCE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:28:52.548765] [FATAL] [MAIN ] BCE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:28:52.548807] [WARN ] [MAIN ] BCE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:28:52.548844] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-28T17:28:52.548898] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-28T17:28:52.548933] [INFO ] [LOCAL ] BCE: Starting deletion of derivative data. [2025-10-28T17:28:52.549748] [DEBUG] [LOCAL ] BCE: Deleted derivative data file. [2025-10-28T17:28:52.550410] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCE took 35.8s. Estimated remaining: 4h 21m 24s. Rate: 8.2 symbols/min [2025-10-28T17:28:52.718021] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:52.738422] [DEBUG] [LOCAL ] BCX: Loaded 21778 existing records from primary storage. [2025-10-28T17:28:52.738699] [INFO ] [MAIN ] BCX: Loaded 21778 existing records. [2025-10-28T17:28:52.768572] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-28T17:28:52.913690] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:52.913894] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-28T17:28:52.913939] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-28T17:28:52.914502] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-28T17:28:52.914560] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-28T17:28:53.263148] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:53.357846] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T17:28:53.559335] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-28T17:28:53.965032] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:28:54.339374] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T17:28:54.359346] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-28T17:28:55.159352] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-28T17:28:55.253847] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:28:55.855416] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:28:55.959345] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-28T17:28:56.759404] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-28T17:28:56.981278] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:28:57.559395] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-28T17:28:57.666529] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T17:28:58.359327] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-28T17:28:58.582813] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:28:59.104101] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:28:59.159334] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-28T17:28:59.908343] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:28:59.959300] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-28T17:29:00.641789] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:29:00.759339] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-28T17:29:01.559329] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-28T17:29:01.575483] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T17:29:02.359346] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-28T17:29:03.137799] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T17:29:03.159305] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-28T17:29:03.221822] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T17:29:03.959351] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-28T17:29:04.478971] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:29:04.664697] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:29:04.759332] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-28T17:29:05.559384] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-28T17:29:05.618885] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T17:29:05.624807] [INFO ] [REMOTE ] BCO: Full fetch complete (35899 records). [2025-10-28T17:29:05.625041] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-28T17:29:06.201403] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-28T17:29:06.201522] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-28T17:29:06.202236] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-28T17:29:06.202320] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-28T17:29:06.203684] [DEBUG] [LOCAL ] BCO: Trimmed 35899 records to 24272 (keeping 200 days of data) [2025-10-28T17:29:06.359797] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-28T17:29:06.393153] [DEBUG] [LOCAL ] BCO: Primary data saved (24272 records). [2025-10-28T17:29:06.393262] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-28T17:29:06.393335] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCO took 36.8s. Estimated remaining: 4h 22m 15s. Rate: 8.1 symbols/min [2025-10-28T17:29:06.570282] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:06.589349] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:29:06.615503] [DEBUG] [LOCAL ] BDC: Loaded 23527 existing records from primary storage. [2025-10-28T17:29:06.615756] [INFO ] [MAIN ] BDC: Loaded 23527 existing records. [2025-10-28T17:29:06.791188] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:06.791387] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-28T17:29:06.791436] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-28T17:29:06.791621] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-28T17:29:06.791700] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-28T17:29:07.154883] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:07.159294] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-28T17:29:07.186879] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T17:29:07.959328] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-28T17:29:08.119018] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:29:08.759347] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-28T17:29:08.850017] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T17:29:09.559349] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-28T17:29:10.233473] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:29:10.245692] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:29:10.359331] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-28T17:29:11.159397] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-28T17:29:11.714297] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:29:11.737955] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:29:11.959364] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-28T17:29:12.759404] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-28T17:29:13.535336] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:29:13.559297] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-28T17:29:13.801263] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-28T17:29:14.251295] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:29:14.359295] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-28T17:29:15.097913] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T17:29:15.159295] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-28T17:29:15.959358] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-28T17:29:16.041554] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:29:16.710711] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:29:16.759315] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-28T17:29:17.563479] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-28T17:29:17.567537] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:29:18.359342] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-28T17:29:18.600498] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:29:18.605932] [INFO ] [REMOTE ] BCX: Full fetch complete (33577 records). [2025-10-28T17:29:18.606070] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-28T17:29:18.971882] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-28T17:29:18.971958] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-28T17:29:18.972363] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-28T17:29:18.972401] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-28T17:29:18.973110] [DEBUG] [LOCAL ] BCX: Trimmed 33577 records to 21667 (keeping 200 days of data) [2025-10-28T17:29:19.099023] [DEBUG] [LOCAL ] BCX: Primary data saved (21667 records). [2025-10-28T17:29:19.099141] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-28T17:29:19.099214] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCX took 26.5s. Estimated remaining: 4h 22m 55s. Rate: 8.1 symbols/min [2025-10-28T17:29:19.159322] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-28T17:29:19.774871] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:29:19.790954] [INFO ] [REMOTE ] BCS: Full fetch complete (77525 records). [2025-10-28T17:29:19.791133] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-28T17:29:19.962756] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-28T17:29:20.225934] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-28T17:29:20.226076] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-28T17:29:20.226938] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-28T17:29:20.227082] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-28T17:29:20.244815] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:29:20.250929] [DEBUG] [LOCAL ] BCS: Trimmed 77525 records to 53436 (keeping 200 days of data) [2025-10-28T17:29:20.574212] [DEBUG] [LOCAL ] BCS: Primary data saved (53436 records). [2025-10-28T17:29:20.574335] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-28T17:29:20.574412] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCS took 41.4s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-28T17:29:20.759348] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-28T17:29:21.266749] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T17:29:21.273719] [INFO ] [REMOTE ] BCSF: Full fetch complete (40099 records). [2025-10-28T17:29:21.273805] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-28T17:29:21.659895] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-28T17:29:21.660079] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-28T17:29:21.660560] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-28T17:29:21.660636] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-28T17:29:21.676039] [DEBUG] [LOCAL ] BCSF: Trimmed 40099 records to 27752 (keeping 200 days of data) [2025-10-28T17:29:21.675937] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:29:21.682112] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-28T17:29:21.845737] [DEBUG] [LOCAL ] BCSF: Primary data saved (27752 records). [2025-10-28T17:29:21.845846] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-28T17:29:21.845920] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCSF took 32.4s. Estimated remaining: 4h 20m 53s. Rate: 8.2 symbols/min [2025-10-28T17:29:22.695860] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:29:22.700821] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-28T17:29:23.942715] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:29:23.949464] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-28T17:29:24.817193] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:29:24.822743] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-28T17:29:25.565903] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T17:29:25.571133] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-28T17:29:26.436184] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T17:29:26.440847] [INFO ] [REMOTE ] BDC: Full fetch complete (35554 records). [2025-10-28T17:29:26.441029] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-28T17:29:26.803241] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-28T17:29:26.803317] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-28T17:29:26.803749] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-28T17:29:26.803809] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-28T17:29:26.804601] [DEBUG] [LOCAL ] BDC: Trimmed 35554 records to 23420 (keeping 200 days of data) [2025-10-28T17:29:26.948828] [DEBUG] [LOCAL ] BDC: Primary data saved (23420 records). [2025-10-28T17:29:26.949007] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-28T17:29:26.949120] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 20.6s. Estimated remaining: 4h 20m 26s. Rate: 8.2 symbols/min [2025-10-28T17:29:27.572933] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.618263] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.658888] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.709997] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.742914] [DEBUG] [LOCAL ] BDJ: Loaded 28843 existing records from primary storage. [2025-10-28T17:29:27.743274] [INFO ] [MAIN ] BDJ: Loaded 28843 existing records. [2025-10-28T17:29:27.885625] [DEBUG] [LOCAL ] BDN: Loaded 47524 existing records from primary storage. [2025-10-28T17:29:27.915121] [INFO ] [MAIN ] BDN: Loaded 47524 existing records. [2025-10-28T17:29:28.054857] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.067140] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-28T17:29:28.110440] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-28T17:29:28.096313] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.116275] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-28T17:29:28.127411] [DEBUG] [LOCAL ] BDX: Loaded 52047 existing records from primary storage. [2025-10-28T17:29:28.127909] [INFO ] [MAIN ] BDX: Loaded 52047 existing records. [2025-10-28T17:29:28.138211] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-28T17:29:28.154023] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-28T17:29:28.333678] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.353888] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.353992] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-28T17:29:28.388826] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-28T17:29:28.455795] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-28T17:29:28.763077] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.785323] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.791038] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.806676] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-28T17:29:28.807447] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.807536] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-28T17:29:28.813188] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-28T17:29:28.847264] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-28T17:29:28.852592] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-28T17:29:28.866446] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-28T17:29:29.631163] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:29.690244] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-28T17:29:30.104959] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:30.158959] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:30.167527] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-28T17:29:30.185526] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-28T17:29:30.191972] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:30.194432] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-28T17:29:31.150464] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T17:29:31.157359] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-28T17:29:31.474380] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:29:31.484134] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-28T17:29:31.913454] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T17:29:31.924272] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-28T17:29:31.940891] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:29:31.947142] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-28T17:29:32.004542] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-28T17:29:32.015597] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-28T17:29:32.620499] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:29:32.759362] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-28T17:29:33.000720] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T17:29:33.236430] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:29:33.379737] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T17:29:33.559305] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-28T17:29:33.839818] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:29:34.359386] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-28T17:29:35.159404] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-28T17:29:35.248683] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T17:29:35.334662] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-28T17:29:35.959385] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-28T17:29:36.759338] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-28T17:29:37.044295] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T17:29:37.241977] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:29:37.564428] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-28T17:29:37.575042] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T17:29:38.359397] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-28T17:29:38.819822] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T17:29:39.159380] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-28T17:29:39.694062] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:29:39.959341] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-28T17:29:40.369194] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:29:40.759297] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-28T17:29:41.052209] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:29:41.559362] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-28T17:29:42.189022] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:29:42.359345] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-28T17:29:42.701815] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T17:29:43.159376] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-28T17:29:43.789228] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:29:43.959321] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-28T17:29:44.200373] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T17:29:44.759321] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-28T17:29:45.416518] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:29:45.536321] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T17:29:45.559330] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-28T17:29:46.359361] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-28T17:29:46.695442] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:29:47.042570] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T17:29:47.159311] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-28T17:29:47.959325] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-28T17:29:48.395572] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:29:48.759337] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-28T17:29:48.957730] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:29:48.963712] [INFO ] [REMOTE ] BDJ: Full fetch complete (42697 records). [2025-10-28T17:29:48.963807] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-28T17:29:49.332985] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-28T17:29:49.333057] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-28T17:29:49.333524] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-28T17:29:49.333565] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-28T17:29:49.334417] [DEBUG] [LOCAL ] BDJ: Trimmed 42697 records to 28805 (keeping 200 days of data) [2025-10-28T17:29:49.496190] [DEBUG] [LOCAL ] BDJ: Primary data saved (28805 records). [2025-10-28T17:29:49.496312] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-28T17:29:49.496387] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDJ took 22.5s. Estimated remaining: 4h 22m 32s. Rate: 8.1 symbols/min [2025-10-28T17:29:49.564566] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-28T17:29:49.663762] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:49.663900] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-28T17:29:49.663937] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-28T17:29:49.664042] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-28T17:29:49.664083] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-28T17:29:49.664124] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-28T17:29:49.664157] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-28T17:29:50.029303] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:50.054880] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T17:29:50.359305] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-28T17:29:51.159315] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-28T17:29:51.205159] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T17:29:51.520862] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:29:51.959330] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-28T17:29:52.477840] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T17:29:52.487222] [INFO ] [REMOTE ] BDN: Full fetch complete (69011 records). [2025-10-28T17:29:52.487385] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-28T17:29:52.488083] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:29:52.488176] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:29:52.488225] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:29:52.488301] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-28T17:29:52.488378] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-28T17:29:52.488430] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-10-28T17:29:52.489782] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-10-28T17:29:52.489899] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDN took 25.5s. Estimated remaining: 4h 21m 46s. Rate: 8.1 symbols/min [2025-10-28T17:29:52.660054] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:52.707119] [DEBUG] [LOCAL ] BEKE: Loaded 53182 existing records from primary storage. [2025-10-28T17:29:52.707438] [INFO ] [MAIN ] BEKE: Loaded 53182 existing records. [2025-10-28T17:29:52.769341] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-28T17:29:52.884684] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:52.884899] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-28T17:29:52.884965] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-28T17:29:52.885834] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-28T17:29:52.885892] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-28T17:29:53.248679] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:53.394042] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:29:53.559313] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-28T17:29:53.989695] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T17:29:54.360119] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-28T17:29:54.365590] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-28T17:29:55.159579] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-28T17:29:55.745111] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:29:55.755204] [INFO ] [REMOTE ] BDX: Full fetch complete (75367 records). [2025-10-28T17:29:55.755366] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-28T17:29:55.969200] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-28T17:29:56.167914] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-28T17:29:56.168001] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-28T17:29:56.168790] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-28T17:29:56.168855] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-28T17:29:56.170977] [DEBUG] [LOCAL ] BDX: Trimmed 75367 records to 52015 (keeping 200 days of data) [2025-10-28T17:29:56.237767] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T17:29:56.460187] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:29:56.543887] [DEBUG] [LOCAL ] BDX: Primary data saved (52015 records). [2025-10-28T17:29:56.544007] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-28T17:29:56.544099] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BDX took 29.6s. Estimated remaining: 4h 21m 10s. Rate: 8.1 symbols/min [2025-10-28T17:29:56.709670] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:56.760144] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-28T17:29:56.760069] [DEBUG] [LOCAL ] BEN: Loaded 53102 existing records from primary storage. [2025-10-28T17:29:56.760725] [INFO ] [MAIN ] BEN: Loaded 53102 existing records. [2025-10-28T17:29:56.967153] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:56.967364] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-28T17:29:56.967410] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-28T17:29:56.967949] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-28T17:29:56.968007] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-28T17:29:57.140546] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T17:29:57.326120] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:57.559384] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-28T17:29:58.359355] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-28T17:29:59.159327] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-28T17:29:59.440867] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T17:29:59.713348] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:29:59.959352] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-28T17:30:00.658434] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:30:00.759311] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-28T17:30:01.369587] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:30:01.559420] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-28T17:30:01.864309] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T17:30:02.359319] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-28T17:30:02.571411] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:30:02.768780] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:30:03.159356] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-28T17:30:03.414833] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-28T17:30:03.959339] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-28T17:30:04.759353] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-28T17:30:05.559357] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-28T17:30:06.260967] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-28T17:30:06.306448] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T17:30:06.359298] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-28T17:30:07.104100] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T17:30:07.159342] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-28T17:30:07.959404] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-28T17:30:08.453285] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-28T17:30:08.464001] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-28T17:30:08.464149] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-28T17:30:08.759733] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-28T17:30:08.889105] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-28T17:30:08.889221] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-28T17:30:08.890097] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-28T17:30:08.890239] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-28T17:30:08.891829] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-28T17:30:09.020638] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-28T17:30:09.145205] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T17:30:09.263667] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-28T17:30:09.263823] [INFO ] [MAIN ] BE: Full history saved. [2025-10-28T17:30:09.263914] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BE took 42.3s. Estimated remaining: 4h 21m 49s. Rate: 8.1 symbols/min [2025-10-28T17:30:09.446117] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:09.480625] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T17:30:09.519124] [DEBUG] [LOCAL ] BEP: Loaded 38684 existing records from primary storage. [2025-10-28T17:30:09.519429] [INFO ] [MAIN ] BEP: Loaded 38684 existing records. [2025-10-28T17:30:09.564556] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-28T17:30:09.729869] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:09.731105] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-28T17:30:09.731167] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-28T17:30:09.732400] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-28T17:30:09.732463] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-28T17:30:10.098303] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:10.359350] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-28T17:30:10.602811] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T17:30:11.159316] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-28T17:30:11.334788] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T17:30:11.959317] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-28T17:30:12.193098] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T17:30:12.752832] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T17:30:12.763368] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-28T17:30:13.260325] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T17:30:13.261232] [INFO ] [REMOTE ] BEDU: Full fetch complete (1328 records). [2025-10-28T17:30:13.261299] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-28T17:30:13.444109] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-28T17:30:13.444292] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:30:13.444365] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:30:13.444434] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-28T17:30:13.444500] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-28T17:30:13.444537] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-28T17:30:13.444577] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-28T17:30:13.444632] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 23.9s. Estimated remaining: 4h 21m 13s. Rate: 8.1 symbols/min [2025-10-28T17:30:13.564465] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-28T17:30:13.627107] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:13.669161] [DEBUG] [LOCAL ] BEPC: Loaded 46201 existing records from primary storage. [2025-10-28T17:30:13.669449] [INFO ] [MAIN ] BEPC: Loaded 46201 existing records. [2025-10-28T17:30:13.846436] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:13.846685] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-28T17:30:13.846743] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-28T17:30:13.847508] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-28T17:30:13.847566] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-28T17:30:14.218479] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:14.359339] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-28T17:30:14.925083] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:30:15.159361] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-28T17:30:15.959336] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-28T17:30:16.343256] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:30:16.759357] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-28T17:30:17.215063] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T17:30:17.436271] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (3.08 seconds). [2025-10-28T17:30:17.559317] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-28T17:30:18.063447] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:30:18.359381] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-28T17:30:18.849455] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T17:30:19.159350] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-28T17:30:19.389389] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:30:19.959329] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-28T17:30:20.741868] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:30:20.759295] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-28T17:30:21.490562] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T17:30:21.559341] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-28T17:30:21.931384] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T17:30:22.359351] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-28T17:30:23.165696] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-28T17:30:23.169413] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T17:30:23.509359] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:30:23.959394] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-28T17:30:24.553510] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:30:24.759331] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-28T17:30:25.336339] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:30:25.559352] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-28T17:30:26.099548] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T17:30:26.359333] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-28T17:30:26.944735] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:30:27.159342] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-28T17:30:27.959312] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-28T17:30:28.523413] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:30:28.676153] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-28T17:30:28.686990] [INFO ] [REMOTE ] BEKE: Full fetch complete (77315 records). [2025-10-28T17:30:28.687155] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-28T17:30:28.764426] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-28T17:30:29.106223] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-28T17:30:29.106391] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-28T17:30:29.107363] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-28T17:30:29.107495] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-28T17:30:29.109066] [DEBUG] [LOCAL ] BEKE: Trimmed 77315 records to 53169 (keeping 200 days of data) [2025-10-28T17:30:29.242422] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:30:29.466628] [DEBUG] [LOCAL ] BEKE: Primary data saved (53169 records). [2025-10-28T17:30:29.466804] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-28T17:30:29.466894] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEKE took 37.0s. Estimated remaining: 4h 22m 20s. Rate: 8.1 symbols/min [2025-10-28T17:30:29.564427] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-28T17:30:29.656590] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:29.662566] [DEBUG] [LOCAL ] BEPH: Loaded 4804 existing records from primary storage. [2025-10-28T17:30:29.662766] [INFO ] [MAIN ] BEPH: Loaded 4804 existing records. [2025-10-28T17:30:29.836290] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:29.836502] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-28T17:30:29.836551] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-28T17:30:29.836787] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-28T17:30:29.836843] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-28T17:30:30.189134] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:30.359337] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-28T17:30:30.435858] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T17:30:30.447129] [INFO ] [REMOTE ] BEN: Full fetch complete (77050 records). [2025-10-28T17:30:30.447490] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-28T17:30:30.770270] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:30:30.865444] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-28T17:30:30.865532] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-28T17:30:30.866339] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-28T17:30:30.866402] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-28T17:30:30.868096] [DEBUG] [LOCAL ] BEN: Trimmed 77050 records to 53093 (keeping 200 days of data) [2025-10-28T17:30:30.893974] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T17:30:31.173155] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-28T17:30:31.218680] [DEBUG] [LOCAL ] BEN: Primary data saved (53093 records). [2025-10-28T17:30:31.218792] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-28T17:30:31.218864] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEN took 34.7s. Estimated remaining: 4h 21m 24s. Rate: 8.1 symbols/min [2025-10-28T17:30:31.390699] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:31.396703] [DEBUG] [LOCAL ] BEPI: Loaded 3495 existing records from primary storage. [2025-10-28T17:30:31.396885] [INFO ] [MAIN ] BEPI: Loaded 3495 existing records. [2025-10-28T17:30:31.569630] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:31.569868] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-28T17:30:31.569935] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-28T17:30:31.570134] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-28T17:30:31.570190] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-28T17:30:31.918442] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:31.959297] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-28T17:30:32.429693] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:30:32.535239] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:30:32.759337] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-28T17:30:33.559350] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-28T17:30:33.877198] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T17:30:34.043002] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:30:34.359368] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-28T17:30:34.742943] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T17:30:35.159355] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-28T17:30:35.544362] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:30:35.959384] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-28T17:30:36.759375] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-28T17:30:37.097483] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T17:30:37.097177] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:30:37.559336] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-28T17:30:38.359348] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-28T17:30:38.623809] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T17:30:39.159352] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-28T17:30:39.671732] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T17:30:39.959366] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-28T17:30:40.091473] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T17:30:40.380049] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T17:30:40.759376] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-28T17:30:41.559371] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-28T17:30:41.951995] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T17:30:42.267735] [DEBUG] [REMOTE ] BEPC: Error fetching primary data for 2025-10: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T17:30:42.267975] [WARN ] [REMOTE ] BEPC: No data returned for month 2025-10 [2025-10-28T17:30:42.268051] [FATAL] [REMOTE ] BEPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:30:42.268098] [FATAL] [MAIN ] BEPC: Failed to fetch primary data. [2025-10-28T17:30:42.268132] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:30:42.268173] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-28T17:30:42.268239] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-28T17:30:42.268277] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-28T17:30:42.268508] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-10-28T17:30:42.268617] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEPC took 28.8s. Estimated remaining: 4h 21m 48s. Rate: 8.1 symbols/min [2025-10-28T17:30:42.364494] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-28T17:30:42.447297] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:42.452511] [DEBUG] [LOCAL ] BEPJ: Loaded 3063 existing records from primary storage. [2025-10-28T17:30:42.452720] [INFO ] [MAIN ] BEPJ: Loaded 3063 existing records. [2025-10-28T17:30:42.638184] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:42.638376] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-28T17:30:42.638421] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-28T17:30:42.638591] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-28T17:30:42.638629] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-28T17:30:42.936480] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T17:30:42.994519] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:43.159328] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-28T17:30:43.611048] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T17:30:43.959370] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-28T17:30:44.300327] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T17:30:44.759447] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-28T17:30:45.559339] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-28T17:30:45.943399] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:30:45.947015] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T17:30:46.359360] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-28T17:30:46.675776] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T17:30:47.159415] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-28T17:30:47.615415] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T17:30:47.959325] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-28T17:30:48.383703] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T17:30:48.759339] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-28T17:30:49.060377] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:30:49.559363] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-28T17:30:49.911056] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T17:30:50.359360] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-28T17:30:50.648114] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T17:30:51.159340] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-28T17:30:51.572274] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T17:30:51.959333] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-28T17:30:52.405517] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:30:52.759365] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-28T17:30:53.071698] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T17:30:53.559335] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-28T17:30:54.037139] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:30:54.359379] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-28T17:30:55.082832] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T17:30:55.159312] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-28T17:30:55.558130] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T17:30:55.959344] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-28T17:30:56.283988] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T17:30:56.759357] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-28T17:30:57.559349] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-28T17:30:57.932677] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:30:58.219430] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:30:58.228845] [INFO ] [REMOTE ] BEP: Full fetch complete (59208 records). [2025-10-28T17:30:58.229002] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-28T17:30:58.364461] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-28T17:30:58.629810] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-28T17:30:58.629903] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-28T17:30:58.630522] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-28T17:30:58.630565] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-28T17:30:58.631952] [DEBUG] [LOCAL ] BEP: Trimmed 59208 records to 38735 (keeping 200 days of data) [2025-10-28T17:30:58.861355] [DEBUG] [LOCAL ] BEP: Primary data saved (38735 records). [2025-10-28T17:30:58.861576] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-28T17:30:58.861691] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEP took 49.6s. Estimated remaining: 4h 22m 59s. Rate: 8.1 symbols/min [2025-10-28T17:30:58.959267] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:30:58.972409] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4398 records). [2025-10-28T17:30:58.988313] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-28T17:30:59.121486] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:59.161227] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-28T17:30:59.426964] [DEBUG] [LOCAL ] BFAM: Loaded 33693 existing records from primary storage. [2025-10-28T17:30:59.450279] [INFO ] [MAIN ] BFAM: Loaded 33693 existing records. [2025-10-28T17:30:59.450397] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-28T17:30:59.450491] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-28T17:30:59.450725] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-28T17:30:59.483134] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-28T17:30:59.531189] [DEBUG] [LOCAL ] BEPJ: Trimmed 4398 records to 3060 (keeping 200 days of data) [2025-10-28T17:30:59.633409] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3060 records). [2025-10-28T17:30:59.661174] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-28T17:30:59.665190] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPJ took 17.4s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-28T17:30:59.664980] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:59.733150] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-28T17:30:59.744608] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-28T17:30:59.777995] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T17:30:59.778174] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-28T17:30:59.780596] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-28T17:30:59.956849] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:59.964482] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-28T17:31:00.277268] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:00.279128] [DEBUG] [LOCAL ] BFH: Loaded 41171 existing records from primary storage. [2025-10-28T17:31:00.279564] [INFO ] [MAIN ] BFH: Loaded 41171 existing records. [2025-10-28T17:31:00.477358] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:00.477586] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-28T17:31:00.477691] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-28T17:31:00.478566] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-28T17:31:00.478627] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-28T17:31:00.590738] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T17:31:00.619557] [INFO ] [REMOTE ] BEPI: Full fetch complete (4703 records). [2025-10-28T17:31:00.637992] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-28T17:31:00.764443] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-28T17:31:01.171328] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:01.262475] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-28T17:31:01.262560] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-28T17:31:01.262729] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-28T17:31:01.262791] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-28T17:31:01.263217] [DEBUG] [LOCAL ] BEPI: Trimmed 4703 records to 3456 (keeping 200 days of data) [2025-10-28T17:31:01.284964] [DEBUG] [LOCAL ] BEPI: Primary data saved (3456 records). [2025-10-28T17:31:01.285086] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-28T17:31:01.285184] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPI took 30.1s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min [2025-10-28T17:31:01.395060] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T17:31:01.422922] [INFO ] [REMOTE ] BEPH: Full fetch complete (7498 records). [2025-10-28T17:31:01.442612] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-28T17:31:01.469420] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:01.538133] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-28T17:31:01.560394] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-28T17:31:01.549196] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-28T17:31:01.579588] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-28T17:31:01.590632] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-28T17:31:01.639767] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-28T17:31:01.655688] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-28T17:31:02.053734] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-28T17:31:02.054786] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-28T17:31:02.107145] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-28T17:31:02.131379] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-28T17:31:02.195482] [DEBUG] [LOCAL ] BEPH: Trimmed 7498 records to 4778 (keeping 200 days of data) [2025-10-28T17:31:02.321069] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:02.326012] [DEBUG] [LOCAL ] BEPH: Primary data saved (4778 records). [2025-10-28T17:31:02.326362] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-28T17:31:02.326445] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPH took 32.9s. Estimated remaining: 4h 19m 58s. Rate: 8.1 symbols/min [2025-10-28T17:31:02.368404] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-28T17:31:02.495483] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:02.545974] [DEBUG] [LOCAL ] BFLY: Loaded 51867 existing records from primary storage. [2025-10-28T17:31:02.546280] [INFO ] [MAIN ] BFLY: Loaded 51867 existing records. [2025-10-28T17:31:02.725700] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:02.725979] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-28T17:31:02.726041] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-28T17:31:02.726457] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-28T17:31:02.726525] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-28T17:31:02.904453] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:31:03.129614] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:03.159292] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-28T17:31:03.480879] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:31:03.959367] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-28T17:31:04.278083] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T17:31:04.418398] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T17:31:04.759394] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-28T17:31:05.559322] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-28T17:31:05.888555] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:31:06.359348] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-28T17:31:06.434747] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T17:31:07.159393] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-28T17:31:07.616458] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T17:31:07.959351] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-28T17:31:08.551426] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:31:08.759346] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-28T17:31:09.322906] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:31:09.559337] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-28T17:31:09.842987] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:31:10.359381] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-28T17:31:10.725963] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:31:11.159360] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-28T17:31:11.673394] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T17:31:11.719455] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:31:11.959343] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-28T17:31:12.759399] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-28T17:31:13.131346] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T17:31:13.559398] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-28T17:31:13.971210] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:31:14.359354] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-28T17:31:14.817559] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:31:15.159362] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-28T17:31:15.230904] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T17:31:15.959386] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-28T17:31:16.443711] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:31:16.621045] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T17:31:16.759409] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-28T17:31:17.454001] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:31:17.559402] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-28T17:31:18.331544] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T17:31:18.359338] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-28T17:31:19.159307] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-28T17:31:19.353167] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T17:31:19.705157] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:31:19.959367] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-28T17:31:20.480956] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T17:31:20.759335] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-28T17:31:21.559360] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-28T17:31:21.653062] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T17:31:22.359310] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-28T17:31:22.469757] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:31:23.159388] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-28T17:31:23.412476] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T17:31:23.959357] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-28T17:31:24.492532] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:31:24.759380] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-28T17:31:25.559325] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-28T17:31:25.610204] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T17:31:25.617792] [INFO ] [REMOTE ] BFAM: Full fetch complete (47612 records). [2025-10-28T17:31:25.617993] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-28T17:31:26.012870] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-28T17:31:26.012953] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-28T17:31:26.013579] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-28T17:31:26.013635] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-28T17:31:26.014861] [DEBUG] [LOCAL ] BFAM: Trimmed 47612 records to 33747 (keeping 200 days of data) [2025-10-28T17:31:26.218487] [DEBUG] [LOCAL ] BFAM: Primary data saved (33747 records). [2025-10-28T17:31:26.218753] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-28T17:31:26.218869] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 27.4s. Estimated remaining: 4h 22m 8s. Rate: 8.1 symbols/min [2025-10-28T17:31:26.347563] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T17:31:26.367782] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-28T17:31:26.440109] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:26.450766] [DEBUG] [LOCAL ] BFS: Loaded 9503 existing records from primary storage. [2025-10-28T17:31:26.450966] [INFO ] [MAIN ] BFS: Loaded 9503 existing records. [2025-10-28T17:31:26.634781] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:26.635404] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-28T17:31:26.635536] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-28T17:31:26.636035] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-28T17:31:26.636105] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-28T17:31:26.854134] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:31:27.047276] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:27.059445] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:31:27.159297] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-28T17:31:27.658306] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T17:31:27.959316] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-28T17:31:28.507631] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:31:28.759363] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-28T17:31:29.559336] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-28T17:31:29.680552] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:31:30.359338] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-28T17:31:30.872477] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T17:31:31.004427] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:31:31.159319] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-28T17:31:31.959330] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-28T17:31:32.548900] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T17:31:32.620220] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T17:31:32.759325] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-28T17:31:33.317515] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T17:31:33.559345] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-28T17:31:34.048263] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:31:34.359344] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-28T17:31:35.159340] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-28T17:31:35.757428] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:31:35.766246] [INFO ] [REMOTE ] BFH: Full fetch complete (60309 records). [2025-10-28T17:31:35.766383] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-28T17:31:35.885343] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T17:31:35.967777] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-28T17:31:36.172984] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-28T17:31:36.173080] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-28T17:31:36.173743] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-28T17:31:36.173807] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-28T17:31:36.175010] [DEBUG] [LOCAL ] BFH: Trimmed 60309 records to 41132 (keeping 200 days of data) [2025-10-28T17:31:36.422356] [DEBUG] [LOCAL ] BFH: Primary data saved (41132 records). [2025-10-28T17:31:36.422472] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-28T17:31:36.422547] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFH took 36.8s. Estimated remaining: 4h 22m 24s. Rate: 8.0 symbols/min [2025-10-28T17:31:36.596274] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:36.607887] [DEBUG] [LOCAL ] BFZ: Loaded 11944 existing records from primary storage. [2025-10-28T17:31:36.608062] [INFO ] [MAIN ] BFZ: Loaded 11944 existing records. [2025-10-28T17:31:36.722836] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:31:36.765688] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-28T17:31:36.806573] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:36.807000] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-28T17:31:36.807050] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-28T17:31:36.807378] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-28T17:31:36.807437] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-28T17:31:37.169387] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:37.362195] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:31:37.559328] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-28T17:31:38.146077] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T17:31:38.359439] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-28T17:31:38.900672] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T17:31:39.159353] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-28T17:31:39.786591] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:31:39.959359] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-28T17:31:40.759319] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-28T17:31:40.830082] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T17:31:40.835386] [INFO ] [REMOTE ] BFK: Full fetch complete (19494 records). [2025-10-28T17:31:40.835558] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-28T17:31:41.199613] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-28T17:31:41.199714] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-28T17:31:41.200088] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-28T17:31:41.200127] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-28T17:31:41.200708] [DEBUG] [LOCAL ] BFK: Trimmed 19494 records to 13780 (keeping 200 days of data) [2025-10-28T17:31:41.281189] [DEBUG] [LOCAL ] BFK: Primary data saved (13780 records). [2025-10-28T17:31:41.281324] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-28T17:31:41.281393] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFK took 40.0s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-28T17:31:41.447047] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:41.447236] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-10-28T17:31:41.447284] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-10-28T17:31:41.447390] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-28T17:31:41.447430] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-28T17:31:41.447469] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-28T17:31:41.447500] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-28T17:31:41.564608] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-28T17:31:41.808126] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:42.219032] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:31:42.359298] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-28T17:31:42.441951] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T17:31:42.444459] [INFO ] [REMOTE ] BFS: Full fetch complete (13107 records). [2025-10-28T17:31:42.444526] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-28T17:31:42.822770] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-28T17:31:42.822839] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-28T17:31:42.823120] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-28T17:31:42.823159] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-28T17:31:42.823615] [DEBUG] [LOCAL ] BFS: Trimmed 13107 records to 9454 (keeping 200 days of data) [2025-10-28T17:31:42.879314] [DEBUG] [LOCAL ] BFS: Primary data saved (9454 records). [2025-10-28T17:31:42.879428] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-28T17:31:42.879505] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFS took 16.7s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min [2025-10-28T17:31:43.046748] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:43.062902] [DEBUG] [LOCAL ] BGB: Loaded 17226 existing records from primary storage. [2025-10-28T17:31:43.063122] [INFO ] [MAIN ] BGB: Loaded 17226 existing records. [2025-10-28T17:31:43.164572] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-28T17:31:43.248431] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:43.248670] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-28T17:31:43.248741] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-28T17:31:43.249199] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-28T17:31:43.249259] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-28T17:31:43.616054] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:43.881450] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:31:43.891871] [INFO ] [REMOTE ] BFLY: Full fetch complete (75484 records). [2025-10-28T17:31:43.891989] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-28T17:31:43.966741] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-28T17:31:44.286953] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-28T17:31:44.287031] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-28T17:31:44.287842] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-28T17:31:44.287928] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-28T17:31:44.289309] [DEBUG] [LOCAL ] BFLY: Trimmed 75484 records to 51850 (keeping 200 days of data) [2025-10-28T17:31:44.603118] [DEBUG] [LOCAL ] BFLY: Primary data saved (51850 records). [2025-10-28T17:31:44.603324] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-28T17:31:44.610149] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFLY took 42.3s. Estimated remaining: 4h 20m 5s. Rate: 8.1 symbols/min [2025-10-28T17:31:44.632677] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:31:44.646958] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:31:44.769955] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-28T17:31:44.803252] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:44.803379] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-10-28T17:31:44.803423] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-10-28T17:31:44.803526] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-28T17:31:44.803566] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-28T17:31:44.803605] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-28T17:31:44.804162] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-28T17:31:45.158330] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:45.559390] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-28T17:31:46.057848] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T17:31:46.359390] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-28T17:31:46.457173] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:31:46.775445] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T17:31:47.159352] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-28T17:31:47.637681] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T17:31:47.959382] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-28T17:31:48.549490] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T17:31:48.759349] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-28T17:31:49.229254] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:31:49.559336] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-28T17:31:50.156303] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:31:50.359348] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-28T17:31:50.911923] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T17:31:51.159333] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-28T17:31:51.661538] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T17:31:51.959348] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-28T17:31:52.759315] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-28T17:31:52.893529] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T17:31:53.559395] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-28T17:31:53.623832] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T17:31:54.359335] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-28T17:31:54.894699] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T17:31:55.064702] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:31:55.159346] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-28T17:31:55.959334] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-28T17:31:56.521639] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:31:56.644710] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:31:56.759354] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-28T17:31:57.463412] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T17:31:57.559337] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-28T17:31:58.115865] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T17:31:58.118532] [INFO ] [REMOTE ] BFZ: Full fetch complete (17576 records). [2025-10-28T17:31:58.118601] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-28T17:31:58.119055] [FATAL] [VALIDATOR ] BFZ: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:31:58.119133] [FATAL] [MAIN ] BFZ: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:31:58.119175] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:31:58.119237] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-28T17:31:58.119300] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-28T17:31:58.119336] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-10-28T17:31:58.119512] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-10-28T17:31:58.119595] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 21.7s. Estimated remaining: 4h 20m 48s. Rate: 8.1 symbols/min [2025-10-28T17:31:58.292909] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:58.305714] [DEBUG] [LOCAL ] BGR: Loaded 13127 existing records from primary storage. [2025-10-28T17:31:58.305897] [INFO ] [MAIN ] BGR: Loaded 13127 existing records. [2025-10-28T17:31:58.366317] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-28T17:31:58.488639] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:58.488866] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-28T17:31:58.488914] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-28T17:31:58.489236] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-28T17:31:58.489297] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-28T17:31:58.838937] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:59.159311] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-28T17:31:59.171896] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T17:31:59.925766] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T17:31:59.959318] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-28T17:32:00.759340] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-28T17:32:01.341396] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:32:01.559333] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-28T17:32:01.740082] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-28T17:32:02.319766] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:32:02.359298] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-28T17:32:03.084353] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:32:03.159299] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-28T17:32:03.799535] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T17:32:03.959380] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-28T17:32:04.624884] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T17:32:04.759370] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-28T17:32:05.505766] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:32:05.511307] [INFO ] [REMOTE ] BGH: Full fetch complete (23082 records). [2025-10-28T17:32:05.511476] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-28T17:32:05.564476] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-28T17:32:05.931946] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-28T17:32:05.932021] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-28T17:32:05.932355] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-28T17:32:05.932394] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-28T17:32:05.933141] [DEBUG] [LOCAL ] BGH: Trimmed 23082 records to 16819 (keeping 200 days of data) [2025-10-28T17:32:06.035880] [DEBUG] [LOCAL ] BGH: Primary data saved (16819 records). [2025-10-28T17:32:06.036016] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-28T17:32:06.036087] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BGH took 21.4s. Estimated remaining: 4h 20m 44s. Rate: 8.1 symbols/min [2025-10-28T17:32:06.208071] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:06.248713] [DEBUG] [LOCAL ] BGS: Loaded 50455 existing records from primary storage. [2025-10-28T17:32:06.249026] [INFO ] [MAIN ] BGS: Loaded 50455 existing records. [2025-10-28T17:32:06.364395] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-28T17:32:06.437368] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:06.437633] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-28T17:32:06.437727] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-28T17:32:06.438967] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-28T17:32:06.439028] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-28T17:32:06.608933] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:32:06.823498] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:07.124625] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:32:07.159319] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-28T17:32:07.800908] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T17:32:07.959356] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-28T17:32:08.522817] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:32:08.759372] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-28T17:32:09.349045] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:32:09.559354] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-28T17:32:10.359382] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-28T17:32:11.159344] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-28T17:32:11.177747] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:32:11.183004] [INFO ] [REMOTE ] BGB: Full fetch complete (26386 records). [2025-10-28T17:32:11.183139] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-28T17:32:11.183824] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:32:11.183930] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:32:11.183986] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:32:11.184066] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-28T17:32:11.184146] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-28T17:32:11.184196] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-10-28T17:32:11.184488] [DEBUG] [LOCAL ] BGB: Deleted derivative data file. [2025-10-28T17:32:11.184628] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BGB took 28.3s. Estimated remaining: 4h 20m 18s. Rate: 8.1 symbols/min [2025-10-28T17:32:11.400612] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:11.407537] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-28T17:32:11.426171] [DEBUG] [LOCAL ] BGSF: Loaded 8297 existing records from primary storage. [2025-10-28T17:32:11.426388] [INFO ] [MAIN ] BGSF: Loaded 8297 existing records. [2025-10-28T17:32:11.628701] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:11.628919] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-28T17:32:11.628968] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-28T17:32:11.629187] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-28T17:32:11.629228] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-28T17:32:11.938864] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:32:11.964460] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-28T17:32:12.023346] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:12.759409] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-28T17:32:13.324729] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T17:32:13.364570] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:32:13.559341] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-28T17:32:14.225424] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T17:32:14.359357] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-28T17:32:15.159325] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-28T17:32:15.562840] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T17:32:15.639011] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:32:15.959324] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-28T17:32:16.721724] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T17:32:16.759322] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-28T17:32:17.539434] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:32:17.559298] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-28T17:32:18.088212] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:32:18.359341] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-28T17:32:18.637373] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T17:32:19.159334] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-28T17:32:19.814225] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:32:19.959332] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-28T17:32:20.759346] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-28T17:32:20.902305] [DEBUG] [REMOTE ] BGSF: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-28T17:32:20.902678] [WARN ] [REMOTE ] BGSF: No data returned for month 2025-03 [2025-10-28T17:32:20.902766] [FATAL] [REMOTE ] BGSF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:32:20.902850] [FATAL] [MAIN ] BGSF: Failed to fetch primary data. [2025-10-28T17:32:20.902919] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:32:20.902972] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-28T17:32:20.903059] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-28T17:32:20.903106] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-10-28T17:32:20.903618] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-10-28T17:32:20.903737] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGSF took 9.7s. Estimated remaining: 4h 20m 29s. Rate: 8.1 symbols/min [2025-10-28T17:32:21.102683] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:21.124153] [DEBUG] [LOCAL ] BGT: Loaded 15819 existing records from primary storage. [2025-10-28T17:32:21.124416] [INFO ] [MAIN ] BGT: Loaded 15819 existing records. [2025-10-28T17:32:21.300575] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:21.300851] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-28T17:32:21.300979] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-28T17:32:21.301305] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-28T17:32:21.301368] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-28T17:32:21.564490] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-28T17:32:21.659462] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:21.709330] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T17:32:22.156249] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:32:22.359341] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-28T17:32:23.159322] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-28T17:32:23.276552] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:32:23.959351] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-28T17:32:24.400133] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:32:24.759391] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-28T17:32:24.849458] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T17:32:24.852353] [INFO ] [REMOTE ] BGR: Full fetch complete (19878 records). [2025-10-28T17:32:24.852425] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-28T17:32:25.213092] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-28T17:32:25.213227] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-28T17:32:25.213579] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-28T17:32:25.213622] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-28T17:32:25.214390] [DEBUG] [LOCAL ] BGR: Trimmed 19878 records to 13033 (keeping 200 days of data) [2025-10-28T17:32:25.296558] [DEBUG] [LOCAL ] BGR: Primary data saved (13033 records). [2025-10-28T17:32:25.296772] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-28T17:32:25.296893] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGR took 27.2s. Estimated remaining: 4h 19m 58s. Rate: 8.1 symbols/min [2025-10-28T17:32:25.408932] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:32:25.479342] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:25.489817] [DEBUG] [LOCAL ] BGX: Loaded 10924 existing records from primary storage. [2025-10-28T17:32:25.490000] [INFO ] [MAIN ] BGX: Loaded 10924 existing records. [2025-10-28T17:32:25.564464] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-28T17:32:25.668905] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:25.669074] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-28T17:32:25.669124] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-28T17:32:25.669430] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-28T17:32:25.669487] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-28T17:32:26.030374] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:26.187060] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:32:26.359329] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-28T17:32:27.159361] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-28T17:32:27.758432] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:32:27.769579] [INFO ] [REMOTE ] BG: Full fetch complete (73032 records). [2025-10-28T17:32:27.769747] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-28T17:32:27.921777] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:32:27.979925] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-28T17:32:28.198443] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-28T17:32:28.198520] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-28T17:32:28.199233] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-28T17:32:28.199294] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-28T17:32:28.200685] [DEBUG] [LOCAL ] BG: Trimmed 73032 records to 50357 (keeping 200 days of data) [2025-10-28T17:32:28.500037] [DEBUG] [LOCAL ] BG: Primary data saved (50357 records). [2025-10-28T17:32:28.500166] [INFO ] [MAIN ] BG: Full history saved. [2025-10-28T17:32:28.500234] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BG took 47.2s. Estimated remaining: 4h 19m 17s. Rate: 8.1 symbols/min [2025-10-28T17:32:28.667581] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:28.686560] [DEBUG] [LOCAL ] BGY: Loaded 21175 existing records from primary storage. [2025-10-28T17:32:28.686826] [INFO ] [MAIN ] BGY: Loaded 21175 existing records. [2025-10-28T17:32:28.759921] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-28T17:32:28.877689] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:32:28.877274] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:28.878014] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-28T17:32:28.881274] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-28T17:32:28.882084] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-28T17:32:28.882153] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-28T17:32:29.224775] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:29.559350] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-28T17:32:29.922764] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:32:30.359326] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-28T17:32:30.410051] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:32:30.918028] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T17:32:31.159350] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-28T17:32:31.959345] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-28T17:32:32.351470] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:32:32.764184] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-28T17:32:32.770701] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:32:33.559346] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-28T17:32:33.990330] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:32:34.263198] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:32:34.359313] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-28T17:32:34.926994] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T17:32:35.159370] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-28T17:32:35.764326] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:32:35.959357] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-28T17:32:36.759368] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-28T17:32:37.244418] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:32:37.311680] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T17:32:37.559355] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-28T17:32:38.094360] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:32:38.359334] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-28T17:32:39.159318] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-28T17:32:39.452312] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:32:39.589859] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:32:39.959351] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-28T17:32:40.508688] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:32:40.759414] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-28T17:32:41.278793] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T17:32:41.559336] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-28T17:32:42.359351] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-28T17:32:42.555913] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T17:32:42.857731] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T17:32:43.159370] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-28T17:32:43.677373] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T17:32:43.959334] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-28T17:32:44.425274] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T17:32:44.759335] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-28T17:32:45.559310] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-28T17:32:45.756444] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:32:45.759603] [INFO ] [REMOTE ] BGT: Full fetch complete (23974 records). [2025-10-28T17:32:45.759706] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-28T17:32:46.136442] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-28T17:32:46.136542] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-28T17:32:46.137000] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-28T17:32:46.137063] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-28T17:32:46.137852] [DEBUG] [LOCAL ] BGT: Trimmed 23974 records to 15761 (keeping 200 days of data) [2025-10-28T17:32:46.232368] [DEBUG] [LOCAL ] BGT: Primary data saved (15761 records). [2025-10-28T17:32:46.232499] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-28T17:32:46.232573] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGT took 25.3s. Estimated remaining: 4h 20m 32s. Rate: 8.1 symbols/min [2025-10-28T17:32:46.364386] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-28T17:32:46.410236] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:46.410547] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-28T17:32:46.410773] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-28T17:32:46.411413] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-28T17:32:46.411488] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-28T17:32:46.411573] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-28T17:32:46.411618] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-28T17:32:46.541780] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:32:46.783492] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:47.146978] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T17:32:47.159293] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-28T17:32:47.867564] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T17:32:47.959326] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-28T17:32:48.633030] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:32:48.759324] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-28T17:32:49.550149] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T17:32:49.559295] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-28T17:32:50.206092] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:32:50.359333] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-28T17:32:51.159399] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-28T17:32:51.766519] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T17:32:51.968365] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-28T17:32:51.988422] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:32:52.759345] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-28T17:32:52.961864] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:32:52.966471] [INFO ] [REMOTE ] BGY: Full fetch complete (32918 records). [2025-10-28T17:32:52.966565] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-28T17:32:53.355046] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-28T17:32:53.355124] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-28T17:32:53.355525] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-28T17:32:53.355565] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-28T17:32:53.356293] [DEBUG] [LOCAL ] BGY: Trimmed 32918 records to 21157 (keeping 200 days of data) [2025-10-28T17:32:53.462030] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T17:32:53.488661] [DEBUG] [LOCAL ] BGY: Primary data saved (21157 records). [2025-10-28T17:32:53.488796] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-28T17:32:53.488888] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGY took 25.0s. Estimated remaining: 4h 20m 23s. Rate: 8.1 symbols/min [2025-10-28T17:32:53.564434] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-28T17:32:53.665132] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:53.704986] [DEBUG] [LOCAL ] BHC: Loaded 46452 existing records from primary storage. [2025-10-28T17:32:53.705276] [INFO ] [MAIN ] BHC: Loaded 46452 existing records. [2025-10-28T17:32:53.877391] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:53.877582] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-28T17:32:53.877630] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-28T17:32:53.878120] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-28T17:32:53.878177] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-28T17:32:54.226203] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:54.315216] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:32:54.318707] [INFO ] [REMOTE ] BGX: Full fetch complete (16463 records). [2025-10-28T17:32:54.318783] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-28T17:32:54.364405] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-28T17:32:54.687673] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-28T17:32:54.687770] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-28T17:32:54.688089] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-28T17:32:54.688131] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-28T17:32:54.688601] [DEBUG] [LOCAL ] BGX: Trimmed 16463 records to 10865 (keeping 200 days of data) [2025-10-28T17:32:54.753786] [DEBUG] [LOCAL ] BGX: Primary data saved (10865 records). [2025-10-28T17:32:54.753911] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-28T17:32:54.754029] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGX took 29.5s. Estimated remaining: 4h 19m 27s. Rate: 8.1 symbols/min [2025-10-28T17:32:54.868356] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T17:32:54.926503] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:54.926677] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-10-28T17:32:54.926731] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-10-28T17:32:54.926841] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-28T17:32:54.926882] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-28T17:32:54.926924] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-28T17:32:54.926974] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-28T17:32:55.164524] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-28T17:32:55.273887] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:55.691847] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T17:32:55.959343] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-28T17:32:56.759394] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-28T17:32:57.559314] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-28T17:32:57.673831] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:32:57.859450] [DEBUG] [REMOTE ] BHC: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T17:32:57.859582] [WARN ] [REMOTE ] BHC: No data returned for month 2025-01 [2025-10-28T17:32:57.859681] [FATAL] [REMOTE ] BHC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:32:57.859746] [FATAL] [MAIN ] BHC: Failed to fetch primary data. [2025-10-28T17:32:57.859810] [WARN ] [MAIN ] BHC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:32:57.859877] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-28T17:32:57.859940] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-10-28T17:32:57.859976] [INFO ] [LOCAL ] BHC: Starting deletion of derivative data. [2025-10-28T17:32:57.860143] [DEBUG] [LOCAL ] BHC: Deleted derivative data file. [2025-10-28T17:32:57.860212] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BHC took 4.4s. Estimated remaining: 4h 18m 45s. Rate: 8.1 symbols/min [2025-10-28T17:32:58.030832] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:58.037136] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:32:58.059913] [DEBUG] [LOCAL ] BHK: Loaded 23928 existing records from primary storage. [2025-10-28T17:32:58.060172] [INFO ] [MAIN ] BHK: Loaded 23928 existing records. [2025-10-28T17:32:58.230271] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:58.230461] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-28T17:32:58.230506] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-28T17:32:58.231523] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-28T17:32:58.231582] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-28T17:32:58.366525] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-28T17:32:58.577236] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:58.978371] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:32:59.159329] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-28T17:32:59.959330] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-28T17:33:00.401264] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:33:00.759336] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-28T17:33:00.981306] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:33:01.507296] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:33:01.559377] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-28T17:33:02.249704] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T17:33:02.359370] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-28T17:33:03.093605] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:33:03.159333] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-28T17:33:03.956629] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T17:33:03.961161] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-28T17:33:04.759384] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-28T17:33:05.559353] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-28T17:33:05.700564] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:33:05.710791] [INFO ] [REMOTE ] BGS: Full fetch complete (72293 records). [2025-10-28T17:33:05.711030] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-28T17:33:05.723977] [FATAL] [VALIDATOR ] BGS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:33:05.725938] [FATAL] [MAIN ] BGS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:33:05.726527] [WARN ] [MAIN ] BGS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:33:05.727463] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T17:33:05.727570] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-28T17:33:05.733497] [DEBUG] [LOCAL ] BGS: No primary data file found to delete. [2025-10-28T17:33:05.733892] [INFO ] [LOCAL ] BGS: Starting deletion of derivative data. [2025-10-28T17:33:05.734064] [DEBUG] [LOCAL ] BGS: Deleted derivative data file. [2025-10-28T17:33:05.734154] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BGS took 59.7s. Estimated remaining: 4h 18m 42s. Rate: 8.1 symbols/min [2025-10-28T17:33:05.905329] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:05.950494] [DEBUG] [LOCAL ] BHP: Loaded 53359 existing records from primary storage. [2025-10-28T17:33:05.950819] [INFO ] [MAIN ] BHP: Loaded 53359 existing records. [2025-10-28T17:33:06.126426] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:06.126685] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-28T17:33:06.126750] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-28T17:33:06.127726] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-28T17:33:06.127784] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-28T17:33:06.364718] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-28T17:33:06.506700] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:06.557759] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T17:33:07.159344] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-28T17:33:07.403590] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T17:33:07.959379] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-28T17:33:08.682372] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:33:08.767190] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-28T17:33:08.790269] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T17:33:09.559328] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-28T17:33:09.767545] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:33:10.359342] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-28T17:33:11.117532] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T17:33:11.159297] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-28T17:33:11.463040] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T17:33:11.959336] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-28T17:33:12.617536] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:33:12.759343] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-28T17:33:12.965473] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:33:13.516874] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:33:13.559333] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-28T17:33:14.359355] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-28T17:33:14.532338] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T17:33:15.023099] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T17:33:15.159362] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-28T17:33:15.962431] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-28T17:33:15.965279] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:33:15.968746] [INFO ] [REMOTE ] BH: Full fetch complete (19622 records). [2025-10-28T17:33:15.968821] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-28T17:33:16.326827] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-28T17:33:16.326905] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-28T17:33:16.327282] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-28T17:33:16.327341] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-28T17:33:16.327945] [DEBUG] [LOCAL ] BH: Trimmed 19622 records to 16681 (keeping 200 days of data) [2025-10-28T17:33:16.423135] [DEBUG] [LOCAL ] BH: Primary data saved (16681 records). [2025-10-28T17:33:16.423261] [INFO ] [MAIN ] BH: Full history saved. [2025-10-28T17:33:16.423329] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BH took 30.2s. Estimated remaining: 4h 18m 60s. Rate: 8.1 symbols/min [2025-10-28T17:33:16.593224] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:16.612596] [DEBUG] [LOCAL ] BHR: Loaded 21977 existing records from primary storage. [2025-10-28T17:33:16.612863] [INFO ] [MAIN ] BHR: Loaded 21977 existing records. [2025-10-28T17:33:16.765483] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-28T17:33:16.800182] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:16.800608] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-28T17:33:16.800814] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-28T17:33:16.801409] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-28T17:33:16.801471] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-28T17:33:16.946271] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T17:33:17.216851] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:17.559350] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-28T17:33:17.660331] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:33:18.359353] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-28T17:33:19.162268] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-28T17:33:19.165549] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T17:33:19.446099] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:33:19.959351] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-28T17:33:20.087330] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T17:33:20.759345] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-28T17:33:21.427421] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T17:33:21.559331] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-28T17:33:21.578964] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:33:22.359357] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-28T17:33:22.999767] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T17:33:23.159313] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-28T17:33:23.235951] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T17:33:23.846951] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T17:33:23.959340] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-28T17:33:24.622411] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T17:33:24.759377] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-28T17:33:25.559350] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-28T17:33:25.724447] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:33:26.359316] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-28T17:33:27.148485] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:33:27.166956] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-28T17:33:27.188972] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:33:27.939825] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:33:27.959307] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-28T17:33:28.598441] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:33:28.759331] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-28T17:33:29.520771] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:33:29.559327] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-28T17:33:30.208447] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:33:30.359352] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-28T17:33:31.166101] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-28T17:33:31.168000] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T17:33:31.959377] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-28T17:33:32.269282] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:33:32.759417] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-28T17:33:33.448768] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T17:33:33.559349] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-28T17:33:33.780759] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:33:33.786317] [INFO ] [REMOTE ] BHR: Full fetch complete (30924 records). [2025-10-28T17:33:33.786433] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-28T17:33:33.786995] [FATAL] [VALIDATOR ] BHR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:33:33.787097] [FATAL] [MAIN ] BHR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:33:33.787185] [WARN ] [MAIN ] BHR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:33:33.787240] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-28T17:33:33.787297] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-28T17:33:33.787331] [INFO ] [LOCAL ] BHR: Starting deletion of derivative data. [2025-10-28T17:33:33.787479] [DEBUG] [LOCAL ] BHR: Deleted derivative data file. [2025-10-28T17:33:33.787549] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHR took 17.4s. Estimated remaining: 4h 20m 10s. Rate: 8.1 symbols/min [2025-10-28T17:33:33.960019] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:33.960193] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-28T17:33:33.960247] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-28T17:33:33.960361] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-28T17:33:33.960426] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-28T17:33:33.960488] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-28T17:33:33.960533] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-28T17:33:34.324269] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:34.336340] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:33:34.340722] [INFO ] [REMOTE ] BHE: Full fetch complete (36248 records). [2025-10-28T17:33:34.340798] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-28T17:33:34.369449] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-28T17:33:34.705057] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-28T17:33:34.705140] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-28T17:33:34.705585] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-28T17:33:34.705626] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-28T17:33:34.706540] [DEBUG] [LOCAL ] BHE: Trimmed 36248 records to 23133 (keeping 200 days of data) [2025-10-28T17:33:34.839466] [DEBUG] [LOCAL ] BHE: Primary data saved (23133 records). [2025-10-28T17:33:34.839580] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-28T17:33:34.839667] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHE took 40.1s. Estimated remaining: 4h 19m 13s. Rate: 8.1 symbols/min [2025-10-28T17:33:35.006892] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:35.051499] [DEBUG] [LOCAL ] BHVN: Loaded 50598 existing records from primary storage. [2025-10-28T17:33:35.051827] [INFO ] [MAIN ] BHVN: Loaded 50598 existing records. [2025-10-28T17:33:35.164525] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-28T17:33:35.233614] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:35.233829] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-28T17:33:35.233876] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-28T17:33:35.234759] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-28T17:33:35.234816] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-28T17:33:35.591203] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:35.900171] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T17:33:35.959301] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-28T17:33:36.267432] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:33:36.759331] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-28T17:33:36.992601] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T17:33:37.162119] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:33:37.559337] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-28T17:33:38.359320] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-28T17:33:38.476976] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T17:33:38.481824] [INFO ] [REMOTE ] BHK: Full fetch complete (30832 records). [2025-10-28T17:33:38.481923] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-28T17:33:38.890365] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-28T17:33:38.890441] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-28T17:33:38.890922] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-28T17:33:38.890982] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-28T17:33:38.891738] [DEBUG] [LOCAL ] BHK: Trimmed 30832 records to 24002 (keeping 200 days of data) [2025-10-28T17:33:39.027755] [DEBUG] [LOCAL ] BHK: Primary data saved (24002 records). [2025-10-28T17:33:39.027878] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-28T17:33:39.027951] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHK took 41.2s. Estimated remaining: 4h 18m 40s. Rate: 8.1 symbols/min [2025-10-28T17:33:39.164796] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-28T17:33:39.196527] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:39.244400] [DEBUG] [LOCAL ] BILL: Loaded 52486 existing records from primary storage. [2025-10-28T17:33:39.244753] [INFO ] [MAIN ] BILL: Loaded 52486 existing records. [2025-10-28T17:33:39.423712] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:39.423967] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-28T17:33:39.424020] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-28T17:33:39.424411] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-28T17:33:39.424469] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-28T17:33:39.495606] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T17:33:39.774154] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:39.959307] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-28T17:33:40.186865] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T17:33:40.197526] [INFO ] [REMOTE ] BHP: Full fetch complete (77441 records). [2025-10-28T17:33:40.197680] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-28T17:33:40.594531] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-28T17:33:40.594660] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-28T17:33:40.595505] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-28T17:33:40.595623] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-28T17:33:40.597127] [DEBUG] [LOCAL ] BHP: Trimmed 77441 records to 53359 (keeping 200 days of data) [2025-10-28T17:33:40.769902] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-28T17:33:40.917659] [DEBUG] [LOCAL ] BHP: Primary data saved (53359 records). [2025-10-28T17:33:40.917802] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-28T17:33:40.917879] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHP took 35.2s. Estimated remaining: 4h 17m 51s. Rate: 8.1 symbols/min [2025-10-28T17:33:41.085354] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:41.107574] [DEBUG] [LOCAL ] BIO: Loaded 23423 existing records from primary storage. [2025-10-28T17:33:41.107825] [INFO ] [MAIN ] BIO: Loaded 23423 existing records. [2025-10-28T17:33:41.288328] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:41.290929] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T17:33:41.291131] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-28T17:33:41.292398] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-28T17:33:41.292597] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-28T17:33:41.292678] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-28T17:33:41.564494] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-28T17:33:41.663008] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:41.689818] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:33:42.359335] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-28T17:33:42.758565] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:33:43.159384] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-28T17:33:43.959390] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-28T17:33:44.060981] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T17:33:44.079032] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:33:44.222064] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T17:33:44.759341] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-28T17:33:45.559352] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-28T17:33:45.873358] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:33:45.910815] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T17:33:46.359338] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-28T17:33:47.159345] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-28T17:33:47.514709] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T17:33:47.758218] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:33:47.959360] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-28T17:33:48.759347] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-28T17:33:49.015214] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-28T17:33:49.402897] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:33:49.559341] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-28T17:33:50.359334] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-28T17:33:50.636470] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T17:33:50.803882] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:33:51.159359] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-28T17:33:51.959383] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-28T17:33:52.308540] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T17:33:52.309380] [INFO ] [REMOTE ] BHV: Full fetch complete (1428 records). [2025-10-28T17:33:52.309446] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-28T17:33:52.490940] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-28T17:33:52.491143] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:33:52.491229] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:33:52.491320] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-28T17:33:52.491402] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-28T17:33:52.491441] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-28T17:33:52.491482] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-28T17:33:52.491537] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHV took 18.7s. Estimated remaining: 4h 18m 15s. Rate: 8.1 symbols/min [2025-10-28T17:33:52.666242] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:52.700841] [DEBUG] [LOCAL ] BIP: Loaded 38519 existing records from primary storage. [2025-10-28T17:33:52.701220] [INFO ] [MAIN ] BIP: Loaded 38519 existing records. [2025-10-28T17:33:52.764574] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-28T17:33:52.844068] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:33:52.926073] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:52.926293] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-28T17:33:52.926352] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-28T17:33:52.926775] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-28T17:33:52.926834] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-28T17:33:53.274468] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:53.559354] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-28T17:33:54.359363] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-28T17:33:54.440256] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-28T17:33:54.635962] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:33:55.159343] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-28T17:33:55.295233] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T17:33:55.959332] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-28T17:33:56.238615] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T17:33:56.759356] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-28T17:33:56.839506] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:33:57.559321] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-28T17:33:57.993580] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:33:58.325061] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:33:58.359300] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-28T17:33:59.159302] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-28T17:33:59.364055] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:33:59.959333] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-28T17:34:00.549238] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:34:00.759327] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-28T17:34:00.954891] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T17:34:01.559349] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-28T17:34:02.090888] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:34:02.359411] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-28T17:34:02.697385] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:34:03.159349] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-28T17:34:03.780429] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T17:34:03.959306] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-28T17:34:04.407920] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T17:34:04.759383] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-28T17:34:05.281126] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T17:34:05.559356] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-28T17:34:05.804179] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:34:06.359329] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-28T17:34:06.814683] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T17:34:07.159342] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-28T17:34:07.753081] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:34:07.957556] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T17:34:07.967417] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-28T17:34:07.969869] [INFO ] [REMOTE ] BILL: Full fetch complete (76120 records). [2025-10-28T17:34:07.969968] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-28T17:34:08.361702] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-28T17:34:08.361778] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-28T17:34:08.362519] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-28T17:34:08.362580] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-28T17:34:08.363970] [DEBUG] [LOCAL ] BILL: Trimmed 76120 records to 52480 (keeping 200 days of data) [2025-10-28T17:34:08.657785] [DEBUG] [LOCAL ] BILL: Primary data saved (52480 records). [2025-10-28T17:34:08.657910] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-28T17:34:08.657985] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BILL took 29.6s. Estimated remaining: 4h 19m 14s. Rate: 8.1 symbols/min [2025-10-28T17:34:08.764443] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-28T17:34:08.829330] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:08.851091] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:34:08.893476] [DEBUG] [LOCAL ] BIPC: Loaded 40781 existing records from primary storage. [2025-10-28T17:34:08.893776] [INFO ] [MAIN ] BIPC: Loaded 40781 existing records. [2025-10-28T17:34:09.080137] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:09.080376] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-28T17:34:09.080429] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-28T17:34:09.080888] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-28T17:34:09.080965] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-28T17:34:09.488539] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:09.559327] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-28T17:34:10.316838] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:34:10.359300] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-28T17:34:10.513024] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T17:34:11.159364] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-28T17:34:11.609397] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:34:11.959438] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-28T17:34:12.316688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:34:12.759481] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-28T17:34:13.065685] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:34:13.559380] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-28T17:34:13.831450] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:34:14.359368] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-28T17:34:14.498035] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T17:34:14.502001] [INFO ] [REMOTE ] BIO: Full fetch complete (34526 records). [2025-10-28T17:34:14.502098] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-28T17:34:14.502626] [FATAL] [VALIDATOR ] BIO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:34:14.502741] [FATAL] [MAIN ] BIO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:34:14.502783] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:34:14.502821] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-28T17:34:14.502876] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-28T17:34:14.502911] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-28T17:34:14.503089] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-28T17:34:14.503178] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BIO took 33.6s. Estimated remaining: 4h 18m 55s. Rate: 8.1 symbols/min [2025-10-28T17:34:14.678196] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:14.682747] [DEBUG] [LOCAL ] BIPH: Loaded 2251 existing records from primary storage. [2025-10-28T17:34:14.682903] [INFO ] [MAIN ] BIPH: Loaded 2251 existing records. [2025-10-28T17:34:14.858179] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:14.858393] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-28T17:34:14.858438] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-28T17:34:14.858559] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-28T17:34:14.858602] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-28T17:34:15.164553] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-28T17:34:15.224223] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:15.560490] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:34:15.959337] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-28T17:34:16.759331] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-28T17:34:16.846234] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T17:34:16.858415] [INFO ] [REMOTE ] BIP: Full fetch complete (57712 records). [2025-10-28T17:34:16.858585] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-28T17:34:17.251737] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-28T17:34:17.251918] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-28T17:34:17.252595] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-28T17:34:17.252695] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-28T17:34:17.253901] [DEBUG] [LOCAL ] BIP: Trimmed 57712 records to 38427 (keeping 200 days of data) [2025-10-28T17:34:17.484583] [DEBUG] [LOCAL ] BIP: Primary data saved (38427 records). [2025-10-28T17:34:17.484778] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-28T17:34:17.484888] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BIP took 25.0s. Estimated remaining: 4h 18m 14s. Rate: 8.1 symbols/min [2025-10-28T17:34:17.559332] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-28T17:34:17.622924] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T17:34:17.660605] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:34:18.359403] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-28T17:34:18.725095] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T17:34:19.159375] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-28T17:34:19.826993] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T17:34:19.959362] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-28T17:34:20.412843] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T17:34:20.462017] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T17:34:20.759371] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-28T17:34:21.206851] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T17:34:21.559350] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-28T17:34:22.359387] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-28T17:34:22.798709] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T17:34:23.159357] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-28T17:34:23.244480] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T17:34:23.254830] [INFO ] [REMOTE ] BHVN: Full fetch complete (70838 records). [2025-10-28T17:34:23.254995] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-28T17:34:23.638727] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-28T17:34:23.638816] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-28T17:34:23.639516] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-28T17:34:23.639558] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-28T17:34:23.640958] [DEBUG] [LOCAL ] BHVN: Trimmed 70838 records to 50589 (keeping 200 days of data) [2025-10-28T17:34:23.930392] [DEBUG] [LOCAL ] BHVN: Primary data saved (50589 records). [2025-10-28T17:34:23.930550] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-28T17:34:23.931140] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BHVN took 49.1s. Estimated remaining: 4h 17m 59s. Rate: 8.1 symbols/min [2025-10-28T17:34:23.959423] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-28T17:34:24.261504] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:34:24.265095] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:34:24.759314] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-28T17:34:25.559390] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-28T17:34:25.826559] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:34:25.930458] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T17:34:26.359405] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-28T17:34:27.159393] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-28T17:34:27.465957] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:34:27.713183] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T17:34:27.959338] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-28T17:34:28.759454] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-28T17:34:29.056565] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T17:34:29.241577] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:34:29.559348] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-28T17:34:30.359409] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-28T17:34:30.503326] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:34:30.606385] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T17:34:31.159341] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-28T17:34:31.959388] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-28T17:34:32.352039] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T17:34:32.353627] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:34:32.365711] [INFO ] [REMOTE ] BIPH: Full fetch complete (3601 records). [2025-10-28T17:34:32.366356] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-28T17:34:32.432185] [INFO ] [REMOTE ] BIPC: Full fetch complete (59882 records). [2025-10-28T17:34:32.443680] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-28T17:34:32.481542] [FATAL] [VALIDATOR ] BIPC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:34:32.520262] [FATAL] [MAIN ] BIPC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:34:32.546792] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:34:32.632400] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-28T17:34:32.653580] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-28T17:34:32.654003] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-10-28T17:34:32.669903] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-10-28T17:34:32.680389] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIPC took 24.0s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-10-28T17:34:32.732410] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-28T17:34:32.732484] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-28T17:34:32.732661] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-28T17:34:32.732723] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-28T17:34:32.733133] [DEBUG] [LOCAL ] BIPH: Trimmed 3601 records to 2221 (keeping 200 days of data) [2025-10-28T17:34:32.746479] [DEBUG] [LOCAL ] BIPH: Primary data saved (2221 records). [2025-10-28T17:34:32.746539] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-28T17:34:32.746605] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPH took 18.2s. Estimated remaining: 4h 16m 60s. Rate: 8.1 symbols/min [2025-10-28T17:34:33.308259] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.439519] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.445783] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.466149] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.445922] [DEBUG] [LOCAL ] BIPJ: No existing data file found in primary storage. [2025-10-28T17:34:33.466731] [WARN ] [MAIN ] BIPJ: No existing data found, performing full refresh instead. [2025-10-28T17:34:33.468599] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-28T17:34:33.469112] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-28T17:34:33.469187] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-28T17:34:33.469224] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-28T17:34:33.543721] [DEBUG] [LOCAL ] BIPI: Loaded 2727 existing records from primary storage. [2025-10-28T17:34:33.563497] [INFO ] [MAIN ] BIPI: Loaded 2727 existing records. [2025-10-28T17:34:33.704300] [DEBUG] [LOCAL ] BIT: Loaded 23558 existing records from primary storage. [2025-10-28T17:34:33.849157] [DEBUG] [LOCAL ] BIRK: Loaded 51082 existing records from primary storage. [2025-10-28T17:34:33.937858] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:33.960236] [INFO ] [MAIN ] BIRK: Loaded 51082 existing records. [2025-10-28T17:34:33.841830] [INFO ] [MAIN ] BIT: Loaded 23558 existing records. [2025-10-28T17:34:33.965623] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-28T17:34:34.002797] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-28T17:34:34.026433] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-28T17:34:34.080721] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-28T17:34:34.442836] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:34.445998] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:34.482536] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-28T17:34:34.511639] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-28T17:34:34.543487] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-28T17:34:34.613493] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-28T17:34:34.586272] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:34.613938] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-28T17:34:34.619403] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-28T17:34:34.635148] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-28T17:34:34.668961] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-28T17:34:34.683549] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-28T17:34:35.032449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T17:34:35.128397] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-28T17:34:35.121697] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:35.160564] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-28T17:34:35.570913] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:35.565509] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:35.571396] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-28T17:34:35.575728] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T17:34:35.711901] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:34:35.959366] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-28T17:34:36.380750] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T17:34:36.407945] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:34:36.759342] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-28T17:34:37.437520] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:34:37.559372] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-28T17:34:37.992944] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:34:38.359346] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-28T17:34:39.159335] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-28T17:34:39.517994] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:34:39.771756] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:34:39.959340] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-28T17:34:40.759347] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-28T17:34:41.264917] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:34:41.559320] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-28T17:34:41.572546] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:34:42.359367] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-28T17:34:42.638830] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:34:42.997851] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T17:34:43.159326] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-28T17:34:43.959351] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-28T17:34:44.326119] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T17:34:44.362715] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T17:34:44.759325] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-28T17:34:45.295746] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:34:45.559347] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-28T17:34:46.009715] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T17:34:46.359352] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-28T17:34:47.159323] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-28T17:34:47.207461] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T17:34:47.959350] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-28T17:34:48.339927] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:34:48.405055] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T17:34:48.759344] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-28T17:34:49.521914] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:34:49.559308] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-28T17:34:49.801678] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T17:34:50.359335] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-28T17:34:50.731313] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:34:51.159353] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-28T17:34:51.463421] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T17:34:51.959384] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-28T17:34:52.759355] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-28T17:34:53.110959] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:34:53.559335] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-28T17:34:53.897322] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:34:54.359391] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-28T17:34:54.719730] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T17:34:54.722633] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:34:55.159377] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-28T17:34:55.959348] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-28T17:34:56.389718] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T17:34:56.512878] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:34:56.759346] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-28T17:34:57.096880] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:34:57.559340] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-28T17:34:58.020943] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T17:34:58.022017] [INFO ] [REMOTE ] BIPI: Full fetch complete (4495 records). [2025-10-28T17:34:58.022088] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-28T17:34:58.367559] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-28T17:34:58.391114] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-28T17:34:58.391185] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-28T17:34:58.391322] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-28T17:34:58.391359] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-28T17:34:58.391794] [DEBUG] [LOCAL ] BIPI: Trimmed 4495 records to 2702 (keeping 200 days of data) [2025-10-28T17:34:58.407841] [DEBUG] [LOCAL ] BIPI: Primary data saved (2702 records). [2025-10-28T17:34:58.407937] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-28T17:34:58.408013] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPI took 25.7s. Estimated remaining: 4h 19m 8s. Rate: 8.0 symbols/min [2025-10-28T17:34:58.576945] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:58.623208] [DEBUG] [LOCAL ] BJ: Loaded 51411 existing records from primary storage. [2025-10-28T17:34:58.623522] [INFO ] [MAIN ] BJ: Loaded 51411 existing records. [2025-10-28T17:34:58.800741] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:58.800972] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-28T17:34:58.801020] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-28T17:34:58.801934] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-28T17:34:58.801990] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-28T17:34:59.152085] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:59.159304] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-28T17:34:59.427820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:34:59.959383] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-28T17:35:00.444700] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T17:35:00.759404] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-28T17:35:01.361723] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:35:01.559426] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-28T17:35:01.812438] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:35:01.820490] [INFO ] [REMOTE ] BIT: Full fetch complete (32259 records). [2025-10-28T17:35:01.820851] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-28T17:35:01.821706] [FATAL] [VALIDATOR ] BIT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:35:01.821803] [FATAL] [MAIN ] BIT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:35:01.821861] [WARN ] [MAIN ] BIT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:35:01.821915] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-28T17:35:01.821995] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-10-28T17:35:01.822043] [INFO ] [LOCAL ] BIT: Starting deletion of derivative data. [2025-10-28T17:35:01.822257] [DEBUG] [LOCAL ] BIT: Deleted derivative data file. [2025-10-28T17:35:01.822365] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIT took 29.1s. Estimated remaining: 4h 18m 30s. Rate: 8.1 symbols/min [2025-10-28T17:35:02.016555] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:02.072963] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T17:35:02.074178] [DEBUG] [LOCAL ] BK: Loaded 53535 existing records from primary storage. [2025-10-28T17:35:02.076454] [INFO ] [MAIN ] BK: Loaded 53535 existing records. [2025-10-28T17:35:02.275974] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:02.276187] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-28T17:35:02.276232] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-28T17:35:02.276813] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-28T17:35:02.276871] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-28T17:35:02.364571] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-28T17:35:02.646213] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:02.864206] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T17:35:03.159366] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-28T17:35:03.959353] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-28T17:35:04.405941] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:35:04.759400] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-28T17:35:05.559318] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-28T17:35:05.617207] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:35:05.627562] [INFO ] [REMOTE ] BIRK: Full fetch complete (73468 records). [2025-10-28T17:35:05.627732] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-28T17:35:06.035224] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-28T17:35:06.035334] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-28T17:35:06.036135] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-28T17:35:06.036215] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-28T17:35:06.037711] [DEBUG] [LOCAL ] BIRK: Trimmed 73468 records to 51067 (keeping 200 days of data) [2025-10-28T17:35:06.273403] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:35:06.361034] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-28T17:35:06.376610] [DEBUG] [LOCAL ] BIRK: Primary data saved (51067 records). [2025-10-28T17:35:06.376716] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-28T17:35:06.376799] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIRK took 33.6s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-10-28T17:35:06.541544] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:06.581850] [DEBUG] [LOCAL ] BKD: Loaded 50297 existing records from primary storage. [2025-10-28T17:35:06.582141] [INFO ] [MAIN ] BKD: Loaded 50297 existing records. [2025-10-28T17:35:06.758043] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:06.758214] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-28T17:35:06.758261] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-28T17:35:06.758979] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-28T17:35:06.759036] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-28T17:35:07.116124] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:07.162975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-28T17:35:07.165316] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T17:35:07.923271] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T17:35:07.959305] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-28T17:35:08.630886] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:35:08.759353] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-28T17:35:09.460938] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:35:09.559319] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-28T17:35:10.026635] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T17:35:10.359342] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-28T17:35:10.789864] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T17:35:10.968820] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T17:35:11.159361] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-28T17:35:11.959331] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-28T17:35:12.710887] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:35:12.759295] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-28T17:35:13.395451] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:35:13.559416] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-28T17:35:14.351513] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T17:35:14.362204] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-28T17:35:14.555233] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T17:35:15.159363] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-28T17:35:15.839956] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T17:35:15.959368] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-28T17:35:16.281404] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:35:16.759340] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-28T17:35:17.062403] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T17:35:17.559348] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-28T17:35:18.062035] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:35:18.359383] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-28T17:35:18.727853] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:35:19.159350] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-28T17:35:19.921245] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T17:35:19.959294] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-28T17:35:20.429921] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:35:20.759393] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-28T17:35:21.280935] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:35:21.559336] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-28T17:35:22.010126] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:35:22.150528] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:35:22.151526] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4113 records). [2025-10-28T17:35:22.151595] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-28T17:35:22.366431] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-28T17:35:22.539080] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-28T17:35:22.539152] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-28T17:35:22.539293] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-28T17:35:22.539338] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-28T17:35:22.539722] [DEBUG] [LOCAL ] BIPJ: Trimmed 4113 records to 3000 (keeping 200 days of data) [2025-10-28T17:35:22.558249] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3000 records). [2025-10-28T17:35:22.558320] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-28T17:35:22.558388] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIPJ took 49.8s. Estimated remaining: 4h 18m 58s. Rate: 8.0 symbols/min [2025-10-28T17:35:22.728961] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:22.759495] [DEBUG] [LOCAL ] BKE: Loaded 33221 existing records from primary storage. [2025-10-28T17:35:22.759781] [INFO ] [MAIN ] BKE: Loaded 33221 existing records. [2025-10-28T17:35:22.937539] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:22.937778] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-28T17:35:22.937826] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-28T17:35:22.938384] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-28T17:35:22.938439] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-28T17:35:23.164419] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-28T17:35:23.309579] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:23.669905] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T17:35:23.959334] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-28T17:35:24.693421] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T17:35:24.759334] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-28T17:35:24.934696] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:35:25.559393] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-28T17:35:26.163379] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:35:26.173807] [INFO ] [REMOTE ] BJ: Full fetch complete (74374 records). [2025-10-28T17:35:26.173939] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-28T17:35:26.366561] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-28T17:35:26.561235] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-28T17:35:26.561311] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-28T17:35:26.562081] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-28T17:35:26.562142] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-28T17:35:26.563542] [DEBUG] [LOCAL ] BJ: Trimmed 74374 records to 51394 (keeping 200 days of data) [2025-10-28T17:35:26.863983] [DEBUG] [LOCAL ] BJ: Primary data saved (51394 records). [2025-10-28T17:35:26.864194] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-28T17:35:26.864285] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 28.5s. Estimated remaining: 4h 18m 28s. Rate: 8.1 symbols/min [2025-10-28T17:35:27.005694] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:35:27.081254] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:27.081899] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-28T17:35:27.081944] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-28T17:35:27.082052] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-28T17:35:27.082093] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-28T17:35:27.082133] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-28T17:35:27.082166] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-28T17:35:27.169615] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-28T17:35:27.428100] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:27.844797] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:35:27.855623] [INFO ] [REMOTE ] BK: Full fetch complete (77668 records). [2025-10-28T17:35:27.855819] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-28T17:35:27.964452] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-28T17:35:28.264324] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-28T17:35:28.264472] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-28T17:35:28.266002] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-28T17:35:28.266117] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-28T17:35:28.277015] [DEBUG] [LOCAL ] BK: Trimmed 77668 records to 53534 (keeping 200 days of data) [2025-10-28T17:35:28.293626] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T17:35:28.761208] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-28T17:35:28.798010] [DEBUG] [LOCAL ] BK: Primary data saved (53534 records). [2025-10-28T17:35:28.798205] [INFO ] [MAIN ] BK: Full history saved. [2025-10-28T17:35:28.798330] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 27.0s. Estimated remaining: 4h 17m 40s. Rate: 8.1 symbols/min [2025-10-28T17:35:29.058573] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:29.110471] [DEBUG] [LOCAL ] BKKT: Loaded 37775 existing records from primary storage. [2025-10-28T17:35:29.110970] [INFO ] [MAIN ] BKKT: Loaded 37775 existing records. [2025-10-28T17:35:29.339823] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:29.340140] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-28T17:35:29.340238] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-28T17:35:29.340639] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-28T17:35:29.340795] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-28T17:35:29.537031] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T17:35:29.561348] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-28T17:35:29.752925] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:29.899154] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:35:30.359349] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-28T17:35:30.808891] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:35:31.159356] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-28T17:35:31.354398] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:35:31.959401] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-28T17:35:32.410208] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:35:32.759353] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-28T17:35:33.171911] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:35:33.559371] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-28T17:35:33.686926] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T17:35:34.359348] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-28T17:35:34.638459] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:35:35.159345] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-28T17:35:35.883257] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:35:35.893330] [INFO ] [REMOTE ] BKD: Full fetch complete (72132 records). [2025-10-28T17:35:35.893463] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-28T17:35:35.964727] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-28T17:35:36.290310] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-28T17:35:36.290477] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-28T17:35:36.291354] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-28T17:35:36.291538] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-28T17:35:36.293000] [DEBUG] [LOCAL ] BKD: Trimmed 72132 records to 50272 (keeping 200 days of data) [2025-10-28T17:35:36.586905] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:35:36.603374] [DEBUG] [LOCAL ] BKD: Primary data saved (50272 records). [2025-10-28T17:35:36.603468] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-28T17:35:36.603544] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKD took 30.2s. Estimated remaining: 4h 17m 36s. Rate: 8.1 symbols/min [2025-10-28T17:35:36.770897] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-28T17:35:36.774708] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:36.783896] [DEBUG] [LOCAL ] BKN: Loaded 7164 existing records from primary storage. [2025-10-28T17:35:36.784110] [INFO ] [MAIN ] BKN: Loaded 7164 existing records. [2025-10-28T17:35:36.971797] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:36.972159] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-28T17:35:36.972231] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-28T17:35:36.972754] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-28T17:35:36.972811] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-28T17:35:37.155975] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:35:37.360538] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:37.559329] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-28T17:35:37.847321] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:35:38.185480] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T17:35:38.359404] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-28T17:35:39.159320] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-28T17:35:39.533841] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:35:39.959371] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-28T17:35:40.176994] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:35:40.759932] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-28T17:35:40.759857] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T17:35:41.559346] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-28T17:35:41.828007] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:35:41.962244] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T17:35:42.359360] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-28T17:35:43.159439] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-28T17:35:43.395928] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T17:35:43.959355] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-28T17:35:44.388629] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:35:44.759421] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-28T17:35:44.902759] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:35:45.559369] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-28T17:35:45.797920] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:35:46.359359] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-28T17:35:46.614084] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T17:35:47.159333] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-28T17:35:47.526158] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T17:35:47.533304] [INFO ] [REMOTE ] BKE: Full fetch complete (49917 records). [2025-10-28T17:35:47.533456] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-28T17:35:47.849253] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T17:35:47.928629] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-28T17:35:47.928751] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-28T17:35:47.929303] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-28T17:35:47.929342] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-28T17:35:47.930308] [DEBUG] [LOCAL ] BKE: Trimmed 49917 records to 33084 (keeping 200 days of data) [2025-10-28T17:35:47.981893] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-28T17:35:48.126737] [DEBUG] [LOCAL ] BKE: Primary data saved (33084 records). [2025-10-28T17:35:48.126865] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-28T17:35:48.127434] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKE took 25.6s. Estimated remaining: 4h 17m 58s. Rate: 8.1 symbols/min [2025-10-28T17:35:48.293441] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:48.338824] [DEBUG] [LOCAL ] BKSY: Loaded 48907 existing records from primary storage. [2025-10-28T17:35:48.339173] [INFO ] [MAIN ] BKSY: Loaded 48907 existing records. [2025-10-28T17:35:48.515960] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:48.516205] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-28T17:35:48.516251] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-28T17:35:48.516757] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-28T17:35:48.516815] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-28T17:35:48.762219] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-28T17:35:48.868735] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:49.113376] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:35:49.483537] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:35:49.559308] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-28T17:35:50.359335] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-28T17:35:51.053990] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T17:35:51.159352] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-28T17:35:51.727021] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:35:51.959334] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-28T17:35:52.571709] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:35:52.759498] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-28T17:35:52.761582] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T17:35:53.232947] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T17:35:53.559338] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-28T17:35:54.359355] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-28T17:35:54.779721] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:35:55.159340] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-28T17:35:55.709704] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:35:55.854238] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:35:55.959314] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-28T17:35:56.759379] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-28T17:35:57.034350] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:35:57.559338] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-28T17:35:58.120637] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:35:58.359343] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-28T17:35:58.629129] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T17:35:58.637278] [INFO ] [REMOTE ] BKH: Full fetch complete (53344 records). [2025-10-28T17:35:58.637417] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-28T17:35:58.869842] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T17:35:59.032674] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-28T17:35:59.032763] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-28T17:35:59.033359] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-28T17:35:59.033419] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-28T17:35:59.034546] [DEBUG] [LOCAL ] BKH: Trimmed 53344 records to 37298 (keeping 200 days of data) [2025-10-28T17:35:59.194836] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-28T17:35:59.255106] [DEBUG] [LOCAL ] BKH: Primary data saved (37298 records). [2025-10-28T17:35:59.255218] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-28T17:35:59.255286] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKH took 32.4s. Estimated remaining: 4h 18m 17s. Rate: 8.0 symbols/min [2025-10-28T17:35:59.424834] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:59.438985] [DEBUG] [LOCAL ] BKT: Loaded 12719 existing records from primary storage. [2025-10-28T17:35:59.439215] [INFO ] [MAIN ] BKT: Loaded 12719 existing records. [2025-10-28T17:35:59.619215] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:59.619408] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-28T17:35:59.619455] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-28T17:35:59.619632] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-28T17:35:59.619723] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-28T17:35:59.974759] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-28T17:35:59.980187] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:00.759329] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-28T17:36:00.878873] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:36:01.410240] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:36:01.483938] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:36:01.559337] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-28T17:36:02.359358] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-28T17:36:02.890701] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:36:03.159334] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-28T17:36:03.721991] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T17:36:03.721781] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-28T17:36:03.734942] [INFO ] [REMOTE ] BKKT: Full fetch complete (52569 records). [2025-10-28T17:36:03.735058] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-28T17:36:03.964592] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-28T17:36:04.114276] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-28T17:36:04.114357] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-28T17:36:04.114971] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-28T17:36:04.115031] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-28T17:36:04.116172] [DEBUG] [LOCAL ] BKKT: Trimmed 52569 records to 37975 (keeping 200 days of data) [2025-10-28T17:36:04.329793] [DEBUG] [LOCAL ] BKKT: Primary data saved (37975 records). [2025-10-28T17:36:04.329920] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-28T17:36:04.329994] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKKT took 35.5s. Estimated remaining: 4h 17m 52s. Rate: 8.1 symbols/min [2025-10-28T17:36:04.501067] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:04.538730] [DEBUG] [LOCAL ] BKU: Loaded 42038 existing records from primary storage. [2025-10-28T17:36:04.539056] [INFO ] [MAIN ] BKU: Loaded 42038 existing records. [2025-10-28T17:36:04.651601] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T17:36:04.733848] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:04.734054] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-28T17:36:04.734100] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-28T17:36:04.734519] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-28T17:36:04.734562] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-28T17:36:04.764415] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-28T17:36:05.091214] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:05.434922] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:36:05.436795] [INFO ] [REMOTE ] BKN: Full fetch complete (11160 records). [2025-10-28T17:36:05.436865] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-28T17:36:05.574845] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-28T17:36:05.799030] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-28T17:36:05.799101] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-28T17:36:05.799345] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-28T17:36:05.799391] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-28T17:36:05.799840] [DEBUG] [LOCAL ] BKN: Trimmed 11160 records to 7211 (keeping 200 days of data) [2025-10-28T17:36:05.842102] [DEBUG] [LOCAL ] BKN: Primary data saved (7211 records). [2025-10-28T17:36:05.842200] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-28T17:36:05.842272] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKN took 29.2s. Estimated remaining: 4h 17m 2s. Rate: 8.1 symbols/min [2025-10-28T17:36:06.011463] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:06.037126] [DEBUG] [LOCAL ] BKV: Loaded 29033 existing records from primary storage. [2025-10-28T17:36:06.037408] [INFO ] [MAIN ] BKV: Loaded 29033 existing records. [2025-10-28T17:36:06.211724] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:06.211936] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-28T17:36:06.211988] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-28T17:36:06.212459] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-28T17:36:06.212528] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-28T17:36:06.367841] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-28T17:36:06.564878] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:06.831953] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T17:36:07.159326] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-28T17:36:07.684022] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:36:07.881636] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:36:07.959334] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-28T17:36:08.759306] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-28T17:36:08.803625] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:36:09.303588] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:36:09.559328] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-28T17:36:10.009417] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:36:10.359333] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-28T17:36:10.812813] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T17:36:11.159337] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-28T17:36:11.776671] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T17:36:11.959364] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-28T17:36:12.759377] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-28T17:36:13.122821] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T17:36:13.559347] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-28T17:36:13.894732] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:36:14.163054] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:36:14.359371] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-28T17:36:15.159342] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-28T17:36:15.611964] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:36:15.959418] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-28T17:36:16.143610] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T17:36:16.148568] [INFO ] [REMOTE ] BKT: Full fetch complete (16852 records). [2025-10-28T17:36:16.148767] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-28T17:36:16.552991] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-28T17:36:16.553066] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-28T17:36:16.553408] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-28T17:36:16.553448] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-28T17:36:16.553997] [DEBUG] [LOCAL ] BKT: Trimmed 16852 records to 12704 (keeping 200 days of data) [2025-10-28T17:36:16.631748] [DEBUG] [LOCAL ] BKT: Primary data saved (12704 records). [2025-10-28T17:36:16.631878] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-28T17:36:16.631955] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKT took 17.4s. Estimated remaining: 4h 17m 19s. Rate: 8.1 symbols/min [2025-10-28T17:36:16.771840] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-28T17:36:16.805617] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:16.838156] [DEBUG] [LOCAL ] BLCO: Loaded 34457 existing records from primary storage. [2025-10-28T17:36:16.838440] [INFO ] [MAIN ] BLCO: Loaded 34457 existing records. [2025-10-28T17:36:17.019547] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:17.019884] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-28T17:36:17.020018] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-28T17:36:17.037857] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-28T17:36:17.038495] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:36:17.038745] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-28T17:36:17.408705] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:17.559323] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-28T17:36:18.359341] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-28T17:36:18.501014] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-28T17:36:18.591244] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:36:19.159341] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-28T17:36:19.236711] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T17:36:19.959346] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-28T17:36:20.394937] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:36:20.759327] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-28T17:36:21.559320] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-28T17:36:21.679129] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:36:21.819496] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-28T17:36:22.359342] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-28T17:36:22.784758] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:36:23.157070] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:36:23.163194] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-28T17:36:23.959335] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-28T17:36:24.097324] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T17:36:24.758636] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T17:36:24.765101] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-28T17:36:25.559345] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-28T17:36:25.962184] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T17:36:26.359394] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-28T17:36:26.632611] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:36:27.159345] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-28T17:36:27.324491] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T17:36:27.894693] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T17:36:27.959380] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-28T17:36:28.759309] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-28T17:36:28.951301] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T17:36:29.559403] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-28T17:36:29.923155] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:36:30.359397] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-28T17:36:31.159353] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-28T17:36:31.193623] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T17:36:31.337153] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T17:36:31.959362] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-28T17:36:32.221224] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:36:32.759323] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-28T17:36:33.295735] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:36:33.559295] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-28T17:36:33.672969] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:36:34.359383] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-28T17:36:34.713444] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:36:35.159350] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-28T17:36:35.959405] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-28T17:36:36.200965] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:36:36.207599] [INFO ] [REMOTE ] BKV: Full fetch complete (44764 records). [2025-10-28T17:36:36.207758] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-28T17:36:36.599196] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-28T17:36:36.642872] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-28T17:36:36.643233] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-28T17:36:36.643871] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-28T17:36:36.644088] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-28T17:36:36.645347] [DEBUG] [LOCAL ] BKV: Trimmed 44764 records to 28974 (keeping 200 days of data) [2025-10-28T17:36:36.761474] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-28T17:36:36.814606] [DEBUG] [LOCAL ] BKV: Primary data saved (28974 records). [2025-10-28T17:36:36.814765] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-28T17:36:36.814849] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKV took 31.0s. Estimated remaining: 4h 18m 41s. Rate: 8.0 symbols/min [2025-10-28T17:36:36.993206] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:37.042350] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:36:37.071531] [DEBUG] [LOCAL ] BLD: Loaded 26648 existing records from primary storage. [2025-10-28T17:36:37.071812] [INFO ] [MAIN ] BLD: Loaded 26648 existing records. [2025-10-28T17:36:37.245305] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:37.245516] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-28T17:36:37.245563] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-28T17:36:37.245887] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-28T17:36:37.245944] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-28T17:36:37.566328] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-28T17:36:37.595405] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:38.359350] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-28T17:36:38.395148] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:36:38.667426] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-28T17:36:38.679357] [INFO ] [REMOTE ] BKSY: Full fetch complete (70785 records). [2025-10-28T17:36:38.679522] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-28T17:36:39.117217] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-28T17:36:39.117542] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-28T17:36:39.118469] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-28T17:36:39.118532] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-28T17:36:39.119903] [DEBUG] [LOCAL ] BKSY: Trimmed 70785 records to 48927 (keeping 200 days of data) [2025-10-28T17:36:39.171000] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-28T17:36:39.413556] [DEBUG] [LOCAL ] BKSY: Primary data saved (48927 records). [2025-10-28T17:36:39.413801] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-28T17:36:39.414383] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKSY took 51.3s. Estimated remaining: 4h 17m 60s. Rate: 8.0 symbols/min [2025-10-28T17:36:39.583517] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:39.599579] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:36:39.652853] [DEBUG] [LOCAL ] BLDR: Loaded 51805 existing records from primary storage. [2025-10-28T17:36:39.653161] [INFO ] [MAIN ] BLDR: Loaded 51805 existing records. [2025-10-28T17:36:39.830267] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:39.830508] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-28T17:36:39.830554] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-28T17:36:39.830903] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-28T17:36:39.830960] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-28T17:36:39.964497] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-28T17:36:40.194596] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:40.430582] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T17:36:40.441248] [INFO ] [REMOTE ] BKU: Full fetch complete (61238 records). [2025-10-28T17:36:40.441412] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-28T17:36:40.769280] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-28T17:36:40.881086] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-28T17:36:40.881364] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-28T17:36:40.882223] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-28T17:36:40.882366] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-28T17:36:40.900302] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:36:40.906555] [DEBUG] [LOCAL ] BKU: Trimmed 61238 records to 42090 (keeping 200 days of data) [2025-10-28T17:36:41.186791] [DEBUG] [LOCAL ] BKU: Primary data saved (42090 records). [2025-10-28T17:36:41.186902] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-28T17:36:41.186981] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKU took 36.9s. Estimated remaining: 4h 17m 12s. Rate: 8.1 symbols/min [2025-10-28T17:36:41.358174] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:41.376250] [DEBUG] [LOCAL ] BLE: Loaded 13448 existing records from primary storage. [2025-10-28T17:36:41.376554] [INFO ] [MAIN ] BLE: Loaded 13448 existing records. [2025-10-28T17:36:41.560257] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:41.560403] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-28T17:36:41.561448] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-28T17:36:41.561518] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-28T17:36:41.561883] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-28T17:36:41.561945] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-28T17:36:41.924837] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:42.098813] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:36:42.359351] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-28T17:36:42.520759] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T17:36:42.945675] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T17:36:43.159350] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-28T17:36:43.626505] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:36:43.959323] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-28T17:36:44.576529] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:36:44.759344] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-28T17:36:45.559399] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-28T17:36:46.129944] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:36:46.359392] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-28T17:36:46.664446] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:36:46.670860] [INFO ] [REMOTE ] BLCO: Full fetch complete (52050 records). [2025-10-28T17:36:46.671003] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-28T17:36:47.070546] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-28T17:36:47.070615] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-28T17:36:47.071252] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-28T17:36:47.071314] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-28T17:36:47.072453] [DEBUG] [LOCAL ] BLCO: Trimmed 52050 records to 34377 (keeping 200 days of data) [2025-10-28T17:36:47.173810] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-28T17:36:47.270684] [DEBUG] [LOCAL ] BLCO: Primary data saved (34377 records). [2025-10-28T17:36:47.270808] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-28T17:36:47.270888] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 30.6s. Estimated remaining: 4h 16m 55s. Rate: 8.1 symbols/min [2025-10-28T17:36:47.443830] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:47.462504] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:36:47.499353] [DEBUG] [LOCAL ] BLK: Loaded 33685 existing records from primary storage. [2025-10-28T17:36:47.499729] [INFO ] [MAIN ] BLK: Loaded 33685 existing records. [2025-10-28T17:36:47.673086] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:47.673293] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-28T17:36:47.673339] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-28T17:36:47.674161] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-28T17:36:47.674218] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-28T17:36:47.965427] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-28T17:36:48.043923] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:36:48.049500] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:48.759343] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-28T17:36:49.177549] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:36:49.559314] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-28T17:36:49.621223] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:36:49.958031] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T17:36:50.359351] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-28T17:36:51.046125] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:36:51.159341] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-28T17:36:51.752560] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T17:36:51.959345] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-28T17:36:52.485232] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:36:52.759340] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-28T17:36:53.559339] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-28T17:36:54.131029] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:36:54.339399] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:36:54.359299] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-28T17:36:55.159326] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-28T17:36:55.682867] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:36:55.959318] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-28T17:36:56.543037] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T17:36:56.545809] [INFO ] [REMOTE ] BLE: Full fetch complete (19614 records). [2025-10-28T17:36:56.545878] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-28T17:36:56.761544] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-28T17:36:56.923207] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-28T17:36:56.923346] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-28T17:36:56.923840] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-28T17:36:56.923919] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-28T17:36:56.924591] [DEBUG] [LOCAL ] BLE: Trimmed 19614 records to 13409 (keeping 200 days of data) [2025-10-28T17:36:57.002946] [DEBUG] [LOCAL ] BLE: Primary data saved (13409 records). [2025-10-28T17:36:57.003120] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-28T17:36:57.003228] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLE took 15.8s. Estimated remaining: 4h 17m 4s. Rate: 8.0 symbols/min [2025-10-28T17:36:57.172598] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T17:36:57.214156] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:57.256364] [DEBUG] [LOCAL ] BLND: Loaded 49191 existing records from primary storage. [2025-10-28T17:36:57.256681] [INFO ] [MAIN ] BLND: Loaded 49191 existing records. [2025-10-28T17:36:57.427446] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:57.427664] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-28T17:36:57.427741] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-28T17:36:57.427994] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-28T17:36:57.428036] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-28T17:36:57.564522] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-28T17:36:57.777528] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:58.292765] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T17:36:58.332667] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:36:58.359292] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-28T17:36:59.159300] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-28T17:36:59.326175] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:36:59.959368] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-28T17:37:00.285096] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:37:00.759320] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-28T17:37:01.468139] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T17:37:01.559325] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-28T17:37:02.239669] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:37:02.359352] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-28T17:37:03.144881] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T17:37:03.159297] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-28T17:37:03.375141] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:37:03.959374] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-28T17:37:04.681740] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T17:37:04.759300] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-28T17:37:05.195061] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:37:05.559328] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-28T17:37:06.203171] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T17:37:06.359349] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-28T17:37:07.159330] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-28T17:37:07.279796] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T17:37:07.329531] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:37:07.960332] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-28T17:37:08.375318] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:37:08.759368] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-28T17:37:09.372681] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T17:37:09.559350] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-28T17:37:10.359349] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-28T17:37:11.118934] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-28T17:37:11.129729] [INFO ] [REMOTE ] BLDR: Full fetch complete (74760 records). [2025-10-28T17:37:11.129948] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-28T17:37:11.162459] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-28T17:37:11.460393] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-28T17:37:11.598026] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-28T17:37:11.598161] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-28T17:37:11.599045] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-28T17:37:11.599914] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-28T17:37:11.601354] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:37:11.611316] [DEBUG] [LOCAL ] BLDR: Trimmed 74760 records to 51799 (keeping 200 days of data) [2025-10-28T17:37:11.962717] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-28T17:37:11.973633] [DEBUG] [LOCAL ] BLDR: Primary data saved (51799 records). [2025-10-28T17:37:11.975247] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-28T17:37:11.975376] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLDR took 32.6s. Estimated remaining: 4h 17m 48s. Rate: 8.0 symbols/min [2025-10-28T17:37:12.168331] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:12.168506] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-28T17:37:12.168543] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-28T17:37:12.168676] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-28T17:37:12.168731] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-28T17:37:12.168772] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-28T17:37:12.168804] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-28T17:37:12.546246] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:12.586578] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T17:37:12.759308] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-28T17:37:12.967591] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:37:12.968612] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T17:37:12.968829] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-28T17:37:12.973245] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:37:12.973808] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-28T17:37:12.973881] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:37:12.973959] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-28T17:37:12.974033] [INFO ] [REMOTE ] BLD: Full fetch complete (39700 records). [2025-10-28T17:37:12.974242] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-28T17:37:12.974159] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-28T17:37:12.974340] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-28T17:37:12.974591] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-28T17:37:12.974687] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLSH took 1.0s. Estimated remaining: 4h 16m 56s. Rate: 8.0 symbols/min [2025-10-28T17:37:13.328155] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:13.502241] [DEBUG] [LOCAL ] BLW: Loaded 12668 existing records from primary storage. [2025-10-28T17:37:13.520009] [INFO ] [MAIN ] BLW: Loaded 12668 existing records. [2025-10-28T17:37:13.564454] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-28T17:37:13.642045] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-28T17:37:13.652818] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-28T17:37:13.653314] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-28T17:37:13.653386] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-28T17:37:13.703191] [DEBUG] [LOCAL ] BLD: Trimmed 39700 records to 26517 (keeping 200 days of data) [2025-10-28T17:37:13.731987] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:13.788750] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-28T17:37:13.815573] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-28T17:37:13.819112] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-28T17:37:13.819913] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-28T17:37:14.178361] [DEBUG] [LOCAL ] BLD: Primary data saved (26517 records). [2025-10-28T17:37:14.178632] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-28T17:37:14.179128] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLD took 37.4s. Estimated remaining: 4h 16m 5s. Rate: 8.1 symbols/min [2025-10-28T17:37:14.371732] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-28T17:37:14.371662] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:14.455446] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:14.471446] [DEBUG] [LOCAL ] BLX: Loaded 14966 existing records from primary storage. [2025-10-28T17:37:14.471745] [INFO ] [MAIN ] BLX: Loaded 14966 existing records. [2025-10-28T17:37:14.647468] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:14.647746] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-28T17:37:14.647801] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-28T17:37:14.648123] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-28T17:37:14.648163] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-28T17:37:15.009010] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:15.037303] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T17:37:15.159295] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-28T17:37:15.790457] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:37:15.959322] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-28T17:37:16.207732] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T17:37:16.759473] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-28T17:37:16.983408] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T17:37:17.559399] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-28T17:37:17.988610] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:37:18.359469] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-28T17:37:18.649278] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:37:19.004485] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:37:19.159333] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-28T17:37:19.759967] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:37:19.959368] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-28T17:37:20.759398] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-28T17:37:21.257805] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T17:37:21.564453] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-28T17:37:21.573659] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:37:22.359381] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-28T17:37:22.531930] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T17:37:23.159312] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-28T17:37:23.345710] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T17:37:23.959363] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-28T17:37:24.445511] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:37:24.722993] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T17:37:24.730536] [INFO ] [REMOTE ] BLK: Full fetch complete (52617 records). [2025-10-28T17:37:24.730699] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-28T17:37:24.766729] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-28T17:37:25.154015] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-28T17:37:25.154093] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-28T17:37:25.154728] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-28T17:37:25.154788] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-28T17:37:25.155831] [DEBUG] [LOCAL ] BLK: Trimmed 52617 records to 33493 (keeping 200 days of data) [2025-10-28T17:37:25.365915] [DEBUG] [LOCAL ] BLK: Primary data saved (33493 records). [2025-10-28T17:37:25.366068] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-28T17:37:25.366939] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLK took 38.1s. Estimated remaining: 4h 16m 24s. Rate: 8.1 symbols/min [2025-10-28T17:37:25.530527] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:25.563559] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-28T17:37:25.565312] [DEBUG] [LOCAL ] BMA: Loaded 36661 existing records from primary storage. [2025-10-28T17:37:25.565719] [INFO ] [MAIN ] BMA: Loaded 36661 existing records. [2025-10-28T17:37:25.739849] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:25.740053] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-28T17:37:25.740100] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-28T17:37:25.740757] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-28T17:37:25.740814] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-28T17:37:26.103431] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:37:26.103052] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:26.167978] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:37:26.359329] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-28T17:37:27.159352] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-28T17:37:27.524441] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T17:37:27.735846] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:37:27.959356] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-28T17:37:28.759416] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-28T17:37:29.212894] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T17:37:29.222866] [INFO ] [REMOTE ] BLND: Full fetch complete (72181 records). [2025-10-28T17:37:29.222980] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-28T17:37:29.553355] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T17:37:29.571131] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-28T17:37:29.631555] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-28T17:37:29.631630] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-28T17:37:29.632385] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-28T17:37:29.632434] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-28T17:37:29.633797] [DEBUG] [LOCAL ] BLND: Trimmed 72181 records to 49182 (keeping 200 days of data) [2025-10-28T17:37:29.909464] [DEBUG] [LOCAL ] BLND: Primary data saved (49182 records). [2025-10-28T17:37:29.909585] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-28T17:37:29.909681] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLND took 32.9s. Estimated remaining: 4h 15m 56s. Rate: 8.1 symbols/min [2025-10-28T17:37:30.084714] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:30.095090] [DEBUG] [LOCAL ] BME: Loaded 11046 existing records from primary storage. [2025-10-28T17:37:30.095254] [INFO ] [MAIN ] BME: Loaded 11046 existing records. [2025-10-28T17:37:30.267552] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:30.267831] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-28T17:37:30.267885] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-28T17:37:30.268175] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-28T17:37:30.268233] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-28T17:37:30.364537] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-28T17:37:30.638927] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:30.657915] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T17:37:31.159325] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-28T17:37:31.285924] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:37:31.761469] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:37:31.959418] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-28T17:37:32.759349] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-28T17:37:32.841297] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:37:33.559322] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-28T17:37:33.677060] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:37:34.086520] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:37:34.359464] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-28T17:37:35.113114] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:37:35.159352] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-28T17:37:35.833708] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:37:35.959346] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-28T17:37:36.633275] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:37:36.636753] [INFO ] [REMOTE ] BLW: Full fetch complete (19168 records). [2025-10-28T17:37:36.636876] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-28T17:37:36.774343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-28T17:37:37.002016] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-28T17:37:37.002082] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-28T17:37:37.002410] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-28T17:37:37.002449] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-28T17:37:37.002985] [DEBUG] [LOCAL ] BLW: Trimmed 19168 records to 12656 (keeping 200 days of data) [2025-10-28T17:37:37.079824] [DEBUG] [LOCAL ] BLW: Primary data saved (12656 records). [2025-10-28T17:37:37.079942] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-28T17:37:37.080016] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLW took 24.1s. Estimated remaining: 4h 15m 47s. Rate: 8.1 symbols/min [2025-10-28T17:37:37.244392] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:37.265929] [DEBUG] [LOCAL ] BMEZ: Loaded 24659 existing records from primary storage. [2025-10-28T17:37:37.266165] [INFO ] [MAIN ] BMEZ: Loaded 24659 existing records. [2025-10-28T17:37:37.448112] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:37.448317] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-28T17:37:37.448378] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-28T17:37:37.449004] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-28T17:37:37.449066] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-28T17:37:37.564453] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-28T17:37:37.825334] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:38.234515] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T17:37:38.359309] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-28T17:37:38.406710] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:37:39.159313] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-28T17:37:39.300185] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T17:37:39.959405] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-28T17:37:40.286730] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:37:40.750938] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T17:37:40.759290] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-28T17:37:41.559332] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-28T17:37:41.729327] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:37:42.359304] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-28T17:37:42.529836] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:37:43.080732] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T17:37:43.159323] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-28T17:37:43.774221] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:37:43.959351] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-28T17:37:44.759313] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-28T17:37:44.868452] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T17:37:45.467731] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:37:45.559326] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-28T17:37:46.359870] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-28T17:37:46.363606] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T17:37:47.159339] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-28T17:37:47.189983] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T17:37:47.193289] [INFO ] [REMOTE ] BLX: Full fetch complete (22350 records). [2025-10-28T17:37:47.193362] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-28T17:37:47.563162] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-28T17:37:47.563234] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-28T17:37:47.563590] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-28T17:37:47.563627] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-28T17:37:47.564231] [DEBUG] [LOCAL ] BLX: Trimmed 22350 records to 14892 (keeping 200 days of data) [2025-10-28T17:37:47.651751] [DEBUG] [LOCAL ] BLX: Primary data saved (14892 records). [2025-10-28T17:37:47.651877] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-28T17:37:47.651952] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BLX took 33.5s. Estimated remaining: 4h 16m 1s. Rate: 8.1 symbols/min [2025-10-28T17:37:47.820201] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:47.845387] [DEBUG] [LOCAL ] BMI: Loaded 24626 existing records from primary storage. [2025-10-28T17:37:47.845597] [INFO ] [MAIN ] BMI: Loaded 24626 existing records. [2025-10-28T17:37:47.964432] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-28T17:37:48.029568] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:48.029858] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-28T17:37:48.029922] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-28T17:37:48.030356] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-28T17:37:48.030421] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-28T17:37:48.399883] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:37:48.446356] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:48.691988] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T17:37:48.759347] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-28T17:37:49.559384] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-28T17:37:49.758533] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:37:50.069712] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T17:37:50.359381] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-28T17:37:51.099220] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T17:37:51.159387] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-28T17:37:51.959343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-28T17:37:52.106129] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T17:37:52.759341] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-28T17:37:53.129416] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:37:53.463156] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:37:53.559307] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-28T17:37:54.359302] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-28T17:37:54.462555] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T17:37:55.159334] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-28T17:37:55.481827] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:37:55.925126] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T17:37:55.959390] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-28T17:37:56.592169] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T17:37:56.759363] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-28T17:37:57.297153] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:37:57.559386] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-28T17:37:58.359324] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-28T17:37:58.426348] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:37:58.910377] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T17:37:59.159350] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-28T17:37:59.959343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-28T17:38:00.039870] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:38:00.759338] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-28T17:38:01.559312] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-28T17:38:01.693752] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T17:38:01.702729] [INFO ] [REMOTE ] BMA: Full fetch complete (52686 records). [2025-10-28T17:38:01.702863] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-28T17:38:01.982281] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:38:02.030110] [INFO ] [REMOTE ] BMEZ: Full fetch complete (38877 records). [2025-10-28T17:38:02.045898] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-28T17:38:02.253312] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-28T17:38:02.253439] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-28T17:38:02.254463] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-28T17:38:02.255187] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-28T17:38:02.369003] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-28T17:38:02.359047] [DEBUG] [LOCAL ] BMA: Trimmed 52686 records to 36732 (keeping 200 days of data) [2025-10-28T17:38:02.593342] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:38:02.711729] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-28T17:38:02.719788] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-28T17:38:02.722450] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-28T17:38:02.722577] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-28T17:38:02.794994] [DEBUG] [LOCAL ] BMEZ: Trimmed 38877 records to 24568 (keeping 200 days of data) [2025-10-28T17:38:02.925909] [DEBUG] [LOCAL ] BMA: Primary data saved (36732 records). [2025-10-28T17:38:02.926783] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-28T17:38:02.927220] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BMA took 37.6s. Estimated remaining: 4h 16m 46s. Rate: 8.0 symbols/min [2025-10-28T17:38:03.083722] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:38:03.160132] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:03.160195] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-28T17:38:03.171922] [DEBUG] [LOCAL ] BMN: Loaded 2612 existing records from primary storage. [2025-10-28T17:38:03.172447] [INFO ] [MAIN ] BMN: Loaded 2612 existing records. [2025-10-28T17:38:03.232178] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24568 records). [2025-10-28T17:38:03.246778] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-28T17:38:03.252628] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BMEZ took 26.2s. Estimated remaining: 4h 15m 51s. Rate: 8.1 symbols/min [2025-10-28T17:38:03.508479] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:03.520886] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-28T17:38:03.541382] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:03.541965] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-28T17:38:03.542175] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-28T17:38:03.542224] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-28T17:38:03.878846] [DEBUG] [LOCAL ] BMO: Loaded 40521 existing records from primary storage. [2025-10-28T17:38:03.929668] [INFO ] [MAIN ] BMO: Loaded 40521 existing records. [2025-10-28T17:38:03.967888] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-28T17:38:04.006622] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:04.086875] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:38:04.178767] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:04.178935] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-28T17:38:04.178983] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-28T17:38:04.179304] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-28T17:38:04.179360] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-28T17:38:04.522447] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:04.672082] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:38:04.759317] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-28T17:38:05.362697] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:38:05.559350] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-28T17:38:06.359392] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-28T17:38:06.547059] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T17:38:06.803274] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T17:38:07.159415] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-28T17:38:07.959326] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-28T17:38:08.092804] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:38:08.095612] [INFO ] [REMOTE ] BME: Full fetch complete (15547 records). [2025-10-28T17:38:08.095737] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-28T17:38:08.266740] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T17:38:08.493315] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-28T17:38:08.493397] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-28T17:38:08.493756] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-28T17:38:08.493817] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-28T17:38:08.494370] [DEBUG] [LOCAL ] BME: Trimmed 15547 records to 11003 (keeping 200 days of data) [2025-10-28T17:38:08.569434] [DEBUG] [LOCAL ] BME: Primary data saved (11003 records). [2025-10-28T17:38:08.569576] [INFO ] [MAIN ] BME: Full history saved. [2025-10-28T17:38:08.569685] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BME took 38.7s. Estimated remaining: 4h 15m 29s. Rate: 8.1 symbols/min [2025-10-28T17:38:08.736630] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:08.761429] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-28T17:38:08.785053] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-28T17:38:08.785437] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-28T17:38:08.968092] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:08.968314] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-28T17:38:08.968361] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-28T17:38:08.969348] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-28T17:38:08.969408] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-28T17:38:09.328868] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:09.559364] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-28T17:38:10.226744] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:38:10.359318] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-28T17:38:10.809511] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:38:11.159361] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-28T17:38:11.480591] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T17:38:11.623481] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:38:11.959394] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-28T17:38:12.392028] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:38:12.759356] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-28T17:38:13.052743] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T17:38:13.559352] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-28T17:38:14.359306] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-28T17:38:14.530782] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T17:38:15.159431] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-28T17:38:15.809985] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:38:15.959348] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-28T17:38:16.403346] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:38:16.415689] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T17:38:16.759366] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-28T17:38:17.559329] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-28T17:38:17.985765] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:38:18.021306] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T17:38:18.359341] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-28T17:38:19.159318] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-28T17:38:19.400068] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:38:19.959333] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-28T17:38:20.266320] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T17:38:20.759313] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-28T17:38:20.805293] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T17:38:21.237627] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T17:38:21.559337] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-28T17:38:22.359387] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-28T17:38:23.022062] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:38:23.027731] [INFO ] [REMOTE ] BMI: Full fetch complete (34226 records). [2025-10-28T17:38:23.027824] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-28T17:38:23.164529] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-28T17:38:23.391636] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-28T17:38:23.391747] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-28T17:38:23.392213] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-28T17:38:23.392253] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-28T17:38:23.393061] [DEBUG] [LOCAL ] BMI: Trimmed 34226 records to 24547 (keeping 200 days of data) [2025-10-28T17:38:23.537344] [DEBUG] [LOCAL ] BMI: Primary data saved (24547 records). [2025-10-28T17:38:23.537466] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-28T17:38:23.537571] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 35.9s. Estimated remaining: 4h 16m 12s. Rate: 8.0 symbols/min [2025-10-28T17:38:23.702967] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:23.748398] [DEBUG] [LOCAL ] BN: Loaded 52973 existing records from primary storage. [2025-10-28T17:38:23.748733] [INFO ] [MAIN ] BN: Loaded 52973 existing records. [2025-10-28T17:38:23.923534] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:23.923895] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-28T17:38:23.923969] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-28T17:38:23.931594] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-28T17:38:23.945320] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-28T17:38:23.982585] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T17:38:23.975506] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-28T17:38:24.339092] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:24.722577] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:38:24.737814] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T17:38:24.739124] [INFO ] [REMOTE ] BMN: Full fetch complete (3745 records). [2025-10-28T17:38:24.739194] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-28T17:38:24.764509] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-28T17:38:25.100322] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-28T17:38:25.100394] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-28T17:38:25.100513] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-28T17:38:25.100550] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-28T17:38:25.100912] [DEBUG] [LOCAL ] BMN: Trimmed 3745 records to 2634 (keeping 200 days of data) [2025-10-28T17:38:25.116566] [DEBUG] [LOCAL ] BMN: Primary data saved (2634 records). [2025-10-28T17:38:25.116628] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-28T17:38:25.116727] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 22.2s. Estimated remaining: 4h 15m 25s. Rate: 8.1 symbols/min [2025-10-28T17:38:25.280213] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:25.307178] [DEBUG] [LOCAL ] BNED: Loaded 27853 existing records from primary storage. [2025-10-28T17:38:25.307424] [INFO ] [MAIN ] BNED: Loaded 27853 existing records. [2025-10-28T17:38:25.478118] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:25.478304] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-28T17:38:25.478350] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-28T17:38:25.478527] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-28T17:38:25.478585] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-28T17:38:25.565810] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-28T17:38:25.841876] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:26.103999] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:38:26.359327] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-28T17:38:27.164495] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-28T17:38:27.183471] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:38:27.380067] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:38:27.959391] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-28T17:38:28.759384] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-28T17:38:28.899531] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:38:29.549070] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-28T17:38:29.559768] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-28T17:38:30.136943] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:38:30.359366] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-28T17:38:30.643089] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:38:31.159349] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-28T17:38:31.354832] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T17:38:31.959358] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-28T17:38:32.730810] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:38:32.759317] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-28T17:38:33.155347] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T17:38:33.559341] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-28T17:38:34.359328] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-28T17:38:34.458467] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T17:38:35.159315] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-28T17:38:35.216032] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:38:35.223984] [INFO ] [REMOTE ] BMO: Full fetch complete (59677 records). [2025-10-28T17:38:35.224101] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-28T17:38:35.430137] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T17:38:35.628429] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-28T17:38:35.628505] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-28T17:38:35.629163] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-28T17:38:35.629227] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-28T17:38:35.630385] [DEBUG] [LOCAL ] BMO: Trimmed 59677 records to 40411 (keeping 200 days of data) [2025-10-28T17:38:35.869205] [DEBUG] [LOCAL ] BMO: Primary data saved (40411 records). [2025-10-28T17:38:35.869324] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-28T17:38:35.869916] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 32.6s. Estimated remaining: 4h 15m 40s. Rate: 8.0 symbols/min [2025-10-28T17:38:35.968118] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-28T17:38:36.038264] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:36.046881] [DEBUG] [LOCAL ] BNH: Loaded 4511 existing records from primary storage. [2025-10-28T17:38:36.047088] [INFO ] [MAIN ] BNH: Loaded 4511 existing records. [2025-10-28T17:38:36.221927] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:36.222154] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-28T17:38:36.222201] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-28T17:38:36.222343] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-28T17:38:36.222398] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-28T17:38:36.566522] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:36.713484] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:38:36.759303] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-28T17:38:37.559343] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-28T17:38:37.611006] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:38:37.898040] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T17:38:38.359334] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-28T17:38:39.023724] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:38:39.159362] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-28T17:38:39.461173] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T17:38:39.959397] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-28T17:38:40.759388] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-28T17:38:40.800869] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T17:38:40.843589] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:38:41.130282] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T17:38:41.559344] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-28T17:38:41.932456] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T17:38:42.359360] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-28T17:38:42.774565] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T17:38:43.159353] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-28T17:38:43.959353] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-28T17:38:44.268790] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:38:44.759310] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-28T17:38:45.559412] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-28T17:38:45.676174] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T17:38:45.934280] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:38:46.101699] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-28T17:38:46.359339] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-28T17:38:47.077340] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:38:47.087908] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-28T17:38:47.088050] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-28T17:38:47.164455] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-28T17:38:47.473519] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-28T17:38:47.473608] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-28T17:38:47.474418] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-28T17:38:47.474480] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-28T17:38:47.476016] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-28T17:38:47.798289] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-28T17:38:47.798384] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-28T17:38:47.798455] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BMY took 39.2s. Estimated remaining: 4h 16m 2s. Rate: 8.0 symbols/min [2025-10-28T17:38:47.963847] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-28T17:38:47.963775] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:47.968708] [DEBUG] [LOCAL ] BNJ: Loaded 2407 existing records from primary storage. [2025-10-28T17:38:47.968916] [INFO ] [MAIN ] BNJ: Loaded 2407 existing records. [2025-10-28T17:38:48.152147] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:48.152328] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-28T17:38:48.152373] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-28T17:38:48.152594] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-28T17:38:48.152685] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-28T17:38:48.425807] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T17:38:48.539074] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:48.581192] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T17:38:48.759346] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-28T17:38:49.559333] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-28T17:38:49.651316] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:38:49.870879] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T17:38:50.359334] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-28T17:38:50.640341] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T17:38:51.159334] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-28T17:38:51.959350] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-28T17:38:52.760350] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-28T17:38:52.994965] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-28T17:38:53.218215] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T17:38:53.559335] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-28T17:38:53.572768] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T17:38:53.577215] [INFO ] [REMOTE ] BNED: Full fetch complete (41372 records). [2025-10-28T17:38:53.577299] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-28T17:38:53.945278] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-28T17:38:53.945357] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-28T17:38:53.945887] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-28T17:38:53.945949] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-28T17:38:53.946883] [DEBUG] [LOCAL ] BNED: Trimmed 41372 records to 27781 (keeping 200 days of data) [2025-10-28T17:38:54.052851] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:38:54.108527] [DEBUG] [LOCAL ] BNED: Primary data saved (27781 records). [2025-10-28T17:38:54.108673] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-28T17:38:54.108769] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BNED took 29.0s. Estimated remaining: 4h 15m 46s. Rate: 8.0 symbols/min [2025-10-28T17:38:54.274019] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:54.315819] [DEBUG] [LOCAL ] BNL: Loaded 46837 existing records from primary storage. [2025-10-28T17:38:54.316112] [INFO ] [MAIN ] BNL: Loaded 46837 existing records. [2025-10-28T17:38:54.367728] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-28T17:38:54.492925] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:54.493104] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-28T17:38:54.493150] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-28T17:38:54.493587] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-28T17:38:54.493626] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-28T17:38:54.839489] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T17:38:54.844876] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:55.159327] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-28T17:38:55.530348] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T17:38:55.959378] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-28T17:38:56.759344] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-28T17:38:57.425362] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:38:57.559321] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-28T17:38:58.132884] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:38:58.232252] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:38:58.233816] [INFO ] [REMOTE ] BNH: Full fetch complete (6840 records). [2025-10-28T17:38:58.233885] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-28T17:38:58.364441] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-28T17:38:58.614274] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-28T17:38:58.614354] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-28T17:38:58.614548] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-28T17:38:58.614586] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-28T17:38:58.615073] [DEBUG] [LOCAL ] BNH: Trimmed 6840 records to 4480 (keeping 200 days of data) [2025-10-28T17:38:58.643177] [DEBUG] [LOCAL ] BNH: Primary data saved (4480 records). [2025-10-28T17:38:58.643321] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-28T17:38:58.643400] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BNH took 22.8s. Estimated remaining: 4h 15m 20s. Rate: 8.0 symbols/min [2025-10-28T17:38:58.829190] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:58.880455] [DEBUG] [LOCAL ] BNS: Loaded 51296 existing records from primary storage. [2025-10-28T17:38:58.880852] [INFO ] [MAIN ] BNS: Loaded 51296 existing records. [2025-10-28T17:38:59.056226] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:59.056445] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-28T17:38:59.056491] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-28T17:38:59.057097] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-28T17:38:59.057173] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-28T17:38:59.164478] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-28T17:38:59.430087] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:59.523695] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T17:38:59.555188] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:38:59.959383] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-28T17:39:00.759344] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-28T17:39:01.534403] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:39:01.559354] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-28T17:39:02.260898] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:39:02.359346] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-28T17:39:02.803771] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:39:03.159340] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-28T17:39:03.959377] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-28T17:39:04.066215] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:39:04.483469] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:39:04.759358] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-28T17:39:05.265805] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:39:05.559330] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-28T17:39:05.942522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:39:06.359346] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-28T17:39:06.956075] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:39:07.159333] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-28T17:39:07.455724] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T17:39:07.735678] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:39:07.959344] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-28T17:39:08.759352] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-28T17:39:09.559347] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-28T17:39:09.860985] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T17:39:09.871711] [INFO ] [REMOTE ] BN: Full fetch complete (76947 records). [2025-10-28T17:39:09.871852] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-28T17:39:09.978466] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:39:10.297572] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T17:39:10.327838] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-28T17:39:10.328283] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-28T17:39:10.329263] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-28T17:39:10.329347] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-28T17:39:10.330897] [DEBUG] [LOCAL ] BN: Trimmed 76947 records to 52969 (keeping 200 days of data) [2025-10-28T17:39:10.382596] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-28T17:39:10.648076] [DEBUG] [LOCAL ] BN: Primary data saved (52969 records). [2025-10-28T17:39:10.648207] [INFO ] [MAIN ] BN: Full history saved. [2025-10-28T17:39:10.648283] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BN took 47.1s. Estimated remaining: 4h 15m 42s. Rate: 8.0 symbols/min [2025-10-28T17:39:10.815419] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:10.820165] [DEBUG] [LOCAL ] BNT: Loaded 3318 existing records from primary storage. [2025-10-28T17:39:10.820326] [INFO ] [MAIN ] BNT: Loaded 3318 existing records. [2025-10-28T17:39:10.996043] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:10.996284] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-28T17:39:10.996337] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-28T17:39:10.996546] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-28T17:39:10.996601] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-28T17:39:11.166772] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-28T17:39:11.351069] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:11.959339] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-28T17:39:12.148815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-28T17:39:12.323508] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T17:39:12.759317] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-28T17:39:12.871113] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T17:39:13.559398] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-28T17:39:14.334502] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T17:39:14.359295] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-28T17:39:14.816188] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:39:15.105851] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:39:15.159357] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-28T17:39:15.488068] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T17:39:15.959396] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-28T17:39:16.759295] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-28T17:39:16.819720] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T17:39:16.820817] [INFO ] [REMOTE ] BNJ: Full fetch complete (3853 records). [2025-10-28T17:39:16.820890] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-28T17:39:17.208069] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-28T17:39:17.208172] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-28T17:39:17.208306] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-28T17:39:17.208346] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-28T17:39:17.208774] [DEBUG] [LOCAL ] BNJ: Trimmed 3853 records to 2411 (keeping 200 days of data) [2025-10-28T17:39:17.223116] [DEBUG] [LOCAL ] BNJ: Primary data saved (2411 records). [2025-10-28T17:39:17.223177] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-28T17:39:17.223243] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNJ took 29.4s. Estimated remaining: 4h 15m 29s. Rate: 8.0 symbols/min [2025-10-28T17:39:17.390554] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:17.399054] [DEBUG] [LOCAL ] BNY: Loaded 7109 existing records from primary storage. [2025-10-28T17:39:17.399220] [INFO ] [MAIN ] BNY: Loaded 7109 existing records. [2025-10-28T17:39:17.568891] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-28T17:39:17.595168] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:17.595477] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-28T17:39:17.595525] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-28T17:39:17.595710] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-28T17:39:17.595767] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-28T17:39:17.958746] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:18.031357] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-28T17:39:18.094612] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:39:18.359351] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-28T17:39:18.952146] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T17:39:19.159321] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-28T17:39:19.527318] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:39:19.959337] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-28T17:39:20.759372] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-28T17:39:21.246888] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:39:21.559328] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-28T17:39:22.005190] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T17:39:22.359376] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-28T17:39:22.660457] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T17:39:23.159359] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-28T17:39:23.959306] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-28T17:39:24.382079] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-28T17:39:24.392124] [INFO ] [REMOTE ] BNL: Full fetch complete (67253 records). [2025-10-28T17:39:24.392276] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-28T17:39:24.500538] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:39:24.767285] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-28T17:39:24.790460] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-28T17:39:24.790558] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-28T17:39:24.791399] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-28T17:39:24.791586] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-28T17:39:24.793152] [DEBUG] [LOCAL ] BNL: Trimmed 67253 records to 46779 (keeping 200 days of data) [2025-10-28T17:39:25.071522] [DEBUG] [LOCAL ] BNL: Primary data saved (46779 records). [2025-10-28T17:39:25.071683] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-28T17:39:25.071778] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNL took 31.0s. Estimated remaining: 4h 15m 24s. Rate: 8.0 symbols/min [2025-10-28T17:39:25.241213] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:25.241364] [DEBUG] [LOCAL ] BOC: No existing data file found in primary storage. [2025-10-28T17:39:25.241401] [WARN ] [MAIN ] BOC: No existing data found, performing full refresh instead. [2025-10-28T17:39:25.241510] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-28T17:39:25.241552] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-28T17:39:25.241592] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-28T17:39:25.241626] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-28T17:39:25.564127] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-28T17:39:25.632164] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:25.636568] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T17:39:25.667698] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T17:39:26.052827] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:39:26.359351] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-28T17:39:26.629627] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-28T17:39:27.159350] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-28T17:39:27.959364] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-28T17:39:28.457714] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:39:28.759320] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-28T17:39:29.400365] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T17:39:29.424532] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T17:39:29.559327] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-28T17:39:30.224809] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T17:39:30.359320] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-28T17:39:31.145936] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T17:39:31.159297] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-28T17:39:31.783850] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T17:39:31.959378] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-28T17:39:32.459836] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T17:39:32.759369] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-28T17:39:33.559393] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-28T17:39:34.004168] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:39:34.359306] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-28T17:39:34.417588] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:39:35.159310] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-28T17:39:35.184213] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:39:35.185861] [INFO ] [REMOTE ] BNT: Full fetch complete (4855 records). [2025-10-28T17:39:35.185935] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-28T17:39:35.573468] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-28T17:39:35.573551] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-28T17:39:35.573723] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-28T17:39:35.573783] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-28T17:39:35.574139] [DEBUG] [LOCAL ] BNT: Trimmed 4855 records to 3298 (keeping 200 days of data) [2025-10-28T17:39:35.594512] [DEBUG] [LOCAL ] BNT: Primary data saved (3298 records). [2025-10-28T17:39:35.594592] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-28T17:39:35.594691] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNT took 24.9s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min [2025-10-28T17:39:35.778314] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T17:39:35.959374] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-28T17:39:36.658162] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:39:36.759317] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-28T17:39:37.559403] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-28T17:39:37.824208] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:39:38.359350] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-28T17:39:38.782849] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:39:38.795080] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T17:39:39.159331] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-28T17:39:39.959390] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-28T17:39:40.430982] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T17:39:40.759338] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-28T17:39:41.274689] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T17:39:41.559322] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-28T17:39:41.687012] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-28T17:39:41.698045] [INFO ] [REMOTE ] BNS: Full fetch complete (74545 records). [2025-10-28T17:39:41.698172] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-28T17:39:42.082500] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:39:42.170530] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-28T17:39:42.170623] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-28T17:39:42.171516] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-28T17:39:42.171579] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-28T17:39:42.173072] [DEBUG] [LOCAL ] BNS: Trimmed 74545 records to 51279 (keeping 200 days of data) [2025-10-28T17:39:42.381948] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-28T17:39:42.483832] [DEBUG] [LOCAL ] BNS: Primary data saved (51279 records). [2025-10-28T17:39:42.483964] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-28T17:39:42.484041] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNS took 43.8s. Estimated remaining: 4h 15m 25s. Rate: 8.0 symbols/min [2025-10-28T17:39:43.093083] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:39:43.159344] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-28T17:39:43.688282] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T17:39:43.959347] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-28T17:39:44.759359] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-28T17:39:45.061460] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:39:45.063714] [INFO ] [REMOTE ] BNY: Full fetch complete (10420 records). [2025-10-28T17:39:45.063784] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-28T17:39:45.425622] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-28T17:39:45.425726] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-28T17:39:45.425970] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-28T17:39:45.426008] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-28T17:39:45.426453] [DEBUG] [LOCAL ] BNY: Trimmed 10420 records to 7132 (keeping 200 days of data) [2025-10-28T17:39:45.467324] [DEBUG] [LOCAL ] BNY: Primary data saved (7132 records). [2025-10-28T17:39:45.467433] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-28T17:39:45.467519] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNY took 28.2s. Estimated remaining: 4h 14m 48s. Rate: 8.0 symbols/min [2025-10-28T17:39:46.112427] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T17:39:46.117617] [INFO ] [REMOTE ] BOC: Full fetch complete (25776 records). [2025-10-28T17:39:46.117763] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-28T17:39:46.492901] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-28T17:39:46.492975] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-28T17:39:46.493379] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-28T17:39:46.493416] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-28T17:39:46.494056] [DEBUG] [LOCAL ] BOC: Trimmed 25776 records to 17761 (keeping 200 days of data) [2025-10-28T17:39:46.592065] [DEBUG] [LOCAL ] BOC: Primary data saved (17761 records). [2025-10-28T17:39:46.592185] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-28T17:39:46.592267] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 21.5s. Estimated remaining: 4h 14m 0s. Rate: 8.1 symbols/min [2025-10-28T17:39:47.205946] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.265204] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.275867] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.303858] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.335537] [DEBUG] [LOCAL ] BOE: Loaded 17571 existing records from primary storage. [2025-10-28T17:39:47.336030] [INFO ] [MAIN ] BOE: Loaded 17571 existing records. [2025-10-28T17:39:47.375669] [DEBUG] [LOCAL ] BOH: Loaded 30475 existing records from primary storage. [2025-10-28T17:39:47.438120] [INFO ] [MAIN ] BOH: Loaded 30475 existing records. [2025-10-28T17:39:47.485789] [DEBUG] [LOCAL ] BOND: Loaded 32267 existing records from primary storage. [2025-10-28T17:39:47.537173] [INFO ] [MAIN ] BOND: Loaded 32267 existing records. [2025-10-28T17:39:47.644473] [DEBUG] [LOCAL ] BOOT: Loaded 39109 existing records from primary storage. [2025-10-28T17:39:47.671781] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:47.699092] [INFO ] [MAIN ] BOOT: Loaded 39109 existing records. [2025-10-28T17:39:47.726546] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-28T17:39:47.753639] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-28T17:39:47.763387] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-28T17:39:47.789215] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-28T17:39:47.978731] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:48.068628] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-28T17:39:48.085545] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-28T17:39:48.147341] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-28T17:39:48.147477] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-28T17:39:48.153099] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:48.226915] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-28T17:39:48.241366] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-28T17:39:48.288386] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-28T17:39:48.381456] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-28T17:39:48.373765] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:48.480105] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-28T17:39:48.598489] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-28T17:39:48.743526] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-28T17:39:48.871420] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-28T17:39:49.045243] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.149600] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-28T17:39:49.323553] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.334787] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-28T17:39:49.476360] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.508742] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-28T17:39:49.694285] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.694637] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-28T17:39:50.458780] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:39:50.463274] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-28T17:39:50.836118] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:39:50.871156] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-28T17:39:50.874971] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:39:50.885802] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-28T17:39:51.126575] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T17:39:51.159340] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-28T17:39:51.538323] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-28T17:39:51.579037] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:39:51.696962] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:39:51.766117] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:39:51.959341] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-28T17:39:52.759312] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-28T17:39:52.864781] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:39:53.517031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:39:53.559315] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-28T17:39:54.359328] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-28T17:39:54.965773] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:39:55.014031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T17:39:55.159368] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-28T17:39:55.879613] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T17:39:55.959321] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-28T17:39:56.759395] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-28T17:39:57.160045] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:39:57.559317] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-28T17:39:57.702037] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T17:39:58.359320] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-28T17:39:58.388743] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T17:39:59.057046] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:39:59.159353] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-28T17:39:59.959321] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-28T17:40:00.160636] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:40:00.759313] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-28T17:40:00.891706] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:40:01.559362] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-28T17:40:02.346126] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:40:02.367242] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-28T17:40:02.384491] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:40:03.159356] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-28T17:40:03.383833] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:40:03.959394] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-28T17:40:04.354705] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:40:04.759367] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-28T17:40:05.559335] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-28T17:40:05.935167] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T17:40:05.939891] [INFO ] [REMOTE ] BOE: Full fetch complete (26588 records). [2025-10-28T17:40:05.939974] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-28T17:40:05.940440] [FATAL] [VALIDATOR ] BOE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:40:05.940524] [FATAL] [MAIN ] BOE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:40:05.940570] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:40:05.940610] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-28T17:40:05.940700] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-28T17:40:05.940786] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-10-28T17:40:05.940940] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-10-28T17:40:05.941025] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOE took 19.3s. Estimated remaining: 4h 15m 8s. Rate: 8.0 symbols/min [2025-10-28T17:40:06.129379] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:06.174786] [DEBUG] [LOCAL ] BORR: Loaded 51047 existing records from primary storage. [2025-10-28T17:40:06.175090] [INFO ] [MAIN ] BORR: Loaded 51047 existing records. [2025-10-28T17:40:06.358139] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:06.358464] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-28T17:40:06.358626] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-28T17:40:06.359302] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-28T17:40:06.360088] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-28T17:40:06.360221] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-28T17:40:06.644116] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T17:40:06.750607] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:06.922110] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:40:07.159397] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-28T17:40:07.243302] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:40:07.959330] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-28T17:40:08.096969] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:40:08.759343] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-28T17:40:08.909171] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:40:09.559444] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-28T17:40:10.359341] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-28T17:40:10.539576] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:40:10.780566] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T17:40:11.159426] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-28T17:40:11.648319] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:40:11.959446] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-28T17:40:12.759382] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-28T17:40:13.117412] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-28T17:40:13.124160] [INFO ] [REMOTE ] BOND: Full fetch complete (46373 records). [2025-10-28T17:40:13.124317] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-28T17:40:13.125053] [FATAL] [VALIDATOR ] BOND: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:40:13.125137] [FATAL] [MAIN ] BOND: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:40:13.125179] [WARN ] [MAIN ] BOND: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:40:13.125217] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-28T17:40:13.125271] [DEBUG] [LOCAL ] BOND: No primary data file found to delete. [2025-10-28T17:40:13.125306] [INFO ] [LOCAL ] BOND: Starting deletion of derivative data. [2025-10-28T17:40:13.125483] [DEBUG] [LOCAL ] BOND: Deleted derivative data file. [2025-10-28T17:40:13.125572] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOND took 26.5s. Estimated remaining: 4h 14m 59s. Rate: 8.0 symbols/min [2025-10-28T17:40:13.327769] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:13.347785] [DEBUG] [LOCAL ] BOW: Loaded 22536 existing records from primary storage. [2025-10-28T17:40:13.348048] [INFO ] [MAIN ] BOW: Loaded 22536 existing records. [2025-10-28T17:40:13.527668] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:13.527864] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-28T17:40:13.527910] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-28T17:40:13.528320] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-28T17:40:13.528375] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-28T17:40:13.559363] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-28T17:40:13.943111] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:13.951515] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T17:40:13.986321] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-28T17:40:14.359409] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-28T17:40:15.159379] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-28T17:40:15.390581] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T17:40:15.959351] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-28T17:40:16.409036] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-28T17:40:16.701606] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T17:40:16.708458] [INFO ] [REMOTE ] BOH: Full fetch complete (45478 records). [2025-10-28T17:40:16.708553] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-28T17:40:16.771997] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-28T17:40:17.091331] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-28T17:40:17.091410] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-28T17:40:17.092022] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-28T17:40:17.092087] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-28T17:40:17.093202] [DEBUG] [LOCAL ] BOH: Trimmed 45478 records to 30444 (keeping 200 days of data) [2025-10-28T17:40:17.276979] [DEBUG] [LOCAL ] BOH: Primary data saved (30444 records). [2025-10-28T17:40:17.277192] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-28T17:40:17.277320] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOH took 30.7s. Estimated remaining: 4h 14m 31s. Rate: 8.0 symbols/min [2025-10-28T17:40:17.446632] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:17.489125] [DEBUG] [LOCAL ] BOX: Loaded 49989 existing records from primary storage. [2025-10-28T17:40:17.489433] [INFO ] [MAIN ] BOX: Loaded 49989 existing records. [2025-10-28T17:40:17.564465] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-28T17:40:17.672461] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:17.672732] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-28T17:40:17.672790] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-28T17:40:17.673601] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-28T17:40:17.673694] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-28T17:40:18.050117] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:18.088315] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-28T17:40:18.191310] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:40:18.299366] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:40:18.359315] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-28T17:40:19.159336] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-28T17:40:19.292830] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T17:40:19.959332] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-28T17:40:20.142878] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T17:40:20.759341] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-28T17:40:21.303693] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:40:21.559320] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-28T17:40:21.627785] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:40:22.359373] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-28T17:40:22.700724] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:40:23.159315] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-28T17:40:23.458581] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:40:23.959346] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-28T17:40:24.452516] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:40:24.759365] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-28T17:40:25.567881] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-28T17:40:25.594274] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T17:40:26.092332] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:40:26.359366] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-28T17:40:26.426138] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T17:40:27.159339] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-28T17:40:27.716486] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:40:27.959372] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-28T17:40:28.265129] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:40:28.759365] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-28T17:40:29.149335] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T17:40:29.559340] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-28T17:40:30.140822] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:40:30.148500] [INFO ] [REMOTE ] BOOT: Full fetch complete (59725 records). [2025-10-28T17:40:30.148718] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-28T17:40:30.367221] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-28T17:40:30.546927] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-28T17:40:30.546998] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-28T17:40:30.547667] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-28T17:40:30.547727] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-28T17:40:30.548817] [DEBUG] [LOCAL ] BOOT: Trimmed 59725 records to 39014 (keeping 200 days of data) [2025-10-28T17:40:30.774057] [DEBUG] [LOCAL ] BOOT: Primary data saved (39014 records). [2025-10-28T17:40:30.774178] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-28T17:40:30.774253] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOOT took 44.2s. Estimated remaining: 4h 15m 1s. Rate: 8.0 symbols/min [2025-10-28T17:40:30.941011] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:30.987358] [DEBUG] [LOCAL ] BP: Loaded 53705 existing records from primary storage. [2025-10-28T17:40:30.987800] [INFO ] [MAIN ] BP: Loaded 53705 existing records. [2025-10-28T17:40:31.168455] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-28T17:40:31.172548] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:31.172929] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-28T17:40:31.173065] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-28T17:40:31.183242] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-28T17:40:31.189421] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-28T17:40:31.283946] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T17:40:31.355058] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T17:40:31.589114] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:31.959347] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-28T17:40:32.661477] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:40:32.759301] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-28T17:40:32.794077] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:40:33.559320] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-28T17:40:33.686591] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:40:34.359341] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-28T17:40:35.037913] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:40:35.159356] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-28T17:40:35.899975] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T17:40:35.959290] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-28T17:40:36.336951] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-28T17:40:36.759385] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-28T17:40:37.559390] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-28T17:40:37.590147] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:40:38.359372] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-28T17:40:38.428919] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T17:40:38.733079] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T17:40:38.738353] [INFO ] [REMOTE ] BOW: Full fetch complete (32163 records). [2025-10-28T17:40:38.738433] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-28T17:40:39.101717] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-28T17:40:39.101807] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-28T17:40:39.102241] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-28T17:40:39.102331] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-28T17:40:39.103076] [DEBUG] [LOCAL ] BOW: Trimmed 32163 records to 22520 (keeping 200 days of data) [2025-10-28T17:40:39.185225] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-28T17:40:39.231538] [DEBUG] [LOCAL ] BOW: Primary data saved (22520 records). [2025-10-28T17:40:39.231634] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-28T17:40:39.231743] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BOW took 26.1s. Estimated remaining: 4h 14m 60s. Rate: 8.0 symbols/min [2025-10-28T17:40:39.397301] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:39.427839] [DEBUG] [LOCAL ] BR: Loaded 34300 existing records from primary storage. [2025-10-28T17:40:39.428081] [INFO ] [MAIN ] BR: Loaded 34300 existing records. [2025-10-28T17:40:39.603911] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:39.604105] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-28T17:40:39.604150] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-28T17:40:39.604810] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-28T17:40:39.604867] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-28T17:40:39.953012] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:39.964443] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-28T17:40:39.981309] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T17:40:39.991480] [INFO ] [REMOTE ] BORR: Full fetch complete (74546 records). [2025-10-28T17:40:39.991596] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-28T17:40:40.373573] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-28T17:40:40.373672] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-28T17:40:40.374429] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-28T17:40:40.374471] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-28T17:40:40.375788] [DEBUG] [LOCAL ] BORR: Trimmed 74546 records to 51050 (keeping 200 days of data) [2025-10-28T17:40:40.655524] [DEBUG] [LOCAL ] BORR: Primary data saved (51050 records). [2025-10-28T17:40:40.655682] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-28T17:40:40.655778] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BORR took 34.7s. Estimated remaining: 4h 14m 14s. Rate: 8.0 symbols/min [2025-10-28T17:40:40.763985] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-28T17:40:40.829468] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:40.876404] [DEBUG] [LOCAL ] BRBR: Loaded 51815 existing records from primary storage. [2025-10-28T17:40:40.876854] [INFO ] [MAIN ] BRBR: Loaded 51815 existing records. [2025-10-28T17:40:41.008478] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:40:41.096129] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:41.096299] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-28T17:40:41.096349] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-28T17:40:41.096786] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-28T17:40:41.096856] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-28T17:40:41.455470] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:41.514189] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:40:41.559297] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-28T17:40:42.252217] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T17:40:42.359351] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-28T17:40:42.855383] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:40:43.159506] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-28T17:40:43.959329] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-28T17:40:44.040303] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-28T17:40:44.221412] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:40:44.759349] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-28T17:40:45.400527] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T17:40:45.559308] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-28T17:40:46.359390] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-28T17:40:46.975394] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:40:47.159312] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-28T17:40:47.251940] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-28T17:40:47.564530] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:40:47.959343] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-28T17:40:48.281933] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T17:40:48.759335] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-28T17:40:49.316106] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:40:49.559346] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-28T17:40:49.880886] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:40:50.359332] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-28T17:40:51.159279] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-28T17:40:51.308765] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T17:40:51.553379] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:40:51.563551] [INFO ] [REMOTE ] BOX: Full fetch complete (72284 records). [2025-10-28T17:40:51.563753] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-28T17:40:51.963216] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-28T17:40:51.962964] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-28T17:40:51.964136] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-28T17:40:51.965178] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-28T17:40:51.965347] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-28T17:40:51.966817] [DEBUG] [LOCAL ] BOX: Trimmed 72284 records to 49960 (keeping 200 days of data) [2025-10-28T17:40:52.253843] [DEBUG] [LOCAL ] BOX: Primary data saved (49960 records). [2025-10-28T17:40:52.253986] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-28T17:40:52.254399] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BOX took 35.0s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-28T17:40:52.424068] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:52.442173] [DEBUG] [LOCAL ] BRC: Loaded 17909 existing records from primary storage. [2025-10-28T17:40:52.442439] [INFO ] [MAIN ] BRC: Loaded 17909 existing records. [2025-10-28T17:40:52.629841] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:52.630202] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-28T17:40:52.630427] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-28T17:40:52.630973] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-28T17:40:52.631034] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-28T17:40:52.765201] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-28T17:40:53.022398] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:53.031139] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-28T17:40:53.559385] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-28T17:40:53.697163] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T17:40:54.309593] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:40:54.359304] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-28T17:40:54.545757] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-28T17:40:55.125052] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:40:55.159341] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-28T17:40:55.959353] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-28T17:40:56.764398] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-28T17:40:56.776601] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T17:40:57.232183] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:40:57.559338] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-28T17:40:57.881263] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:40:58.328196] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T17:40:58.359341] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-28T17:40:59.056218] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:40:59.159297] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-28T17:40:59.959341] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-28T17:40:59.978760] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T17:41:00.759388] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-28T17:41:01.555556] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T17:41:01.566019] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-28T17:41:02.249944] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T17:41:02.328144] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:41:02.359356] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-28T17:41:02.997811] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T17:41:03.159335] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-28T17:41:03.763780] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:41:03.959335] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-28T17:41:04.759334] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-28T17:41:05.071019] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:41:05.074742] [INFO ] [REMOTE ] BRC: Full fetch complete (28215 records). [2025-10-28T17:41:05.074815] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-28T17:41:05.455104] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-28T17:41:05.455181] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-28T17:41:05.455661] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-28T17:41:05.455723] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-28T17:41:05.456363] [DEBUG] [LOCAL ] BRC: Trimmed 28215 records to 17861 (keeping 200 days of data) [2025-10-28T17:41:05.565227] [DEBUG] [LOCAL ] BRC: Primary data saved (17861 records). [2025-10-28T17:41:05.559329] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-28T17:41:05.566215] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-28T17:41:05.566326] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BRC took 13.3s. Estimated remaining: 4h 15m 1s. Rate: 8.0 symbols/min [2025-10-28T17:41:05.744434] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:05.780256] [DEBUG] [LOCAL ] BRCC: Loaded 39939 existing records from primary storage. [2025-10-28T17:41:05.780541] [INFO ] [MAIN ] BRCC: Loaded 39939 existing records. [2025-10-28T17:41:05.958214] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:05.958452] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-28T17:41:05.958508] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-28T17:41:05.959184] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-28T17:41:05.959240] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-28T17:41:06.305569] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:06.359306] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-28T17:41:06.576181] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T17:41:07.118921] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:41:07.159346] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-28T17:41:07.504594] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:41:07.959337] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-28T17:41:08.408566] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:41:08.759399] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-28T17:41:09.423747] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:41:09.559308] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-28T17:41:09.588594] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:41:10.359382] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-28T17:41:10.727757] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:41:11.159313] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-28T17:41:11.835577] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:41:11.959345] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-28T17:41:12.538765] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:41:12.759310] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-28T17:41:13.145036] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:41:13.559390] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-28T17:41:14.326886] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T17:41:14.359324] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-28T17:41:15.159381] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-28T17:41:15.565205] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-28T17:41:15.576083] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-28T17:41:15.576236] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-28T17:41:15.987218] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-28T17:41:15.963265] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-28T17:41:15.988449] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-28T17:41:15.989482] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-28T17:41:15.989703] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-28T17:41:15.991575] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53705 (keeping 200 days of data) [2025-10-28T17:41:16.127887] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:41:16.155509] [INFO ] [REMOTE ] BRBR: Full fetch complete (73361 records). [2025-10-28T17:41:16.155731] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-28T17:41:16.698269] [DEBUG] [LOCAL ] BP: Primary data saved (53705 records). [2025-10-28T17:41:16.709421] [INFO ] [MAIN ] BP: Full history saved. [2025-10-28T17:41:16.720031] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BP took 45.9s. Estimated remaining: 4h 15m 16s. Rate: 8.0 symbols/min [2025-10-28T17:41:16.893814] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-28T17:41:16.909348] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-28T17:41:16.909287] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T17:41:16.929262] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-28T17:41:16.945421] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-28T17:41:16.956048] [INFO ] [REMOTE ] BR: Full fetch complete (49854 records). [2025-10-28T17:41:16.966441] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-28T17:41:17.016083] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:17.064603] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-28T17:41:17.085690] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-28T17:41:17.086033] [DEBUG] [LOCAL ] BRBR: Trimmed 73361 records to 51854 (keeping 200 days of data) [2025-10-28T17:41:17.086169] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-28T17:41:17.122425] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-28T17:41:17.123117] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-28T17:41:17.123489] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-28T17:41:17.378977] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T17:41:17.471833] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-28T17:41:17.941408] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-28T17:41:17.947584] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-28T17:41:17.975531] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-28T17:41:17.984933] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-28T17:41:18.081573] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:18.082013] [DEBUG] [LOCAL ] BR: Trimmed 49854 records to 34189 (keeping 200 days of data) [2025-10-28T17:41:18.082962] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-28T17:41:18.256375] [DEBUG] [LOCAL ] BRBR: Primary data saved (51854 records). [2025-10-28T17:41:18.263822] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-28T17:41:18.268890] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BRBR took 37.6s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-28T17:41:18.310126] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:41:18.342533] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-28T17:41:18.353411] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:41:18.362136] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-28T17:41:18.426224] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:41:18.457068] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-28T17:41:18.499203] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-28T17:41:18.518778] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-28T17:41:18.570132] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:18.572259] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-28T17:41:18.581052] [DEBUG] [LOCAL ] BR: Primary data saved (34189 records). [2025-10-28T17:41:18.581224] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-28T17:41:18.573273] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRCE took 1.8s. Estimated remaining: 4h 13m 40s. Rate: 8.0 symbols/min [2025-10-28T17:41:18.581362] [INFO ] [MAIN ] BR: Full history saved. [2025-10-28T17:41:18.581437] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-28T17:41:18.581856] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BR took 39.4s. Estimated remaining: 4h 12m 47s. Rate: 8.0 symbols/min [2025-10-28T17:41:18.635319] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-28T17:41:18.719446] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-28T17:41:18.764135] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-28T17:41:18.804539] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-28T17:41:18.959695] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:19.059546] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:19.304952] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T17:41:19.330867] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-28T17:41:19.409607] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:19.409984] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-28T17:41:19.426794] [DEBUG] [LOCAL ] BRO: Loaded 52099 existing records from primary storage. [2025-10-28T17:41:19.429172] [INFO ] [MAIN ] BRO: Loaded 52099 existing records. [2025-10-28T17:41:19.428945] [DEBUG] [LOCAL ] BROS: Loaded 53298 existing records from primary storage. [2025-10-28T17:41:19.451629] [INFO ] [MAIN ] BROS: Loaded 53298 existing records. [2025-10-28T17:41:19.600281] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:41:19.638885] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-28T17:41:19.639006] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:41:19.650282] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-28T17:41:19.736992] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:41:19.749187] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-28T17:41:19.778200] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-28T17:41:19.805735] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:19.806128] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-28T17:41:19.805868] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-28T17:41:19.806391] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-28T17:41:19.806232] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-28T17:41:19.806563] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRIE took 1.5s. Estimated remaining: 4h 12m 1s. Rate: 8.1 symbols/min [2025-10-28T17:41:19.800089] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:19.827592] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-28T17:41:19.838027] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-28T17:41:19.838169] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-28T17:41:19.916080] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-28T17:41:19.973036] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-28T17:41:19.988278] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-28T17:41:20.237000] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:20.250628] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-28T17:41:20.285398] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-28T17:41:20.318095] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-28T17:41:20.386768] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-28T17:41:20.442519] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-28T17:41:20.458283] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-28T17:41:20.773107] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:20.794980] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-28T17:41:20.948170] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T17:41:20.967888] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:20.984856] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-28T17:41:21.145867] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:21.559356] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-28T17:41:22.359310] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-28T17:41:22.416974] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:41:22.635965] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:41:22.636260] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-28T17:41:22.636349] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:41:22.636393] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-28T17:41:22.636448] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:41:22.636515] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-28T17:41:22.636601] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-28T17:41:22.636695] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-28T17:41:22.636757] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-28T17:41:22.636804] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRSL took 2.8s. Estimated remaining: 4h 11m 26s. Rate: 8.1 symbols/min [2025-10-28T17:41:22.807758] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:22.808062] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-10-28T17:41:22.808198] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-10-28T17:41:22.808601] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-28T17:41:22.808798] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-28T17:41:22.809382] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-28T17:41:22.809524] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-28T17:41:22.934762] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:41:23.121600] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-28T17:41:23.164503] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-28T17:41:23.233917] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:23.959387] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-28T17:41:24.307588] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:41:24.759362] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-28T17:41:25.112991] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:41:25.559334] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-28T17:41:26.152018] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:41:26.359349] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-28T17:41:26.814959] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:41:27.159386] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-28T17:41:27.443793] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:41:27.959349] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-28T17:41:28.764489] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-28T17:41:28.784221] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T17:41:29.330903] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:41:29.559309] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-28T17:41:29.847105] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:41:30.359489] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-28T17:41:31.019857] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:41:31.028569] [INFO ] [REMOTE ] BRCC: Full fetch complete (57370 records). [2025-10-28T17:41:31.028764] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-28T17:41:31.164529] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-28T17:41:31.449830] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-28T17:41:31.449915] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-28T17:41:31.450626] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-28T17:41:31.450715] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-28T17:41:31.452187] [DEBUG] [LOCAL ] BRCC: Trimmed 57370 records to 39997 (keeping 200 days of data) [2025-10-28T17:41:31.693043] [DEBUG] [LOCAL ] BRCC: Primary data saved (39997 records). [2025-10-28T17:41:31.693288] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-28T17:41:31.693843] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRCC took 26.1s. Estimated remaining: 4h 11m 28s. Rate: 8.1 symbols/min [2025-10-28T17:41:31.875002] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:31.909492] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:41:31.923907] [DEBUG] [LOCAL ] BRT: Loaded 5162 existing records from primary storage. [2025-10-28T17:41:31.924222] [INFO ] [MAIN ] BRT: Loaded 5162 existing records. [2025-10-28T17:41:31.965964] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-28T17:41:32.100230] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:32.100432] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-28T17:41:32.100480] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-28T17:41:32.100807] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-28T17:41:32.100867] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-28T17:41:32.459070] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:32.485005] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T17:41:32.759338] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-28T17:41:33.346481] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:41:33.465283] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T17:41:33.559332] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-28T17:41:34.359307] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-28T17:41:34.483173] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T17:41:34.872511] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:41:35.159337] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-28T17:41:35.959340] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-28T17:41:36.278119] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T17:41:36.759328] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-28T17:41:36.857507] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T17:41:37.559345] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-28T17:41:37.944840] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:41:38.055614] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:41:38.359354] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-28T17:41:38.896318] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T17:41:39.159340] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-28T17:41:39.959349] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-28T17:41:40.553517] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:41:40.766687] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-28T17:41:40.785091] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T17:41:41.265733] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T17:41:41.559345] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-28T17:41:42.359349] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-28T17:41:42.772534] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T17:41:43.139862] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:41:43.159313] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-28T17:41:43.959353] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-28T17:41:44.759324] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-28T17:41:45.015899] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-28T17:41:45.057311] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:41:45.384851] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T17:41:45.559307] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-28T17:41:46.034136] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T17:41:46.359369] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-28T17:41:47.148808] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T17:41:47.150763] [INFO ] [REMOTE ] BRT: Full fetch complete (7115 records). [2025-10-28T17:41:47.150831] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-28T17:41:47.164434] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-28T17:41:47.521792] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-28T17:41:47.521868] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-28T17:41:47.522049] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-28T17:41:47.522089] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-28T17:41:47.522486] [DEBUG] [LOCAL ] BRT: Trimmed 7115 records to 5156 (keeping 200 days of data) [2025-10-28T17:41:47.553758] [DEBUG] [LOCAL ] BRT: Primary data saved (5156 records). [2025-10-28T17:41:47.553891] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-28T17:41:47.553968] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BRT took 15.9s. Estimated remaining: 4h 12m 12s. Rate: 8.0 symbols/min [2025-10-28T17:41:47.723597] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:47.741607] [DEBUG] [LOCAL ] BRW: Loaded 20882 existing records from primary storage. [2025-10-28T17:41:47.741885] [INFO ] [MAIN ] BRW: Loaded 20882 existing records. [2025-10-28T17:41:47.925067] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:47.925323] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-28T17:41:47.925397] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-28T17:41:47.925918] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-28T17:41:47.925993] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-28T17:41:47.965979] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-28T17:41:48.286397] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:48.759307] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-28T17:41:48.840539] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:41:49.519219] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:41:49.559320] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-28T17:41:50.180860] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T17:41:50.359348] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-28T17:41:51.159322] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-28T17:41:51.266220] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:41:51.461451] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T17:41:51.959343] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-28T17:41:52.759362] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-28T17:41:52.877147] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T17:41:53.385575] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T17:41:53.396090] [INFO ] [REMOTE ] BRSP: Full fetch complete (53870 records). [2025-10-28T17:41:53.396250] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-28T17:41:53.564463] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-28T17:41:53.810432] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-28T17:41:53.810504] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-28T17:41:53.811276] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-28T17:41:53.811336] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-28T17:41:53.812348] [DEBUG] [LOCAL ] BRSP: Trimmed 53870 records to 35933 (keeping 200 days of data) [2025-10-28T17:41:54.020481] [DEBUG] [LOCAL ] BRSP: Primary data saved (35933 records). [2025-10-28T17:41:54.020618] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-28T17:41:54.020723] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BRSP took 31.4s. Estimated remaining: 4h 11m 58s. Rate: 8.1 symbols/min [2025-10-28T17:41:54.194032] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:54.208378] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T17:41:54.249622] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:41:54.301628] [DEBUG] [LOCAL ] BRX: Loaded 51796 existing records from primary storage. [2025-10-28T17:41:54.302003] [INFO ] [MAIN ] BRX: Loaded 51796 existing records. [2025-10-28T17:41:54.367822] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-28T17:41:54.494136] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:54.494379] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-28T17:41:54.494429] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-28T17:41:54.495323] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-28T17:41:54.495381] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-28T17:41:54.857567] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:55.159303] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-28T17:41:55.243855] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T17:41:55.959340] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-28T17:41:56.659626] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T17:41:56.680919] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:41:56.759302] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-28T17:41:57.325349] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T17:41:57.559339] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-28T17:41:58.359336] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-28T17:41:59.159305] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-28T17:41:59.174323] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:41:59.346932] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:41:59.357698] [INFO ] [REMOTE ] BRO: Full fetch complete (75161 records). [2025-10-28T17:41:59.357847] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-28T17:41:59.740144] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-28T17:41:59.740234] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-28T17:41:59.741029] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-28T17:41:59.741092] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-28T17:41:59.742499] [DEBUG] [LOCAL ] BRO: Trimmed 75161 records to 52100 (keeping 200 days of data) [2025-10-28T17:41:59.962227] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-28T17:42:00.058388] [DEBUG] [LOCAL ] BRO: Primary data saved (52100 records). [2025-10-28T17:42:00.058623] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-28T17:42:00.058743] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BRO took 41.5s. Estimated remaining: 4h 11m 42s. Rate: 8.1 symbols/min [2025-10-28T17:42:00.227537] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:00.257385] [DEBUG] [LOCAL ] BSAC: Loaded 32455 existing records from primary storage. [2025-10-28T17:42:00.257633] [INFO ] [MAIN ] BSAC: Loaded 32455 existing records. [2025-10-28T17:42:00.435033] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:00.435390] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-28T17:42:00.435463] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-28T17:42:00.435871] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-28T17:42:00.436004] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-28T17:42:00.739718] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:42:00.765945] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-28T17:42:00.826713] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:01.559331] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-28T17:42:01.918127] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-28T17:42:02.197257] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:42:02.359344] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-28T17:42:02.919733] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:42:03.159337] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-28T17:42:03.959324] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-28T17:42:04.093682] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T17:42:04.549728] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:42:04.759425] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-28T17:42:05.294942] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T17:42:05.559312] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-28T17:42:05.625743] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T17:42:06.243459] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T17:42:06.359302] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-28T17:42:07.159315] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-28T17:42:07.218601] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T17:42:07.959336] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-28T17:42:08.759392] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-28T17:42:09.225071] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-28T17:42:09.235740] [INFO ] [REMOTE ] BROS: Full fetch complete (77278 records). [2025-10-28T17:42:09.235859] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-28T17:42:09.562223] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-28T17:42:09.667424] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-28T17:42:09.667590] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-28T17:42:09.668515] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-28T17:42:09.668819] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-28T17:42:09.692366] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:42:09.692622] [DEBUG] [LOCAL ] BROS: Trimmed 77278 records to 53295 (keeping 200 days of data) [2025-10-28T17:42:09.701476] [INFO ] [REMOTE ] BRW: Full fetch complete (30177 records). [2025-10-28T17:42:09.701751] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-28T17:42:09.897752] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-28T17:42:10.352525] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-28T17:42:10.353681] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-28T17:42:10.354527] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-28T17:42:10.362986] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-28T17:42:10.358915] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-28T17:42:10.428371] [DEBUG] [LOCAL ] BRW: Trimmed 30177 records to 20781 (keeping 200 days of data) [2025-10-28T17:42:10.506898] [DEBUG] [LOCAL ] BROS: Primary data saved (53295 records). [2025-10-28T17:42:10.540478] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-28T17:42:10.548742] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BROS took 52.0s. Estimated remaining: 4h 11m 53s. Rate: 8.0 symbols/min [2025-10-28T17:42:10.626378] [DEBUG] [LOCAL ] BRW: Primary data saved (20781 records). [2025-10-28T17:42:10.640370] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-28T17:42:10.652226] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRW took 23.1s. Estimated remaining: 4h 11m 2s. Rate: 8.1 symbols/min [2025-10-28T17:42:10.851174] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:10.862300] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-28T17:42:10.867621] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-28T17:42:10.891386] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-28T17:42:10.891500] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-28T17:42:10.941580] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:10.922412] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-28T17:42:10.941864] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-28T17:42:10.943555] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-28T17:42:10.943781] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-28T17:42:10.943479] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:42:10.944098] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-28T17:42:10.943976] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-28T17:42:10.995505] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-28T17:42:11.021715] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-28T17:42:11.160522] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-28T17:42:11.655937] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:11.739328] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:11.767906] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T17:42:11.959341] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-28T17:42:12.174546] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T17:42:12.759344] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-28T17:42:12.879691] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:42:13.559332] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-28T17:42:13.932844] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T17:42:14.102560] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T17:42:14.359336] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-28T17:42:15.013371] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T17:42:15.159344] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-28T17:42:15.959395] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-28T17:42:16.174583] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:42:16.759337] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-28T17:42:17.294367] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:42:17.559303] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-28T17:42:17.813291] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T17:42:18.115091] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T17:42:18.359327] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-28T17:42:19.159323] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-28T17:42:19.615718] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:42:19.959338] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-28T17:42:20.636222] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:42:20.702967] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T17:42:20.759306] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-28T17:42:21.199771] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T17:42:21.559330] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-28T17:42:22.040930] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:42:22.359320] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-28T17:42:23.159345] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-28T17:42:23.340469] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T17:42:23.959342] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-28T17:42:24.261913] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:42:24.759305] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-28T17:42:24.797532] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T17:42:25.329728] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T17:42:25.559340] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-28T17:42:26.359307] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-28T17:42:26.432638] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:42:26.919710] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T17:42:27.159363] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-28T17:42:27.959354] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-28T17:42:28.266886] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:42:28.685962] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T17:42:28.688589] [INFO ] [REMOTE ] BSL: Full fetch complete (13094 records). [2025-10-28T17:42:28.688682] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-28T17:42:28.764379] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-28T17:42:29.043110] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-28T17:42:29.043182] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-28T17:42:29.043450] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-28T17:42:29.043488] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-28T17:42:29.043955] [DEBUG] [LOCAL ] BSL: Trimmed 13094 records to 7990 (keeping 200 days of data) [2025-10-28T17:42:29.090874] [DEBUG] [LOCAL ] BSL: Primary data saved (7990 records). [2025-10-28T17:42:29.090978] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-28T17:42:29.091043] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BSL took 18.4s. Estimated remaining: 4h 11m 60s. Rate: 8.0 symbols/min [2025-10-28T17:42:29.260118] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:29.260264] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-28T17:42:29.260299] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-28T17:42:29.260410] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-28T17:42:29.260450] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-28T17:42:29.260489] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-28T17:42:29.260521] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-28T17:42:29.564417] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-28T17:42:29.617571] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:29.887295] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T17:42:30.359341] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-28T17:42:30.894338] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:42:31.159336] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-28T17:42:31.242522] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T17:42:31.959335] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-28T17:42:32.161165] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:42:32.759368] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-28T17:42:33.124125] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T17:42:33.130472] [INFO ] [REMOTE ] BSAC: Full fetch complete (45471 records). [2025-10-28T17:42:33.130592] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-28T17:42:33.519275] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-28T17:42:33.519354] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-28T17:42:33.519921] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-28T17:42:33.519980] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-28T17:42:33.521023] [DEBUG] [LOCAL ] BSAC: Trimmed 45471 records to 32305 (keeping 200 days of data) [2025-10-28T17:42:33.567745] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-28T17:42:33.710325] [DEBUG] [LOCAL ] BSAC: Primary data saved (32305 records). [2025-10-28T17:42:33.710470] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-28T17:42:33.710580] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSAC took 33.7s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-10-28T17:42:33.886809] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:33.903706] [DEBUG] [LOCAL ] BST: Loaded 17979 existing records from primary storage. [2025-10-28T17:42:33.903955] [INFO ] [MAIN ] BST: Loaded 17979 existing records. [2025-10-28T17:42:34.068911] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:42:34.116613] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:34.116850] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-28T17:42:34.116897] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-28T17:42:34.117384] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-28T17:42:34.117447] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-28T17:42:34.364630] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-28T17:42:34.478091] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:35.159316] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-28T17:42:35.211326] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T17:42:35.221848] [INFO ] [REMOTE ] BRX: Full fetch complete (75165 records). [2025-10-28T17:42:35.222000] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-28T17:42:35.639236] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T17:42:35.647169] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-28T17:42:35.647633] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-28T17:42:35.648512] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-28T17:42:35.648584] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-28T17:42:35.650296] [DEBUG] [LOCAL ] BRX: Trimmed 75165 records to 51800 (keeping 200 days of data) [2025-10-28T17:42:35.955826] [DEBUG] [LOCAL ] BRX: Primary data saved (51800 records). [2025-10-28T17:42:35.955937] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-28T17:42:35.956050] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BRX took 41.9s. Estimated remaining: 4h 10m 57s. Rate: 8.1 symbols/min [2025-10-28T17:42:35.966949] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-28T17:42:36.128564] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:36.147387] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:42:36.172198] [DEBUG] [LOCAL ] BSTZ: Loaded 24166 existing records from primary storage. [2025-10-28T17:42:36.172422] [INFO ] [MAIN ] BSTZ: Loaded 24166 existing records. [2025-10-28T17:42:36.343812] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:36.344016] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-28T17:42:36.344063] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-28T17:42:36.344231] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-28T17:42:36.344285] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-28T17:42:36.689244] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:36.759298] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-28T17:42:36.858578] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:42:37.559342] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-28T17:42:38.136622] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:42:38.359393] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-28T17:42:38.780532] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:42:39.111558] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:42:39.159313] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-28T17:42:39.959320] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-28T17:42:40.025753] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:42:40.759405] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-28T17:42:40.783710] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T17:42:41.559351] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-28T17:42:41.867159] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:42:42.317824] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:42:42.359299] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-28T17:42:43.127386] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:42:43.159329] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-28T17:42:43.922357] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:42:43.959316] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-28T17:42:44.759335] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-28T17:42:45.275937] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T17:42:45.559333] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-28T17:42:46.068508] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:42:46.359333] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-28T17:42:46.578701] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:42:47.159342] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-28T17:42:47.376365] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:42:47.871274] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:42:47.959321] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-28T17:42:48.706787] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T17:42:48.759307] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-28T17:42:49.559319] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-28T17:42:50.278353] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T17:42:50.359314] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-28T17:42:50.486120] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T17:42:50.493675] [INFO ] [REMOTE ] BSBR: Full fetch complete (50774 records). [2025-10-28T17:42:50.493800] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-28T17:42:50.910518] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-28T17:42:50.910614] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-28T17:42:50.911339] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-28T17:42:50.911392] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-28T17:42:50.912568] [DEBUG] [LOCAL ] BSBR: Trimmed 50774 records to 35513 (keeping 200 days of data) [2025-10-28T17:42:51.113574] [DEBUG] [LOCAL ] BSBR: Primary data saved (35513 records). [2025-10-28T17:42:51.113703] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-28T17:42:51.113784] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSBR took 40.6s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-10-28T17:42:51.168426] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-28T17:42:51.285775] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:51.334202] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-28T17:42:51.334559] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-28T17:42:51.454147] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:42:51.498088] [INFO ] [REMOTE ] BST: Full fetch complete (28061 records). [2025-10-28T17:42:51.516665] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-28T17:42:51.538756] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:51.538908] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-28T17:42:51.533828] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:42:51.539076] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:42:51.539124] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-28T17:42:51.539211] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:42:51.539357] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-28T17:42:51.539470] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-28T17:42:51.539517] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-28T17:42:51.539687] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-10-28T17:42:51.539775] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BST took 17.8s. Estimated remaining: 4h 10m 46s. Rate: 8.1 symbols/min [2025-10-28T17:42:51.550762] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-28T17:42:51.571309] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-28T17:42:51.864366] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:51.964380] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-28T17:42:51.989923] [DEBUG] [LOCAL ] BTA: Loaded 5673 existing records from primary storage. [2025-10-28T17:42:51.995541] [INFO ] [MAIN ] BTA: Loaded 5673 existing records. [2025-10-28T17:42:52.176231] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:52.249900] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:52.250155] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-28T17:42:52.250314] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-28T17:42:52.250559] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-28T17:42:52.250615] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-28T17:42:52.406141] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:42:52.627557] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:52.759303] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-28T17:42:53.038594] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T17:42:53.403528] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:42:53.559377] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-28T17:42:54.359353] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-28T17:42:54.416097] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:42:54.853926] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:42:55.159340] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-28T17:42:55.959344] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-28T17:42:56.367696] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T17:42:56.596373] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T17:42:56.759313] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-28T17:42:57.559350] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-28T17:42:58.128352] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T17:42:58.245608] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T17:42:58.359339] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-28T17:42:59.140769] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:42:59.159294] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-28T17:42:59.959311] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-28T17:42:59.995240] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T17:43:00.759373] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-28T17:43:00.973194] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T17:43:01.202865] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T17:43:01.559390] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-28T17:43:02.359339] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-28T17:43:03.117572] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:43:03.159297] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-28T17:43:03.235545] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:43:03.959316] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-28T17:43:04.472279] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:43:04.641700] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:43:04.647547] [INFO ] [REMOTE ] BSM: Full fetch complete (46466 records). [2025-10-28T17:43:04.647632] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-28T17:43:04.764478] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-28T17:43:05.035882] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-28T17:43:05.035966] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-28T17:43:05.036540] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-28T17:43:05.036583] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-28T17:43:05.037686] [DEBUG] [LOCAL ] BSM: Trimmed 46466 records to 31800 (keeping 200 days of data) [2025-10-28T17:43:05.223330] [DEBUG] [LOCAL ] BSM: Primary data saved (31800 records). [2025-10-28T17:43:05.223459] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-28T17:43:05.223527] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BSM took 36.1s. Estimated remaining: 4h 11m 15s. Rate: 8.0 symbols/min [2025-10-28T17:43:05.394699] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:05.444158] [DEBUG] [LOCAL ] BTE: Loaded 52671 existing records from primary storage. [2025-10-28T17:43:05.444496] [INFO ] [MAIN ] BTE: Loaded 52671 existing records. [2025-10-28T17:43:05.564435] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-28T17:43:05.629322] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:05.629550] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-28T17:43:05.629607] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-28T17:43:05.630536] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-28T17:43:05.630596] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-28T17:43:05.987701] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:06.197320] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:43:06.359308] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-28T17:43:06.395636] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:43:07.159395] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-28T17:43:07.725629] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T17:43:07.964340] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-28T17:43:07.972807] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:43:08.369758] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T17:43:08.759345] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-28T17:43:09.559951] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-28T17:43:09.563941] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T17:43:09.983817] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T17:43:10.359336] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-28T17:43:11.159341] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-28T17:43:11.256603] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T17:43:11.261831] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36172 records). [2025-10-28T17:43:11.261922] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-28T17:43:11.626476] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-28T17:43:11.626547] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-28T17:43:11.627029] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-28T17:43:11.627091] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-28T17:43:11.627897] [DEBUG] [LOCAL ] BSTZ: Trimmed 36172 records to 24145 (keeping 200 days of data) [2025-10-28T17:43:11.772400] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24145 records). [2025-10-28T17:43:11.772519] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-28T17:43:11.772594] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BSTZ took 35.8s. Estimated remaining: 4h 11m 3s. Rate: 8.0 symbols/min [2025-10-28T17:43:11.952988] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:11.959369] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-28T17:43:11.999562] [DEBUG] [LOCAL ] BTI: Loaded 53583 existing records from primary storage. [2025-10-28T17:43:11.999887] [INFO ] [MAIN ] BTI: Loaded 53583 existing records. [2025-10-28T17:43:12.177306] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:12.177533] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-28T17:43:12.177596] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-28T17:43:12.178494] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-28T17:43:12.178552] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-28T17:43:12.569922] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:12.662589] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T17:43:12.677297] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:43:12.680244] [INFO ] [REMOTE ] BTA: Full fetch complete (8972 records). [2025-10-28T17:43:12.680315] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-28T17:43:12.764513] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-28T17:43:13.034985] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-28T17:43:13.035058] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-28T17:43:13.035273] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-28T17:43:13.035309] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-28T17:43:13.035738] [DEBUG] [LOCAL ] BTA: Trimmed 8972 records to 5643 (keeping 200 days of data) [2025-10-28T17:43:13.069155] [DEBUG] [LOCAL ] BTA: Primary data saved (5643 records). [2025-10-28T17:43:13.069290] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-28T17:43:13.069367] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BTA took 21.5s. Estimated remaining: 4h 10m 19s. Rate: 8.1 symbols/min [2025-10-28T17:43:13.240954] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:13.249721] [DEBUG] [LOCAL ] BTO: Loaded 8609 existing records from primary storage. [2025-10-28T17:43:13.249887] [INFO ] [MAIN ] BTO: Loaded 8609 existing records. [2025-10-28T17:43:13.423850] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:13.424042] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-28T17:43:13.424089] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-28T17:43:13.424334] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-28T17:43:13.424391] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-28T17:43:13.569806] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-28T17:43:13.788750] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:14.085444] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:43:14.359341] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-28T17:43:14.876579] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:43:15.028566] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:43:15.159368] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-28T17:43:15.959425] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-28T17:43:16.452119] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:43:16.747345] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T17:43:16.759295] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-28T17:43:17.256579] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T17:43:17.559342] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-28T17:43:18.045059] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T17:43:18.359332] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-28T17:43:19.159335] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-28T17:43:19.694211] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:43:19.959322] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-28T17:43:20.088008] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:43:20.759367] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-28T17:43:21.360040] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T17:43:21.377712] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T17:43:21.559359] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-28T17:43:22.085851] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:43:22.359371] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-28T17:43:23.159341] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-28T17:43:23.594893] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T17:43:23.747225] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:43:23.959340] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-28T17:43:24.452405] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:43:24.759385] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-28T17:43:25.559348] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-28T17:43:26.359361] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-28T17:43:26.830089] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:43:26.916574] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:43:27.159318] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-28T17:43:27.332594] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:43:27.335412] [INFO ] [REMOTE ] BTO: Full fetch complete (13289 records). [2025-10-28T17:43:27.335499] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-28T17:43:27.851145] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-28T17:43:27.851269] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-28T17:43:27.851994] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-28T17:43:27.852076] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-28T17:43:27.853025] [DEBUG] [LOCAL ] BTO: Trimmed 13289 records to 8608 (keeping 200 days of data) [2025-10-28T17:43:27.923915] [DEBUG] [LOCAL ] BTO: Primary data saved (8608 records). [2025-10-28T17:43:27.924092] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-28T17:43:27.924204] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTO took 14.9s. Estimated remaining: 4h 10m 55s. Rate: 8.0 symbols/min [2025-10-28T17:43:27.964598] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-28T17:43:28.199725] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:28.220465] [DEBUG] [LOCAL ] BTT: Loaded 15124 existing records from primary storage. [2025-10-28T17:43:28.220800] [INFO ] [MAIN ] BTT: Loaded 15124 existing records. [2025-10-28T17:43:28.412896] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:28.413162] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-28T17:43:28.413210] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-28T17:43:28.413570] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-28T17:43:28.413628] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-28T17:43:28.761357] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-28T17:43:28.800851] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:28.833371] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T17:43:29.511807] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:43:29.559329] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-28T17:43:30.359355] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-28T17:43:30.709788] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-28T17:43:30.962779] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:43:31.159336] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-28T17:43:31.959306] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-28T17:43:31.993305] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:43:32.349871] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T17:43:32.728289] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T17:43:32.759297] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-28T17:43:33.361397] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:43:33.559340] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-28T17:43:34.202889] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T17:43:34.359352] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-28T17:43:35.159339] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-28T17:43:35.959341] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-28T17:43:36.019761] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:43:36.555250] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T17:43:36.567624] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-28T17:43:36.567820] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-28T17:43:36.760932] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-28T17:43:37.029384] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-28T17:43:37.029492] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-28T17:43:37.030468] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-28T17:43:37.030554] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-28T17:43:37.032526] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-28T17:43:37.162210] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-28T17:43:37.408756] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-28T17:43:37.408906] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-28T17:43:37.409009] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BSX took 46.3s. Estimated remaining: 4h 10m 59s. Rate: 8.0 symbols/min [2025-10-28T17:43:37.571275] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-28T17:43:37.590226] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:37.633868] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:43:37.655354] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-28T17:43:37.655706] [INFO ] [MAIN ] BTU: Loaded 53318 existing records. [2025-10-28T17:43:37.844014] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:37.844246] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-28T17:43:37.844295] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-28T17:43:37.845204] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-28T17:43:37.845262] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-28T17:43:38.217367] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:38.359346] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-28T17:43:39.018328] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:43:39.028778] [INFO ] [REMOTE ] BTE: Full fetch complete (76351 records). [2025-10-28T17:43:39.028895] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-28T17:43:39.165585] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-28T17:43:39.419535] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-28T17:43:39.419609] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-28T17:43:39.420402] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-28T17:43:39.420464] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-28T17:43:39.421861] [DEBUG] [LOCAL ] BTE: Trimmed 76351 records to 52665 (keeping 200 days of data) [2025-10-28T17:43:39.732243] [DEBUG] [LOCAL ] BTE: Primary data saved (52665 records). [2025-10-28T17:43:39.732358] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-28T17:43:39.732872] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BTE took 34.5s. Estimated remaining: 4h 10m 22s. Rate: 8.0 symbols/min [2025-10-28T17:43:39.913518] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:39.914315] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-28T17:43:39.914964] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T17:43:39.915199] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-28T17:43:39.918965] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-28T17:43:39.919228] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-28T17:43:39.919546] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-28T17:43:39.919895] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-28T17:43:39.972718] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-28T17:43:40.236870] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T17:43:40.338156] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:40.759348] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-28T17:43:41.427748] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:43:41.559303] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-28T17:43:41.677899] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T17:43:42.123335] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T17:43:42.359342] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-28T17:43:42.513088] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:43:42.513409] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-28T17:43:42.513493] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:43:42.513539] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-28T17:43:42.513571] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:43:42.513632] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-28T17:43:42.513733] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-28T17:43:42.513774] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-28T17:43:42.513813] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-28T17:43:42.513857] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTX took 2.8s. Estimated remaining: 4h 9m 48s. Rate: 8.1 symbols/min [2025-10-28T17:43:42.707632] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:42.733001] [DEBUG] [LOCAL ] BTZ: Loaded 22002 existing records from primary storage. [2025-10-28T17:43:42.733270] [INFO ] [MAIN ] BTZ: Loaded 22002 existing records. [2025-10-28T17:43:42.909434] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:42.909665] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-28T17:43:42.909723] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-28T17:43:42.910020] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-28T17:43:42.910061] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-28T17:43:43.164556] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-28T17:43:43.262733] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:43.959310] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-28T17:43:44.759301] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-28T17:43:44.857473] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T17:43:44.899855] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T17:43:45.559336] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-28T17:43:46.199967] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:43:46.274098] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T17:43:46.359309] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-28T17:43:47.090594] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T17:43:47.159354] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-28T17:43:47.959359] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-28T17:43:48.676599] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T17:43:48.759342] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-28T17:43:49.484087] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:43:49.562377] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-28T17:43:49.566453] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T17:43:50.359317] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-28T17:43:51.053333] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:43:51.083953] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:43:51.159307] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-28T17:43:51.959401] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-28T17:43:52.518902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:43:52.627225] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T17:43:52.759353] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-28T17:43:53.559347] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-28T17:43:54.311385] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:43:54.345972] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:43:54.359386] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-28T17:43:55.092722] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T17:43:55.159309] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-28T17:43:55.794313] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T17:43:55.797524] [INFO ] [REMOTE ] BTT: Full fetch complete (22460 records). [2025-10-28T17:43:55.797601] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-28T17:43:55.973968] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-28T17:43:56.205613] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-28T17:43:56.205732] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-28T17:43:56.206187] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-28T17:43:56.206248] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-28T17:43:56.206864] [DEBUG] [LOCAL ] BTT: Trimmed 22460 records to 15008 (keeping 200 days of data) [2025-10-28T17:43:56.294038] [DEBUG] [LOCAL ] BTT: Primary data saved (15008 records). [2025-10-28T17:43:56.294161] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-28T17:43:56.294237] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTT took 28.4s. Estimated remaining: 4h 10m 17s. Rate: 8.0 symbols/min [2025-10-28T17:43:56.459490] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:56.506502] [DEBUG] [LOCAL ] BUD: Loaded 52580 existing records from primary storage. [2025-10-28T17:43:56.506887] [INFO ] [MAIN ] BUD: Loaded 52580 existing records. [2025-10-28T17:43:56.687507] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:56.687770] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-28T17:43:56.687832] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-28T17:43:56.688192] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-28T17:43:56.688237] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-28T17:43:56.764456] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-28T17:43:57.046861] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:57.258525] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:43:57.559301] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-28T17:43:57.581189] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T17:43:58.359349] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-28T17:43:58.951303] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:43:59.159355] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-28T17:43:59.813443] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:43:59.959360] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-28T17:44:00.595132] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:44:00.648222] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:44:00.759346] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-28T17:44:01.559352] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-28T17:44:02.359384] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-28T17:44:02.661014] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:44:02.796385] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T17:44:03.159327] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-28T17:44:03.952069] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T17:44:03.962810] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-28T17:44:04.759329] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-28T17:44:04.860324] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T17:44:05.517153] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:44:05.559378] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-28T17:44:06.359389] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-28T17:44:06.480292] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T17:44:06.487614] [INFO ] [REMOTE ] BTZ: Full fetch complete (33208 records). [2025-10-28T17:44:06.487947] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-28T17:44:06.846473] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-28T17:44:06.884545] [INFO ] [REMOTE ] BTI: Full fetch complete (77660 records). [2025-10-28T17:44:06.937541] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-28T17:44:07.028431] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-28T17:44:07.050876] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-28T17:44:07.076874] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-28T17:44:07.082931] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-28T17:44:07.138176] [DEBUG] [LOCAL ] BTZ: Trimmed 33208 records to 21866 (keeping 200 days of data) [2025-10-28T17:44:07.174577] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-28T17:44:07.492008] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-28T17:44:07.492512] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-28T17:44:07.493517] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-28T17:44:07.493873] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-28T17:44:07.506867] [DEBUG] [LOCAL ] BTI: Trimmed 77660 records to 53583 (keeping 200 days of data) [2025-10-28T17:44:07.579636] [DEBUG] [LOCAL ] BTZ: Primary data saved (21866 records). [2025-10-28T17:44:07.588210] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-28T17:44:07.588829] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BTZ took 25.1s. Estimated remaining: 4h 10m 31s. Rate: 8.0 symbols/min [2025-10-28T17:44:07.815789] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:07.963591] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:44:07.953796] [DEBUG] [LOCAL ] BUI: Loaded 11639 existing records from primary storage. [2025-10-28T17:44:07.984117] [INFO ] [MAIN ] BUI: Loaded 11639 existing records. [2025-10-28T17:44:07.983904] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-28T17:44:08.279951] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:08.281508] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-28T17:44:08.281910] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-28T17:44:08.283383] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-28T17:44:08.284030] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-28T17:44:08.375842] [DEBUG] [LOCAL ] BTI: Primary data saved (53583 records). [2025-10-28T17:44:08.394384] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-28T17:44:08.396826] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTI took 56.6s. Estimated remaining: 4h 9m 46s. Rate: 8.1 symbols/min [2025-10-28T17:44:08.733855] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:08.861910] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:08.862408] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-28T17:44:08.900981] [DEBUG] [LOCAL ] BUR: Loaded 45425 existing records from primary storage. [2025-10-28T17:44:08.901321] [INFO ] [MAIN ] BUR: Loaded 45425 existing records. [2025-10-28T17:44:09.111566] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:09.114981] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-28T17:44:09.115281] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-28T17:44:09.117015] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-28T17:44:09.127803] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-28T17:44:09.128457] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-28T17:44:09.528776] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:09.537504] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T17:44:09.559313] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-28T17:44:09.663300] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T17:44:10.126356] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T17:44:10.359344] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-28T17:44:11.159306] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-28T17:44:11.959312] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-28T17:44:12.096450] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:44:12.107164] [INFO ] [REMOTE ] BTU: Full fetch complete (77304 records). [2025-10-28T17:44:12.107297] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-28T17:44:12.528597] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-28T17:44:12.529023] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T17:44:12.529154] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-28T17:44:12.530103] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-28T17:44:12.532706] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-28T17:44:12.534771] [DEBUG] [LOCAL ] BTU: Trimmed 77304 records to 53318 (keeping 200 days of data) [2025-10-28T17:44:12.773002] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T17:44:12.771132] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-28T17:44:12.894034] [DEBUG] [LOCAL ] BTU: Primary data saved (53318 records). [2025-10-28T17:44:12.894156] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-28T17:44:12.894230] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BTU took 35.5s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-28T17:44:13.065230] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:13.108683] [DEBUG] [LOCAL ] BURL: Loaded 45188 existing records from primary storage. [2025-10-28T17:44:13.109007] [INFO ] [MAIN ] BURL: Loaded 45188 existing records. [2025-10-28T17:44:13.291888] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:13.292275] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-28T17:44:13.292396] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-28T17:44:13.292949] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-28T17:44:13.293008] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-28T17:44:13.410171] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T17:44:13.564444] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-28T17:44:13.694692] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:14.359364] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-28T17:44:14.881434] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:44:15.159438] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-28T17:44:15.570612] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:44:15.959354] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-28T17:44:16.454524] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T17:44:16.663791] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T17:44:16.759396] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-28T17:44:17.297549] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T17:44:17.559376] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-28T17:44:18.359416] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-28T17:44:18.872744] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T17:44:19.159350] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-28T17:44:19.358585] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:44:19.959420] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-28T17:44:20.759339] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-28T17:44:20.953474] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:44:20.965147] [INFO ] [REMOTE ] BUD: Full fetch complete (76479 records). [2025-10-28T17:44:20.965271] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-28T17:44:21.402471] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:44:21.457515] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-28T17:44:21.457603] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-28T17:44:21.458506] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-28T17:44:21.458590] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-28T17:44:21.460033] [DEBUG] [LOCAL ] BUD: Trimmed 76479 records to 52576 (keeping 200 days of data) [2025-10-28T17:44:21.565855] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-28T17:44:21.769591] [DEBUG] [LOCAL ] BUD: Primary data saved (52576 records). [2025-10-28T17:44:21.769782] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-28T17:44:21.769869] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUD took 25.5s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-28T17:44:21.892709] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:44:22.359430] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-28T17:44:22.906367] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T17:44:23.159461] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-28T17:44:23.323693] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T17:44:23.898234] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:44:23.959345] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-28T17:44:24.759305] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-28T17:44:25.276997] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:44:25.559411] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-28T17:44:26.162263] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:44:26.251746] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:44:26.359331] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-28T17:44:26.919454] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T17:44:27.159323] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-28T17:44:27.959389] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-28T17:44:28.556145] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T17:44:28.759374] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-28T17:44:29.235132] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:44:29.559395] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-28T17:44:30.016052] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:44:30.155246] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T17:44:30.158170] [INFO ] [REMOTE ] BUI: Full fetch complete (16461 records). [2025-10-28T17:44:30.158277] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-28T17:44:30.366866] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-28T17:44:30.521897] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-28T17:44:30.521977] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-28T17:44:30.522352] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-28T17:44:30.522391] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-28T17:44:30.522950] [DEBUG] [LOCAL ] BUI: Trimmed 16461 records to 11546 (keeping 200 days of data) [2025-10-28T17:44:30.593571] [DEBUG] [LOCAL ] BUI: Primary data saved (11546 records). [2025-10-28T17:44:30.593741] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-28T17:44:30.593828] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BUI took 23.0s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-28T17:44:31.159423] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-28T17:44:31.653873] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:44:31.959429] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-28T17:44:32.294281] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:44:32.759390] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-28T17:44:33.136359] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:44:33.559334] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-28T17:44:34.016829] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:44:34.359388] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-28T17:44:34.922105] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T17:44:34.933542] [INFO ] [REMOTE ] BUR: Full fetch complete (64767 records). [2025-10-28T17:44:34.933762] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-28T17:44:35.364913] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-28T17:44:35.364991] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-28T17:44:35.365759] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-28T17:44:35.365838] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-28T17:44:35.367099] [DEBUG] [LOCAL ] BUR: Trimmed 64767 records to 45403 (keeping 200 days of data) [2025-10-28T17:44:35.659460] [DEBUG] [LOCAL ] BUR: Primary data saved (45403 records). [2025-10-28T17:44:35.660947] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-28T17:44:35.661111] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUR took 27.3s. Estimated remaining: 4h 9m 2s. Rate: 8.1 symbols/min [2025-10-28T17:44:35.660824] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T17:44:35.671204] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-28T17:44:36.833588] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T17:44:36.844012] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-28T17:44:38.297756] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:44:38.306472] [INFO ] [REMOTE ] BURL: Full fetch complete (65623 records). [2025-10-28T17:44:38.306612] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-28T17:44:38.692991] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-28T17:44:38.693069] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-28T17:44:38.693783] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-28T17:44:38.693846] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-28T17:44:38.695072] [DEBUG] [LOCAL ] BURL: Trimmed 65623 records to 45055 (keeping 200 days of data) [2025-10-28T17:44:38.988608] [DEBUG] [LOCAL ] BURL: Primary data saved (45055 records). [2025-10-28T17:44:38.988771] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-28T17:44:38.988858] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BURL took 26.1s. Estimated remaining: 4h 8m 31s. Rate: 8.1 symbols/min [2025-10-28T17:44:39.715801] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.728297] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.734910] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-28T17:44:39.755871] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-28T17:44:39.791544] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-28T17:44:39.792602] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.808288] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-28T17:44:39.808162] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-28T17:44:39.810310] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-28T17:44:39.810581] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-28T17:44:39.811757] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-28T17:44:39.811700] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-28T17:44:39.811907] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-28T17:44:39.824726] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.824968] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-28T17:44:39.825071] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-28T17:44:39.850754] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-28T17:44:39.850410] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-28T17:44:39.866544] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-28T17:44:39.874556] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-28T17:44:39.975805] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-28T17:44:40.009487] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-28T17:44:40.214150] [DEBUG] [LOCAL ] BW: Loaded 40358 existing records from primary storage. [2025-10-28T17:44:40.279055] [INFO ] [MAIN ] BW: Loaded 40358 existing records. [2025-10-28T17:44:41.033385] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.024439] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:41.061622] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-28T17:44:41.061833] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-28T17:44:41.080046] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-28T17:44:41.143236] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-28T17:44:41.156920] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-28T17:44:41.244303] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.300522] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.321584] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-28T17:44:41.334015] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-28T17:44:41.606382] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.606724] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-28T17:44:41.787622] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T17:44:41.790385] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-28T17:44:42.264887] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:44:42.267561] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-28T17:44:42.318585] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:44:42.324533] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-28T17:44:42.542694] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:44:42.551018] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-28T17:44:42.695909] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:44:42.812100] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:44:43.159337] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-28T17:44:43.396482] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T17:44:43.503497] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T17:44:43.959351] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-28T17:44:44.167053] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:44:44.675930] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:44:44.759332] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-28T17:44:45.559336] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-28T17:44:45.848260] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T17:44:46.163824] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T17:44:46.359347] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-28T17:44:47.159399] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-28T17:44:47.637269] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:44:47.959387] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-28T17:44:48.118124] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T17:44:48.759358] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-28T17:44:49.009256] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T17:44:49.559379] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-28T17:44:49.936458] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:44:50.359337] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-28T17:44:50.525224] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:44:51.159328] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-28T17:44:51.514210] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T17:44:51.959315] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-28T17:44:52.449153] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:44:52.759343] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-28T17:44:53.026875] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:44:53.448176] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:44:53.559293] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-28T17:44:54.208491] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T17:44:54.359341] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-28T17:44:55.159371] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-28T17:44:55.400029] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T17:44:55.565486] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T17:44:55.959347] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-28T17:44:56.759358] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-28T17:44:56.926679] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:44:57.341477] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:44:57.559334] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-28T17:44:58.366005] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-28T17:44:58.367771] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:44:58.371146] [INFO ] [REMOTE ] BUXX: Full fetch complete (20776 records). [2025-10-28T17:44:58.371215] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-28T17:44:58.730396] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-28T17:44:58.730465] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-28T17:44:58.730795] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-28T17:44:58.730855] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-28T17:44:58.731407] [DEBUG] [LOCAL ] BUXX: Trimmed 20776 records to 15150 (keeping 200 days of data) [2025-10-28T17:44:58.818496] [DEBUG] [LOCAL ] BUXX: Primary data saved (15150 records). [2025-10-28T17:44:58.818616] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-28T17:44:58.818711] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BUXX took 19.8s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-28T17:44:58.982463] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:59.029009] [DEBUG] [LOCAL ] BWA: Loaded 52031 existing records from primary storage. [2025-10-28T17:44:59.029291] [INFO ] [MAIN ] BWA: Loaded 52031 existing records. [2025-10-28T17:44:59.166628] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-28T17:44:59.206211] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:59.206360] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-28T17:44:59.206420] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-28T17:44:59.206905] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-28T17:44:59.206965] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-28T17:44:59.556929] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:59.700730] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:44:59.959302] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-28T17:45:00.131530] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T17:45:00.759387] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-28T17:45:01.559325] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-28T17:45:01.599257] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:45:02.359348] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-28T17:45:02.609698] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T17:45:02.619543] [INFO ] [REMOTE ] BVN: Full fetch complete (63798 records). [2025-10-28T17:45:02.619683] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-28T17:45:03.002113] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-28T17:45:03.002246] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-28T17:45:03.003002] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-28T17:45:03.003092] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-28T17:45:03.022077] [DEBUG] [LOCAL ] BVN: Trimmed 63798 records to 44573 (keeping 200 days of data) [2025-10-28T17:45:03.023581] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T17:45:03.189548] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-28T17:45:03.285027] [DEBUG] [LOCAL ] BVN: Primary data saved (44573 records). [2025-10-28T17:45:03.285141] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-28T17:45:03.285206] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BVN took 24.3s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-10-28T17:45:03.457679] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:03.480529] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:45:03.497753] [DEBUG] [LOCAL ] BWG: Loaded 12426 existing records from primary storage. [2025-10-28T17:45:03.497962] [INFO ] [MAIN ] BWG: Loaded 12426 existing records. [2025-10-28T17:45:03.674078] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:03.674290] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-28T17:45:03.674341] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-28T17:45:03.674481] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-28T17:45:03.674518] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-28T17:45:03.964500] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-28T17:45:04.025544] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:04.335812] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:45:04.759381] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-28T17:45:05.053481] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:45:05.514340] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:45:05.559296] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-28T17:45:06.359334] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-28T17:45:06.424248] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T17:45:06.970140] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T17:45:07.159445] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-28T17:45:07.775983] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:45:07.959378] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-28T17:45:08.759342] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-28T17:45:09.118529] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:45:09.559341] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-28T17:45:09.824399] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:45:10.359359] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-28T17:45:10.814722] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:45:11.159341] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-28T17:45:11.646564] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:45:11.655801] [INFO ] [REMOTE ] BV: Full fetch complete (55171 records). [2025-10-28T17:45:11.656006] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-28T17:45:11.964488] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-28T17:45:12.094017] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-28T17:45:12.094101] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-28T17:45:12.094840] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-28T17:45:12.094906] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-28T17:45:12.096156] [DEBUG] [LOCAL ] BV: Trimmed 55171 records to 38278 (keeping 200 days of data) [2025-10-28T17:45:12.318730] [DEBUG] [LOCAL ] BV: Primary data saved (38278 records). [2025-10-28T17:45:12.318902] [INFO ] [MAIN ] BV: Full history saved. [2025-10-28T17:45:12.318983] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BV took 33.3s. Estimated remaining: 4h 9m 10s. Rate: 8.0 symbols/min [2025-10-28T17:45:12.495937] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:12.496123] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-28T17:45:12.496184] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-28T17:45:12.496294] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-28T17:45:12.496336] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-28T17:45:12.496378] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-28T17:45:12.496410] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-28T17:45:12.630063] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T17:45:12.762979] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-28T17:45:12.880870] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:12.958840] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-28T17:45:13.373299] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:45:13.559312] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-28T17:45:14.359344] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-28T17:45:14.788580] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T17:45:14.978420] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:45:15.159421] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-28T17:45:15.903356] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:45:15.959357] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-28T17:45:16.759404] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-28T17:45:17.047331] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:45:17.560698] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-28T17:45:18.199076] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T17:45:18.209173] [INFO ] [REMOTE ] BW: Full fetch complete (59298 records). [2025-10-28T17:45:18.209345] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-28T17:45:18.368296] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-28T17:45:18.608799] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-28T17:45:18.608920] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-28T17:45:18.609600] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-28T17:45:18.609670] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-28T17:45:18.610963] [DEBUG] [LOCAL ] BW: Trimmed 59298 records to 40394 (keeping 200 days of data) [2025-10-28T17:45:18.834738] [DEBUG] [LOCAL ] BW: Primary data saved (40394 records). [2025-10-28T17:45:18.835437] [INFO ] [MAIN ] BW: Full history saved. [2025-10-28T17:45:18.835621] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BW took 39.8s. Estimated remaining: 4h 8m 57s. Rate: 8.0 symbols/min [2025-10-28T17:45:18.978522] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:45:19.023826] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:19.036448] [DEBUG] [LOCAL ] BWMX: Loaded 7931 existing records from primary storage. [2025-10-28T17:45:19.036614] [INFO ] [MAIN ] BWMX: Loaded 7931 existing records. [2025-10-28T17:45:19.172663] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-28T17:45:19.246979] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:19.247560] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-28T17:45:19.247824] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-28T17:45:19.250739] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:45:19.261061] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-28T17:45:19.261152] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-28T17:45:19.607243] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:19.959316] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-28T17:45:20.321897] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:45:20.431336] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:45:20.759356] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-28T17:45:21.559349] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-28T17:45:21.824741] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T17:45:21.954469] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T17:45:22.359369] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-28T17:45:23.159316] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-28T17:45:23.280404] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T17:45:23.520337] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T17:45:23.959412] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-28T17:45:24.435817] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:45:24.759424] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-28T17:45:25.463987] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:45:25.559353] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-28T17:45:25.964659] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:45:26.359366] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-28T17:45:27.022001] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T17:45:27.024323] [INFO ] [REMOTE ] BWG: Full fetch complete (17548 records). [2025-10-28T17:45:27.024415] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-28T17:45:27.164571] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-28T17:45:27.389394] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-28T17:45:27.389470] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-28T17:45:27.389847] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-28T17:45:27.389908] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-28T17:45:27.390487] [DEBUG] [LOCAL ] BWG: Trimmed 17548 records to 12358 (keeping 200 days of data) [2025-10-28T17:45:27.463595] [DEBUG] [LOCAL ] BWG: Primary data saved (12358 records). [2025-10-28T17:45:27.463753] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-28T17:45:27.463840] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWG took 24.2s. Estimated remaining: 4h 8m 56s. Rate: 8.0 symbols/min [2025-10-28T17:45:27.643192] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:27.649136] [DEBUG] [LOCAL ] BWNB: Loaded 4033 existing records from primary storage. [2025-10-28T17:45:27.649342] [INFO ] [MAIN ] BWNB: Loaded 4033 existing records. [2025-10-28T17:45:27.828700] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:27.828908] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-28T17:45:27.828983] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-28T17:45:27.829219] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-28T17:45:27.829285] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-28T17:45:27.970673] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-28T17:45:28.207832] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:28.414955] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:45:28.759380] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-28T17:45:29.217226] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:45:29.234923] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T17:45:29.559351] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-28T17:45:30.359351] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-28T17:45:30.704004] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T17:45:31.159391] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-28T17:45:31.226180] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T17:45:31.803810] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:45:31.959310] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-28T17:45:32.313785] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T17:45:32.759335] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-28T17:45:33.559341] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-28T17:45:33.646267] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:45:33.883093] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T17:45:34.359348] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-28T17:45:34.848951] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:45:35.159374] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-28T17:45:35.614422] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T17:45:35.959370] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-28T17:45:36.512715] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T17:45:36.514680] [INFO ] [REMOTE ] BWMX: Full fetch complete (10084 records). [2025-10-28T17:45:36.514755] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-28T17:45:36.764453] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-28T17:45:36.927572] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-28T17:45:36.927676] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-28T17:45:36.927954] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-28T17:45:36.927996] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-28T17:45:36.928501] [DEBUG] [LOCAL ] BWMX: Trimmed 10084 records to 8027 (keeping 200 days of data) [2025-10-28T17:45:36.977188] [DEBUG] [LOCAL ] BWMX: Primary data saved (8027 records). [2025-10-28T17:45:36.977324] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-28T17:45:36.977406] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BWMX took 18.1s. Estimated remaining: 4h 8m 60s. Rate: 8.0 symbols/min [2025-10-28T17:45:37.148958] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:37.155114] [DEBUG] [LOCAL ] BWSN: Loaded 5047 existing records from primary storage. [2025-10-28T17:45:37.155333] [INFO ] [MAIN ] BWSN: Loaded 5047 existing records. [2025-10-28T17:45:37.337511] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:37.337741] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-28T17:45:37.337793] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-28T17:45:37.338005] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-28T17:45:37.338061] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-28T17:45:37.570371] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-28T17:45:37.699486] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:37.914244] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T17:45:38.216403] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:45:38.359393] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-28T17:45:39.159343] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-28T17:45:39.454234] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:45:39.959345] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-28T17:45:40.412306] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:45:40.759339] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-28T17:45:40.822520] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T17:45:41.289813] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:45:41.559357] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-28T17:45:42.359354] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-28T17:45:42.819635] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T17:45:43.011885] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:45:43.159330] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-28T17:45:43.959335] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-28T17:45:44.258631] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:45:44.265354] [INFO ] [REMOTE ] BWLP: Full fetch complete (47761 records). [2025-10-28T17:45:44.265459] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-28T17:45:44.369964] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:45:44.644767] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-28T17:45:44.644861] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-28T17:45:44.645420] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-28T17:45:44.645460] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-28T17:45:44.646422] [DEBUG] [LOCAL ] BWLP: Trimmed 47761 records to 31688 (keeping 200 days of data) [2025-10-28T17:45:44.759898] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-28T17:45:44.832620] [DEBUG] [LOCAL ] BWLP: Primary data saved (31688 records). [2025-10-28T17:45:44.832771] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-28T17:45:44.832844] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWLP took 32.5s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-10-28T17:45:45.004283] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:45.004457] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-10-28T17:45:45.004495] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-10-28T17:45:45.004604] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-28T17:45:45.004669] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-28T17:45:45.004740] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-28T17:45:45.004775] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-28T17:45:45.111536] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T17:45:45.372676] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:45.559334] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-28T17:45:46.359314] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-28T17:45:46.925537] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:45:47.159326] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-28T17:45:47.469782] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:45:47.959364] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-28T17:45:48.245339] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T17:45:48.561279] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:45:48.759338] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-28T17:45:49.193350] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T17:45:49.559341] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-28T17:45:50.359350] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-28T17:45:50.703895] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T17:45:51.078047] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:45:51.159337] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-28T17:45:51.959331] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-28T17:45:52.299636] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:45:52.383073] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T17:45:52.759335] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-28T17:45:53.248144] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T17:45:53.559348] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-28T17:45:54.105015] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:45:54.359348] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-28T17:45:55.159349] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-28T17:45:55.959352] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-28T17:45:56.011948] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T17:45:56.022244] [INFO ] [REMOTE ] BWA: Full fetch complete (75855 records). [2025-10-28T17:45:56.022368] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-28T17:45:56.416565] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-28T17:45:56.416718] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-28T17:45:56.417579] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-28T17:45:56.417667] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-28T17:45:56.419127] [DEBUG] [LOCAL ] BWA: Trimmed 75855 records to 52002 (keeping 200 days of data) [2025-10-28T17:45:56.650931] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:45:56.760469] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-28T17:45:56.769773] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:45:56.767367] [DEBUG] [LOCAL ] BWA: Primary data saved (52002 records). [2025-10-28T17:45:56.779565] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-28T17:45:56.779708] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWA took 58.0s. Estimated remaining: 4h 9m 11s. Rate: 8.0 symbols/min [2025-10-28T17:45:56.959222] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:57.014521] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-28T17:45:57.014881] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-28T17:45:57.106321] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T17:45:57.235274] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:57.235569] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-28T17:45:57.235633] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-28T17:45:57.236163] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-28T17:45:57.236223] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-28T17:45:57.565467] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-28T17:45:57.605761] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:58.359365] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-28T17:45:58.942810] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T17:45:58.944151] [INFO ] [REMOTE ] BWNB: Full fetch complete (5586 records). [2025-10-28T17:45:58.944286] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-28T17:45:59.164515] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-28T17:45:59.358489] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-28T17:45:59.373990] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-28T17:45:59.374489] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-28T17:45:59.375160] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-28T17:45:59.375226] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-28T17:45:59.375838] [DEBUG] [LOCAL ] BWNB: Trimmed 5586 records to 4035 (keeping 200 days of data) [2025-10-28T17:45:59.401361] [DEBUG] [LOCAL ] BWNB: Primary data saved (4035 records). [2025-10-28T17:45:59.401499] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-28T17:45:59.401606] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BWNB took 31.9s. Estimated remaining: 4h 8m 37s. Rate: 8.0 symbols/min [2025-10-28T17:45:59.578701] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:59.578870] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-10-28T17:45:59.578909] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-10-28T17:45:59.579020] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-28T17:45:59.579061] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-28T17:45:59.579102] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-28T17:45:59.579135] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-28T17:45:59.944401] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:59.959319] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-28T17:46:00.520326] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T17:46:00.759414] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-28T17:46:01.157670] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-28T17:46:01.559438] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-28T17:46:02.005774] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T17:46:02.364442] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-28T17:46:02.378300] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T17:46:02.704769] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:46:03.159344] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-28T17:46:03.674140] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T17:46:03.675594] [INFO ] [REMOTE ] BWSN: Full fetch complete (6409 records). [2025-10-28T17:46:03.675685] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-28T17:46:03.676036] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:46:03.676114] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:46:03.676176] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:46:03.676245] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-28T17:46:03.676307] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-28T17:46:03.676342] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-10-28T17:46:03.676526] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-10-28T17:46:03.676609] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWSN took 26.7s. Estimated remaining: 4h 8m 13s. Rate: 8.0 symbols/min [2025-10-28T17:46:03.841902] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:03.884542] [DEBUG] [LOCAL ] BXMT: Loaded 47144 existing records from primary storage. [2025-10-28T17:46:03.884895] [INFO ] [MAIN ] BXMT: Loaded 47144 existing records. [2025-10-28T17:46:03.964465] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-28T17:46:04.063700] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:46:04.063887] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-28T17:46:04.063932] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-28T17:46:04.064291] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-28T17:46:04.064330] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-28T17:46:04.419174] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:04.759333] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-28T17:46:05.559308] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-28T17:46:05.739194] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T17:46:06.002359] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:46:06.161779] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:46:06.359349] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-28T17:46:07.159377] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-28T17:46:07.820997] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:46:07.959336] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-28T17:46:08.316323] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:46:08.682098] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:46:08.759406] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-28T17:46:09.559352] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-28T17:46:09.904486] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:46:10.359671] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-28T17:46:10.417231] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:46:11.159352] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-28T17:46:11.594850] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:46:11.959332] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-28T17:46:12.537382] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:46:12.663476] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:46:12.759420] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-28T17:46:13.339052] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:46:13.559320] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-28T17:46:14.158612] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T17:46:14.359343] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-28T17:46:14.891630] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:46:15.159358] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-28T17:46:15.959353] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-28T17:46:16.436882] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:46:16.759366] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-28T17:46:17.368307] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T17:46:17.509244] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T17:46:17.559389] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-28T17:46:18.359402] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-28T17:46:19.159355] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-28T17:46:19.212380] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T17:46:19.223100] [INFO ] [REMOTE ] BWXT: Full fetch complete (68098 records). [2025-10-28T17:46:19.223300] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-28T17:46:19.679351] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-28T17:46:19.679524] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-28T17:46:19.680843] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-28T17:46:19.680940] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-28T17:46:19.718289] [DEBUG] [LOCAL ] BWXT: Trimmed 68098 records to 47089 (keeping 200 days of data) [2025-10-28T17:46:19.721815] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:46:19.979946] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-28T17:46:20.078348] [DEBUG] [LOCAL ] BWXT: Primary data saved (47089 records). [2025-10-28T17:46:20.078567] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-28T17:46:20.078689] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BWXT took 35.2s. Estimated remaining: 4h 8m 53s. Rate: 8.0 symbols/min [2025-10-28T17:46:20.272388] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:20.295049] [DEBUG] [LOCAL ] BXMX: Loaded 18764 existing records from primary storage. [2025-10-28T17:46:20.295580] [INFO ] [MAIN ] BXMX: Loaded 18764 existing records. [2025-10-28T17:46:20.495493] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:46:20.495844] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-28T17:46:20.495910] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-28T17:46:20.496339] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-28T17:46:20.496405] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-28T17:46:20.762559] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-28T17:46:20.855902] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T17:46:20.880306] [INFO ] [REMOTE ] BXC: Full fetch complete (18304 records). [2025-10-28T17:46:20.911572] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-28T17:46:20.958198] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:21.331455] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-28T17:46:21.331627] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-28T17:46:21.332047] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-28T17:46:21.332123] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-28T17:46:21.358783] [DEBUG] [LOCAL ] BXC: Trimmed 18304 records to 13065 (keeping 200 days of data) [2025-10-28T17:46:21.363824] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-28T17:46:21.451805] [DEBUG] [LOCAL ] BXC: Primary data saved (13065 records). [2025-10-28T17:46:21.451938] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-28T17:46:21.452008] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BXC took 22.1s. Estimated remaining: 4h 8m 13s. Rate: 8.0 symbols/min [2025-10-28T17:46:21.564465] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-28T17:46:21.618270] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:21.618748] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-28T17:46:21.618800] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-28T17:46:21.618921] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-28T17:46:21.618984] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-28T17:46:21.619043] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-28T17:46:21.619089] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-28T17:46:21.970423] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:22.279226] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T17:46:22.312140] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:46:22.359293] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-28T17:46:23.159342] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-28T17:46:23.640480] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:46:23.959323] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-28T17:46:24.644109] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T17:46:24.759381] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-28T17:46:25.337535] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:46:25.559372] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-28T17:46:26.359305] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-28T17:46:26.446739] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T17:46:26.463523] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:46:27.159388] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-28T17:46:27.772580] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:46:27.959344] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-28T17:46:28.708214] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T17:46:28.761537] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-28T17:46:28.770224] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:46:29.559382] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-28T17:46:30.359375] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-28T17:46:30.542588] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:46:30.552682] [INFO ] [REMOTE ] BXMT: Full fetch complete (69465 records). [2025-10-28T17:46:30.552822] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-28T17:46:30.553591] [FATAL] [VALIDATOR ] BXMT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:46:30.553711] [FATAL] [MAIN ] BXMT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:46:30.553757] [WARN ] [MAIN ] BXMT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:46:30.553798] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-28T17:46:30.553855] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-28T17:46:30.553890] [INFO ] [LOCAL ] BXMT: Starting deletion of derivative data. [2025-10-28T17:46:30.554077] [DEBUG] [LOCAL ] BXMT: Deleted derivative data file. [2025-10-28T17:46:30.554175] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BXMT took 26.9s. Estimated remaining: 4h 8m 14s. Rate: 8.0 symbols/min [2025-10-28T17:46:30.732828] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:30.733072] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-10-28T17:46:30.733142] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-10-28T17:46:30.733527] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-28T17:46:30.733858] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-28T17:46:30.733946] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-28T17:46:30.733994] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-28T17:46:31.104900] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:31.136225] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:46:31.159319] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-28T17:46:31.791047] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T17:46:31.959396] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-28T17:46:32.516270] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:46:32.759376] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-28T17:46:32.836909] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:46:33.559347] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-28T17:46:33.978503] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T17:46:34.359341] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-28T17:46:34.888820] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:46:35.159369] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-28T17:46:35.742942] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:46:35.959432] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-28T17:46:36.417715] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:46:36.759360] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-28T17:46:37.328700] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:46:37.559373] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-28T17:46:37.796497] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:46:38.359411] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-28T17:46:38.776026] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:46:39.159317] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-28T17:46:39.959348] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-28T17:46:40.134992] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T17:46:40.515375] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:46:40.635193] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:46:40.759378] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-28T17:46:41.559340] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-28T17:46:41.872870] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:46:42.359352] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-28T17:46:42.434492] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:46:43.159353] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-28T17:46:43.470353] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T17:46:43.873932] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T17:46:43.959364] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-28T17:46:44.533387] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:46:44.759362] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-28T17:46:45.559354] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-28T17:46:46.359334] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-28T17:46:46.560733] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T17:46:46.561489] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:46:46.579247] [INFO ] [REMOTE ] BXMX: Full fetch complete (28465 records). [2025-10-28T17:46:46.579665] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-28T17:46:46.606291] [INFO ] [REMOTE ] BX: Full fetch complete (77613 records). [2025-10-28T17:46:46.648581] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-28T17:46:47.169702] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-28T17:46:47.432976] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-28T17:46:47.437476] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-28T17:46:47.453244] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-28T17:46:47.457127] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-28T17:46:47.457478] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-28T17:46:47.457949] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-28T17:46:47.458797] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-28T17:46:47.458881] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-28T17:46:47.459383] [DEBUG] [LOCAL ] BXMX: Trimmed 28465 records to 18686 (keeping 200 days of data) [2025-10-28T17:46:47.506425] [DEBUG] [LOCAL ] BX: Trimmed 77613 records to 53483 (keeping 200 days of data) [2025-10-28T17:46:47.663468] [DEBUG] [LOCAL ] BXMX: Primary data saved (18686 records). [2025-10-28T17:46:47.664296] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-28T17:46:47.676332] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXMX took 27.6s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-28T17:46:47.975604] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:47.979798] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-28T17:46:47.982713] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-28T17:46:47.987387] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-28T17:46:47.987605] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-28T17:46:48.016789] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-28T17:46:48.017246] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-28T17:46:48.147553] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T17:46:48.242806] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-28T17:46:48.242436] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-28T17:46:48.247170] [INFO ] [MAIN ] BX: Full history saved. [2025-10-28T17:46:48.248235] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BX took 51.5s. Estimated remaining: 4h 8m 14s. Rate: 8.0 symbols/min [2025-10-28T17:46:48.523787] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:48.576667] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-28T17:46:48.588407] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-28T17:46:48.604786] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-28T17:46:48.615543] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-28T17:46:48.615879] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-28T17:46:48.626880] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-28T17:46:48.759505] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:48.787849] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-28T17:46:49.011321] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-28T17:46:49.097454] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:49.559332] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-28T17:46:49.649521] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T17:46:49.878846] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-28T17:46:50.359332] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-28T17:46:50.907412] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:46:50.927197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T17:46:51.159334] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-28T17:46:51.959364] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-28T17:46:52.515239] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:46:52.759316] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-28T17:46:52.852197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:46:53.559332] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-28T17:46:54.349158] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:46:54.359238] [INFO ] [REMOTE ] BXSL: Full fetch complete (69812 records). [2025-10-28T17:46:54.359315] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-28T17:46:54.360194] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-28T17:46:54.361149] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:46:54.361326] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:46:54.361407] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:46:54.361491] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-28T17:46:54.361566] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-28T17:46:54.361616] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-10-28T17:46:54.361718] [DEBUG] [LOCAL ] BXSL: No derivative data file found to delete. [2025-10-28T17:46:54.361807] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXSL took 23.8s. Estimated remaining: 4h 7m 59s. Rate: 8.0 symbols/min [2025-10-28T17:46:54.530488] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:54.542425] [DEBUG] [LOCAL ] BYM: Loaded 11121 existing records from primary storage. [2025-10-28T17:46:54.542610] [INFO ] [MAIN ] BYM: Loaded 11121 existing records. [2025-10-28T17:46:54.717077] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:46:54.717377] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-28T17:46:54.717466] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-28T17:46:54.717800] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-28T17:46:54.717860] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-28T17:46:55.083450] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:55.107072] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T17:46:55.160570] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-28T17:46:55.164392] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T17:46:55.830663] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:46:55.959361] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-28T17:46:56.759408] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-28T17:46:57.488853] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T17:46:57.559324] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-28T17:46:57.925094] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:46:58.359365] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-28T17:46:58.949219] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:46:59.159327] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-28T17:46:59.269010] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T17:46:59.280331] [INFO ] [REMOTE ] BXP: Full fetch complete (72213 records). [2025-10-28T17:46:59.280493] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-28T17:46:59.721062] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-28T17:46:59.721159] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-28T17:46:59.722014] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-28T17:46:59.722082] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-28T17:46:59.723544] [DEBUG] [LOCAL ] BXP: Trimmed 72213 records to 49707 (keeping 200 days of data) [2025-10-28T17:46:59.959443] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-28T17:47:00.052349] [DEBUG] [LOCAL ] BXP: Primary data saved (49707 records). [2025-10-28T17:47:00.052478] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-28T17:47:00.052563] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BXP took 38.6s. Estimated remaining: 4h 7m 42s. Rate: 8.0 symbols/min [2025-10-28T17:47:00.235904] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:00.265235] [DEBUG] [LOCAL ] BZH: Loaded 31712 existing records from primary storage. [2025-10-28T17:47:00.265493] [INFO ] [MAIN ] BZH: Loaded 31712 existing records. [2025-10-28T17:47:00.442968] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:00.443278] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-28T17:47:00.443413] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-28T17:47:00.443925] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-28T17:47:00.443993] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-28T17:47:00.581118] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T17:47:00.582243] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T17:47:00.764479] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-28T17:47:00.846681] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:01.559381] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-28T17:47:01.848413] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T17:47:02.197230] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T17:47:02.359398] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-28T17:47:03.091534] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:47:03.159415] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-28T17:47:03.959318] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-28T17:47:04.243524] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T17:47:04.528296] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T17:47:04.759437] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-28T17:47:05.559406] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-28T17:47:05.796779] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:47:06.155249] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:47:06.359334] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-28T17:47:06.930617] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T17:47:07.159396] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-28T17:47:07.959328] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-28T17:47:08.325609] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:47:08.672285] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T17:47:08.759343] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-28T17:47:09.242191] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:47:09.559395] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-28T17:47:10.329471] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T17:47:10.359347] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-28T17:47:11.159394] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-28T17:47:11.399030] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:47:11.403334] [INFO ] [REMOTE ] BY: Full fetch complete (29740 records). [2025-10-28T17:47:11.403406] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-28T17:47:11.779360] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-28T17:47:11.779433] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-28T17:47:11.779877] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-28T17:47:11.779936] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-28T17:47:11.780623] [DEBUG] [LOCAL ] BY: Trimmed 29740 records to 21442 (keeping 200 days of data) [2025-10-28T17:47:11.905566] [DEBUG] [LOCAL ] BY: Primary data saved (21442 records). [2025-10-28T17:47:11.905708] [INFO ] [MAIN ] BY: Full history saved. [2025-10-28T17:47:11.905786] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BY took 24.2s. Estimated remaining: 4h 7m 58s. Rate: 8.0 symbols/min [2025-10-28T17:47:11.966945] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-28T17:47:12.077301] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:12.107343] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T17:47:12.150595] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-28T17:47:12.150908] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-28T17:47:12.327830] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:12.328038] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-28T17:47:12.328087] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-28T17:47:12.328752] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-28T17:47:12.328808] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-28T17:47:12.686499] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:12.746497] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T17:47:12.759293] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-28T17:47:13.372552] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T17:47:13.375315] [INFO ] [REMOTE ] BYM: Full fetch complete (17305 records). [2025-10-28T17:47:13.375385] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-28T17:47:13.564450] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-28T17:47:13.752509] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-28T17:47:13.752583] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-28T17:47:13.753013] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-28T17:47:13.753073] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-28T17:47:13.753672] [DEBUG] [LOCAL ] BYM: Trimmed 17305 records to 11239 (keeping 200 days of data) [2025-10-28T17:47:13.820477] [DEBUG] [LOCAL ] BYM: Primary data saved (11239 records). [2025-10-28T17:47:13.820603] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-28T17:47:13.820717] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BYM took 19.5s. Estimated remaining: 4h 7m 21s. Rate: 8.0 symbols/min [2025-10-28T17:47:13.993547] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:13.993747] [DEBUG] [LOCAL ] CAAP: No existing data file found in primary storage. [2025-10-28T17:47:13.993791] [WARN ] [MAIN ] CAAP: No existing data found, performing full refresh instead. [2025-10-28T17:47:13.993896] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-28T17:47:13.993936] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-28T17:47:13.993977] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-28T17:47:13.994007] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-28T17:47:14.348022] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:14.359300] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-28T17:47:14.595073] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:47:15.101844] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T17:47:15.159314] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-28T17:47:15.959370] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-28T17:47:16.604855] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T17:47:16.621830] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T17:47:16.759336] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-28T17:47:17.561533] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-28T17:47:17.566563] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:47:18.359398] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-28T17:47:19.164494] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-28T17:47:19.182537] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:47:19.654316] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:47:19.959350] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-28T17:47:20.065638] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T17:47:20.677896] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:47:20.759342] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-28T17:47:21.559348] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-28T17:47:22.079088] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:47:22.359365] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-28T17:47:22.522797] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:47:23.101403] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T17:47:23.159331] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-28T17:47:23.862357] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:47:23.959382] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-28T17:47:24.759347] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-28T17:47:25.423146] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T17:47:25.559372] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-28T17:47:25.625031] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T17:47:26.359370] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-28T17:47:26.756001] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:47:27.159339] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-28T17:47:27.959335] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-28T17:47:28.094146] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T17:47:28.378929] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T17:47:28.759352] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-28T17:47:28.880016] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T17:47:29.559380] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-28T17:47:30.359325] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-28T17:47:30.415180] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T17:47:30.704389] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:47:31.159371] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-28T17:47:31.194834] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T17:47:31.201150] [INFO ] [REMOTE ] BZH: Full fetch complete (47054 records). [2025-10-28T17:47:31.201275] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-28T17:47:31.598943] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-28T17:47:31.599020] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-28T17:47:31.599581] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-28T17:47:31.599620] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-28T17:47:31.600526] [DEBUG] [LOCAL ] BZH: Trimmed 47054 records to 31574 (keeping 200 days of data) [2025-10-28T17:47:31.782461] [DEBUG] [LOCAL ] BZH: Primary data saved (31574 records). [2025-10-28T17:47:31.782734] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-28T17:47:31.782845] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. BZH took 31.7s. Estimated remaining: 4h 8m 9s. Rate: 8.0 symbols/min [2025-10-28T17:47:31.885094] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:47:31.969412] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-28T17:47:31.974053] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:31.993430] [DEBUG] [LOCAL ] CABO: Loaded 16486 existing records from primary storage. [2025-10-28T17:47:31.993675] [INFO ] [MAIN ] CABO: Loaded 16486 existing records. [2025-10-28T17:47:32.167622] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:32.167835] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-28T17:47:32.167881] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-28T17:47:32.168181] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-28T17:47:32.168237] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-28T17:47:32.514508] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:32.759338] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-28T17:47:32.921757] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T17:47:33.287397] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T17:47:33.559318] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-28T17:47:34.208631] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:47:34.359351] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-28T17:47:34.972914] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:47:35.159345] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-28T17:47:35.959361] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-28T17:47:36.764012] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-28T17:47:36.777468] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T17:47:37.092399] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T17:47:37.559332] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-28T17:47:37.731139] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:47:38.359346] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-28T17:47:39.129116] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T17:47:39.138408] [INFO ] [REMOTE ] BYD: Full fetch complete (65623 records). [2025-10-28T17:47:39.138527] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-28T17:47:39.170729] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-28T17:47:39.524272] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-28T17:47:39.524362] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-28T17:47:39.525209] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-28T17:47:39.525274] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-28T17:47:39.526619] [DEBUG] [LOCAL ] BYD: Trimmed 65623 records to 44940 (keeping 200 days of data) [2025-10-28T17:47:39.808438] [DEBUG] [LOCAL ] BYD: Primary data saved (44940 records). [2025-10-28T17:47:39.808742] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-28T17:47:39.808903] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. BYD took 51.6s. Estimated remaining: 4h 8m 4s. Rate: 8.0 symbols/min [2025-10-28T17:47:39.986160] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:39.962386] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-28T17:47:40.020292] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:47:40.044872] [DEBUG] [LOCAL ] CACI: Loaded 22047 existing records from primary storage. [2025-10-28T17:47:40.045102] [INFO ] [MAIN ] CACI: Loaded 22047 existing records. [2025-10-28T17:47:40.170061] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:47:40.220562] [INFO ] [REMOTE ] CAAP: Full fetch complete (28126 records). [2025-10-28T17:47:40.236428] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-28T17:47:40.241006] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:40.272495] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-28T17:47:40.283963] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-28T17:47:40.315983] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-28T17:47:40.332157] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-28T17:47:40.776870] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-28T17:47:40.977940] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:40.973770] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-28T17:47:40.978418] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-28T17:47:40.978924] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-28T17:47:40.979013] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-28T17:47:40.988201] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:47:40.991217] [DEBUG] [LOCAL ] CAAP: Trimmed 28126 records to 19752 (keeping 200 days of data) [2025-10-28T17:47:41.100542] [DEBUG] [LOCAL ] CAAP: Primary data saved (19752 records). [2025-10-28T17:47:41.100692] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-28T17:47:41.100774] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. CAAP took 27.3s. Estimated remaining: 4h 7m 24s. Rate: 8.0 symbols/min [2025-10-28T17:47:41.268737] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:41.311319] [DEBUG] [LOCAL ] CADE: Loaded 49705 existing records from primary storage. [2025-10-28T17:47:41.311596] [INFO ] [MAIN ] CADE: Loaded 49705 existing records. [2025-10-28T17:47:41.485165] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:41.485358] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-28T17:47:41.485403] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-28T17:47:41.485967] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-28T17:47:41.486026] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-28T17:47:41.564504] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-28T17:47:41.837547] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:42.316246] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T17:47:42.359309] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-28T17:47:42.801099] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:47:43.159344] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-28T17:47:43.425784] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:47:43.959361] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-28T17:47:44.759336] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-28T17:47:44.973168] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:47:45.044871] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T17:47:45.559319] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-28T17:47:45.660376] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:47:46.359346] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-28T17:47:47.159302] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-28T17:47:47.226796] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T17:47:47.627486] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:47:47.959328] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-28T17:47:48.107056] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T17:47:48.759363] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-28T17:47:49.518197] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:47:49.559348] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-28T17:47:49.775228] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T17:47:49.786261] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-28T17:47:49.786435] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-28T17:47:50.180523] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-28T17:47:50.180590] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-28T17:47:50.181402] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-28T17:47:50.181469] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-28T17:47:50.182995] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 53741 (keeping 200 days of data) [2025-10-28T17:47:50.360221] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-28T17:47:50.422719] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T17:47:50.533800] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-28T17:47:50.533942] [INFO ] [MAIN ] C: Full history saved. [2025-10-28T17:47:50.534551] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. C took 38.6s. Estimated remaining: 4h 7m 27s. Rate: 8.0 symbols/min [2025-10-28T17:47:50.719595] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:50.755752] [DEBUG] [LOCAL ] CAE: Loaded 38731 existing records from primary storage. [2025-10-28T17:47:50.756019] [INFO ] [MAIN ] CAE: Loaded 38731 existing records. [2025-10-28T17:47:50.930082] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:50.930302] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-28T17:47:50.930361] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-28T17:47:50.930704] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-28T17:47:50.930761] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-28T17:47:51.167176] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-28T17:47:51.282918] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:51.482159] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:47:51.816872] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:47:51.959337] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-28T17:47:52.759352] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-28T17:47:53.029318] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T17:47:53.559351] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-28T17:47:53.792982] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T17:47:54.065273] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T17:47:54.359337] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-28T17:47:55.028291] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:47:55.032106] [INFO ] [REMOTE ] CABO: Full fetch complete (23141 records). [2025-10-28T17:47:55.032275] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-28T17:47:55.164746] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-28T17:47:55.587138] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-28T17:47:55.587240] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-28T17:47:55.587718] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-28T17:47:55.587783] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-28T17:47:55.588618] [DEBUG] [LOCAL ] CABO: Trimmed 23141 records to 16475 (keeping 200 days of data) [2025-10-28T17:47:55.692189] [DEBUG] [LOCAL ] CABO: Primary data saved (16475 records). [2025-10-28T17:47:55.692352] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-28T17:47:55.692487] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CABO took 23.9s. Estimated remaining: 4h 7m 7s. Rate: 8.0 symbols/min [2025-10-28T17:47:55.897753] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:55.904037] [DEBUG] [LOCAL ] CAF: Loaded 3393 existing records from primary storage. [2025-10-28T17:47:55.904256] [INFO ] [MAIN ] CAF: Loaded 3393 existing records. [2025-10-28T17:47:55.971242] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-28T17:47:56.116034] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:56.116261] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-28T17:47:56.116311] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-28T17:47:56.116449] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-28T17:47:56.116490] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-28T17:47:56.500328] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:56.521028] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:47:56.759337] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-28T17:47:57.213358] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T17:47:57.463867] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:47:57.559393] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-28T17:47:58.359344] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-28T17:47:58.783038] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T17:47:59.083428] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T17:47:59.159328] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-28T17:47:59.959353] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-28T17:48:00.759332] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-28T17:48:01.161560] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:48:01.559362] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-28T17:48:02.080230] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T17:48:02.359355] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-28T17:48:03.159390] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-28T17:48:03.397468] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (4.24 seconds). [2025-10-28T17:48:03.487789] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T17:48:03.565041] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T17:48:03.890177] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T17:48:03.959313] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-28T17:48:04.759341] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-28T17:48:04.796729] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T17:48:05.559353] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-28T17:48:06.252428] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T17:48:06.359319] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-28T17:48:06.419994] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:48:06.793157] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:48:07.159369] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-28T17:48:07.959346] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-28T17:48:08.664542] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:48:08.675734] [INFO ] [REMOTE ] CADE: Full fetch complete (70836 records). [2025-10-28T17:48:08.675854] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-28T17:48:08.764409] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-28T17:48:09.094638] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-28T17:48:09.094765] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-28T17:48:09.095510] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-28T17:48:09.095584] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-28T17:48:09.097273] [DEBUG] [LOCAL ] CADE: Trimmed 70836 records to 49726 (keeping 200 days of data) [2025-10-28T17:48:09.120107] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:48:09.421898] [DEBUG] [LOCAL ] CADE: Primary data saved (49726 records). [2025-10-28T17:48:09.422024] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-28T17:48:09.422099] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CADE took 28.3s. Estimated remaining: 4h 7m 32s. Rate: 8.0 symbols/min [2025-10-28T17:48:09.564423] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-28T17:48:09.591613] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:09.591796] [DEBUG] [LOCAL ] CAG: No existing data file found in primary storage. [2025-10-28T17:48:09.591841] [WARN ] [MAIN ] CAG: No existing data found, performing full refresh instead. [2025-10-28T17:48:09.591971] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-28T17:48:09.592028] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-28T17:48:09.592071] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-28T17:48:09.592103] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-28T17:48:09.940334] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T17:48:09.964803] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:09.965875] [INFO ] [REMOTE ] CACI: Full fetch complete (38429 records). [2025-10-28T17:48:09.966037] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-28T17:48:10.071487] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T17:48:10.340752] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-28T17:48:10.340832] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-28T17:48:10.341363] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-28T17:48:10.341486] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-28T17:48:10.342509] [DEBUG] [LOCAL ] CACI: Trimmed 38429 records to 21921 (keeping 200 days of data) [2025-10-28T17:48:10.391828] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-28T17:48:10.473826] [DEBUG] [LOCAL ] CACI: Primary data saved (21921 records). [2025-10-28T17:48:10.473947] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-28T17:48:10.474040] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CACI took 30.7s. Estimated remaining: 4h 6m 51s. Rate: 8.0 symbols/min [2025-10-28T17:48:10.640553] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:10.692583] [DEBUG] [LOCAL ] CAH: Loaded 51367 existing records from primary storage. [2025-10-28T17:48:10.692934] [INFO ] [MAIN ] CAH: Loaded 51367 existing records. [2025-10-28T17:48:10.852422] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T17:48:10.878829] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:48:10.881119] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-28T17:48:10.881174] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-28T17:48:10.881789] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-28T17:48:10.881846] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-28T17:48:11.162193] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-28T17:48:11.240436] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:11.959318] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-28T17:48:12.514659] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:48:12.759291] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-28T17:48:13.250295] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T17:48:13.559345] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-28T17:48:14.083301] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T17:48:14.359322] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-28T17:48:14.982524] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T17:48:15.077478] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T17:48:15.159346] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-28T17:48:15.959328] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-28T17:48:16.473671] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T17:48:16.759433] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-28T17:48:17.115774] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T17:48:17.559352] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-28T17:48:17.909114] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T17:48:18.270241] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:48:18.359327] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-28T17:48:19.159334] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-28T17:48:19.677787] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T17:48:19.959347] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-28T17:48:20.531293] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:48:20.759347] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-28T17:48:21.308369] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T17:48:21.559384] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-28T17:48:22.023810] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:48:22.359367] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-28T17:48:23.167277] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-28T17:48:23.172578] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:48:23.437573] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-28T17:48:23.764413] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:48:23.959382] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-28T17:48:24.759367] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-28T17:48:25.184941] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T17:48:25.559354] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-28T17:48:26.172468] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T17:48:26.359355] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-28T17:48:26.775436] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:48:27.048494] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T17:48:27.159300] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-28T17:48:27.503460] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:48:27.959353] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-28T17:48:28.673726] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T17:48:28.675099] [INFO ] [REMOTE ] CAF: Full fetch complete (5570 records). [2025-10-28T17:48:28.675169] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-28T17:48:28.764475] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-28T17:48:29.036670] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-28T17:48:29.036770] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-28T17:48:29.036941] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-28T17:48:29.036980] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-28T17:48:29.037347] [DEBUG] [LOCAL ] CAF: Trimmed 5570 records to 3372 (keeping 200 days of data) [2025-10-28T17:48:29.056451] [DEBUG] [LOCAL ] CAF: Primary data saved (3372 records). [2025-10-28T17:48:29.056522] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-28T17:48:29.056593] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CAF took 33.4s. Estimated remaining: 4h 7m 41s. Rate: 8.0 symbols/min [2025-10-28T17:48:29.224427] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:29.264107] [DEBUG] [LOCAL ] CAL: Loaded 42457 existing records from primary storage. [2025-10-28T17:48:29.264373] [INFO ] [MAIN ] CAL: Loaded 42457 existing records. [2025-10-28T17:48:29.438135] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:48:29.438344] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-28T17:48:29.438392] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-28T17:48:29.438849] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-28T17:48:29.438905] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-28T17:48:29.564408] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-28T17:48:29.794058] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:29.899537] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:48:30.359340] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-28T17:48:30.855148] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:48:31.159406] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-28T17:48:31.959315] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-28T17:48:32.020134] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T17:48:32.652936] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T17:48:32.759441] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-28T17:48:33.559308] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-28T17:48:33.689302] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T17:48:33.821965] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:48:34.359366] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-28T17:48:35.107851] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T17:48:35.159368] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-28T17:48:35.927211] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T17:48:35.959341] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-28T17:48:36.638987] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:48:36.647064] [INFO ] [REMOTE ] CAE: Full fetch complete (56551 records). [2025-10-28T17:48:36.647226] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-28T17:48:36.764499] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-28T17:48:37.034744] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-28T17:48:37.034819] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-28T17:48:37.035436] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-28T17:48:37.035474] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-28T17:48:37.036520] [DEBUG] [LOCAL ] CAE: Trimmed 56551 records to 38660 (keeping 200 days of data) [2025-10-28T17:48:37.252808] [DEBUG] [LOCAL ] CAE: Primary data saved (38660 records). [2025-10-28T17:48:37.252929] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-28T17:48:37.253293] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CAE took 46.7s. Estimated remaining: 4h 7m 37s. Rate: 8.0 symbols/min [2025-10-28T17:48:37.422014] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:37.422172] [DEBUG] [LOCAL ] CALX: No existing data file found in primary storage. [2025-10-28T17:48:37.422208] [WARN ] [MAIN ] CALX: No existing data found, performing full refresh instead. [2025-10-28T17:48:37.422313] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-28T17:48:37.422353] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-28T17:48:37.422393] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-10-28T17:48:37.422424] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-28T17:48:37.576123] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-28T17:48:37.796761] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:37.828274] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T17:48:37.838888] [INFO ] [REMOTE ] CAH: Full fetch complete (74849 records). [2025-10-28T17:48:37.839068] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-28T17:48:38.227881] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-28T17:48:38.228004] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-28T17:48:38.229067] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-28T17:48:38.229144] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-28T17:48:38.230540] [DEBUG] [LOCAL ] CAH: Trimmed 74849 records to 51348 (keeping 200 days of data) [2025-10-28T17:48:38.359507] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-28T17:48:38.473457] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-28T17:48:38.586839] [DEBUG] [LOCAL ] CAH: Primary data saved (51348 records). [2025-10-28T17:48:38.586969] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-28T17:48:38.588006] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAH took 28.1s. Estimated remaining: 4h 6m 58s. Rate: 8.0 symbols/min [2025-10-28T17:48:38.756850] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:38.784309] [DEBUG] [LOCAL ] CANG: Loaded 26993 existing records from primary storage. [2025-10-28T17:48:38.784569] [INFO ] [MAIN ] CANG: Loaded 26993 existing records. [2025-10-28T17:48:38.962460] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:48:38.962719] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-28T17:48:38.962774] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-28T17:48:38.963196] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-28T17:48:38.963253] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-28T17:48:39.165085] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-28T17:48:39.310917] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:39.623516] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-28T17:48:39.647517] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T17:48:39.656555] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-28T17:48:39.657450] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-28T17:48:39.964461] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-28T17:48:40.047799] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-28T17:48:40.047895] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-28T17:48:40.048755] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-28T17:48:40.048816] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-28T17:48:40.050222] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 53666 (keeping 200 days of data) [2025-10-28T17:48:40.396658] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-28T17:48:40.408566] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-28T17:48:40.408733] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAG took 31.0s. Estimated remaining: 4h 6m 22s. Rate: 8.0 symbols/min [2025-10-28T17:48:40.421854] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:48:40.590940] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:40.591109] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-10-28T17:48:40.591147] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-10-28T17:48:40.591258] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-28T17:48:40.591298] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-28T17:48:40.591341] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-28T17:48:40.591373] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-28T17:48:40.762967] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-28T17:48:40.953460] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:40.972056] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:48:41.559318] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-28T17:48:42.092256] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:48:42.359476] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-28T17:48:42.808321] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T17:48:43.159352] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-28T17:48:43.712461] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:48:43.769886] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T17:48:43.959339] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-28T17:48:44.442204] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T17:48:44.759337] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-28T17:48:45.392140] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T17:48:45.559334] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-28T17:48:46.359334] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-28T17:48:46.655427] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T17:48:47.159347] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-28T17:48:47.435391] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:48:47.959371] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-28T17:48:48.239707] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:48:48.759376] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-28T17:48:49.030237] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:48:49.559305] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-28T17:48:49.778504] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:48:50.343047] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:48:50.359305] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-28T17:48:51.159322] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-28T17:48:51.203799] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:48:51.514908] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:48:51.959351] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-28T17:48:52.376773] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T17:48:52.759349] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-28T17:48:53.559337] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-28T17:48:53.804621] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T17:48:54.359342] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-28T17:48:54.738712] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T17:48:55.159320] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-28T17:48:55.518755] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:48:55.902380] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T17:48:55.959342] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-28T17:48:56.759323] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-28T17:48:57.022102] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:48:57.459492] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:48:57.559305] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-28T17:48:58.359337] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-28T17:48:58.559821] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:48:59.159316] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-28T17:48:59.673583] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:48:59.682018] [INFO ] [REMOTE ] CAL: Full fetch complete (61918 records). [2025-10-28T17:48:59.682122] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-28T17:48:59.964575] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-28T17:49:00.072295] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-28T17:49:00.072369] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-28T17:49:00.073053] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-28T17:49:00.073114] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-28T17:49:00.074278] [DEBUG] [LOCAL ] CAL: Trimmed 61918 records to 42431 (keeping 200 days of data) [2025-10-28T17:49:00.305914] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:49:00.362627] [DEBUG] [LOCAL ] CAL: Primary data saved (42431 records). [2025-10-28T17:49:00.362778] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-28T17:49:00.362856] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAL took 31.3s. Estimated remaining: 4h 7m 17s. Rate: 8.0 symbols/min [2025-10-28T17:49:00.528909] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:00.529090] [DEBUG] [LOCAL ] CARR: No existing data file found in primary storage. [2025-10-28T17:49:00.529129] [WARN ] [MAIN ] CARR: No existing data found, performing full refresh instead. [2025-10-28T17:49:00.529260] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-28T17:49:00.529311] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-28T17:49:00.529355] [DEBUG] [LOCAL ] CARR: No primary data file found to delete. [2025-10-28T17:49:00.529389] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-28T17:49:00.764545] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-28T17:49:00.784016] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T17:49:00.900173] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:01.559335] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-28T17:49:01.883062] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:49:02.359367] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-28T17:49:02.603351] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:49:03.159335] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-28T17:49:03.192922] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:49:03.959342] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-28T17:49:04.641433] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T17:49:04.759378] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-28T17:49:05.033174] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:49:05.559358] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-28T17:49:05.962215] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:49:06.359353] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-28T17:49:07.066839] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:49:07.073489] [INFO ] [REMOTE ] CALX: Full fetch complete (53979 records). [2025-10-28T17:49:07.073637] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-28T17:49:07.169464] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-28T17:49:07.465893] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-28T17:49:07.467812] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-28T17:49:07.468601] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-28T17:49:07.469043] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-28T17:49:07.469551] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:49:07.475616] [INFO ] [REMOTE ] CANG: Full fetch complete (39092 records). [2025-10-28T17:49:07.475894] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-28T17:49:07.476095] [DEBUG] [LOCAL ] CALX: Trimmed 53979 records to 36838 (keeping 200 days of data) [2025-10-28T17:49:07.962523] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-28T17:49:08.057341] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-28T17:49:08.058473] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-28T17:49:08.059462] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-28T17:49:08.059842] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-28T17:49:08.066319] [DEBUG] [LOCAL ] CANG: Trimmed 39092 records to 27056 (keeping 200 days of data) [2025-10-28T17:49:08.137012] [DEBUG] [LOCAL ] CALX: Primary data saved (36838 records). [2025-10-28T17:49:08.163027] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-28T17:49:08.172035] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CALX took 30.9s. Estimated remaining: 4h 7m 11s. Rate: 8.0 symbols/min [2025-10-28T17:49:08.382031] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:08.413170] [DEBUG] [LOCAL ] CARS: No existing data file found in primary storage. [2025-10-28T17:49:08.414795] [WARN ] [MAIN ] CARS: No existing data found, performing full refresh instead. [2025-10-28T17:49:08.415216] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-28T17:49:08.415715] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-28T17:49:08.418475] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-28T17:49:08.429206] [DEBUG] [LOCAL ] CANG: Primary data saved (27056 records). [2025-10-28T17:49:08.429734] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-28T17:49:08.429483] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-28T17:49:08.430134] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CANG took 29.8s. Estimated remaining: 4h 6m 27s. Rate: 8.0 symbols/min [2025-10-28T17:49:08.582754] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T17:49:08.762673] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-28T17:49:08.835676] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:09.026705] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-28T17:49:09.031235] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:09.079062] [DEBUG] [LOCAL ] CAT: Loaded 52903 existing records from primary storage. [2025-10-28T17:49:09.079378] [INFO ] [MAIN ] CAT: Loaded 52903 existing records. [2025-10-28T17:49:09.260143] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:09.260363] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-28T17:49:09.260410] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-28T17:49:09.261547] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-28T17:49:09.261619] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-28T17:49:09.369596] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:49:09.564501] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-28T17:49:09.627154] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:10.359341] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-28T17:49:10.740015] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T17:49:11.110402] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T17:49:11.159337] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-28T17:49:11.959401] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-28T17:49:12.713553] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T17:49:12.715834] [INFO ] [REMOTE ] CAPL: Full fetch complete (8732 records). [2025-10-28T17:49:12.715919] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-28T17:49:12.764465] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-28T17:49:13.095747] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-28T17:49:13.095826] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-28T17:49:13.096063] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-28T17:49:13.096121] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-28T17:49:13.096562] [DEBUG] [LOCAL ] CAPL: Trimmed 8732 records to 5245 (keeping 200 days of data) [2025-10-28T17:49:13.128236] [DEBUG] [LOCAL ] CAPL: Primary data saved (5245 records). [2025-10-28T17:49:13.128367] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-28T17:49:13.128494] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CAPL took 32.7s. Estimated remaining: 4h 6m 6s. Rate: 8.0 symbols/min [2025-10-28T17:49:13.300366] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:13.308568] [DEBUG] [LOCAL ] CATO: Loaded 6605 existing records from primary storage. [2025-10-28T17:49:13.308808] [INFO ] [MAIN ] CATO: Loaded 6605 existing records. [2025-10-28T17:49:13.488317] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:13.488544] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-28T17:49:13.488591] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-28T17:49:13.488737] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-28T17:49:13.488793] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-28T17:49:13.565743] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-28T17:49:13.857246] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:13.886739] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T17:49:14.359294] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-28T17:49:14.546981] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-28T17:49:14.559142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T17:49:15.159347] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-28T17:49:15.802447] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:49:15.959328] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-28T17:49:16.340869] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T17:49:16.759403] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-28T17:49:17.560533] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-28T17:49:17.568701] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T17:49:17.580554] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T17:49:18.359464] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-28T17:49:18.597344] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T17:49:18.885177] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:49:19.159336] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-28T17:49:19.959339] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-28T17:49:20.491144] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T17:49:20.603538] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:49:20.759327] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-28T17:49:21.559342] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-28T17:49:22.080223] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:49:22.359332] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-28T17:49:23.126553] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T17:49:23.159320] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-28T17:49:23.565373] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T17:49:23.841388] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T17:49:23.959320] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-28T17:49:24.759318] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-28T17:49:24.960809] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T17:49:25.559369] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-28T17:49:26.337917] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T17:49:26.359293] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-28T17:49:26.537998] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:49:27.159332] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-28T17:49:27.760030] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:49:27.959336] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-28T17:49:28.699443] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T17:49:28.759349] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-28T17:49:29.159152] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T17:49:29.318174] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T17:49:29.559320] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-28T17:49:30.359384] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-28T17:49:30.828546] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T17:49:31.159333] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-28T17:49:31.570996] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T17:49:31.966381] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-28T17:49:31.972275] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:49:32.399047] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:49:32.759337] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-28T17:49:33.559347] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-28T17:49:34.074007] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T17:49:34.359295] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-28T17:49:34.397954] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T17:49:34.407538] [INFO ] [REMOTE ] CARS: Full fetch complete (56735 records). [2025-10-28T17:49:34.407666] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-28T17:49:34.855140] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-28T17:49:34.861757] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-28T17:49:34.862602] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-28T17:49:34.863184] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-28T17:49:34.863457] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:49:34.867285] [DEBUG] [LOCAL ] CARS: Trimmed 56735 records to 39539 (keeping 200 days of data) [2025-10-28T17:49:35.090941] [DEBUG] [LOCAL ] CARS: Primary data saved (39539 records). [2025-10-28T17:49:35.091090] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-28T17:49:35.091163] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CARS took 26.9s. Estimated remaining: 4h 7m 10s. Rate: 8.0 symbols/min [2025-10-28T17:49:35.164489] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-28T17:49:35.272087] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:35.319236] [DEBUG] [LOCAL ] CAVA: Loaded 53539 existing records from primary storage. [2025-10-28T17:49:35.319562] [INFO ] [MAIN ] CAVA: Loaded 53539 existing records. [2025-10-28T17:49:35.497274] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:35.497555] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-28T17:49:35.497607] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-28T17:49:35.498635] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-28T17:49:35.498741] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-28T17:49:35.849979] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:35.959350] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-28T17:49:36.383746] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T17:49:36.385496] [INFO ] [REMOTE ] CATO: Full fetch complete (10600 records). [2025-10-28T17:49:36.385564] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-28T17:49:36.759299] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-28T17:49:36.766326] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-28T17:49:36.766498] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-28T17:49:36.766836] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-28T17:49:36.766936] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-28T17:49:36.767695] [DEBUG] [LOCAL ] CATO: Trimmed 10600 records to 6662 (keeping 200 days of data) [2025-10-28T17:49:36.805881] [DEBUG] [LOCAL ] CATO: Primary data saved (6662 records). [2025-10-28T17:49:36.805988] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-28T17:49:36.806063] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CATO took 23.7s. Estimated remaining: 4h 6m 34s. Rate: 8.0 symbols/min [2025-10-28T17:49:36.992472] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:37.028106] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T17:49:37.077900] [DEBUG] [LOCAL ] CB: Loaded 49917 existing records from primary storage. [2025-10-28T17:49:37.078196] [INFO ] [MAIN ] CB: Loaded 49917 existing records. [2025-10-28T17:49:37.248559] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:37.248775] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-28T17:49:37.248823] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-28T17:49:37.249615] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-28T17:49:37.249703] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-28T17:49:37.567674] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-28T17:49:37.596346] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:38.359323] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-28T17:49:38.399813] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T17:49:39.148028] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:49:39.159307] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-28T17:49:39.159521] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-10-28T17:49:39.160430] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-28T17:49:39.555378] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-28T17:49:39.555526] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-28T17:49:39.556354] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-28T17:49:39.556416] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-28T17:49:39.557891] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 53601 (keeping 200 days of data) [2025-10-28T17:49:39.902245] [DEBUG] [LOCAL ] CARR: Primary data saved (53601 records). [2025-10-28T17:49:39.902589] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-28T17:49:39.902732] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CARR took 39.5s. Estimated remaining: 4h 6m 5s. Rate: 8.0 symbols/min [2025-10-28T17:49:39.904253] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:49:39.959304] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-28T17:49:40.759485] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-28T17:49:40.988545] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-28T17:49:41.506332] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:49:41.559315] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-28T17:49:42.010238] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:49:42.359353] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-28T17:49:43.045894] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:49:43.159331] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-28T17:49:43.845989] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T17:49:43.959335] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-28T17:49:44.759370] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-28T17:49:45.236835] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-28T17:49:45.247828] [INFO ] [REMOTE ] CAT: Full fetch complete (76857 records). [2025-10-28T17:49:45.247978] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-28T17:49:45.396784] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T17:49:45.573082] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-28T17:49:45.676476] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-28T17:49:45.676554] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-28T17:49:45.677412] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-28T17:49:45.677475] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-28T17:49:45.678966] [DEBUG] [LOCAL ] CAT: Trimmed 76857 records to 52900 (keeping 200 days of data) [2025-10-28T17:49:46.002831] [DEBUG] [LOCAL ] CAT: Primary data saved (52900 records). [2025-10-28T17:49:46.002962] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-28T17:49:46.003733] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CAT took 37.5s. Estimated remaining: 4h 5m 50s. Rate: 8.0 symbols/min [2025-10-28T17:49:46.383429] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T17:49:46.395183] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-28T17:49:47.045481] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:49:47.159317] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-28T17:49:47.827199] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:49:47.959299] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-28T17:49:48.412060] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:49:48.759384] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-28T17:49:49.555220] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:49:49.567372] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-28T17:49:50.681785] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-28T17:49:50.697503] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-28T17:49:51.153749] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T17:49:51.169022] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-28T17:49:52.007714] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T17:49:52.018749] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-28T17:49:52.672584] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:49:52.759329] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-28T17:49:53.180300] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:49:53.559342] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-28T17:49:54.139622] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:49:54.359328] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-28T17:49:54.866037] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T17:49:55.159335] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-28T17:49:55.764381] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:49:55.959349] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-28T17:49:57.158240] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T17:49:57.168399] [INFO ] [REMOTE ] CB: Full fetch complete (72843 records). [2025-10-28T17:49:57.168556] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-28T17:49:57.552149] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-28T17:49:57.552284] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-28T17:49:57.553228] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-28T17:49:57.553313] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-28T17:49:57.554847] [DEBUG] [LOCAL ] CB: Trimmed 72843 records to 49912 (keeping 200 days of data) [2025-10-28T17:49:57.867639] [DEBUG] [LOCAL ] CB: Primary data saved (49912 records). [2025-10-28T17:49:57.867899] [INFO ] [MAIN ] CB: Full history saved. [2025-10-28T17:49:57.867991] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CB took 21.1s. Estimated remaining: 4h 6m 4s. Rate: 8.0 symbols/min [2025-10-28T17:49:57.898734] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-28T17:49:57.909419] [INFO ] [REMOTE ] CAVA: Full fetch complete (77455 records). [2025-10-28T17:49:57.909558] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-28T17:49:58.291832] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-28T17:49:58.291909] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-28T17:49:58.292717] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-28T17:49:58.292776] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-28T17:49:58.294137] [DEBUG] [LOCAL ] CAVA: Trimmed 77455 records to 53531 (keeping 200 days of data) [2025-10-28T17:49:58.601679] [DEBUG] [LOCAL ] CAVA: Primary data saved (53531 records). [2025-10-28T17:49:58.601801] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-28T17:49:58.602240] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CAVA took 23.5s. Estimated remaining: 4h 5m 23s. Rate: 8.0 symbols/min [2025-10-28T17:49:59.234498] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.271476] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.269033] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.321127] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.322948] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-28T17:49:59.325934] [DEBUG] [LOCAL ] CBNA: Loaded 2817 existing records from primary storage. [2025-10-28T17:49:59.326451] [INFO ] [MAIN ] CBNA: Loaded 2817 existing records. [2025-10-28T17:49:59.326162] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-28T17:49:59.367832] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-28T17:49:59.410298] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-28T17:49:59.438674] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-28T17:49:59.455481] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-28T17:49:59.474930] [DEBUG] [LOCAL ] CBL: Loaded 15649 existing records from primary storage. [2025-10-28T17:49:59.475187] [DEBUG] [LOCAL ] CBAN: Loaded 10025 existing records from primary storage. [2025-10-28T17:49:59.505677] [INFO ] [MAIN ] CBAN: Loaded 10025 existing records. [2025-10-28T17:49:59.554719] [INFO ] [MAIN ] CBL: Loaded 15649 existing records. [2025-10-28T17:49:59.643450] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:59.682040] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-28T17:49:59.729460] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-28T17:49:59.763349] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-28T17:49:59.789804] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-28T17:50:00.327102] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:00.369522] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-28T17:50:00.395403] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-28T17:50:00.357986] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:00.443246] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-28T17:50:00.485779] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-28T17:50:00.509237] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-28T17:50:00.603380] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-28T17:50:00.603247] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:00.641465] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-28T17:50:00.621241] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-28T17:50:00.666244] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-28T17:50:00.884908] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:00.965458] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-28T17:50:01.345924] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:01.363318] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-28T17:50:01.426171] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:01.426637] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-28T17:50:01.443985] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:50:01.444552] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-28T17:50:01.444708] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:50:01.444802] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-28T17:50:01.444883] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:50:01.444975] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-28T17:50:01.445085] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-28T17:50:01.445359] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-28T17:50:01.445449] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-28T17:50:01.445540] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 2.8s. Estimated remaining: 4h 4m 53s. Rate: 8.0 symbols/min [2025-10-28T17:50:01.643427] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:01.707212] [DEBUG] [LOCAL ] CBRE: Loaded 50256 existing records from primary storage. [2025-10-28T17:50:01.707875] [INFO ] [MAIN ] CBRE: Loaded 50256 existing records. [2025-10-28T17:50:01.907126] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:01.907358] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-28T17:50:01.907405] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-28T17:50:01.908052] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-28T17:50:01.908111] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-28T17:50:02.040022] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:50:02.053158] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-28T17:50:02.305804] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:02.306176] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-28T17:50:02.316275] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:50:02.320183] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-28T17:50:02.695304] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T17:50:02.696589] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-28T17:50:02.854109] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:50:02.976307] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:50:03.159316] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-28T17:50:03.359823] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T17:50:03.518637] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:50:03.959312] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-28T17:50:04.014634] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T17:50:04.658884] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:50:04.759362] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-28T17:50:05.350547] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:50:05.559350] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-28T17:50:06.110495] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T17:50:06.359365] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-28T17:50:06.951348] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:50:07.159341] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-28T17:50:07.427371] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T17:50:07.959342] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-28T17:50:08.302142] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T17:50:08.759339] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-28T17:50:09.058168] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T17:50:09.559352] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-28T17:50:09.945475] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T17:50:10.359377] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-28T17:50:11.159317] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-28T17:50:11.434582] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:50:11.839119] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:50:11.959359] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-28T17:50:12.759348] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-28T17:50:12.989114] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T17:50:13.559351] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-28T17:50:14.359345] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-28T17:50:14.450152] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:50:15.159350] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-28T17:50:15.284158] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T17:50:15.959449] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-28T17:50:16.489474] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:50:16.699084] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-28T17:50:16.759311] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-28T17:50:17.208025] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-28T17:50:17.559354] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-28T17:50:18.062537] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T17:50:18.063447] [INFO ] [REMOTE ] CBNA: Full fetch complete (4183 records). [2025-10-28T17:50:18.063514] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-28T17:50:18.361423] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-28T17:50:18.355956] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:50:18.440089] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-28T17:50:18.440167] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-28T17:50:18.440319] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-28T17:50:18.440357] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-28T17:50:18.440787] [DEBUG] [LOCAL ] CBNA: Trimmed 4183 records to 2806 (keeping 200 days of data) [2025-10-28T17:50:18.456591] [DEBUG] [LOCAL ] CBNA: Primary data saved (2806 records). [2025-10-28T17:50:18.456687] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-28T17:50:18.456770] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBNA took 19.9s. Estimated remaining: 4h 5m 32s. Rate: 8.0 symbols/min [2025-10-28T17:50:18.619844] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:18.648938] [DEBUG] [LOCAL ] CBT: Loaded 30570 existing records from primary storage. [2025-10-28T17:50:18.649198] [INFO ] [MAIN ] CBT: Loaded 30570 existing records. [2025-10-28T17:50:18.824429] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:18.824711] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-28T17:50:18.824767] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-28T17:50:18.825183] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-28T17:50:18.825240] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-28T17:50:19.139325] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T17:50:19.164263] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-28T17:50:19.195044] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:19.959346] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-28T17:50:20.764268] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-28T17:50:20.771779] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T17:50:20.935250] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:50:21.265940] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:50:21.559344] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-28T17:50:22.359355] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-28T17:50:22.797840] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T17:50:22.801171] [INFO ] [REMOTE ] CBAN: Full fetch complete (16376 records). [2025-10-28T17:50:22.801274] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-28T17:50:23.164485] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-28T17:50:23.172625] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-28T17:50:23.173390] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-28T17:50:23.173761] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-28T17:50:23.173822] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-28T17:50:23.174416] [DEBUG] [LOCAL ] CBAN: Trimmed 16376 records to 10006 (keeping 200 days of data) [2025-10-28T17:50:23.233852] [DEBUG] [LOCAL ] CBAN: Primary data saved (10006 records). [2025-10-28T17:50:23.234074] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-28T17:50:23.234173] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBAN took 24.6s. Estimated remaining: 4h 5m 11s. Rate: 8.0 symbols/min [2025-10-28T17:50:23.401826] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:23.422786] [DEBUG] [LOCAL ] CBU: Loaded 22333 existing records from primary storage. [2025-10-28T17:50:23.423028] [INFO ] [MAIN ] CBU: Loaded 22333 existing records. [2025-10-28T17:50:23.607730] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:23.608767] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-28T17:50:23.608928] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-28T17:50:23.609798] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-28T17:50:23.609858] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-28T17:50:23.779767] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T17:50:23.964422] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-28T17:50:24.015782] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:24.199626] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:50:24.759388] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-28T17:50:25.031755] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T17:50:25.559385] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-28T17:50:25.804066] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:50:26.131684] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T17:50:26.359340] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-28T17:50:27.159333] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-28T17:50:27.184871] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T17:50:27.861010] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:50:27.959323] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-28T17:50:28.667844] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T17:50:28.759326] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-28T17:50:29.559310] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-28T17:50:29.724736] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:50:30.359340] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-28T17:50:31.060596] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:50:31.087239] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:50:31.159334] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-28T17:50:31.959344] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-28T17:50:32.459415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:50:32.729352] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:50:32.759350] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-28T17:50:33.559335] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-28T17:50:33.853801] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:50:34.354972] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:50:34.359375] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-28T17:50:35.166278] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-28T17:50:35.170374] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:50:35.959337] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-28T17:50:36.627305] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:50:36.759317] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-28T17:50:37.559402] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-28T17:50:37.992525] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T17:50:37.997554] [INFO ] [REMOTE ] CBL: Full fetch complete (24518 records). [2025-10-28T17:50:37.997787] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-28T17:50:38.374081] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-28T17:50:38.429856] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T17:50:38.451547] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-28T17:50:38.452002] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-28T17:50:38.452737] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-28T17:50:38.452833] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-28T17:50:38.453837] [DEBUG] [LOCAL ] CBL: Trimmed 24518 records to 15582 (keeping 200 days of data) [2025-10-28T17:50:38.549300] [DEBUG] [LOCAL ] CBL: Primary data saved (15582 records). [2025-10-28T17:50:38.549477] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-28T17:50:38.549604] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBL took 39.9s. Estimated remaining: 4h 5m 42s. Rate: 8.0 symbols/min [2025-10-28T17:50:38.732697] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:50:38.749571] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:38.756504] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-28T17:50:38.756564] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-28T17:50:38.757073] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-28T17:50:38.757168] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-28T17:50:38.757479] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-28T17:50:38.757529] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-28T17:50:39.123136] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:39.159302] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-28T17:50:39.959313] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-28T17:50:40.008360] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:50:40.036381] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:50:40.103245] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:50:40.103585] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-28T17:50:40.103710] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:50:40.103776] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-28T17:50:40.103840] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:50:40.103911] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-28T17:50:40.103974] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-28T17:50:40.104016] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-28T17:50:40.104096] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-28T17:50:40.104161] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBX took 1.6s. Estimated remaining: 4h 5m 6s. Rate: 8.0 symbols/min [2025-10-28T17:50:40.276591] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:40.309682] [DEBUG] [LOCAL ] CBZ: Loaded 34157 existing records from primary storage. [2025-10-28T17:50:40.309963] [INFO ] [MAIN ] CBZ: Loaded 34157 existing records. [2025-10-28T17:50:40.488430] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:40.488639] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-28T17:50:40.488737] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-28T17:50:40.489181] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-28T17:50:40.489240] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-28T17:50:40.766811] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-28T17:50:40.850120] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:41.559349] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-28T17:50:41.733501] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T17:50:42.359343] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-28T17:50:43.057317] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:50:43.139492] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:50:43.152204] [INFO ] [REMOTE ] CBRE: Full fetch complete (73731 records). [2025-10-28T17:50:43.152371] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-28T17:50:43.164677] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-28T17:50:43.544402] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-28T17:50:43.544481] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-28T17:50:43.545274] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-28T17:50:43.545366] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-28T17:50:43.546731] [DEBUG] [LOCAL ] CBRE: Trimmed 73731 records to 50235 (keeping 200 days of data) [2025-10-28T17:50:43.837584] [DEBUG] [LOCAL ] CBRE: Primary data saved (50235 records). [2025-10-28T17:50:43.837737] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-28T17:50:43.838342] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBRE took 42.4s. Estimated remaining: 4h 4m 40s. Rate: 8.0 symbols/min [2025-10-28T17:50:43.964435] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-28T17:50:44.008638] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:44.065150] [DEBUG] [LOCAL ] CC: Loaded 52972 existing records from primary storage. [2025-10-28T17:50:44.065506] [INFO ] [MAIN ] CC: Loaded 52972 existing records. [2025-10-28T17:50:44.243844] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:44.244051] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-28T17:50:44.244097] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-28T17:50:44.244697] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-28T17:50:44.244756] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-28T17:50:44.604586] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:44.623638] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:50:44.759339] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-28T17:50:45.340895] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:50:45.345682] [INFO ] [REMOTE ] CBU: Full fetch complete (32551 records). [2025-10-28T17:50:45.345805] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-28T17:50:45.564500] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-28T17:50:45.730767] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-28T17:50:45.730869] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-28T17:50:45.731558] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-28T17:50:45.731716] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-28T17:50:45.750369] [DEBUG] [LOCAL ] CBU: Trimmed 32551 records to 22252 (keeping 200 days of data) [2025-10-28T17:50:45.752094] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T17:50:45.887840] [DEBUG] [LOCAL ] CBU: Primary data saved (22252 records). [2025-10-28T17:50:45.887964] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-28T17:50:45.888039] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBU took 22.7s. Estimated remaining: 4h 4m 6s. Rate: 8.0 symbols/min [2025-10-28T17:50:46.055633] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:46.103947] [DEBUG] [LOCAL ] CCI: Loaded 53098 existing records from primary storage. [2025-10-28T17:50:46.104249] [INFO ] [MAIN ] CCI: Loaded 53098 existing records. [2025-10-28T17:50:46.277519] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:46.277710] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-28T17:50:46.277766] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-28T17:50:46.278370] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-28T17:50:46.278428] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-28T17:50:46.367297] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-28T17:50:46.631773] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:46.719722] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:50:47.159325] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-28T17:50:47.921571] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:50:47.959323] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-28T17:50:48.114309] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T17:50:48.759363] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-28T17:50:48.864255] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T17:50:49.559361] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-28T17:50:50.005901] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T17:50:50.012191] [INFO ] [REMOTE ] CBT: Full fetch complete (45679 records). [2025-10-28T17:50:50.012292] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-28T17:50:50.374043] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-28T17:50:50.391334] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-28T17:50:50.391416] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-28T17:50:50.391996] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-28T17:50:50.392056] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-28T17:50:50.393328] [DEBUG] [LOCAL ] CBT: Trimmed 45679 records to 30466 (keeping 200 days of data) [2025-10-28T17:50:50.577731] [DEBUG] [LOCAL ] CBT: Primary data saved (30466 records). [2025-10-28T17:50:50.577888] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-28T17:50:50.577988] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CBT took 32.1s. Estimated remaining: 4h 3m 45s. Rate: 8.0 symbols/min [2025-10-28T17:50:50.754994] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:50:50.787576] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:50.788422] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-28T17:50:50.788483] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-28T17:50:50.788596] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-28T17:50:50.788638] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-28T17:50:50.788730] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-28T17:50:50.788766] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-28T17:50:51.141032] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:51.159334] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-28T17:50:51.944315] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T17:50:51.959306] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-28T17:50:52.405040] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T17:50:52.759394] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-28T17:50:53.260785] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T17:50:53.559326] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-28T17:50:53.787358] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:50:54.359371] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-28T17:50:54.736748] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:50:55.005819] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T17:50:55.159368] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-28T17:50:55.959312] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-28T17:50:56.041953] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:50:56.759360] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-28T17:50:57.299927] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T17:50:57.559320] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-28T17:50:58.040906] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:50:58.207309] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:50:58.359325] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-28T17:50:59.159325] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-28T17:50:59.847268] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:50:59.959365] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-28T17:51:00.759383] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-28T17:51:01.259054] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-28T17:51:01.282879] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T17:51:01.533258] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T17:51:01.559315] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-28T17:51:02.359382] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-28T17:51:02.616471] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-28T17:51:03.022967] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:51:03.159354] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-28T17:51:03.959365] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-28T17:51:04.450616] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:51:04.759360] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-28T17:51:05.318236] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:51:05.559372] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-28T17:51:05.742083] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:51:06.359366] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-28T17:51:06.745458] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T17:51:06.804996] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T17:51:07.159338] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-28T17:51:07.959351] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-28T17:51:08.205075] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T17:51:08.255293] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:51:08.759342] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-28T17:51:09.513068] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:51:09.559329] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-28T17:51:10.359339] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-28T17:51:10.587066] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T17:51:11.159367] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-28T17:51:11.552757] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-28T17:51:11.566765] [INFO ] [REMOTE ] CC: Full fetch complete (76206 records). [2025-10-28T17:51:11.566903] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-28T17:51:11.965800] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-28T17:51:11.967385] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-28T17:51:11.967442] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-28T17:51:11.968332] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-28T17:51:11.968486] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-28T17:51:11.970016] [DEBUG] [LOCAL ] CC: Trimmed 76206 records to 52964 (keeping 200 days of data) [2025-10-28T17:51:12.280562] [DEBUG] [LOCAL ] CC: Primary data saved (52964 records). [2025-10-28T17:51:12.280719] [INFO ] [MAIN ] CC: Full history saved. [2025-10-28T17:51:12.281048] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CC took 28.4s. Estimated remaining: 4h 4m 46s. Rate: 8.0 symbols/min [2025-10-28T17:51:12.465093] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:12.495979] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T17:51:12.516547] [DEBUG] [LOCAL ] CCIF: Loaded 15071 existing records from primary storage. [2025-10-28T17:51:12.516797] [INFO ] [MAIN ] CCIF: Loaded 15071 existing records. [2025-10-28T17:51:12.693147] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:12.693333] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-28T17:51:12.693381] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-28T17:51:12.693724] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-28T17:51:12.693783] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-28T17:51:12.768122] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-28T17:51:13.050705] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:13.124446] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T17:51:13.546750] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:51:13.554833] [INFO ] [REMOTE ] CBZ: Full fetch complete (46751 records). [2025-10-28T17:51:13.555035] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-28T17:51:13.567218] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-28T17:51:13.946853] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-28T17:51:13.946943] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-28T17:51:13.947589] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-28T17:51:13.947688] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-28T17:51:13.948841] [DEBUG] [LOCAL ] CBZ: Trimmed 46751 records to 34214 (keeping 200 days of data) [2025-10-28T17:51:14.142925] [DEBUG] [LOCAL ] CBZ: Primary data saved (34214 records). [2025-10-28T17:51:14.143052] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-28T17:51:14.143127] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CBZ took 34.0s. Estimated remaining: 4h 4m 12s. Rate: 8.0 symbols/min [2025-10-28T17:51:14.315742] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:14.363259] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-28T17:51:14.365201] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-28T17:51:14.365604] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-28T17:51:14.548425] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:14.548684] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-28T17:51:14.548756] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-28T17:51:14.549229] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-28T17:51:14.549288] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-28T17:51:14.758985] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T17:51:14.910597] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:15.030235] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:51:15.159319] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-28T17:51:15.959380] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-28T17:51:16.759354] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-28T17:51:17.199877] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T17:51:17.559315] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-28T17:51:17.728893] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T17:51:17.866571] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:51:18.359345] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-28T17:51:18.948122] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:51:18.949580] [INFO ] [REMOTE ] CCIA: Full fetch complete (2191 records). [2025-10-28T17:51:18.949757] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-28T17:51:19.139076] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T17:51:19.139338] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:51:19.139500] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:51:19.139690] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-28T17:51:19.139793] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-28T17:51:19.139851] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-28T17:51:19.139898] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-28T17:51:19.139958] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIA took 28.6s. Estimated remaining: 4h 3m 52s. Rate: 8.0 symbols/min [2025-10-28T17:51:19.169049] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-28T17:51:19.313993] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:19.314317] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-10-28T17:51:19.314452] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-10-28T17:51:19.314588] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-28T17:51:19.314771] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-28T17:51:19.314958] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-28T17:51:19.315027] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-28T17:51:19.498083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T17:51:19.745499] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:19.854884] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:51:19.959378] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-28T17:51:20.675148] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:51:20.759326] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-28T17:51:21.559318] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-28T17:51:21.641566] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:51:22.359356] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-28T17:51:22.938152] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:51:23.078850] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:51:23.159323] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-28T17:51:23.763157] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:51:23.959386] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-28T17:51:24.759347] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-28T17:51:25.357228] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T17:51:25.559344] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-28T17:51:25.600469] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:51:26.359316] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-28T17:51:27.125722] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T17:51:27.136914] [INFO ] [REMOTE ] CCI: Full fetch complete (77093 records). [2025-10-28T17:51:27.137072] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-28T17:51:27.168348] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-28T17:51:27.539504] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-28T17:51:27.539594] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-28T17:51:27.540407] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-28T17:51:27.540469] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-28T17:51:27.541899] [DEBUG] [LOCAL ] CCI: Trimmed 77093 records to 53098 (keeping 200 days of data) [2025-10-28T17:51:27.878078] [DEBUG] [LOCAL ] CCI: Primary data saved (53098 records). [2025-10-28T17:51:27.878215] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-28T17:51:27.878293] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCI took 42.0s. Estimated remaining: 4h 3m 51s. Rate: 8.0 symbols/min [2025-10-28T17:51:27.972249] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-28T17:51:28.055174] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:28.105729] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-28T17:51:28.106134] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-28T17:51:28.305409] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:28.306136] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-28T17:51:28.306310] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-28T17:51:28.307044] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-28T17:51:28.307177] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-28T17:51:28.427394] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T17:51:28.718756] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:28.753320] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:51:28.762688] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:51:28.762825] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-28T17:51:29.559334] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-28T17:51:30.359417] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-28T17:51:30.772565] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:51:30.841153] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-28T17:51:30.949605] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:51:31.159350] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-28T17:51:31.959364] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-28T17:51:32.688769] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T17:51:32.759355] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-28T17:51:33.165169] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:51:33.559353] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-28T17:51:34.359355] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-28T17:51:34.619845] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-28T17:51:34.970024] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:51:35.049738] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:51:35.052905] [INFO ] [REMOTE ] CCIF: Full fetch complete (21982 records). [2025-10-28T17:51:35.052975] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-28T17:51:35.166033] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-28T17:51:35.436721] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-28T17:51:35.436821] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-28T17:51:35.437233] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-28T17:51:35.437292] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-28T17:51:35.437998] [DEBUG] [LOCAL ] CCIF: Trimmed 21982 records to 15075 (keeping 200 days of data) [2025-10-28T17:51:35.521084] [DEBUG] [LOCAL ] CCIF: Primary data saved (15075 records). [2025-10-28T17:51:35.521210] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-28T17:51:35.521288] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCIF took 23.2s. Estimated remaining: 4h 3m 44s. Rate: 8.0 symbols/min [2025-10-28T17:51:35.685634] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:35.728182] [DEBUG] [LOCAL ] CCO: Loaded 48691 existing records from primary storage. [2025-10-28T17:51:35.728463] [INFO ] [MAIN ] CCO: Loaded 48691 existing records. [2025-10-28T17:51:35.901933] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:35.902177] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-28T17:51:35.902223] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-28T17:51:35.902722] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-28T17:51:35.902779] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-28T17:51:35.964541] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-28T17:51:36.253019] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:36.677200] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T17:51:36.759319] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-28T17:51:37.559355] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-28T17:51:37.937573] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-28T17:51:38.359331] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-28T17:51:38.684387] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-28T17:51:38.984574] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T17:51:39.159338] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-28T17:51:39.489242] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:51:39.959378] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-28T17:51:40.113972] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T17:51:40.759393] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-28T17:51:41.559335] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-28T17:51:41.763446] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T17:51:41.846812] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T17:51:42.359331] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-28T17:51:42.707879] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:51:43.159374] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-28T17:51:43.492472] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T17:51:43.959328] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-28T17:51:44.759302] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-28T17:51:44.875415] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T17:51:45.559322] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-28T17:51:45.883793] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T17:51:45.928115] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:51:46.359319] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-28T17:51:47.148589] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T17:51:47.159223] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-28T17:51:47.817773] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:51:47.959311] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-28T17:51:48.759376] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-28T17:51:49.149025] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-28T17:51:49.552431] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T17:51:49.561335] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-28T17:51:50.254089] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:51:50.359365] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-28T17:51:51.159318] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-28T17:51:51.339597] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T17:51:51.959388] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-28T17:51:52.295435] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T17:51:52.525406] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-28T17:51:52.759340] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-28T17:51:53.559346] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-28T17:51:53.963288] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T17:51:54.359315] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-28T17:51:54.470395] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T17:51:54.480130] [INFO ] [REMOTE ] CCK: Full fetch complete (68179 records). [2025-10-28T17:51:54.480293] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-28T17:51:54.889074] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-28T17:51:54.889369] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-28T17:51:54.890184] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-28T17:51:54.890262] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-28T17:51:54.926939] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:51:54.925153] [DEBUG] [LOCAL ] CCK: Trimmed 68179 records to 46444 (keeping 200 days of data) [2025-10-28T17:51:55.162677] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-28T17:51:55.216585] [DEBUG] [LOCAL ] CCK: Primary data saved (46444 records). [2025-10-28T17:51:55.216730] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-28T17:51:55.216807] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCK took 36.1s. Estimated remaining: 4h 4m 34s. Rate: 8.0 symbols/min [2025-10-28T17:51:55.384322] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:55.394893] [DEBUG] [LOCAL ] CCRD: Loaded 9616 existing records from primary storage. [2025-10-28T17:51:55.395076] [INFO ] [MAIN ] CCRD: Loaded 9616 existing records. [2025-10-28T17:51:55.586063] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:55.586236] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-28T17:51:55.586282] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-28T17:51:55.586420] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-28T17:51:55.586458] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-28T17:51:55.930364] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:55.959297] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-28T17:51:56.269769] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T17:51:56.471863] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:51:56.546027] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-28T17:51:56.556786] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-28T17:51:56.556929] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-28T17:51:56.767498] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-28T17:51:56.965055] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-28T17:51:56.965146] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-28T17:51:56.966013] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-28T17:51:56.966080] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-28T17:51:56.967619] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-28T17:51:57.278891] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-28T17:51:57.279021] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-28T17:51:57.279098] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCL took 29.4s. Estimated remaining: 4h 4m 1s. Rate: 8.0 symbols/min [2025-10-28T17:51:57.444782] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:57.473378] [DEBUG] [LOCAL ] CCS: Loaded 29822 existing records from primary storage. [2025-10-28T17:51:57.473631] [INFO ] [MAIN ] CCS: Loaded 29822 existing records. [2025-10-28T17:51:57.564610] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-28T17:51:57.661024] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:57.661217] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-28T17:51:57.661262] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-28T17:51:57.661635] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-28T17:51:57.661723] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-28T17:51:58.027978] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:58.032555] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:51:58.359383] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-28T17:51:58.685714] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T17:51:58.696699] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-28T17:51:58.696840] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-28T17:51:58.844375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T17:51:59.139517] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-28T17:51:59.139591] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-28T17:51:59.140405] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-28T17:51:59.140466] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-28T17:51:59.141872] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53691 (keeping 200 days of data) [2025-10-28T17:51:59.190239] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-28T17:51:59.453318] [DEBUG] [LOCAL ] CCJ: Primary data saved (53691 records). [2025-10-28T17:51:59.453434] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-28T17:51:59.453507] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCJ took 45.3s. Estimated remaining: 4h 3m 28s. Rate: 8.0 symbols/min [2025-10-28T17:51:59.632887] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:59.653083] [DEBUG] [LOCAL ] CCU: Loaded 21160 existing records from primary storage. [2025-10-28T17:51:59.653331] [INFO ] [MAIN ] CCU: Loaded 21160 existing records. [2025-10-28T17:51:59.826826] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:59.827045] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-28T17:51:59.827115] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-28T17:51:59.827366] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-28T17:51:59.827422] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-28T17:51:59.964548] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-28T17:52:00.183454] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:00.258318] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:52:00.759378] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-28T17:52:01.559314] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-28T17:52:01.702473] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T17:52:01.765578] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:52:02.359396] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-28T17:52:02.504484] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:52:02.762546] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T17:52:03.159350] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-28T17:52:03.959347] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-28T17:52:04.683075] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:52:04.692893] [INFO ] [REMOTE ] CCO: Full fetch complete (67529 records). [2025-10-28T17:52:04.693003] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-28T17:52:04.767248] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-28T17:52:05.089937] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-28T17:52:05.090122] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-28T17:52:05.090982] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-28T17:52:05.091151] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-28T17:52:05.092880] [DEBUG] [LOCAL ] CCO: Trimmed 67529 records to 48719 (keeping 200 days of data) [2025-10-28T17:52:05.202285] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:52:05.379064] [DEBUG] [LOCAL ] CCO: Primary data saved (48719 records). [2025-10-28T17:52:05.379220] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-28T17:52:05.379572] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCO took 29.9s. Estimated remaining: 4h 3m 14s. Rate: 8.0 symbols/min [2025-10-28T17:52:05.546809] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:05.546935] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-28T17:52:05.546971] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-28T17:52:05.547098] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-28T17:52:05.547154] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-28T17:52:05.547199] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-28T17:52:05.547231] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-28T17:52:05.567189] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-28T17:52:05.678075] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T17:52:05.919077] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:06.283592] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:52:06.359343] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-28T17:52:07.145965] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:52:07.159343] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-28T17:52:07.793476] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T17:52:07.959337] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-28T17:52:08.492956] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:52:08.759398] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-28T17:52:08.948131] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-10-28T17:52:09.559375] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-28T17:52:10.359329] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-28T17:52:10.405191] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T17:52:10.595806] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-28T17:52:11.159405] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-28T17:52:11.384542] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T17:52:11.959321] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-28T17:52:12.176015] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-28T17:52:12.759366] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-28T17:52:13.247924] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:52:13.559364] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-28T17:52:14.359379] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-28T17:52:14.545728] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:52:14.545973] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-28T17:52:14.546059] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:52:14.546180] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-28T17:52:14.546259] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:52:14.546331] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-28T17:52:14.546394] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-28T17:52:14.546429] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-28T17:52:14.546467] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-28T17:52:14.546511] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCZ took 9.2s. Estimated remaining: 4h 3m 14s. Rate: 8.0 symbols/min [2025-10-28T17:52:14.730261] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:14.751724] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T17:52:14.810832] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-28T17:52:14.811173] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-28T17:52:14.985303] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:14.985525] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-28T17:52:14.985581] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-28T17:52:14.986376] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-28T17:52:14.986433] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-28T17:52:15.168137] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-28T17:52:15.343155] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:15.959349] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-28T17:52:16.213601] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T17:52:16.759342] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-28T17:52:17.264985] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:52:17.559352] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-28T17:52:17.706898] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:52:18.359356] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-28T17:52:18.799461] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:52:19.159314] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-28T17:52:19.506602] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:52:19.959312] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-28T17:52:20.099929] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T17:52:20.584156] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T17:52:20.759343] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-28T17:52:21.559338] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-28T17:52:22.104699] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T17:52:22.359345] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-28T17:52:22.672203] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:52:23.159339] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-28T17:52:23.849805] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:52:23.959312] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-28T17:52:24.098558] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-28T17:52:24.759361] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-28T17:52:24.912037] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:52:25.486174] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:52:25.559327] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-28T17:52:26.294139] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:52:26.359394] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-28T17:52:27.010587] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T17:52:27.159327] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-28T17:52:27.952154] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:52:27.959308] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-28T17:52:28.759335] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-28T17:52:29.530614] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T17:52:29.534516] [INFO ] [REMOTE ] CCU: Full fetch complete (32150 records). [2025-10-28T17:52:29.534594] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-28T17:52:29.569059] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-28T17:52:29.703808] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:52:29.759994] [INFO ] [REMOTE ] CCS: Full fetch complete (44763 records). [2025-10-28T17:52:29.792816] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-28T17:52:30.122319] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-28T17:52:30.127935] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-28T17:52:30.136957] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-28T17:52:30.142350] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-28T17:52:30.221445] [DEBUG] [LOCAL ] CCU: Trimmed 32150 records to 20968 (keeping 200 days of data) [2025-10-28T17:52:30.251017] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T17:52:30.323020] [INFO ] [REMOTE ] CCRD: Full fetch complete (11718 records). [2025-10-28T17:52:30.373871] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-28T17:52:30.374341] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-28T17:52:30.484059] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-28T17:52:30.484172] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-28T17:52:30.499049] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-28T17:52:30.507692] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-28T17:52:30.554362] [DEBUG] [LOCAL ] CCU: Primary data saved (20968 records). [2025-10-28T17:52:30.569715] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-28T17:52:30.575134] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCU took 31.1s. Estimated remaining: 4h 3m 46s. Rate: 8.0 symbols/min [2025-10-28T17:52:30.584769] [DEBUG] [LOCAL ] CCS: Trimmed 44763 records to 29790 (keeping 200 days of data) [2025-10-28T17:52:31.124329] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:31.177986] [DEBUG] [LOCAL ] CCS: Primary data saved (29790 records). [2025-10-28T17:52:31.182711] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-28T17:52:31.182874] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CCS took 33.9s. Estimated remaining: 4h 3m 7s. Rate: 8.0 symbols/min [2025-10-28T17:52:31.364399] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-28T17:52:31.383055] [DEBUG] [LOCAL ] CDLR: Loaded 10141 existing records from primary storage. [2025-10-28T17:52:31.388390] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-28T17:52:31.406135] [INFO ] [MAIN ] CDLR: Loaded 10141 existing records. [2025-10-28T17:52:31.402806] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-28T17:52:31.406693] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-28T17:52:31.522350] [DEBUG] [LOCAL ] CCRD: Trimmed 11718 records to 9635 (keeping 200 days of data) [2025-10-28T17:52:31.553699] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:31.726736] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:31.730236] [DEBUG] [LOCAL ] CCRD: Primary data saved (9635 records). [2025-10-28T17:52:31.730515] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-28T17:52:31.731352] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-28T17:52:31.731450] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-28T17:52:31.731614] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CCRD took 36.5s. Estimated remaining: 4h 2m 27s. Rate: 8.0 symbols/min [2025-10-28T17:52:31.731890] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-28T17:52:31.743593] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-28T17:52:32.022999] [DEBUG] [LOCAL ] CDP: Loaded 42185 existing records from primary storage. [2025-10-28T17:52:32.060976] [INFO ] [MAIN ] CDP: Loaded 42185 existing records. [2025-10-28T17:52:32.060825] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:32.514850] [DEBUG] [LOCAL ] CDRE: Loaded 24420 existing records from primary storage. [2025-10-28T17:52:32.512477] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:32.515175] [INFO ] [MAIN ] CDRE: Loaded 24420 existing records. [2025-10-28T17:52:32.516308] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-28T17:52:32.519449] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:32.519812] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-28T17:52:32.520808] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-28T17:52:32.565832] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-28T17:52:32.615080] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-28T17:52:32.747212] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-28T17:52:32.849059] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:32.860625] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-28T17:52:32.867418] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-28T17:52:32.872731] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-28T17:52:32.901222] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-28T17:52:32.937006] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-28T17:52:33.330928] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:33.343712] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T17:52:33.366399] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-28T17:52:33.482135] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:33.559300] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-28T17:52:33.802116] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T17:52:34.359354] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-28T17:52:34.549037] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T17:52:34.763576] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:52:35.159369] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-28T17:52:35.185321] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T17:52:35.959400] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-28T17:52:36.397602] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:52:36.759398] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-28T17:52:37.120277] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:52:37.413942] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:52:37.559332] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-28T17:52:38.362233] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-28T17:52:38.369793] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:52:39.027157] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T17:52:39.159362] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-28T17:52:39.591462] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:52:39.959356] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-28T17:52:40.567508] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:52:40.759341] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-28T17:52:41.286973] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T17:52:41.559335] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-28T17:52:42.359352] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-28T17:52:42.912331] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:52:43.037013] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T17:52:43.159329] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-28T17:52:43.959342] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-28T17:52:44.264031] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:52:44.759311] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-28T17:52:45.559411] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-28T17:52:45.702289] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T17:52:46.051333] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:52:46.158890] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:52:46.359316] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-28T17:52:47.159388] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-28T17:52:47.653588] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:52:47.959338] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-28T17:52:48.154817] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T17:52:48.166234] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-28T17:52:48.166376] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-28T17:52:48.557428] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-28T17:52:48.557520] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-28T17:52:48.558447] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-28T17:52:48.558514] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-28T17:52:48.559990] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 53644 (keeping 200 days of data) [2025-10-28T17:52:48.742597] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:52:48.771525] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-28T17:52:48.772212] [INFO ] [REMOTE ] CDLR: Full fetch complete (14306 records). [2025-10-28T17:52:48.773454] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-28T17:52:48.776008] [FATAL] [VALIDATOR ] CDLR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:52:48.778491] [FATAL] [MAIN ] CDLR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:52:48.806677] [WARN ] [MAIN ] CDLR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:52:48.809443] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-28T17:52:48.809513] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-10-28T17:52:48.809551] [INFO ] [LOCAL ] CDLR: Starting deletion of derivative data. [2025-10-28T17:52:48.809757] [DEBUG] [LOCAL ] CDLR: Deleted derivative data file. [2025-10-28T17:52:48.809855] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDLR took 18.2s. Estimated remaining: 4h 3m 4s. Rate: 8.0 symbols/min [2025-10-28T17:52:49.009888] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-28T17:52:49.020307] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-28T17:52:49.033012] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDE took 34.5s. Estimated remaining: 4h 2m 23s. Rate: 8.0 symbols/min [2025-10-28T17:52:49.130291] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:49.241285] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:49.247532] [DEBUG] [LOCAL ] CEE: Loaded 4934 existing records from primary storage. [2025-10-28T17:52:49.247922] [INFO ] [MAIN ] CEE: Loaded 4934 existing records. [2025-10-28T17:52:49.423217] [DEBUG] [LOCAL ] CE: Loaded 51167 existing records from primary storage. [2025-10-28T17:52:49.445358] [INFO ] [MAIN ] CE: Loaded 51167 existing records. [2025-10-28T17:52:49.477784] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:49.504267] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-28T17:52:49.516427] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-28T17:52:49.539007] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-28T17:52:49.556734] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-28T17:52:49.573957] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-28T17:52:49.770631] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:49.781711] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-28T17:52:49.800383] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-28T17:52:49.845430] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-28T17:52:49.861787] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-28T17:52:50.052472] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:52:50.232464] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:50.364439] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-28T17:52:50.434316] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:51.076883] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T17:52:51.159335] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-28T17:52:51.268840] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:52:51.628460] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:52:51.959345] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-28T17:52:52.759425] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-28T17:52:53.102744] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T17:52:53.559315] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-28T17:52:53.740369] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T17:52:54.359318] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-28T17:52:54.588676] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T17:52:54.920497] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T17:52:55.159403] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-28T17:52:55.959343] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-28T17:52:56.480287] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T17:52:56.647557] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:52:56.759306] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-28T17:52:57.552636] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:52:57.559283] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-28T17:52:58.273972] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:52:58.359313] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-28T17:52:59.159392] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-28T17:52:59.686173] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:52:59.959377] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-28T17:53:00.386359] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:53:00.558065] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T17:53:00.759312] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-28T17:53:01.559390] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-28T17:53:01.822082] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T17:53:01.826740] [INFO ] [REMOTE ] CDRE: Full fetch complete (34793 records). [2025-10-28T17:53:01.826820] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-28T17:53:01.827338] [FATAL] [VALIDATOR ] CDRE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:53:01.827419] [FATAL] [MAIN ] CDRE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:53:01.827480] [WARN ] [MAIN ] CDRE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:53:01.827518] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-28T17:53:01.827571] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-10-28T17:53:01.827612] [INFO ] [LOCAL ] CDRE: Starting deletion of derivative data. [2025-10-28T17:53:01.827814] [DEBUG] [LOCAL ] CDRE: Deleted derivative data file. [2025-10-28T17:53:01.827906] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CDRE took 30.1s. Estimated remaining: 4h 2m 40s. Rate: 8.0 symbols/min [2025-10-28T17:53:01.997676] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:02.022207] [DEBUG] [LOCAL ] CEPU: Loaded 27156 existing records from primary storage. [2025-10-28T17:53:02.022446] [INFO ] [MAIN ] CEPU: Loaded 27156 existing records. [2025-10-28T17:53:02.217461] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T17:53:02.242088] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:02.244208] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-28T17:53:02.244518] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-28T17:53:02.245047] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-28T17:53:02.245105] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-28T17:53:02.364494] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-28T17:53:02.639553] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:03.159347] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-28T17:53:03.863904] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T17:53:03.959363] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-28T17:53:04.258441] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:53:04.759371] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-28T17:53:05.221945] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:53:05.559342] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-28T17:53:05.904184] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T17:53:06.359358] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-28T17:53:06.628623] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:53:06.696783] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:53:07.159341] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-28T17:53:07.591180] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T17:53:07.959336] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-28T17:53:08.759357] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-28T17:53:09.138369] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T17:53:09.162325] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T17:53:09.171016] [INFO ] [REMOTE ] CDP: Full fetch complete (62136 records). [2025-10-28T17:53:09.171124] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-28T17:53:09.544983] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-28T17:53:09.545066] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-28T17:53:09.545759] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-28T17:53:09.545839] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-28T17:53:09.546948] [DEBUG] [LOCAL ] CDP: Trimmed 62136 records to 42091 (keeping 200 days of data) [2025-10-28T17:53:09.598565] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-28T17:53:09.802926] [DEBUG] [LOCAL ] CDP: Primary data saved (42091 records). [2025-10-28T17:53:09.803061] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-28T17:53:09.803141] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CDP took 38.6s. Estimated remaining: 4h 2m 34s. Rate: 8.0 symbols/min [2025-10-28T17:53:09.969762] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:10.015526] [DEBUG] [LOCAL ] CF: Loaded 52070 existing records from primary storage. [2025-10-28T17:53:10.015893] [INFO ] [MAIN ] CF: Loaded 52070 existing records. [2025-10-28T17:53:10.189092] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:10.189283] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-28T17:53:10.189330] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-28T17:53:10.190165] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-28T17:53:10.190221] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-28T17:53:10.359376] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-28T17:53:10.566619] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:10.586102] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:53:11.159393] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-28T17:53:11.573352] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T17:53:11.582114] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:53:11.959322] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-28T17:53:12.685612] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T17:53:12.759350] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-28T17:53:13.559337] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-28T17:53:14.040911] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:53:14.361979] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-28T17:53:14.363098] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T17:53:15.159337] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-28T17:53:15.959319] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-28T17:53:16.015506] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:53:16.101520] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T17:53:16.312507] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T17:53:16.759376] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-28T17:53:17.559346] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-28T17:53:17.884595] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:53:18.017150] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T17:53:18.018334] [INFO ] [REMOTE ] CEE: Full fetch complete (9883 records). [2025-10-28T17:53:18.018401] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-28T17:53:18.369524] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-28T17:53:18.369904] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-28T17:53:18.370637] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-28T17:53:18.370897] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-28T17:53:18.370939] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-28T17:53:18.371351] [DEBUG] [LOCAL ] CEE: Trimmed 9883 records to 4853 (keeping 200 days of data) [2025-10-28T17:53:18.398951] [DEBUG] [LOCAL ] CEE: Primary data saved (4853 records). [2025-10-28T17:53:18.399026] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-28T17:53:18.399096] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CEE took 29.4s. Estimated remaining: 4h 2m 32s. Rate: 8.0 symbols/min [2025-10-28T17:53:18.565267] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:18.614290] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-28T17:53:18.614595] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-28T17:53:18.789120] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:18.789321] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-28T17:53:18.789365] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-28T17:53:18.790353] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-28T17:53:18.790410] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-28T17:53:19.136209] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:19.159301] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-28T17:53:19.661376] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:53:19.959331] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-28T17:53:20.492147] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:53:20.759375] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-28T17:53:21.181287] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T17:53:21.559396] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-28T17:53:21.972264] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:53:22.359344] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-28T17:53:22.729622] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:53:23.159377] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-28T17:53:23.847611] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T17:53:23.857638] [INFO ] [REMOTE ] CE: Full fetch complete (74737 records). [2025-10-28T17:53:23.857809] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-28T17:53:23.960795] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-28T17:53:24.283674] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T17:53:24.283818] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-28T17:53:24.289944] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-28T17:53:24.290888] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-28T17:53:24.291239] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-28T17:53:24.292608] [DEBUG] [LOCAL ] CE: Trimmed 74737 records to 51149 (keeping 200 days of data) [2025-10-28T17:53:24.587265] [DEBUG] [LOCAL ] CE: Primary data saved (51149 records). [2025-10-28T17:53:24.587403] [INFO ] [MAIN ] CE: Full history saved. [2025-10-28T17:53:24.587480] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CE took 35.8s. Estimated remaining: 4h 2m 18s. Rate: 8.0 symbols/min [2025-10-28T17:53:24.758180] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:24.758378] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-28T17:53:24.758417] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-28T17:53:24.758532] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-28T17:53:24.758574] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-28T17:53:24.758614] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-28T17:53:24.758672] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-28T17:53:24.770414] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-28T17:53:25.184157] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:25.431985] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:53:25.560508] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-28T17:53:25.564025] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:53:26.359333] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-28T17:53:26.901714] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T17:53:27.021966] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T17:53:27.159329] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-28T17:53:27.959393] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-28T17:53:28.118478] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:53:28.118751] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-28T17:53:28.118841] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:53:28.118907] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-28T17:53:28.118968] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:53:28.119033] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-28T17:53:28.119095] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-28T17:53:28.119131] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-28T17:53:28.119171] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-28T17:53:28.119215] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CFND took 3.5s. Estimated remaining: 4h 1m 53s. Rate: 8.0 symbols/min [2025-10-28T17:53:28.288332] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:28.288506] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-10-28T17:53:28.288543] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-10-28T17:53:28.288675] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-28T17:53:28.288737] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-28T17:53:28.288795] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-28T17:53:28.288837] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-28T17:53:28.659733] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:28.702262] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T17:53:28.759321] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-28T17:53:29.559353] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-28T17:53:30.207695] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:53:30.359331] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-28T17:53:30.657928] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T17:53:31.062926] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:53:31.159325] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-28T17:53:31.959340] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-28T17:53:32.432024] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T17:53:32.759327] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-28T17:53:33.100826] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:53:33.559478] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-28T17:53:33.793293] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:53:34.359346] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-28T17:53:34.535631] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:53:35.159382] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-28T17:53:35.246735] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:53:35.959375] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-28T17:53:36.643366] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T17:53:36.759335] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-28T17:53:37.221944] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T17:53:37.229494] [INFO ] [REMOTE ] CEPU: Full fetch complete (39776 records). [2025-10-28T17:53:37.229725] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-28T17:53:37.567923] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-28T17:53:37.606260] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-28T17:53:37.606327] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-28T17:53:37.606903] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-28T17:53:37.606963] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-28T17:53:37.607868] [DEBUG] [LOCAL ] CEPU: Trimmed 39776 records to 27302 (keeping 200 days of data) [2025-10-28T17:53:37.761065] [DEBUG] [LOCAL ] CEPU: Primary data saved (27302 records). [2025-10-28T17:53:37.761178] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-28T17:53:37.761257] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CEPU took 35.9s. Estimated remaining: 4h 1m 55s. Rate: 8.0 symbols/min [2025-10-28T17:53:37.926113] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:37.962942] [DEBUG] [LOCAL ] CGAU: Loaded 43897 existing records from primary storage. [2025-10-28T17:53:37.963263] [INFO ] [MAIN ] CGAU: Loaded 43897 existing records. [2025-10-28T17:53:38.135465] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:38.135673] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-28T17:53:38.135731] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-28T17:53:38.136363] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-28T17:53:38.136421] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-28T17:53:38.373761] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-28T17:53:38.489016] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:38.953035] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-28T17:53:39.169693] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-28T17:53:39.174749] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T17:53:39.762363] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:53:39.959329] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-28T17:53:40.314268] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:53:40.759311] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-28T17:53:40.993441] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T17:53:41.559338] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-28T17:53:41.840079] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:53:42.359335] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-28T17:53:42.596771] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:53:43.159346] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-28T17:53:43.649111] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:53:43.959392] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-28T17:53:44.066869] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:53:44.759435] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-28T17:53:45.244925] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:53:45.255349] [INFO ] [REMOTE ] CF: Full fetch complete (75585 records). [2025-10-28T17:53:45.255519] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-28T17:53:45.562463] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-28T17:53:45.658866] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-28T17:53:45.658945] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-28T17:53:45.659883] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-28T17:53:45.659948] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-28T17:53:45.661361] [DEBUG] [LOCAL ] CF: Trimmed 75585 records to 52048 (keeping 200 days of data) [2025-10-28T17:53:45.976338] [DEBUG] [LOCAL ] CF: Primary data saved (52048 records). [2025-10-28T17:53:45.976469] [INFO ] [MAIN ] CF: Full history saved. [2025-10-28T17:53:45.976545] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CF took 36.2s. Estimated remaining: 4h 1m 51s. Rate: 8.0 symbols/min [2025-10-28T17:53:46.150157] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:46.180032] [DEBUG] [LOCAL ] CGV: Loaded 1306 existing records from primary storage. [2025-10-28T17:53:46.181993] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:53:46.180736] [INFO ] [MAIN ] CGV: Loaded 1306 existing records. [2025-10-28T17:53:46.368307] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-28T17:53:46.374256] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:46.375247] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-28T17:53:46.375299] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-28T17:53:46.375443] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-28T17:53:46.375487] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-28T17:53:46.743494] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:46.768220] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:53:47.159394] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-28T17:53:47.804893] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T17:53:47.815763] [INFO ] [REMOTE ] CFG: Full fetch complete (77781 records). [2025-10-28T17:53:47.815945] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-28T17:53:47.966075] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-28T17:53:48.240021] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-28T17:53:48.240320] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-28T17:53:48.241588] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-28T17:53:48.241721] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-28T17:53:48.243421] [DEBUG] [LOCAL ] CFG: Trimmed 77781 records to 53622 (keeping 200 days of data) [2025-10-28T17:53:48.394060] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T17:53:48.602948] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:53:48.603100] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-28T17:53:48.604522] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-28T17:53:48.604962] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFG took 30.2s. Estimated remaining: 4h 1m 22s. Rate: 8.0 symbols/min [2025-10-28T17:53:48.771088] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-28T17:53:48.774249] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:48.774630] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-28T17:53:48.775575] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-28T17:53:48.775734] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-28T17:53:48.775782] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-28T17:53:48.775825] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-28T17:53:48.775857] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-28T17:53:49.129632] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:49.129805] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T17:53:49.559340] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-28T17:53:50.359352] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-28T17:53:50.473499] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T17:53:50.589611] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T17:53:51.159359] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-28T17:53:51.426424] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T17:53:51.959345] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-28T17:53:52.759309] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-28T17:53:52.956009] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:53:53.455026] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:53:53.559349] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-28T17:53:54.304685] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T17:53:54.359361] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-28T17:53:55.159315] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-28T17:53:55.203310] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T17:53:55.959315] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-28T17:53:55.999119] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T17:53:56.759340] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-28T17:53:57.000906] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T17:53:57.078676] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:53:57.559337] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-28T17:53:58.339303] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:53:58.359298] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-28T17:53:59.125554] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T17:53:59.159379] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-28T17:53:59.959385] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-28T17:54:00.174581] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T17:54:00.318271] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T17:54:00.759333] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-28T17:54:01.040624] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T17:54:01.559347] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-28T17:54:01.799481] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T17:54:02.359342] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-28T17:54:03.159368] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-28T17:54:03.383281] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:54:03.415711] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-28T17:54:03.959344] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-28T17:54:04.759399] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-28T17:54:05.076948] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:54:05.153205] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T17:54:05.154149] [INFO ] [REMOTE ] CGV: Full fetch complete (2169 records). [2025-10-28T17:54:05.154217] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-28T17:54:05.547855] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-28T17:54:05.547972] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-28T17:54:05.548116] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-28T17:54:05.548172] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-28T17:54:05.548625] [DEBUG] [LOCAL ] CGV: Trimmed 2169 records to 1299 (keeping 200 days of data) [2025-10-28T17:54:05.557469] [DEBUG] [LOCAL ] CGV: Primary data saved (1299 records). [2025-10-28T17:54:05.557558] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-28T17:54:05.557682] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CGV took 19.6s. Estimated remaining: 4h 1m 56s. Rate: 8.0 symbols/min [2025-10-28T17:54:05.567775] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-28T17:54:05.727336] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:05.727535] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-10-28T17:54:05.727571] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-10-28T17:54:05.727713] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-28T17:54:05.727785] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-28T17:54:05.727828] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-28T17:54:05.727860] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-28T17:54:06.111149] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:06.359366] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-28T17:54:06.680344] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:54:06.686867] [INFO ] [REMOTE ] CFR: Full fetch complete (48680 records). [2025-10-28T17:54:06.686987] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-28T17:54:07.080707] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T17:54:07.080828] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-28T17:54:07.085881] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-28T17:54:07.086723] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-28T17:54:07.086895] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-28T17:54:07.087980] [DEBUG] [LOCAL ] CFR: Trimmed 48680 records to 32148 (keeping 200 days of data) [2025-10-28T17:54:07.175634] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-28T17:54:07.286625] [DEBUG] [LOCAL ] CFR: Primary data saved (32148 records). [2025-10-28T17:54:07.286791] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-28T17:54:07.286867] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CFR took 39.2s. Estimated remaining: 4h 1m 23s. Rate: 8.0 symbols/min [2025-10-28T17:54:07.461978] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:07.478539] [DEBUG] [LOCAL ] CHE: Loaded 15307 existing records from primary storage. [2025-10-28T17:54:07.478811] [INFO ] [MAIN ] CHE: Loaded 15307 existing records. [2025-10-28T17:54:07.658506] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:07.658722] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-28T17:54:07.658780] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-28T17:54:07.659002] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-28T17:54:07.659043] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-28T17:54:07.960873] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-28T17:54:08.039901] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:08.049953] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:54:08.759368] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-28T17:54:09.554734] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:54:09.564416] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-28T17:54:09.595881] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:54:10.359324] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-28T17:54:10.519910] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T17:54:10.524802] [INFO ] [REMOTE ] CHCT: Full fetch complete (34709 records). [2025-10-28T17:54:10.524875] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-28T17:54:10.913255] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-28T17:54:10.913326] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-28T17:54:10.913817] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-28T17:54:10.913897] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-28T17:54:10.914609] [DEBUG] [LOCAL ] CHCT: Trimmed 34709 records to 23917 (keeping 200 days of data) [2025-10-28T17:54:11.053138] [DEBUG] [LOCAL ] CHCT: Primary data saved (23917 records). [2025-10-28T17:54:11.053300] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-28T17:54:11.053380] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHCT took 22.4s. Estimated remaining: 4h 0m 59s. Rate: 8.0 symbols/min [2025-10-28T17:54:11.164465] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-28T17:54:11.220112] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:11.260453] [DEBUG] [LOCAL ] CHGG: Loaded 47346 existing records from primary storage. [2025-10-28T17:54:11.260751] [INFO ] [MAIN ] CHGG: Loaded 47346 existing records. [2025-10-28T17:54:11.446504] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:11.446869] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-28T17:54:11.446976] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-28T17:54:11.455585] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-28T17:54:11.469261] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-28T17:54:11.502164] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:54:11.826353] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:11.959353] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-28T17:54:12.240909] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:54:12.759562] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-28T17:54:13.339850] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:54:13.559364] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-28T17:54:14.054989] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T17:54:14.075466] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:54:14.359358] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-28T17:54:14.988279] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T17:54:15.159364] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-28T17:54:15.959343] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-28T17:54:16.536148] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:54:16.649496] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:54:16.759397] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-28T17:54:17.559336] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-28T17:54:18.231586] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:54:18.251597] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T17:54:18.359365] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-28T17:54:19.159341] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-28T17:54:19.287204] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:54:19.959338] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-28T17:54:20.193782] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:54:20.759333] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-28T17:54:21.347400] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:54:21.559302] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-28T17:54:21.797836] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T17:54:22.359331] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-28T17:54:22.727574] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:54:23.159379] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-28T17:54:23.916565] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T17:54:23.959392] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-28T17:54:24.759355] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-28T17:54:24.908905] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T17:54:25.559307] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-28T17:54:25.658454] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T17:54:25.668518] [INFO ] [REMOTE ] CGAU: Full fetch complete (62368 records). [2025-10-28T17:54:25.668627] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-28T17:54:26.058918] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-28T17:54:26.058999] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-28T17:54:26.059721] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-28T17:54:26.059784] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-28T17:54:26.060938] [DEBUG] [LOCAL ] CGAU: Trimmed 62368 records to 43880 (keeping 200 days of data) [2025-10-28T17:54:26.320104] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T17:54:26.330670] [DEBUG] [LOCAL ] CGAU: Primary data saved (43880 records). [2025-10-28T17:54:26.330814] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-28T17:54:26.330911] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CGAU took 48.6s. Estimated remaining: 4h 1m 26s. Rate: 8.0 symbols/min [2025-10-28T17:54:26.362755] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-28T17:54:26.506537] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:26.550463] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-28T17:54:26.571917] [DEBUG] [LOCAL ] CHH: Loaded 32110 existing records from primary storage. [2025-10-28T17:54:26.572196] [INFO ] [MAIN ] CHH: Loaded 32110 existing records. [2025-10-28T17:54:26.758052] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:26.758283] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-28T17:54:26.758337] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-28T17:54:26.759085] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-28T17:54:26.759146] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-28T17:54:27.138126] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:27.149951] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:54:27.159289] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-28T17:54:27.935092] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:54:27.940136] [INFO ] [REMOTE ] CHE: Full fetch complete (20684 records). [2025-10-28T17:54:27.940235] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-28T17:54:27.967422] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-28T17:54:28.401306] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-28T17:54:28.401462] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-28T17:54:28.401884] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-28T17:54:28.401944] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-28T17:54:28.402534] [DEBUG] [LOCAL ] CHE: Trimmed 20684 records to 15358 (keeping 200 days of data) [2025-10-28T17:54:28.501974] [DEBUG] [LOCAL ] CHE: Primary data saved (15358 records). [2025-10-28T17:54:28.502388] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-28T17:54:28.502472] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHE took 21.2s. Estimated remaining: 4h 0m 55s. Rate: 8.0 symbols/min [2025-10-28T17:54:28.668609] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:28.668872] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-28T17:54:28.668914] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-28T17:54:28.669059] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-28T17:54:28.669099] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-28T17:54:28.669139] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-28T17:54:28.669170] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-28T17:54:28.764611] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-28T17:54:29.023702] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:29.421547] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:54:29.559354] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-28T17:54:30.245916] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T17:54:30.359350] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-28T17:54:30.630928] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:54:31.159336] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-28T17:54:31.868980] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T17:54:31.959368] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-28T17:54:32.434381] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T17:54:32.759366] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-28T17:54:32.815949] [DEBUG] [REMOTE ] CHGG: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-28T17:54:32.816286] [WARN ] [REMOTE ] CHGG: No data returned for month 2025-08 [2025-10-28T17:54:32.816381] [FATAL] [REMOTE ] CHGG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:54:32.816459] [FATAL] [MAIN ] CHGG: Failed to fetch primary data. [2025-10-28T17:54:32.816495] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:54:32.816531] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-28T17:54:32.816585] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-28T17:54:32.816620] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-10-28T17:54:32.817009] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-10-28T17:54:32.817459] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHGG took 21.8s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-10-28T17:54:33.246713] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:54:33.559350] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-28T17:54:34.359335] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-28T17:54:34.413886] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:54:35.159361] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-28T17:54:35.442916] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:54:35.787555] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:54:35.959342] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-28T17:54:36.747540] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:54:36.759301] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-28T17:54:37.559338] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-28T17:54:37.743701] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T17:54:38.359346] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-28T17:54:38.668625] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:54:39.041965] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:54:39.159309] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-28T17:54:39.898612] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T17:54:39.959304] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-28T17:54:40.759338] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-28T17:54:41.559364] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-28T17:54:41.665763] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:54:41.894193] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:54:42.253212] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:54:42.359301] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-28T17:54:43.159342] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-28T17:54:43.946517] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:54:43.964467] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-28T17:54:43.983530] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T17:54:44.759344] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-28T17:54:44.921795] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T17:54:45.559318] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-28T17:54:45.575097] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:54:46.359307] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-28T17:54:46.440491] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T17:54:47.081354] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T17:54:47.159330] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-28T17:54:47.959387] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-28T17:54:48.533514] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T17:54:48.543911] [INFO ] [REMOTE ] CHD: Full fetch complete (75012 records). [2025-10-28T17:54:48.544062] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-28T17:54:48.774501] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-28T17:54:48.943629] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-28T17:54:48.943810] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-28T17:54:48.944692] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-28T17:54:48.944901] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-28T17:54:48.946466] [DEBUG] [LOCAL ] CHD: Trimmed 75012 records to 52297 (keeping 200 days of data) [2025-10-28T17:54:49.079985] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:54:49.292819] [DEBUG] [LOCAL ] CHD: Primary data saved (52297 records). [2025-10-28T17:54:49.292966] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-28T17:54:49.293040] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHD took 43.7s. Estimated remaining: 4h 1m 6s. Rate: 8.0 symbols/min [2025-10-28T17:54:49.559378] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-28T17:54:49.622375] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T17:54:49.626543] [INFO ] [REMOTE ] CHMI: Full fetch complete (31181 records). [2025-10-28T17:54:49.626617] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-28T17:54:50.004697] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-28T17:54:50.004787] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-28T17:54:50.005272] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-28T17:54:50.005310] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-28T17:54:50.006099] [DEBUG] [LOCAL ] CHMI: Trimmed 31181 records to 20680 (keeping 200 days of data) [2025-10-28T17:54:50.122395] [DEBUG] [LOCAL ] CHMI: Primary data saved (20680 records). [2025-10-28T17:54:50.122512] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-28T17:54:50.122577] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHMI took 21.6s. Estimated remaining: 4h 0m 29s. Rate: 8.0 symbols/min [2025-10-28T17:54:50.849595] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:54:50.857179] [INFO ] [REMOTE ] CHH: Full fetch complete (47682 records). [2025-10-28T17:54:50.857379] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-28T17:54:51.237172] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-28T17:54:51.237249] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-28T17:54:51.237878] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-28T17:54:51.237940] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-28T17:54:51.238991] [DEBUG] [LOCAL ] CHH: Trimmed 47682 records to 32029 (keeping 200 days of data) [2025-10-28T17:54:51.431772] [DEBUG] [LOCAL ] CHH: Primary data saved (32029 records). [2025-10-28T17:54:51.431907] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-28T17:54:51.431980] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHH took 25.1s. Estimated remaining: 3h 59m 54s. Rate: 8.0 symbols/min [2025-10-28T17:54:52.084702] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.090918] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.098147] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.121067] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-28T17:54:52.127664] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-28T17:54:52.130947] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-28T17:54:52.135703] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-28T17:54:52.153723] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-28T17:54:52.158737] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-28T17:54:52.163105] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.251631] [DEBUG] [LOCAL ] CHT: Loaded 19042 existing records from primary storage. [2025-10-28T17:54:52.276560] [INFO ] [MAIN ] CHT: Loaded 19042 existing records. [2025-10-28T17:54:52.472713] [DEBUG] [LOCAL ] CHPT: Loaded 46484 existing records from primary storage. [2025-10-28T17:54:52.515872] [INFO ] [MAIN ] CHPT: Loaded 46484 existing records. [2025-10-28T17:54:52.786667] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:52.961718] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-28T17:54:52.961887] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-28T17:54:52.966540] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:52.968039] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-28T17:54:52.961572] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:52.968403] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-28T17:54:52.968570] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-28T17:54:52.968773] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-28T17:54:52.968626] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-28T17:54:52.989262] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-28T17:54:52.989199] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-28T17:54:53.003377] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-28T17:54:52.969100] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-28T17:54:53.462962] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:53.527875] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-28T17:54:53.547558] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-28T17:54:53.605175] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-28T17:54:53.620927] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-28T17:54:53.884496] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:54:53.895748] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-28T17:54:53.951917] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:54.032732] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-28T17:54:54.090961] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:54.142924] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-28T17:54:54.264891] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:54.265151] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-28T17:54:54.339302] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T17:54:54.359356] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-28T17:54:54.707260] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:54:54.716686] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T17:54:55.159353] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-28T17:54:55.803867] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:54:55.848620] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:54:55.959316] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-28T17:54:56.231538] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T17:54:56.759399] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-28T17:54:57.426630] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T17:54:57.448822] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T17:54:57.559311] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-28T17:54:58.314312] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:54:58.359294] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-28T17:54:59.159315] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-28T17:54:59.964435] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-28T17:54:59.988701] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T17:55:00.014220] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T17:55:00.539326] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T17:55:00.759314] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-28T17:55:01.559354] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-28T17:55:01.924540] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:55:02.359387] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-28T17:55:03.159351] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-28T17:55:03.173628] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T17:55:03.592780] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-28T17:55:03.959360] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-28T17:55:04.759413] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-28T17:55:04.915988] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-28T17:55:05.314362] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T17:55:05.559291] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-28T17:55:05.705333] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T17:55:05.953169] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T17:55:06.359348] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-28T17:55:06.836906] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:55:07.159342] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-28T17:55:07.552793] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T17:55:07.959366] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-28T17:55:08.759348] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-28T17:55:09.559361] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-28T17:55:09.624353] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T17:55:10.251176] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:55:10.252854] [INFO ] [REMOTE ] CHN: Full fetch complete (7608 records). [2025-10-28T17:55:10.252921] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-28T17:55:10.364540] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-28T17:55:10.628192] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-28T17:55:10.628309] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-28T17:55:10.628734] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-28T17:55:10.628849] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-28T17:55:10.629513] [DEBUG] [LOCAL ] CHN: Trimmed 7608 records to 4981 (keeping 200 days of data) [2025-10-28T17:55:10.660367] [DEBUG] [LOCAL ] CHN: Primary data saved (4981 records). [2025-10-28T17:55:10.660618] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-28T17:55:10.660746] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CHN took 19.2s. Estimated remaining: 4h 0m 38s. Rate: 8.0 symbols/min [2025-10-28T17:55:10.869415] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-28T17:55:10.873241] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:10.934843] [DEBUG] [LOCAL ] CI: Loaded 49475 existing records from primary storage. [2025-10-28T17:55:10.935177] [INFO ] [MAIN ] CI: Loaded 49475 existing records. [2025-10-28T17:55:11.113215] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:11.113410] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-28T17:55:11.113456] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-28T17:55:11.113792] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-28T17:55:11.113848] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-28T17:55:11.170852] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-28T17:55:11.478730] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:11.521060] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:55:11.959365] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-28T17:55:12.745823] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:55:12.759299] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-28T17:55:12.793854] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:55:13.559349] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-28T17:55:14.359321] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-28T17:55:14.398412] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T17:55:15.025982] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:55:15.058168] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T17:55:15.159355] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-28T17:55:15.959357] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-28T17:55:16.499243] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T17:55:16.759359] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-28T17:55:16.772951] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:55:16.777008] [INFO ] [REMOTE ] CHT: Full fetch complete (27563 records). [2025-10-28T17:55:16.777169] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-28T17:55:16.777721] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:55:16.777817] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:55:16.777898] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:55:16.777983] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-28T17:55:16.778060] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-28T17:55:16.778337] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-28T17:55:16.778716] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-28T17:55:16.778821] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CHT took 25.3s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-10-28T17:55:16.951198] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:16.965575] [DEBUG] [LOCAL ] CIA: Loaded 16250 existing records from primary storage. [2025-10-28T17:55:16.965833] [INFO ] [MAIN ] CIA: Loaded 16250 existing records. [2025-10-28T17:55:17.146203] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:17.146411] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-28T17:55:17.146459] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-28T17:55:17.146821] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-28T17:55:17.146880] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-28T17:55:17.514401] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:17.559351] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-28T17:55:18.274750] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T17:55:18.334330] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:55:18.359307] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-28T17:55:19.159318] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-28T17:55:19.737870] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:55:19.959351] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-28T17:55:20.642021] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:55:20.759357] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-28T17:55:21.365270] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:55:21.386779] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:55:21.559355] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-28T17:55:22.359338] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-28T17:55:22.922814] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:55:23.159335] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-28T17:55:23.835788] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:55:23.959351] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-28T17:55:24.759365] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-28T17:55:25.138811] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T17:55:25.539136] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:55:25.551745] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-28T17:55:25.551923] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-28T17:55:25.564552] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-28T17:55:26.016119] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-28T17:55:26.016218] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-28T17:55:26.017193] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-28T17:55:26.017288] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-28T17:55:26.018824] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 53654 (keeping 200 days of data) [2025-10-28T17:55:26.334128] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-28T17:55:26.334386] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-28T17:55:26.334497] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 34.9s. Estimated remaining: 4h 0m 26s. Rate: 8.0 symbols/min [2025-10-28T17:55:26.365455] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-28T17:55:26.513044] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T17:55:26.546286] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:26.546898] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-28T17:55:26.546947] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-28T17:55:26.547106] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-28T17:55:26.547524] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-28T17:55:26.547587] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-28T17:55:26.547622] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-28T17:55:26.924426] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:26.948597] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:55:27.060636] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T17:55:27.159358] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-28T17:55:27.959306] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-28T17:55:28.281812] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:55:28.759335] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-28T17:55:28.914435] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:55:29.559345] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-28T17:55:30.141161] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:55:30.364421] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-28T17:55:30.374071] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T17:55:31.159359] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-28T17:55:31.715147] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:55:31.959330] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-28T17:55:32.018037] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T17:55:32.759361] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-28T17:55:33.358866] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:55:33.559371] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-28T17:55:33.823834] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:55:34.151034] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:55:34.359335] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-28T17:55:35.159395] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-28T17:55:35.959385] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-28T17:55:36.021205] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:55:36.030297] [INFO ] [REMOTE ] CHPT: Full fetch complete (70405 records). [2025-10-28T17:55:36.030503] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-28T17:55:36.427726] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-28T17:55:36.427958] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-28T17:55:36.428876] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-28T17:55:36.429176] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-28T17:55:36.449058] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:55:36.451837] [DEBUG] [LOCAL ] CHPT: Trimmed 70405 records to 46294 (keeping 200 days of data) [2025-10-28T17:55:36.577889] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T17:55:36.603678] [INFO ] [REMOTE ] CI: Full fetch complete (72001 records). [2025-10-28T17:55:36.605951] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-28T17:55:36.771094] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-28T17:55:37.068626] [DEBUG] [LOCAL ] CHPT: Primary data saved (46294 records). [2025-10-28T17:55:37.074556] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-28T17:55:37.079885] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CHPT took 45.6s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min [2025-10-28T17:55:37.311180] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-28T17:55:37.323523] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-28T17:55:37.339939] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-28T17:55:37.341113] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-28T17:55:37.342622] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:37.342931] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-28T17:55:37.343058] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-28T17:55:37.343295] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-28T17:55:37.343407] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-28T17:55:37.343598] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-28T17:55:37.343688] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-28T17:55:37.375227] [DEBUG] [LOCAL ] CI: Trimmed 72001 records to 49430 (keeping 200 days of data) [2025-10-28T17:55:37.562773] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-28T17:55:37.839302] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:38.020367] [DEBUG] [LOCAL ] CI: Primary data saved (49430 records). [2025-10-28T17:55:38.020491] [INFO ] [MAIN ] CI: Full history saved. [2025-10-28T17:55:38.021006] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CI took 27.4s. Estimated remaining: 3h 59m 57s. Rate: 8.0 symbols/min [2025-10-28T17:55:38.188367] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:38.210785] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:55:38.261706] [DEBUG] [LOCAL ] CIEN: Loaded 52090 existing records from primary storage. [2025-10-28T17:55:38.262005] [INFO ] [MAIN ] CIEN: Loaded 52090 existing records. [2025-10-28T17:55:38.360402] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-28T17:55:38.441180] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:38.441585] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-28T17:55:38.441693] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-28T17:55:38.447681] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-28T17:55:38.456700] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-28T17:55:38.472299] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T17:55:38.835814] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:38.830819] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:55:39.159370] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-28T17:55:39.959366] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-28T17:55:40.216491] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-28T17:55:40.554901] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:55:40.759334] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-28T17:55:40.961921] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-28T17:55:41.559373] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-28T17:55:41.823191] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-28T17:55:42.359334] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-28T17:55:43.159380] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-28T17:55:43.300079] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T17:55:43.959373] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-28T17:55:43.994984] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T17:55:44.224826] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T17:55:44.759356] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-28T17:55:45.559338] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-28T17:55:45.865556] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T17:55:45.948550] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:55:46.359356] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-28T17:55:47.014818] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T17:55:47.159339] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-28T17:55:47.714392] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T17:55:47.959337] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-28T17:55:48.214727] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T17:55:48.759334] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-28T17:55:49.559317] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-28T17:55:49.646446] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:55:50.328308] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T17:55:50.331192] [INFO ] [REMOTE ] CIA: Full fetch complete (23145 records). [2025-10-28T17:55:50.331290] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-28T17:55:50.364454] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-28T17:55:50.726262] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-28T17:55:50.726384] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-28T17:55:50.727316] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-28T17:55:50.727393] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-28T17:55:50.728427] [DEBUG] [LOCAL ] CIA: Trimmed 23145 records to 16202 (keeping 200 days of data) [2025-10-28T17:55:50.843958] [DEBUG] [LOCAL ] CIA: Primary data saved (16202 records). [2025-10-28T17:55:50.844093] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-28T17:55:50.844172] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CIA took 34.1s. Estimated remaining: 4h 0m 12s. Rate: 8.0 symbols/min [2025-10-28T17:55:51.014160] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:51.019585] [DEBUG] [LOCAL ] CIF: Loaded 3862 existing records from primary storage. [2025-10-28T17:55:51.019829] [INFO ] [MAIN ] CIF: Loaded 3862 existing records. [2025-10-28T17:55:51.165743] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-28T17:55:51.196749] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:51.197246] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-28T17:55:51.197303] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-28T17:55:51.197482] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-28T17:55:51.197524] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-28T17:55:51.544867] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:51.548185] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T17:55:51.771796] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T17:55:51.959345] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-28T17:55:52.199301] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T17:55:52.759390] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-28T17:55:53.065658] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T17:55:53.066495] [INFO ] [REMOTE ] CICB: Full fetch complete (1919 records). [2025-10-28T17:55:53.066565] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-28T17:55:53.241292] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T17:55:53.241463] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:55:53.241508] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:55:53.241571] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-28T17:55:53.241630] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-28T17:55:53.241701] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-28T17:55:53.241753] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-28T17:55:53.241807] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CICB took 16.2s. Estimated remaining: 3h 59m 43s. Rate: 8.0 symbols/min [2025-10-28T17:55:53.403881] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:53.441171] [DEBUG] [LOCAL ] CIG: Loaded 44462 existing records from primary storage. [2025-10-28T17:55:53.441439] [INFO ] [MAIN ] CIG: Loaded 44462 existing records. [2025-10-28T17:55:53.564572] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-28T17:55:53.617583] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:53.617778] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-28T17:55:53.617823] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-28T17:55:53.618562] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-28T17:55:53.618618] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-28T17:55:53.962924] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:54.359331] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-28T17:55:54.542503] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T17:55:55.159352] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-28T17:55:55.412943] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:55:55.959385] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-28T17:55:56.493464] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:55:56.751441] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:55:56.759291] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-28T17:55:57.559339] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-28T17:55:57.611511] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T17:55:58.359380] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-28T17:55:58.464400] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T17:55:58.761004] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T17:55:59.159323] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-28T17:55:59.959390] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-28T17:56:00.136173] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T17:56:00.142355] [INFO ] [REMOTE ] CIB: Full fetch complete (45424 records). [2025-10-28T17:56:00.142497] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-28T17:56:00.518556] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-28T17:56:00.518677] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-28T17:56:00.519290] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-28T17:56:00.519354] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-28T17:56:00.520448] [DEBUG] [LOCAL ] CIB: Trimmed 45424 records to 29643 (keeping 200 days of data) [2025-10-28T17:56:00.688360] [DEBUG] [LOCAL ] CIB: Primary data saved (29643 records). [2025-10-28T17:56:00.688500] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-28T17:56:00.688570] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CIB took 34.4s. Estimated remaining: 3h 59m 35s. Rate: 8.0 symbols/min [2025-10-28T17:56:00.765014] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-28T17:56:00.864952] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:00.881481] [DEBUG] [LOCAL ] CII: Loaded 14625 existing records from primary storage. [2025-10-28T17:56:00.881782] [INFO ] [MAIN ] CII: Loaded 14625 existing records. [2025-10-28T17:56:01.059944] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:01.060139] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-28T17:56:01.060186] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-28T17:56:01.060521] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-28T17:56:01.060579] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-28T17:56:01.413099] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:01.564382] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-28T17:56:01.581555] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T17:56:02.359381] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-28T17:56:02.945632] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-28T17:56:03.115106] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T17:56:03.159354] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-28T17:56:03.580716] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T17:56:03.959390] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-28T17:56:04.455431] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:56:04.759330] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-28T17:56:05.060238] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T17:56:05.559342] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-28T17:56:06.094952] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:56:06.161546] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:56:06.359343] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-28T17:56:06.973469] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T17:56:07.159386] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-28T17:56:07.959397] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-28T17:56:08.413108] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:56:08.759355] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-28T17:56:09.143457] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:56:09.449310] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:56:09.559332] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-28T17:56:10.097830] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:56:10.359366] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-28T17:56:11.159323] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-28T17:56:11.473268] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T17:56:11.692903] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T17:56:11.959408] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-28T17:56:12.456817] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T17:56:12.759371] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-28T17:56:13.270155] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T17:56:13.559332] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-28T17:56:14.359378] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-28T17:56:14.783740] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T17:56:14.879117] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:56:15.159325] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-28T17:56:15.574097] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T17:56:15.959398] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-28T17:56:16.759372] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-28T17:56:17.277228] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T17:56:17.459935] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T17:56:17.559362] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-28T17:56:18.333018] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T17:56:18.336758] [INFO ] [REMOTE ] CII: Full fetch complete (22800 records). [2025-10-28T17:56:18.336835] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-28T17:56:18.366154] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-28T17:56:18.704879] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-28T17:56:18.704976] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-28T17:56:18.705305] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-28T17:56:18.705343] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-28T17:56:18.705939] [DEBUG] [LOCAL ] CII: Trimmed 22800 records to 14584 (keeping 200 days of data) [2025-10-28T17:56:18.790105] [DEBUG] [LOCAL ] CII: Primary data saved (14584 records). [2025-10-28T17:56:18.790228] [INFO ] [MAIN ] CII: Full history saved. [2025-10-28T17:56:18.790305] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CII took 18.1s. Estimated remaining: 4h 0m 13s. Rate: 8.0 symbols/min [2025-10-28T17:56:18.955591] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:18.989870] [DEBUG] [LOCAL ] CIM: Loaded 37039 existing records from primary storage. [2025-10-28T17:56:18.990128] [INFO ] [MAIN ] CIM: Loaded 37039 existing records. [2025-10-28T17:56:19.164517] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-28T17:56:19.168704] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:19.169956] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-28T17:56:19.170005] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-28T17:56:19.170445] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-28T17:56:19.170502] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-28T17:56:19.515586] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:19.570734] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:56:19.952479] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:56:19.962160] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-28T17:56:19.963972] [INFO ] [REMOTE ] CIEN: Full fetch complete (75838 records). [2025-10-28T17:56:19.964055] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-28T17:56:20.344918] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-28T17:56:20.344999] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-28T17:56:20.345825] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-28T17:56:20.345886] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-28T17:56:20.347281] [DEBUG] [LOCAL ] CIEN: Trimmed 75838 records to 52075 (keeping 200 days of data) [2025-10-28T17:56:20.435732] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T17:56:20.656303] [DEBUG] [LOCAL ] CIEN: Primary data saved (52075 records). [2025-10-28T17:56:20.656434] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-28T17:56:20.656859] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIEN took 42.6s. Estimated remaining: 3h 59m 41s. Rate: 8.0 symbols/min [2025-10-28T17:56:20.764452] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-28T17:56:20.824034] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:20.824189] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-28T17:56:20.824225] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-28T17:56:20.824331] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-28T17:56:20.824371] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-28T17:56:20.824411] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-28T17:56:20.824441] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-28T17:56:21.186567] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:21.559339] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-28T17:56:22.051009] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:56:22.359310] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-28T17:56:22.486245] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:56:23.159341] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-28T17:56:23.373583] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T17:56:23.620400] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T17:56:23.959337] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-28T17:56:24.759359] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-28T17:56:25.414286] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:56:25.423873] [INFO ] [REMOTE ] CIG: Full fetch complete (62968 records). [2025-10-28T17:56:25.423995] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-28T17:56:25.559532] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-28T17:56:25.849013] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-28T17:56:25.849227] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-28T17:56:25.850221] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-28T17:56:25.850305] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-28T17:56:25.872944] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:56:25.880666] [DEBUG] [LOCAL ] CIG: Trimmed 62968 records to 44535 (keeping 200 days of data) [2025-10-28T17:56:26.054574] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T17:56:26.139925] [DEBUG] [LOCAL ] CIG: Primary data saved (44535 records). [2025-10-28T17:56:26.140054] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-28T17:56:26.140156] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIG took 32.9s. Estimated remaining: 3h 59m 25s. Rate: 8.0 symbols/min [2025-10-28T17:56:26.315588] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:26.315790] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-28T17:56:26.315837] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-28T17:56:26.315955] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-28T17:56:26.315997] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-28T17:56:26.316038] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-28T17:56:26.316071] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-28T17:56:26.364560] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-28T17:56:26.675825] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:26.783875] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T17:56:27.159337] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-28T17:56:27.624586] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T17:56:27.625795] [INFO ] [REMOTE ] CIF: Full fetch complete (6536 records). [2025-10-28T17:56:27.625863] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-28T17:56:27.966552] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-28T17:56:27.974782] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-28T17:56:27.974899] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-28T17:56:27.975108] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-28T17:56:27.975148] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-28T17:56:27.975532] [DEBUG] [LOCAL ] CIF: Trimmed 6536 records to 3832 (keeping 200 days of data) [2025-10-28T17:56:27.998542] [DEBUG] [LOCAL ] CIF: Primary data saved (3832 records). [2025-10-28T17:56:27.998712] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-28T17:56:27.999197] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CIF took 37.2s. Estimated remaining: 3h 58m 54s. Rate: 8.0 symbols/min [2025-10-28T17:56:28.168631] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:28.168946] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-28T17:56:28.168998] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-28T17:56:28.169121] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-28T17:56:28.169161] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-28T17:56:28.169201] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-28T17:56:28.169233] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-28T17:56:28.518178] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:56:28.523197] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:28.759306] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-28T17:56:28.899038] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:56:28.899269] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-28T17:56:28.899352] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:56:28.899423] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-28T17:56:28.899486] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:56:28.899556] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-28T17:56:28.899616] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-28T17:56:28.899687] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-28T17:56:28.899746] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-28T17:56:28.899793] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIMP took 0.9s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-28T17:56:29.065169] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:29.084267] [DEBUG] [LOCAL ] CINT: Loaded 20484 existing records from primary storage. [2025-10-28T17:56:29.084489] [INFO ] [MAIN ] CINT: Loaded 20484 existing records. [2025-10-28T17:56:29.257376] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:29.257560] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-28T17:56:29.257625] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-28T17:56:29.258014] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-28T17:56:29.258087] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-28T17:56:29.567260] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-28T17:56:29.607779] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:29.878735] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T17:56:30.359340] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-28T17:56:31.159347] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-28T17:56:31.510096] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:56:31.870411] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T17:56:31.959329] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-28T17:56:32.585733] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:56:32.759333] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-28T17:56:33.043329] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:56:33.559331] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-28T17:56:34.026613] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T17:56:34.359324] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-28T17:56:34.644845] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T17:56:35.159352] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-28T17:56:35.569893] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:56:35.959334] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-28T17:56:36.299234] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T17:56:36.759331] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-28T17:56:37.331352] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T17:56:37.559337] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-28T17:56:37.977380] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T17:56:38.359380] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-28T17:56:39.027745] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T17:56:39.159364] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-28T17:56:39.521256] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T17:56:39.959374] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-28T17:56:40.617621] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T17:56:40.759343] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-28T17:56:41.043819] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:56:41.559359] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-28T17:56:41.893508] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T17:56:42.359364] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-28T17:56:43.159382] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-28T17:56:43.521807] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:56:43.863037] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T17:56:43.959352] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-28T17:56:44.296932] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:56:44.759328] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-28T17:56:45.051939] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T17:56:45.559346] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-28T17:56:46.359316] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-28T17:56:46.560202] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T17:56:46.730751] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:56:47.159372] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-28T17:56:47.959477] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-28T17:56:48.085628] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:56:48.322919] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T17:56:48.759324] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-28T17:56:49.207262] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:56:49.208447] [INFO ] [REMOTE ] CIMO: Full fetch complete (4537 records). [2025-10-28T17:56:49.208518] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-28T17:56:49.386611] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T17:56:49.386818] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:56:49.386885] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:56:49.386952] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-28T17:56:49.387013] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-28T17:56:49.387057] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-28T17:56:49.387136] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-28T17:56:49.387196] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIMO took 23.2s. Estimated remaining: 3h 59m 6s. Rate: 8.0 symbols/min [2025-10-28T17:56:49.552439] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:49.563118] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-28T17:56:49.572950] [DEBUG] [LOCAL ] CIO: Loaded 21195 existing records from primary storage. [2025-10-28T17:56:49.573152] [INFO ] [MAIN ] CIO: Loaded 21195 existing records. [2025-10-28T17:56:49.747532] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:49.747825] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-28T17:56:49.747872] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-28T17:56:49.748350] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-28T17:56:49.748407] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-28T17:56:50.098833] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:50.359292] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-28T17:56:50.534355] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T17:56:51.108463] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:56:51.159341] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-28T17:56:51.757391] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:56:51.959326] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-28T17:56:52.614239] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T17:56:52.759316] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-28T17:56:53.526695] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T17:56:53.559302] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-28T17:56:54.180741] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T17:56:54.359352] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-28T17:56:55.141233] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T17:56:55.159336] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-28T17:56:55.820370] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T17:56:55.959353] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-28T17:56:56.706154] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:56:56.759302] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-28T17:56:57.559342] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-28T17:56:57.809976] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:56:57.815939] [INFO ] [REMOTE ] CINT: Full fetch complete (28813 records). [2025-10-28T17:56:57.816017] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-28T17:56:57.992460] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:56:58.189778] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-28T17:56:58.189872] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-28T17:56:58.190387] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-28T17:56:58.190450] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-28T17:56:58.191224] [DEBUG] [LOCAL ] CINT: Trimmed 28813 records to 20423 (keeping 200 days of data) [2025-10-28T17:56:58.302222] [DEBUG] [LOCAL ] CINT: Primary data saved (20423 records). [2025-10-28T17:56:58.302349] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-28T17:56:58.302426] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CINT took 29.4s. Estimated remaining: 3h 59m 4s. Rate: 8.0 symbols/min [2025-10-28T17:56:58.364550] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-28T17:56:58.506215] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:58.506396] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-28T17:56:58.506435] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-28T17:56:58.506550] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-28T17:56:58.506591] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-28T17:56:58.506634] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-28T17:56:58.506710] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-28T17:56:58.785767] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:56:58.861864] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:59.159323] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-28T17:56:59.959319] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-28T17:57:00.010049] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:57:00.265049] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T17:57:00.759419] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-28T17:57:01.559347] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-28T17:57:01.837861] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T17:57:02.359369] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-28T17:57:02.528390] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:57:03.159327] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-28T17:57:03.434194] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:57:03.959334] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-28T17:57:03.982105] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T17:57:04.669615] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T17:57:04.759306] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-28T17:57:05.231611] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T17:57:05.232724] [INFO ] [REMOTE ] CIMN: Full fetch complete (3883 records). [2025-10-28T17:57:05.232792] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-28T17:57:05.564490] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-28T17:57:05.593439] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-28T17:57:05.593508] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-28T17:57:05.593624] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-28T17:57:05.593694] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-28T17:57:05.594045] [DEBUG] [LOCAL ] CIMN: Trimmed 3883 records to 2662 (keeping 200 days of data) [2025-10-28T17:57:05.610422] [DEBUG] [LOCAL ] CIMN: Primary data saved (2662 records). [2025-10-28T17:57:05.610627] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-28T17:57:05.610794] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIMN took 45.0s. Estimated remaining: 3h 58m 56s. Rate: 8.0 symbols/min [2025-10-28T17:57:05.776736] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:05.824670] [DEBUG] [LOCAL ] CIVI: Loaded 52668 existing records from primary storage. [2025-10-28T17:57:05.824972] [INFO ] [MAIN ] CIVI: Loaded 52668 existing records. [2025-10-28T17:57:05.997295] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:05.997481] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-28T17:57:05.997527] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-28T17:57:05.998042] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-28T17:57:05.998099] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-28T17:57:06.347182] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:06.359299] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-28T17:57:06.406901] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:57:07.159346] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-28T17:57:07.621428] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T17:57:07.629347] [INFO ] [REMOTE ] CIM: Full fetch complete (54712 records). [2025-10-28T17:57:07.629474] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-28T17:57:07.969751] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-28T17:57:08.032367] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-28T17:57:08.032483] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-28T17:57:08.033376] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-28T17:57:08.033445] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-28T17:57:08.034747] [DEBUG] [LOCAL ] CIM: Trimmed 54712 records to 36901 (keeping 200 days of data) [2025-10-28T17:57:08.259591] [DEBUG] [LOCAL ] CIM: Primary data saved (36901 records). [2025-10-28T17:57:08.259761] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-28T17:57:08.259867] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CIM took 49.5s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-28T17:57:08.440417] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:08.472753] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:57:08.532850] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-28T17:57:08.533197] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-28T17:57:08.717853] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:08.718259] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-28T17:57:08.718314] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-28T17:57:08.718954] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-28T17:57:08.719014] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-28T17:57:08.761723] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-28T17:57:08.851857] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T17:57:09.103554] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:09.559371] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-28T17:57:10.036940] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T17:57:10.359398] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-28T17:57:10.696320] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T17:57:11.159414] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-28T17:57:11.628917] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:57:11.908898] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:57:11.959308] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-28T17:57:12.759337] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-28T17:57:13.127548] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T17:57:13.133464] [INFO ] [REMOTE ] CIO: Full fetch complete (29916 records). [2025-10-28T17:57:13.133550] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-28T17:57:13.513601] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-28T17:57:13.513765] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-28T17:57:13.514410] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-28T17:57:13.514592] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-28T17:57:13.515837] [DEBUG] [LOCAL ] CIO: Trimmed 29916 records to 21194 (keeping 200 days of data) [2025-10-28T17:57:13.573706] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-28T17:57:13.585334] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T17:57:13.658169] [DEBUG] [LOCAL ] CIO: Primary data saved (21194 records). [2025-10-28T17:57:13.658264] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-28T17:57:13.658344] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIO took 24.3s. Estimated remaining: 3h 58m 12s. Rate: 8.0 symbols/min [2025-10-28T17:57:13.829096] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:13.862380] [DEBUG] [LOCAL ] CLB: Loaded 33471 existing records from primary storage. [2025-10-28T17:57:13.862672] [INFO ] [MAIN ] CLB: Loaded 33471 existing records. [2025-10-28T17:57:14.051980] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:14.052204] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-28T17:57:14.052262] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-28T17:57:14.052590] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-28T17:57:14.052632] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-28T17:57:14.369751] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-28T17:57:14.410125] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:14.923851] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:57:15.159308] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-28T17:57:15.214282] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T17:57:15.959362] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-28T17:57:16.104268] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T17:57:16.759356] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-28T17:57:17.132493] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:57:17.559349] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-28T17:57:17.673492] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T17:57:18.293249] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:57:18.359302] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-28T17:57:19.159352] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-28T17:57:19.205111] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T17:57:19.959337] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-28T17:57:20.470270] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:57:20.759380] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-28T17:57:21.287889] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:57:21.559358] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-28T17:57:22.121483] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:57:22.359350] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-28T17:57:22.785279] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:57:23.157717] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T17:57:23.163197] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-28T17:57:23.942305] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T17:57:23.959326] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-28T17:57:24.759398] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-28T17:57:25.477682] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:57:25.559332] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-28T17:57:25.804109] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T17:57:26.359368] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-28T17:57:27.113752] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:57:27.159327] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-28T17:57:27.180972] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:57:27.187444] [INFO ] [REMOTE ] CION: Full fetch complete (40383 records). [2025-10-28T17:57:27.187775] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-28T17:57:27.588254] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-28T17:57:27.588363] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-28T17:57:27.589067] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-28T17:57:27.589131] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-28T17:57:27.590131] [DEBUG] [LOCAL ] CION: Trimmed 40383 records to 27286 (keeping 200 days of data) [2025-10-28T17:57:27.747172] [DEBUG] [LOCAL ] CION: Primary data saved (27286 records). [2025-10-28T17:57:27.747299] [INFO ] [MAIN ] CION: Full history saved. [2025-10-28T17:57:27.747369] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CION took 29.4s. Estimated remaining: 3h 58m 32s. Rate: 8.0 symbols/min [2025-10-28T17:57:27.911957] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:27.924016] [DEBUG] [LOCAL ] CLCO: Loaded 12926 existing records from primary storage. [2025-10-28T17:57:27.924214] [INFO ] [MAIN ] CLCO: Loaded 12926 existing records. [2025-10-28T17:57:27.965931] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-28T17:57:28.100748] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:28.100958] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-28T17:57:28.101003] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-28T17:57:28.101381] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-28T17:57:28.101439] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-28T17:57:28.460638] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:28.522203] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T17:57:28.759319] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-28T17:57:29.366268] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T17:57:29.559389] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-28T17:57:29.929811] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T17:57:30.359350] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-28T17:57:30.623903] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:57:31.159348] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-28T17:57:31.675513] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:57:31.959416] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-28T17:57:32.693548] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:57:32.704591] [INFO ] [REMOTE ] CIVI: Full fetch complete (76097 records). [2025-10-28T17:57:32.704794] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-28T17:57:32.763907] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-28T17:57:32.860266] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:57:33.148810] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-28T17:57:33.148895] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-28T17:57:33.149850] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-28T17:57:33.149913] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-28T17:57:33.151278] [DEBUG] [LOCAL ] CIVI: Trimmed 76097 records to 52642 (keeping 200 days of data) [2025-10-28T17:57:33.469906] [DEBUG] [LOCAL ] CIVI: Primary data saved (52642 records). [2025-10-28T17:57:33.470035] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-28T17:57:33.470429] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CIVI took 27.9s. Estimated remaining: 3h 58m 17s. Rate: 8.0 symbols/min [2025-10-28T17:57:33.566918] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-28T17:57:33.641159] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:33.667162] [DEBUG] [LOCAL ] CLDT: Loaded 24789 existing records from primary storage. [2025-10-28T17:57:33.667437] [INFO ] [MAIN ] CLDT: Loaded 24789 existing records. [2025-10-28T17:57:33.849384] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:33.849661] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-28T17:57:33.849724] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-28T17:57:33.850207] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-28T17:57:33.850264] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-28T17:57:34.210523] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:34.242939] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T17:57:34.359300] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-28T17:57:34.414368] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T17:57:35.154961] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T17:57:35.159303] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-28T17:57:35.959387] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-28T17:57:36.759366] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-28T17:57:37.283294] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-28T17:57:37.362911] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:57:37.559400] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-28T17:57:38.247675] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T17:57:38.359389] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-28T17:57:39.018049] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:57:39.126480] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T17:57:39.159321] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-28T17:57:39.860974] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:57:39.959324] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-28T17:57:40.759355] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-28T17:57:41.559415] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-28T17:57:41.669537] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T17:57:41.670928] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:57:41.688912] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-28T17:57:41.689073] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-28T17:57:42.095600] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-28T17:57:42.095710] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-28T17:57:42.096632] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-28T17:57:42.096726] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-28T17:57:42.098284] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-28T17:57:42.379110] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-28T17:57:42.426948] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-28T17:57:42.427118] [INFO ] [MAIN ] CL: Full history saved. [2025-10-28T17:57:42.427205] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CL took 34.2s. Estimated remaining: 3h 58m 15s. Rate: 8.0 symbols/min [2025-10-28T17:57:42.600806] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:42.651452] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-28T17:57:42.669109] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-28T17:57:42.741271] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:57:42.860954] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:42.861275] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-28T17:57:42.861333] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-28T17:57:42.861884] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-28T17:57:42.861941] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-28T17:57:43.162357] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-28T17:57:43.221281] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:43.266474] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T17:57:43.959325] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-28T17:57:44.139758] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T17:57:44.759331] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-28T17:57:45.550287] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:57:45.560291] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-28T17:57:45.642847] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T17:57:46.165966] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T17:57:46.359413] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-28T17:57:47.159384] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-28T17:57:47.772537] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:57:47.911205] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:57:47.959410] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-28T17:57:48.759350] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-28T17:57:49.286475] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:57:49.559372] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-28T17:57:49.603950] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T17:57:50.075321] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T17:57:50.359335] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-28T17:57:50.829453] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T17:57:51.159359] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-28T17:57:51.959356] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-28T17:57:52.725420] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T17:57:52.759358] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-28T17:57:53.239557] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T17:57:53.247088] [INFO ] [REMOTE ] CLB: Full fetch complete (47868 records). [2025-10-28T17:57:53.247193] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-28T17:57:53.370774] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:57:53.564566] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-28T17:57:53.631833] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-28T17:57:53.631936] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-28T17:57:53.632595] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-28T17:57:53.632638] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-28T17:57:53.633854] [DEBUG] [LOCAL ] CLB: Trimmed 47868 records to 33443 (keeping 200 days of data) [2025-10-28T17:57:53.830545] [DEBUG] [LOCAL ] CLB: Primary data saved (33443 records). [2025-10-28T17:57:53.830736] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-28T17:57:53.830838] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLB took 40.2s. Estimated remaining: 3h 58m 24s. Rate: 8.0 symbols/min [2025-10-28T17:57:53.994197] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:54.018863] [DEBUG] [LOCAL ] CLH: Loaded 27306 existing records from primary storage. [2025-10-28T17:57:54.019179] [INFO ] [MAIN ] CLH: Loaded 27306 existing records. [2025-10-28T17:57:54.194443] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:54.194688] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-28T17:57:54.194746] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-28T17:57:54.195380] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-28T17:57:54.195450] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-28T17:57:54.367104] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-28T17:57:54.493133] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T17:57:54.573184] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:55.159344] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-28T17:57:55.959325] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-28T17:57:55.973819] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:57:56.104408] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-28T17:57:56.629204] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:57:56.759343] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-28T17:57:57.559344] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-28T17:57:57.734797] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:57:58.359342] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-28T17:57:58.989962] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:57:59.159312] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-28T17:57:59.203379] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T17:57:59.959429] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-28T17:58:00.759391] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-28T17:58:01.384941] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T17:58:01.391060] [INFO ] [REMOTE ] CLDT: Full fetch complete (37706 records). [2025-10-28T17:58:01.391216] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-28T17:58:01.560370] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-28T17:58:01.806364] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-28T17:58:01.806832] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-28T17:58:01.807737] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-28T17:58:01.807849] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-28T17:58:01.840501] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-28T17:58:01.852547] [DEBUG] [LOCAL ] CLDT: Trimmed 37706 records to 24678 (keeping 200 days of data) [2025-10-28T17:58:01.962329] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:58:02.027888] [DEBUG] [LOCAL ] CLDT: Primary data saved (24678 records). [2025-10-28T17:58:02.028012] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-28T17:58:02.028117] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLDT took 28.6s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-28T17:58:02.194270] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:02.203197] [DEBUG] [LOCAL ] CLPR: Loaded 9660 existing records from primary storage. [2025-10-28T17:58:02.203355] [INFO ] [MAIN ] CLPR: Loaded 9660 existing records. [2025-10-28T17:58:02.363984] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-28T17:58:02.376830] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:02.377043] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-28T17:58:02.377976] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-28T17:58:02.378254] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-28T17:58:02.378312] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-28T17:58:02.738597] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:02.750014] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:58:02.754364] [INFO ] [REMOTE ] CLCO: Full fetch complete (22662 records). [2025-10-28T17:58:02.754435] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-28T17:58:03.126104] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-28T17:58:03.126180] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-28T17:58:03.126586] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-28T17:58:03.126625] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-28T17:58:03.127230] [DEBUG] [LOCAL ] CLCO: Trimmed 22662 records to 12886 (keeping 200 days of data) [2025-10-28T17:58:03.160425] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-28T17:58:03.198902] [DEBUG] [LOCAL ] CLCO: Primary data saved (12886 records). [2025-10-28T17:58:03.199205] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-28T17:58:03.199302] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLCO took 35.5s. Estimated remaining: 3h 57m 46s. Rate: 8.0 symbols/min [2025-10-28T17:58:03.367049] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:03.417031] [DEBUG] [LOCAL ] CLS: Loaded 53546 existing records from primary storage. [2025-10-28T17:58:03.417452] [INFO ] [MAIN ] CLS: Loaded 53546 existing records. [2025-10-28T17:58:03.596221] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:03.596476] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-28T17:58:03.596597] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-28T17:58:03.597092] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-28T17:58:03.614910] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-28T17:58:03.697124] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:58:03.960054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-28T17:58:03.980054] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:04.767973] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-28T17:58:04.770387] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T17:58:05.048429] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:58:05.559334] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-28T17:58:06.359326] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-28T17:58:06.684412] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T17:58:06.960614] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T17:58:07.064967] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T17:58:07.159302] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-28T17:58:07.959371] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-28T17:58:08.435430] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T17:58:08.759355] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-28T17:58:08.953580] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:58:08.964344] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-28T17:58:08.964500] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-28T17:58:09.374600] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-28T17:58:09.374867] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-28T17:58:09.375927] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-28T17:58:09.376092] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-28T17:58:09.386717] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T17:58:09.390672] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-28T17:58:09.560348] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-28T17:58:09.700212] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-28T17:58:09.700339] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-28T17:58:09.700414] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLF took 27.3s. Estimated remaining: 3h 57m 34s. Rate: 8.0 symbols/min [2025-10-28T17:58:09.869767] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:09.913254] [DEBUG] [LOCAL ] CLVT: Loaded 51854 existing records from primary storage. [2025-10-28T17:58:09.913607] [INFO ] [MAIN ] CLVT: Loaded 51854 existing records. [2025-10-28T17:58:10.091410] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:10.091606] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-28T17:58:10.091678] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-28T17:58:10.092464] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-28T17:58:10.092523] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-28T17:58:10.369606] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-28T17:58:10.451613] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:11.159350] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-28T17:58:11.197513] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T17:58:11.504730] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T17:58:11.819403] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T17:58:11.959417] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-28T17:58:12.759363] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-28T17:58:13.374360] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:58:13.559399] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-28T17:58:13.866832] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T17:58:14.359352] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-28T17:58:14.448869] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:58:15.159348] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-28T17:58:15.959550] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-28T17:58:16.121209] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T17:58:16.573047] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T17:58:16.668122] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T17:58:16.759355] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-28T17:58:17.446106] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:58:17.559332] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-28T17:58:18.359401] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-28T17:58:19.159321] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-28T17:58:19.381386] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-28T17:58:19.583824] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:58:19.623313] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T17:58:19.959368] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-28T17:58:20.399551] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:58:20.759396] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-28T17:58:21.559350] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-28T17:58:22.007187] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T17:58:22.359366] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-28T17:58:23.104336] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T17:58:23.159326] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-28T17:58:23.536864] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:58:23.959348] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-28T17:58:24.724223] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T17:58:24.726160] [INFO ] [REMOTE ] CLPR: Full fetch complete (15631 records). [2025-10-28T17:58:24.726231] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-28T17:58:24.770153] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-28T17:58:25.096118] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-28T17:58:25.096314] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-28T17:58:25.096712] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-28T17:58:25.096822] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-28T17:58:25.097611] [DEBUG] [LOCAL ] CLPR: Trimmed 15631 records to 9592 (keeping 200 days of data) [2025-10-28T17:58:25.153011] [DEBUG] [LOCAL ] CLPR: Primary data saved (9592 records). [2025-10-28T17:58:25.153153] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-28T17:58:25.153280] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLPR took 23.1s. Estimated remaining: 3h 57m 59s. Rate: 8.0 symbols/min [2025-10-28T17:58:25.290448] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-28T17:58:25.369274] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:25.387716] [DEBUG] [LOCAL ] CLW: Loaded 20956 existing records from primary storage. [2025-10-28T17:58:25.387943] [INFO ] [MAIN ] CLW: Loaded 20956 existing records. [2025-10-28T17:58:25.562435] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:25.562671] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-28T17:58:25.563756] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-28T17:58:25.563892] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-28T17:58:25.564326] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-28T17:58:25.564386] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-28T17:58:25.937121] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:26.065412] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T17:58:26.359345] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-28T17:58:26.749223] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T17:58:27.159340] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-28T17:58:27.600816] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:58:27.959352] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-28T17:58:28.759342] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-28T17:58:28.781099] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:58:28.969637] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:58:29.564877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-28T17:58:29.573610] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T17:58:30.359353] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-28T17:58:30.394074] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T17:58:31.159339] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-28T17:58:31.948123] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:58:31.959297] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-28T17:58:32.131723] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-28T17:58:32.759340] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-28T17:58:33.458855] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:58:33.512564] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:58:33.559322] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-28T17:58:34.359344] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-28T17:58:34.849730] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:58:35.159351] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-28T17:58:35.325094] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:58:35.331259] [INFO ] [REMOTE ] CLH: Full fetch complete (42256 records). [2025-10-28T17:58:35.331339] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-28T17:58:35.698355] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-28T17:58:35.698425] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-28T17:58:35.698998] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-28T17:58:35.699062] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-28T17:58:35.699904] [DEBUG] [LOCAL ] CLH: Trimmed 42256 records to 27313 (keeping 200 days of data) [2025-10-28T17:58:35.856360] [DEBUG] [LOCAL ] CLH: Primary data saved (27313 records). [2025-10-28T17:58:35.856483] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-28T17:58:35.856559] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLH took 42.0s. Estimated remaining: 3h 58m 5s. Rate: 8.0 symbols/min [2025-10-28T17:58:35.964509] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-28T17:58:36.028519] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:36.028674] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-10-28T17:58:36.028726] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-10-28T17:58:36.028891] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-28T17:58:36.028943] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-28T17:58:36.028985] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-28T17:58:36.029017] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-28T17:58:36.378615] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:36.759293] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-28T17:58:36.843989] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T17:58:37.071287] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-28T17:58:37.081823] [INFO ] [REMOTE ] CLS: Full fetch complete (77704 records). [2025-10-28T17:58:37.081942] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-28T17:58:37.469379] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-28T17:58:37.469456] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-28T17:58:37.470280] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-28T17:58:37.470341] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-28T17:58:37.471804] [DEBUG] [LOCAL ] CLS: Trimmed 77704 records to 53546 (keeping 200 days of data) [2025-10-28T17:58:37.562725] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-28T17:58:37.785506] [DEBUG] [LOCAL ] CLS: Primary data saved (53546 records). [2025-10-28T17:58:37.785632] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-28T17:58:37.785745] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLS took 34.6s. Estimated remaining: 3h 57m 34s. Rate: 8.0 symbols/min [2025-10-28T17:58:37.968740] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:38.011709] [DEBUG] [LOCAL ] CM: Loaded 48138 existing records from primary storage. [2025-10-28T17:58:38.012059] [INFO ] [MAIN ] CM: Loaded 48138 existing records. [2025-10-28T17:58:38.205934] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:38.206161] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-28T17:58:38.206303] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-28T17:58:38.206881] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-28T17:58:38.207019] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-28T17:58:38.322790] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T17:58:38.363400] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-28T17:58:38.423125] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T17:58:38.655077] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:39.159346] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-28T17:58:39.614446] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:58:39.899140] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:58:39.959400] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-28T17:58:40.653773] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:58:40.759338] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-28T17:58:41.559330] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-28T17:58:42.359323] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-28T17:58:42.399931] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:58:42.778824] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:58:43.159331] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-28T17:58:43.723331] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:58:43.860950] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:58:43.959303] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-28T17:58:44.664151] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T17:58:44.668688] [INFO ] [REMOTE ] CLW: Full fetch complete (33382 records). [2025-10-28T17:58:44.668777] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-28T17:58:44.768512] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-28T17:58:45.049218] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-28T17:58:45.049297] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-28T17:58:45.049844] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-28T17:58:45.049905] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-28T17:58:45.050663] [DEBUG] [LOCAL ] CLW: Trimmed 33382 records to 20961 (keeping 200 days of data) [2025-10-28T17:58:45.170913] [DEBUG] [LOCAL ] CLW: Primary data saved (20961 records). [2025-10-28T17:58:45.171028] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-28T17:58:45.171100] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLW took 20.0s. Estimated remaining: 3h 57m 26s. Rate: 8.0 symbols/min [2025-10-28T17:58:45.341826] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:45.388578] [DEBUG] [LOCAL ] CMA: Loaded 50157 existing records from primary storage. [2025-10-28T17:58:45.388922] [INFO ] [MAIN ] CMA: Loaded 50157 existing records. [2025-10-28T17:58:45.566907] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-28T17:58:45.572987] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:45.573966] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-28T17:58:45.574038] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-28T17:58:45.574671] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-28T17:58:45.574770] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-28T17:58:45.932487] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:46.168252] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:58:46.359389] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-28T17:58:46.895206] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:58:47.159335] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-28T17:58:47.587664] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T17:58:47.959358] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-28T17:58:48.764534] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-28T17:58:48.779397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T17:58:49.191871] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:58:49.559335] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-28T17:58:49.729797] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T17:58:50.359375] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-28T17:58:50.855434] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:58:51.159355] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-28T17:58:51.598869] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:58:51.959383] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-28T17:58:52.571598] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T17:58:52.759336] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-28T17:58:53.147630] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:58:53.157888] [INFO ] [REMOTE ] CLVT: Full fetch complete (75389 records). [2025-10-28T17:58:53.158014] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-28T17:58:53.557148] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-28T17:58:53.557227] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-28T17:58:53.558073] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-28T17:58:53.558133] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-28T17:58:53.559329] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-28T17:58:53.559543] [DEBUG] [LOCAL ] CLVT: Trimmed 75389 records to 51857 (keeping 200 days of data) [2025-10-28T17:58:53.840386] [DEBUG] [LOCAL ] CLVT: Primary data saved (51857 records). [2025-10-28T17:58:53.840511] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-28T17:58:53.840588] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CLVT took 44.1s. Estimated remaining: 3h 57m 24s. Rate: 8.0 symbols/min [2025-10-28T17:58:54.014084] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:54.043684] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:58:54.072806] [DEBUG] [LOCAL ] CMBT: Loaded 28308 existing records from primary storage. [2025-10-28T17:58:54.073049] [INFO ] [MAIN ] CMBT: Loaded 28308 existing records. [2025-10-28T17:58:54.275988] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:54.276179] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-28T17:58:54.276225] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-28T17:58:54.276520] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-28T17:58:54.276572] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-28T17:58:54.364455] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-28T17:58:54.668055] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:54.912812] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:58:55.159336] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-28T17:58:55.726830] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T17:58:55.959441] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-28T17:58:56.347404] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:58:56.759390] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-28T17:58:57.170890] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:58:57.559335] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-28T17:58:57.909183] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T17:58:58.176724] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T17:58:58.359399] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-28T17:58:58.910393] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T17:58:59.159350] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-28T17:58:59.855423] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T17:58:59.959340] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-28T17:59:00.759379] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-28T17:59:01.559336] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-28T17:59:01.761833] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-28T17:59:02.272574] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T17:59:02.359345] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-28T17:59:02.923502] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-28T17:59:03.159355] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-28T17:59:03.268977] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T17:59:03.279333] [INFO ] [REMOTE ] CLX: Full fetch complete (73985 records). [2025-10-28T17:59:03.279518] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-28T17:59:03.659968] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-28T17:59:03.660046] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-28T17:59:03.660834] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-28T17:59:03.660896] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-28T17:59:03.662209] [DEBUG] [LOCAL ] CLX: Trimmed 73985 records to 51838 (keeping 200 days of data) [2025-10-28T17:59:03.911756] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T17:59:03.961198] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-28T17:59:03.996715] [DEBUG] [LOCAL ] CLX: Primary data saved (51838 records). [2025-10-28T17:59:03.996844] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-28T17:59:03.996913] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CLX took 28.1s. Estimated remaining: 3h 57m 27s. Rate: 8.0 symbols/min [2025-10-28T17:59:04.167915] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:04.207762] [DEBUG] [LOCAL ] CMC: Loaded 45505 existing records from primary storage. [2025-10-28T17:59:04.208096] [INFO ] [MAIN ] CMC: Loaded 45505 existing records. [2025-10-28T17:59:04.395593] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:04.395888] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-28T17:59:04.395975] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-28T17:59:04.396592] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-28T17:59:04.396699] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-28T17:59:04.763078] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-28T17:59:04.763761] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:59:04.834087] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:05.559337] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-28T17:59:05.981534] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T17:59:06.359358] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-28T17:59:06.837173] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:59:07.159345] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-28T17:59:07.560196] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:59:07.959349] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-28T17:59:08.350631] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T17:59:08.759419] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-28T17:59:09.399403] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:59:09.559326] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-28T17:59:09.906771] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:59:10.359353] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-28T17:59:10.755682] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T17:59:11.159374] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-28T17:59:11.620961] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:59:11.959380] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-28T17:59:12.759352] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-28T17:59:13.014412] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T17:59:13.375059] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:59:13.463607] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:59:13.559344] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-28T17:59:14.359359] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-28T17:59:14.908255] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T17:59:14.922191] [INFO ] [REMOTE ] CM: Full fetch complete (69667 records). [2025-10-28T17:59:14.922424] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-28T17:59:15.168615] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-28T17:59:15.335418] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-28T17:59:15.335494] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-28T17:59:15.336577] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-28T17:59:15.336680] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-28T17:59:15.338139] [DEBUG] [LOCAL ] CM: Trimmed 69667 records to 48051 (keeping 200 days of data) [2025-10-28T17:59:15.620639] [DEBUG] [LOCAL ] CM: Primary data saved (48051 records). [2025-10-28T17:59:15.620822] [INFO ] [MAIN ] CM: Full history saved. [2025-10-28T17:59:15.620902] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CM took 37.8s. Estimated remaining: 3h 57m 36s. Rate: 8.0 symbols/min [2025-10-28T17:59:15.786381] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:15.792849] [DEBUG] [LOCAL ] CMCM: Loaded 4809 existing records from primary storage. [2025-10-28T17:59:15.793006] [INFO ] [MAIN ] CMCM: Loaded 4809 existing records. [2025-10-28T17:59:15.978431] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:15.973746] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-28T17:59:15.979738] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-28T17:59:15.979884] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-28T17:59:15.980247] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-28T17:59:15.980324] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-28T17:59:16.307586] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T17:59:16.393121] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:16.394108] [INFO ] [REMOTE ] CMA: Full fetch complete (73481 records). [2025-10-28T17:59:16.394472] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-28T17:59:16.512455] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:59:16.764572] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-28T17:59:16.817824] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-28T17:59:16.817902] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-28T17:59:16.818769] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-28T17:59:16.818830] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-28T17:59:16.820169] [DEBUG] [LOCAL ] CMA: Trimmed 73481 records to 50115 (keeping 200 days of data) [2025-10-28T17:59:17.115826] [DEBUG] [LOCAL ] CMA: Primary data saved (50115 records). [2025-10-28T17:59:17.115950] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-28T17:59:17.116400] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CMA took 31.9s. Estimated remaining: 3h 57m 4s. Rate: 8.0 symbols/min [2025-10-28T17:59:17.291383] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:17.291693] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-28T17:59:17.291747] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-28T17:59:17.291854] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-28T17:59:17.291895] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-28T17:59:17.291935] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-28T17:59:17.291966] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-28T17:59:17.573424] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-28T17:59:17.672181] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:17.699025] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T17:59:18.067351] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T17:59:18.244015] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:59:18.359344] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-28T17:59:18.852357] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:59:19.159339] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-28T17:59:19.547593] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:59:19.959351] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-28T17:59:20.759380] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-28T17:59:21.130948] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T17:59:21.489035] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:59:21.498838] [INFO ] [REMOTE ] CMBT: Full fetch complete (35008 records). [2025-10-28T17:59:21.498923] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-28T17:59:21.564573] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-28T17:59:21.869367] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-28T17:59:21.869446] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-28T17:59:21.870011] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-28T17:59:21.870071] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-28T17:59:21.870928] [DEBUG] [LOCAL ] CMBT: Trimmed 35008 records to 28622 (keeping 200 days of data) [2025-10-28T17:59:22.038431] [DEBUG] [LOCAL ] CMBT: Primary data saved (28622 records). [2025-10-28T17:59:22.038560] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-28T17:59:22.038637] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMBT took 28.2s. Estimated remaining: 3h 56m 46s. Rate: 8.0 symbols/min [2025-10-28T17:59:22.207575] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:22.255873] [DEBUG] [LOCAL ] CMG: Loaded 53723 existing records from primary storage. [2025-10-28T17:59:22.256165] [INFO ] [MAIN ] CMG: Loaded 53723 existing records. [2025-10-28T17:59:22.364436] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-28T17:59:22.434325] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:22.434512] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-28T17:59:22.434558] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-28T17:59:22.435491] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-28T17:59:22.435548] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-28T17:59:22.575340] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:59:22.635610] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-28T17:59:22.651265] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:59:22.669594] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-28T17:59:22.721418] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:59:22.721866] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-28T17:59:22.803183] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:22.748318] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-28T17:59:22.803471] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-28T17:59:22.804014] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-28T17:59:22.804095] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMDB took 5.7s. Estimated remaining: 3h 56m 12s. Rate: 8.0 symbols/min [2025-10-28T17:59:22.999350] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:22.997600] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T17:59:23.046838] [DEBUG] [LOCAL ] CMI: Loaded 41324 existing records from primary storage. [2025-10-28T17:59:23.047158] [INFO ] [MAIN ] CMI: Loaded 41324 existing records. [2025-10-28T17:59:23.164466] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-28T17:59:23.227439] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:23.227611] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-28T17:59:23.227696] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-28T17:59:23.228269] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-28T17:59:23.228327] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-28T17:59:23.575458] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:23.959344] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-28T17:59:24.351078] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T17:59:24.759332] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-28T17:59:24.979614] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-28T17:59:25.373468] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:59:25.559339] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-28T17:59:26.359524] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-28T17:59:27.103706] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T17:59:27.159416] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-28T17:59:27.494190] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:59:27.959336] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-28T17:59:28.756799] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T17:59:28.766965] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-28T17:59:29.135393] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T17:59:29.196741] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T17:59:29.559339] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-28T17:59:30.359342] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-28T17:59:31.159330] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-28T17:59:31.583125] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-28T17:59:31.959322] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-28T17:59:31.993908] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T17:59:32.183804] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:59:32.759337] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-28T17:59:33.527969] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:59:33.559317] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-28T17:59:33.926557] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:59:34.359353] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-28T17:59:34.967755] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:59:35.159341] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-28T17:59:35.215436] [DEBUG] [REMOTE ] CMG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-28T17:59:35.215767] [WARN ] [REMOTE ] CMG: No data returned for month 2025-07 [2025-10-28T17:59:35.215852] [FATAL] [REMOTE ] CMG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:59:35.215931] [FATAL] [MAIN ] CMG: Failed to fetch primary data. [2025-10-28T17:59:35.215992] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:59:35.216061] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-28T17:59:35.216123] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-28T17:59:35.216158] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-10-28T17:59:35.216320] [DEBUG] [LOCAL ] CMG: Deleted derivative data file. [2025-10-28T17:59:35.216406] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMG took 13.2s. Estimated remaining: 3h 56m 24s. Rate: 8.0 symbols/min [2025-10-28T17:59:35.393706] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:35.427017] [DEBUG] [LOCAL ] CMP: Loaded 35271 existing records from primary storage. [2025-10-28T17:59:35.427339] [INFO ] [MAIN ] CMP: Loaded 35271 existing records. [2025-10-28T17:59:35.612933] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:35.613266] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-28T17:59:35.613329] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-28T17:59:35.614100] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-28T17:59:35.614160] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-28T17:59:35.939676] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:59:35.968422] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-28T17:59:36.035787] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:36.759354] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-28T17:59:37.161233] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:59:37.559315] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-28T17:59:37.748216] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:59:38.359361] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-28T17:59:38.738600] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T17:59:38.839735] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:59:39.159377] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-28T17:59:39.959391] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-28T17:59:40.118903] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T17:59:40.431889] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T17:59:40.759394] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-28T17:59:41.197029] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:59:41.559392] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-28T17:59:42.080449] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T17:59:42.082381] [INFO ] [REMOTE ] CMCM: Full fetch complete (7084 records). [2025-10-28T17:59:42.082481] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-28T17:59:42.364621] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-28T17:59:42.463426] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-28T17:59:42.463529] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-28T17:59:42.463956] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-28T17:59:42.464022] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-28T17:59:42.464485] [DEBUG] [LOCAL ] CMCM: Trimmed 7084 records to 4794 (keeping 200 days of data) [2025-10-28T17:59:42.495625] [DEBUG] [LOCAL ] CMCM: Primary data saved (4794 records). [2025-10-28T17:59:42.495862] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-28T17:59:42.495975] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMCM took 26.9s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-10-28T17:59:43.159397] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-28T17:59:43.597319] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T17:59:43.959372] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-28T17:59:44.076743] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:59:44.759334] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-28T17:59:45.395463] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:59:45.559347] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-28T17:59:45.774341] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T17:59:46.359377] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-28T17:59:46.885730] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:59:46.896443] [INFO ] [REMOTE ] CMC: Full fetch complete (66857 records). [2025-10-28T17:59:46.896733] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-28T17:59:46.897999] [FATAL] [VALIDATOR ] CMC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:59:46.898121] [FATAL] [MAIN ] CMC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:59:46.898166] [WARN ] [MAIN ] CMC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:59:46.898207] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-28T17:59:46.898274] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-28T17:59:46.898314] [INFO ] [LOCAL ] CMC: Starting deletion of derivative data. [2025-10-28T17:59:46.898517] [DEBUG] [LOCAL ] CMC: Deleted derivative data file. [2025-10-28T17:59:46.898612] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMC took 42.9s. Estimated remaining: 3h 55m 56s. Rate: 8.0 symbols/min [2025-10-28T17:59:47.159482] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-28T17:59:47.577427] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:59:47.959491] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-28T17:59:48.342478] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:59:48.759463] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-28T17:59:49.029044] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:59:49.559398] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-28T17:59:49.769264] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:59:50.359374] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-28T17:59:50.783111] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:59:50.793976] [INFO ] [REMOTE ] CMI: Full fetch complete (61177 records). [2025-10-28T17:59:50.794272] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-28T17:59:51.223402] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-28T17:59:51.223514] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-28T17:59:51.224523] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-28T17:59:51.224594] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-28T17:59:51.226418] [DEBUG] [LOCAL ] CMI: Trimmed 61177 records to 41254 (keeping 200 days of data) [2025-10-28T17:59:51.518550] [DEBUG] [LOCAL ] CMI: Primary data saved (41254 records). [2025-10-28T17:59:51.533799] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-28T17:59:51.534782] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMI took 28.7s. Estimated remaining: 3h 55m 37s. Rate: 8.0 symbols/min [2025-10-28T17:59:51.535972] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:59:51.545548] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-28T17:59:52.391231] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T17:59:52.399373] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-28T17:59:53.265755] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:59:53.273504] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-28T17:59:54.320848] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:59:54.327323] [INFO ] [REMOTE ] CMP: Full fetch complete (51356 records). [2025-10-28T17:59:54.327456] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-28T17:59:54.716176] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-28T17:59:54.716297] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-28T17:59:54.717165] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-28T17:59:54.717235] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-28T17:59:54.718912] [DEBUG] [LOCAL ] CMP: Trimmed 51356 records to 35190 (keeping 200 days of data) [2025-10-28T17:59:54.950518] [DEBUG] [LOCAL ] CMP: Primary data saved (35190 records). [2025-10-28T17:59:54.950768] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-28T17:59:54.950940] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMP took 19.7s. Estimated remaining: 3h 55m 13s. Rate: 8.0 symbols/min [2025-10-28T17:59:55.736698] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.774054] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.817095] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.824059] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.824852] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-28T17:59:55.825164] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-28T17:59:55.825526] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-28T17:59:55.825734] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-28T17:59:55.826058] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-28T17:59:55.826396] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-28T17:59:56.201833] [DEBUG] [LOCAL ] CMPO: Loaded 37974 existing records from primary storage. [2025-10-28T17:59:56.232703] [DEBUG] [LOCAL ] CMS: Loaded 52509 existing records from primary storage. [2025-10-28T17:59:56.233817] [DEBUG] [LOCAL ] CMRE: Loaded 35264 existing records from primary storage. [2025-10-28T17:59:56.234692] [INFO ] [MAIN ] CMPO: Loaded 37974 existing records. [2025-10-28T17:59:56.235076] [INFO ] [MAIN ] CMRE: Loaded 35264 existing records. [2025-10-28T17:59:56.234883] [INFO ] [MAIN ] CMS: Loaded 52509 existing records. [2025-10-28T17:59:56.558419] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:56.679962] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-28T17:59:56.976090] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:57.001575] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:57.042436] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-28T17:59:57.042192] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:57.042682] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-28T17:59:57.043017] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-28T17:59:57.043072] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-28T17:59:57.042881] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-28T17:59:57.043324] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-28T17:59:57.043691] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-28T17:59:57.043767] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-28T17:59:57.049156] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-28T17:59:57.049279] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-28T17:59:57.069019] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-28T17:59:57.062205] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-28T17:59:57.408806] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T17:59:57.493778] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-28T17:59:58.311934] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:58.331751] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-28T17:59:58.333098] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:59:58.338133] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:58.362219] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-28T17:59:58.368496] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:58.362884] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-28T17:59:58.371733] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-28T17:59:58.674127] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T17:59:58.675713] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-28T17:59:59.015449] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T17:59:59.159359] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-28T17:59:59.308413] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:59:59.417501] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:59:59.621836] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T17:59:59.706405] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:59:59.959634] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-28T18:00:00.759427] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-28T18:00:01.559349] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-28T18:00:01.613748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T18:00:02.232426] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:00:02.359377] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-28T18:00:03.159482] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-28T18:00:03.556157] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T18:00:03.922596] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-28T18:00:03.959347] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-28T18:00:04.759355] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-28T18:00:04.828157] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T18:00:05.559321] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-28T18:00:05.609708] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T18:00:05.957037] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:00:06.359345] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-28T18:00:06.900095] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T18:00:07.134128] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:00:07.159313] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-28T18:00:07.959350] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-28T18:00:08.309971] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:00:08.759384] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-28T18:00:09.383326] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:00:09.559356] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-28T18:00:09.993743] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:00:10.359343] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-28T18:00:11.045968] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:00:11.159330] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-28T18:00:11.594490] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:00:11.959358] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-28T18:00:12.584433] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:00:12.759340] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-28T18:00:13.022048] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T18:00:13.559355] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-28T18:00:14.137037] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T18:00:14.138752] [INFO ] [REMOTE ] CMSA: Full fetch complete (4785 records). [2025-10-28T18:00:14.138838] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-28T18:00:14.360220] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-28T18:00:14.508835] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-28T18:00:14.508917] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-28T18:00:14.509078] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-28T18:00:14.509117] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-28T18:00:14.509496] [DEBUG] [LOCAL ] CMSA: Trimmed 4785 records to 3430 (keeping 200 days of data) [2025-10-28T18:00:14.529679] [DEBUG] [LOCAL ] CMSA: Primary data saved (3430 records). [2025-10-28T18:00:14.529765] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-28T18:00:14.529842] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMSA took 19.6s. Estimated remaining: 3h 55m 53s. Rate: 8.0 symbols/min [2025-10-28T18:00:14.700012] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:14.700810] [DEBUG] [LOCAL ] CMSC: No existing data file found in primary storage. [2025-10-28T18:00:14.700862] [WARN ] [MAIN ] CMSC: No existing data found, performing full refresh instead. [2025-10-28T18:00:14.701043] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-28T18:00:14.701096] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-28T18:00:14.701138] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-28T18:00:14.701169] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-28T18:00:15.053573] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:15.159328] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-28T18:00:15.403611] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-28T18:00:15.651991] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:00:15.652142] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:00:15.959353] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-28T18:00:16.759333] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-28T18:00:17.417109] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T18:00:17.559335] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-28T18:00:17.763909] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:00:17.864620] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:00:18.359333] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-28T18:00:19.159327] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-28T18:00:19.959306] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-28T18:00:20.176818] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T18:00:20.309046] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T18:00:20.404838] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-28T18:00:20.759337] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-28T18:00:21.559342] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-28T18:00:22.026324] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:00:22.359316] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-28T18:00:22.546928] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T18:00:23.159345] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-28T18:00:23.549710] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:00:23.959348] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-28T18:00:24.341044] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T18:00:24.759359] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-28T18:00:25.042032] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T18:00:25.338810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T18:00:25.559321] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-28T18:00:26.359335] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-28T18:00:26.625894] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T18:00:26.632666] [INFO ] [REMOTE ] CMPO: Full fetch complete (57766 records). [2025-10-28T18:00:26.632798] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-28T18:00:27.028706] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-28T18:00:27.028798] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-28T18:00:27.029470] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-28T18:00:27.029512] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-28T18:00:27.030907] [DEBUG] [LOCAL ] CMPO: Trimmed 57766 records to 37862 (keeping 200 days of data) [2025-10-28T18:00:27.192690] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-28T18:00:27.255986] [DEBUG] [LOCAL ] CMPO: Primary data saved (37862 records). [2025-10-28T18:00:27.256121] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-28T18:00:27.256200] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMPO took 32.3s. Estimated remaining: 3h 56m 6s. Rate: 8.0 symbols/min [2025-10-28T18:00:27.441089] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:27.449075] [DEBUG] [LOCAL ] CMSD: Loaded 7446 existing records from primary storage. [2025-10-28T18:00:27.449248] [INFO ] [MAIN ] CMSD: Loaded 7446 existing records. [2025-10-28T18:00:27.602009] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:00:27.663889] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:27.664459] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-28T18:00:27.664616] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-28T18:00:27.664959] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-28T18:00:27.665016] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-28T18:00:27.768504] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T18:00:27.964445] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-28T18:00:28.032225] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:28.759372] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-28T18:00:29.150488] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:00:29.458857] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T18:00:29.469980] [INFO ] [REMOTE ] CMS: Full fetch complete (75890 records). [2025-10-28T18:00:29.470181] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-28T18:00:29.471279] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:00:29.471388] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:00:29.471437] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:00:29.471480] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-28T18:00:29.471547] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-28T18:00:29.471586] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-28T18:00:29.471810] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-28T18:00:29.472398] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMS took 34.5s. Estimated remaining: 3h 55m 38s. Rate: 8.0 symbols/min [2025-10-28T18:00:29.564584] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-28T18:00:29.653618] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:29.653922] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-28T18:00:29.653974] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-28T18:00:29.654101] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-28T18:00:29.654172] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-28T18:00:29.654243] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-28T18:00:29.654281] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-28T18:00:30.021167] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:30.195264] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:00:30.359368] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-28T18:00:30.734731] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T18:00:31.159403] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-28T18:00:31.560835] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:00:31.959371] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-28T18:00:32.486261] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T18:00:32.759413] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-28T18:00:33.140365] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:00:33.559345] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-28T18:00:34.359377] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-28T18:00:34.623684] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:00:34.631133] [INFO ] [REMOTE ] CMRE: Full fetch complete (51145 records). [2025-10-28T18:00:34.631269] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-28T18:00:34.748372] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:00:35.016299] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-28T18:00:35.016387] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-28T18:00:35.017031] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-28T18:00:35.017125] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-28T18:00:35.018266] [DEBUG] [LOCAL ] CMRE: Trimmed 51145 records to 35169 (keeping 200 days of data) [2025-10-28T18:00:35.170915] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-28T18:00:35.224415] [DEBUG] [LOCAL ] CMRE: Primary data saved (35169 records). [2025-10-28T18:00:35.224531] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-28T18:00:35.224611] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMRE took 40.3s. Estimated remaining: 3h 55m 24s. Rate: 8.0 symbols/min [2025-10-28T18:00:35.393537] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:35.401103] [DEBUG] [LOCAL ] CMU: Loaded 6086 existing records from primary storage. [2025-10-28T18:00:35.401288] [INFO ] [MAIN ] CMU: Loaded 6086 existing records. [2025-10-28T18:00:35.573633] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:35.573821] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-28T18:00:35.573918] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-28T18:00:35.574080] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-28T18:00:35.574121] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-28T18:00:35.678469] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T18:00:35.685448] [INFO ] [REMOTE ] CMSC: Full fetch complete (6831 records). [2025-10-28T18:00:35.695754] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-28T18:00:35.718759] [FATAL] [VALIDATOR ] CMSC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:00:35.728813] [FATAL] [MAIN ] CMSC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:00:35.737477] [WARN ] [MAIN ] CMSC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:00:35.752970] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-28T18:00:35.819056] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-28T18:00:35.824664] [INFO ] [LOCAL ] CMSC: Starting deletion of derivative data. [2025-10-28T18:00:35.846275] [DEBUG] [LOCAL ] CMSC: No derivative data file found to delete. [2025-10-28T18:00:35.854155] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMSC took 21.3s. Estimated remaining: 3h 54m 50s. Rate: 8.0 symbols/min [2025-10-28T18:00:35.961071] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-28T18:00:36.032062] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:36.100292] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:36.128349] [DEBUG] [LOCAL ] CNA: Loaded 32238 existing records from primary storage. [2025-10-28T18:00:36.128621] [INFO ] [MAIN ] CNA: Loaded 32238 existing records. [2025-10-28T18:00:36.322397] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:36.322612] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-28T18:00:36.322687] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-28T18:00:36.323307] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-28T18:00:36.323364] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-28T18:00:36.702325] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T18:00:36.764554] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-28T18:00:36.864788] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:37.559353] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-28T18:00:38.107459] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:00:38.122543] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:00:38.359321] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-28T18:00:38.862902] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T18:00:39.159320] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-28T18:00:39.587029] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:00:39.959410] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-28T18:00:40.490011] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T18:00:40.759341] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-28T18:00:41.327597] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T18:00:41.559347] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-28T18:00:41.920500] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T18:00:42.359356] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-28T18:00:43.159397] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-28T18:00:43.619120] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:00:43.625296] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:00:43.959366] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-28T18:00:44.522477] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:00:44.759369] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-28T18:00:45.230022] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T18:00:45.559373] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-28T18:00:45.963519] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:00:46.359330] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-28T18:00:46.977994] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T18:00:47.159341] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-28T18:00:47.651291] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T18:00:47.959350] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-28T18:00:48.759388] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-28T18:00:48.802910] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T18:00:49.559340] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-28T18:00:50.148298] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:00:50.149585] [INFO ] [REMOTE ] CMU: Full fetch complete (9425 records). [2025-10-28T18:00:50.149688] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-28T18:00:50.150115] [FATAL] [VALIDATOR ] CMU: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:00:50.150207] [FATAL] [MAIN ] CMU: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:00:50.150276] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:00:50.150358] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-28T18:00:50.150434] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-28T18:00:50.150485] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-28T18:00:50.150680] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-28T18:00:50.150787] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMU took 14.9s. Estimated remaining: 3h 55m 8s. Rate: 8.0 symbols/min [2025-10-28T18:00:50.330460] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:50.359312] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-28T18:00:50.381612] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-28T18:00:50.381979] [INFO ] [MAIN ] CNC: Loaded 53779 existing records. [2025-10-28T18:00:50.571525] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:50.571844] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-28T18:00:50.571895] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-28T18:00:50.572398] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-28T18:00:50.572468] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-28T18:00:50.820828] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-28T18:00:50.873145] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:00:50.972557] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:51.159345] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-28T18:00:51.959340] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-28T18:00:52.394615] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:00:52.759306] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-28T18:00:52.864714] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T18:00:53.559339] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-28T18:00:54.010740] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:00:54.158337] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T18:00:54.160029] [INFO ] [REMOTE ] CMSD: Full fetch complete (11359 records). [2025-10-28T18:00:54.160098] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-28T18:00:54.368691] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-28T18:00:54.521489] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-28T18:00:54.521567] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-28T18:00:54.521869] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-28T18:00:54.521930] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-28T18:00:54.522369] [DEBUG] [LOCAL ] CMSD: Trimmed 11359 records to 7410 (keeping 200 days of data) [2025-10-28T18:00:54.566297] [DEBUG] [LOCAL ] CMSD: Primary data saved (7410 records). [2025-10-28T18:00:54.566420] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-28T18:00:54.566494] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CMSD took 27.3s. Estimated remaining: 3h 54m 49s. Rate: 8.0 symbols/min [2025-10-28T18:00:54.733399] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:54.743579] [DEBUG] [LOCAL ] CNF: Loaded 10606 existing records from primary storage. [2025-10-28T18:00:54.743819] [INFO ] [MAIN ] CNF: Loaded 10606 existing records. [2025-10-28T18:00:54.917639] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:54.917881] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-28T18:00:54.917929] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-28T18:00:54.918213] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-28T18:00:54.918272] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-28T18:00:55.164500] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-28T18:00:55.298215] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:55.959400] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-28T18:00:55.969017] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T18:00:56.171589] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T18:00:56.489961] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T18:00:56.759344] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-28T18:00:57.559332] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-28T18:00:58.278962] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:00:58.359311] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-28T18:00:58.842318] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:00:59.159325] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-28T18:00:59.503393] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T18:00:59.959338] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-28T18:01:00.759326] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-28T18:01:01.559379] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-28T18:01:02.131066] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:01:02.359337] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-28T18:01:02.823576] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (4.46 seconds). [2025-10-28T18:01:03.159314] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-28T18:01:03.271702] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T18:01:03.271506] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T18:01:03.959324] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-28T18:01:04.025532] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (4.07 seconds). [2025-10-28T18:01:04.536197] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T18:01:04.759308] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-28T18:01:05.388580] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:01:05.559314] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-28T18:01:06.073400] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T18:01:06.371345] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-28T18:01:06.377827] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-28T18:01:07.159341] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-28T18:01:07.472285] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T18:01:07.896832] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:01:07.959314] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-28T18:01:08.759306] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-28T18:01:09.009367] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:01:09.559349] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-28T18:01:09.794376] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:01:10.359407] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-28T18:01:10.963794] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T18:01:10.979173] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T18:01:10.981425] [INFO ] [REMOTE ] CNF: Full fetch complete (12903 records). [2025-10-28T18:01:10.981507] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-28T18:01:11.167554] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-28T18:01:11.348805] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-28T18:01:11.348886] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-28T18:01:11.349260] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-28T18:01:11.349299] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-28T18:01:11.349809] [DEBUG] [LOCAL ] CNF: Trimmed 12903 records to 10607 (keeping 200 days of data) [2025-10-28T18:01:11.406067] [DEBUG] [LOCAL ] CNF: Primary data saved (10607 records). [2025-10-28T18:01:11.406195] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-28T18:01:11.406274] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CNF took 16.8s. Estimated remaining: 3h 55m 17s. Rate: 8.0 symbols/min [2025-10-28T18:01:11.574008] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:11.574202] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-28T18:01:11.574238] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-28T18:01:11.574344] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-28T18:01:11.574385] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-28T18:01:11.574423] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-28T18:01:11.574454] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-28T18:01:11.919530] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:11.959323] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-28T18:01:12.759350] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-28T18:01:13.339640] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-28T18:01:13.439933] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:01:13.559308] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-28T18:01:13.802975] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T18:01:14.359326] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-28T18:01:15.159320] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-28T18:01:15.648536] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-28T18:01:15.959389] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-28T18:01:16.192733] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T18:01:16.759322] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-28T18:01:17.204193] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:01:17.559399] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-28T18:01:18.356452] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (4.00 seconds). [2025-10-28T18:01:18.367530] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-28T18:01:19.159348] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-28T18:01:19.339700] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-28T18:01:19.574497] [DEBUG] [REMOTE ] CNA: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T18:01:19.574620] [WARN ] [REMOTE ] CNA: No data returned for month 2025-08 [2025-10-28T18:01:19.574710] [FATAL] [REMOTE ] CNA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:01:19.574752] [FATAL] [MAIN ] CNA: Failed to fetch primary data. [2025-10-28T18:01:19.574815] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:01:19.574882] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-28T18:01:19.574940] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-28T18:01:19.574976] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-10-28T18:01:19.575148] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-10-28T18:01:19.575215] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNA took 43.7s. Estimated remaining: 3h 55m 12s. Rate: 8.0 symbols/min [2025-10-28T18:01:19.742859] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:19.788016] [DEBUG] [LOCAL ] CNI: Loaded 51583 existing records from primary storage. [2025-10-28T18:01:19.788448] [INFO ] [MAIN ] CNI: Loaded 51583 existing records. [2025-10-28T18:01:19.961533] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-28T18:01:19.967236] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:19.967693] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-28T18:01:19.967788] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-28T18:01:19.969352] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-28T18:01:19.969416] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-28T18:01:20.124969] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T18:01:20.380261] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:20.759321] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-28T18:01:20.821044] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T18:01:20.902296] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:01:21.559321] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-28T18:01:22.197676] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:01:22.247412] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T18:01:22.252856] [INFO ] [REMOTE ] CMTG: Full fetch complete (52340 records). [2025-10-28T18:01:22.252955] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-28T18:01:22.253564] [FATAL] [VALIDATOR ] CMTG: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:01:22.253691] [FATAL] [MAIN ] CMTG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:01:22.253758] [WARN ] [MAIN ] CMTG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:01:22.253836] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-28T18:01:22.253899] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-28T18:01:22.253936] [INFO ] [LOCAL ] CMTG: Starting deletion of derivative data. [2025-10-28T18:01:22.253976] [DEBUG] [LOCAL ] CMTG: No derivative data file found to delete. [2025-10-28T18:01:22.254029] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CMTG took 52.8s. Estimated remaining: 3h 54m 46s. Rate: 8.0 symbols/min [2025-10-28T18:01:22.364477] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-28T18:01:22.430805] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:22.481410] [DEBUG] [LOCAL ] CNK: Loaded 52892 existing records from primary storage. [2025-10-28T18:01:22.481732] [INFO ] [MAIN ] CNK: Loaded 52892 existing records. [2025-10-28T18:01:22.661065] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:22.661296] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-28T18:01:22.661343] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-28T18:01:22.662300] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-28T18:01:22.662358] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-28T18:01:23.015562] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:23.159306] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-28T18:01:23.894546] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T18:01:23.959426] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-28T18:01:24.420491] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:01:24.759328] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-28T18:01:25.559365] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-28T18:01:26.359349] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-28T18:01:26.456975] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-28T18:01:27.152086] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-28T18:01:27.163031] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-28T18:01:27.442029] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-28T18:01:27.721361] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T18:01:27.732569] [INFO ] [REMOTE ] CNC: Full fetch complete (77866 records). [2025-10-28T18:01:27.732759] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-28T18:01:27.964673] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-28T18:01:28.145424] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-28T18:01:28.145507] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-28T18:01:28.146371] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-28T18:01:28.146455] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-28T18:01:28.178234] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T18:01:28.190676] [DEBUG] [LOCAL ] CNC: Trimmed 77866 records to 53779 (keeping 200 days of data) [2025-10-28T18:01:28.496881] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-28T18:01:28.497008] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-28T18:01:28.497103] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNC took 38.3s. Estimated remaining: 3h 54m 34s. Rate: 8.0 symbols/min [2025-10-28T18:01:28.665584] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:28.712368] [DEBUG] [LOCAL ] CNM: Loaded 50952 existing records from primary storage. [2025-10-28T18:01:28.712889] [INFO ] [MAIN ] CNM: Loaded 50952 existing records. [2025-10-28T18:01:28.766328] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-28T18:01:28.889549] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:28.889795] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-28T18:01:28.889843] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-28T18:01:28.890248] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-28T18:01:28.890305] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-28T18:01:29.249191] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:29.317751] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:01:29.559331] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-28T18:01:30.232227] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T18:01:30.359338] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-28T18:01:31.159348] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-28T18:01:31.489789] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T18:01:31.707815] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T18:01:31.959440] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-28T18:01:32.723330] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T18:01:32.759343] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-28T18:01:33.206510] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:01:33.559337] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-28T18:01:34.234951] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:01:34.359368] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-28T18:01:35.019844] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:01:35.159358] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-28T18:01:35.862698] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:01:35.873520] [INFO ] [REMOTE ] CNH: Full fetch complete (77702 records). [2025-10-28T18:01:35.873743] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-28T18:01:35.967363] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-28T18:01:36.274607] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-28T18:01:36.274753] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-28T18:01:36.275729] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-28T18:01:36.275795] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-28T18:01:36.277514] [DEBUG] [LOCAL ] CNH: Trimmed 77702 records to 53539 (keeping 200 days of data) [2025-10-28T18:01:36.593349] [DEBUG] [LOCAL ] CNH: Primary data saved (53539 records). [2025-10-28T18:01:36.593467] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-28T18:01:36.593579] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNH took 25.2s. Estimated remaining: 3h 54m 29s. Rate: 8.0 symbols/min [2025-10-28T18:01:36.768092] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:36.765476] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-28T18:01:36.800157] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T18:01:36.831969] [DEBUG] [LOCAL ] CNMD: Loaded 31736 existing records from primary storage. [2025-10-28T18:01:36.832221] [INFO ] [MAIN ] CNMD: Loaded 31736 existing records. [2025-10-28T18:01:37.007749] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:37.008097] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-28T18:01:37.008158] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-28T18:01:37.008902] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-28T18:01:37.008961] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-28T18:01:37.364970] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:37.393721] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:01:37.559312] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-28T18:01:38.359341] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-28T18:01:39.159329] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-28T18:01:39.285046] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T18:01:39.450346] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-28T18:01:39.568202] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T18:01:39.959359] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-28T18:01:40.759307] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-28T18:01:40.812890] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T18:01:41.357154] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:01:41.559335] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-28T18:01:41.884820] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T18:01:42.359336] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-28T18:01:42.826871] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:01:43.159348] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-28T18:01:43.959324] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-28T18:01:44.751121] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-28T18:01:44.762719] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-28T18:01:44.827384] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T18:01:45.559355] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-28T18:01:45.921164] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:01:45.966676] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-28T18:01:46.359394] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-28T18:01:47.159356] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-28T18:01:47.270404] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T18:01:47.514213] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:01:47.959351] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-28T18:01:48.373363] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T18:01:48.759324] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-28T18:01:49.405327] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:01:49.415723] [INFO ] [REMOTE ] CNI: Full fetch complete (74801 records). [2025-10-28T18:01:49.415881] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-28T18:01:49.564427] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-28T18:01:49.825682] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-28T18:01:49.825913] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-28T18:01:49.826828] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-28T18:01:49.826911] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-28T18:01:49.828423] [DEBUG] [LOCAL ] CNI: Trimmed 74801 records to 51538 (keeping 200 days of data) [2025-10-28T18:01:50.074526] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:01:50.171629] [DEBUG] [LOCAL ] CNI: Primary data saved (51538 records). [2025-10-28T18:01:50.171803] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-28T18:01:50.171884] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNI took 30.6s. Estimated remaining: 3h 54m 44s. Rate: 8.0 symbols/min [2025-10-28T18:01:50.341409] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:50.341623] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-28T18:01:50.341700] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-28T18:01:50.341812] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-28T18:01:50.341872] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-28T18:01:50.341915] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-28T18:01:50.341946] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-28T18:01:50.364432] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-28T18:01:50.696848] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:50.921320] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:01:51.159344] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-28T18:01:51.704983] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T18:01:51.959450] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-28T18:01:52.102222] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:01:52.759333] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-28T18:01:53.491304] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:01:53.559309] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-28T18:01:53.670522] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:01:54.359377] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-28T18:01:54.720171] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:01:55.159334] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-28T18:01:55.653100] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T18:01:55.663391] [INFO ] [REMOTE ] CNK: Full fetch complete (75990 records). [2025-10-28T18:01:55.663526] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-28T18:01:55.664359] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:01:55.664447] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:01:55.664489] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:01:55.664552] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-28T18:01:55.664615] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-28T18:01:55.664678] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-28T18:01:55.664872] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-28T18:01:55.665175] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNK took 33.4s. Estimated remaining: 3h 54m 29s. Rate: 8.0 symbols/min [2025-10-28T18:01:55.849516] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:55.849753] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-10-28T18:01:55.849809] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-10-28T18:01:55.849916] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-28T18:01:55.849957] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-28T18:01:55.849999] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-28T18:01:55.850031] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-28T18:01:55.961580] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-28T18:01:56.234145] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:56.256174] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:01:56.759364] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-28T18:01:57.177089] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:01:57.532451] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:01:57.559342] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-28T18:01:58.359377] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-28T18:01:58.885853] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:01:59.159335] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-28T18:01:59.611104] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:01:59.959309] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-28T18:02:00.166067] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:02:00.759338] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-28T18:02:01.559375] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-28T18:02:01.699628] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T18:02:02.359512] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-28T18:02:03.065288] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-28T18:02:03.075218] [INFO ] [REMOTE ] CNM: Full fetch complete (73378 records). [2025-10-28T18:02:03.075366] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-28T18:02:03.076226] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:03.076329] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:03.076377] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:03.076417] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-28T18:02:03.076474] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-28T18:02:03.076511] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-10-28T18:02:03.076703] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-10-28T18:02:03.076809] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNM took 34.6s. Estimated remaining: 3h 54m 21s. Rate: 8.0 symbols/min [2025-10-28T18:02:03.164490] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-28T18:02:03.270920] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:03.330575] [DEBUG] [LOCAL ] CNP: Loaded 53474 existing records from primary storage. [2025-10-28T18:02:03.331023] [INFO ] [MAIN ] CNP: Loaded 53474 existing records. [2025-10-28T18:02:03.514477] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:03.514712] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-28T18:02:03.514767] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-28T18:02:03.515341] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-28T18:02:03.515398] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-28T18:02:03.905377] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:03.959298] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-28T18:02:04.260721] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:02:04.267272] [INFO ] [REMOTE ] CNMD: Full fetch complete (47205 records). [2025-10-28T18:02:04.267389] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-28T18:02:04.268100] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:04.268184] [FATAL] [MAIN ] CNMD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:04.268234] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:04.268312] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-28T18:02:04.268389] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-28T18:02:04.268443] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-10-28T18:02:04.268622] [DEBUG] [LOCAL ] CNMD: Deleted derivative data file. [2025-10-28T18:02:04.268757] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNMD took 27.7s. Estimated remaining: 3h 53m 50s. Rate: 8.0 symbols/min [2025-10-28T18:02:04.445940] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:04.446105] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-10-28T18:02:04.446141] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-10-28T18:02:04.446251] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-28T18:02:04.446291] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-28T18:02:04.446330] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-28T18:02:04.446359] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-28T18:02:04.812203] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:04.821311] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-28T18:02:04.840727] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-28T18:02:05.522861] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T18:02:05.559322] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-28T18:02:06.030864] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (4.47 seconds). [2025-10-28T18:02:06.117460] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:02:06.359413] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-28T18:02:06.779434] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:02:07.159405] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-28T18:02:07.508053] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:02:07.959376] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-28T18:02:08.366876] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:02:08.759362] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-28T18:02:09.228731] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T18:02:09.559335] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-28T18:02:10.067168] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T18:02:10.359351] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-28T18:02:10.488684] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:02:11.159342] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-28T18:02:11.959388] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-28T18:02:12.759350] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-28T18:02:12.912061] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:02:12.952037] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-28T18:02:13.559314] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-28T18:02:13.863232] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-28T18:02:14.359327] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-28T18:02:14.913103] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-28T18:02:15.159335] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-28T18:02:15.919185] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-28T18:02:15.959419] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-28T18:02:16.204622] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:02:16.759364] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-28T18:02:17.559339] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-28T18:02:17.947805] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:02:18.359332] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-28T18:02:18.572663] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (4.21 seconds). [2025-10-28T18:02:18.732770] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T18:02:19.159327] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-28T18:02:19.390492] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:02:19.675998] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (3.72 seconds). [2025-10-28T18:02:19.959339] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-28T18:02:20.586072] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:02:20.759327] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-28T18:02:21.466388] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:02:21.559305] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-28T18:02:21.941290] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:02:22.359345] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-28T18:02:22.777522] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:02:23.159313] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-28T18:02:23.361428] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T18:02:23.959348] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-28T18:02:24.362734] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:02:24.759340] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-28T18:02:25.305754] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T18:02:25.559314] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-28T18:02:26.359328] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-28T18:02:26.417632] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:02:26.424228] [INFO ] [REMOTE ] CNNE: Full fetch complete (50382 records). [2025-10-28T18:02:26.424330] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-28T18:02:26.424989] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:26.425075] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:26.425124] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:26.425210] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-28T18:02:26.425311] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-28T18:02:26.425360] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-28T18:02:26.425415] [DEBUG] [LOCAL ] CNNE: No derivative data file found to delete. [2025-10-28T18:02:26.425498] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNNE took 36.3s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-28T18:02:26.597840] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:26.597995] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-28T18:02:26.598031] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-28T18:02:26.598135] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-28T18:02:26.598180] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-28T18:02:26.598256] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-28T18:02:26.598303] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-28T18:02:26.975586] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:27.005348] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:02:27.159349] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-28T18:02:27.713470] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:02:27.964498] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-28T18:02:27.976276] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:02:28.759346] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-28T18:02:29.559398] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-28T18:02:30.359383] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-28T18:02:30.399047] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:02:30.407319] [INFO ] [REMOTE ] CNO: Full fetch complete (60635 records). [2025-10-28T18:02:30.407481] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-28T18:02:30.851324] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-28T18:02:30.851418] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-28T18:02:30.852385] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-28T18:02:30.852453] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-28T18:02:30.853940] [DEBUG] [LOCAL ] CNO: Trimmed 60635 records to 39874 (keeping 200 days of data) [2025-10-28T18:02:31.128271] [DEBUG] [LOCAL ] CNO: Primary data saved (39874 records). [2025-10-28T18:02:31.128479] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-28T18:02:31.128607] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNO took 35.5s. Estimated remaining: 3h 54m 19s. Rate: 8.0 symbols/min [2025-10-28T18:02:31.308946] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:31.330318] [DEBUG] [LOCAL ] CNS: Loaded 21224 existing records from primary storage. [2025-10-28T18:02:31.330590] [INFO ] [MAIN ] CNS: Loaded 21224 existing records. [2025-10-28T18:02:31.526931] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:31.527193] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-28T18:02:31.527244] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-28T18:02:31.527554] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-28T18:02:31.527618] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-28T18:02:31.720784] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-10-28T18:02:31.817178] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-28T18:02:31.958995] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-28T18:02:31.978674] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:31.987977] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-28T18:02:32.194218] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T18:02:32.204834] [INFO ] [REMOTE ] CNP: Full fetch complete (77556 records). [2025-10-28T18:02:32.204950] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-28T18:02:32.593940] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-28T18:02:32.594042] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-28T18:02:32.595120] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-28T18:02:32.595230] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-28T18:02:32.597115] [DEBUG] [LOCAL ] CNP: Trimmed 77556 records to 53474 (keeping 200 days of data) [2025-10-28T18:02:32.792287] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-28T18:02:32.837637] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:02:32.961800] [DEBUG] [LOCAL ] CNP: Primary data saved (53474 records). [2025-10-28T18:02:32.962158] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-28T18:02:32.962239] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNP took 29.9s. Estimated remaining: 3h 53m 50s. Rate: 8.0 symbols/min [2025-10-28T18:02:33.134193] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:33.180129] [DEBUG] [LOCAL ] CNX: Loaded 51282 existing records from primary storage. [2025-10-28T18:02:33.180473] [INFO ] [MAIN ] CNX: Loaded 51282 existing records. [2025-10-28T18:02:33.363761] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:33.364206] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-28T18:02:33.364279] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-28T18:02:33.365331] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-28T18:02:33.365392] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-28T18:02:33.560769] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-28T18:02:33.615383] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-28T18:02:33.802094] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:34.359324] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-28T18:02:34.539496] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T18:02:35.025429] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-28T18:02:35.159369] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-28T18:02:35.959379] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-28T18:02:36.677008] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T18:02:36.759411] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-28T18:02:36.796566] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T18:02:37.559336] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-28T18:02:37.780040] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (3.42 seconds). [2025-10-28T18:02:38.268056] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T18:02:38.359312] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-28T18:02:38.889069] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T18:02:38.899959] [INFO ] [REMOTE ] CNQ: Full fetch complete (77739 records). [2025-10-28T18:02:38.900118] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-28T18:02:39.165581] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-28T18:02:39.227276] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T18:02:39.339262] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-28T18:02:39.339343] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-28T18:02:39.340329] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-28T18:02:39.340398] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-28T18:02:39.342023] [DEBUG] [LOCAL ] CNQ: Trimmed 77739 records to 53578 (keeping 200 days of data) [2025-10-28T18:02:39.699034] [DEBUG] [LOCAL ] CNQ: Primary data saved (53578 records). [2025-10-28T18:02:39.699168] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-28T18:02:39.699242] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNQ took 35.4s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-28T18:02:39.889156] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:39.929451] [DEBUG] [LOCAL ] CODI: Loaded 41978 existing records from primary storage. [2025-10-28T18:02:39.929797] [INFO ] [MAIN ] CODI: Loaded 41978 existing records. [2025-10-28T18:02:39.965218] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-28T18:02:40.120049] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:40.120242] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-28T18:02:40.120291] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-28T18:02:40.120736] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-28T18:02:40.120793] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-28T18:02:40.491744] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:40.562922] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T18:02:40.759360] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-28T18:02:41.155522] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:02:41.389471] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:02:41.559348] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-28T18:02:42.339490] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T18:02:42.359307] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-28T18:02:43.143035] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:02:43.159317] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-28T18:02:43.847160] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:02:43.959374] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-28T18:02:44.759393] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-28T18:02:45.388825] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:02:45.559348] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-28T18:02:46.160905] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:02:46.359352] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-28T18:02:46.492139] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:02:47.159416] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-28T18:02:47.460197] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T18:02:47.959385] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-28T18:02:48.451743] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:02:48.759356] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-28T18:02:48.876568] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T18:02:48.882387] [INFO ] [REMOTE ] CNS: Full fetch complete (31518 records). [2025-10-28T18:02:48.882564] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-28T18:02:48.883218] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:48.883325] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:48.883395] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:48.883465] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-28T18:02:48.883532] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-28T18:02:48.883568] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-28T18:02:48.883759] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-28T18:02:48.883849] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CNS took 17.8s. Estimated remaining: 3h 53m 39s. Rate: 8.0 symbols/min [2025-10-28T18:02:49.060133] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:49.117330] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-28T18:02:49.117679] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-28T18:02:49.295557] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:49.295780] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-28T18:02:49.295828] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-28T18:02:49.296813] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-28T18:02:49.296870] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-28T18:02:49.567629] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-28T18:02:49.650884] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:50.202871] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:02:50.316276] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T18:02:50.359327] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-28T18:02:51.159325] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-28T18:02:51.358820] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T18:02:51.959611] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-28T18:02:52.759321] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-28T18:02:53.455865] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:02:53.559309] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-28T18:02:53.781683] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T18:02:54.359355] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-28T18:02:54.481687] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-28T18:02:54.947810] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:02:55.159360] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-28T18:02:55.959384] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-28T18:02:56.759328] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-28T18:02:57.286005] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-28T18:02:57.559373] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-28T18:02:57.968436] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T18:02:58.359338] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-28T18:02:58.516032] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-10-28T18:02:58.779707] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:02:59.159328] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-28T18:02:59.296859] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-10-28T18:02:59.959586] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-28T18:03:00.447342] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-28T18:03:00.759360] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-28T18:03:01.559395] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-28T18:03:01.616317] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T18:03:01.662763] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-28T18:03:02.359367] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-28T18:03:03.006722] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-28T18:03:03.160284] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-28T18:03:03.609618] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:03:03.730600] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-28T18:03:03.744153] [INFO ] [REMOTE ] CNR: Full fetch complete (63768 records). [2025-10-28T18:03:03.744348] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-28T18:03:03.745300] [FATAL] [VALIDATOR ] CNR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:03.745400] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:03.745469] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:03.745540] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-28T18:03:03.745607] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-28T18:03:03.745673] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-28T18:03:03.745743] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-28T18:03:03.745806] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CNR took 37.3s. Estimated remaining: 3h 53m 58s. Rate: 8.0 symbols/min [2025-10-28T18:03:03.928340] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:03.959342] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-28T18:03:03.980010] [DEBUG] [LOCAL ] COHR: Loaded 53376 existing records from primary storage. [2025-10-28T18:03:03.980336] [INFO ] [MAIN ] COHR: Loaded 53376 existing records. [2025-10-28T18:03:04.165765] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:04.166004] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-28T18:03:04.166053] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-28T18:03:04.166482] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-28T18:03:04.166540] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-28T18:03:04.541516] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:04.759315] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-28T18:03:04.930589] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T18:03:05.202530] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:03:05.559344] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-28T18:03:06.359317] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-28T18:03:07.105802] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-28T18:03:07.159316] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-28T18:03:07.445196] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T18:03:07.869604] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:03:07.881440] [INFO ] [REMOTE ] CNX: Full fetch complete (74883 records). [2025-10-28T18:03:07.881630] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-28T18:03:07.964869] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-28T18:03:08.286304] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-28T18:03:08.286383] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-28T18:03:08.287211] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-28T18:03:08.287273] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-28T18:03:08.288561] [DEBUG] [LOCAL ] CNX: Trimmed 74883 records to 51279 (keeping 200 days of data) [2025-10-28T18:03:08.578570] [DEBUG] [LOCAL ] CNX: Primary data saved (51279 records). [2025-10-28T18:03:08.578719] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-28T18:03:08.578805] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. CNX took 35.6s. Estimated remaining: 3h 53m 41s. Rate: 8.0 symbols/min [2025-10-28T18:03:08.748844] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:08.773277] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-28T18:03:08.779074] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T18:03:08.834622] [DEBUG] [LOCAL ] COLD: Loaded 52495 existing records from primary storage. [2025-10-28T18:03:08.834953] [INFO ] [MAIN ] COLD: Loaded 52495 existing records. [2025-10-28T18:03:09.007401] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:09.007596] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-28T18:03:09.007664] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-28T18:03:09.008204] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-28T18:03:09.008262] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-28T18:03:09.371685] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:09.394560] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:03:09.559352] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-28T18:03:10.359304] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-28T18:03:11.067541] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:03:11.077031] [INFO ] [REMOTE ] CODI: Full fetch complete (54150 records). [2025-10-28T18:03:11.077206] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-28T18:03:11.078076] [FATAL] [VALIDATOR ] CODI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:11.078178] [FATAL] [MAIN ] CODI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:11.078223] [WARN ] [MAIN ] CODI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:11.078303] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-28T18:03:11.078372] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-28T18:03:11.078409] [INFO ] [LOCAL ] CODI: Starting deletion of derivative data. [2025-10-28T18:03:11.078591] [DEBUG] [LOCAL ] CODI: Deleted derivative data file. [2025-10-28T18:03:11.078717] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. CODI took 31.4s. Estimated remaining: 3h 53m 15s. Rate: 8.0 symbols/min [2025-10-28T18:03:11.165586] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-28T18:03:11.266633] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:11.315155] [DEBUG] [LOCAL ] COMP: Loaded 53399 existing records from primary storage. [2025-10-28T18:03:11.315474] [INFO ] [MAIN ] COMP: Loaded 53399 existing records. [2025-10-28T18:03:11.491249] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:11.491475] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-28T18:03:11.491585] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-28T18:03:11.492023] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-28T18:03:11.492079] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-28T18:03:11.899710] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:11.926829] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-10-28T18:03:11.959299] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-28T18:03:12.759375] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-28T18:03:13.472795] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-28T18:03:13.559337] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-28T18:03:14.153304] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (3.79 seconds). [2025-10-28T18:03:14.359293] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-28T18:03:14.707625] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:03:15.159379] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-28T18:03:15.600613] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (3.64 seconds). [2025-10-28T18:03:15.893031] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T18:03:15.959319] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-28T18:03:16.759361] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-28T18:03:17.787858] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T18:03:17.799192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-28T18:03:18.011541] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (5.25 seconds). [2025-10-28T18:03:18.230236] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:03:18.359368] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-28T18:03:19.159328] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-28T18:03:19.311161] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:03:19.586680] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T18:03:19.877618] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (4.72 seconds). [2025-10-28T18:03:19.959341] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-28T18:03:20.613944] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T18:03:20.759317] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-28T18:03:21.161724] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:03:21.559323] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-28T18:03:22.021584] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:03:22.359337] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-28T18:03:23.110362] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T18:03:23.159302] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-28T18:03:23.876824] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:03:23.959361] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-28T18:03:24.759462] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-28T18:03:25.559352] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-28T18:03:25.928185] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:03:26.029492] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-28T18:03:26.359324] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-28T18:03:26.547495] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T18:03:26.559189] [INFO ] [REMOTE ] COF: Full fetch complete (77719 records). [2025-10-28T18:03:26.559347] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-28T18:03:27.029996] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-28T18:03:27.082820] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-28T18:03:27.083116] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-28T18:03:27.084281] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-28T18:03:27.084404] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-28T18:03:27.086636] [DEBUG] [LOCAL ] COF: Trimmed 77719 records to 53625 (keeping 200 days of data) [2025-10-28T18:03:27.181394] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-28T18:03:27.451034] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-28T18:03:27.451316] [INFO ] [MAIN ] COF: Full history saved. [2025-10-28T18:03:27.452359] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. COF took 38.6s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-28T18:03:27.652835] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:27.691275] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:03:27.741432] [DEBUG] [LOCAL ] CON: Loaded 38586 existing records from primary storage. [2025-10-28T18:03:27.741849] [INFO ] [MAIN ] CON: Loaded 38586 existing records. [2025-10-28T18:03:27.932225] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:27.932520] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-28T18:03:27.932615] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-28T18:03:27.932949] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-28T18:03:27.933025] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-28T18:03:27.965565] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-28T18:03:28.305962] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:28.759338] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-28T18:03:28.801996] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T18:03:29.412493] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:03:29.559338] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-28T18:03:30.224222] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T18:03:30.359374] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-28T18:03:31.168085] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-28T18:03:31.194587] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:03:31.304041] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:03:31.959451] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-28T18:03:32.759399] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-28T18:03:33.388523] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-28T18:03:33.399693] [INFO ] [REMOTE ] COHR: Full fetch complete (77475 records). [2025-10-28T18:03:33.399894] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-28T18:03:33.575743] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-28T18:03:33.844744] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-28T18:03:33.847745] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-28T18:03:33.848847] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-28T18:03:33.848926] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-28T18:03:33.851029] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-28T18:03:33.862627] [DEBUG] [LOCAL ] COHR: Trimmed 77475 records to 53375 (keeping 200 days of data) [2025-10-28T18:03:34.179688] [DEBUG] [LOCAL ] COHR: Primary data saved (53375 records). [2025-10-28T18:03:34.179911] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-28T18:03:34.180097] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COHR took 30.4s. Estimated remaining: 3h 53m 29s. Rate: 8.0 symbols/min [2025-10-28T18:03:34.322384] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T18:03:34.365486] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-28T18:03:34.392626] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:34.392879] [DEBUG] [LOCAL ] COOK: No existing data file found in primary storage. [2025-10-28T18:03:34.392923] [WARN ] [MAIN ] COOK: No existing data found, performing full refresh instead. [2025-10-28T18:03:34.393030] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-28T18:03:34.393071] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-28T18:03:34.393111] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-28T18:03:34.393143] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-28T18:03:34.740180] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:35.166292] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-28T18:03:35.174218] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T18:03:35.732041] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:03:35.959329] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-28T18:03:36.360709] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:03:36.759382] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-28T18:03:37.292732] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:03:37.559313] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-28T18:03:38.308758] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:03:38.319629] [INFO ] [REMOTE ] COLD: Full fetch complete (74652 records). [2025-10-28T18:03:38.319787] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-28T18:03:38.320524] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:38.320611] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:38.320686] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:38.320742] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-28T18:03:38.320799] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-28T18:03:38.320844] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-28T18:03:38.321024] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-28T18:03:38.321116] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. COLD took 29.7s. Estimated remaining: 3h 53m 10s. Rate: 8.0 symbols/min [2025-10-28T18:03:38.363863] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-28T18:03:38.494848] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:38.495178] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-28T18:03:38.495302] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-28T18:03:38.495478] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-28T18:03:38.495538] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-28T18:03:38.495707] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-28T18:03:38.495778] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-28T18:03:38.615264] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:03:38.877908] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:39.159308] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-28T18:03:39.289299] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:03:39.959381] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-28T18:03:40.325219] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:03:40.759408] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-28T18:03:41.489630] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T18:03:41.559343] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-28T18:03:42.303107] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T18:03:42.359309] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-28T18:03:43.159328] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-28T18:03:43.196990] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:03:43.207956] [INFO ] [REMOTE ] COMP: Full fetch complete (77412 records). [2025-10-28T18:03:43.208082] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-28T18:03:43.606413] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-28T18:03:43.606501] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-28T18:03:43.607454] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-28T18:03:43.607519] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-28T18:03:43.609107] [DEBUG] [LOCAL ] COMP: Trimmed 77412 records to 53398 (keeping 200 days of data) [2025-10-28T18:03:43.717205] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T18:03:43.925902] [DEBUG] [LOCAL ] COMP: Primary data saved (53398 records). [2025-10-28T18:03:43.926064] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-28T18:03:43.926146] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. COMP took 32.8s. Estimated remaining: 3h 52m 55s. Rate: 8.0 symbols/min [2025-10-28T18:03:43.960612] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-28T18:03:44.113665] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:44.157615] [DEBUG] [LOCAL ] COR: Loaded 45968 existing records from primary storage. [2025-10-28T18:03:44.157955] [INFO ] [MAIN ] COR: Loaded 45968 existing records. [2025-10-28T18:03:44.340669] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:44.340938] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-28T18:03:44.340991] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-28T18:03:44.341511] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-28T18:03:44.341684] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-28T18:03:44.716449] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:44.753469] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-28T18:03:44.763146] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-28T18:03:44.945535] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:03:45.559351] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-28T18:03:46.164521] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:03:46.359333] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-28T18:03:46.845020] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:03:47.109943] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:03:47.159302] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-28T18:03:47.959309] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-28T18:03:48.164637] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T18:03:48.759364] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-28T18:03:49.025283] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:03:49.559345] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-28T18:03:50.363306] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-28T18:03:50.366206] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:03:50.672013] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:03:51.159340] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-28T18:03:51.401457] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:03:51.959335] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-28T18:03:52.300925] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:03:52.759317] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-28T18:03:53.312700] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:03:53.559346] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-28T18:03:54.223533] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:03:54.230926] [INFO ] [REMOTE ] CON: Full fetch complete (56285 records). [2025-10-28T18:03:54.231024] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-28T18:03:54.231721] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:54.231808] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:54.231859] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:54.231923] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-28T18:03:54.231988] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-28T18:03:54.232026] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-28T18:03:54.232198] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-28T18:03:54.232697] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. CON took 26.8s. Estimated remaining: 3h 52m 58s. Rate: 8.0 symbols/min [2025-10-28T18:03:54.371373] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-28T18:03:54.403707] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:54.452210] [DEBUG] [LOCAL ] COTY: Loaded 53247 existing records from primary storage. [2025-10-28T18:03:54.452512] [INFO ] [MAIN ] COTY: Loaded 53247 existing records. [2025-10-28T18:03:54.633917] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:54.634237] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-28T18:03:54.634294] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-28T18:03:54.635052] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-28T18:03:54.635110] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-28T18:03:55.005021] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:55.035480] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T18:03:55.159305] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-28T18:03:55.882522] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T18:03:55.959344] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-28T18:03:56.759319] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-28T18:03:56.964060] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T18:03:57.559319] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-28T18:03:57.704402] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T18:03:58.359414] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-28T18:03:58.806082] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-28T18:03:59.159343] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-28T18:03:59.288488] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T18:03:59.867735] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:03:59.921141] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T18:03:59.959353] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-28T18:04:00.759338] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-28T18:04:01.144595] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:04:01.559338] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-28T18:04:02.359419] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-28T18:04:02.585064] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-28T18:04:03.159377] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-28T18:04:03.958365] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-28T18:04:03.960340] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-28T18:04:04.249858] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T18:04:04.759317] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-28T18:04:05.010773] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-28T18:04:05.264710] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T18:04:05.559342] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-28T18:04:06.346826] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T18:04:06.359303] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-28T18:04:06.815741] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:04:07.159355] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-28T18:04:07.464698] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T18:04:07.469808] [INFO ] [REMOTE ] COOK: Full fetch complete (33151 records). [2025-10-28T18:04:07.469891] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-28T18:04:07.858191] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-28T18:04:07.858268] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-28T18:04:07.858810] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-28T18:04:07.858874] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-28T18:04:07.859612] [DEBUG] [LOCAL ] COOK: Trimmed 33151 records to 24632 (keeping 200 days of data) [2025-10-28T18:04:07.963687] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-28T18:04:07.994010] [DEBUG] [LOCAL ] COOK: Primary data saved (24632 records). [2025-10-28T18:04:07.994135] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-28T18:04:07.994235] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COOK took 33.8s. Estimated remaining: 3h 53m 13s. Rate: 8.0 symbols/min [2025-10-28T18:04:08.164616] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:08.207917] [DEBUG] [LOCAL ] COUR: Loaded 49420 existing records from primary storage. [2025-10-28T18:04:08.208196] [INFO ] [MAIN ] COUR: Loaded 49420 existing records. [2025-10-28T18:04:08.384162] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:08.384366] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-28T18:04:08.384492] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-28T18:04:08.385215] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-28T18:04:08.385274] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-28T18:04:08.765561] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:08.760513] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-28T18:04:08.768588] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T18:04:09.201306] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T18:04:09.559364] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-28T18:04:10.306265] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T18:04:10.359314] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-28T18:04:10.868246] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T18:04:10.936537] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T18:04:10.947027] [INFO ] [REMOTE ] COP: Full fetch complete (77516 records). [2025-10-28T18:04:10.947201] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-28T18:04:10.948054] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:10.948150] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:10.948225] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:10.948315] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-28T18:04:10.948396] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-28T18:04:10.948435] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-28T18:04:10.948475] [DEBUG] [LOCAL ] COP: No derivative data file found to delete. [2025-10-28T18:04:10.948532] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 32.6s. Estimated remaining: 3h 52m 49s. Rate: 8.0 symbols/min [2025-10-28T18:04:11.159043] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:11.159334] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-28T18:04:11.160433] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-28T18:04:11.160495] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-28T18:04:11.160632] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-28T18:04:11.160869] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-28T18:04:11.160929] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-28T18:04:11.160965] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-28T18:04:11.697156] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:11.959409] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-28T18:04:12.608891] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:04:12.759297] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-28T18:04:13.236089] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:04:13.559320] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-28T18:04:14.359349] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-28T18:04:14.468676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T18:04:14.915173] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:04:15.159317] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-28T18:04:15.716090] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T18:04:15.959339] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-28T18:04:16.759327] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-28T18:04:17.110160] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-28T18:04:17.428772] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T18:04:17.559316] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-28T18:04:18.079255] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T18:04:18.087394] [INFO ] [REMOTE ] COR: Full fetch complete (67867 records). [2025-10-28T18:04:18.087510] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-28T18:04:18.088169] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:18.088254] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:18.088296] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:18.088333] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-28T18:04:18.088388] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-28T18:04:18.088423] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-28T18:04:18.088578] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-28T18:04:18.089615] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. COR took 34.2s. Estimated remaining: 3h 52m 40s. Rate: 8.0 symbols/min [2025-10-28T18:04:18.257772] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:18.284729] [DEBUG] [LOCAL ] CPA: Loaded 27383 existing records from primary storage. [2025-10-28T18:04:18.284976] [INFO ] [MAIN ] CPA: Loaded 27383 existing records. [2025-10-28T18:04:18.364526] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-28T18:04:18.462050] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:18.462234] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-28T18:04:18.462278] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-28T18:04:18.462804] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-28T18:04:18.462861] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-28T18:04:18.820186] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:18.850089] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:04:19.159335] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-28T18:04:19.959312] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-28T18:04:20.086005] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T18:04:20.097907] [INFO ] [REMOTE ] COTY: Full fetch complete (77277 records). [2025-10-28T18:04:20.098107] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-28T18:04:20.545328] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-28T18:04:20.545433] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-28T18:04:20.546617] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-28T18:04:20.546714] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-28T18:04:20.579925] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T18:04:20.578078] [DEBUG] [LOCAL ] COTY: Trimmed 77277 records to 53246 (keeping 200 days of data) [2025-10-28T18:04:20.761189] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-28T18:04:20.891407] [DEBUG] [LOCAL ] COTY: Primary data saved (53246 records). [2025-10-28T18:04:20.891535] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-28T18:04:20.892136] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. COTY took 26.7s. Estimated remaining: 3h 52m 15s. Rate: 8.0 symbols/min [2025-10-28T18:04:21.061918] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:21.062069] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-28T18:04:21.062106] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-28T18:04:21.062209] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-28T18:04:21.062249] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-28T18:04:21.062292] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-28T18:04:21.062323] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-28T18:04:21.418731] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:21.444968] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T18:04:21.559293] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-28T18:04:21.890004] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:04:22.359320] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-28T18:04:22.724815] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T18:04:23.135106] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:04:23.159347] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-28T18:04:23.959359] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-28T18:04:24.759336] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-28T18:04:24.998353] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-28T18:04:25.100737] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T18:04:25.559375] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-28T18:04:25.605434] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:04:25.800448] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T18:04:26.359365] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-28T18:04:26.613133] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T18:04:27.159409] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-28T18:04:27.372949] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-28T18:04:27.959365] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-28T18:04:28.759351] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-28T18:04:29.261571] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:04:29.559328] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-28T18:04:29.957154] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T18:04:30.359392] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-28T18:04:30.629309] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:04:31.159375] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-28T18:04:31.416394] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T18:04:31.633393] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T18:04:31.959359] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-28T18:04:32.221818] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-28T18:04:32.759333] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-28T18:04:33.559347] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-28T18:04:34.359350] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-28T18:04:34.514092] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T18:04:35.159376] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-28T18:04:35.405505] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T18:04:35.616357] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-28T18:04:35.959433] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-28T18:04:36.410016] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T18:04:36.511209] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T18:04:36.759378] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-28T18:04:37.559357] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-28T18:04:38.359761] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-28T18:04:38.362367] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:04:38.372864] [INFO ] [REMOTE ] COUR: Full fetch complete (70994 records). [2025-10-28T18:04:38.373018] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-28T18:04:38.373796] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:38.373880] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:38.373924] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:38.373990] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-28T18:04:38.374054] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-28T18:04:38.374091] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-10-28T18:04:38.374256] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-10-28T18:04:38.374331] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. COUR took 30.4s. Estimated remaining: 3h 52m 43s. Rate: 8.0 symbols/min [2025-10-28T18:04:38.544420] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:38.571681] [DEBUG] [LOCAL ] CPAY: Loaded 29565 existing records from primary storage. [2025-10-28T18:04:38.571945] [INFO ] [MAIN ] CPAY: Loaded 29565 existing records. [2025-10-28T18:04:38.750694] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:38.751010] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-28T18:04:38.751062] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-28T18:04:38.751618] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-28T18:04:38.751717] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-28T18:04:39.126410] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:39.156157] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T18:04:39.166966] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-28T18:04:39.415943] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:04:39.959381] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-28T18:04:40.759373] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-28T18:04:41.271728] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-28T18:04:41.559364] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-28T18:04:41.880405] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-28T18:04:41.922245] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:04:42.359318] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-28T18:04:42.684552] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T18:04:43.159311] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-28T18:04:43.264685] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T18:04:43.959318] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-28T18:04:44.342161] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T18:04:44.574052] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T18:04:44.759354] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-28T18:04:45.559349] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-28T18:04:46.187620] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:04:46.359352] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-28T18:04:46.667178] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:04:46.930807] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T18:04:46.931871] [INFO ] [REMOTE ] CPAC: Full fetch complete (1810 records). [2025-10-28T18:04:46.931939] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-28T18:04:47.129543] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T18:04:47.129810] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:47.129880] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:47.129962] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-28T18:04:47.130031] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-28T18:04:47.130068] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-28T18:04:47.130133] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-28T18:04:47.130201] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. CPAC took 26.2s. Estimated remaining: 3h 52m 40s. Rate: 8.0 symbols/min [2025-10-28T18:04:47.164492] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-28T18:04:47.300129] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:47.316575] [DEBUG] [LOCAL ] CPF: Loaded 14882 existing records from primary storage. [2025-10-28T18:04:47.316830] [INFO ] [MAIN ] CPF: Loaded 14882 existing records. [2025-10-28T18:04:47.489193] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:47.489389] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-28T18:04:47.489434] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-28T18:04:47.489828] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-28T18:04:47.489886] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-28T18:04:47.856709] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:47.959313] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-28T18:04:48.764437] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-28T18:04:48.773456] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:04:49.208091] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T18:04:49.218301] [INFO ] [REMOTE ] CP: Full fetch complete (76900 records). [2025-10-28T18:04:49.218428] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-28T18:04:49.219209] [FATAL] [VALIDATOR ] CP: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:49.219357] [FATAL] [MAIN ] CP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:49.219443] [WARN ] [MAIN ] CP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:49.219489] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-28T18:04:49.219546] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-28T18:04:49.219580] [INFO ] [LOCAL ] CP: Starting deletion of derivative data. [2025-10-28T18:04:49.219618] [DEBUG] [LOCAL ] CP: No derivative data file found to delete. [2025-10-28T18:04:49.219702] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CP took 38.3s. Estimated remaining: 3h 52m 13s. Rate: 8.0 symbols/min [2025-10-28T18:04:49.386969] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:49.400874] [DEBUG] [LOCAL ] CPK: Loaded 13687 existing records from primary storage. [2025-10-28T18:04:49.401107] [INFO ] [MAIN ] CPK: Loaded 13687 existing records. [2025-10-28T18:04:49.570683] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-28T18:04:49.578943] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:49.580253] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-28T18:04:49.580309] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-28T18:04:49.580720] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-28T18:04:49.580777] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-28T18:04:49.939274] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:49.966832] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:04:50.311929] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:04:50.359337] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-28T18:04:51.159312] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-28T18:04:51.398697] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:04:51.786374] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:04:51.959402] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-28T18:04:52.759342] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-28T18:04:53.047913] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:04:53.559313] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-28T18:04:53.697895] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T18:04:53.702760] [INFO ] [REMOTE ] CPA: Full fetch complete (40746 records). [2025-10-28T18:04:53.702881] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-28T18:04:53.703496] [FATAL] [VALIDATOR ] CPA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:53.703611] [FATAL] [MAIN ] CPA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:53.703702] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:53.703774] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-28T18:04:53.703837] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-28T18:04:53.703871] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-28T18:04:53.704003] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-10-28T18:04:53.704076] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPA took 35.6s. Estimated remaining: 3h 51m 55s. Rate: 8.0 symbols/min [2025-10-28T18:04:54.150346] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T18:04:54.359365] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-28T18:04:55.159340] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-28T18:04:55.384770] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T18:04:55.730189] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T18:04:55.959355] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-28T18:04:56.731176] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:04:56.759320] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-28T18:04:57.463834] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T18:04:57.559309] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-28T18:04:58.292026] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T18:04:58.359325] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-28T18:04:59.069528] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T18:04:59.159358] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-28T18:04:59.887036] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T18:04:59.959366] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-28T18:05:00.759315] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-28T18:05:01.479701] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:05:01.559382] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-28T18:05:01.646724] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T18:05:02.307480] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:05:02.359422] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-28T18:05:03.159442] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-28T18:05:03.758016] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:05:03.959360] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-28T18:05:04.227324] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:05:04.759388] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-28T18:05:05.414560] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:05:05.452076] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:05:05.559309] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-28T18:05:06.359319] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-28T18:05:06.658314] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:05:07.104886] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:05:07.159335] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-28T18:05:07.835860] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T18:05:07.959311] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-28T18:05:08.759375] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-28T18:05:08.849435] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T18:05:08.852872] [INFO ] [REMOTE ] CPF: Full fetch complete (23107 records). [2025-10-28T18:05:08.852955] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-28T18:05:09.211673] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-28T18:05:09.211760] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-28T18:05:09.212185] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-28T18:05:09.212245] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-28T18:05:09.212890] [DEBUG] [LOCAL ] CPF: Trimmed 23107 records to 14819 (keeping 200 days of data) [2025-10-28T18:05:09.299274] [DEBUG] [LOCAL ] CPF: Primary data saved (14819 records). [2025-10-28T18:05:09.299407] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-28T18:05:09.299486] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPF took 22.2s. Estimated remaining: 3h 52m 16s. Rate: 8.0 symbols/min [2025-10-28T18:05:09.434720] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T18:05:09.559311] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-28T18:05:10.359417] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-28T18:05:10.465097] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:05:10.468916] [INFO ] [REMOTE ] CPK: Full fetch complete (18808 records). [2025-10-28T18:05:10.469027] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-28T18:05:10.469498] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:05:10.469587] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:05:10.469632] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:05:10.469729] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-28T18:05:10.469802] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-28T18:05:10.469844] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-10-28T18:05:10.469990] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-10-28T18:05:10.470066] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPK took 21.3s. Estimated remaining: 3h 51m 46s. Rate: 8.0 symbols/min [2025-10-28T18:05:11.189317] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T18:05:11.195685] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-28T18:05:12.237449] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:05:12.242908] [INFO ] [REMOTE ] CPAY: Full fetch complete (44356 records). [2025-10-28T18:05:12.242993] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-28T18:05:12.629607] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-28T18:05:12.629731] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-28T18:05:12.630382] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-28T18:05:12.630428] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-28T18:05:12.631494] [DEBUG] [LOCAL ] CPAY: Trimmed 44356 records to 29462 (keeping 200 days of data) [2025-10-28T18:05:12.814159] [DEBUG] [LOCAL ] CPAY: Primary data saved (29462 records). [2025-10-28T18:05:12.814280] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-28T18:05:12.814357] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPAY took 34.4s. Estimated remaining: 3h 51m 20s. Rate: 8.0 symbols/min [2025-10-28T18:05:13.404200] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.429909] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-10-28T18:05:13.494591] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.507058] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.526018] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-10-28T18:05:13.527637] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.526812] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-28T18:05:13.529458] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-28T18:05:13.529527] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-28T18:05:13.529562] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-28T18:05:13.760938] [DEBUG] [LOCAL ] CPS: Loaded 24342 existing records from primary storage. [2025-10-28T18:05:13.815973] [INFO ] [MAIN ] CPS: Loaded 24342 existing records. [2025-10-28T18:05:13.867730] [DEBUG] [LOCAL ] CPT: Loaded 44324 existing records from primary storage. [2025-10-28T18:05:13.958048] [INFO ] [MAIN ] CPT: Loaded 44324 existing records. [2025-10-28T18:05:13.972834] [DEBUG] [LOCAL ] CPRI: Loaded 52365 existing records from primary storage. [2025-10-28T18:05:14.048800] [INFO ] [MAIN ] CPRI: Loaded 52365 existing records. [2025-10-28T18:05:14.314987] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:14.382612] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-28T18:05:14.395212] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:14.420743] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-28T18:05:14.426293] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-28T18:05:14.488167] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-28T18:05:14.535974] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:14.539895] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-28T18:05:14.539816] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:14.570871] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-28T18:05:14.570818] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-28T18:05:14.576175] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-28T18:05:14.570996] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-28T18:05:14.604734] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-28T18:05:14.631945] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-28T18:05:14.639492] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-28T18:05:14.653778] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-28T18:05:15.476639] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:15.493261] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-28T18:05:15.635722] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:15.641770] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:15.637830] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-28T18:05:15.642060] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-28T18:05:16.173731] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:05:16.183923] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-28T18:05:16.533587] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:05:16.538252] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-28T18:05:16.815129] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T18:05:16.824326] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-28T18:05:17.019016] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:05:17.433867] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:05:17.559335] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-28T18:05:17.937633] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:05:18.089449] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-28T18:05:18.359323] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-28T18:05:18.781683] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:05:19.159321] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-28T18:05:19.959396] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-28T18:05:20.249766] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T18:05:20.345748] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T18:05:20.759371] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-28T18:05:21.013934] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T18:05:21.559330] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-28T18:05:22.157094] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:05:22.359310] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-28T18:05:22.539518] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T18:05:23.159315] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-28T18:05:23.898670] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:05:23.959293] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-28T18:05:24.712177] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T18:05:24.759295] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-28T18:05:25.016935] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-28T18:05:25.559313] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-28T18:05:25.724624] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:05:26.359318] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-28T18:05:27.159324] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-28T18:05:27.368823] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T18:05:27.776003] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:05:27.959309] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T18:05:27.959435] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-28T18:05:28.759340] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-28T18:05:29.250745] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:05:29.559352] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-28T18:05:29.732499] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T18:05:29.736920] [INFO ] [REMOTE ] CPS: Full fetch complete (36429 records). [2025-10-28T18:05:29.737001] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-28T18:05:30.097952] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-28T18:05:30.098031] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-28T18:05:30.098584] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-28T18:05:30.098632] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-28T18:05:30.099491] [DEBUG] [LOCAL ] CPS: Trimmed 36429 records to 24213 (keeping 200 days of data) [2025-10-28T18:05:30.233256] [DEBUG] [LOCAL ] CPS: Primary data saved (24213 records). [2025-10-28T18:05:30.233380] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-28T18:05:30.233456] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CPS took 17.4s. Estimated remaining: 3h 51m 47s. Rate: 8.0 symbols/min [2025-10-28T18:05:30.370361] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-28T18:05:30.401542] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:30.401731] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-28T18:05:30.401786] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-28T18:05:30.401910] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-28T18:05:30.401950] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-28T18:05:30.401991] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-28T18:05:30.402022] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-28T18:05:30.767506] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:30.821503] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:05:31.159329] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-28T18:05:31.959310] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-28T18:05:32.351853] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-28T18:05:32.619617] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:05:32.759341] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-28T18:05:32.855636] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T18:05:33.559330] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-28T18:05:34.359307] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-28T18:05:34.455591] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T18:05:34.815638] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:05:35.159356] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-28T18:05:35.926351] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:05:35.959322] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-28T18:05:36.072017] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T18:05:36.759334] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-28T18:05:37.554025] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:05:37.564501] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-28T18:05:38.004929] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:05:38.212726] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T18:05:38.359398] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-28T18:05:39.159343] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-28T18:05:39.498756] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T18:05:39.959385] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-28T18:05:40.614798] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T18:05:40.759404] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-28T18:05:41.094929] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-28T18:05:41.559338] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-28T18:05:41.930884] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:05:42.359365] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-28T18:05:42.703587] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:05:43.159335] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-28T18:05:43.830763] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:05:43.959354] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-28T18:05:44.759384] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-28T18:05:45.227513] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:05:45.269391] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-28T18:05:45.281011] [INFO ] [REMOTE ] CPNG: Full fetch complete (77793 records). [2025-10-28T18:05:45.281201] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-28T18:05:45.564546] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-28T18:05:45.679464] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-28T18:05:45.679557] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-28T18:05:45.680463] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-28T18:05:45.680531] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-28T18:05:45.682185] [DEBUG] [LOCAL ] CPNG: Trimmed 77793 records to 53679 (keeping 200 days of data) [2025-10-28T18:05:46.002256] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-28T18:05:46.002555] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-28T18:05:46.002715] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPNG took 33.2s. Estimated remaining: 3h 52m 9s. Rate: 7.9 symbols/min [2025-10-28T18:05:46.197559] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:46.201921] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:05:46.211745] [INFO ] [REMOTE ] CPT: Full fetch complete (64700 records). [2025-10-28T18:05:46.211905] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-28T18:05:46.386944] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-28T18:05:46.410624] [DEBUG] [LOCAL ] CR: Loaded 23894 existing records from primary storage. [2025-10-28T18:05:46.428923] [INFO ] [MAIN ] CR: Loaded 23894 existing records. [2025-10-28T18:05:46.843042] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-28T18:05:46.848307] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:46.848552] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-28T18:05:46.848894] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-28T18:05:46.848991] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-28T18:05:46.849946] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-28T18:05:46.850090] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-28T18:05:46.850476] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-28T18:05:46.850583] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-28T18:05:46.922060] [DEBUG] [LOCAL ] CPT: Trimmed 64700 records to 44251 (keeping 200 days of data) [2025-10-28T18:05:47.431085] [DEBUG] [LOCAL ] CPT: Primary data saved (44251 records). [2025-10-28T18:05:47.457989] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-28T18:05:47.484121] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CPT took 34.6s. Estimated remaining: 3h 51m 40s. Rate: 8.0 symbols/min [2025-10-28T18:05:47.569916] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:47.645431] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-28T18:05:47.676502] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-28T18:05:47.670526] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:05:47.763440] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:47.773494] [DEBUG] [LOCAL ] CRBD: Loaded 8602 existing records from primary storage. [2025-10-28T18:05:47.773720] [INFO ] [MAIN ] CRBD: Loaded 8602 existing records. [2025-10-28T18:05:47.946545] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:47.946762] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-28T18:05:47.946812] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-28T18:05:47.947013] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-28T18:05:47.947053] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-28T18:05:47.966946] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-28T18:05:48.307278] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:48.574415] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:05:48.759344] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-28T18:05:49.319492] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T18:05:49.329302] [INFO ] [REMOTE ] CPRI: Full fetch complete (75808 records). [2025-10-28T18:05:49.329458] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-28T18:05:49.330184] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:05:49.330267] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:05:49.330334] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:05:49.330402] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-28T18:05:49.330465] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-28T18:05:49.330500] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-10-28T18:05:49.330683] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-10-28T18:05:49.330774] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CPRI took 36.5s. Estimated remaining: 3h 51m 12s. Rate: 8.0 symbols/min [2025-10-28T18:05:49.494301] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:49.542682] [DEBUG] [LOCAL ] CRBG: Loaded 52566 existing records from primary storage. [2025-10-28T18:05:49.542978] [INFO ] [MAIN ] CRBG: Loaded 52566 existing records. [2025-10-28T18:05:49.564402] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-28T18:05:49.723012] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:49.738195] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-28T18:05:49.739281] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T18:05:49.738772] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-28T18:05:49.745618] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-28T18:05:49.745706] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-28T18:05:50.101534] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:50.359677] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-28T18:05:50.359600] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T18:05:51.159398] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-28T18:05:51.789668] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:05:51.906373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:05:51.959320] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-28T18:05:52.457534] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T18:05:52.759348] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-28T18:05:53.559326] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-28T18:05:53.883477] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:05:54.359421] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-28T18:05:54.426735] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:05:54.855886] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T18:05:55.159408] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-28T18:05:55.959401] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-28T18:05:56.449060] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:05:56.570626] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:05:56.759387] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-28T18:05:57.426829] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:05:57.559343] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-28T18:05:58.027831] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:05:58.359362] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-28T18:05:59.121025] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T18:05:59.124549] [INFO ] [REMOTE ] CQP: Full fetch complete (29427 records). [2025-10-28T18:05:59.124714] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-28T18:05:59.164437] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-28T18:05:59.526583] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-28T18:05:59.526693] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-28T18:05:59.527290] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-28T18:05:59.527355] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-28T18:05:59.528258] [DEBUG] [LOCAL ] CQP: Trimmed 29427 records to 18615 (keeping 200 days of data) [2025-10-28T18:05:59.639338] [DEBUG] [LOCAL ] CQP: Primary data saved (18615 records). [2025-10-28T18:05:59.639480] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-28T18:05:59.639553] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CQP took 29.4s. Estimated remaining: 3h 51m 15s. Rate: 8.0 symbols/min [2025-10-28T18:05:59.815194] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:59.852198] [DEBUG] [LOCAL ] CRC: Loaded 43808 existing records from primary storage. [2025-10-28T18:05:59.852566] [INFO ] [MAIN ] CRC: Loaded 43808 existing records. [2025-10-28T18:05:59.960088] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-28T18:06:00.040547] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:00.040772] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-28T18:06:00.040822] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-28T18:06:00.041507] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-28T18:06:00.041565] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-28T18:06:00.425257] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:00.571452] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:06:00.759367] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-28T18:06:01.065579] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:06:01.559349] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-28T18:06:02.359320] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-28T18:06:02.396952] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T18:06:02.515529] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T18:06:03.159360] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-28T18:06:03.475695] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:06:03.959321] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-28T18:06:04.183345] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T18:06:04.759397] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-28T18:06:05.056487] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:06:05.559325] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-28T18:06:05.911234] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T18:06:06.086405] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:06:06.359357] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-28T18:06:07.159366] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-28T18:06:07.215597] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T18:06:07.686193] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T18:06:07.959357] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-28T18:06:08.487384] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T18:06:08.759388] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-28T18:06:09.559350] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-28T18:06:10.224915] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:06:10.359345] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-28T18:06:10.801823] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:06:11.159352] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-28T18:06:11.741557] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T18:06:11.959342] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-28T18:06:12.033673] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:06:12.759358] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-28T18:06:13.241008] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:06:13.400844] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T18:06:13.559328] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-28T18:06:14.359345] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-28T18:06:14.710006] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:06:14.790774] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T18:06:15.159371] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-28T18:06:15.959350] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-28T18:06:16.284366] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T18:06:16.759376] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-28T18:06:17.328068] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T18:06:17.338578] [INFO ] [REMOTE ] CRBG: Full fetch complete (76044 records). [2025-10-28T18:06:17.338751] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-28T18:06:17.468801] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:06:17.499525] [INFO ] [REMOTE ] CRBD: Full fetch complete (12725 records). [2025-10-28T18:06:17.510679] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-28T18:06:17.567760] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-28T18:06:18.100730] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-28T18:06:18.102281] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-28T18:06:18.103239] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-28T18:06:18.103633] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-28T18:06:18.180827] [DEBUG] [LOCAL ] CRBG: Trimmed 76044 records to 52565 (keeping 200 days of data) [2025-10-28T18:06:18.188904] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-28T18:06:18.189286] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-28T18:06:18.189522] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-28T18:06:18.189589] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-28T18:06:18.190288] [DEBUG] [LOCAL ] CRBD: Trimmed 12725 records to 8602 (keeping 200 days of data) [2025-10-28T18:06:18.341797] [DEBUG] [LOCAL ] CRBD: Primary data saved (8602 records). [2025-10-28T18:06:18.353279] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-28T18:06:18.353409] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 30.9s. Estimated remaining: 3h 51m 46s. Rate: 7.9 symbols/min [2025-10-28T18:06:18.372860] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-28T18:06:18.640008] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:18.648144] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-28T18:06:18.648925] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-28T18:06:18.652904] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-28T18:06:18.655815] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-28T18:06:18.672042] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-28T18:06:18.674517] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-28T18:06:18.673603] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T18:06:18.873823] [DEBUG] [LOCAL ] CRBG: Primary data saved (52565 records). [2025-10-28T18:06:18.884558] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-28T18:06:18.884708] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CRBG took 29.6s. Estimated remaining: 3h 51m 14s. Rate: 8.0 symbols/min [2025-10-28T18:06:19.166496] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-28T18:06:19.246153] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:19.331883] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:19.371141] [DEBUG] [LOCAL ] CRGY: Loaded 52486 existing records from primary storage. [2025-10-28T18:06:19.371431] [INFO ] [MAIN ] CRGY: Loaded 52486 existing records. [2025-10-28T18:06:19.546524] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:19.546767] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-28T18:06:19.546819] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-28T18:06:19.547348] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-28T18:06:19.547405] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-28T18:06:19.917095] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:19.940960] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T18:06:19.959301] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-28T18:06:20.213727] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:06:20.759345] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-28T18:06:20.919814] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:06:20.920168] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-28T18:06:20.920254] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:06:20.920299] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-28T18:06:20.920360] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:06:20.920429] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-28T18:06:20.920492] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-28T18:06:20.920527] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-28T18:06:20.920565] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-28T18:06:20.920610] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRCL took 2.6s. Estimated remaining: 3h 50m 47s. Rate: 8.0 symbols/min [2025-10-28T18:06:21.090104] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:21.137671] [DEBUG] [LOCAL ] CRH: Loaded 53392 existing records from primary storage. [2025-10-28T18:06:21.137974] [INFO ] [MAIN ] CRH: Loaded 53392 existing records. [2025-10-28T18:06:21.315021] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:21.315381] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-28T18:06:21.315452] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-28T18:06:21.316401] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-28T18:06:21.316461] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-28T18:06:21.441529] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:06:21.564526] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-28T18:06:21.701911] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:22.359378] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-28T18:06:22.733635] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T18:06:22.738636] [INFO ] [REMOTE ] CR: Full fetch complete (35043 records). [2025-10-28T18:06:22.738743] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-28T18:06:23.109897] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-28T18:06:23.110196] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-28T18:06:23.110702] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-28T18:06:23.110762] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-28T18:06:23.111527] [DEBUG] [LOCAL ] CR: Trimmed 35043 records to 23923 (keeping 200 days of data) [2025-10-28T18:06:23.164821] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-28T18:06:23.259568] [DEBUG] [LOCAL ] CR: Primary data saved (23923 records). [2025-10-28T18:06:23.259816] [INFO ] [MAIN ] CR: Full history saved. [2025-10-28T18:06:23.259905] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CR took 37.3s. Estimated remaining: 3h 50m 22s. Rate: 8.0 symbols/min [2025-10-28T18:06:23.426459] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:23.467824] [DEBUG] [LOCAL ] CRI: Loaded 49480 existing records from primary storage. [2025-10-28T18:06:23.468131] [INFO ] [MAIN ] CRI: Loaded 49480 existing records. [2025-10-28T18:06:23.651955] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:23.652538] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-28T18:06:23.652716] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-28T18:06:23.653740] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-28T18:06:23.653800] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-28T18:06:23.794794] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:06:23.969317] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-28T18:06:24.057588] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:24.357770] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:06:24.759421] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-28T18:06:25.450372] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:06:25.559345] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-28T18:06:26.183970] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T18:06:26.359367] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-28T18:06:27.008115] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:06:27.159361] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-28T18:06:27.604110] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T18:06:27.959327] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-28T18:06:28.614214] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T18:06:28.759314] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-28T18:06:29.119239] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T18:06:29.559383] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-28T18:06:29.959574] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:06:30.359329] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-28T18:06:31.021767] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:06:31.030994] [INFO ] [REMOTE ] CRC: Full fetch complete (62837 records). [2025-10-28T18:06:31.031187] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-28T18:06:31.173513] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-28T18:06:31.417347] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-28T18:06:31.417502] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-28T18:06:31.418439] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-28T18:06:31.418509] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-28T18:06:31.420092] [DEBUG] [LOCAL ] CRC: Trimmed 62837 records to 43708 (keeping 200 days of data) [2025-10-28T18:06:31.703334] [DEBUG] [LOCAL ] CRC: Primary data saved (43708 records). [2025-10-28T18:06:31.703591] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-28T18:06:31.703745] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRC took 32.1s. Estimated remaining: 3h 50m 17s. Rate: 8.0 symbols/min [2025-10-28T18:06:31.929983] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:31.933146] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:06:31.971441] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-28T18:06:31.995824] [DEBUG] [LOCAL ] CRK: Loaded 52167 existing records from primary storage. [2025-10-28T18:06:31.996137] [INFO ] [MAIN ] CRK: Loaded 52167 existing records. [2025-10-28T18:06:32.195832] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:32.196057] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-28T18:06:32.196121] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-28T18:06:32.196560] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-28T18:06:32.196602] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-28T18:06:32.614834] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:32.647821] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T18:06:32.759326] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-28T18:06:33.179105] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:06:33.559388] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-28T18:06:33.994411] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:06:34.359425] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-28T18:06:35.006870] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T18:06:35.159370] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-28T18:06:35.651262] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:06:35.959379] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-28T18:06:36.771065] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-28T18:06:36.777452] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T18:06:37.418724] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:06:37.559342] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-28T18:06:37.918124] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:06:38.359366] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-28T18:06:38.903060] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T18:06:39.159403] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-28T18:06:39.619445] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:06:39.959327] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-28T18:06:40.627517] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T18:06:40.759318] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-28T18:06:41.414061] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:06:41.559353] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-28T18:06:42.158282] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:06:42.359401] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-28T18:06:42.994495] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:06:43.159355] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-28T18:06:43.579579] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:06:43.959398] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-28T18:06:44.633286] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:06:44.759314] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-28T18:06:45.189241] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T18:06:45.559376] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-28T18:06:46.359368] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-28T18:06:46.583013] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T18:06:46.793549] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:06:47.159358] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-28T18:06:47.583061] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T18:06:47.959382] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-28T18:06:48.759329] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-28T18:06:48.844382] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T18:06:49.507134] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T18:06:49.559345] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-28T18:06:49.946259] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T18:06:50.359345] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-28T18:06:50.814742] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:06:51.159380] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-28T18:06:51.944590] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T18:06:51.955154] [INFO ] [REMOTE ] CRGY: Full fetch complete (76169 records). [2025-10-28T18:06:51.955291] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-28T18:06:51.966900] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-28T18:06:52.345524] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-28T18:06:52.345704] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-28T18:06:52.346609] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-28T18:06:52.346694] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-28T18:06:52.348153] [DEBUG] [LOCAL ] CRGY: Trimmed 76169 records to 52484 (keeping 200 days of data) [2025-10-28T18:06:52.625790] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:06:52.718734] [DEBUG] [LOCAL ] CRGY: Primary data saved (52484 records). [2025-10-28T18:06:52.718857] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-28T18:06:52.718933] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRGY took 33.8s. Estimated remaining: 3h 50m 57s. Rate: 7.9 symbols/min [2025-10-28T18:06:52.764420] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-28T18:06:52.887602] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:52.926220] [DEBUG] [LOCAL ] CRL: Loaded 42476 existing records from primary storage. [2025-10-28T18:06:52.926500] [INFO ] [MAIN ] CRL: Loaded 42476 existing records. [2025-10-28T18:06:53.101927] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:53.102147] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-28T18:06:53.102195] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-28T18:06:53.102913] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-28T18:06:53.102969] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-28T18:06:53.473941] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:53.502714] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T18:06:53.512231] [INFO ] [REMOTE ] CRI: Full fetch complete (71076 records). [2025-10-28T18:06:53.512365] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-28T18:06:53.566320] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-28T18:06:53.894439] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-28T18:06:53.894518] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-28T18:06:53.895474] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-28T18:06:53.895543] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-28T18:06:53.897154] [DEBUG] [LOCAL ] CRI: Trimmed 71076 records to 49467 (keeping 200 days of data) [2025-10-28T18:06:54.194399] [DEBUG] [LOCAL ] CRI: Primary data saved (49467 records). [2025-10-28T18:06:54.194556] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-28T18:06:54.194718] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRI took 30.9s. Estimated remaining: 3h 50m 28s. Rate: 8.0 symbols/min [2025-10-28T18:06:54.366343] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:54.363804] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-28T18:06:54.400227] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:06:54.411190] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-10-28T18:06:54.411317] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-28T18:06:54.736155] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-28T18:06:54.755205] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-28T18:06:54.958024] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-28T18:06:54.963633] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-28T18:06:54.980376] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-28T18:06:55.008762] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-28T18:06:55.039061] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:55.039751] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-28T18:06:55.040188] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-28T18:06:55.040950] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-28T18:06:55.041227] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-28T18:06:55.052561] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 53383 (keeping 200 days of data) [2025-10-28T18:06:55.512814] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-28T18:06:55.595453] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-28T18:06:55.702315] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:55.794473] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:06:55.821075] [DEBUG] [LOCAL ] CRH: Primary data saved (53383 records). [2025-10-28T18:06:55.821188] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-28T18:06:55.821261] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRH took 34.9s. Estimated remaining: 3h 50m 0s. Rate: 8.0 symbols/min [2025-10-28T18:06:55.965259] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-28T18:06:55.992695] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:56.029636] [DEBUG] [LOCAL ] CRS: Loaded 43082 existing records from primary storage. [2025-10-28T18:06:56.029936] [INFO ] [MAIN ] CRS: Loaded 43082 existing records. [2025-10-28T18:06:56.210012] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:56.210238] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-28T18:06:56.210297] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-28T18:06:56.211103] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-28T18:06:56.211161] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-28T18:06:56.559309] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:56.759385] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-28T18:06:56.945988] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:06:57.245890] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:06:57.559384] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-28T18:06:58.359311] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-28T18:06:58.597396] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-28T18:06:58.741626] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:06:59.159318] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-28T18:06:59.485570] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:06:59.959316] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-28T18:07:00.578010] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:07:00.759367] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-28T18:07:01.264481] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:07:01.559344] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-28T18:07:02.359396] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-28T18:07:02.484793] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T18:07:03.030761] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T18:07:03.041158] [INFO ] [REMOTE ] CRK: Full fetch complete (75369 records). [2025-10-28T18:07:03.041318] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-28T18:07:03.042219] [FATAL] [VALIDATOR ] CRK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:07:03.042313] [FATAL] [MAIN ] CRK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:07:03.042358] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:07:03.042397] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-28T18:07:03.042456] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-28T18:07:03.042490] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-10-28T18:07:03.042707] [DEBUG] [LOCAL ] CRK: Deleted derivative data file. [2025-10-28T18:07:03.042811] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRK took 31.3s. Estimated remaining: 3h 49m 52s. Rate: 8.0 symbols/min [2025-10-28T18:07:03.164554] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-28T18:07:03.212294] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:03.217937] [DEBUG] [LOCAL ] CRT: Loaded 4799 existing records from primary storage. [2025-10-28T18:07:03.218116] [INFO ] [MAIN ] CRT: Loaded 4799 existing records. [2025-10-28T18:07:03.402662] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:03.402885] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-28T18:07:03.402932] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-28T18:07:03.403140] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-28T18:07:03.403198] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-28T18:07:03.764295] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:03.849256] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:07:03.959355] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-28T18:07:04.510999] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T18:07:04.512676] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:07:04.759347] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-28T18:07:05.559341] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-28T18:07:06.099021] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:07:06.359362] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-28T18:07:06.858709] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:07:07.159322] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-28T18:07:07.795929] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:07:07.959328] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-28T18:07:08.568022] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:07:08.759351] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-28T18:07:09.361015] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T18:07:09.424949] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:07:09.559337] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-28T18:07:09.964412] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T18:07:10.359325] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-28T18:07:11.159355] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-28T18:07:11.583269] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:07:11.959355] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-28T18:07:12.335770] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T18:07:12.442444] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-28T18:07:12.759357] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-28T18:07:13.559340] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-28T18:07:14.233561] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:07:14.359363] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-28T18:07:14.844251] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T18:07:15.159357] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-28T18:07:15.290579] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T18:07:15.959366] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-28T18:07:16.360408] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T18:07:16.681260] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T18:07:16.759344] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-28T18:07:17.559346] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-28T18:07:17.984013] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:07:18.359334] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-28T18:07:19.159312] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-28T18:07:19.334220] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T18:07:19.557344] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:07:19.655859] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:07:19.959351] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-28T18:07:20.431149] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:07:20.759357] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-28T18:07:21.447619] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T18:07:21.449221] [INFO ] [REMOTE ] CRT: Full fetch complete (7423 records). [2025-10-28T18:07:21.449304] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-28T18:07:21.564455] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-28T18:07:21.802188] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-28T18:07:21.802261] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-28T18:07:21.802449] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-28T18:07:21.802487] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-28T18:07:21.802887] [DEBUG] [LOCAL ] CRT: Trimmed 7423 records to 4820 (keeping 200 days of data) [2025-10-28T18:07:21.831527] [DEBUG] [LOCAL ] CRT: Primary data saved (4820 records). [2025-10-28T18:07:21.831601] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-28T18:07:21.831713] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRT took 18.8s. Estimated remaining: 3h 50m 23s. Rate: 7.9 symbols/min [2025-10-28T18:07:21.995827] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:22.033685] [DEBUG] [LOCAL ] CSAN: Loaded 42109 existing records from primary storage. [2025-10-28T18:07:22.033962] [INFO ] [MAIN ] CSAN: Loaded 42109 existing records. [2025-10-28T18:07:22.207451] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:22.207687] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-28T18:07:22.207744] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-28T18:07:22.208234] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-28T18:07:22.208290] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-28T18:07:22.366620] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-28T18:07:22.562413] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:23.159382] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-28T18:07:23.415435] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-28T18:07:23.902374] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T18:07:23.912839] [INFO ] [REMOTE ] CRL: Full fetch complete (63791 records). [2025-10-28T18:07:23.912968] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-28T18:07:23.967372] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-28T18:07:24.320568] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-28T18:07:24.320724] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-28T18:07:24.321574] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-28T18:07:24.321714] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-28T18:07:24.337350] [DEBUG] [LOCAL ] CRL: Trimmed 63791 records to 42469 (keeping 200 days of data) [2025-10-28T18:07:24.349151] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:07:24.610077] [DEBUG] [LOCAL ] CRL: Primary data saved (42469 records). [2025-10-28T18:07:24.610239] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-28T18:07:24.611174] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRL took 31.9s. Estimated remaining: 3h 49m 59s. Rate: 8.0 symbols/min [2025-10-28T18:07:24.768470] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-28T18:07:24.799212] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:24.831776] [DEBUG] [LOCAL ] CSL: Loaded 30902 existing records from primary storage. [2025-10-28T18:07:24.832014] [INFO ] [MAIN ] CSL: Loaded 30902 existing records. [2025-10-28T18:07:25.010355] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:25.010571] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-28T18:07:25.010617] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-28T18:07:25.011112] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-28T18:07:25.011169] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-28T18:07:25.391943] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:25.559326] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-28T18:07:26.115711] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:07:26.156020] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-28T18:07:26.359335] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-28T18:07:26.762948] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:07:27.159324] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-28T18:07:27.727332] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:07:27.959369] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-28T18:07:28.275146] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T18:07:28.759371] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-28T18:07:29.559376] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-28T18:07:30.130766] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-28T18:07:30.224238] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:07:30.232702] [INFO ] [REMOTE ] CRS: Full fetch complete (62854 records). [2025-10-28T18:07:30.232821] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-28T18:07:30.371181] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-28T18:07:30.622248] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-28T18:07:30.622356] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-28T18:07:30.623362] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-28T18:07:30.623444] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-28T18:07:30.625079] [DEBUG] [LOCAL ] CRS: Trimmed 62854 records to 43073 (keeping 200 days of data) [2025-10-28T18:07:30.652350] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:07:30.926755] [DEBUG] [LOCAL ] CRS: Primary data saved (43073 records). [2025-10-28T18:07:30.926897] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-28T18:07:30.926978] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CRS took 35.1s. Estimated remaining: 3h 49m 47s. Rate: 8.0 symbols/min [2025-10-28T18:07:31.093221] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:31.105941] [DEBUG] [LOCAL ] CSR: Loaded 13284 existing records from primary storage. [2025-10-28T18:07:31.106143] [INFO ] [MAIN ] CSR: Loaded 13284 existing records. [2025-10-28T18:07:31.167879] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-28T18:07:31.284050] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:31.284236] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-28T18:07:31.284281] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-28T18:07:31.284565] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-28T18:07:31.284605] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-28T18:07:31.651359] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:31.959355] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-28T18:07:32.355110] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:07:32.631587] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-28T18:07:32.759306] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-28T18:07:32.777888] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:07:33.559381] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-28T18:07:33.876297] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:07:34.166204] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:07:34.177293] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-28T18:07:34.177413] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-28T18:07:34.371199] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-28T18:07:34.571510] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-28T18:07:34.571579] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-28T18:07:34.572429] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-28T18:07:34.572489] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-28T18:07:34.573843] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 53770 (keeping 200 days of data) [2025-10-28T18:07:34.903068] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-28T18:07:34.903205] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-28T18:07:34.903282] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CRM took 40.7s. Estimated remaining: 3h 49m 27s. Rate: 8.0 symbols/min [2025-10-28T18:07:35.072031] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:35.113777] [DEBUG] [LOCAL ] CSTM: Loaded 47323 existing records from primary storage. [2025-10-28T18:07:35.114153] [INFO ] [MAIN ] CSTM: Loaded 47323 existing records. [2025-10-28T18:07:35.170440] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-28T18:07:35.310701] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:35.310954] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-28T18:07:35.311004] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-28T18:07:35.311729] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-28T18:07:35.311789] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-28T18:07:35.669808] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:35.695202] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:07:35.799408] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T18:07:35.959337] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-28T18:07:36.759387] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-28T18:07:37.297165] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T18:07:37.370592] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:07:37.559302] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-28T18:07:38.359339] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-28T18:07:38.806854] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:07:39.159350] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-28T18:07:39.628065] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:07:39.841192] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T18:07:39.959372] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-28T18:07:40.759341] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-28T18:07:41.272436] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:07:41.559402] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-28T18:07:41.847895] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:07:42.359337] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-28T18:07:42.774106] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:07:43.159418] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-28T18:07:43.391318] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T18:07:43.904589] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T18:07:43.959306] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-28T18:07:44.614560] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T18:07:44.759336] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-28T18:07:45.436119] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:07:45.559356] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-28T18:07:46.359386] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-28T18:07:46.662034] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T18:07:47.159344] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-28T18:07:47.804892] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:07:47.813098] [INFO ] [REMOTE ] CSAN: Full fetch complete (60283 records). [2025-10-28T18:07:47.813255] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-28T18:07:47.964498] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-28T18:07:48.219611] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-28T18:07:48.219723] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-28T18:07:48.220478] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-28T18:07:48.220522] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-28T18:07:48.221767] [DEBUG] [LOCAL ] CSAN: Trimmed 60283 records to 41980 (keeping 200 days of data) [2025-10-28T18:07:48.449815] [DEBUG] [LOCAL ] CSAN: Primary data saved (41980 records). [2025-10-28T18:07:48.449944] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-28T18:07:48.450022] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSAN took 26.6s. Estimated remaining: 3h 49m 40s. Rate: 8.0 symbols/min [2025-10-28T18:07:48.625986] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:48.670377] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T18:07:48.686927] [DEBUG] [LOCAL ] CSV: Loaded 12119 existing records from primary storage. [2025-10-28T18:07:48.687236] [INFO ] [MAIN ] CSV: Loaded 12119 existing records. [2025-10-28T18:07:48.764494] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-28T18:07:48.871610] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:48.872249] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-28T18:07:48.872303] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-28T18:07:48.872523] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-28T18:07:48.872567] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-28T18:07:49.241222] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:49.285510] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:07:49.454328] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T18:07:49.559356] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-28T18:07:50.359417] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-28T18:07:50.662453] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T18:07:51.159426] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-28T18:07:51.437733] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:07:51.881728] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T18:07:51.959383] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-28T18:07:52.759406] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-28T18:07:52.904297] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:07:53.484251] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T18:07:53.559541] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-28T18:07:54.359371] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-28T18:07:54.774634] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:07:55.016816] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T18:07:55.159334] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-28T18:07:55.959332] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-28T18:07:56.154338] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T18:07:56.735498] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:07:56.759301] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-28T18:07:57.413581] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T18:07:57.559350] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-28T18:07:58.359328] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-28T18:07:58.772071] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T18:07:59.159407] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-28T18:07:59.959360] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-28T18:08:00.115949] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T18:08:00.158258] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-28T18:08:00.521415] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T18:08:00.759376] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-28T18:08:01.559342] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-28T18:08:01.728963] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T18:08:01.732064] [INFO ] [REMOTE ] CSR: Full fetch complete (17872 records). [2025-10-28T18:08:01.732132] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-28T18:08:01.732513] [FATAL] [VALIDATOR ] CSR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:08:01.732593] [FATAL] [MAIN ] CSR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:08:01.732636] [WARN ] [MAIN ] CSR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:08:01.732725] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-28T18:08:01.732785] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-28T18:08:01.732820] [INFO ] [LOCAL ] CSR: Starting deletion of derivative data. [2025-10-28T18:08:01.732995] [DEBUG] [LOCAL ] CSR: Deleted derivative data file. [2025-10-28T18:08:01.733081] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSR took 30.8s. Estimated remaining: 3h 49m 52s. Rate: 7.9 symbols/min [2025-10-28T18:08:01.897224] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:01.897404] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-28T18:08:01.897441] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-28T18:08:01.897546] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-28T18:08:01.897587] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-28T18:08:01.897627] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-28T18:08:01.897694] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-28T18:08:02.242128] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:02.359365] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-28T18:08:02.505396] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:08:02.505776] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-28T18:08:02.505885] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:08:02.505935] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-28T18:08:02.505985] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:08:02.506071] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-28T18:08:02.506168] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-28T18:08:02.506240] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-28T18:08:02.506305] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-28T18:08:02.506373] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSW took 0.8s. Estimated remaining: 3h 49m 22s. Rate: 8.0 symbols/min [2025-10-28T18:08:02.682097] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:02.689336] [DEBUG] [LOCAL ] CTBB: Loaded 6201 existing records from primary storage. [2025-10-28T18:08:02.689519] [INFO ] [MAIN ] CTBB: Loaded 6201 existing records. [2025-10-28T18:08:02.866072] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:02.866353] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-28T18:08:02.866577] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-28T18:08:02.866942] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-28T18:08:02.867014] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-28T18:08:03.060785] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T18:08:03.164510] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-28T18:08:03.261988] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:03.959320] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-28T18:08:04.344861] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:08:04.350904] [INFO ] [REMOTE ] CSL: Full fetch complete (45528 records). [2025-10-28T18:08:04.350995] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-28T18:08:04.351575] [FATAL] [VALIDATOR ] CSL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:08:04.351683] [FATAL] [MAIN ] CSL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:08:04.351736] [WARN ] [MAIN ] CSL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:08:04.351778] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-28T18:08:04.351853] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-10-28T18:08:04.351890] [INFO ] [LOCAL ] CSL: Starting deletion of derivative data. [2025-10-28T18:08:04.352060] [DEBUG] [LOCAL ] CSL: Deleted derivative data file. [2025-10-28T18:08:04.352159] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSL took 39.7s. Estimated remaining: 3h 48m 55s. Rate: 8.0 symbols/min [2025-10-28T18:08:04.518548] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:04.528318] [DEBUG] [LOCAL ] CTDD: Loaded 5011 existing records from primary storage. [2025-10-28T18:08:04.528574] [INFO ] [MAIN ] CTDD: Loaded 5011 existing records. [2025-10-28T18:08:04.704877] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T18:08:04.728293] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:04.728472] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-28T18:08:04.728529] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-28T18:08:04.728723] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-28T18:08:04.728781] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-28T18:08:04.764421] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-28T18:08:05.075897] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:05.491050] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:08:05.559327] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-28T18:08:06.359335] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-28T18:08:06.779960] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:08:07.016275] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:08:07.159339] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-28T18:08:07.653812] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:08:07.959341] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-28T18:08:08.428139] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:08:08.759341] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-28T18:08:09.559339] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-28T18:08:10.161585] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T18:08:10.167089] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:08:10.359335] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-28T18:08:11.159359] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-28T18:08:11.733686] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T18:08:11.743537] [INFO ] [REMOTE ] CSTM: Full fetch complete (69571 records). [2025-10-28T18:08:11.743734] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-28T18:08:11.913731] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T18:08:11.925895] [INFO ] [REMOTE ] CSV: Full fetch complete (18810 records). [2025-10-28T18:08:11.941203] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-28T18:08:11.960333] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-28T18:08:12.343510] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-28T18:08:12.399277] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-28T18:08:12.426299] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-28T18:08:12.440878] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-28T18:08:12.492159] [DEBUG] [LOCAL ] CSTM: Trimmed 69571 records to 47316 (keeping 200 days of data) [2025-10-28T18:08:12.570444] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:08:12.572730] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-28T18:08:12.622031] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-28T18:08:12.630930] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-28T18:08:12.657353] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-28T18:08:12.684355] [DEBUG] [LOCAL ] CSV: Trimmed 18810 records to 11936 (keeping 200 days of data) [2025-10-28T18:08:12.773808] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-28T18:08:12.891113] [DEBUG] [LOCAL ] CSV: Primary data saved (11936 records). [2025-10-28T18:08:12.891332] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-28T18:08:12.891460] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CSV took 24.4s. Estimated remaining: 3h 48m 51s. Rate: 8.0 symbols/min [2025-10-28T18:08:13.046742] [DEBUG] [LOCAL ] CSTM: Primary data saved (47316 records). [2025-10-28T18:08:13.046989] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-28T18:08:13.047156] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CSTM took 38.1s. Estimated remaining: 3h 48m 19s. Rate: 8.0 symbols/min [2025-10-28T18:08:13.209745] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:13.233004] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-28T18:08:13.233126] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-28T18:08:13.244074] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-28T18:08:13.255173] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-28T18:08:13.308672] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-28T18:08:13.312911] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:13.314014] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-28T18:08:13.447851] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T18:08:13.526964] [DEBUG] [LOCAL ] CTO: Loaded 27078 existing records from primary storage. [2025-10-28T18:08:13.545161] [INFO ] [MAIN ] CTO: Loaded 27078 existing records. [2025-10-28T18:08:13.570027] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-28T18:08:13.921864] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:13.925215] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:13.925620] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-28T18:08:13.925711] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-28T18:08:13.926233] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-28T18:08:13.926291] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-28T18:08:14.281863] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:14.336548] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:08:14.359303] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-28T18:08:15.159356] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-28T18:08:15.463104] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T18:08:15.848026] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T18:08:15.959337] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-28T18:08:16.759314] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-28T18:08:16.837166] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T18:08:17.253170] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:08:17.559357] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-28T18:08:17.706599] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:08:17.706954] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-28T18:08:17.707024] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:08:17.707063] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-28T18:08:17.707150] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:08:17.707196] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-28T18:08:17.707253] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-28T18:08:17.707288] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-28T18:08:17.707326] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-28T18:08:17.707370] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTEV took 4.8s. Estimated remaining: 3h 48m 2s. Rate: 8.0 symbols/min [2025-10-28T18:08:17.873317] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:17.905962] [DEBUG] [LOCAL ] CTOS: Loaded 37098 existing records from primary storage. [2025-10-28T18:08:17.906223] [INFO ] [MAIN ] CTOS: Loaded 37098 existing records. [2025-10-28T18:08:18.079403] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:18.079609] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-28T18:08:18.079680] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-28T18:08:18.080113] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-28T18:08:18.080169] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-28T18:08:18.364561] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-28T18:08:18.433960] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:18.961402] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T18:08:19.159363] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-28T18:08:19.959389] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-28T18:08:20.759337] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-28T18:08:21.107154] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:08:21.283556] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:08:21.559334] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-28T18:08:22.197916] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-28T18:08:22.359319] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-28T18:08:22.519100] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T18:08:22.952817] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T18:08:23.159404] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-28T18:08:23.648024] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T18:08:23.959386] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-28T18:08:24.380848] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:08:24.759317] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-28T18:08:25.247211] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T18:08:25.559346] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-28T18:08:25.954905] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:08:26.359323] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-28T18:08:27.159339] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-28T18:08:27.588896] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T18:08:27.655220] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:08:27.959350] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-28T18:08:28.759298] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-28T18:08:28.987605] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T18:08:28.989269] [INFO ] [REMOTE ] CTBB: Full fetch complete (10015 records). [2025-10-28T18:08:28.989338] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-28T18:08:29.348408] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-28T18:08:29.348480] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-28T18:08:29.348730] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-28T18:08:29.348789] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-28T18:08:29.349216] [DEBUG] [LOCAL ] CTBB: Trimmed 10015 records to 6178 (keeping 200 days of data) [2025-10-28T18:08:29.388409] [DEBUG] [LOCAL ] CTBB: Primary data saved (6178 records). [2025-10-28T18:08:29.388515] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-28T18:08:29.388604] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CTBB took 26.9s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-10-28T18:08:29.559745] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-28T18:08:29.559612] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:29.606214] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-28T18:08:29.606504] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-28T18:08:29.796584] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:08:29.800881] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:29.801084] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-28T18:08:29.806406] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-28T18:08:29.807791] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-28T18:08:29.807850] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-28T18:08:30.084359] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:08:30.175370] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:30.359314] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-28T18:08:31.159323] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-28T18:08:31.788730] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:08:31.951614] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T18:08:31.961683] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-28T18:08:32.403253] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T18:08:32.404530] [INFO ] [REMOTE ] CTDD: Full fetch complete (7906 records). [2025-10-28T18:08:32.404597] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-28T18:08:32.761877] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-28T18:08:32.762956] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-28T18:08:32.763017] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-28T18:08:32.763250] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-28T18:08:32.763316] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-28T18:08:32.764112] [DEBUG] [LOCAL ] CTDD: Trimmed 7906 records to 4993 (keeping 200 days of data) [2025-10-28T18:08:32.794674] [DEBUG] [LOCAL ] CTDD: Primary data saved (4993 records). [2025-10-28T18:08:32.794774] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-28T18:08:32.794846] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTDD took 28.4s. Estimated remaining: 3h 47m 47s. Rate: 8.0 symbols/min [2025-10-28T18:08:32.966350] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:33.011022] [DEBUG] [LOCAL ] CTRE: Loaded 49379 existing records from primary storage. [2025-10-28T18:08:33.011352] [INFO ] [MAIN ] CTRE: Loaded 49379 existing records. [2025-10-28T18:08:33.216930] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:33.217168] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-28T18:08:33.217223] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-28T18:08:33.218352] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-28T18:08:33.218413] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-28T18:08:33.564466] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-28T18:08:33.625885] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:34.359328] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-28T18:08:34.886883] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:08:35.159502] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-28T18:08:35.367597] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:08:35.413453] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-28T18:08:35.959335] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-28T18:08:36.759315] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-28T18:08:37.186339] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:08:37.559382] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-28T18:08:37.835123] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:08:38.359312] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-28T18:08:38.549249] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (3.39 seconds). [2025-10-28T18:08:39.159323] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-28T18:08:39.959391] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-28T18:08:40.492125] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (2.93 seconds). [2025-10-28T18:08:40.582563] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T18:08:40.759313] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-28T18:08:40.836117] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T18:08:41.559355] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-28T18:08:42.359336] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-28T18:08:42.463012] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T18:08:43.159331] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-28T18:08:43.432135] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-28T18:08:43.571245] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (5.21 seconds). [2025-10-28T18:08:43.821184] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T18:08:43.959393] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-28T18:08:44.759348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-28T18:08:45.024570] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T18:08:45.030753] [INFO ] [REMOTE ] CTO: Full fetch complete (41391 records). [2025-10-28T18:08:45.030869] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-28T18:08:45.437341] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-28T18:08:45.437446] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-28T18:08:45.438279] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-28T18:08:45.438368] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-28T18:08:45.439676] [DEBUG] [LOCAL ] CTO: Trimmed 41391 records to 27014 (keeping 200 days of data) [2025-10-28T18:08:45.560283] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-28T18:08:45.612284] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:08:45.651297] [DEBUG] [LOCAL ] CTO: Primary data saved (27014 records). [2025-10-28T18:08:45.651537] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-28T18:08:45.651680] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTO took 32.6s. Estimated remaining: 3h 47m 57s. Rate: 8.0 symbols/min [2025-10-28T18:08:45.923383] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:45.968945] [DEBUG] [LOCAL ] CTRI: Loaded 41068 existing records from primary storage. [2025-10-28T18:08:45.969346] [INFO ] [MAIN ] CTRI: Loaded 41068 existing records. [2025-10-28T18:08:46.204605] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:46.204990] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-28T18:08:46.205077] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-28T18:08:46.205548] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-28T18:08:46.205609] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-28T18:08:46.371868] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-28T18:08:46.628187] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:46.869953] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:08:47.159382] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-28T18:08:47.588395] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-28T18:08:47.863939] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T18:08:47.959348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-28T18:08:48.059501] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:08:48.759444] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-28T18:08:49.559357] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-28T18:08:50.359359] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-28T18:08:50.585319] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:08:51.159324] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-28T18:08:51.318753] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-28T18:08:51.477959] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T18:08:51.918724] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:08:51.959317] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-28T18:08:52.644778] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (3.89 seconds). [2025-10-28T18:08:52.759317] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-28T18:08:53.559323] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-28T18:08:53.771095] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-28T18:08:53.846363] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T18:08:54.359329] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-28T18:08:55.159363] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-28T18:08:55.193769] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T18:08:55.400292] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:08:55.959390] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-28T18:08:56.353465] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:08:56.759348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-28T18:08:57.559375] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-28T18:08:58.040863] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-28T18:08:58.051000] [INFO ] [REMOTE ] CTOS: Full fetch complete (54055 records). [2025-10-28T18:08:58.051229] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-28T18:08:58.360770] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-28T18:08:58.496076] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T18:08:58.527471] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-28T18:08:58.527853] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-28T18:08:58.529262] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-28T18:08:58.529355] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-28T18:08:58.531488] [DEBUG] [LOCAL ] CTOS: Trimmed 54055 records to 37111 (keeping 200 days of data) [2025-10-28T18:08:58.754610] [DEBUG] [LOCAL ] CTOS: Primary data saved (37111 records). [2025-10-28T18:08:58.754860] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-28T18:08:58.754969] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTOS took 41.0s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-10-28T18:08:58.978125] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:59.001380] [DEBUG] [LOCAL ] CTS: Loaded 19302 existing records from primary storage. [2025-10-28T18:08:59.001824] [INFO ] [MAIN ] CTS: Loaded 19302 existing records. [2025-10-28T18:08:59.164179] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-28T18:08:59.236801] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:59.237595] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-28T18:08:59.238004] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-28T18:08:59.238397] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-28T18:08:59.238470] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-28T18:08:59.435038] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T18:08:59.693704] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:59.959343] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-28T18:09:00.091315] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-28T18:09:00.762878] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-28T18:09:00.768454] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:09:00.779377] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-28T18:09:00.779517] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-28T18:09:01.173906] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-28T18:09:01.174000] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-28T18:09:01.174892] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-28T18:09:01.174954] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-28T18:09:01.176476] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-28T18:09:01.402367] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:09:01.515067] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-28T18:09:01.515201] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-28T18:09:01.515281] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRA took 32.1s. Estimated remaining: 3h 47m 45s. Rate: 8.0 symbols/min [2025-10-28T18:09:01.568474] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-28T18:09:01.702765] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:01.756079] [DEBUG] [LOCAL ] CTVA: Loaded 53299 existing records from primary storage. [2025-10-28T18:09:01.756397] [INFO ] [MAIN ] CTVA: Loaded 53299 existing records. [2025-10-28T18:09:01.962608] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:01.963029] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-28T18:09:01.963084] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-28T18:09:01.964158] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-28T18:09:01.964217] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-28T18:09:02.379360] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-28T18:09:02.387012] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:02.687698] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T18:09:02.859373] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T18:09:03.159350] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-28T18:09:03.350878] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:09:03.959377] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-28T18:09:04.238876] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T18:09:04.759342] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-28T18:09:05.312340] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T18:09:05.322550] [INFO ] [REMOTE ] CTRE: Full fetch complete (71365 records). [2025-10-28T18:09:05.322736] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-28T18:09:05.568436] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-28T18:09:05.724562] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T18:09:05.788179] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-28T18:09:05.788596] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-28T18:09:05.789625] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-28T18:09:05.789715] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-28T18:09:05.791339] [DEBUG] [LOCAL ] CTRE: Trimmed 71365 records to 49394 (keeping 200 days of data) [2025-10-28T18:09:06.102081] [DEBUG] [LOCAL ] CTRE: Primary data saved (49394 records). [2025-10-28T18:09:06.102211] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-28T18:09:06.102285] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTRE took 33.3s. Estimated remaining: 3h 47m 27s. Rate: 8.0 symbols/min [2025-10-28T18:09:06.287801] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:06.287968] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-28T18:09:06.288004] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-28T18:09:06.288112] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-28T18:09:06.288152] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-28T18:09:06.288192] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-28T18:09:06.288223] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-28T18:09:06.364468] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-28T18:09:06.649311] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:07.159390] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-28T18:09:07.280899] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:09:07.604213] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-28T18:09:07.959414] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-28T18:09:08.553040] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:09:08.759385] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-28T18:09:09.022735] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:09:09.559361] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-28T18:09:10.359337] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-28T18:09:10.723763] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-28T18:09:11.048233] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T18:09:11.159319] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-28T18:09:11.257558] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-28T18:09:11.959342] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-28T18:09:12.237870] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T18:09:12.677464] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T18:09:12.759337] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-28T18:09:13.559343] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-28T18:09:14.359329] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-28T18:09:14.474551] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T18:09:14.584060] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-28T18:09:15.079710] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T18:09:15.159326] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-28T18:09:15.959518] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-28T18:09:16.759310] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-28T18:09:16.857773] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:09:17.055391] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T18:09:17.065322] [INFO ] [REMOTE ] CTRI: Full fetch complete (55163 records). [2025-10-28T18:09:17.065480] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-28T18:09:17.441876] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-28T18:09:17.442062] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-28T18:09:17.442852] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-28T18:09:17.442917] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-28T18:09:17.444152] [DEBUG] [LOCAL ] CTRI: Trimmed 55163 records to 41153 (keeping 200 days of data) [2025-10-28T18:09:17.603065] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-28T18:09:17.682308] [DEBUG] [LOCAL ] CTRI: Primary data saved (41153 records). [2025-10-28T18:09:17.682437] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-28T18:09:17.682539] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CTRI took 32.0s. Estimated remaining: 3h 47m 33s. Rate: 8.0 symbols/min [2025-10-28T18:09:17.858874] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:17.859094] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-10-28T18:09:17.859147] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-10-28T18:09:17.859253] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-28T18:09:17.859295] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-28T18:09:17.859338] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-28T18:09:17.859371] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-28T18:09:17.896916] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:09:18.223381] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:18.252523] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T18:09:18.359304] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-28T18:09:19.159355] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-28T18:09:19.397931] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T18:09:19.959316] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-28T18:09:20.132802] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.17 seconds). [2025-10-28T18:09:20.759320] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-28T18:09:21.100391] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T18:09:21.559328] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-28T18:09:22.359366] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-28T18:09:22.820403] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T18:09:22.832076] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (4.47 seconds). [2025-10-28T18:09:23.159418] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-28T18:09:23.959390] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-28T18:09:24.545489] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:09:24.759386] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-28T18:09:25.559358] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-28T18:09:25.719339] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-28T18:09:26.240699] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:09:26.359351] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-28T18:09:27.159362] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-28T18:09:27.622613] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (3.66 seconds). [2025-10-28T18:09:27.667693] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:09:27.680780] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-28T18:09:27.959350] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-28T18:09:28.759396] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-28T18:09:29.020605] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T18:09:29.050376] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T18:09:29.559390] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-28T18:09:29.912835] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T18:09:29.914036] [INFO ] [REMOTE ] CUBB: Full fetch complete (965 records). [2025-10-28T18:09:29.914131] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-28T18:09:30.222751] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-28T18:09:30.223139] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:09:30.223229] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:09:30.223386] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-28T18:09:30.223575] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-28T18:09:30.223676] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-28T18:09:30.223877] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-28T18:09:30.224085] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CUBB took 24.1s. Estimated remaining: 3h 47m 42s. Rate: 8.0 symbols/min [2025-10-28T18:09:30.359860] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-28T18:09:30.466245] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:09:30.533613] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:30.531882] [INFO ] [REMOTE ] CTVA: Full fetch complete (77239 records). [2025-10-28T18:09:30.534096] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-28T18:09:30.803900] [DEBUG] [LOCAL ] CUBI: Loaded 26871 existing records from primary storage. [2025-10-28T18:09:30.832497] [INFO ] [MAIN ] CUBI: Loaded 26871 existing records. [2025-10-28T18:09:31.088040] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-28T18:09:31.098464] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-28T18:09:31.117684] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-28T18:09:31.136741] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-28T18:09:31.161173] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-28T18:09:31.160987] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:31.162685] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-28T18:09:31.162809] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-28T18:09:31.163406] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-28T18:09:31.163846] [DEBUG] [LOCAL ] CTVA: Trimmed 77239 records to 53299 (keeping 200 days of data) [2025-10-28T18:09:31.163716] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-28T18:09:31.355249] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T18:09:31.764861] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:31.871353] [DEBUG] [LOCAL ] CTVA: Primary data saved (53299 records). [2025-10-28T18:09:31.871484] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-28T18:09:31.871564] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CTVA took 30.4s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min [2025-10-28T18:09:31.968614] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-28T18:09:32.043688] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:32.088870] [DEBUG] [LOCAL ] CUK: Loaded 51033 existing records from primary storage. [2025-10-28T18:09:32.089162] [INFO ] [MAIN ] CUK: Loaded 51033 existing records. [2025-10-28T18:09:32.267022] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:32.267238] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-28T18:09:32.267286] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-28T18:09:32.268089] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-28T18:09:32.268148] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-28T18:09:32.627994] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:32.759324] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-28T18:09:32.976451] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:09:33.559350] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-28T18:09:33.588594] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T18:09:33.593587] [INFO ] [REMOTE ] CTS: Full fetch complete (27532 records). [2025-10-28T18:09:33.593782] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-28T18:09:33.969051] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-28T18:09:33.969148] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-28T18:09:33.969688] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-28T18:09:33.969751] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-28T18:09:33.970697] [DEBUG] [LOCAL ] CTS: Trimmed 27532 records to 19303 (keeping 200 days of data) [2025-10-28T18:09:34.082093] [DEBUG] [LOCAL ] CTS: Primary data saved (19303 records). [2025-10-28T18:09:34.082213] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-28T18:09:34.082289] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CTS took 35.3s. Estimated remaining: 3h 46m 51s. Rate: 8.0 symbols/min [2025-10-28T18:09:34.254275] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:34.258291] [DEBUG] [LOCAL ] CULP: Loaded 2757 existing records from primary storage. [2025-10-28T18:09:34.258429] [INFO ] [MAIN ] CULP: Loaded 2757 existing records. [2025-10-28T18:09:34.368056] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-28T18:09:34.461152] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:34.461414] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-28T18:09:34.461498] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-28T18:09:34.461727] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-28T18:09:34.461785] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-28T18:09:34.779838] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (3.62 seconds). [2025-10-28T18:09:34.863116] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:35.064291] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:09:35.159339] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-28T18:09:35.959342] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-28T18:09:35.980313] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T18:09:36.297019] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:09:36.478159] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T18:09:36.759427] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-28T18:09:37.559352] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-28T18:09:38.347835] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:09:38.359293] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-28T18:09:39.159334] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-28T18:09:39.436522] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T18:09:39.641166] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:09:39.959310] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-28T18:09:40.377554] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T18:09:40.759401] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-28T18:09:41.061930] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (3.50 seconds). [2025-10-28T18:09:41.559317] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-28T18:09:42.359402] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-28T18:09:42.745573] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-28T18:09:42.772666] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T18:09:42.845456] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:09:43.159415] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-28T18:09:43.579819] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:09:43.959330] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-28T18:09:44.380435] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:09:44.759401] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-28T18:09:45.559354] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-28T18:09:45.944809] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T18:09:46.359385] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-28T18:09:47.048061] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-28T18:09:47.159355] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-28T18:09:47.803109] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:09:47.828758] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T18:09:47.959377] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-28T18:09:48.664059] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T18:09:48.759346] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-28T18:09:49.559393] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-28T18:09:49.645975] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:09:50.359421] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-28T18:09:50.677576] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:09:51.100044] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:09:51.159355] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-28T18:09:51.959331] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-28T18:09:51.990799] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T18:09:52.414721] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T18:09:52.759348] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-28T18:09:53.559340] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-28T18:09:54.359325] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-28T18:09:54.399083] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:09:55.159317] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-28T18:09:55.302706] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T18:09:55.308090] [INFO ] [REMOTE ] CUBI: Full fetch complete (39139 records). [2025-10-28T18:09:55.308172] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-28T18:09:55.692196] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-28T18:09:55.692274] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-28T18:09:55.692829] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-28T18:09:55.692890] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-28T18:09:55.693708] [DEBUG] [LOCAL ] CUBI: Trimmed 39139 records to 26775 (keeping 200 days of data) [2025-10-28T18:09:55.844756] [DEBUG] [LOCAL ] CUBI: Primary data saved (26775 records). [2025-10-28T18:09:55.844879] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-28T18:09:55.844956] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CUBI took 25.6s. Estimated remaining: 3h 47m 29s. Rate: 8.0 symbols/min [2025-10-28T18:09:55.964501] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-28T18:09:56.014086] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:56.046346] [DEBUG] [LOCAL ] CURB: Loaded 32698 existing records from primary storage. [2025-10-28T18:09:56.046589] [INFO ] [MAIN ] CURB: Loaded 32698 existing records. [2025-10-28T18:09:56.180288] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-28T18:09:56.234637] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:56.234879] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-28T18:09:56.234928] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-28T18:09:56.235543] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-28T18:09:56.235630] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-28T18:09:56.596192] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:56.632161] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:09:56.759339] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-28T18:09:57.559380] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-28T18:09:57.716141] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:09:57.984951] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T18:09:57.986637] [INFO ] [REMOTE ] CULP: Full fetch complete (4400 records). [2025-10-28T18:09:57.986815] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-28T18:09:58.369551] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-28T18:09:58.397007] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-28T18:09:58.397192] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-28T18:09:58.397458] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-28T18:09:58.397505] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-28T18:09:58.398337] [DEBUG] [LOCAL ] CULP: Trimmed 4400 records to 2753 (keeping 200 days of data) [2025-10-28T18:09:58.416465] [DEBUG] [LOCAL ] CULP: Primary data saved (2753 records). [2025-10-28T18:09:58.416698] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-28T18:09:58.416820] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CULP took 24.3s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min [2025-10-28T18:09:59.159326] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-28T18:09:59.410466] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:09:59.959374] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-28T18:10:01.108039] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:10:01.115595] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-28T18:10:02.493497] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:10:02.502499] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-28T18:10:03.436081] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (7.47 seconds). [2025-10-28T18:10:03.447472] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-28T18:10:08.177031] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (9.02 seconds). [2025-10-28T18:10:08.188306] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-28T18:10:09.657865] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:10:09.668837] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-28T18:10:10.974721] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (8.47 seconds). [2025-10-28T18:10:10.980678] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-28T18:10:11.237672] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:10:11.248286] [INFO ] [REMOTE ] CUK: Full fetch complete (74400 records). [2025-10-28T18:10:11.248451] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-28T18:10:11.645165] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-28T18:10:11.645316] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-28T18:10:11.646297] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-28T18:10:11.646372] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-28T18:10:11.648049] [DEBUG] [LOCAL ] CUK: Trimmed 74400 records to 51034 (keeping 200 days of data) [2025-10-28T18:10:11.920246] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:10:11.937878] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-28T18:10:12.004780] [DEBUG] [LOCAL ] CUK: Primary data saved (51034 records). [2025-10-28T18:10:12.004930] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-28T18:10:12.005010] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CUK took 40.1s. Estimated remaining: 3h 47m 18s. Rate: 8.0 symbols/min [2025-10-28T18:10:13.049693] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T18:10:13.057921] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-28T18:10:14.489936] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (11.04 seconds). [2025-10-28T18:10:14.501528] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-28T18:10:16.220416] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-28T18:10:16.228507] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-28T18:10:17.623438] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:10:17.632600] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-28T18:10:18.812817] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:10:18.821418] [INFO ] [REMOTE ] CURB: Full fetch complete (47714 records). [2025-10-28T18:10:18.821607] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-28T18:10:19.238072] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-28T18:10:19.238201] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-28T18:10:19.239005] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-28T18:10:19.239072] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-28T18:10:19.240498] [DEBUG] [LOCAL ] CURB: Trimmed 47714 records to 32676 (keeping 200 days of data) [2025-10-28T18:10:19.457435] [DEBUG] [LOCAL ] CURB: Primary data saved (32676 records). [2025-10-28T18:10:19.457637] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-28T18:10:19.457783] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CURB took 23.6s. Estimated remaining: 3h 47m 10s. Rate: 8.0 symbols/min [2025-10-28T18:10:20.176212] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (5.67 seconds). [2025-10-28T18:10:20.188319] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-28T18:10:21.523276] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T18:10:21.534753] [INFO ] [REMOTE ] CUBE: Full fetch complete (72948 records). [2025-10-28T18:10:21.534994] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-28T18:10:21.536152] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:10:21.536256] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:10:21.536317] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:10:21.536425] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-28T18:10:21.536513] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-28T18:10:21.536555] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-28T18:10:21.536598] [DEBUG] [LOCAL ] CUBE: No derivative data file found to delete. [2025-10-28T18:10:21.536712] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CUBE took 1m 4s. Estimated remaining: 3h 46m 45s. Rate: 8.0 symbols/min [2025-10-28T18:10:22.084733] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.154476] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.285379] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.289044] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.339697] [DEBUG] [LOCAL ] CVEO: Loaded 15001 existing records from primary storage. [2025-10-28T18:10:22.340479] [INFO ] [MAIN ] CVEO: Loaded 15001 existing records. [2025-10-28T18:10:22.414508] [DEBUG] [LOCAL ] CUZ: Loaded 49312 existing records from primary storage. [2025-10-28T18:10:22.421605] [INFO ] [MAIN ] CUZ: Loaded 49312 existing records. [2025-10-28T18:10:22.434829] [DEBUG] [LOCAL ] CURV: Loaded 27358 existing records from primary storage. [2025-10-28T18:10:22.541542] [INFO ] [MAIN ] CURV: Loaded 27358 existing records. [2025-10-28T18:10:22.657705] [DEBUG] [LOCAL ] CVE: Loaded 53560 existing records from primary storage. [2025-10-28T18:10:22.783376] [INFO ] [MAIN ] CVE: Loaded 53560 existing records. [2025-10-28T18:10:22.840053] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:22.898499] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-28T18:10:22.931160] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-28T18:10:22.910200] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:22.988075] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-28T18:10:22.987946] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-28T18:10:22.998568] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-28T18:10:23.036134] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-28T18:10:23.014279] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-28T18:10:23.061856] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-28T18:10:23.203311] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:23.295042] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-28T18:10:23.342567] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-28T18:10:23.424638] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-28T18:10:23.424523] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:23.430941] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-28T18:10:23.431260] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-28T18:10:23.464487] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-28T18:10:23.579448] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-28T18:10:23.620944] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-28T18:10:24.434897] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.456996] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-28T18:10:24.511397] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.543587] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-28T18:10:24.695292] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.747563] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-28T18:10:24.870142] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.870510] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-28T18:10:25.704349] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:10:25.710767] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-28T18:10:25.794213] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:10:25.803631] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-28T18:10:26.102980] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:10:26.114082] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-28T18:10:26.436152] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:10:26.442413] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-28T18:10:26.871200] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-28T18:10:26.873762] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-28T18:10:26.921955] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:10:26.931682] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-28T18:10:27.264268] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T18:10:27.271178] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-28T18:10:27.352940] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T18:10:27.363849] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-28T18:10:27.385274] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T18:10:27.389259] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-28T18:10:27.980620] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T18:10:28.003171] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:10:28.008890] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-28T18:10:28.008503] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-28T18:10:28.026941] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T18:10:28.033062] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-28T18:10:28.553335] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T18:10:28.557953] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-28T18:10:28.571747] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T18:10:28.577007] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-28T18:10:29.302215] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T18:10:29.307938] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-28T18:10:29.343308] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:10:29.354841] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-28T18:10:30.088677] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:10:30.093136] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-28T18:10:30.355016] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:10:30.365810] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-28T18:10:30.530472] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T18:10:30.534631] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-28T18:10:30.885041] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-28T18:10:30.890881] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-28T18:10:31.104755] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T18:10:31.108875] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-28T18:10:31.577504] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:10:31.601367] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T18:10:31.599886] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-28T18:10:31.606458] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-28T18:10:32.404244] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:10:32.407936] [INFO ] [REMOTE ] CVEO: Full fetch complete (21008 records). [2025-10-28T18:10:32.408028] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-28T18:10:32.794846] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (5.43 seconds). [2025-10-28T18:10:32.901121] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-28T18:10:32.907696] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-28T18:10:32.908920] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-28T18:10:32.909713] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-28T18:10:32.909801] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-28T18:10:32.911289] [DEBUG] [LOCAL ] CVEO: Trimmed 21008 records to 15047 (keeping 200 days of data) [2025-10-28T18:10:33.019516] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:10:33.046448] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-28T18:10:33.059288] [DEBUG] [LOCAL ] CVEO: Primary data saved (15047 records). [2025-10-28T18:10:33.059500] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-28T18:10:33.059731] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 11.5s. Estimated remaining: 3h 46m 50s. Rate: 8.0 symbols/min [2025-10-28T18:10:33.245494] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:33.310068] [DEBUG] [LOCAL ] CVI: Loaded 46550 existing records from primary storage. [2025-10-28T18:10:33.310493] [INFO ] [MAIN ] CVI: Loaded 46550 existing records. [2025-10-28T18:10:33.506144] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:33.506446] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-28T18:10:33.506498] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-28T18:10:33.507131] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-28T18:10:33.507192] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-28T18:10:33.870974] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:33.871327] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-28T18:10:34.615087] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T18:10:34.626047] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-28T18:10:35.177957] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T18:10:35.186962] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-28T18:10:36.161252] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (5.27 seconds). [2025-10-28T18:10:36.169372] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-28T18:10:36.289769] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:10:36.759324] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-28T18:10:37.268601] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:10:37.559335] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-28T18:10:37.954719] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:10:38.359398] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-28T18:10:38.518047] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (5.62 seconds). [2025-10-28T18:10:38.579837] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T18:10:39.159338] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-28T18:10:39.618346] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:10:39.959381] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-28T18:10:40.147669] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (5.52 seconds). [2025-10-28T18:10:40.759395] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-28T18:10:41.253963] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:10:41.559364] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-28T18:10:41.617834] [DEBUG] [REMOTE ] CVI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-28T18:10:41.618115] [WARN ] [REMOTE ] CVI: No data returned for month 2025-06 [2025-10-28T18:10:41.618207] [FATAL] [REMOTE ] CVI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:10:41.618288] [FATAL] [MAIN ] CVI: Failed to fetch primary data. [2025-10-28T18:10:41.618349] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:10:41.618423] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-28T18:10:41.618486] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-28T18:10:41.618523] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-28T18:10:41.618736] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-28T18:10:41.618823] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CVI took 8.6s. Estimated remaining: 3h 46m 46s. Rate: 8.0 symbols/min [2025-10-28T18:10:41.788929] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:41.804272] [DEBUG] [LOCAL ] CVLG: Loaded 15185 existing records from primary storage. [2025-10-28T18:10:41.804531] [INFO ] [MAIN ] CVLG: Loaded 15185 existing records. [2025-10-28T18:10:41.998275] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:41.998631] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-28T18:10:41.998722] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-28T18:10:41.999443] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-28T18:10:41.999503] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-28T18:10:42.353909] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:42.368836] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-28T18:10:42.381188] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:10:42.391090] [INFO ] [REMOTE ] CUZ: Full fetch complete (70788 records). [2025-10-28T18:10:42.391205] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-28T18:10:42.793803] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-28T18:10:42.793889] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-28T18:10:42.794728] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-28T18:10:42.794798] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-28T18:10:42.796238] [DEBUG] [LOCAL ] CUZ: Trimmed 70788 records to 49295 (keeping 200 days of data) [2025-10-28T18:10:43.110595] [DEBUG] [LOCAL ] CUZ: Primary data saved (49295 records). [2025-10-28T18:10:43.110834] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-28T18:10:43.110930] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CUZ took 21.6s. Estimated remaining: 3h 46m 19s. Rate: 8.0 symbols/min [2025-10-28T18:10:43.173447] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-28T18:10:43.289421] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:43.343796] [DEBUG] [LOCAL ] CVNA: Loaded 52806 existing records from primary storage. [2025-10-28T18:10:43.344168] [INFO ] [MAIN ] CVNA: Loaded 52806 existing records. [2025-10-28T18:10:43.556949] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:43.576725] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-28T18:10:43.576957] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-28T18:10:43.578558] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (4.42 seconds). [2025-10-28T18:10:43.578604] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-28T18:10:43.589364] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-28T18:10:43.961916] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:43.961978] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-28T18:10:44.186382] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:10:44.759426] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-28T18:10:45.559322] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-28T18:10:45.683789] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T18:10:46.359346] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-28T18:10:46.582955] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (4.21 seconds). [2025-10-28T18:10:46.589862] [INFO ] [REMOTE ] CURV: Full fetch complete (39145 records). [2025-10-28T18:10:46.590005] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-28T18:10:46.979429] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-28T18:10:46.979616] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-28T18:10:46.988465] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-28T18:10:46.988922] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:10:46.992511] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-28T18:10:46.993587] [DEBUG] [LOCAL ] CURV: Trimmed 39145 records to 27484 (keeping 200 days of data) [2025-10-28T18:10:47.143569] [DEBUG] [LOCAL ] CURV: Primary data saved (27484 records). [2025-10-28T18:10:47.143731] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-28T18:10:47.143822] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CURV took 25.6s. Estimated remaining: 3h 46m 0s. Rate: 8.0 symbols/min [2025-10-28T18:10:47.164816] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-28T18:10:47.321233] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:47.351769] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:10:47.414308] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-28T18:10:47.414775] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-28T18:10:47.616806] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:47.617066] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-28T18:10:47.617126] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-28T18:10:47.617996] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-28T18:10:47.618054] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-28T18:10:47.816186] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (3.85 seconds). [2025-10-28T18:10:47.962612] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-28T18:10:48.025378] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:48.040689] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T18:10:48.759331] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-28T18:10:49.473067] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:10:49.559327] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-28T18:10:50.308236] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:10:50.342750] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T18:10:50.359295] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-28T18:10:51.159358] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-28T18:10:51.959318] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-28T18:10:52.007577] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T18:10:52.759386] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-28T18:10:53.559386] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-28T18:10:53.651609] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-28T18:10:54.309112] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:10:54.360490] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-28T18:10:54.364843] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:10:55.043610] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:10:55.159362] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-28T18:10:55.959339] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-28T18:10:56.309821] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (5.15 seconds). [2025-10-28T18:10:56.759345] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-28T18:10:57.559351] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-28T18:10:57.957872] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-28T18:10:58.052855] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T18:10:58.086373] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T18:10:58.359355] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-28T18:10:59.159325] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-28T18:10:59.959367] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-28T18:11:02.122925] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-28T18:11:02.126853] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-28T18:11:02.162737] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-28T18:11:02.175824] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-28T18:11:03.005055] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T18:11:03.008371] [INFO ] [REMOTE ] CVLG: Full fetch complete (21407 records). [2025-10-28T18:11:03.008479] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-28T18:11:03.172669] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (8.01 seconds). [2025-10-28T18:11:03.232795] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-28T18:11:03.441075] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-28T18:11:03.441160] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-28T18:11:03.441596] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-28T18:11:03.441677] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-28T18:11:03.442298] [DEBUG] [LOCAL ] CVLG: Trimmed 21407 records to 15144 (keeping 200 days of data) [2025-10-28T18:11:03.531002] [DEBUG] [LOCAL ] CVLG: Primary data saved (15144 records). [2025-10-28T18:11:03.531120] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-28T18:11:03.531193] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CVLG took 21.9s. Estimated remaining: 3h 46m 21s. Rate: 8.0 symbols/min [2025-10-28T18:11:03.697918] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:03.746023] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-28T18:11:03.746332] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-28T18:11:03.921610] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:03.921846] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-28T18:11:03.921891] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-28T18:11:03.922870] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-28T18:11:03.922927] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-28T18:11:04.279255] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:04.279579] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-28T18:11:07.636543] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (9.28 seconds). [2025-10-28T18:11:07.647434] [INFO ] [REMOTE ] CVE: Full fetch complete (77711 records). [2025-10-28T18:11:07.647605] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-28T18:11:08.048244] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-28T18:11:08.048341] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-28T18:11:08.049282] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-28T18:11:08.049346] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-28T18:11:08.050849] [DEBUG] [LOCAL ] CVE: Trimmed 77711 records to 53558 (keeping 200 days of data) [2025-10-28T18:11:08.378755] [DEBUG] [LOCAL ] CVE: Primary data saved (53558 records). [2025-10-28T18:11:08.378985] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-28T18:11:08.379088] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVE took 46.8s. Estimated remaining: 3h 46m 5s. Rate: 8.0 symbols/min [2025-10-28T18:11:08.554216] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:08.575272] [DEBUG] [LOCAL ] CW: Loaded 21509 existing records from primary storage. [2025-10-28T18:11:08.575520] [INFO ] [MAIN ] CW: Loaded 21509 existing records. [2025-10-28T18:11:08.756269] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:08.756467] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-28T18:11:08.756513] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-28T18:11:08.756873] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-28T18:11:08.756952] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-28T18:11:09.117103] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:09.117438] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-28T18:11:10.235778] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:11:10.241692] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-28T18:11:11.238218] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T18:11:11.243914] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-28T18:11:13.438322] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (11.26 seconds). [2025-10-28T18:11:13.449309] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-28T18:11:15.130839] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T18:11:15.143847] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-28T18:11:15.673579] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (12.44 seconds). [2025-10-28T18:11:15.685396] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-28T18:11:17.103819] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T18:11:17.115805] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-28T18:11:18.165573] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (13.89 seconds). [2025-10-28T18:11:18.176812] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-28T18:11:19.955746] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T18:11:19.966144] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-28T18:11:24.002444] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (12.76 seconds). [2025-10-28T18:11:24.007580] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-28T18:11:27.073948] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (11.39 seconds). [2025-10-28T18:11:27.084784] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-28T18:11:29.560800] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (12.44 seconds). [2025-10-28T18:11:29.572481] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-28T18:11:31.333506] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-28T18:11:31.345144] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-28T18:11:33.389676] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T18:11:33.400274] [INFO ] [REMOTE ] CVNA: Full fetch complete (76710 records). [2025-10-28T18:11:33.400429] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-28T18:11:33.807064] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-28T18:11:33.807160] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-28T18:11:33.808147] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-28T18:11:33.808217] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-28T18:11:33.810017] [DEBUG] [LOCAL ] CVNA: Trimmed 76710 records to 52804 (keeping 200 days of data) [2025-10-28T18:11:33.926235] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (13.96 seconds). [2025-10-28T18:11:33.948101] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-28T18:11:34.175534] [DEBUG] [LOCAL ] CVNA: Primary data saved (52804 records). [2025-10-28T18:11:34.175679] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-28T18:11:34.175781] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVNA took 51.1s. Estimated remaining: 3h 46m 55s. Rate: 7.9 symbols/min [2025-10-28T18:11:34.350146] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:34.396878] [DEBUG] [LOCAL ] CWAN: Loaded 52664 existing records from primary storage. [2025-10-28T18:11:34.397228] [INFO ] [MAIN ] CWAN: Loaded 52664 existing records. [2025-10-28T18:11:34.572172] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:34.572380] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-28T18:11:34.572426] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-28T18:11:34.573276] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-28T18:11:34.573333] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-28T18:11:34.919319] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:34.919619] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-28T18:11:36.129035] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-28T18:11:36.140954] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-28T18:11:36.169198] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (12.16 seconds). [2025-10-28T18:11:36.174317] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-28T18:11:36.365596] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T18:11:36.375589] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-28T18:11:37.512817] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:11:37.522547] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-28T18:11:39.005298] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T18:11:39.015959] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-28T18:11:40.352068] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:11:40.362830] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-28T18:11:41.717486] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:11:41.728980] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-28T18:11:43.047685] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T18:11:43.058973] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-28T18:11:43.541553] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (16.46 seconds). [2025-10-28T18:11:43.553406] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-28T18:11:44.459845] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:11:44.471278] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-28T18:11:45.142954] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:11:45.154797] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-28T18:11:45.826668] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T18:11:45.841207] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-28T18:11:46.864052] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T18:11:46.880412] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-28T18:11:47.163845] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T18:11:47.175033] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-28T18:11:47.385670] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T18:11:47.396786] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-28T18:11:47.396936] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-28T18:11:47.790611] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-28T18:11:47.790736] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-28T18:11:47.791754] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-28T18:11:47.791817] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-28T18:11:47.793354] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-28T18:11:48.125184] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-28T18:11:48.125345] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-28T18:11:48.125435] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVS took 1m 1s. Estimated remaining: 3h 47m 8s. Rate: 7.9 symbols/min [2025-10-28T18:11:48.301162] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:48.340730] [DEBUG] [LOCAL ] CWEN: Loaded 45119 existing records from primary storage. [2025-10-28T18:11:48.341070] [INFO ] [MAIN ] CWEN: Loaded 45119 existing records. [2025-10-28T18:11:48.522270] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:48.522520] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-28T18:11:48.522584] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-28T18:11:48.522988] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-28T18:11:48.523047] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-28T18:11:48.874616] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:48.874976] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-28T18:11:50.012832] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:11:50.021296] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-28T18:11:51.075845] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (14.90 seconds). [2025-10-28T18:11:51.082227] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-28T18:11:51.118679] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:11:51.127299] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-28T18:11:52.114950] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:11:52.120312] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-28T18:11:52.267503] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T18:11:52.277114] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-28T18:11:53.333992] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:11:53.343827] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-28T18:12:00.394931] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (8.27 seconds). [2025-10-28T18:12:00.399787] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-28T18:12:02.139310] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (26.00 seconds). [2025-10-28T18:12:02.151237] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-28T18:12:04.076374] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-28T18:12:04.087155] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-28T18:12:07.558054] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (14.21 seconds). [2025-10-28T18:12:07.567023] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-28T18:12:07.744175] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (20.57 seconds). [2025-10-28T18:12:07.755347] [INFO ] [REMOTE ] CWAN: Full fetch complete (75643 records). [2025-10-28T18:12:07.755501] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-28T18:12:08.142833] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-28T18:12:08.142906] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-28T18:12:08.143734] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-28T18:12:08.143795] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-28T18:12:08.145121] [DEBUG] [LOCAL ] CWAN: Trimmed 75643 records to 52664 (keeping 200 days of data) [2025-10-28T18:12:08.441986] [DEBUG] [LOCAL ] CWAN: Primary data saved (52664 records). [2025-10-28T18:12:08.442109] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-28T18:12:08.442183] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CWAN took 34.3s. Estimated remaining: 3h 47m 41s. Rate: 7.9 symbols/min [2025-10-28T18:12:08.607302] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:08.654599] [DEBUG] [LOCAL ] CWH: Loaded 51204 existing records from primary storage. [2025-10-28T18:12:08.654974] [INFO ] [MAIN ] CWH: Loaded 51204 existing records. [2025-10-28T18:12:08.829231] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:08.829475] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-28T18:12:08.829522] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-28T18:12:08.830125] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-28T18:12:08.830187] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-28T18:12:09.179302] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:09.179554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-28T18:12:13.696442] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (13.30 seconds). [2025-10-28T18:12:13.701726] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-28T18:12:17.688297] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (8.51 seconds). [2025-10-28T18:12:17.697859] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-28T18:12:19.031039] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T18:12:19.040251] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-28T18:12:20.276170] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:12:20.286914] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-28T18:12:21.790104] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T18:12:21.802480] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-28T18:12:23.140051] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:12:23.151265] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-28T18:12:23.483096] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (19.40 seconds). [2025-10-28T18:12:23.495051] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-28T18:12:24.403247] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:12:24.413451] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-28T18:12:25.134670] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-28T18:12:25.145823] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-28T18:12:25.831450] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:12:25.842801] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-28T18:12:30.126635] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (22.56 seconds). [2025-10-28T18:12:30.135542] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-28T18:12:31.412916] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:12:31.422765] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-28T18:12:32.575885] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T18:12:32.585572] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-28T18:12:34.808840] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (21.11 seconds). [2025-10-28T18:12:34.813259] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-28T18:12:35.926307] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T18:12:35.932149] [INFO ] [REMOTE ] CW: Full fetch complete (32895 records). [2025-10-28T18:12:35.932307] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-28T18:12:36.332305] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-28T18:12:36.332382] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-28T18:12:36.332898] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-28T18:12:36.332958] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-28T18:12:36.333687] [DEBUG] [LOCAL ] CW: Trimmed 32895 records to 21599 (keeping 200 days of data) [2025-10-28T18:12:36.472831] [DEBUG] [LOCAL ] CW: Primary data saved (21599 records). [2025-10-28T18:12:36.472968] [INFO ] [MAIN ] CW: Full history saved. [2025-10-28T18:12:36.473062] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CW took 1m 28s. Estimated remaining: 3h 48m 37s. Rate: 7.9 symbols/min [2025-10-28T18:12:36.640855] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:36.685908] [DEBUG] [LOCAL ] CWK: Loaded 49600 existing records from primary storage. [2025-10-28T18:12:36.686222] [INFO ] [MAIN ] CWK: Loaded 49600 existing records. [2025-10-28T18:12:36.868908] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:36.869125] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-28T18:12:36.869174] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-28T18:12:36.869931] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-28T18:12:36.869992] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-28T18:12:37.221949] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:37.222273] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-28T18:12:38.324228] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T18:12:38.333949] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-28T18:12:38.902620] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (13.76 seconds). [2025-10-28T18:12:38.914110] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-28T18:12:39.329583] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (6.74 seconds). [2025-10-28T18:12:39.339353] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-28T18:12:40.927783] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T18:12:40.937200] [INFO ] [REMOTE ] CWEN: Full fetch complete (65649 records). [2025-10-28T18:12:40.937322] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-28T18:12:41.322783] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-28T18:12:41.322872] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-28T18:12:41.323719] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-28T18:12:41.323803] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-28T18:12:41.325137] [DEBUG] [LOCAL ] CWEN: Trimmed 65649 records to 45068 (keeping 200 days of data) [2025-10-28T18:12:41.597244] [DEBUG] [LOCAL ] CWEN: Primary data saved (45068 records). [2025-10-28T18:12:41.597394] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-28T18:12:41.597504] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWEN took 53.5s. Estimated remaining: 3h 48m 22s. Rate: 7.9 symbols/min [2025-10-28T18:12:41.770722] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:41.796991] [DEBUG] [LOCAL ] CWT: Loaded 27782 existing records from primary storage. [2025-10-28T18:12:41.797274] [INFO ] [MAIN ] CWT: Loaded 27782 existing records. [2025-10-28T18:12:41.974793] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:41.975195] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-28T18:12:41.975255] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-28T18:12:41.975716] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-28T18:12:41.975773] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-28T18:12:42.358832] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (16.52 seconds). [2025-10-28T18:12:42.411153] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:42.411779] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-28T18:12:42.412952] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-28T18:12:42.440543] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (4.11 seconds). [2025-10-28T18:12:42.450132] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-28T18:12:43.745508] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:12:43.751838] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-28T18:12:43.834018] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (4.92 seconds). [2025-10-28T18:12:43.837776] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:12:43.862584] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-28T18:12:43.862854] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-28T18:12:43.864166] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-28T18:12:44.304071] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-28T18:12:44.330449] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-28T18:12:44.332172] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-28T18:12:44.333679] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-28T18:12:44.333520] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T18:12:44.344860] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-28T18:12:44.346378] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-28T18:12:44.678746] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-28T18:12:44.678951] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-28T18:12:44.694122] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CVX took 1m 41s. Estimated remaining: 3h 47m 60s. Rate: 7.9 symbols/min [2025-10-28T18:12:44.772430] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:12:44.805802] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-28T18:12:44.876176] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:44.925788] [DEBUG] [LOCAL ] CX: Loaded 52770 existing records from primary storage. [2025-10-28T18:12:44.926104] [INFO ] [MAIN ] CX: Loaded 52770 existing records. [2025-10-28T18:12:45.098928] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:45.099122] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-28T18:12:45.099167] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-28T18:12:45.099589] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-28T18:12:45.099688] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-28T18:12:45.454209] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:45.454609] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-28T18:12:45.481617] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:12:45.492130] [INFO ] [REMOTE ] CWH: Full fetch complete (73260 records). [2025-10-28T18:12:45.492261] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-28T18:12:45.868256] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:12:45.927629] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-28T18:12:45.928039] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-28T18:12:45.928332] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-28T18:12:45.930099] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-28T18:12:45.930203] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-28T18:12:45.958870] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T18:12:45.969479] [DEBUG] [LOCAL ] CWH: Trimmed 73260 records to 51203 (keeping 200 days of data) [2025-10-28T18:12:45.970721] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-28T18:12:46.272448] [DEBUG] [LOCAL ] CWH: Primary data saved (51203 records). [2025-10-28T18:12:46.272572] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-28T18:12:46.272745] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWH took 37.8s. Estimated remaining: 3h 47m 33s. Rate: 7.9 symbols/min [2025-10-28T18:12:46.447282] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:46.455423] [DEBUG] [LOCAL ] CXE: Loaded 6300 existing records from primary storage. [2025-10-28T18:12:46.455614] [INFO ] [MAIN ] CXE: Loaded 6300 existing records. [2025-10-28T18:12:46.632586] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:46.632796] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-28T18:12:46.632893] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-28T18:12:46.633053] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-28T18:12:46.633123] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-28T18:12:46.997121] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:46.997508] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-28T18:12:47.018004] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:12:47.025164] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-28T18:12:47.055003] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-28T18:12:47.065085] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-28T18:12:47.216715] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:12:47.230111] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-28T18:12:47.763530] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T18:12:47.766164] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-28T18:12:48.178280] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T18:12:48.185139] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-28T18:12:48.287396] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:12:48.288815] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T18:12:48.303623] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-28T18:12:48.302677] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-28T18:12:48.839772] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T18:12:48.842986] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-28T18:12:48.995051] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T18:12:49.004421] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-28T18:12:49.073945] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T18:12:49.079761] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-28T18:12:49.517540] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:12:49.519547] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-28T18:12:49.945068] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T18:12:49.956391] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-28T18:12:49.996832] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T18:12:50.003916] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-28T18:12:50.012444] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T18:12:50.015055] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-28T18:12:50.417368] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T18:12:50.419445] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-28T18:12:50.811627] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T18:12:50.817799] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-28T18:12:50.825587] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T18:12:50.827540] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-28T18:12:51.144461] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T18:12:51.146288] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-28T18:12:51.293004] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-28T18:12:51.304450] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-28T18:12:51.345920] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:12:51.356946] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-28T18:12:51.584406] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:12:51.590615] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-28T18:12:51.652105] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:12:51.654380] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-28T18:12:52.265379] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:12:52.267182] [INFO ] [REMOTE ] CXE: Full fetch complete (10957 records). [2025-10-28T18:12:52.267266] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-28T18:12:52.640051] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-28T18:12:52.640291] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-28T18:12:52.640899] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-28T18:12:52.641140] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-28T18:12:52.655760] [DEBUG] [LOCAL ] CXE: Trimmed 10957 records to 6302 (keeping 200 days of data) [2025-10-28T18:12:52.659634] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T18:12:52.721256] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:12:52.718707] [INFO ] [REMOTE ] CWT: Full fetch complete (41310 records). [2025-10-28T18:12:52.734694] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-28T18:12:52.741463] [DEBUG] [LOCAL ] CXE: Primary data saved (6302 records). [2025-10-28T18:12:52.741578] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-28T18:12:52.742005] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CXE took 6.5s. Estimated remaining: 3h 47m 22s. Rate: 7.9 symbols/min [2025-10-28T18:12:52.784156] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-28T18:12:53.091477] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:53.215668] [DEBUG] [LOCAL ] CXH: Loaded 4349 existing records from primary storage. [2025-10-28T18:12:53.258534] [INFO ] [MAIN ] CXH: Loaded 4349 existing records. [2025-10-28T18:12:53.317522] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-28T18:12:53.332934] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-28T18:12:53.340221] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-28T18:12:53.355874] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-28T18:12:53.435475] [DEBUG] [LOCAL ] CWT: Trimmed 41310 records to 27707 (keeping 200 days of data) [2025-10-28T18:12:53.454308] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-28T18:12:53.581313] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:53.590909] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-28T18:12:53.590615] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-28T18:12:53.617504] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-28T18:12:53.626358] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-28T18:12:53.641207] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-28T18:12:53.802137] [DEBUG] [LOCAL ] CWT: Primary data saved (27707 records). [2025-10-28T18:12:53.811113] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-28T18:12:53.817694] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CWT took 12.2s. Estimated remaining: 3h 46m 54s. Rate: 7.9 symbols/min [2025-10-28T18:12:54.182589] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:54.287161] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:54.287867] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-28T18:12:54.320883] [DEBUG] [LOCAL ] CXM: Loaded 47108 existing records from primary storage. [2025-10-28T18:12:54.321194] [INFO ] [MAIN ] CXM: Loaded 47108 existing records. [2025-10-28T18:12:54.527443] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T18:12:54.531810] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:54.541919] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-28T18:12:54.542298] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-28T18:12:54.542761] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-28T18:12:54.543673] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-28T18:12:54.543737] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-28T18:12:54.816706] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T18:12:54.828073] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-28T18:12:54.908812] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:54.909161] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-28T18:12:54.953601] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T18:12:54.964304] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-28T18:12:55.230033] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:12:55.231159] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-28T18:12:55.529418] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T18:12:55.530561] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-28T18:12:55.858188] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T18:12:55.859822] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-28T18:12:56.030978] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T18:12:56.040519] [INFO ] [REMOTE ] CWK: Full fetch complete (71023 records). [2025-10-28T18:12:56.040628] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-28T18:12:56.041465] [FATAL] [VALIDATOR ] CWK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:12:56.041546] [FATAL] [MAIN ] CWK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:12:56.041589] [WARN ] [MAIN ] CWK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:12:56.041677] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-28T18:12:56.041752] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-28T18:12:56.041789] [INFO ] [LOCAL ] CWK: Starting deletion of derivative data. [2025-10-28T18:12:56.041964] [DEBUG] [LOCAL ] CWK: Deleted derivative data file. [2025-10-28T18:12:56.042051] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CWK took 19.6s. Estimated remaining: 3h 46m 30s. Rate: 7.9 symbols/min [2025-10-28T18:12:56.216101] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:56.244904] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T18:12:56.246811] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:12:56.258881] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-28T18:12:56.260166] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-28T18:12:56.292727] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:12:56.311913] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-28T18:12:56.323212] [DEBUG] [LOCAL ] CXT: Loaded 30425 existing records from primary storage. [2025-10-28T18:12:56.323431] [INFO ] [MAIN ] CXT: Loaded 30425 existing records. [2025-10-28T18:12:56.496683] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:56.496849] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-28T18:12:56.496912] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-28T18:12:56.500611] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-28T18:12:56.500715] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-28T18:12:56.678177] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:12:56.727512] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-28T18:12:56.860507] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:56.860791] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-28T18:12:57.189306] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:12:57.198045] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-28T18:12:57.581044] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T18:12:57.583563] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-28T18:12:57.767808] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T18:12:57.779009] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-28T18:12:57.922115] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T18:12:57.928783] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-28T18:12:57.964226] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:12:57.965819] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-28T18:12:58.306207] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:12:58.317281] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-28T18:12:58.360918] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:12:58.362895] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-28T18:12:58.761253] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:12:58.767865] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-28T18:12:58.771731] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T18:12:58.772865] [INFO ] [REMOTE ] CXH: Full fetch complete (5304 records). [2025-10-28T18:12:58.772975] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-28T18:12:59.141553] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-28T18:12:59.141714] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-28T18:12:59.141950] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-28T18:12:59.142028] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-28T18:12:59.168958] [DEBUG] [LOCAL ] CXH: Trimmed 5304 records to 4335 (keeping 200 days of data) [2025-10-28T18:12:59.184002] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T18:12:59.210944] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-28T18:12:59.210566] [DEBUG] [LOCAL ] CXH: Primary data saved (4335 records). [2025-10-28T18:12:59.211813] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-28T18:12:59.211899] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXH took 6.5s. Estimated remaining: 3h 46m 9s. Rate: 7.9 symbols/min [2025-10-28T18:12:59.381128] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:59.421901] [DEBUG] [LOCAL ] CXW: Loaded 43394 existing records from primary storage. [2025-10-28T18:12:59.422297] [INFO ] [MAIN ] CXW: Loaded 43394 existing records. [2025-10-28T18:12:59.578564] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:12:59.643945] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:59.644909] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-28T18:12:59.645037] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-28T18:12:59.644794] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-28T18:12:59.646299] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-28T18:12:59.646369] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-28T18:12:59.804619] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T18:12:59.929531] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-28T18:13:00.028703] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:00.028986] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-28T18:13:00.876118] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:13:00.889180] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-28T18:13:01.040820] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:13:01.048485] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-28T18:13:01.102789] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T18:13:01.113209] [INFO ] [REMOTE ] CX: Full fetch complete (76556 records). [2025-10-28T18:13:01.113351] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-28T18:13:01.507179] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-28T18:13:01.507296] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-28T18:13:01.508261] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-28T18:13:01.508482] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-28T18:13:01.534147] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:13:01.534283] [DEBUG] [LOCAL ] CX: Trimmed 76556 records to 52770 (keeping 200 days of data) [2025-10-28T18:13:01.543861] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-28T18:13:01.865287] [DEBUG] [LOCAL ] CX: Primary data saved (52770 records). [2025-10-28T18:13:01.865438] [INFO ] [MAIN ] CX: Full history saved. [2025-10-28T18:13:01.865529] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CX took 17.2s. Estimated remaining: 3h 45m 46s. Rate: 7.9 symbols/min [2025-10-28T18:13:02.044072] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:02.062153] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T18:13:02.069165] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-28T18:13:02.107093] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:13:02.126375] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-28T18:13:02.126878] [DEBUG] [LOCAL ] CYD: Loaded 27069 existing records from primary storage. [2025-10-28T18:13:02.127224] [INFO ] [MAIN ] CYD: Loaded 27069 existing records. [2025-10-28T18:13:02.301735] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:02.301975] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-28T18:13:02.302029] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-28T18:13:02.302301] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-28T18:13:02.302340] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-28T18:13:02.659169] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:02.659485] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-28T18:13:02.859198] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:13:02.868619] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-28T18:13:03.043443] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:13:03.050458] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-28T18:13:03.222794] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T18:13:03.224385] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-28T18:13:03.547774] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:13:03.558186] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-28T18:13:03.934272] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:13:03.948221] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-28T18:13:03.961968] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:13:03.966828] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-28T18:13:04.014014] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T18:13:04.024377] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-28T18:13:04.660120] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:13:04.675618] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-28T18:13:04.758929] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:13:04.769857] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-28T18:13:05.006998] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T18:13:05.014376] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-28T18:13:05.321119] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T18:13:05.330955] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-28T18:13:05.706685] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:13:05.712946] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-28T18:13:05.937079] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T18:13:05.944458] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-28T18:13:06.064783] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:13:06.076214] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-28T18:13:06.354704] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T18:13:06.364060] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-28T18:13:06.521002] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T18:13:06.526438] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-28T18:13:07.065706] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T18:13:07.071936] [INFO ] [REMOTE ] CXT: Full fetch complete (45517 records). [2025-10-28T18:13:07.072025] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-28T18:13:07.476702] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-28T18:13:07.477432] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-28T18:13:07.478459] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-28T18:13:07.479338] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-28T18:13:07.536245] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T18:13:07.534856] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:13:07.536920] [DEBUG] [LOCAL ] CXT: Trimmed 45517 records to 30366 (keeping 200 days of data) [2025-10-28T18:13:07.558032] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-28T18:13:07.613549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-28T18:13:07.683280] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T18:13:07.730838] [INFO ] [REMOTE ] CXM: Full fetch complete (68320 records). [2025-10-28T18:13:07.734393] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-28T18:13:07.862184] [DEBUG] [LOCAL ] CXT: Primary data saved (30366 records). [2025-10-28T18:13:07.875396] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-28T18:13:07.886158] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXT took 11.8s. Estimated remaining: 3h 45m 33s. Rate: 7.9 symbols/min [2025-10-28T18:13:08.345316] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:08.474260] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-28T18:13:08.474488] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-28T18:13:08.475327] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-28T18:13:08.475388] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-28T18:13:08.476639] [DEBUG] [LOCAL ] CXM: Trimmed 68320 records to 47019 (keeping 200 days of data) [2025-10-28T18:13:08.669441] [DEBUG] [LOCAL ] CYH: Loaded 47628 existing records from primary storage. [2025-10-28T18:13:08.722303] [INFO ] [MAIN ] CYH: Loaded 47628 existing records. [2025-10-28T18:13:08.824484] [DEBUG] [LOCAL ] CXM: Primary data saved (47019 records). [2025-10-28T18:13:08.834392] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-28T18:13:08.875922] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CXM took 15.0s. Estimated remaining: 3h 45m 5s. Rate: 7.9 symbols/min [2025-10-28T18:13:08.917606] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T18:13:08.979009] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-28T18:13:09.095613] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:09.096312] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-28T18:13:09.113076] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-28T18:13:09.137201] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-28T18:13:09.171124] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:09.167003] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-28T18:13:09.171458] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-28T18:13:09.220279] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-28T18:13:09.236907] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-28T18:13:09.242249] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-28T18:13:09.259566] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-28T18:13:09.259726] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-28T18:13:09.714348] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-28T18:13:09.843517] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-28T18:13:09.904355] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:09.934474] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-28T18:13:09.971413] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:09.971854] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-28T18:13:09.991553] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T18:13:09.998477] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-28T18:13:10.920967] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T18:13:10.928230] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-28T18:13:11.143790] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:13:11.153541] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-28T18:13:11.414152] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:13:11.423768] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-28T18:13:11.657060] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T18:13:11.667428] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-28T18:13:11.856094] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T18:13:11.862272] [INFO ] [REMOTE ] CYD: Full fetch complete (36492 records). [2025-10-28T18:13:11.862351] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-28T18:13:11.862880] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:13:11.862959] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:13:11.863001] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:13:11.863038] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-28T18:13:11.863093] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-28T18:13:11.863128] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-28T18:13:11.863278] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-28T18:13:11.863346] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CYD took 10.0s. Estimated remaining: 3h 44m 44s. Rate: 7.9 symbols/min [2025-10-28T18:13:12.028394] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:12.040470] [DEBUG] [LOCAL ] DAC: Loaded 11984 existing records from primary storage. [2025-10-28T18:13:12.040746] [INFO ] [MAIN ] DAC: Loaded 11984 existing records. [2025-10-28T18:13:12.214741] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:12.214931] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-28T18:13:12.214976] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-28T18:13:12.215174] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-28T18:13:12.215213] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-28T18:13:12.593454] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:12.604490] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-28T18:13:12.604132] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:13:12.615944] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-28T18:13:12.644928] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:13:12.655864] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-28T18:13:12.881913] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T18:13:12.891932] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-28T18:13:13.400060] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T18:13:13.403826] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-28T18:13:13.635588] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:13:13.645336] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-28T18:13:14.059331] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:13:14.068533] [INFO ] [REMOTE ] CXW: Full fetch complete (64675 records). [2025-10-28T18:13:14.068724] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-28T18:13:14.174074] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:13:14.186113] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-28T18:13:14.510901] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-28T18:13:14.511011] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-28T18:13:14.511831] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-28T18:13:14.511976] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-28T18:13:14.514500] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T18:13:14.526007] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-28T18:13:14.526915] [DEBUG] [LOCAL ] CXW: Trimmed 64675 records to 43420 (keeping 200 days of data) [2025-10-28T18:13:14.780284] [DEBUG] [LOCAL ] CXW: Primary data saved (43420 records). [2025-10-28T18:13:14.780404] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-28T18:13:14.780483] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. CXW took 15.6s. Estimated remaining: 3h 44m 22s. Rate: 8.0 symbols/min [2025-10-28T18:13:14.991312] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:14.992370] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T18:13:14.992592] [DEBUG] [LOCAL ] DAL: No existing data file found in primary storage. [2025-10-28T18:13:14.996361] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-28T18:13:14.997323] [WARN ] [MAIN ] DAL: No existing data found, performing full refresh instead. [2025-10-28T18:13:14.997574] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-28T18:13:14.997688] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-28T18:13:14.997902] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-28T18:13:14.997957] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-28T18:13:15.131677] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:13:15.168288] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-28T18:13:15.398810] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:15.399115] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-28T18:13:15.717024] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T18:13:15.720876] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-28T18:13:16.052793] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T18:13:16.064024] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-28T18:13:16.306090] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:13:16.309436] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-28T18:13:16.586339] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:13:16.759360] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-28T18:13:16.971424] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T18:13:17.071255] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T18:13:17.377228] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:13:17.559365] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-28T18:13:17.819173] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:13:18.359329] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-28T18:13:18.818600] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T18:13:18.898442] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T18:13:19.159317] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-28T18:13:19.959327] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-28T18:13:20.574834] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T18:13:20.759376] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-28T18:13:21.266598] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T18:13:21.559333] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-28T18:13:22.232761] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:13:22.359346] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-28T18:13:22.901113] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:13:22.924834] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T18:13:23.159346] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-28T18:13:23.959352] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-28T18:13:24.759391] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-28T18:13:24.797443] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T18:13:25.384060] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T18:13:25.383817] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:13:25.559332] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-28T18:13:26.359333] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-28T18:13:27.006737] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:13:27.102594] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T18:13:27.105569] [INFO ] [REMOTE ] DAC: Full fetch complete (18826 records). [2025-10-28T18:13:27.105638] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-28T18:13:27.168788] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-28T18:13:27.492170] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-28T18:13:27.492255] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-28T18:13:27.492821] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-28T18:13:27.492882] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-28T18:13:27.493488] [DEBUG] [LOCAL ] DAC: Trimmed 18826 records to 11883 (keeping 200 days of data) [2025-10-28T18:13:27.564599] [DEBUG] [LOCAL ] DAC: Primary data saved (11883 records). [2025-10-28T18:13:27.564768] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-28T18:13:27.564856] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. DAC took 15.7s. Estimated remaining: 3h 44m 31s. Rate: 7.9 symbols/min [2025-10-28T18:13:27.730565] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:27.778004] [DEBUG] [LOCAL ] DAN: Loaded 49315 existing records from primary storage. [2025-10-28T18:13:27.778298] [INFO ] [MAIN ] DAN: Loaded 49315 existing records. [2025-10-28T18:13:27.954998] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:27.955199] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-28T18:13:27.955245] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-28T18:13:27.955762] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-28T18:13:27.955818] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-28T18:13:27.966991] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-28T18:13:28.325803] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:28.350114] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:13:28.616094] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:13:28.627025] [INFO ] [REMOTE ] D: Full fetch complete (77811 records). [2025-10-28T18:13:28.627186] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-28T18:13:28.768540] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-28T18:13:29.024206] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-28T18:13:29.024298] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-28T18:13:29.025306] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-28T18:13:29.025374] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-28T18:13:29.026890] [DEBUG] [LOCAL ] D: Trimmed 77811 records to 53648 (keeping 200 days of data) [2025-10-28T18:13:29.371732] [DEBUG] [LOCAL ] D: Primary data saved (53648 records). [2025-10-28T18:13:29.371873] [INFO ] [MAIN ] D: Full history saved. [2025-10-28T18:13:29.371945] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. D took 20.5s. Estimated remaining: 3h 44m 5s. Rate: 8.0 symbols/min [2025-10-28T18:13:29.553362] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:29.563375] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-28T18:13:29.572456] [DEBUG] [LOCAL ] DAO: Loaded 19588 existing records from primary storage. [2025-10-28T18:13:29.572718] [INFO ] [MAIN ] DAO: Loaded 19588 existing records. [2025-10-28T18:13:29.760230] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:29.760461] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-28T18:13:29.760506] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-28T18:13:29.760847] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-28T18:13:29.760905] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-28T18:13:30.160161] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:30.190099] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T18:13:30.199902] [INFO ] [REMOTE ] CYH: Full fetch complete (69936 records). [2025-10-28T18:13:30.200040] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-28T18:13:30.374281] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-28T18:13:30.591231] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-28T18:13:30.591310] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-28T18:13:30.592200] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-28T18:13:30.592273] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-28T18:13:30.593751] [DEBUG] [LOCAL ] CYH: Trimmed 69936 records to 47632 (keeping 200 days of data) [2025-10-28T18:13:30.858224] [DEBUG] [LOCAL ] CYH: Primary data saved (47632 records). [2025-10-28T18:13:30.858377] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-28T18:13:30.858465] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. CYH took 23.0s. Estimated remaining: 3h 43m 39s. Rate: 8.0 symbols/min [2025-10-28T18:13:31.027935] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:31.074476] [DEBUG] [LOCAL ] DAR: Loaded 51980 existing records from primary storage. [2025-10-28T18:13:31.074809] [INFO ] [MAIN ] DAR: Loaded 51980 existing records. [2025-10-28T18:13:31.175453] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-28T18:13:31.305143] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:31.309374] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:13:31.314721] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-28T18:13:31.314852] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-28T18:13:31.315702] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-28T18:13:31.315881] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-28T18:13:31.682740] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-28T18:13:31.756608] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:31.959411] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-28T18:13:32.500844] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:13:32.759352] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-28T18:13:32.925383] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:13:33.559335] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-28T18:13:33.902930] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:13:34.359439] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-28T18:13:34.475718] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T18:13:35.159401] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-28T18:13:35.964489] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-28T18:13:35.982587] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T18:13:36.348801] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:13:36.759343] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-28T18:13:37.274680] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T18:13:37.559301] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-28T18:13:37.609623] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:13:38.359398] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-28T18:13:38.676823] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:13:39.048757] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T18:13:39.159319] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-28T18:13:39.773267] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T18:13:39.959385] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-28T18:13:40.759384] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-28T18:13:41.421468] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T18:13:41.559332] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-28T18:13:42.299695] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T18:13:42.359311] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-28T18:13:42.903535] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:13:43.159345] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-28T18:13:43.783474] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T18:13:43.959315] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-28T18:13:44.007224] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T18:13:44.759389] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-28T18:13:45.338842] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:13:45.559358] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-28T18:13:45.949115] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:13:46.359353] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-28T18:13:46.375298] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:13:47.159359] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-28T18:13:47.583746] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:13:47.913118] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:13:47.959322] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-28T18:13:48.759341] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-28T18:13:48.801203] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T18:13:48.806227] [INFO ] [REMOTE ] DAO: Full fetch complete (32779 records). [2025-10-28T18:13:48.806389] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-28T18:13:49.179900] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-28T18:13:49.179968] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-28T18:13:49.180540] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-28T18:13:49.180583] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-28T18:13:49.181312] [DEBUG] [LOCAL ] DAO: Trimmed 32779 records to 19584 (keeping 200 days of data) [2025-10-28T18:13:49.289324] [DEBUG] [LOCAL ] DAO: Primary data saved (19584 records). [2025-10-28T18:13:49.289468] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-28T18:13:49.289564] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAO took 19.9s. Estimated remaining: 3h 44m 5s. Rate: 7.9 symbols/min [2025-10-28T18:13:49.455775] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:49.494898] [DEBUG] [LOCAL ] DAVA: Loaded 41895 existing records from primary storage. [2025-10-28T18:13:49.495187] [INFO ] [MAIN ] DAVA: Loaded 41895 existing records. [2025-10-28T18:13:49.568904] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-28T18:13:49.675825] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:49.676028] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-28T18:13:49.676075] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-28T18:13:49.676532] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-28T18:13:49.676590] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-28T18:13:50.058946] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:50.131683] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:13:50.359340] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-28T18:13:51.081764] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-28T18:13:51.159321] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-28T18:13:51.330237] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:13:51.959420] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-28T18:13:52.744070] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T18:13:52.759294] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-28T18:13:52.900467] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:13:53.390550] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:13:53.401219] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-28T18:13:53.401366] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-28T18:13:53.569403] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-28T18:13:53.791203] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-28T18:13:53.791279] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-28T18:13:53.792131] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-28T18:13:53.792197] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-28T18:13:53.793662] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-28T18:13:54.123458] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-28T18:13:54.123662] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-28T18:13:54.123773] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAL took 39.3s. Estimated remaining: 3h 43m 49s. Rate: 7.9 symbols/min [2025-10-28T18:13:54.297375] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:54.339404] [DEBUG] [LOCAL ] DAY: Loaded 49047 existing records from primary storage. [2025-10-28T18:13:54.339771] [INFO ] [MAIN ] DAY: Loaded 49047 existing records. [2025-10-28T18:13:54.364467] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-28T18:13:54.530822] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:54.531087] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-28T18:13:54.531258] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-28T18:13:54.532099] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-28T18:13:54.532158] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-28T18:13:54.837629] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:13:54.918836] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:55.159341] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-28T18:13:55.726233] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T18:13:55.959356] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-28T18:13:56.125385] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T18:13:56.759346] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-28T18:13:57.215310] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:13:57.559331] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-28T18:13:58.097600] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:13:58.359334] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-28T18:13:58.680621] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:13:59.159323] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-28T18:13:59.743553] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T18:13:59.959335] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-28T18:14:00.409590] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T18:14:00.759392] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-28T18:14:01.533980] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:14:01.545815] [INFO ] [REMOTE ] DAR: Full fetch complete (75204 records). [2025-10-28T18:14:01.545991] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-28T18:14:01.569050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-28T18:14:01.971961] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-28T18:14:01.972152] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-28T18:14:01.973270] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-28T18:14:01.973361] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-28T18:14:01.975091] [DEBUG] [LOCAL ] DAR: Trimmed 75204 records to 51973 (keeping 200 days of data) [2025-10-28T18:14:02.209798] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:14:02.317235] [DEBUG] [LOCAL ] DAR: Primary data saved (51973 records). [2025-10-28T18:14:02.317363] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-28T18:14:02.317440] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAR took 31.5s. Estimated remaining: 3h 43m 44s. Rate: 7.9 symbols/min [2025-10-28T18:14:02.370770] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-28T18:14:02.485701] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:02.532885] [DEBUG] [LOCAL ] DB: Loaded 52404 existing records from primary storage. [2025-10-28T18:14:02.533178] [INFO ] [MAIN ] DB: Loaded 52404 existing records. [2025-10-28T18:14:02.706920] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:02.707296] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-28T18:14:02.707373] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-28T18:14:02.707962] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-28T18:14:02.708028] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-28T18:14:03.119323] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:03.113838] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T18:14:03.159290] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-28T18:14:03.518220] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:14:03.959335] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-28T18:14:04.402261] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:14:04.759351] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-28T18:14:05.530276] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T18:14:05.559325] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-28T18:14:05.865551] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:14:06.359447] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-28T18:14:06.507036] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:14:07.159368] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-28T18:14:07.622563] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:14:07.959342] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-28T18:14:08.044701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:14:08.759334] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-28T18:14:09.448515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T18:14:09.559334] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-28T18:14:09.918808] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:14:10.359317] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-28T18:14:10.766590] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:14:11.159372] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-28T18:14:11.770732] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:14:11.959329] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-28T18:14:12.767441] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-28T18:14:12.774075] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T18:14:13.340168] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T18:14:13.349834] [INFO ] [REMOTE ] DAN: Full fetch complete (71060 records). [2025-10-28T18:14:13.350000] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-28T18:14:13.350721] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:14:13.350809] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:14:13.350863] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:14:13.350933] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-28T18:14:13.350996] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-28T18:14:13.351031] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-28T18:14:13.351196] [DEBUG] [LOCAL ] DAN: Deleted derivative data file. [2025-10-28T18:14:13.351288] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAN took 45.8s. Estimated remaining: 3h 43m 47s. Rate: 7.9 symbols/min [2025-10-28T18:14:13.522334] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:13.522516] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-28T18:14:13.522552] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-28T18:14:13.522679] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-28T18:14:13.522732] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-28T18:14:13.522774] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-28T18:14:13.522805] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-28T18:14:13.565015] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-28T18:14:13.883988] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:14.158597] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:14:14.169160] [INFO ] [REMOTE ] DAVA: Full fetch complete (57475 records). [2025-10-28T18:14:14.169340] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-28T18:14:14.369443] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-28T18:14:14.549724] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-28T18:14:14.549821] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-28T18:14:14.550508] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-28T18:14:14.550547] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-28T18:14:14.551705] [DEBUG] [LOCAL ] DAVA: Trimmed 57475 records to 41936 (keeping 200 days of data) [2025-10-28T18:14:14.786507] [DEBUG] [LOCAL ] DAVA: Primary data saved (41936 records). [2025-10-28T18:14:14.786625] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-28T18:14:14.786750] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DAVA took 25.5s. Estimated remaining: 3h 43m 21s. Rate: 8.0 symbols/min [2025-10-28T18:14:14.968082] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:15.029613] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:14:15.028050] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:14:15.059125] [DEBUG] [LOCAL ] DBI: Loaded 43009 existing records from primary storage. [2025-10-28T18:14:15.059785] [INFO ] [MAIN ] DBI: Loaded 43009 existing records. [2025-10-28T18:14:15.164460] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-28T18:14:15.248497] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:15.248715] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-28T18:14:15.248769] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-28T18:14:15.249312] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-28T18:14:15.249369] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-28T18:14:15.644394] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:15.959324] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-28T18:14:16.322844] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T18:14:16.759421] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-28T18:14:17.257670] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:14:17.559332] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-28T18:14:18.264257] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T18:14:18.359337] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-28T18:14:18.787134] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T18:14:19.159330] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-28T18:14:19.773232] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:14:19.945080] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T18:14:19.959512] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-28T18:14:20.759380] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-28T18:14:21.021118] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:14:21.559382] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-28T18:14:22.258807] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T18:14:22.366983] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-28T18:14:22.370273] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T18:14:23.159356] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-28T18:14:23.686635] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:14:23.959383] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-28T18:14:24.616017] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T18:14:24.759372] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-28T18:14:25.091840] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:14:25.446784] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:14:25.559336] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-28T18:14:26.359399] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-28T18:14:27.012353] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:14:27.159336] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-28T18:14:27.800834] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:14:27.959321] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-28T18:14:28.097675] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:14:28.759326] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-28T18:14:29.175180] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T18:14:29.559365] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-28T18:14:30.359349] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-28T18:14:30.467917] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:14:30.478312] [INFO ] [REMOTE ] DB: Full fetch complete (75756 records). [2025-10-28T18:14:30.478459] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-28T18:14:30.872724] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-28T18:14:30.872835] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-28T18:14:30.873746] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-28T18:14:30.873915] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-28T18:14:30.875575] [DEBUG] [LOCAL ] DB: Trimmed 75756 records to 52388 (keeping 200 days of data) [2025-10-28T18:14:30.902338] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:14:31.006025] [INFO ] [REMOTE ] DAY: Full fetch complete (71901 records). [2025-10-28T18:14:31.031783] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-28T18:14:31.204675] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-28T18:14:31.231199] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T18:14:31.455320] [DEBUG] [LOCAL ] DB: Primary data saved (52388 records). [2025-10-28T18:14:31.475639] [INFO ] [MAIN ] DB: Full history saved. [2025-10-28T18:14:31.494849] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DB took 29.2s. Estimated remaining: 3h 43m 41s. Rate: 7.9 symbols/min [2025-10-28T18:14:31.897131] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-28T18:14:31.898775] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-28T18:14:31.898697] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:31.899871] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-28T18:14:31.900342] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-28T18:14:31.902943] [DEBUG] [LOCAL ] DAY: Trimmed 71901 records to 49049 (keeping 200 days of data) [2025-10-28T18:14:31.957062] [DEBUG] [LOCAL ] DBL: Loaded 9267 existing records from primary storage. [2025-10-28T18:14:31.965541] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-28T18:14:31.966164] [INFO ] [MAIN ] DBL: Loaded 9267 existing records. [2025-10-28T18:14:32.218833] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:32.237193] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-28T18:14:32.237268] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-28T18:14:32.237719] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-28T18:14:32.237778] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-28T18:14:32.584669] [DEBUG] [LOCAL ] DAY: Primary data saved (49049 records). [2025-10-28T18:14:32.598181] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-28T18:14:32.615953] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DAY took 38.5s. Estimated remaining: 3h 43m 14s. Rate: 7.9 symbols/min [2025-10-28T18:14:32.981002] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:32.992061] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-28T18:14:33.023293] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:33.029799] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T18:14:33.057997] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:14:33.104272] [DEBUG] [LOCAL ] DBRG: Loaded 49964 existing records from primary storage. [2025-10-28T18:14:33.104587] [INFO ] [MAIN ] DBRG: Loaded 49964 existing records. [2025-10-28T18:14:33.277786] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:33.278001] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-28T18:14:33.278047] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-28T18:14:33.278860] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-28T18:14:33.278916] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-28T18:14:33.564477] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-28T18:14:33.635038] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:33.640545] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T18:14:34.359346] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-28T18:14:34.725447] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:14:34.798742] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T18:14:35.159342] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-28T18:14:35.908358] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:14:35.959313] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-28T18:14:36.735907] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T18:14:36.759298] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-28T18:14:37.442183] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T18:14:37.447900] [INFO ] [REMOTE ] DBD: Full fetch complete (32166 records). [2025-10-28T18:14:37.448067] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-28T18:14:37.448614] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:14:37.448870] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:14:37.448938] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:14:37.448988] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-28T18:14:37.449045] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-28T18:14:37.449097] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-28T18:14:37.449138] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-28T18:14:37.449193] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DBD took 24.1s. Estimated remaining: 3h 42m 58s. Rate: 8.0 symbols/min [2025-10-28T18:14:37.564470] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-28T18:14:37.640599] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:37.677380] [DEBUG] [LOCAL ] DCI: Loaded 36620 existing records from primary storage. [2025-10-28T18:14:37.677712] [INFO ] [MAIN ] DCI: Loaded 36620 existing records. [2025-10-28T18:14:37.851914] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:37.852104] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-28T18:14:37.852148] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-28T18:14:37.852491] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-28T18:14:37.852554] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-28T18:14:38.198292] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:38.359320] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-28T18:14:39.018987] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:14:39.159316] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-28T18:14:39.479615] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:14:39.959337] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-28T18:14:40.236094] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:14:40.319534] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:14:40.759341] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-28T18:14:41.559396] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-28T18:14:41.592868] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:14:42.071958] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T18:14:42.359396] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-28T18:14:42.687312] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T18:14:43.159358] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-28T18:14:43.959355] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-28T18:14:44.367794] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:14:44.759355] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-28T18:14:44.949680] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T18:14:45.339941] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T18:14:45.559354] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-28T18:14:46.359335] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-28T18:14:46.710461] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:14:47.159383] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-28T18:14:47.478783] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T18:14:47.959320] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-28T18:14:48.057065] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T18:14:48.509725] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:14:48.759324] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-28T18:14:49.279077] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:14:49.559344] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-28T18:14:50.041589] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T18:14:50.359402] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-28T18:14:51.159354] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-28T18:14:51.464455] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T18:14:51.658571] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T18:14:51.660771] [INFO ] [REMOTE ] DBL: Full fetch complete (12771 records). [2025-10-28T18:14:51.660848] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-28T18:14:51.964551] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-28T18:14:52.038873] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-28T18:14:52.038957] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-28T18:14:52.039277] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-28T18:14:52.039335] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-28T18:14:52.039896] [DEBUG] [LOCAL ] DBL: Trimmed 12771 records to 9211 (keeping 200 days of data) [2025-10-28T18:14:52.093958] [DEBUG] [LOCAL ] DBL: Primary data saved (9211 records). [2025-10-28T18:14:52.094079] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-28T18:14:52.094155] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBL took 20.6s. Estimated remaining: 3h 43m 12s. Rate: 7.9 symbols/min [2025-10-28T18:14:52.261113] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:52.261265] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-28T18:14:52.261300] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-28T18:14:52.261405] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-28T18:14:52.261445] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-28T18:14:52.261486] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-28T18:14:52.261517] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-28T18:14:52.648016] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:52.759349] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-28T18:14:53.359137] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:14:53.559340] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-28T18:14:53.619995] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:14:53.627569] [INFO ] [REMOTE ] DBI: Full fetch complete (64396 records). [2025-10-28T18:14:53.627770] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-28T18:14:54.065631] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-28T18:14:54.065753] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-28T18:14:54.066686] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-28T18:14:54.066757] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-28T18:14:54.068184] [DEBUG] [LOCAL ] DBI: Trimmed 64396 records to 42870 (keeping 200 days of data) [2025-10-28T18:14:54.331882] [DEBUG] [LOCAL ] DBI: Primary data saved (42870 records). [2025-10-28T18:14:54.332034] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-28T18:14:54.332119] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DBI took 39.5s. Estimated remaining: 3h 42m 48s. Rate: 7.9 symbols/min [2025-10-28T18:14:54.364310] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-28T18:14:54.510847] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:54.537667] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T18:14:54.588184] [DEBUG] [LOCAL ] DD: Loaded 52906 existing records from primary storage. [2025-10-28T18:14:54.588552] [INFO ] [MAIN ] DD: Loaded 52906 existing records. [2025-10-28T18:14:54.761743] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:54.761953] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-28T18:14:54.762000] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-28T18:14:54.763126] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-28T18:14:54.763183] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-28T18:14:55.098684] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:14:55.153330] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:55.159294] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-28T18:14:55.959354] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-28T18:14:56.668392] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:14:56.759337] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-28T18:14:57.034134] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:14:57.559346] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-28T18:14:58.076664] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:14:58.191431] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:14:58.359329] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-28T18:14:58.853489] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:14:59.159330] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-28T18:14:59.731388] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T18:14:59.959337] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-28T18:15:00.684294] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T18:15:00.759403] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-28T18:15:01.559340] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-28T18:15:02.328018] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:15:02.359328] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-28T18:15:03.165789] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-28T18:15:03.181229] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T18:15:03.959306] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-28T18:15:04.172396] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-28T18:15:04.759295] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-28T18:15:04.908783] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-28T18:15:05.119688] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:15:05.126291] [INFO ] [REMOTE ] DCI: Full fetch complete (53527 records). [2025-10-28T18:15:05.126372] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-28T18:15:05.127033] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:15:05.127114] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:15:05.127157] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:15:05.127193] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-28T18:15:05.127246] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-28T18:15:05.127280] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-28T18:15:05.127469] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-28T18:15:05.127554] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCI took 27.7s. Estimated remaining: 3h 42m 50s. Rate: 7.9 symbols/min [2025-10-28T18:15:05.295723] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:05.340437] [DEBUG] [LOCAL ] DDD: Loaded 50909 existing records from primary storage. [2025-10-28T18:15:05.340747] [INFO ] [MAIN ] DDD: Loaded 50909 existing records. [2025-10-28T18:15:05.517453] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:05.517632] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-28T18:15:05.517713] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-28T18:15:05.518449] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-28T18:15:05.518506] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-28T18:15:05.564516] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-28T18:15:05.878043] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:06.363404] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-28T18:15:06.371754] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:15:06.413927] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T18:15:07.159397] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-28T18:15:07.934669] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T18:15:07.959321] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-28T18:15:08.661102] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:15:08.759389] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-28T18:15:09.230997] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:15:09.559332] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-28T18:15:10.036784] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:15:10.192190] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T18:15:10.359357] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-28T18:15:11.114952] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T18:15:11.159301] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-28T18:15:11.959316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-28T18:15:12.057178] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T18:15:12.061095] [INFO ] [REMOTE ] DCO: Full fetch complete (19793 records). [2025-10-28T18:15:12.061175] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-28T18:15:12.061598] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:15:12.061740] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:15:12.061820] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:15:12.061906] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-28T18:15:12.061983] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-28T18:15:12.062034] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-28T18:15:12.062089] [DEBUG] [LOCAL ] DCO: No derivative data file found to delete. [2025-10-28T18:15:12.062165] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DCO took 20.0s. Estimated remaining: 3h 42m 41s. Rate: 7.9 symbols/min [2025-10-28T18:15:12.759339] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-28T18:15:13.362187] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T18:15:13.559315] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-28T18:15:14.155613] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:15:14.359343] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-28T18:15:15.126513] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T18:15:15.159293] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-28T18:15:15.811607] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T18:15:15.959382] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-28T18:15:16.615672] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:15:16.759382] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-28T18:15:17.362001] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:15:17.559335] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-28T18:15:18.359394] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-28T18:15:18.408161] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T18:15:19.094886] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T18:15:19.159314] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-28T18:15:19.506385] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T18:15:19.959355] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-28T18:15:20.623692] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T18:15:20.759334] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-28T18:15:21.292713] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:15:21.411841] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:15:21.422459] [INFO ] [REMOTE ] DD: Full fetch complete (76624 records). [2025-10-28T18:15:21.422602] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-28T18:15:21.566838] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-28T18:15:21.820100] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-28T18:15:21.820182] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-28T18:15:21.821034] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-28T18:15:21.821096] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-28T18:15:21.822491] [DEBUG] [LOCAL ] DD: Trimmed 76624 records to 52906 (keeping 200 days of data) [2025-10-28T18:15:22.144629] [DEBUG] [LOCAL ] DD: Primary data saved (52906 records). [2025-10-28T18:15:22.144802] [INFO ] [MAIN ] DD: Full history saved. [2025-10-28T18:15:22.144881] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DD took 27.8s. Estimated remaining: 3h 42m 41s. Rate: 7.9 symbols/min [2025-10-28T18:15:22.359355] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-28T18:15:22.765530] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:15:23.159403] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-28T18:15:23.708812] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:15:23.959335] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-28T18:15:24.601090] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:15:24.611225] [INFO ] [REMOTE ] DBRG: Full fetch complete (72667 records). [2025-10-28T18:15:24.611337] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-28T18:15:24.991581] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-28T18:15:24.991680] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-28T18:15:24.992508] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-28T18:15:24.992548] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-28T18:15:24.994019] [DEBUG] [LOCAL ] DBRG: Trimmed 72667 records to 49956 (keeping 200 days of data) [2025-10-28T18:15:25.293466] [DEBUG] [LOCAL ] DBRG: Primary data saved (49956 records). [2025-10-28T18:15:25.293584] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-28T18:15:25.293691] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DBRG took 52.7s. Estimated remaining: 3h 42m 20s. Rate: 7.9 symbols/min [2025-10-28T18:15:25.390975] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T18:15:25.402535] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-28T18:15:26.888195] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T18:15:26.898815] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-28T18:15:28.152284] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:15:28.163183] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-28T18:15:29.803737] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:15:29.814529] [INFO ] [REMOTE ] DDD: Full fetch complete (74029 records). [2025-10-28T18:15:29.814733] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-28T18:15:30.255501] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-28T18:15:30.255598] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-28T18:15:30.256597] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-28T18:15:30.256710] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-28T18:15:30.258352] [DEBUG] [LOCAL ] DDD: Trimmed 74029 records to 50922 (keeping 200 days of data) [2025-10-28T18:15:30.538462] [DEBUG] [LOCAL ] DDD: Primary data saved (50922 records). [2025-10-28T18:15:30.538603] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-28T18:15:30.538720] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDD took 25.4s. Estimated remaining: 3h 42m 6s. Rate: 8.0 symbols/min [2025-10-28T18:15:31.149224] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.259945] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.260876] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.292605] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.293377] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-10-28T18:15:31.293561] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-10-28T18:15:31.293813] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-28T18:15:31.293903] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-28T18:15:31.294042] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-28T18:15:31.294101] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-28T18:15:31.381282] [DEBUG] [LOCAL ] DDT: Loaded 1794 existing records from primary storage. [2025-10-28T18:15:31.412440] [DEBUG] [LOCAL ] DDS: Loaded 11957 existing records from primary storage. [2025-10-28T18:15:31.412122] [INFO ] [MAIN ] DDT: Loaded 1794 existing records. [2025-10-28T18:15:31.412715] [INFO ] [MAIN ] DDS: Loaded 11957 existing records. [2025-10-28T18:15:31.868555] [DEBUG] [LOCAL ] DE: Loaded 47383 existing records from primary storage. [2025-10-28T18:15:31.959715] [INFO ] [MAIN ] DE: Loaded 47383 existing records. [2025-10-28T18:15:31.954327] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:31.979125] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-28T18:15:32.004543] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-28T18:15:32.054490] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-28T18:15:32.120788] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:32.141596] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-28T18:15:32.183845] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-28T18:15:32.256839] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:32.277265] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-28T18:15:32.262179] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-28T18:15:32.326526] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-28T18:15:32.335355] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-28T18:15:32.580782] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:32.640818] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-28T18:15:32.675920] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-28T18:15:32.750669] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-28T18:15:32.817997] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-28T18:15:33.261293] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:33.310616] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-28T18:15:33.295012] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:33.361818] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-28T18:15:33.492048] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:33.492517] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-28T18:15:33.512737] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:15:33.519569] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-28T18:15:33.834052] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T18:15:33.835100] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-28T18:15:34.094660] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T18:15:34.097595] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-28T18:15:34.217134] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:15:34.218258] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-28T18:15:34.365871] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T18:15:34.374615] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-28T18:15:34.520433] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T18:15:34.521604] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-28T18:15:34.719590] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T18:15:34.905381] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:15:35.021151] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T18:15:35.159390] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-28T18:15:35.280735] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:15:35.899811] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:15:35.959303] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-28T18:15:36.713117] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:15:36.759310] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-28T18:15:37.373981] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T18:15:37.559332] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-28T18:15:38.359352] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-28T18:15:38.812320] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:15:39.159333] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-28T18:15:39.459249] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T18:15:39.842781] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T18:15:39.959374] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-28T18:15:40.255477] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T18:15:40.759389] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-28T18:15:41.333215] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T18:15:41.559341] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-28T18:15:41.919274] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T18:15:42.359339] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-28T18:15:42.658757] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T18:15:43.159362] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-28T18:15:43.444475] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:15:43.959366] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-28T18:15:44.452047] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:15:44.452936] [INFO ] [REMOTE ] DDT: Full fetch complete (2817 records). [2025-10-28T18:15:44.453003] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-28T18:15:44.767745] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-28T18:15:44.809378] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-28T18:15:44.809469] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-28T18:15:44.809596] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-28T18:15:44.809637] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-28T18:15:44.810074] [DEBUG] [LOCAL ] DDT: Trimmed 2817 records to 1781 (keeping 200 days of data) [2025-10-28T18:15:44.821572] [DEBUG] [LOCAL ] DDT: Primary data saved (1781 records). [2025-10-28T18:15:44.821712] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-28T18:15:44.821801] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 14.3s. Estimated remaining: 3h 42m 18s. Rate: 7.9 symbols/min [2025-10-28T18:15:45.001763] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:45.037322] [DEBUG] [LOCAL ] DEA: Loaded 39763 existing records from primary storage. [2025-10-28T18:15:45.037603] [INFO ] [MAIN ] DEA: Loaded 39763 existing records. [2025-10-28T18:15:45.216999] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:45.217239] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-28T18:15:45.217321] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-28T18:15:45.218143] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-28T18:15:45.218218] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-28T18:15:45.567924] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-28T18:15:45.567855] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:46.113922] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:15:46.335156] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T18:15:46.359302] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-28T18:15:47.159358] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-28T18:15:47.949894] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:15:47.963290] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-28T18:15:48.051295] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T18:15:48.759336] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-28T18:15:49.176603] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:15:49.559302] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-28T18:15:49.626093] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:15:50.135905] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:15:50.359338] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-28T18:15:50.880476] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:15:51.159344] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-28T18:15:51.874147] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:15:51.876285] [INFO ] [REMOTE ] DDS: Full fetch complete (18200 records). [2025-10-28T18:15:51.876365] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-28T18:15:51.964635] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-28T18:15:52.255714] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-28T18:15:52.255799] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-28T18:15:52.256221] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-28T18:15:52.256261] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-28T18:15:52.256844] [DEBUG] [LOCAL ] DDS: Trimmed 18200 records to 11887 (keeping 200 days of data) [2025-10-28T18:15:52.332775] [DEBUG] [LOCAL ] DDS: Primary data saved (11887 records). [2025-10-28T18:15:52.332909] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-28T18:15:52.332993] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DDS took 21.8s. Estimated remaining: 3h 42m 11s. Rate: 7.9 symbols/min [2025-10-28T18:15:52.506373] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:52.533990] [DEBUG] [LOCAL ] DEC: Loaded 29884 existing records from primary storage. [2025-10-28T18:15:52.534297] [INFO ] [MAIN ] DEC: Loaded 29884 existing records. [2025-10-28T18:15:52.725672] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:52.725946] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-28T18:15:52.726001] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-28T18:15:52.726746] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-28T18:15:52.726805] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-28T18:15:52.764533] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-28T18:15:53.094385] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:53.559339] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-28T18:15:53.640864] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T18:15:53.930204] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T18:15:54.359357] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-28T18:15:54.468347] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:15:55.159345] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-28T18:15:55.780328] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:15:55.959341] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-28T18:15:56.546938] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:15:56.759362] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-28T18:15:57.142809] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:15:57.559344] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-28T18:15:57.812805] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:15:58.367204] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-28T18:15:58.382267] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T18:15:59.159316] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-28T18:15:59.959328] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-28T18:16:00.055136] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T18:16:00.219865] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:16:00.228448] [INFO ] [REMOTE ] DDL: Full fetch complete (53871 records). [2025-10-28T18:16:00.228580] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-28T18:16:00.601913] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-28T18:16:00.601988] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-28T18:16:00.602715] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-28T18:16:00.602777] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-28T18:16:00.603873] [DEBUG] [LOCAL ] DDL: Trimmed 53871 records to 37084 (keeping 200 days of data) [2025-10-28T18:16:00.778778] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-28T18:16:00.806408] [DEBUG] [LOCAL ] DDL: Primary data saved (37084 records). [2025-10-28T18:16:00.806522] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-28T18:16:00.806592] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DDL took 30.3s. Estimated remaining: 3h 42m 6s. Rate: 7.9 symbols/min [2025-10-28T18:16:00.986038] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:00.986265] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-28T18:16:00.986323] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-28T18:16:00.986450] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-28T18:16:00.986492] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-28T18:16:00.986533] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-28T18:16:00.986566] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-28T18:16:01.369463] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:01.371748] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:16:01.559320] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-28T18:16:02.359317] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-28T18:16:02.441483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T18:16:02.954404] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:16:03.159352] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-28T18:16:03.522935] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:16:03.959337] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-28T18:16:04.759321] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-28T18:16:04.818286] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T18:16:05.553575] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T18:16:05.563402] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-28T18:16:06.171100] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:16:06.359388] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-28T18:16:06.750096] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:16:07.159407] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-28T18:16:07.908345] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:16:07.918531] [INFO ] [REMOTE ] DE: Full fetch complete (69902 records). [2025-10-28T18:16:07.918746] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-28T18:16:07.965369] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-28T18:16:08.328711] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-28T18:16:08.328902] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-28T18:16:08.329735] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-28T18:16:08.329813] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-28T18:16:08.353918] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:16:08.354076] [DEBUG] [LOCAL ] DE: Trimmed 69902 records to 47337 (keeping 200 days of data) [2025-10-28T18:16:08.651590] [DEBUG] [LOCAL ] DE: Primary data saved (47337 records). [2025-10-28T18:16:08.651739] [INFO ] [MAIN ] DE: Full history saved. [2025-10-28T18:16:08.651821] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DE took 38.1s. Estimated remaining: 3h 41m 59s. Rate: 7.9 symbols/min [2025-10-28T18:16:08.760451] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-28T18:16:08.832501] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:08.874701] [DEBUG] [LOCAL ] DEI: Loaded 48162 existing records from primary storage. [2025-10-28T18:16:08.875004] [INFO ] [MAIN ] DEI: Loaded 48162 existing records. [2025-10-28T18:16:09.056786] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:09.057021] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-28T18:16:09.057071] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-28T18:16:09.058030] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-28T18:16:09.058090] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-28T18:16:09.414022] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:09.560957] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-28T18:16:09.563884] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T18:16:09.727015] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T18:16:10.359396] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-28T18:16:10.613908] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:16:11.159405] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-28T18:16:11.815314] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T18:16:11.959382] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-28T18:16:12.375254] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T18:16:12.759379] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-28T18:16:13.559381] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-28T18:16:13.627485] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T18:16:13.970327] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T18:16:14.359348] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-28T18:16:14.596231] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:16:15.159404] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-28T18:16:15.959332] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-28T18:16:15.992068] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T18:16:16.569421] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:16:16.759403] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-28T18:16:16.939618] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T18:16:17.559352] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-28T18:16:17.875218] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:16:18.359334] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-28T18:16:18.888181] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:16:19.159331] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-28T18:16:19.959336] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-28T18:16:20.033091] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T18:16:20.507005] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:16:20.759306] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-28T18:16:20.847373] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:16:21.559377] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-28T18:16:21.889754] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:16:22.359343] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-28T18:16:22.944301] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T18:16:23.159346] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-28T18:16:23.959313] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-28T18:16:24.015478] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T18:16:24.496273] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T18:16:24.759321] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-28T18:16:24.795763] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T18:16:25.559333] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-28T18:16:26.368423] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-28T18:16:26.375443] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T18:16:26.434969] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T18:16:27.159336] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-28T18:16:27.959356] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-28T18:16:28.109593] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T18:16:28.759426] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-28T18:16:29.003737] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T18:16:29.010293] [INFO ] [REMOTE ] DEC: Full fetch complete (44464 records). [2025-10-28T18:16:29.010434] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-28T18:16:29.011119] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:16:29.011205] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:16:29.011271] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:16:29.011344] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-28T18:16:29.011407] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-28T18:16:29.011443] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-28T18:16:29.011684] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-10-28T18:16:29.011798] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DEC took 36.7s. Estimated remaining: 3h 42m 29s. Rate: 7.9 symbols/min [2025-10-28T18:16:29.188078] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:29.240308] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:16:29.267253] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-28T18:16:29.267575] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-28T18:16:29.438172] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:29.438376] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-28T18:16:29.438423] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-28T18:16:29.439407] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-28T18:16:29.439465] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-28T18:16:29.574409] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-28T18:16:29.791409] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:30.359393] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-28T18:16:30.818836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-28T18:16:30.829487] [INFO ] [REMOTE ] DECK: Full fetch complete (77237 records). [2025-10-28T18:16:30.829617] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-28T18:16:31.161433] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-28T18:16:31.237574] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-28T18:16:31.238132] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-28T18:16:31.239033] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-28T18:16:31.248005] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-28T18:16:31.266667] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T18:16:31.270265] [DEBUG] [LOCAL ] DECK: Trimmed 77237 records to 53302 (keeping 200 days of data) [2025-10-28T18:16:31.277163] [INFO ] [REMOTE ] DEI: Full fetch complete (69894 records). [2025-10-28T18:16:31.277257] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-28T18:16:31.971537] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-28T18:16:31.989745] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-28T18:16:31.991061] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-28T18:16:31.991143] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-28T18:16:32.012524] [DEBUG] [LOCAL ] DEI: Trimmed 69894 records to 48147 (keeping 200 days of data) [2025-10-28T18:16:32.015068] [DEBUG] [LOCAL ] DECK: Primary data saved (53302 records). [2025-10-28T18:16:32.015540] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-28T18:16:32.015684] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DECK took 31.2s. Estimated remaining: 3h 42m 8s. Rate: 7.9 symbols/min [2025-10-28T18:16:32.291791] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:32.494944] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-28T18:16:32.509083] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-28T18:16:32.508366] [DEBUG] [LOCAL ] DEO: Loaded 49158 existing records from primary storage. [2025-10-28T18:16:32.513333] [INFO ] [MAIN ] DEO: Loaded 49158 existing records. [2025-10-28T18:16:32.702233] [DEBUG] [LOCAL ] DEI: Primary data saved (48147 records). [2025-10-28T18:16:32.715325] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-28T18:16:32.725904] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DEI took 24.1s. Estimated remaining: 3h 41m 40s. Rate: 7.9 symbols/min [2025-10-28T18:16:32.755958] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:32.767111] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-28T18:16:32.767196] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-28T18:16:32.872214] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-28T18:16:32.880016] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-28T18:16:32.890899] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T18:16:32.962444] [INFO ] [REMOTE ] DEA: Full fetch complete (61469 records). [2025-10-28T18:16:32.999964] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-28T18:16:33.149016] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:33.609576] [DEBUG] [LOCAL ] DFH: Loaded 31185 existing records from primary storage. [2025-10-28T18:16:33.647893] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:33.670105] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-28T18:16:33.670342] [INFO ] [MAIN ] DFH: Loaded 31185 existing records. [2025-10-28T18:16:33.872239] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-28T18:16:33.872339] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-28T18:16:33.873166] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-28T18:16:33.873551] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-28T18:16:33.924360] [DEBUG] [LOCAL ] DEA: Trimmed 61469 records to 39679 (keeping 200 days of data) [2025-10-28T18:16:33.954000] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:33.954473] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-28T18:16:33.954525] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-28T18:16:33.954959] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-28T18:16:33.955019] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-28T18:16:34.440636] [DEBUG] [LOCAL ] DEA: Primary data saved (39679 records). [2025-10-28T18:16:34.467717] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-28T18:16:34.479293] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEA took 49.7s. Estimated remaining: 3h 41m 16s. Rate: 7.9 symbols/min [2025-10-28T18:16:34.678347] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:34.682297] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-28T18:16:34.754462] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:34.782330] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-28T18:16:34.800356] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-28T18:16:34.810104] [DEBUG] [LOCAL ] DFIN: Loaded 22124 existing records from primary storage. [2025-10-28T18:16:34.810315] [INFO ] [MAIN ] DFIN: Loaded 22124 existing records. [2025-10-28T18:16:34.984034] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:34.984221] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-28T18:16:34.984267] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-28T18:16:34.984701] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-28T18:16:34.984758] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-28T18:16:35.376878] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:35.377289] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-28T18:16:35.408413] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T18:16:35.660618] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T18:16:35.959331] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-28T18:16:36.284163] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:16:36.725627] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T18:16:36.759300] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-28T18:16:37.237179] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:16:37.559338] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-28T18:16:38.359423] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-28T18:16:38.661411] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-28T18:16:39.032258] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T18:16:39.055625] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:16:39.159336] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-28T18:16:39.960870] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-28T18:16:40.705871] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T18:16:40.759407] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-28T18:16:41.559346] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-28T18:16:41.653670] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T18:16:41.947688] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:16:42.359359] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-28T18:16:42.599305] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:16:43.159331] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-28T18:16:43.183525] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T18:16:43.959330] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-28T18:16:44.759385] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-28T18:16:45.048667] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:16:45.147357] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-28T18:16:45.559346] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-28T18:16:46.348539] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T18:16:46.359290] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-28T18:16:46.391815] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T18:16:47.159352] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-28T18:16:47.448965] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T18:16:47.896771] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:16:47.959317] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-28T18:16:48.685145] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:16:48.759371] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-28T18:16:49.559336] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-28T18:16:50.359352] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-28T18:16:50.684695] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-28T18:16:51.086310] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:16:51.159339] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-28T18:16:51.500171] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T18:16:51.959351] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-28T18:16:52.759301] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-28T18:16:52.978121] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-28T18:16:53.512268] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:16:53.559318] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-28T18:16:53.619211] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T18:16:54.307996] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:16:54.359334] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-28T18:16:55.159333] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-28T18:16:55.959339] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-28T18:16:56.238090] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-28T18:16:56.334883] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:16:56.339293] [INFO ] [REMOTE ] DFIN: Full fetch complete (33359 records). [2025-10-28T18:16:56.339456] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-28T18:16:56.340143] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:16:56.340242] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:16:56.340329] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:16:56.340424] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-28T18:16:56.340512] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-28T18:16:56.340552] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-10-28T18:16:56.340746] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-10-28T18:16:56.340839] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFIN took 21.9s. Estimated remaining: 3h 41m 50s. Rate: 7.9 symbols/min [2025-10-28T18:16:56.512334] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:56.523443] [DEBUG] [LOCAL ] DFP: Loaded 10752 existing records from primary storage. [2025-10-28T18:16:56.523688] [INFO ] [MAIN ] DFP: Loaded 10752 existing records. [2025-10-28T18:16:56.705758] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:56.706012] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-28T18:16:56.706065] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-28T18:16:56.706326] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-28T18:16:56.706365] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-28T18:16:56.768573] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-28T18:16:57.076475] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:57.559333] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-28T18:16:57.849332] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:16:57.909112] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-28T18:16:58.359349] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-28T18:16:58.928872] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T18:16:59.159306] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-28T18:16:59.370006] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T18:16:59.380172] [INFO ] [REMOTE ] DEO: Full fetch complete (71731 records). [2025-10-28T18:16:59.380297] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-28T18:16:59.777591] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T18:16:59.801228] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-28T18:16:59.801283] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-28T18:16:59.802075] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-28T18:16:59.802135] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-28T18:16:59.803340] [DEBUG] [LOCAL ] DEO: Trimmed 71731 records to 49131 (keeping 200 days of data) [2025-10-28T18:16:59.980726] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-28T18:17:00.108335] [DEBUG] [LOCAL ] DEO: Primary data saved (49131 records). [2025-10-28T18:17:00.108485] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-28T18:17:00.109380] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DEO took 28.1s. Estimated remaining: 3h 41m 31s. Rate: 7.9 symbols/min [2025-10-28T18:17:00.280359] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:00.333412] [DEBUG] [LOCAL ] DG: Loaded 53220 existing records from primary storage. [2025-10-28T18:17:00.333733] [INFO ] [MAIN ] DG: Loaded 53220 existing records. [2025-10-28T18:17:00.510052] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:00.510268] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-28T18:17:00.510315] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-28T18:17:00.510865] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-28T18:17:00.510922] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-28T18:17:00.764496] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-28T18:17:00.874712] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:01.559353] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-28T18:17:01.962771] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T18:17:02.089222] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T18:17:02.187687] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-28T18:17:02.198854] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-28T18:17:02.199072] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-28T18:17:02.199998] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:17:02.200099] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:17:02.200143] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:17:02.200186] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-28T18:17:02.200251] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-28T18:17:02.200288] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-28T18:17:02.200550] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-28T18:17:02.200703] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DELL took 33.2s. Estimated remaining: 3h 41m 8s. Rate: 7.9 symbols/min [2025-10-28T18:17:02.364986] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-28T18:17:02.396663] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:02.445195] [DEBUG] [LOCAL ] DGX: Loaded 44445 existing records from primary storage. [2025-10-28T18:17:02.445596] [INFO ] [MAIN ] DGX: Loaded 44445 existing records. [2025-10-28T18:17:02.633737] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:02.634098] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-28T18:17:02.634156] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-28T18:17:02.634502] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-28T18:17:02.634597] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-28T18:17:03.069397] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:03.159359] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-28T18:17:03.959349] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-28T18:17:04.082009] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T18:17:04.156140] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:17:04.395342] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T18:17:04.759338] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-28T18:17:05.559364] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-28T18:17:05.841017] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:17:06.130170] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T18:17:06.359355] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-28T18:17:07.159317] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-28T18:17:07.556740] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:17:07.959381] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-28T18:17:08.527722] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T18:17:08.759363] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-28T18:17:09.369297] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T18:17:09.514610] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T18:17:09.559356] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-28T18:17:10.126605] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T18:17:10.359315] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-28T18:17:11.159346] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-28T18:17:11.685779] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T18:17:11.687552] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T18:17:11.959338] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-28T18:17:12.759351] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-28T18:17:13.286909] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T18:17:13.352435] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:17:13.559332] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-28T18:17:14.134989] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T18:17:14.140161] [INFO ] [REMOTE ] DFP: Full fetch complete (15802 records). [2025-10-28T18:17:14.140282] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-28T18:17:14.364528] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-28T18:17:14.504034] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-28T18:17:14.504115] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-28T18:17:14.504501] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-28T18:17:14.504541] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-28T18:17:14.505102] [DEBUG] [LOCAL ] DFP: Trimmed 15802 records to 10701 (keeping 200 days of data) [2025-10-28T18:17:14.568182] [DEBUG] [LOCAL ] DFP: Primary data saved (10701 records). [2025-10-28T18:17:14.568303] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-28T18:17:14.568382] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DFP took 18.2s. Estimated remaining: 3h 41m 14s. Rate: 7.9 symbols/min [2025-10-28T18:17:14.741376] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:14.759465] [DEBUG] [LOCAL ] DHF: Loaded 20579 existing records from primary storage. [2025-10-28T18:17:14.759712] [INFO ] [MAIN ] DHF: Loaded 20579 existing records. [2025-10-28T18:17:14.943990] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:14.944184] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-28T18:17:14.944231] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-28T18:17:14.944778] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-28T18:17:14.944837] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-28T18:17:15.167744] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-28T18:17:15.311089] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:15.354390] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T18:17:15.959355] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-28T18:17:16.455124] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:17:16.759361] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-28T18:17:16.886289] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T18:17:16.893176] [INFO ] [REMOTE ] DFH: Full fetch complete (47040 records). [2025-10-28T18:17:16.893329] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-28T18:17:17.307432] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-28T18:17:17.307515] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-28T18:17:17.308148] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-28T18:17:17.308210] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-28T18:17:17.309325] [DEBUG] [LOCAL ] DFH: Trimmed 47040 records to 31085 (keeping 200 days of data) [2025-10-28T18:17:17.504241] [DEBUG] [LOCAL ] DFH: Primary data saved (31085 records). [2025-10-28T18:17:17.504560] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-28T18:17:17.504765] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DFH took 44.8s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-10-28T18:17:17.554634] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T18:17:17.564557] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-28T18:17:17.721834] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:17.722010] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-28T18:17:17.722048] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-28T18:17:17.722155] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-28T18:17:17.722200] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-28T18:17:17.722243] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-28T18:17:17.722276] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-28T18:17:18.083229] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:18.359344] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-28T18:17:19.159289] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-28T18:17:19.528577] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-28T18:17:19.882401] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T18:17:19.916937] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:17:19.959386] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-28T18:17:20.660301] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T18:17:20.759318] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-28T18:17:21.546816] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T18:17:21.559292] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-28T18:17:22.359328] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-28T18:17:23.065082] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T18:17:23.064619] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T18:17:23.159347] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-28T18:17:23.891631] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T18:17:23.959323] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-28T18:17:24.759332] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-28T18:17:25.206615] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:17:25.559359] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-28T18:17:26.359341] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-28T18:17:26.398570] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:17:26.680197] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:17:26.989520] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T18:17:27.159396] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-28T18:17:27.959415] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-28T18:17:28.498718] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T18:17:28.759362] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-28T18:17:28.827338] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T18:17:29.559355] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-28T18:17:30.154188] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:17:30.194093] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:17:30.359329] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-28T18:17:31.159346] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-28T18:17:31.521500] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:17:31.959355] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-28T18:17:32.669263] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:17:32.671176] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:17:32.685859] [INFO ] [REMOTE ] DHF: Full fetch complete (29767 records). [2025-10-28T18:17:32.686039] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-28T18:17:32.686872] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:17:32.686951] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:17:32.687013] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:17:32.687083] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-28T18:17:32.687144] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-28T18:17:32.687195] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-28T18:17:32.687364] [DEBUG] [LOCAL ] DHF: Deleted derivative data file. [2025-10-28T18:17:32.687448] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DHF took 18.1s. Estimated remaining: 3h 41m 8s. Rate: 7.9 symbols/min [2025-10-28T18:17:32.764401] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-28T18:17:32.854544] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:32.905019] [DEBUG] [LOCAL ] DHR: Loaded 53369 existing records from primary storage. [2025-10-28T18:17:32.905336] [INFO ] [MAIN ] DHR: Loaded 53369 existing records. [2025-10-28T18:17:33.082805] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:33.083017] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-28T18:17:33.083063] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-28T18:17:33.083616] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-28T18:17:33.083709] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-28T18:17:33.437310] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:33.559373] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-28T18:17:34.311399] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:17:34.359326] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-28T18:17:34.915037] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:17:35.159341] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-28T18:17:35.691441] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:17:35.959340] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-28T18:17:36.601056] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:17:36.610781] [INFO ] [REMOTE ] DGX: Full fetch complete (65401 records). [2025-10-28T18:17:36.611134] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-28T18:17:36.612467] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:17:36.612586] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:17:36.612633] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:17:36.612722] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-28T18:17:36.612798] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-28T18:17:36.612838] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-28T18:17:36.613059] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-10-28T18:17:36.613177] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DGX took 34.4s. Estimated remaining: 3h 40m 50s. Rate: 7.9 symbols/min [2025-10-28T18:17:36.764588] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-28T18:17:36.832941] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:36.883773] [DEBUG] [LOCAL ] DHT: Loaded 47756 existing records from primary storage. [2025-10-28T18:17:36.884311] [INFO ] [MAIN ] DHT: Loaded 47756 existing records. [2025-10-28T18:17:37.093065] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:37.093335] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-28T18:17:37.093414] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-28T18:17:37.094381] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-28T18:17:37.094442] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-28T18:17:37.474381] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:37.512750] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T18:17:37.559299] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-28T18:17:38.184540] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T18:17:38.359390] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-28T18:17:38.836274] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:17:39.159381] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-28T18:17:39.729004] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:17:39.959403] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-28T18:17:40.423354] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:17:40.759360] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-28T18:17:41.501799] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T18:17:41.559330] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-28T18:17:42.121217] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:17:42.172465] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:17:42.183256] [INFO ] [REMOTE ] DG: Full fetch complete (77274 records). [2025-10-28T18:17:42.183417] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-28T18:17:42.361763] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-28T18:17:42.576603] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-28T18:17:42.576731] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-28T18:17:42.577598] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-28T18:17:42.577696] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-28T18:17:42.579262] [DEBUG] [LOCAL ] DG: Trimmed 77274 records to 53192 (keeping 200 days of data) [2025-10-28T18:17:42.901961] [DEBUG] [LOCAL ] DG: Primary data saved (53192 records). [2025-10-28T18:17:42.902083] [INFO ] [MAIN ] DG: Full history saved. [2025-10-28T18:17:42.902824] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DG took 42.8s. Estimated remaining: 3h 40m 38s. Rate: 7.9 symbols/min [2025-10-28T18:17:43.069118] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:43.084140] [DEBUG] [LOCAL ] DHX: Loaded 13037 existing records from primary storage. [2025-10-28T18:17:43.084414] [INFO ] [MAIN ] DHX: Loaded 13037 existing records. [2025-10-28T18:17:43.164487] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-28T18:17:43.260799] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:43.261031] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-28T18:17:43.261092] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-28T18:17:43.261413] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-28T18:17:43.261471] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-28T18:17:43.636732] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:43.673167] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:17:43.959370] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-28T18:17:44.767875] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-28T18:17:44.772454] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T18:17:45.283607] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T18:17:45.421409] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T18:17:45.559307] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-28T18:17:46.316585] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:17:46.359300] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-28T18:17:46.987332] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:17:47.159362] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-28T18:17:47.793745] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T18:17:47.959335] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-28T18:17:48.759384] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-28T18:17:49.071881] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T18:17:49.559323] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-28T18:17:50.033703] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:17:50.359330] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-28T18:17:50.945247] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T18:17:51.128246] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:17:51.159299] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-28T18:17:51.654233] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T18:17:51.959367] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-28T18:17:52.759346] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-28T18:17:53.162145] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:17:53.559324] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-28T18:17:54.198542] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T18:17:54.359332] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-28T18:17:54.775421] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T18:17:54.905760] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:17:55.159332] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-28T18:17:55.959341] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-28T18:17:56.759309] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-28T18:17:56.993671] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-28T18:17:57.195162] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:17:57.559332] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-28T18:17:58.359347] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-28T18:17:58.641563] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-28T18:17:58.689519] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T18:17:59.159320] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-28T18:17:59.661715] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T18:17:59.772816] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T18:17:59.959333] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-28T18:18:00.759402] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-28T18:18:01.559317] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-28T18:18:01.963061] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-28T18:18:02.359306] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-28T18:18:02.433987] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T18:18:02.693159] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:18:03.159344] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-28T18:18:03.904262] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T18:18:03.909094] [INFO ] [REMOTE ] DHX: Full fetch complete (21490 records). [2025-10-28T18:18:03.909194] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-28T18:18:03.971421] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-28T18:18:04.285150] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-28T18:18:04.285345] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-28T18:18:04.285921] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-28T18:18:04.286000] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-28T18:18:04.286739] [DEBUG] [LOCAL ] DHX: Trimmed 21490 records to 13052 (keeping 200 days of data) [2025-10-28T18:18:04.385828] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-28T18:18:04.401016] [DEBUG] [LOCAL ] DHX: Primary data saved (13052 records). [2025-10-28T18:18:04.401460] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-28T18:18:04.401559] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHX took 21.5s. Estimated remaining: 3h 41m 10s. Rate: 7.9 symbols/min [2025-10-28T18:18:04.582855] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:04.583093] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-28T18:18:04.583265] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-28T18:18:04.583691] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-28T18:18:04.583837] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-28T18:18:04.583917] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-28T18:18:04.583971] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-28T18:18:04.769121] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-28T18:18:04.882791] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:18:04.914905] [INFO ] [REMOTE ] DHR: Full fetch complete (77438 records). [2025-10-28T18:18:04.925232] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-28T18:18:05.078917] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:05.363343] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-28T18:18:05.363410] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-28T18:18:05.364256] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-28T18:18:05.364321] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-28T18:18:05.365670] [DEBUG] [LOCAL ] DHR: Trimmed 77438 records to 53365 (keeping 200 days of data) [2025-10-28T18:18:05.574459] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-28T18:18:05.691174] [DEBUG] [LOCAL ] DHR: Primary data saved (53365 records). [2025-10-28T18:18:05.691298] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-28T18:18:05.691904] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHR took 33.0s. Estimated remaining: 3h 40m 45s. Rate: 7.9 symbols/min [2025-10-28T18:18:05.857785] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:05.891591] [DEBUG] [LOCAL ] DIN: Loaded 36358 existing records from primary storage. [2025-10-28T18:18:05.891881] [INFO ] [MAIN ] DIN: Loaded 36358 existing records. [2025-10-28T18:18:06.068319] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:06.068568] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-28T18:18:06.068733] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-28T18:18:06.069478] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-28T18:18:06.069538] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-28T18:18:06.182016] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:18:06.280636] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T18:18:06.364442] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-28T18:18:06.481256] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:07.159415] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-28T18:18:07.670610] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T18:18:07.959355] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-28T18:18:08.113452] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T18:18:08.124100] [INFO ] [REMOTE ] DHI: Full fetch complete (77408 records). [2025-10-28T18:18:08.124213] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-28T18:18:08.506487] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-28T18:18:08.506577] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-28T18:18:08.507436] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-28T18:18:08.507497] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-28T18:18:08.508886] [DEBUG] [LOCAL ] DHI: Trimmed 77408 records to 53348 (keeping 200 days of data) [2025-10-28T18:18:08.780973] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-28T18:18:08.827106] [DEBUG] [LOCAL ] DHI: Primary data saved (53348 records). [2025-10-28T18:18:08.827252] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-28T18:18:08.827342] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DHI took 51.3s. Estimated remaining: 3h 40m 25s. Rate: 7.9 symbols/min [2025-10-28T18:18:08.996300] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:09.041354] [DEBUG] [LOCAL ] DINO: Loaded 52788 existing records from primary storage. [2025-10-28T18:18:09.041636] [INFO ] [MAIN ] DINO: Loaded 52788 existing records. [2025-10-28T18:18:09.217251] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:09.217419] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-28T18:18:09.217491] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-28T18:18:09.218545] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-28T18:18:09.218603] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-28T18:18:09.570005] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-28T18:18:09.580395] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:09.582340] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T18:18:09.613538] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T18:18:09.623371] [INFO ] [REMOTE ] DHT: Full fetch complete (70328 records). [2025-10-28T18:18:09.623478] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-28T18:18:10.004739] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-28T18:18:10.004820] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-28T18:18:10.005596] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-28T18:18:10.005636] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-28T18:18:10.006969] [DEBUG] [LOCAL ] DHT: Trimmed 70328 records to 47743 (keeping 200 days of data) [2025-10-28T18:18:10.280901] [DEBUG] [LOCAL ] DHT: Primary data saved (47743 records). [2025-10-28T18:18:10.281022] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-28T18:18:10.281098] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DHT took 33.7s. Estimated remaining: 3h 40m 0s. Rate: 7.9 symbols/min [2025-10-28T18:18:10.364526] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-28T18:18:10.449662] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:10.497505] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-28T18:18:10.497815] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-28T18:18:10.679829] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:10.680024] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-28T18:18:10.680078] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-28T18:18:10.681075] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-28T18:18:10.681134] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-28T18:18:11.039602] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:11.049721] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:18:11.075198] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:18:11.159307] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-28T18:18:11.959379] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-28T18:18:12.759351] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-28T18:18:13.013152] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:18:13.559304] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-28T18:18:13.729024] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-28T18:18:14.116799] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:18:14.198887] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:18:14.359315] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-28T18:18:14.840141] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T18:18:15.159319] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-28T18:18:15.959570] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-28T18:18:16.367881] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:18:16.636452] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:18:16.759392] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-28T18:18:17.559331] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-28T18:18:17.945741] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T18:18:18.359327] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-28T18:18:18.955558] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T18:18:19.159354] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-28T18:18:19.373883] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-28T18:18:19.959465] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-28T18:18:20.362932] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:18:20.481547] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:18:20.759367] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-28T18:18:21.559338] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-28T18:18:22.093728] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:18:22.359360] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-28T18:18:23.159331] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-28T18:18:23.496488] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T18:18:23.661209] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-28T18:18:23.959331] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-28T18:18:24.759345] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-28T18:18:25.559348] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-28T18:18:26.192571] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:18:26.195879] [INFO ] [REMOTE ] DIAX: Full fetch complete (17676 records). [2025-10-28T18:18:26.196023] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-28T18:18:26.377384] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-10-28T18:18:26.498061] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-28T18:18:26.667035] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-28T18:18:26.667251] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-28T18:18:26.667840] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-28T18:18:26.667905] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-28T18:18:26.668709] [DEBUG] [LOCAL ] DIAX: Trimmed 17676 records to 12223 (keeping 200 days of data) [2025-10-28T18:18:26.750312] [DEBUG] [LOCAL ] DIAX: Primary data saved (12223 records). [2025-10-28T18:18:26.750565] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-28T18:18:26.750709] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DIAX took 22.3s. Estimated remaining: 3h 40m 17s. Rate: 7.9 symbols/min [2025-10-28T18:18:26.934570] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:26.934950] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-28T18:18:26.935005] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-28T18:18:26.935147] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-28T18:18:26.935209] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-28T18:18:26.935312] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-28T18:18:26.935395] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-28T18:18:27.231804] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (3.27 seconds). [2025-10-28T18:18:27.289020] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-28T18:18:27.299362] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-28T18:18:27.389313] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:27.960286] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-28T18:18:27.963156] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T18:18:28.327280] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T18:18:28.362688] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T18:18:28.759351] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-28T18:18:28.993711] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T18:18:29.559334] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-28T18:18:30.359357] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-28T18:18:31.159415] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-28T18:18:31.391964] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:18:31.478936] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T18:18:31.512324] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-28T18:18:31.959354] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-28T18:18:32.759380] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-28T18:18:33.559341] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-28T18:18:33.935555] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-28T18:18:34.037727] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:18:34.359327] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-28T18:18:35.159350] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-28T18:18:35.424492] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-28T18:18:35.458071] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:18:35.466042] [INFO ] [REMOTE ] DIN: Full fetch complete (54321 records). [2025-10-28T18:18:35.466175] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-28T18:18:35.849280] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-28T18:18:35.849369] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-28T18:18:35.850249] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-28T18:18:35.850325] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-28T18:18:35.852024] [DEBUG] [LOCAL ] DIN: Trimmed 54321 records to 36263 (keeping 200 days of data) [2025-10-28T18:18:35.961255] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-28T18:18:36.077733] [DEBUG] [LOCAL ] DIN: Primary data saved (36263 records). [2025-10-28T18:18:36.077874] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-28T18:18:36.077956] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DIN took 30.4s. Estimated remaining: 3h 40m 15s. Rate: 7.9 symbols/min [2025-10-28T18:18:36.243776] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:36.289067] [DEBUG] [LOCAL ] DK: Loaded 49105 existing records from primary storage. [2025-10-28T18:18:36.289380] [INFO ] [MAIN ] DK: Loaded 49105 existing records. [2025-10-28T18:18:36.471847] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:36.472073] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-28T18:18:36.472123] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-28T18:18:36.472683] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-28T18:18:36.472757] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-28T18:18:36.765038] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-28T18:18:36.848150] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:36.878860] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-28T18:18:37.114372] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T18:18:37.559417] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-28T18:18:37.736528] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-28T18:18:38.359339] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-28T18:18:38.963219] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:18:39.159329] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-28T18:18:39.965576] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-28T18:18:39.986078] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T18:18:40.598484] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:18:40.759338] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-28T18:18:41.052254] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T18:18:41.559346] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-28T18:18:42.359316] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-28T18:18:42.677680] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-28T18:18:42.835459] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:18:43.159331] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-28T18:18:43.959308] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-28T18:18:44.036698] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T18:18:44.214348] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T18:18:44.563823] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:18:44.759338] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-28T18:18:45.559322] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-28T18:18:46.359349] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-28T18:18:47.159305] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-28T18:18:47.269900] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-28T18:18:47.281413] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-28T18:18:47.281557] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-28T18:18:47.463940] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T18:18:47.744299] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-28T18:18:47.744393] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-28T18:18:47.745487] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-28T18:18:47.745554] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-28T18:18:47.747171] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-28T18:18:47.974085] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-28T18:18:48.111853] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-28T18:18:48.112023] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-28T18:18:48.112147] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIS took 37.8s. Estimated remaining: 3h 40m 20s. Rate: 7.9 symbols/min [2025-10-28T18:18:48.249871] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:18:48.327462] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:48.327588] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-28T18:18:48.327701] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-28T18:18:48.327813] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-28T18:18:48.327865] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-28T18:18:48.327923] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-28T18:18:48.327982] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-28T18:18:48.699391] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:48.759341] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-28T18:18:49.475220] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T18:18:49.559326] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-28T18:18:50.359332] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-28T18:18:50.401414] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T18:18:50.688823] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T18:18:50.689547] [INFO ] [REMOTE ] DIVY: Full fetch complete (1661 records). [2025-10-28T18:18:50.689613] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-28T18:18:50.865130] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T18:18:50.865359] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:18:50.865425] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:18:50.865492] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-28T18:18:50.865554] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-28T18:18:50.865590] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-28T18:18:50.865629] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-28T18:18:50.865720] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DIVY took 24.1s. Estimated remaining: 3h 39m 59s. Rate: 7.9 symbols/min [2025-10-28T18:18:51.056079] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (5.50 seconds). [2025-10-28T18:18:51.081925] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (4.72 seconds). [2025-10-28T18:18:51.118851] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:51.170915] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-28T18:18:51.173884] [DEBUG] [LOCAL ] DKS: Loaded 49014 existing records from primary storage. [2025-10-28T18:18:51.174204] [INFO ] [MAIN ] DKS: Loaded 49014 existing records. [2025-10-28T18:18:51.362384] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:51.362610] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-28T18:18:51.362690] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-28T18:18:51.363410] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-28T18:18:51.363468] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-28T18:18:51.744419] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:51.959335] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-28T18:18:52.693025] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:18:52.759326] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-28T18:18:53.290546] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:18:53.559339] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-28T18:18:54.359311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-28T18:18:54.818149] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:18:55.159321] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-28T18:18:55.537787] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-28T18:18:55.947229] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:18:55.959292] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-28T18:18:56.486426] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:18:56.759322] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-28T18:18:56.844029] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T18:18:57.559327] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-28T18:18:58.359318] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-28T18:18:59.165938] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-28T18:18:59.177353] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:18:59.193436] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-28T18:18:59.203729] [INFO ] [REMOTE ] DINO: Full fetch complete (76304 records). [2025-10-28T18:18:59.204618] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-28T18:18:59.218072] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:18:59.218240] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:18:59.218892] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:18:59.219466] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:18:59.219677] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-28T18:18:59.219858] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-28T18:18:59.224868] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-28T18:18:59.225403] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-28T18:18:59.225498] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DINO took 50.4s. Estimated remaining: 3h 39m 53s. Rate: 7.9 symbols/min [2025-10-28T18:18:59.395343] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:59.423273] [DEBUG] [LOCAL ] DLB: Loaded 32098 existing records from primary storage. [2025-10-28T18:18:59.423547] [INFO ] [MAIN ] DLB: Loaded 32098 existing records. [2025-10-28T18:18:59.599399] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:59.599608] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-28T18:18:59.599692] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-28T18:18:59.600300] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-28T18:18:59.600358] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-28T18:18:59.970572] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:59.965751] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-28T18:19:00.759330] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-28T18:19:01.544722] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T18:19:01.559299] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-28T18:19:01.673110] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:19:02.359363] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-28T18:19:02.693504] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (3.53 seconds). [2025-10-28T18:19:02.884170] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T18:19:03.159386] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-28T18:19:03.529271] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T18:19:03.959372] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-28T18:19:04.638789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:19:04.759328] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-28T18:19:05.180397] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:19:05.559347] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-28T18:19:06.194969] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T18:19:06.359308] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-28T18:19:06.443192] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:19:07.159361] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-28T18:19:07.721840] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:19:07.959321] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-28T18:19:08.604180] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T18:19:08.759312] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-28T18:19:08.898283] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T18:19:09.415930] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T18:19:09.418459] [INFO ] [REMOTE ] DKL: Full fetch complete (27416 records). [2025-10-28T18:19:09.418529] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-28T18:19:09.564406] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-28T18:19:09.807423] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-28T18:19:09.807505] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-28T18:19:09.807987] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-28T18:19:09.808046] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-28T18:19:09.808667] [DEBUG] [LOCAL ] DKL: Trimmed 27416 records to 15947 (keeping 200 days of data) [2025-10-28T18:19:09.900305] [DEBUG] [LOCAL ] DKL: Primary data saved (15947 records). [2025-10-28T18:19:09.900432] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-28T18:19:09.900501] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DKL took 21.8s. Estimated remaining: 3h 39m 54s. Rate: 7.9 symbols/min [2025-10-28T18:19:10.069327] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:10.075710] [DEBUG] [LOCAL ] DLNG: Loaded 5896 existing records from primary storage. [2025-10-28T18:19:10.075874] [INFO ] [MAIN ] DLNG: Loaded 5896 existing records. [2025-10-28T18:19:10.248424] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:10.248636] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-28T18:19:10.248716] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-28T18:19:10.248957] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-28T18:19:10.249013] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-28T18:19:10.364559] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-28T18:19:10.599171] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:10.861867] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T18:19:10.871358] [INFO ] [REMOTE ] DK: Full fetch complete (70772 records). [2025-10-28T18:19:10.871485] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-28T18:19:11.164592] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-28T18:19:11.268835] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-28T18:19:11.268910] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-28T18:19:11.269792] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-28T18:19:11.269853] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-28T18:19:11.271352] [DEBUG] [LOCAL ] DK: Trimmed 70772 records to 49049 (keeping 200 days of data) [2025-10-28T18:19:11.556158] [DEBUG] [LOCAL ] DK: Primary data saved (49049 records). [2025-10-28T18:19:11.556478] [INFO ] [MAIN ] DK: Full history saved. [2025-10-28T18:19:11.556574] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DK took 35.5s. Estimated remaining: 3h 39m 30s. Rate: 7.9 symbols/min [2025-10-28T18:19:11.724940] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:11.774170] [DEBUG] [LOCAL ] DLR: Loaded 50574 existing records from primary storage. [2025-10-28T18:19:11.774485] [INFO ] [MAIN ] DLR: Loaded 50574 existing records. [2025-10-28T18:19:11.954467] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:11.954677] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-28T18:19:11.954735] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-28T18:19:11.955320] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-28T18:19:11.955376] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-28T18:19:11.985584] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-28T18:19:12.304386] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:12.660407] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-28T18:19:12.759312] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-28T18:19:13.335420] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T18:19:13.559388] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-28T18:19:14.359329] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-28T18:19:15.038283] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (3.87 seconds). [2025-10-28T18:19:15.159316] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-28T18:19:15.339771] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-28T18:19:15.912903] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-28T18:19:15.959296] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-28T18:19:16.759374] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-28T18:19:17.039188] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:19:17.362093] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T18:19:17.559361] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-28T18:19:18.359359] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-28T18:19:19.096239] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (4.74 seconds). [2025-10-28T18:19:19.159334] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-28T18:19:19.237636] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:19:19.959378] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-28T18:19:20.412399] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:19:20.759394] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-28T18:19:21.460686] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (6.30 seconds). [2025-10-28T18:19:21.559325] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-28T18:19:22.164861] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:19:22.266539] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (4.71 seconds). [2025-10-28T18:19:22.359381] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-28T18:19:23.159382] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-28T18:19:23.645340] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (3.69 seconds). [2025-10-28T18:19:23.959426] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-28T18:19:24.505998] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T18:19:24.538876] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-28T18:19:24.759480] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-28T18:19:25.138455] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T18:19:25.507751] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:19:25.559306] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-28T18:19:26.359318] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-28T18:19:26.533606] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T18:19:26.656168] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (5.10 seconds). [2025-10-28T18:19:26.668153] [INFO ] [REMOTE ] DKS: Full fetch complete (71352 records). [2025-10-28T18:19:26.668457] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-28T18:19:27.146567] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-28T18:19:27.146761] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-28T18:19:27.148037] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-28T18:19:27.148104] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-28T18:19:27.150467] [DEBUG] [LOCAL ] DKS: Trimmed 71352 records to 48935 (keeping 200 days of data) [2025-10-28T18:19:27.213350] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-28T18:19:27.507337] [DEBUG] [LOCAL ] DKS: Primary data saved (48935 records). [2025-10-28T18:19:27.507560] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-28T18:19:27.507707] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DKS took 36.6s. Estimated remaining: 3h 39m 46s. Rate: 7.9 symbols/min [2025-10-28T18:19:27.711332] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:27.711622] [DEBUG] [LOCAL ] DLX: No existing data file found in primary storage. [2025-10-28T18:19:27.711783] [WARN ] [MAIN ] DLX: No existing data found, performing full refresh instead. [2025-10-28T18:19:27.711937] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-28T18:19:27.712014] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-28T18:19:27.712058] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-28T18:19:27.712092] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-28T18:19:27.985752] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-28T18:19:28.121165] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:28.251568] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:19:28.258386] [INFO ] [REMOTE ] DLB: Full fetch complete (47345 records). [2025-10-28T18:19:28.258492] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-28T18:19:28.259112] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:19:28.259196] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:19:28.259238] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:19:28.259304] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-28T18:19:28.259366] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-28T18:19:28.259402] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-10-28T18:19:28.259576] [DEBUG] [LOCAL ] DLB: Deleted derivative data file. [2025-10-28T18:19:28.259696] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLB took 29.0s. Estimated remaining: 3h 39m 19s. Rate: 7.9 symbols/min [2025-10-28T18:19:28.423451] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:28.442027] [DEBUG] [LOCAL ] DLY: Loaded 20602 existing records from primary storage. [2025-10-28T18:19:28.442732] [INFO ] [MAIN ] DLY: Loaded 20602 existing records. [2025-10-28T18:19:28.549370] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:19:28.626075] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:28.626288] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-28T18:19:28.626359] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-28T18:19:28.626876] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-28T18:19:28.626932] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-28T18:19:28.764505] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-28T18:19:28.990323] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:29.566121] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-28T18:19:29.567402] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T18:19:29.810977] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-10-28T18:19:29.966990] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:19:30.359395] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-28T18:19:31.159403] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-28T18:19:31.537496] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:19:31.551847] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:19:31.959375] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-28T18:19:32.759350] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-28T18:19:33.559321] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-28T18:19:33.705468] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:19:34.359303] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-28T18:19:34.817055] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:19:35.159331] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-28T18:19:35.391880] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:19:35.477693] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (3.52 seconds). [2025-10-28T18:19:35.959315] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-28T18:19:35.973549] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T18:19:35.975267] [INFO ] [REMOTE ] DLNG: Full fetch complete (10964 records). [2025-10-28T18:19:35.975368] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-28T18:19:36.331805] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-28T18:19:36.331878] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-28T18:19:36.332150] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-28T18:19:36.332190] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-28T18:19:36.332600] [DEBUG] [LOCAL ] DLNG: Trimmed 10964 records to 5867 (keeping 200 days of data) [2025-10-28T18:19:36.365660] [DEBUG] [LOCAL ] DLNG: Primary data saved (5867 records). [2025-10-28T18:19:36.365776] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-28T18:19:36.365856] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DLNG took 26.5s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-28T18:19:36.538102] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:36.543776] [DEBUG] [LOCAL ] DMA: Loaded 4689 existing records from primary storage. [2025-10-28T18:19:36.543931] [INFO ] [MAIN ] DMA: Loaded 4689 existing records. [2025-10-28T18:19:36.703466] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:19:36.742922] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:36.743873] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-28T18:19:36.743929] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-28T18:19:36.744132] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-28T18:19:36.744188] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-28T18:19:36.764440] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-28T18:19:37.094433] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:37.559332] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-28T18:19:37.934448] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T18:19:38.359365] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-28T18:19:38.574232] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T18:19:38.914504] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T18:19:39.159380] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-28T18:19:39.651132] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T18:19:39.959340] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-28T18:19:40.759387] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-28T18:19:41.378873] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:19:41.559344] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-28T18:19:42.065467] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T18:19:42.075471] [INFO ] [REMOTE ] DLR: Full fetch complete (74159 records). [2025-10-28T18:19:42.075593] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-28T18:19:42.364596] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-28T18:19:42.461964] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-28T18:19:42.462042] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-28T18:19:42.462867] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-28T18:19:42.462927] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-28T18:19:42.464310] [DEBUG] [LOCAL ] DLR: Trimmed 74159 records to 50543 (keeping 200 days of data) [2025-10-28T18:19:42.773401] [DEBUG] [LOCAL ] DLR: Primary data saved (50543 records). [2025-10-28T18:19:42.773526] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-28T18:19:42.773601] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLR took 31.2s. Estimated remaining: 3h 39m 2s. Rate: 7.9 symbols/min [2025-10-28T18:19:42.902161] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T18:19:42.947791] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:42.957989] [DEBUG] [LOCAL ] DMB: Loaded 10487 existing records from primary storage. [2025-10-28T18:19:42.958187] [INFO ] [MAIN ] DMB: Loaded 10487 existing records. [2025-10-28T18:19:43.133815] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:43.134034] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-28T18:19:43.134104] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-28T18:19:43.134384] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-28T18:19:43.134437] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-28T18:19:43.166691] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-28T18:19:43.523115] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:43.666260] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T18:19:43.909197] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (3.15 seconds). [2025-10-28T18:19:43.959295] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-28T18:19:44.759380] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-28T18:19:44.901384] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:19:45.067850] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T18:19:45.559348] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-28T18:19:46.309633] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:19:46.359304] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-28T18:19:47.159347] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-28T18:19:47.226100] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T18:19:47.510157] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T18:19:47.959343] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-28T18:19:48.759306] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-28T18:19:49.432676] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T18:19:49.559346] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-28T18:19:50.004305] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T18:19:50.359401] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-28T18:19:51.159369] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-28T18:19:51.426778] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-28T18:19:51.862504] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T18:19:51.959397] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-28T18:19:52.405145] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:19:52.759388] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-28T18:19:53.518220] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T18:19:53.559329] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-28T18:19:54.359367] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-28T18:19:54.382452] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-28T18:19:55.159385] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-28T18:19:55.284004] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T18:19:55.593636] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T18:19:55.802736] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T18:19:55.804747] [INFO ] [REMOTE ] DMA: Full fetch complete (6532 records). [2025-10-28T18:19:55.804826] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-28T18:19:55.964416] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-28T18:19:56.176196] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-28T18:19:56.176260] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-28T18:19:56.176433] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-28T18:19:56.176471] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-28T18:19:56.176929] [DEBUG] [LOCAL ] DMA: Trimmed 6532 records to 4701 (keeping 200 days of data) [2025-10-28T18:19:56.203894] [DEBUG] [LOCAL ] DMA: Primary data saved (4701 records). [2025-10-28T18:19:56.203959] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-28T18:19:56.204028] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DMA took 19.8s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-10-28T18:19:56.378825] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:56.388719] [DEBUG] [LOCAL ] DMO: Loaded 9505 existing records from primary storage. [2025-10-28T18:19:56.388887] [INFO ] [MAIN ] DMO: Loaded 9505 existing records. [2025-10-28T18:19:56.562669] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:56.562861] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-28T18:19:56.562907] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-28T18:19:56.563143] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-28T18:19:56.563184] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-28T18:19:56.765672] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-28T18:19:56.913577] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T18:19:56.957179] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:57.373451] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T18:19:57.559329] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-28T18:19:58.120712] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T18:19:58.359331] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-28T18:19:58.850693] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T18:19:59.159327] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-28T18:19:59.670123] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T18:19:59.959333] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-28T18:20:00.759311] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-28T18:20:00.867293] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T18:20:01.559334] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-28T18:20:02.058578] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:20:02.359320] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-28T18:20:02.952525] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T18:20:03.007720] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:20:03.013484] [INFO ] [REMOTE ] DLY: Full fetch complete (28691 records). [2025-10-28T18:20:03.013590] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-28T18:20:03.014134] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:20:03.014218] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:20:03.014262] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:20:03.014329] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-28T18:20:03.014392] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-28T18:20:03.014429] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-28T18:20:03.014573] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-28T18:20:03.014668] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DLY took 34.8s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-28T18:20:03.167607] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-28T18:20:03.194146] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:03.235444] [DEBUG] [LOCAL ] DNA: Loaded 48413 existing records from primary storage. [2025-10-28T18:20:03.235767] [INFO ] [MAIN ] DNA: Loaded 48413 existing records. [2025-10-28T18:20:03.412698] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:03.412930] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-28T18:20:03.412988] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-28T18:20:03.413693] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-28T18:20:03.413750] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-28T18:20:03.768704] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:03.959347] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-28T18:20:04.100731] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T18:20:04.759341] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-28T18:20:05.546512] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T18:20:05.559296] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-28T18:20:05.708761] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T18:20:06.359396] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-28T18:20:06.983483] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T18:20:07.157899] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T18:20:07.166859] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-28T18:20:07.632221] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:20:07.959437] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-28T18:20:08.759390] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-28T18:20:09.509242] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T18:20:09.543179] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T18:20:09.559305] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-28T18:20:10.359346] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-28T18:20:10.891593] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:20:11.107914] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T18:20:11.113174] [INFO ] [REMOTE ] DLX: Full fetch complete (41395 records). [2025-10-28T18:20:11.113291] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-28T18:20:11.164628] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-28T18:20:11.534968] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-28T18:20:11.535041] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-28T18:20:11.535608] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-28T18:20:11.535670] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-28T18:20:11.536474] [DEBUG] [LOCAL ] DLX: Trimmed 41395 records to 27575 (keeping 200 days of data) [2025-10-28T18:20:11.694065] [DEBUG] [LOCAL ] DLX: Primary data saved (27575 records). [2025-10-28T18:20:11.694184] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-28T18:20:11.694251] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DLX took 44.2s. Estimated remaining: 3h 38m 57s. Rate: 7.9 symbols/min [2025-10-28T18:20:11.864628] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:11.864784] [DEBUG] [LOCAL ] DNOW: No existing data file found in primary storage. [2025-10-28T18:20:11.864823] [WARN ] [MAIN ] DNOW: No existing data found, performing full refresh instead. [2025-10-28T18:20:11.864929] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-28T18:20:11.864968] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-28T18:20:11.865008] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-28T18:20:11.865039] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-28T18:20:11.964054] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-28T18:20:12.221576] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:12.653738] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T18:20:12.759326] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-28T18:20:13.293475] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:20:13.312972] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:20:13.559320] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-28T18:20:14.359310] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-28T18:20:14.910981] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:20:15.159395] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-28T18:20:15.959319] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-28T18:20:15.989541] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T18:20:16.759413] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-28T18:20:17.523566] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-28T18:20:17.559371] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-28T18:20:18.186140] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:20:18.188612] [INFO ] [REMOTE ] DMO: Full fetch complete (14301 records). [2025-10-28T18:20:18.188846] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-28T18:20:18.363458] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-28T18:20:18.526908] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T18:20:18.587926] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-28T18:20:18.587999] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-28T18:20:18.588378] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-28T18:20:18.588428] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-28T18:20:18.588976] [DEBUG] [LOCAL ] DMO: Trimmed 14301 records to 9429 (keeping 200 days of data) [2025-10-28T18:20:18.645414] [DEBUG] [LOCAL ] DMO: Primary data saved (9429 records). [2025-10-28T18:20:18.645538] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-28T18:20:18.645615] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DMO took 22.4s. Estimated remaining: 3h 38m 47s. Rate: 7.9 symbols/min [2025-10-28T18:20:18.813778] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:18.842541] [DEBUG] [LOCAL ] DNP: Loaded 32861 existing records from primary storage. [2025-10-28T18:20:18.842829] [INFO ] [MAIN ] DNP: Loaded 32861 existing records. [2025-10-28T18:20:19.018079] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:19.018371] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-28T18:20:19.018428] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-28T18:20:19.019068] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-28T18:20:19.019128] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-28T18:20:19.167335] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-28T18:20:19.391797] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:19.419015] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-10-28T18:20:19.748939] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:20:19.959314] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-28T18:20:20.028086] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T18:20:20.759326] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-28T18:20:21.030111] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T18:20:21.559377] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-28T18:20:21.975449] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T18:20:22.359337] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-28T18:20:23.159310] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-28T18:20:23.959341] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-28T18:20:24.152711] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T18:20:24.265312] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:20:24.759319] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-28T18:20:24.907018] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:20:25.559346] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-28T18:20:25.931924] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:20:26.359385] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-28T18:20:26.488083] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:20:26.967680] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:20:26.970418] [INFO ] [REMOTE ] DMB: Full fetch complete (14457 records). [2025-10-28T18:20:26.970489] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-28T18:20:26.970917] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:20:26.970998] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:20:26.971058] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:20:26.971136] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-28T18:20:26.971224] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-28T18:20:26.971274] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-28T18:20:26.971452] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-28T18:20:26.971549] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DMB took 44.2s. Estimated remaining: 3h 38m 42s. Rate: 7.9 symbols/min [2025-10-28T18:20:27.141295] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:27.166134] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-28T18:20:27.190305] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-28T18:20:27.190599] [INFO ] [MAIN ] DOC: Loaded 53554 existing records. [2025-10-28T18:20:27.368809] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:27.369096] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-28T18:20:27.369147] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-28T18:20:27.370087] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-28T18:20:27.370145] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-28T18:20:27.724468] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:27.959313] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-28T18:20:28.606514] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (7.05 seconds). [2025-10-28T18:20:28.759378] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-28T18:20:29.196631] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T18:20:29.559315] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-28T18:20:30.210964] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:20:30.359323] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-28T18:20:30.460373] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:20:31.159342] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-28T18:20:31.794675] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:20:31.935771] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (4.77 seconds). [2025-10-28T18:20:31.959291] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-28T18:20:32.386572] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:20:32.759343] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-28T18:20:33.559316] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-28T18:20:33.834465] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:20:34.359400] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-28T18:20:35.159312] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-28T18:20:35.361848] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T18:20:35.372042] [INFO ] [REMOTE ] DNA: Full fetch complete (71074 records). [2025-10-28T18:20:35.372173] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-28T18:20:35.781941] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-28T18:20:35.790503] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-28T18:20:35.791464] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-28T18:20:35.791544] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-28T18:20:35.793854] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:20:35.803925] [DEBUG] [LOCAL ] DNA: Trimmed 71074 records to 48345 (keeping 200 days of data) [2025-10-28T18:20:35.960335] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-28T18:20:36.075456] [DEBUG] [LOCAL ] DNA: Primary data saved (48345 records). [2025-10-28T18:20:36.075581] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-28T18:20:36.075687] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNA took 33.1s. Estimated remaining: 3h 38m 38s. Rate: 7.9 symbols/min [2025-10-28T18:20:36.375816] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (4.42 seconds). [2025-10-28T18:20:36.410853] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:20:36.759387] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-28T18:20:37.559370] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-28T18:20:38.509453] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:20:38.516005] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-28T18:20:38.952188] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-28T18:20:38.961282] [INFO ] [REMOTE ] DNOW: Full fetch complete (63891 records). [2025-10-28T18:20:38.961383] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-28T18:20:39.349257] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-28T18:20:39.349337] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-28T18:20:39.350132] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-28T18:20:39.350193] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-28T18:20:39.351440] [DEBUG] [LOCAL ] DNOW: Trimmed 63891 records to 43622 (keeping 200 days of data) [2025-10-28T18:20:39.600169] [DEBUG] [LOCAL ] DNOW: Primary data saved (43622 records). [2025-10-28T18:20:39.600294] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-28T18:20:39.600362] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DNOW took 27.9s. Estimated remaining: 3h 38m 20s. Rate: 7.9 symbols/min [2025-10-28T18:20:40.235046] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (3.48 seconds). [2025-10-28T18:20:40.246377] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T18:20:40.261024] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-28T18:20:40.262848] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-28T18:20:41.143871] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T18:20:41.151436] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-28T18:20:41.680045] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T18:20:41.691067] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-28T18:20:42.076902] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T18:20:42.359392] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-28T18:20:43.100746] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T18:20:43.159317] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-28T18:20:43.487208] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T18:20:43.493751] [INFO ] [REMOTE ] DNP: Full fetch complete (48397 records). [2025-10-28T18:20:43.493843] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-28T18:20:43.860571] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-28T18:20:43.860666] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-28T18:20:43.861299] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-28T18:20:43.861340] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-28T18:20:43.862314] [DEBUG] [LOCAL ] DNP: Trimmed 48397 records to 32822 (keeping 200 days of data) [2025-10-28T18:20:44.051211] [DEBUG] [LOCAL ] DNP: Primary data saved (32822 records). [2025-10-28T18:20:44.051338] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-28T18:20:44.051415] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DNP took 25.4s. Estimated remaining: 3h 38m 4s. Rate: 7.9 symbols/min [2025-10-28T18:20:44.407159] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:20:44.417904] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-28T18:20:45.900680] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:20:45.913942] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-28T18:20:47.303768] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T18:20:47.314951] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-28T18:20:48.658349] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T18:20:48.669677] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-28T18:20:50.214782] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:20:50.225495] [INFO ] [REMOTE ] DOC: Full fetch complete (77599 records). [2025-10-28T18:20:50.225685] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-28T18:20:50.614266] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-28T18:20:50.614343] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-28T18:20:50.615289] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-28T18:20:50.615352] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-28T18:20:50.616884] [DEBUG] [LOCAL ] DOC: Trimmed 77599 records to 53554 (keeping 200 days of data) [2025-10-28T18:20:50.947692] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-28T18:20:50.947826] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-28T18:20:50.947905] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOC took 24.0s. Estimated remaining: 3h 37m 54s. Rate: 7.9 symbols/min [2025-10-28T18:20:51.479914] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.571951] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.607767] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.634155] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.634551] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-10-28T18:20:51.634595] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-10-28T18:20:51.634701] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-28T18:20:51.634751] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-28T18:20:51.634792] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-28T18:20:51.634822] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-28T18:20:51.838884] [DEBUG] [LOCAL ] DOUG: Loaded 33433 existing records from primary storage. [2025-10-28T18:20:51.862893] [DEBUG] [LOCAL ] DOCS: Loaded 50150 existing records from primary storage. [2025-10-28T18:20:51.885340] [INFO ] [MAIN ] DOUG: Loaded 33433 existing records. [2025-10-28T18:20:51.892285] [INFO ] [MAIN ] DOCS: Loaded 50150 existing records. [2025-10-28T18:20:52.144900] [DEBUG] [LOCAL ] DOCN: Loaded 51095 existing records from primary storage. [2025-10-28T18:20:52.187090] [INFO ] [MAIN ] DOCN: Loaded 51095 existing records. [2025-10-28T18:20:52.422285] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:52.477903] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:52.491832] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-28T18:20:52.535435] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-28T18:20:52.536405] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-28T18:20:52.550945] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-28T18:20:52.554432] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-28T18:20:52.554293] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:52.588827] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-28T18:20:52.594100] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-28T18:20:52.616615] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-28T18:20:52.616848] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-28T18:20:52.846247] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:52.910513] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-28T18:20:52.935628] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-28T18:20:52.948868] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-28T18:20:53.019703] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-28T18:20:53.447395] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:53.487138] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-28T18:20:53.557724] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:53.559879] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-28T18:20:53.781889] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:53.782193] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-28T18:20:54.431557] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:20:54.438860] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-28T18:20:54.797037] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:20:54.806566] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-28T18:20:55.217023] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:20:55.227339] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-28T18:20:55.357584] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T18:20:55.364548] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-28T18:20:55.940350] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (3.45 seconds). [2025-10-28T18:20:55.947492] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-28T18:20:56.325624] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T18:20:56.334007] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-28T18:20:56.365173] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T18:20:56.376229] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-28T18:20:56.407064] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T18:20:56.416524] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-28T18:20:56.993631] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:20:56.999984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-28T18:20:57.115127] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:20:57.559302] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-28T18:20:57.697850] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T18:20:58.359316] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-28T18:20:58.612065] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T18:20:59.160893] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-28T18:20:59.163534] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-28T18:20:59.638265] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:20:59.959326] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-28T18:21:00.161447] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T18:21:00.367723] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (3.95 seconds). [2025-10-28T18:21:00.759341] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-28T18:21:01.559307] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-28T18:21:01.707715] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T18:21:01.940941] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:21:02.359380] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-28T18:21:02.598329] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T18:21:03.159359] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-28T18:21:03.959420] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-28T18:21:04.636665] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T18:21:04.759361] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-28T18:21:05.414899] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:21:05.559391] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-28T18:21:05.719978] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T18:21:06.263799] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (3.90 seconds). [2025-10-28T18:21:06.359344] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-28T18:21:06.857002] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:21:07.159417] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-28T18:21:07.397472] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T18:21:07.959363] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-28T18:21:08.759355] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-28T18:21:09.016822] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T18:21:09.542151] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T18:21:09.559369] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-28T18:21:10.173456] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T18:21:10.359324] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-28T18:21:10.456040] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T18:21:11.159337] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-28T18:21:11.734227] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:21:11.959362] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-28T18:21:12.358213] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:21:12.759361] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-28T18:21:13.559320] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-28T18:21:14.341547] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-28T18:21:14.359346] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-28T18:21:14.916253] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-28T18:21:14.923189] [INFO ] [REMOTE ] DOUG: Full fetch complete (49381 records). [2025-10-28T18:21:14.923669] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-28T18:21:15.063260] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:21:15.113218] [INFO ] [REMOTE ] DOCS: Full fetch complete (73576 records). [2025-10-28T18:21:15.163885] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-28T18:21:15.148808] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-28T18:21:15.594428] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-28T18:21:15.613342] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-28T18:21:15.628406] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-28T18:21:15.638122] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-28T18:21:15.706173] [DEBUG] [LOCAL ] DOUG: Trimmed 49381 records to 33370 (keeping 200 days of data) [2025-10-28T18:21:15.902587] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-28T18:21:15.909803] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-28T18:21:15.920254] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-28T18:21:15.920364] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-28T18:21:15.962716] [DEBUG] [LOCAL ] DOCS: Trimmed 73576 records to 50085 (keeping 200 days of data) [2025-10-28T18:21:16.123788] [DEBUG] [LOCAL ] DOUG: Primary data saved (33370 records). [2025-10-28T18:21:16.125284] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-28T18:21:16.124358] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-28T18:21:16.135546] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOUG took 25.2s. Estimated remaining: 3h 38m 34s. Rate: 7.9 symbols/min [2025-10-28T18:21:16.161238] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-28T18:21:16.474180] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:16.492458] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-10-28T18:21:16.497189] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-10-28T18:21:16.500113] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-28T18:21:16.500701] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-28T18:21:16.509132] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-28T18:21:16.509218] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-28T18:21:16.509022] [DEBUG] [LOCAL ] DOCS: Primary data saved (50085 records). [2025-10-28T18:21:16.545442] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-28T18:21:16.552579] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOCS took 25.6s. Estimated remaining: 3h 38m 7s. Rate: 7.9 symbols/min [2025-10-28T18:21:16.959485] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:17.079774] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:17.080224] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-28T18:21:17.083093] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T18:21:17.093237] [INFO ] [REMOTE ] DOLE: Full fetch complete (54711 records). [2025-10-28T18:21:17.093430] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-28T18:21:17.338607] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-28T18:21:17.387445] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-28T18:21:17.669858] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-28T18:21:17.675336] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-28T18:21:17.686797] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-28T18:21:17.697602] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-28T18:21:17.762277] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:17.762753] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-28T18:21:17.762926] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-28T18:21:17.763901] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-28T18:21:17.764075] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-28T18:21:17.763826] [DEBUG] [LOCAL ] DOLE: Trimmed 54711 records to 39074 (keeping 200 days of data) [2025-10-28T18:21:18.340085] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-28T18:21:18.382176] [DEBUG] [LOCAL ] DOLE: Primary data saved (39074 records). [2025-10-28T18:21:18.409949] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-28T18:21:18.429429] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:18.430620] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-28T18:21:18.430307] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOLE took 27.5s. Estimated remaining: 3h 37m 44s. Rate: 7.9 symbols/min [2025-10-28T18:21:18.430011] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-28T18:21:18.607292] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:18.632076] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:21:18.650838] [DEBUG] [LOCAL ] DPG: Loaded 13105 existing records from primary storage. [2025-10-28T18:21:18.651074] [INFO ] [MAIN ] DPG: Loaded 13105 existing records. [2025-10-28T18:21:18.834160] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:18.834341] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-28T18:21:18.834389] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-28T18:21:18.834559] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-28T18:21:18.834600] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-28T18:21:19.170256] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-28T18:21:19.193817] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:19.910218] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:21:19.959306] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-28T18:21:20.209010] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:21:20.759312] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-28T18:21:21.435716] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T18:21:21.559365] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-28T18:21:21.840818] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-10-28T18:21:21.988446] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T18:21:22.359363] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-28T18:21:22.682829] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:21:23.159364] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-28T18:21:23.754442] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T18:21:23.959321] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-28T18:21:24.759373] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-28T18:21:25.553146] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:21:25.563720] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-28T18:21:26.359381] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-28T18:21:27.061048] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (3.90 seconds). [2025-10-28T18:21:27.159352] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-28T18:21:27.252318] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-28T18:21:27.958379] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T18:21:27.969564] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-28T18:21:28.583999] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:21:28.759323] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-28T18:21:28.939294] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (3.38 seconds). [2025-10-28T18:21:28.949767] [INFO ] [REMOTE ] DOCN: Full fetch complete (73166 records). [2025-10-28T18:21:28.949911] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-28T18:21:29.340207] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-28T18:21:29.340341] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-28T18:21:29.341201] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-28T18:21:29.341322] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-28T18:21:29.342901] [DEBUG] [LOCAL ] DOCN: Trimmed 73166 records to 51087 (keeping 200 days of data) [2025-10-28T18:21:29.563524] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-28T18:21:29.632718] [DEBUG] [LOCAL ] DOCN: Primary data saved (51087 records). [2025-10-28T18:21:29.632819] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-28T18:21:29.632893] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOCN took 38.7s. Estimated remaining: 3h 37m 46s. Rate: 7.9 symbols/min [2025-10-28T18:21:29.802122] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:29.843597] [DEBUG] [LOCAL ] DQ: Loaded 43643 existing records from primary storage. [2025-10-28T18:21:29.843900] [INFO ] [MAIN ] DQ: Loaded 43643 existing records. [2025-10-28T18:21:29.973870] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-28T18:21:30.057993] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:30.058180] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-28T18:21:30.058227] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-28T18:21:30.058579] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-28T18:21:30.058618] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-28T18:21:30.361589] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-28T18:21:30.414703] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:30.509856] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T18:21:31.159325] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-28T18:21:31.522396] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:21:31.959384] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-28T18:21:32.366341] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (3.61 seconds). [2025-10-28T18:21:32.759316] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-28T18:21:33.131525] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:21:33.532992] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:21:33.559298] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-28T18:21:34.104582] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-10-28T18:21:34.359316] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-28T18:21:34.478517] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:21:35.159360] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-28T18:21:35.757673] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T18:21:35.959315] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-28T18:21:36.531311] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T18:21:36.759302] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-28T18:21:37.328763] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T18:21:37.559313] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-28T18:21:37.631349] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (3.27 seconds). [2025-10-28T18:21:38.359308] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-28T18:21:38.577762] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T18:21:38.580581] [INFO ] [REMOTE ] DPG: Full fetch complete (18966 records). [2025-10-28T18:21:38.580718] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-28T18:21:38.941449] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-28T18:21:38.941524] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-28T18:21:38.941968] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-28T18:21:38.942029] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-28T18:21:38.942559] [DEBUG] [LOCAL ] DPG: Trimmed 18966 records to 13104 (keeping 200 days of data) [2025-10-28T18:21:39.021867] [DEBUG] [LOCAL ] DPG: Primary data saved (13104 records). [2025-10-28T18:21:39.021998] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-28T18:21:39.022075] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 20.6s. Estimated remaining: 3h 37m 44s. Rate: 7.9 symbols/min [2025-10-28T18:21:39.167560] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-28T18:21:39.194125] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:39.231896] [DEBUG] [LOCAL ] DRD: Loaded 37947 existing records from primary storage. [2025-10-28T18:21:39.232157] [INFO ] [MAIN ] DRD: Loaded 37947 existing records. [2025-10-28T18:21:39.416448] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:39.416735] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-28T18:21:39.416796] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-28T18:21:39.417341] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-28T18:21:39.417398] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-28T18:21:39.772192] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:39.796311] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:21:39.959304] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-28T18:21:40.759365] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-28T18:21:40.832542] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T18:21:41.098318] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:21:41.559345] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-28T18:21:42.146998] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:21:42.359397] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-28T18:21:43.159322] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-28T18:21:43.204130] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T18:21:43.959321] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-28T18:21:44.073094] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:21:44.166371] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T18:21:44.759386] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-28T18:21:45.124930] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:21:45.559357] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-28T18:21:45.783809] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:21:46.359357] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-28T18:21:46.645953] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:21:47.159360] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-28T18:21:47.872130] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T18:21:47.959302] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-28T18:21:48.128960] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:21:48.759373] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-28T18:21:49.559329] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-28T18:21:50.322587] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T18:21:50.332152] [INFO ] [REMOTE ] DOV: Full fetch complete (66380 records). [2025-10-28T18:21:50.332266] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-28T18:21:50.364515] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-28T18:21:50.739756] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-28T18:21:50.739840] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-28T18:21:50.740711] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-28T18:21:50.740794] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-28T18:21:50.768957] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:21:50.777805] [DEBUG] [LOCAL ] DOV: Trimmed 66380 records to 45528 (keeping 200 days of data) [2025-10-28T18:21:51.062558] [DEBUG] [LOCAL ] DOV: Primary data saved (45528 records). [2025-10-28T18:21:51.062696] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-28T18:21:51.062785] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DOV took 34.9s. Estimated remaining: 3h 37m 48s. Rate: 7.9 symbols/min [2025-10-28T18:21:51.163815] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-28T18:21:51.234568] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:51.276499] [DEBUG] [LOCAL ] DRH: Loaded 50096 existing records from primary storage. [2025-10-28T18:21:51.304053] [INFO ] [MAIN ] DRH: Loaded 50096 existing records. [2025-10-28T18:21:51.382517] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (3.42 seconds). [2025-10-28T18:21:51.430678] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-28T18:21:51.446197] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-28T18:21:51.594696] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:51.614923] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-28T18:21:51.618301] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-28T18:21:51.624227] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-28T18:21:51.645008] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-28T18:21:52.195810] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-28T18:21:52.206328] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-28T18:21:52.228266] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-28T18:21:52.233636] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-28T18:21:52.319345] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:52.320229] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-28T18:21:52.319944] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-28T18:21:52.351492] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-28T18:21:52.495524] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:21:52.726520] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-28T18:21:52.726691] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-28T18:21:52.726820] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DOW took 36.2s. Estimated remaining: 3h 37m 25s. Rate: 7.9 symbols/min [2025-10-28T18:21:52.769076] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-28T18:21:52.896399] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:52.936949] [DEBUG] [LOCAL ] DRI: Loaded 47373 existing records from primary storage. [2025-10-28T18:21:52.937230] [INFO ] [MAIN ] DRI: Loaded 47373 existing records. [2025-10-28T18:21:53.113196] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:53.113399] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-28T18:21:53.113454] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-28T18:21:53.114266] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-28T18:21:53.114324] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-28T18:21:53.468957] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:53.559297] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-28T18:21:54.025767] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:21:54.359308] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-28T18:21:54.490586] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:21:55.159336] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-28T18:21:55.348762] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-10-28T18:21:55.662778] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:21:55.959334] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-28T18:21:56.405800] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:21:56.759360] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-28T18:21:57.559311] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-28T18:21:57.854182] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:21:58.359327] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-28T18:21:59.006688] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:21:59.016385] [INFO ] [REMOTE ] DQ: Full fetch complete (63786 records). [2025-10-28T18:21:59.016505] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-28T18:21:59.164507] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-28T18:21:59.411967] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-28T18:21:59.412124] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-28T18:21:59.412957] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-28T18:21:59.413018] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-28T18:21:59.414259] [DEBUG] [LOCAL ] DQ: Trimmed 63786 records to 43647 (keeping 200 days of data) [2025-10-28T18:21:59.546223] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (3.59 seconds). [2025-10-28T18:21:59.695104] [DEBUG] [LOCAL ] DQ: Primary data saved (43647 records). [2025-10-28T18:21:59.695221] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-28T18:21:59.695298] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DQ took 30.1s. Estimated remaining: 3h 37m 15s. Rate: 7.9 symbols/min [2025-10-28T18:21:59.863071] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:59.871466] [DEBUG] [LOCAL ] DRLL: Loaded 8444 existing records from primary storage. [2025-10-28T18:21:59.871670] [INFO ] [MAIN ] DRLL: Loaded 8444 existing records. [2025-10-28T18:21:59.964513] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-28T18:22:00.054899] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:00.055553] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-28T18:22:00.055613] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-28T18:22:00.055907] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-28T18:22:00.055960] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-28T18:22:00.407278] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:00.759331] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-28T18:22:01.574759] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:22:01.577583] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-28T18:22:02.122696] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T18:22:02.359398] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-28T18:22:03.092024] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (4.73 seconds). [2025-10-28T18:22:03.159304] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-28T18:22:03.650294] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (3.69 seconds). [2025-10-28T18:22:03.959420] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-28T18:22:04.552103] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:22:04.759312] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-28T18:22:04.884439] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-28T18:22:05.203328] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T18:22:05.507556] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (6.34 seconds). [2025-10-28T18:22:05.559305] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-28T18:22:06.017267] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:22:06.089437] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T18:22:06.359332] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-28T18:22:06.838369] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T18:22:07.159334] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-28T18:22:07.959385] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-28T18:22:08.759383] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-28T18:22:09.070617] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T18:22:09.559408] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-28T18:22:10.035383] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:22:10.359415] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-28T18:22:10.598089] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (3.44 seconds). [2025-10-28T18:22:11.159320] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-28T18:22:11.460176] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:22:11.841305] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-28T18:22:11.959368] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-28T18:22:12.759319] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-28T18:22:13.258001] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:22:13.489469] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:22:13.559385] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-28T18:22:13.839662] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-28T18:22:14.082690] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:22:14.359406] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-28T18:22:15.159352] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-28T18:22:15.780087] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T18:22:15.782112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:22:15.959391] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-28T18:22:16.759379] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-28T18:22:17.221029] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:22:17.559342] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-28T18:22:17.611799] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T18:22:17.613712] [INFO ] [REMOTE ] DRLL: Full fetch complete (14410 records). [2025-10-28T18:22:17.613782] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-28T18:22:17.987546] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-28T18:22:17.987623] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-28T18:22:17.987986] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-28T18:22:17.988041] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-28T18:22:17.988529] [DEBUG] [LOCAL ] DRLL: Trimmed 14410 records to 8432 (keeping 200 days of data) [2025-10-28T18:22:18.043212] [DEBUG] [LOCAL ] DRLL: Primary data saved (8432 records). [2025-10-28T18:22:18.043393] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-28T18:22:18.043529] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRLL took 18.3s. Estimated remaining: 3h 37m 36s. Rate: 7.9 symbols/min [2025-10-28T18:22:18.219390] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:18.248469] [DEBUG] [LOCAL ] DSL: Loaded 28643 existing records from primary storage. [2025-10-28T18:22:18.248760] [INFO ] [MAIN ] DSL: Loaded 28643 existing records. [2025-10-28T18:22:18.364449] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-28T18:22:18.437303] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:18.437506] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-28T18:22:18.437557] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-28T18:22:18.438199] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-28T18:22:18.438259] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-28T18:22:18.809861] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:18.998324] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T18:22:19.159321] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-28T18:22:19.925782] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T18:22:19.959374] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-28T18:22:20.631849] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:22:20.759371] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-28T18:22:21.536884] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:22:21.547922] [INFO ] [REMOTE ] DRD: Full fetch complete (52597 records). [2025-10-28T18:22:21.548694] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-28T18:22:21.560605] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-28T18:22:21.600622] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T18:22:21.966265] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-28T18:22:21.966386] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-28T18:22:21.967115] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-28T18:22:21.967186] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-28T18:22:21.968403] [DEBUG] [LOCAL ] DRD: Trimmed 52597 records to 37883 (keeping 200 days of data) [2025-10-28T18:22:22.207081] [DEBUG] [LOCAL ] DRD: Primary data saved (37883 records). [2025-10-28T18:22:22.207231] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-28T18:22:22.207325] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRD took 43.2s. Estimated remaining: 3h 37m 20s. Rate: 7.9 symbols/min [2025-10-28T18:22:22.375494] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-28T18:22:22.410073] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:22.410253] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-28T18:22:22.410296] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-28T18:22:22.410404] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-28T18:22:22.410445] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-28T18:22:22.410486] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-28T18:22:22.410518] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-28T18:22:22.815411] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:23.108955] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:22:23.122047] [INFO ] [REMOTE ] DRI: Full fetch complete (69350 records). [2025-10-28T18:22:23.122241] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-28T18:22:23.169287] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-28T18:22:23.540553] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-28T18:22:23.540686] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-28T18:22:23.541579] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-28T18:22:23.541624] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-28T18:22:23.543061] [DEBUG] [LOCAL ] DRI: Trimmed 69350 records to 47301 (keeping 200 days of data) [2025-10-28T18:22:23.888003] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T18:22:23.917741] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T18:22:23.928481] [DEBUG] [LOCAL ] DRI: Primary data saved (47301 records). [2025-10-28T18:22:23.928690] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-28T18:22:23.929626] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DRI took 31.2s. Estimated remaining: 3h 36m 56s. Rate: 7.9 symbols/min [2025-10-28T18:22:23.969084] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-28T18:22:24.117089] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:24.120174] [DEBUG] [LOCAL ] DSMC: Loaded 1704 existing records from primary storage. [2025-10-28T18:22:24.120315] [INFO ] [MAIN ] DSMC: Loaded 1704 existing records. [2025-10-28T18:22:24.300418] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:24.300726] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-28T18:22:24.300779] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-28T18:22:24.301011] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-28T18:22:24.301080] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-28T18:22:24.658711] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:24.759381] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-28T18:22:24.918731] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:22:25.171273] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T18:22:25.559317] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-28T18:22:26.359331] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-28T18:22:26.470911] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T18:22:27.159394] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-28T18:22:27.764692] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T18:22:27.776216] [INFO ] [REMOTE ] DRH: Full fetch complete (71876 records). [2025-10-28T18:22:27.776411] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-28T18:22:27.967569] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-28T18:22:28.088734] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:22:28.219492] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-28T18:22:28.219570] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-28T18:22:28.220436] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-28T18:22:28.220498] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-28T18:22:28.221912] [DEBUG] [LOCAL ] DRH: Trimmed 71876 records to 50049 (keeping 200 days of data) [2025-10-28T18:22:28.432915] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:22:28.515434] [DEBUG] [LOCAL ] DRH: Primary data saved (50049 records). [2025-10-28T18:22:28.515566] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-28T18:22:28.515665] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DRH took 37.5s. Estimated remaining: 3h 36m 41s. Rate: 7.9 symbols/min [2025-10-28T18:22:28.681677] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:28.681912] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-28T18:22:28.681953] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-28T18:22:28.682024] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-28T18:22:28.682059] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-28T18:22:28.682097] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-28T18:22:28.682127] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-28T18:22:28.764577] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-28T18:22:29.030339] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:29.203140] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T18:22:29.559337] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-28T18:22:29.935758] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:22:30.359385] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-28T18:22:31.159370] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-28T18:22:31.180094] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:22:31.959332] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-28T18:22:32.218769] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:22:32.250201] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T18:22:32.759339] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-28T18:22:33.559366] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-28T18:22:33.905918] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:22:34.322453] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:22:34.359427] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-28T18:22:34.647869] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T18:22:35.159371] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-28T18:22:35.661672] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T18:22:35.959339] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-28T18:22:36.258721] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T18:22:36.759393] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-28T18:22:37.559330] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-28T18:22:37.668562] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:22:38.359318] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-28T18:22:38.388759] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:22:39.159364] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-28T18:22:39.185236] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T18:22:39.959449] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-28T18:22:40.329388] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:22:40.604901] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T18:22:40.759343] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-28T18:22:41.479801] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T18:22:41.559343] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-28T18:22:42.329003] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T18:22:42.359308] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-28T18:22:42.976434] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T18:22:43.159418] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-28T18:22:43.959319] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-28T18:22:44.121991] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T18:22:44.665403] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T18:22:44.759374] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-28T18:22:45.446264] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:22:45.559333] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-28T18:22:46.359332] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-28T18:22:46.606738] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:22:47.150240] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T18:22:47.159283] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-28T18:22:47.959361] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-28T18:22:48.124752] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T18:22:48.561040] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T18:22:48.563916] [INFO ] [REMOTE ] DSM: Full fetch complete (24091 records). [2025-10-28T18:22:48.563986] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-28T18:22:48.764503] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-28T18:22:48.922957] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-28T18:22:48.923034] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-28T18:22:48.923481] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-28T18:22:48.923519] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-28T18:22:48.924172] [DEBUG] [LOCAL ] DSM: Trimmed 24091 records to 13784 (keeping 200 days of data) [2025-10-28T18:22:49.002103] [DEBUG] [LOCAL ] DSM: Primary data saved (13784 records). [2025-10-28T18:22:49.002252] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-28T18:22:49.002352] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSM took 26.8s. Estimated remaining: 3h 37m 7s. Rate: 7.9 symbols/min [2025-10-28T18:22:49.189968] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:49.210845] [DEBUG] [LOCAL ] DSX: Loaded 23205 existing records from primary storage. [2025-10-28T18:22:49.211088] [INFO ] [MAIN ] DSX: Loaded 23205 existing records. [2025-10-28T18:22:49.399710] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:49.399915] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-28T18:22:49.399961] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-28T18:22:49.400452] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-28T18:22:49.400512] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-28T18:22:49.572297] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-28T18:22:49.774322] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:49.791269] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:22:49.954094] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T18:22:50.359336] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-28T18:22:51.159328] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-28T18:22:51.327479] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T18:22:51.959335] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-28T18:22:52.108741] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T18:22:52.321438] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T18:22:52.322424] [INFO ] [REMOTE ] DSMC: Full fetch complete (2864 records). [2025-10-28T18:22:52.322496] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-28T18:22:52.322910] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:22:52.322995] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:22:52.323070] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:22:52.323140] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-28T18:22:52.323203] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-28T18:22:52.323272] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-28T18:22:52.323450] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-28T18:22:52.323549] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSMC took 28.4s. Estimated remaining: 3h 36m 48s. Rate: 7.9 symbols/min [2025-10-28T18:22:52.497111] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:52.545112] [DEBUG] [LOCAL ] DT: Loaded 52910 existing records from primary storage. [2025-10-28T18:22:52.545398] [INFO ] [MAIN ] DT: Loaded 52910 existing records. [2025-10-28T18:22:52.727224] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:52.727464] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-28T18:22:52.727511] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-28T18:22:52.728280] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-28T18:22:52.728336] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-28T18:22:52.764421] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-28T18:22:53.084255] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:53.559308] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-28T18:22:53.711770] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T18:22:54.359335] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-28T18:22:54.700698] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T18:22:54.707702] [INFO ] [REMOTE ] DSL: Full fetch complete (41739 records). [2025-10-28T18:22:54.707868] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-28T18:22:54.708611] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:22:54.708736] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:22:54.708814] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:22:54.708899] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-28T18:22:54.708984] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-28T18:22:54.709035] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-28T18:22:54.709220] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-28T18:22:54.709325] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DSL took 36.7s. Estimated remaining: 3h 36m 27s. Rate: 7.9 symbols/min [2025-10-28T18:22:54.888438] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:54.888662] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-28T18:22:54.888720] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-28T18:22:54.888832] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-28T18:22:54.888876] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-28T18:22:54.888922] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-28T18:22:54.888957] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-28T18:22:55.167536] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-28T18:22:55.255819] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:55.305032] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T18:22:55.310285] [INFO ] [REMOTE ] DSU: Full fetch complete (32944 records). [2025-10-28T18:22:55.310440] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-28T18:22:55.735290] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-28T18:22:55.735381] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-28T18:22:55.736005] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-28T18:22:55.736073] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-28T18:22:55.737130] [DEBUG] [LOCAL ] DSU: Trimmed 32944 records to 22359 (keeping 200 days of data) [2025-10-28T18:22:55.873604] [DEBUG] [LOCAL ] DSU: Primary data saved (22359 records). [2025-10-28T18:22:55.873762] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-28T18:22:55.873841] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DSU took 27.4s. Estimated remaining: 3h 36m 3s. Rate: 7.9 symbols/min [2025-10-28T18:22:55.965521] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-28T18:22:56.048812] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:56.090944] [DEBUG] [LOCAL ] DTE: Loaded 46946 existing records from primary storage. [2025-10-28T18:22:56.091240] [INFO ] [MAIN ] DTE: Loaded 46946 existing records. [2025-10-28T18:22:56.279607] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:56.279912] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-28T18:22:56.279961] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-28T18:22:56.280795] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-28T18:22:56.280852] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-28T18:22:56.567915] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:22:56.576893] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:22:56.671872] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:56.759350] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-28T18:22:57.564586] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-28T18:22:57.575096] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T18:22:58.359333] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-28T18:22:59.159317] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-28T18:22:59.959545] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-28T18:23:03.318356] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (4.96 seconds). [2025-10-28T18:23:03.319717] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-28T18:23:05.157199] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (7.59 seconds). [2025-10-28T18:23:05.166994] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-28T18:23:05.564860] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (6.41 seconds). [2025-10-28T18:23:05.575210] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-28T18:23:05.977674] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (6.02 seconds). [2025-10-28T18:23:05.983710] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-28T18:23:06.198683] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-28T18:23:06.200042] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-28T18:23:06.807119] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T18:23:06.809822] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-28T18:23:06.812442] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T18:23:06.823300] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-28T18:23:07.097822] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T18:23:07.108619] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-28T18:23:07.235388] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T18:23:07.237487] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-28T18:23:07.668510] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T18:23:07.959359] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-28T18:23:08.241954] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:23:08.480618] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-28T18:23:08.528050] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T18:23:08.759309] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-28T18:23:08.957231] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-28T18:23:09.239869] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:23:09.559363] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-28T18:23:10.074454] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:23:10.359343] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-28T18:23:11.159356] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-28T18:23:11.930356] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T18:23:11.959293] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-28T18:23:12.646301] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:23:12.759328] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-28T18:23:13.414879] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:23:13.559299] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-28T18:23:13.590871] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:23:14.182619] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T18:23:14.183889] [INFO ] [REMOTE ] DTB: Full fetch complete (6481 records). [2025-10-28T18:23:14.183958] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-28T18:23:14.364539] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-28T18:23:14.564634] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-28T18:23:14.564764] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-28T18:23:14.564966] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-28T18:23:14.565011] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-28T18:23:14.565552] [DEBUG] [LOCAL ] DTB: Trimmed 6481 records to 4861 (keeping 200 days of data) [2025-10-28T18:23:14.597700] [DEBUG] [LOCAL ] DTB: Primary data saved (4861 records). [2025-10-28T18:23:14.597835] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-28T18:23:14.597909] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DTB took 19.9s. Estimated remaining: 3h 36m 24s. Rate: 7.9 symbols/min [2025-10-28T18:23:14.768439] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:14.768588] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-28T18:23:14.768624] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-28T18:23:14.768748] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-28T18:23:14.768788] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-28T18:23:14.768882] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-28T18:23:14.768930] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-28T18:23:15.111609] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:15.159296] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-28T18:23:15.364856] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T18:23:15.559865] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T18:23:15.959329] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-28T18:23:16.759344] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-28T18:23:17.486387] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T18:23:17.559315] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-28T18:23:18.130614] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T18:23:18.359337] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-28T18:23:18.966190] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:23:19.159327] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-28T18:23:19.747028] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:23:19.959388] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-28T18:23:20.210976] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-28T18:23:20.213245] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:23:20.759397] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-28T18:23:21.042680] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T18:23:21.559335] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-28T18:23:22.359344] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-28T18:23:22.423015] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:23:23.159340] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-28T18:23:23.467777] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T18:23:23.899494] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T18:23:23.959317] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-28T18:23:24.759351] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-28T18:23:25.044411] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T18:23:25.368602] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:23:25.559334] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-28T18:23:26.359366] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-28T18:23:27.123578] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T18:23:27.134731] [INFO ] [REMOTE ] DT: Full fetch complete (76865 records). [2025-10-28T18:23:27.134900] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-28T18:23:27.165741] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-28T18:23:27.522392] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-28T18:23:27.522475] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-28T18:23:27.523431] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-28T18:23:27.523496] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-28T18:23:27.524984] [DEBUG] [LOCAL ] DT: Trimmed 76865 records to 52899 (keeping 200 days of data) [2025-10-28T18:23:27.745857] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T18:23:27.866700] [DEBUG] [LOCAL ] DT: Primary data saved (52899 records). [2025-10-28T18:23:27.866928] [INFO ] [MAIN ] DT: Full history saved. [2025-10-28T18:23:27.867947] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DT took 35.5s. Estimated remaining: 3h 36m 31s. Rate: 7.9 symbols/min [2025-10-28T18:23:27.869334] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:23:27.960723] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-28T18:23:28.065374] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:28.073089] [DEBUG] [LOCAL ] DTG: Loaded 5634 existing records from primary storage. [2025-10-28T18:23:28.073318] [INFO ] [MAIN ] DTG: Loaded 5634 existing records. [2025-10-28T18:23:28.272154] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:23:28.272394] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-28T18:23:28.272442] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-28T18:23:28.272713] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-28T18:23:28.272774] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-28T18:23:28.353758] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T18:23:28.638545] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:28.759327] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-28T18:23:29.311893] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T18:23:29.559371] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-28T18:23:30.359321] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-28T18:23:30.441162] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T18:23:30.755082] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:23:31.159351] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-28T18:23:31.959444] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-28T18:23:32.266743] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T18:23:32.759313] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-28T18:23:32.920515] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T18:23:33.559312] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-28T18:23:33.649270] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T18:23:33.653967] [INFO ] [REMOTE ] DSX: Full fetch complete (35155 records). [2025-10-28T18:23:33.654053] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-28T18:23:34.044569] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-28T18:23:34.044715] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-28T18:23:34.045250] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-28T18:23:34.045291] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-28T18:23:34.046099] [DEBUG] [LOCAL ] DSX: Trimmed 35155 records to 23143 (keeping 200 days of data) [2025-10-28T18:23:34.138633] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T18:23:34.184021] [DEBUG] [LOCAL ] DSX: Primary data saved (23143 records). [2025-10-28T18:23:34.184149] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-28T18:23:34.184226] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DSX took 45.2s. Estimated remaining: 3h 36m 20s. Rate: 7.9 symbols/min [2025-10-28T18:23:34.353907] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:34.354063] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-28T18:23:34.354100] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-28T18:23:34.354209] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-28T18:23:34.354250] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-28T18:23:34.354292] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-28T18:23:34.354323] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-28T18:23:34.365147] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-28T18:23:34.722841] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:35.159348] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-28T18:23:35.311911] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:23:35.312210] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-28T18:23:35.312297] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:23:35.312347] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-28T18:23:35.312407] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:23:35.312480] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-28T18:23:35.312543] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-28T18:23:35.312579] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-28T18:23:35.312619] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-28T18:23:35.312693] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTK took 1.1s. Estimated remaining: 3h 35m 56s. Rate: 7.9 symbols/min [2025-10-28T18:23:35.497709] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:35.535922] [DEBUG] [LOCAL ] DTM: Loaded 43642 existing records from primary storage. [2025-10-28T18:23:35.536204] [INFO ] [MAIN ] DTM: Loaded 43642 existing records. [2025-10-28T18:23:35.726857] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:23:35.727110] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-28T18:23:35.727180] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-28T18:23:35.728237] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-28T18:23:35.728308] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-28T18:23:35.960602] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-28T18:23:36.137706] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:36.162536] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-28T18:23:36.442268] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:23:36.759354] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-28T18:23:37.181222] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:23:37.559334] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-28T18:23:37.968146] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:23:38.359330] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-28T18:23:39.159329] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-28T18:23:39.724550] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T18:23:39.959342] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-28T18:23:40.295103] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:23:40.295957] [INFO ] [REMOTE ] DTF: Full fetch complete (1713 records). [2025-10-28T18:23:40.296030] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-28T18:23:40.476398] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T18:23:40.476717] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:23:40.476799] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:23:40.476900] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-28T18:23:40.476967] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-28T18:23:40.477004] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-28T18:23:40.477043] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-28T18:23:40.477097] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTF took 25.9s. Estimated remaining: 3h 35m 42s. Rate: 7.9 symbols/min [2025-10-28T18:23:40.649584] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:40.655156] [DEBUG] [LOCAL ] DTW: Loaded 4638 existing records from primary storage. [2025-10-28T18:23:40.655370] [INFO ] [MAIN ] DTW: Loaded 4638 existing records. [2025-10-28T18:23:40.761069] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-28T18:23:40.836443] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:23:40.845675] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-28T18:23:40.858911] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-28T18:23:40.859568] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-28T18:23:40.859634] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-28T18:23:40.860410] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T18:23:40.953014] [INFO ] [REMOTE ] DTE: Full fetch complete (68478 records). [2025-10-28T18:23:40.973925] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-28T18:23:40.985918] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:23:40.996341] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:23:41.026609] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:23:41.052384] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-28T18:23:41.097695] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-28T18:23:41.118432] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-28T18:23:41.123957] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-28T18:23:41.130245] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTE took 45.3s. Estimated remaining: 3h 35m 17s. Rate: 7.9 symbols/min [2025-10-28T18:23:41.412532] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:41.416482] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:41.416592] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-28T18:23:41.421743] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T18:23:41.421552] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-28T18:23:41.422026] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-28T18:23:41.424283] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-28T18:23:41.424462] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-28T18:23:41.424507] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-28T18:23:41.564538] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-28T18:23:41.830978] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:42.008355] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T18:23:42.359333] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-28T18:23:43.159401] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-28T18:23:43.691811] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T18:23:43.959312] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-28T18:23:44.109497] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T18:23:44.338891] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:23:44.759346] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-28T18:23:45.559379] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-28T18:23:45.931396] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T18:23:46.002809] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T18:23:46.359379] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-28T18:23:47.159356] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-28T18:23:47.589211] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T18:23:47.730187] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:23:47.959360] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-28T18:23:48.371004] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:23:48.759372] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-28T18:23:49.248466] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:23:49.250313] [INFO ] [REMOTE ] DTG: Full fetch complete (8437 records). [2025-10-28T18:23:49.250389] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-28T18:23:49.564456] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-28T18:23:49.620784] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-28T18:23:49.620874] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-28T18:23:49.621094] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-28T18:23:49.621133] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-28T18:23:49.621604] [DEBUG] [LOCAL ] DTG: Trimmed 8437 records to 5605 (keeping 200 days of data) [2025-10-28T18:23:49.655876] [DEBUG] [LOCAL ] DTG: Primary data saved (5605 records). [2025-10-28T18:23:49.656012] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-28T18:23:49.656094] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DTG took 21.8s. Estimated remaining: 3h 35m 12s. Rate: 7.9 symbols/min [2025-10-28T18:23:49.824341] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:49.824563] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-28T18:23:49.824607] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-28T18:23:49.824866] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-28T18:23:49.824908] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-28T18:23:49.824948] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-28T18:23:49.824979] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-28T18:23:50.178233] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:50.359359] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-28T18:23:50.959052] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:23:51.159400] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-28T18:23:51.759310] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:23:51.959306] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-28T18:23:52.289223] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T18:23:52.362093] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:23:52.759335] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-28T18:23:53.343329] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T18:23:53.559427] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-28T18:23:54.359341] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-28T18:23:54.811242] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:23:54.843545] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T18:23:55.159345] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-28T18:23:55.546947] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:23:55.959342] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-28T18:23:56.759329] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-28T18:23:57.175788] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T18:23:57.563132] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-28T18:23:57.569369] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:23:58.359348] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-28T18:23:58.773162] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:23:58.832277] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T18:23:59.159358] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-28T18:23:59.537461] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:23:59.959336] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-28T18:24:00.358969] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:24:00.759344] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-28T18:24:01.275029] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T18:24:01.559377] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-28T18:24:02.095090] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T18:24:02.359471] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-28T18:24:02.781797] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T18:24:02.783357] [INFO ] [REMOTE ] DTW: Full fetch complete (6863 records). [2025-10-28T18:24:02.783451] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-28T18:24:02.784027] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:24:02.784138] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:24:02.784186] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:24:02.784247] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-28T18:24:02.784355] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-28T18:24:02.784436] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-28T18:24:02.784712] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-28T18:24:02.784832] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DTW took 22.3s. Estimated remaining: 3h 35m 18s. Rate: 7.9 symbols/min [2025-10-28T18:24:02.954913] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:03.003549] [DEBUG] [LOCAL ] DV: Loaded 51235 existing records from primary storage. [2025-10-28T18:24:03.003868] [INFO ] [MAIN ] DV: Loaded 51235 existing records. [2025-10-28T18:24:03.179587] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:03.159447] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-28T18:24:03.180067] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-28T18:24:03.180160] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-28T18:24:03.181942] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-28T18:24:03.182008] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-28T18:24:03.542663] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:03.741386] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T18:24:03.959351] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-28T18:24:04.759397] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-28T18:24:05.297533] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:24:05.559356] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-28T18:24:06.218582] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T18:24:06.359393] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-28T18:24:06.808910] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T18:24:06.836348] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:24:07.159339] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-28T18:24:07.557915] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:24:07.959388] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-28T18:24:08.759381] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-28T18:24:09.422410] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:24:09.559320] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-28T18:24:10.359319] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-28T18:24:10.519542] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T18:24:10.760687] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:24:10.770074] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:24:11.159340] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-28T18:24:11.959337] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-28T18:24:12.524631] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T18:24:12.526080] [INFO ] [REMOTE ] DUKB: Full fetch complete (8909 records). [2025-10-28T18:24:12.526319] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-28T18:24:12.771739] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-28T18:24:12.921805] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-28T18:24:12.921926] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-28T18:24:12.922280] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-28T18:24:12.922405] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-28T18:24:12.923178] [DEBUG] [LOCAL ] DUKB: Trimmed 8909 records to 5882 (keeping 200 days of data) [2025-10-28T18:24:12.984748] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-28T18:24:12.998508] [DEBUG] [LOCAL ] DUKB: Primary data saved (5882 records). [2025-10-28T18:24:12.998823] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-28T18:24:12.998924] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DUKB took 23.3s. Estimated remaining: 3h 35m 17s. Rate: 7.9 symbols/min [2025-10-28T18:24:13.169875] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:13.170020] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-10-28T18:24:13.170074] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-10-28T18:24:13.170182] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-28T18:24:13.170247] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-28T18:24:13.170311] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-28T18:24:13.170357] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-28T18:24:13.529111] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:13.559294] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-28T18:24:14.035197] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:24:14.359379] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-28T18:24:14.688137] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:24:15.159430] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-28T18:24:15.959325] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-28T18:24:16.029048] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T18:24:16.681350] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T18:24:16.759330] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-28T18:24:17.352164] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:24:17.361222] [INFO ] [REMOTE ] DTM: Full fetch complete (65278 records). [2025-10-28T18:24:17.361329] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-28T18:24:17.564512] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-28T18:24:17.749264] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-28T18:24:17.749331] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-28T18:24:17.750092] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-28T18:24:17.750152] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-28T18:24:17.751284] [DEBUG] [LOCAL ] DTM: Trimmed 65278 records to 43576 (keeping 200 days of data) [2025-10-28T18:24:18.012329] [DEBUG] [LOCAL ] DTM: Primary data saved (43576 records). [2025-10-28T18:24:18.012447] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-28T18:24:18.012520] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DTM took 42.7s. Estimated remaining: 3h 35m 3s. Rate: 7.9 symbols/min [2025-10-28T18:24:18.176551] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:18.224087] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-28T18:24:18.224371] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-28T18:24:18.362197] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-28T18:24:18.407504] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:18.408125] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-28T18:24:18.408254] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-28T18:24:18.409149] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-28T18:24:18.409216] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-28T18:24:18.727589] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-28T18:24:18.812596] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:19.067613] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T18:24:19.159294] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-28T18:24:19.766608] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T18:24:19.959340] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-28T18:24:20.496395] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:24:20.759321] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-28T18:24:21.559365] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-28T18:24:21.681638] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T18:24:22.364421] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-28T18:24:22.380852] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T18:24:22.848377] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T18:24:23.159358] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-28T18:24:23.666986] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:24:23.959394] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-28T18:24:24.641874] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:24:24.759325] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-28T18:24:25.559449] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-28T18:24:25.862802] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T18:24:25.873391] [INFO ] [REMOTE ] DUK: Full fetch complete (77557 records). [2025-10-28T18:24:25.873511] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-28T18:24:26.275409] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-28T18:24:26.275673] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-28T18:24:26.276710] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-28T18:24:26.286959] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-28T18:24:26.306950] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:24:26.318633] [DEBUG] [LOCAL ] DUK: Trimmed 77557 records to 53418 (keeping 200 days of data) [2025-10-28T18:24:26.373187] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-28T18:24:26.645609] [DEBUG] [LOCAL ] DUK: Primary data saved (53418 records). [2025-10-28T18:24:26.645790] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-28T18:24:26.645885] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DUK took 45.5s. Estimated remaining: 3h 34m 58s. Rate: 7.9 symbols/min [2025-10-28T18:24:26.819047] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:26.819238] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-28T18:24:26.819275] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-28T18:24:26.819385] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-28T18:24:26.819426] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-28T18:24:26.819467] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-28T18:24:26.819498] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-28T18:24:27.167835] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-28T18:24:27.210475] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:27.256611] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T18:24:27.633229] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:24:27.959347] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-28T18:24:28.634324] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:24:28.759382] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-28T18:24:29.559334] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-28T18:24:29.667279] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T18:24:30.359402] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-28T18:24:30.495535] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T18:24:31.159315] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-28T18:24:31.218021] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:24:31.228286] [INFO ] [REMOTE ] DV: Full fetch complete (73903 records). [2025-10-28T18:24:31.228425] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-28T18:24:31.609842] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-28T18:24:31.609927] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-28T18:24:31.610812] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-28T18:24:31.610873] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-28T18:24:31.612340] [DEBUG] [LOCAL ] DV: Trimmed 73903 records to 51217 (keeping 200 days of data) [2025-10-28T18:24:31.937665] [DEBUG] [LOCAL ] DV: Primary data saved (51217 records). [2025-10-28T18:24:31.938315] [INFO ] [MAIN ] DV: Full history saved. [2025-10-28T18:24:31.939518] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DV took 29.2s. Estimated remaining: 3h 34m 45s. Rate: 7.9 symbols/min [2025-10-28T18:24:31.939305] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T18:24:31.970344] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-28T18:24:32.118356] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:32.163052] [DEBUG] [LOCAL ] DXC: Loaded 49831 existing records from primary storage. [2025-10-28T18:24:32.163344] [INFO ] [MAIN ] DXC: Loaded 49831 existing records. [2025-10-28T18:24:32.359740] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:32.360064] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-28T18:24:32.360198] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-28T18:24:32.360889] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-28T18:24:32.360950] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-28T18:24:32.517590] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T18:24:32.765743] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-28T18:24:32.789757] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:33.559405] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-28T18:24:33.862294] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T18:24:33.945134] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:24:34.359314] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-28T18:24:34.957796] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:24:35.159339] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-28T18:24:35.959299] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-28T18:24:36.117862] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T18:24:36.759314] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-28T18:24:36.834270] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T18:24:37.185751] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:24:37.559356] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-28T18:24:38.037810] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:24:38.359396] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-28T18:24:39.102767] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:24:39.159327] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-28T18:24:39.677719] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T18:24:39.959351] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-28T18:24:40.759419] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-28T18:24:40.967066] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T18:24:41.141740] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:24:41.559333] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-28T18:24:41.750808] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T18:24:42.359341] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-28T18:24:43.111349] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T18:24:43.159314] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-28T18:24:43.460152] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T18:24:43.959345] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-28T18:24:44.759598] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-28T18:24:44.762681] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T18:24:45.258428] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T18:24:45.266525] [INFO ] [REMOTE ] DVA: Full fetch complete (59601 records). [2025-10-28T18:24:45.266722] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-28T18:24:45.564474] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-28T18:24:45.667226] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-28T18:24:45.667305] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-28T18:24:45.668101] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-28T18:24:45.668162] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-28T18:24:45.669386] [DEBUG] [LOCAL ] DVA: Trimmed 59601 records to 40399 (keeping 200 days of data) [2025-10-28T18:24:45.909365] [DEBUG] [LOCAL ] DVA: Primary data saved (40399 records). [2025-10-28T18:24:45.909495] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-28T18:24:45.909595] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DVA took 32.9s. Estimated remaining: 3h 34m 53s. Rate: 7.9 symbols/min [2025-10-28T18:24:46.080462] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:46.108842] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T18:24:46.147222] [DEBUG] [LOCAL ] DXYZ: Loaded 36706 existing records from primary storage. [2025-10-28T18:24:46.147540] [INFO ] [MAIN ] DXYZ: Loaded 36706 existing records. [2025-10-28T18:24:46.321842] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:46.322057] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-28T18:24:46.322105] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-28T18:24:46.322995] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-28T18:24:46.323055] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-28T18:24:46.367180] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-28T18:24:46.692043] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:47.159303] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-28T18:24:47.223785] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T18:24:47.793559] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:24:47.959354] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-28T18:24:48.639005] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:24:48.759350] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-28T18:24:49.559344] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-28T18:24:50.053993] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T18:24:50.219536] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:24:50.359315] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-28T18:24:51.171927] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-28T18:24:51.177750] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T18:24:51.729015] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:24:51.959387] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-28T18:24:52.759319] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-28T18:24:52.980283] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T18:24:52.990903] [INFO ] [REMOTE ] DX: Full fetch complete (75927 records). [2025-10-28T18:24:52.991031] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-28T18:24:53.384195] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-28T18:24:53.384365] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-28T18:24:53.385322] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-28T18:24:53.385399] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-28T18:24:53.411509] [DEBUG] [LOCAL ] DX: Trimmed 75927 records to 52482 (keeping 200 days of data) [2025-10-28T18:24:53.413212] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T18:24:53.591573] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-28T18:24:53.737048] [DEBUG] [LOCAL ] DX: Primary data saved (52482 records). [2025-10-28T18:24:53.737179] [INFO ] [MAIN ] DX: Full history saved. [2025-10-28T18:24:53.737249] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DX took 27.1s. Estimated remaining: 3h 34m 46s. Rate: 7.9 symbols/min [2025-10-28T18:24:53.904107] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:53.929205] [DEBUG] [LOCAL ] DY: Loaded 27690 existing records from primary storage. [2025-10-28T18:24:53.929452] [INFO ] [MAIN ] DY: Loaded 27690 existing records. [2025-10-28T18:24:54.105721] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:54.105919] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-28T18:24:54.105966] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-28T18:24:54.106782] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-28T18:24:54.106838] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-28T18:24:54.369805] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-28T18:24:54.489164] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:54.519614] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T18:24:54.889424] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:24:55.159336] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-28T18:24:55.959358] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-28T18:24:56.052438] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:24:56.144469] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T18:24:56.759345] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-28T18:24:57.569363] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-28T18:24:57.601898] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T18:24:57.810352] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:24:58.359358] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-28T18:24:59.137196] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:24:59.147127] [INFO ] [REMOTE ] DXC: Full fetch complete (70472 records). [2025-10-28T18:24:59.147282] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-28T18:24:59.169534] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-28T18:24:59.575069] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-28T18:24:59.575153] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-28T18:24:59.576158] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-28T18:24:59.576236] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-28T18:24:59.577987] [DEBUG] [LOCAL ] DXC: Trimmed 70472 records to 49802 (keeping 200 days of data) [2025-10-28T18:24:59.879155] [DEBUG] [LOCAL ] DXC: Primary data saved (49802 records). [2025-10-28T18:24:59.879287] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-28T18:24:59.879364] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXC took 27.9s. Estimated remaining: 3h 34m 35s. Rate: 7.9 symbols/min [2025-10-28T18:24:59.972594] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-28T18:25:00.060130] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:00.089717] [DEBUG] [LOCAL ] E: Loaded 32833 existing records from primary storage. [2025-10-28T18:25:00.089982] [INFO ] [MAIN ] E: Loaded 32833 existing records. [2025-10-28T18:25:00.269168] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:00.269484] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-28T18:25:00.269563] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-28T18:25:00.282191] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-28T18:25:00.287398] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-28T18:25:00.397397] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T18:25:00.692713] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:00.717413] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T18:25:00.759375] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-28T18:25:01.559331] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-28T18:25:01.702157] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:25:02.003085] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T18:25:02.015009] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-28T18:25:02.015383] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-28T18:25:02.365122] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-28T18:25:02.425293] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-28T18:25:02.425412] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-28T18:25:02.426389] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-28T18:25:02.426454] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-28T18:25:02.428141] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 53699 (keeping 200 days of data) [2025-10-28T18:25:02.751830] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-28T18:25:02.751971] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-28T18:25:02.752048] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. DVN took 44.7s. Estimated remaining: 3h 34m 16s. Rate: 7.9 symbols/min [2025-10-28T18:25:02.918790] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:02.953441] [DEBUG] [LOCAL ] EAF: Loaded 40545 existing records from primary storage. [2025-10-28T18:25:02.953731] [INFO ] [MAIN ] EAF: Loaded 40545 existing records. [2025-10-28T18:25:03.135524] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:03.135771] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-28T18:25:03.135824] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-28T18:25:03.136415] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-28T18:25:03.136474] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-28T18:25:03.166202] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-28T18:25:03.532973] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:03.534771] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-28T18:25:03.563617] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:25:03.959364] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-28T18:25:04.400364] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:25:04.759352] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-28T18:25:04.835097] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:25:05.559381] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-28T18:25:05.903672] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:25:06.359347] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-28T18:25:07.159339] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-28T18:25:07.213198] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T18:25:07.260935] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:25:07.959364] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-28T18:25:08.448611] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T18:25:08.759372] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-28T18:25:09.533230] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T18:25:09.559308] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-28T18:25:09.857271] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T18:25:10.359379] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-28T18:25:11.159317] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-28T18:25:11.731448] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-28T18:25:11.959340] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-28T18:25:12.067666] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T18:25:12.534810] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:25:12.759399] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-28T18:25:13.551583] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:25:13.559219] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-28T18:25:14.063147] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:25:14.359347] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-28T18:25:15.159389] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-28T18:25:15.254123] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-28T18:25:15.819332] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:25:15.959374] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-28T18:25:16.187838] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:25:16.759350] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-28T18:25:17.420503] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:25:17.559344] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-28T18:25:17.792683] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T18:25:18.359367] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-28T18:25:18.973580] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T18:25:19.159349] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-28T18:25:19.772979] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:25:19.959339] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-28T18:25:20.394887] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T18:25:20.759369] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-28T18:25:21.559353] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-28T18:25:21.616755] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T18:25:21.933130] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-28T18:25:21.941237] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56186 records). [2025-10-28T18:25:21.941408] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-28T18:25:22.318109] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-28T18:25:22.318188] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-28T18:25:22.318901] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-28T18:25:22.318962] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-28T18:25:22.320086] [DEBUG] [LOCAL ] DXYZ: Trimmed 56186 records to 36619 (keeping 200 days of data) [2025-10-28T18:25:22.367107] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-28T18:25:22.536422] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36619 records). [2025-10-28T18:25:22.536539] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-28T18:25:22.536639] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. DXYZ took 36.6s. Estimated remaining: 3h 34m 39s. Rate: 7.9 symbols/min [2025-10-28T18:25:22.697152] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T18:25:22.725628] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:22.726386] [INFO ] [REMOTE ] DY: Full fetch complete (43187 records). [2025-10-28T18:25:22.726549] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-28T18:25:22.834679] [DEBUG] [LOCAL ] EAI: Loaded 3807 existing records from primary storage. [2025-10-28T18:25:22.837597] [INFO ] [MAIN ] EAI: Loaded 3807 existing records. [2025-10-28T18:25:23.182943] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-28T18:25:23.213803] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:23.233593] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-28T18:25:23.239453] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-28T18:25:23.250337] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-28T18:25:23.255551] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-28T18:25:23.443824] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-28T18:25:23.448671] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-28T18:25:23.449461] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-28T18:25:23.455211] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-28T18:25:23.603031] [DEBUG] [LOCAL ] DY: Trimmed 43187 records to 27594 (keeping 200 days of data) [2025-10-28T18:25:23.851455] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:23.863278] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:25:23.870972] [INFO ] [REMOTE ] EAF: Full fetch complete (61583 records). [2025-10-28T18:25:23.874983] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-28T18:25:23.964682] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-28T18:25:24.076969] [DEBUG] [LOCAL ] DY: Primary data saved (27594 records). [2025-10-28T18:25:24.095341] [INFO ] [MAIN ] DY: Full history saved. [2025-10-28T18:25:24.105779] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. DY took 30.4s. Estimated remaining: 3h 34m 16s. Rate: 7.9 symbols/min [2025-10-28T18:25:24.504999] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:24.547756] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-28T18:25:24.555571] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-28T18:25:24.556592] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-28T18:25:24.555487] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T18:25:24.568024] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-28T18:25:24.571812] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T18:25:24.590701] [DEBUG] [LOCAL ] EAF: Trimmed 61583 records to 40560 (keeping 200 days of data) [2025-10-28T18:25:24.703843] [DEBUG] [LOCAL ] EARN: Loaded 27168 existing records from primary storage. [2025-10-28T18:25:24.712370] [INFO ] [MAIN ] EARN: Loaded 27168 existing records. [2025-10-28T18:25:24.789934] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-28T18:25:24.986156] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:24.990017] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-28T18:25:24.990094] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-28T18:25:24.991387] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-28T18:25:24.991458] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-28T18:25:25.161808] [DEBUG] [LOCAL ] EAF: Primary data saved (40560 records). [2025-10-28T18:25:25.172605] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-28T18:25:25.183032] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. EAF took 22.4s. Estimated remaining: 3h 33m 52s. Rate: 7.9 symbols/min [2025-10-28T18:25:25.531145] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:25.552266] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:25.559371] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-28T18:25:25.596529] [DEBUG] [LOCAL ] EAT: Loaded 49667 existing records from primary storage. [2025-10-28T18:25:25.596907] [INFO ] [MAIN ] EAT: Loaded 49667 existing records. [2025-10-28T18:25:25.774631] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:25.774842] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-28T18:25:25.774888] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-28T18:25:25.775697] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-28T18:25:25.775754] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-28T18:25:26.150932] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:26.154583] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T18:25:26.359322] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-28T18:25:26.743294] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:25:27.159311] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-28T18:25:27.798051] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:25:27.959351] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-28T18:25:28.223334] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:25:28.759324] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-28T18:25:29.353198] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:25:29.559332] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-28T18:25:30.086283] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:25:30.359393] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-28T18:25:30.835694] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T18:25:30.835458] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:25:31.159335] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-28T18:25:31.959342] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-28T18:25:32.175887] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T18:25:32.759330] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-28T18:25:33.295614] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T18:25:33.559327] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-28T18:25:33.832667] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T18:25:33.966252] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T18:25:34.359382] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-28T18:25:34.859463] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T18:25:35.159397] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-28T18:25:35.547789] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T18:25:35.959369] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-28T18:25:36.333169] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T18:25:36.759365] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-28T18:25:37.209674] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T18:25:37.559346] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-28T18:25:38.359347] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-28T18:25:38.921769] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:25:38.928221] [INFO ] [REMOTE ] E: Full fetch complete (47560 records). [2025-10-28T18:25:38.928345] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-28T18:25:39.167848] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-28T18:25:39.322947] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-28T18:25:39.323025] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-28T18:25:39.323734] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-28T18:25:39.323798] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-28T18:25:39.324933] [DEBUG] [LOCAL ] E: Trimmed 47560 records to 32661 (keeping 200 days of data) [2025-10-28T18:25:39.523971] [DEBUG] [LOCAL ] E: Primary data saved (32661 records). [2025-10-28T18:25:39.524109] [INFO ] [MAIN ] E: Full history saved. [2025-10-28T18:25:39.524190] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. E took 39.6s. Estimated remaining: 3h 34m 1s. Rate: 7.9 symbols/min [2025-10-28T18:25:39.690109] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:39.719982] [DEBUG] [LOCAL ] EB: Loaded 35786 existing records from primary storage. [2025-10-28T18:25:39.720238] [INFO ] [MAIN ] EB: Loaded 35786 existing records. [2025-10-28T18:25:39.902588] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:39.902996] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-28T18:25:39.903160] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-28T18:25:39.903815] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-28T18:25:39.903874] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-28T18:25:39.965964] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-28T18:25:40.277230] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:40.311217] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-28T18:25:40.383803] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T18:25:40.593789] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T18:25:40.759316] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-28T18:25:41.559344] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-28T18:25:42.213418] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:25:42.359318] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-28T18:25:42.825384] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T18:25:43.159358] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-28T18:25:43.810770] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T18:25:43.959337] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-28T18:25:44.244830] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:25:44.759386] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-28T18:25:44.992630] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T18:25:45.224091] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T18:25:45.559324] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-28T18:25:46.359335] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-28T18:25:46.832802] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T18:25:46.833988] [INFO ] [REMOTE ] EAI: Full fetch complete (5646 records). [2025-10-28T18:25:46.834055] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-28T18:25:46.834389] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:25:46.834480] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:25:46.834560] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:25:46.834684] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-28T18:25:46.834765] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-28T18:25:46.834803] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-28T18:25:46.834949] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-28T18:25:46.835018] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EAI took 24.3s. Estimated remaining: 3h 33m 53s. Rate: 7.9 symbols/min [2025-10-28T18:25:47.005264] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T18:25:47.159327] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-28T18:25:47.959387] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-28T18:25:48.541626] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:25:48.759381] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-28T18:25:49.052394] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:25:49.564441] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-28T18:25:49.576218] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T18:25:50.359363] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-28T18:25:50.985495] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:25:51.159320] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-28T18:25:51.258916] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T18:25:51.959339] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-28T18:25:52.272132] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:25:52.759302] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-28T18:25:52.869431] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T18:25:53.559322] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-28T18:25:53.742690] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T18:25:54.359326] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-28T18:25:55.036459] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:25:55.147343] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T18:25:55.159300] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-28T18:25:55.959330] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-28T18:25:56.234540] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T18:25:56.240509] [INFO ] [REMOTE ] EARN: Full fetch complete (44741 records). [2025-10-28T18:25:56.240721] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-28T18:25:56.241361] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:25:56.241447] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:25:56.241491] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:25:56.241563] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-28T18:25:56.241627] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-28T18:25:56.241707] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-28T18:25:56.241918] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-28T18:25:56.242018] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EARN took 32.1s. Estimated remaining: 3h 33m 50s. Rate: 7.9 symbols/min [2025-10-28T18:25:56.759337] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-28T18:25:57.118944] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:25:57.559319] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-28T18:25:58.471909] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:25:58.481691] [INFO ] [REMOTE ] EAT: Full fetch complete (72477 records). [2025-10-28T18:25:58.481822] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-28T18:25:58.841919] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T18:25:58.910727] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-28T18:25:58.910920] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-28T18:25:58.911775] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-28T18:25:58.911851] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-28T18:25:58.912144] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-28T18:25:58.914003] [DEBUG] [LOCAL ] EAT: Trimmed 72477 records to 49680 (keeping 200 days of data) [2025-10-28T18:25:59.200829] [DEBUG] [LOCAL ] EAT: Primary data saved (49680 records). [2025-10-28T18:25:59.200947] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-28T18:25:59.201029] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EAT took 34.0s. Estimated remaining: 3h 33m 31s. Rate: 7.9 symbols/min [2025-10-28T18:25:59.949619] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:25:59.956900] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-28T18:26:01.326206] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T18:26:01.332704] [INFO ] [REMOTE ] EB: Full fetch complete (54587 records). [2025-10-28T18:26:01.332794] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-28T18:26:01.701474] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-28T18:26:01.701539] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-28T18:26:01.702365] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-28T18:26:01.702435] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-28T18:26:01.703533] [DEBUG] [LOCAL ] EB: Trimmed 54587 records to 35675 (keeping 200 days of data) [2025-10-28T18:26:01.896112] [DEBUG] [LOCAL ] EB: Primary data saved (35675 records). [2025-10-28T18:26:01.896243] [INFO ] [MAIN ] EB: Full history saved. [2025-10-28T18:26:01.896319] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EB took 22.4s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-28T18:26:02.502129] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.592163] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.617770] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.626329] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-10-28T18:26:02.644553] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.645541] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-10-28T18:26:02.646468] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-28T18:26:02.646521] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-28T18:26:02.646918] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-10-28T18:26:02.646997] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-28T18:26:02.841982] [DEBUG] [LOCAL ] EBF: Loaded 19197 existing records from primary storage. [2025-10-28T18:26:02.859724] [INFO ] [MAIN ] EBF: Loaded 19197 existing records. [2025-10-28T18:26:03.051350] [DEBUG] [LOCAL ] EBS: Loaded 46495 existing records from primary storage. [2025-10-28T18:26:03.105583] [INFO ] [MAIN ] EBS: Loaded 46495 existing records. [2025-10-28T18:26:03.068798] [DEBUG] [LOCAL ] EC: Loaded 48770 existing records from primary storage. [2025-10-28T18:26:03.116233] [INFO ] [MAIN ] EC: Loaded 48770 existing records. [2025-10-28T18:26:03.382968] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:03.438974] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:03.442875] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-28T18:26:03.448150] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-28T18:26:03.442779] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-28T18:26:03.454836] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-28T18:26:03.475904] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-28T18:26:03.661344] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:03.713420] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-28T18:26:03.732772] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:03.736197] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-28T18:26:03.736313] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-28T18:26:03.736447] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-28T18:26:03.736798] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-28T18:26:03.736887] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-28T18:26:03.758584] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-28T18:26:03.778214] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-28T18:26:04.594258] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:04.612088] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-28T18:26:04.735861] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:04.739010] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-28T18:26:04.769690] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:04.770110] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-28T18:26:05.131772] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T18:26:05.140450] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-28T18:26:05.429453] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:26:05.433557] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-28T18:26:06.001484] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:26:06.010569] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-28T18:26:06.195048] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:26:06.199749] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-28T18:26:06.248177] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:26:06.328266] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T18:26:06.359295] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-28T18:26:06.939418] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:26:07.106615] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:26:07.159323] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-28T18:26:07.721345] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T18:26:07.959340] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-28T18:26:08.509633] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:26:08.759306] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-28T18:26:08.863154] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T18:26:09.559324] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-28T18:26:09.924442] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T18:26:10.359386] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-28T18:26:10.948154] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:26:11.159332] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-28T18:26:11.216140] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:26:11.959331] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-28T18:26:12.676988] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:26:12.759327] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-28T18:26:13.350069] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:26:13.559354] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-28T18:26:14.278223] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:26:14.359308] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-28T18:26:14.459298] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:26:15.159341] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-28T18:26:15.713676] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:26:15.959299] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-28T18:26:16.098689] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T18:26:16.759315] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-28T18:26:17.453331] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T18:26:17.481991] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T18:26:17.559324] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-28T18:26:18.359338] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-28T18:26:19.100981] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:26:19.159333] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-28T18:26:19.677733] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:26:19.845348] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:26:19.959362] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-28T18:26:20.759338] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-28T18:26:21.559320] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-28T18:26:21.632453] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T18:26:21.909185] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T18:26:22.359394] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-28T18:26:22.813870] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:26:23.159388] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-28T18:26:23.639854] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:26:23.959363] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-28T18:26:24.612638] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:26:24.759384] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-28T18:26:25.054847] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:26:25.059693] [INFO ] [REMOTE ] EBF: Full fetch complete (28275 records). [2025-10-28T18:26:25.059769] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-28T18:26:25.060205] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:26:25.060282] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:25.060324] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:25.060362] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-28T18:26:25.060436] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-28T18:26:25.060471] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-28T18:26:25.060620] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-28T18:26:25.060723] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. EBF took 23.2s. Estimated remaining: 3h 33m 42s. Rate: 7.9 symbols/min [2025-10-28T18:26:25.232061] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:25.259955] [DEBUG] [LOCAL ] ECAT: Loaded 28876 existing records from primary storage. [2025-10-28T18:26:25.260215] [INFO ] [MAIN ] ECAT: Loaded 28876 existing records. [2025-10-28T18:26:25.431603] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:25.431825] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-28T18:26:25.431874] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-28T18:26:25.432445] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-28T18:26:25.432501] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-28T18:26:25.567455] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-28T18:26:25.782979] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:25.847966] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:26:26.359344] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-28T18:26:26.852361] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T18:26:27.159342] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-28T18:26:27.549356] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:26:27.959395] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-28T18:26:28.467765] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:26:28.759307] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-28T18:26:28.932613] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:26:29.559350] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-28T18:26:30.359323] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-28T18:26:30.387849] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:26:30.421509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:26:30.430541] [INFO ] [REMOTE ] EBS: Full fetch complete (67374 records). [2025-10-28T18:26:30.430704] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-28T18:26:30.844700] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-28T18:26:30.844800] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-28T18:26:30.845600] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-28T18:26:30.845665] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-28T18:26:30.847240] [DEBUG] [LOCAL ] EBS: Trimmed 67374 records to 46486 (keeping 200 days of data) [2025-10-28T18:26:31.101056] [DEBUG] [LOCAL ] EBS: Primary data saved (46486 records). [2025-10-28T18:26:31.101185] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-28T18:26:31.101265] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. EBS took 29.2s. Estimated remaining: 3h 33m 31s. Rate: 7.9 symbols/min [2025-10-28T18:26:31.159395] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-28T18:26:31.271746] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:31.271938] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-10-28T18:26:31.271980] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-10-28T18:26:31.272087] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-28T18:26:31.272126] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-28T18:26:31.272165] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-28T18:26:31.272197] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-28T18:26:31.613665] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:31.964570] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-28T18:26:31.982723] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:26:31.995722] [INFO ] [REMOTE ] EC: Full fetch complete (71512 records). [2025-10-28T18:26:31.995899] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-28T18:26:31.996553] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:26:31.996688] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:31.996757] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:31.996840] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-28T18:26:31.996927] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-28T18:26:31.996967] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-28T18:26:31.997124] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-28T18:26:31.997235] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EC took 30.1s. Estimated remaining: 3h 33m 6s. Rate: 7.9 symbols/min [2025-10-28T18:26:32.176969] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:32.177246] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-28T18:26:32.177296] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-28T18:26:32.177401] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-28T18:26:32.177440] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-28T18:26:32.177480] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-28T18:26:32.177511] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-28T18:26:32.435439] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:26:32.593297] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:32.759381] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-28T18:26:33.081808] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T18:26:33.228547] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:26:33.559344] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-28T18:26:33.783764] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T18:26:34.359404] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-28T18:26:35.159348] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-28T18:26:35.232163] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T18:26:35.959424] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-28T18:26:36.521553] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T18:26:36.759386] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-28T18:26:37.053737] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:26:37.559311] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-28T18:26:37.619785] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:26:38.359387] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-28T18:26:38.935252] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T18:26:39.159326] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-28T18:26:39.543490] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:26:39.959345] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-28T18:26:40.192083] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T18:26:40.524961] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T18:26:40.759329] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-28T18:26:41.559333] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-28T18:26:41.792941] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T18:26:42.015501] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:26:42.359336] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-28T18:26:43.159352] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-28T18:26:43.755026] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:26:43.959345] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-28T18:26:44.463671] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T18:26:44.475488] [INFO ] [REMOTE ] EBR: Full fetch complete (62376 records). [2025-10-28T18:26:44.475700] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-28T18:26:44.764450] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-28T18:26:44.892149] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-28T18:26:44.892241] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-28T18:26:44.893027] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-28T18:26:44.893091] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-28T18:26:44.894385] [DEBUG] [LOCAL ] EBR: Trimmed 62376 records to 43196 (keeping 200 days of data) [2025-10-28T18:26:45.137109] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T18:26:45.150224] [DEBUG] [LOCAL ] EBR: Primary data saved (43196 records). [2025-10-28T18:26:45.150555] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-28T18:26:45.150712] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EBR took 43.3s. Estimated remaining: 3h 33m 12s. Rate: 7.9 symbols/min [2025-10-28T18:26:45.345412] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:45.347808] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:26:45.360554] [DEBUG] [LOCAL ] ECCU: Loaded 2087 existing records from primary storage. [2025-10-28T18:26:45.360781] [INFO ] [MAIN ] ECCU: Loaded 2087 existing records. [2025-10-28T18:26:45.539053] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:45.539314] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-28T18:26:45.539373] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-28T18:26:45.539499] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-28T18:26:45.539537] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-28T18:26:45.568721] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-28T18:26:45.897686] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:46.359395] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-28T18:26:46.608673] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-28T18:26:46.721125] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T18:26:47.159357] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-28T18:26:47.959394] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-28T18:26:48.639426] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:26:48.759407] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-28T18:26:48.985495] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:26:49.559335] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-28T18:26:49.788860] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T18:26:49.865503] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T18:26:50.359335] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-28T18:26:50.727192] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T18:26:51.159345] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-28T18:26:51.959398] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-28T18:26:52.195140] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T18:26:52.759332] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-28T18:26:53.196236] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:26:53.559313] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-28T18:26:53.686683] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T18:26:53.930141] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T18:26:54.359334] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-28T18:26:55.159318] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-28T18:26:55.277502] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T18:26:55.282902] [INFO ] [REMOTE ] ECAT: Full fetch complete (42600 records). [2025-10-28T18:26:55.283008] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-28T18:26:55.283581] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:26:55.283687] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:55.283737] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:55.283799] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-28T18:26:55.283862] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-28T18:26:55.283896] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-28T18:26:55.284086] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-28T18:26:55.284187] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECAT took 30.2s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-28T18:26:55.454118] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:55.454304] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-28T18:26:55.454342] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-28T18:26:55.454470] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-28T18:26:55.454540] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-28T18:26:55.454632] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-28T18:26:55.454728] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-28T18:26:55.579155] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:26:55.816718] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:55.959324] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-28T18:26:56.291321] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T18:26:56.759332] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-28T18:26:57.559342] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-28T18:26:57.845517] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:26:58.359281] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-28T18:26:58.407140] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T18:26:58.415897] [INFO ] [REMOTE ] ECC: Full fetch complete (61592 records). [2025-10-28T18:26:58.416004] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-28T18:26:58.743752] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T18:26:58.757354] [INFO ] [REMOTE ] ECCC: Full fetch complete (1312 records). [2025-10-28T18:26:58.773585] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-28T18:26:58.855626] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-28T18:26:58.861150] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-28T18:26:58.872898] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-28T18:26:58.891663] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-28T18:26:58.942935] [DEBUG] [LOCAL ] ECC: Trimmed 61592 records to 43047 (keeping 200 days of data) [2025-10-28T18:26:58.972050] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T18:26:59.017625] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:59.026090] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:59.026206] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-28T18:26:59.052882] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-28T18:26:59.056517] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-28T18:26:59.060727] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-28T18:26:59.063711] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCC took 27.1s. Estimated remaining: 3h 32m 54s. Rate: 7.9 symbols/min [2025-10-28T18:26:59.164450] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-28T18:26:59.356504] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:59.365780] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-28T18:26:59.369107] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-28T18:26:59.376819] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-28T18:26:59.378909] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-28T18:26:59.378969] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-28T18:26:59.385519] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-28T18:26:59.492924] [DEBUG] [LOCAL ] ECC: Primary data saved (43047 records). [2025-10-28T18:26:59.495251] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-28T18:26:59.495571] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECC took 28.4s. Estimated remaining: 3h 32m 29s. Rate: 7.9 symbols/min [2025-10-28T18:26:59.666967] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T18:26:59.859363] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:59.930981] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:59.953116] [DEBUG] [LOCAL ] ECG: Loaded 32450 existing records from primary storage. [2025-10-28T18:26:59.953353] [INFO ] [MAIN ] ECG: Loaded 32450 existing records. [2025-10-28T18:26:59.964530] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-28T18:27:00.130450] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:00.130765] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-28T18:27:00.130826] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-28T18:27:00.131523] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-28T18:27:00.131583] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-28T18:27:00.412357] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T18:27:00.490322] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:00.759302] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-28T18:27:01.559379] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-28T18:27:01.793710] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:27:01.967127] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T18:27:02.359319] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-28T18:27:02.587092] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-28T18:27:03.159363] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-28T18:27:03.959341] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-28T18:27:04.183374] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T18:27:04.313205] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:27:04.759326] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-28T18:27:04.984553] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T18:27:05.559345] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-28T18:27:05.807411] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-28T18:27:06.359394] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-28T18:27:06.738076] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T18:27:07.159407] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-28T18:27:07.959415] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-28T18:27:08.232234] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T18:27:08.236493] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:27:08.759358] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-28T18:27:09.559337] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-28T18:27:09.799016] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T18:27:09.892793] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T18:27:10.359339] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-28T18:27:10.744976] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T18:27:11.159337] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-28T18:27:11.440360] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T18:27:11.959349] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-28T18:27:12.238023] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:27:12.759422] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-28T18:27:13.119717] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:27:13.559325] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-28T18:27:13.896131] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:27:13.897065] [INFO ] [REMOTE ] ECCU: Full fetch complete (3961 records). [2025-10-28T18:27:13.897133] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-28T18:27:14.278054] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-28T18:27:14.278128] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-28T18:27:14.278260] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-28T18:27:14.278297] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-28T18:27:14.278621] [DEBUG] [LOCAL ] ECCU: Trimmed 3961 records to 2068 (keeping 200 days of data) [2025-10-28T18:27:14.291304] [DEBUG] [LOCAL ] ECCU: Primary data saved (2068 records). [2025-10-28T18:27:14.291364] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-28T18:27:14.291427] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCU took 29.1s. Estimated remaining: 3h 32m 39s. Rate: 7.9 symbols/min [2025-10-28T18:27:14.364465] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-28T18:27:14.460238] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:14.500014] [DEBUG] [LOCAL ] ECL: Loaded 46631 existing records from primary storage. [2025-10-28T18:27:14.500326] [INFO ] [MAIN ] ECL: Loaded 46631 existing records. [2025-10-28T18:27:14.672352] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:14.672532] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-28T18:27:14.672578] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-28T18:27:14.673447] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-28T18:27:14.673504] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-28T18:27:15.026055] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:15.159347] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-28T18:27:15.487837] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T18:27:15.583721] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T18:27:15.959374] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-28T18:27:16.739851] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:27:16.759297] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-28T18:27:17.559322] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-28T18:27:17.624157] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T18:27:18.359346] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-28T18:27:18.605904] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T18:27:19.066499] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:27:19.159314] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-28T18:27:19.351394] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-10-28T18:27:19.959339] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-28T18:27:20.759352] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-28T18:27:21.354989] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T18:27:21.559324] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-28T18:27:21.703917] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T18:27:22.359331] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-28T18:27:22.656015] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:27:22.763919] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:27:23.159335] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-28T18:27:23.472283] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T18:27:23.959336] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-28T18:27:24.759328] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-28T18:27:24.989442] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T18:27:25.320218] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:27:25.559314] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-28T18:27:26.359463] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-28T18:27:26.814334] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T18:27:26.815263] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-28T18:27:26.815396] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-28T18:27:27.008241] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-28T18:27:27.008572] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:27:27.008717] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:27:27.008871] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-28T18:27:27.008938] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-28T18:27:27.041037] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-28T18:27:27.045133] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-28T18:27:27.045261] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECCW took 31.8s. Estimated remaining: 3h 32m 44s. Rate: 7.9 symbols/min [2025-10-28T18:27:27.071804] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T18:27:27.165793] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-28T18:27:27.240932] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:27.257665] [DEBUG] [LOCAL ] ECO: Loaded 17789 existing records from primary storage. [2025-10-28T18:27:27.257902] [INFO ] [MAIN ] ECO: Loaded 17789 existing records. [2025-10-28T18:27:27.434418] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:27.434606] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-28T18:27:27.434701] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-28T18:27:27.435077] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-28T18:27:27.435134] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-28T18:27:27.787701] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:27.959330] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-28T18:27:28.713368] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:27:28.759362] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-28T18:27:28.918801] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:27:29.559352] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-28T18:27:30.063676] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:27:30.364427] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-28T18:27:30.374855] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T18:27:31.159334] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-28T18:27:31.180631] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T18:27:31.959335] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-28T18:27:32.323930] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T18:27:32.326942] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T18:27:32.759330] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-28T18:27:32.980526] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T18:27:33.559383] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-28T18:27:33.814130] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T18:27:34.359368] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-28T18:27:34.681995] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T18:27:34.682778] [INFO ] [REMOTE ] ECCX: Full fetch complete (1436 records). [2025-10-28T18:27:34.682845] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-28T18:27:34.876488] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T18:27:34.876744] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:27:34.876795] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:27:34.876857] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-28T18:27:34.876918] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-28T18:27:34.876953] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-28T18:27:34.876992] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-28T18:27:34.877044] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECCX took 35.8s. Estimated remaining: 3h 32m 37s. Rate: 7.9 symbols/min [2025-10-28T18:27:35.041316] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:35.076219] [DEBUG] [LOCAL ] ECVT: Loaded 42785 existing records from primary storage. [2025-10-28T18:27:35.076498] [INFO ] [MAIN ] ECVT: Loaded 42785 existing records. [2025-10-28T18:27:35.164478] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-28T18:27:35.251387] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:35.251588] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-28T18:27:35.251691] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-28T18:27:35.252356] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-28T18:27:35.252416] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-28T18:27:35.600679] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:35.959358] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-28T18:27:36.759379] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-28T18:27:37.192449] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T18:27:37.198969] [INFO ] [REMOTE ] ECG: Full fetch complete (50818 records). [2025-10-28T18:27:37.199083] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-28T18:27:37.560122] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-28T18:27:37.607233] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-28T18:27:37.607428] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-28T18:27:37.608509] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-28T18:27:37.608704] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-28T18:27:37.610145] [DEBUG] [LOCAL ] ECG: Trimmed 50818 records to 32342 (keeping 200 days of data) [2025-10-28T18:27:37.752727] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T18:27:37.851009] [DEBUG] [LOCAL ] ECG: Primary data saved (32342 records). [2025-10-28T18:27:37.851146] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-28T18:27:37.851228] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECG took 38.4s. Estimated remaining: 3h 32m 18s. Rate: 7.9 symbols/min [2025-10-28T18:27:38.051385] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:38.102940] [DEBUG] [LOCAL ] ED: Loaded 52504 existing records from primary storage. [2025-10-28T18:27:38.103350] [INFO ] [MAIN ] ED: Loaded 52504 existing records. [2025-10-28T18:27:38.310340] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:38.310566] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-28T18:27:38.310618] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-28T18:27:38.311544] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-28T18:27:38.311602] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-28T18:27:38.376740] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-28T18:27:38.726056] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:38.746608] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:27:38.825783] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T18:27:39.159329] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-28T18:27:39.832224] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:27:39.842514] [INFO ] [REMOTE ] ECL: Full fetch complete (68462 records). [2025-10-28T18:27:39.842665] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-28T18:27:39.960981] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-28T18:27:40.259877] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-28T18:27:40.266340] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-28T18:27:40.278825] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-28T18:27:40.280258] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:27:40.279468] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-28T18:27:40.288718] [DEBUG] [LOCAL ] ECL: Trimmed 68462 records to 46659 (keeping 200 days of data) [2025-10-28T18:27:40.575689] [DEBUG] [LOCAL ] ECL: Primary data saved (46659 records). [2025-10-28T18:27:40.575813] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-28T18:27:40.576278] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECL took 26.3s. Estimated remaining: 3h 31m 58s. Rate: 7.9 symbols/min [2025-10-28T18:27:40.742866] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:40.743015] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-10-28T18:27:40.743052] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-10-28T18:27:40.743156] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-28T18:27:40.743195] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-28T18:27:40.743235] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-28T18:27:40.743266] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-28T18:27:40.764480] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-28T18:27:41.060393] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T18:27:41.126131] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:41.559319] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-28T18:27:42.029765] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T18:27:42.359357] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-28T18:27:42.433124] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T18:27:43.067047] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T18:27:43.159340] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-28T18:27:43.936503] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:27:43.959297] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-28T18:27:44.759329] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-28T18:27:44.792436] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T18:27:45.559384] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-28T18:27:45.740905] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:27:46.359387] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-28T18:27:46.945164] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:27:47.159331] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-28T18:27:47.545071] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:27:47.959384] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-28T18:27:48.511267] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:27:48.759364] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-28T18:27:49.052479] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:27:49.559327] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-28T18:27:50.234587] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T18:27:50.359301] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-28T18:27:50.658725] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T18:27:51.159384] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-28T18:27:51.639074] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:27:51.764724] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T18:27:51.959339] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-28T18:27:52.759338] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-28T18:27:53.309122] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:27:53.533210] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T18:27:53.559296] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-28T18:27:54.247539] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:27:54.359307] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-28T18:27:55.159340] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-28T18:27:55.451510] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:27:55.825572] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:27:55.959348] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-28T18:27:56.759340] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-28T18:27:57.207418] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:27:57.492685] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T18:27:57.559299] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-28T18:27:58.359332] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-28T18:27:58.687712] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:27:59.159301] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-28T18:27:59.198858] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T18:27:59.202811] [INFO ] [REMOTE ] ECO: Full fetch complete (28156 records). [2025-10-28T18:27:59.202885] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-28T18:27:59.575840] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-28T18:27:59.575916] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-28T18:27:59.576468] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-28T18:27:59.576528] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-28T18:27:59.577217] [DEBUG] [LOCAL ] ECO: Trimmed 28156 records to 17871 (keeping 200 days of data) [2025-10-28T18:27:59.688713] [DEBUG] [LOCAL ] ECO: Primary data saved (17871 records). [2025-10-28T18:27:59.688833] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-28T18:27:59.688956] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ECO took 32.6s. Estimated remaining: 3h 32m 19s. Rate: 7.9 symbols/min [2025-10-28T18:27:59.856353] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:59.856530] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-28T18:27:59.856586] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-28T18:27:59.856735] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-28T18:27:59.856798] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-28T18:27:59.856882] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-28T18:27:59.856927] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-28T18:27:59.964520] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-28T18:28:00.212942] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:00.691516] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:28:00.759294] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-28T18:28:00.961345] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:28:01.559321] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-28T18:28:02.227689] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:28:02.359384] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-28T18:28:02.882030] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T18:28:02.889954] [INFO ] [REMOTE ] ECVT: Full fetch complete (60149 records). [2025-10-28T18:28:02.890103] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-28T18:28:02.890820] [FATAL] [VALIDATOR ] ECVT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:28:02.890907] [FATAL] [MAIN ] ECVT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:28:02.890950] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:28:02.890989] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-28T18:28:02.891045] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-28T18:28:02.891080] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-28T18:28:02.891254] [DEBUG] [LOCAL ] ECVT: Deleted derivative data file. [2025-10-28T18:28:02.891346] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. ECVT took 28.0s. Estimated remaining: 3h 32m 0s. Rate: 7.9 symbols/min [2025-10-28T18:28:03.064283] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:03.081884] [DEBUG] [LOCAL ] EDN: Loaded 19576 existing records from primary storage. [2025-10-28T18:28:03.082109] [INFO ] [MAIN ] EDN: Loaded 19576 existing records. [2025-10-28T18:28:03.164556] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-28T18:28:03.262099] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:03.262313] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-28T18:28:03.262362] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-28T18:28:03.262807] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-28T18:28:03.262866] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-28T18:28:03.617410] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:03.713159] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T18:28:03.959304] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-28T18:28:04.047464] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:28:04.759378] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-28T18:28:05.474786] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T18:28:05.485131] [INFO ] [REMOTE ] ED: Full fetch complete (76294 records). [2025-10-28T18:28:05.490542] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-28T18:28:05.496231] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:28:05.564471] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-28T18:28:05.887387] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-28T18:28:05.887472] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-28T18:28:05.888360] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-28T18:28:05.888424] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-28T18:28:05.889891] [DEBUG] [LOCAL ] ED: Trimmed 76294 records to 52473 (keeping 200 days of data) [2025-10-28T18:28:06.199995] [DEBUG] [LOCAL ] ED: Primary data saved (52473 records). [2025-10-28T18:28:06.200117] [INFO ] [MAIN ] ED: Full history saved. [2025-10-28T18:28:06.200191] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. ED took 28.3s. Estimated remaining: 3h 31m 42s. Rate: 7.9 symbols/min [2025-10-28T18:28:06.365070] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-28T18:28:06.373438] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:06.411809] [DEBUG] [LOCAL ] EDU: Loaded 44629 existing records from primary storage. [2025-10-28T18:28:06.412085] [INFO ] [MAIN ] EDU: Loaded 44629 existing records. [2025-10-28T18:28:06.582356] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T18:28:06.602095] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:06.607617] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-28T18:28:06.607749] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-28T18:28:06.608805] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-28T18:28:06.608867] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-28T18:28:06.956143] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:07.159373] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-28T18:28:07.456604] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:28:07.959346] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-28T18:28:08.190755] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T18:28:08.759366] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-28T18:28:09.263410] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:28:09.559342] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-28T18:28:09.599491] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T18:28:10.199587] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T18:28:10.359336] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-28T18:28:11.159331] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-28T18:28:11.342163] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T18:28:11.959346] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-28T18:28:12.466614] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:28:12.759347] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-28T18:28:12.917058] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T18:28:12.924077] [INFO ] [REMOTE ] EDD: Full fetch complete (38945 records). [2025-10-28T18:28:12.924255] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-28T18:28:13.317614] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-28T18:28:13.317718] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-28T18:28:13.318288] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-28T18:28:13.318327] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-28T18:28:13.319223] [DEBUG] [LOCAL ] EDD: Trimmed 38945 records to 26837 (keeping 200 days of data) [2025-10-28T18:28:13.474971] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T18:28:13.485938] [DEBUG] [LOCAL ] EDD: Primary data saved (26837 records). [2025-10-28T18:28:13.486343] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-28T18:28:13.486417] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. EDD took 32.9s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-10-28T18:28:13.564403] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-28T18:28:13.660628] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:13.691251] [DEBUG] [LOCAL ] EE: Loaded 32366 existing records from primary storage. [2025-10-28T18:28:13.691548] [INFO ] [MAIN ] EE: Loaded 32366 existing records. [2025-10-28T18:28:13.870971] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:13.871232] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-28T18:28:13.871278] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-28T18:28:13.871924] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-28T18:28:13.871980] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-28T18:28:14.218545] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:14.341881] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:28:14.359301] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-28T18:28:15.159311] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-28T18:28:15.295951] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:28:15.930117] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:28:15.959368] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-28T18:28:16.759544] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-28T18:28:16.763892] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T18:28:17.559303] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-28T18:28:17.595953] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T18:28:18.359409] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-28T18:28:18.921467] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T18:28:19.089447] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T18:28:19.159310] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-28T18:28:19.959339] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-28T18:28:20.458402] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:28:20.475749] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:28:20.759354] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-28T18:28:21.400514] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T18:28:21.559291] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-28T18:28:22.050277] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T18:28:22.359356] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-28T18:28:22.892372] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T18:28:23.159368] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-28T18:28:23.801914] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T18:28:23.805257] [INFO ] [REMOTE ] EDF: Full fetch complete (19603 records). [2025-10-28T18:28:23.805367] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-28T18:28:23.805921] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:28:23.806030] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:28:23.806110] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:28:23.806197] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-28T18:28:23.806271] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-28T18:28:23.806309] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-28T18:28:23.806348] [DEBUG] [LOCAL ] EDF: No derivative data file found to delete. [2025-10-28T18:28:23.806402] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDF took 24.1s. Estimated remaining: 3h 31m 33s. Rate: 7.9 symbols/min [2025-10-28T18:28:23.970226] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-28T18:28:23.972987] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:23.974048] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-28T18:28:23.974092] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-28T18:28:23.974195] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-28T18:28:23.974235] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-28T18:28:23.974277] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-28T18:28:23.974308] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-28T18:28:24.401025] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:24.759349] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-28T18:28:25.035227] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:28:25.455868] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T18:28:25.559340] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-28T18:28:26.125036] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T18:28:26.359349] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-28T18:28:27.159346] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-28T18:28:27.331127] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T18:28:27.880902] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:28:27.959360] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-28T18:28:28.759351] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-28T18:28:28.896417] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:28:29.182914] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T18:28:29.559358] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-28T18:28:30.221277] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:28:30.359317] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-28T18:28:31.159338] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-28T18:28:31.860514] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T18:28:31.959335] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-28T18:28:32.321078] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T18:28:32.759349] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-28T18:28:33.084438] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:28:33.559326] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-28T18:28:33.673394] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T18:28:34.359336] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-28T18:28:34.573987] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:28:35.159329] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-28T18:28:35.229592] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T18:28:35.959347] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-28T18:28:36.596243] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:28:36.605621] [INFO ] [REMOTE ] EDU: Full fetch complete (67124 records). [2025-10-28T18:28:36.605774] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-28T18:28:36.759532] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-28T18:28:36.948735] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T18:28:37.027703] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-28T18:28:37.027783] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-28T18:28:37.028552] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-28T18:28:37.028592] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-28T18:28:37.029807] [DEBUG] [LOCAL ] EDU: Trimmed 67124 records to 44599 (keeping 200 days of data) [2025-10-28T18:28:37.137793] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:28:37.283432] [DEBUG] [LOCAL ] EDU: Primary data saved (44599 records). [2025-10-28T18:28:37.283552] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-28T18:28:37.283625] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EDU took 31.1s. Estimated remaining: 3h 31m 39s. Rate: 7.9 symbols/min [2025-10-28T18:28:37.452703] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:37.452881] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-28T18:28:37.452933] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-28T18:28:37.453045] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-28T18:28:37.453086] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-28T18:28:37.453126] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-28T18:28:37.453156] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-28T18:28:37.564398] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-28T18:28:37.820233] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:38.359338] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-28T18:28:38.727833] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:28:39.159321] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-28T18:28:39.266952] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:28:39.959334] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-28T18:28:40.119397] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T18:28:40.759363] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-28T18:28:41.024120] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:28:41.029758] [INFO ] [REMOTE ] EDN: Full fetch complete (29664 records). [2025-10-28T18:28:41.029846] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-28T18:28:41.390359] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-28T18:28:41.390436] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-28T18:28:41.390987] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-28T18:28:41.391048] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-28T18:28:41.391746] [DEBUG] [LOCAL ] EDN: Trimmed 29664 records to 19707 (keeping 200 days of data) [2025-10-28T18:28:41.514235] [DEBUG] [LOCAL ] EDN: Primary data saved (19707 records). [2025-10-28T18:28:41.514383] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-28T18:28:41.514544] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EDN took 38.6s. Estimated remaining: 3h 31m 24s. Rate: 7.9 symbols/min [2025-10-28T18:28:41.561828] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-28T18:28:41.712444] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:41.710141] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T18:28:41.760820] [DEBUG] [LOCAL ] EFC: Loaded 46165 existing records from primary storage. [2025-10-28T18:28:41.761144] [INFO ] [MAIN ] EFC: Loaded 46165 existing records. [2025-10-28T18:28:41.959991] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:41.960223] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-28T18:28:41.960273] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-28T18:28:41.960826] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-28T18:28:41.960885] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-28T18:28:42.315745] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:42.359296] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-28T18:28:42.522769] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T18:28:43.159348] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-28T18:28:43.528066] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T18:28:43.959308] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-28T18:28:44.147779] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:28:44.341395] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T18:28:44.759368] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-28T18:28:45.379958] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T18:28:45.559361] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-28T18:28:46.304945] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:28:46.359303] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-28T18:28:47.039578] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T18:28:47.159374] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-28T18:28:47.684143] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T18:28:47.959304] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-28T18:28:48.601427] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T18:28:48.759340] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-28T18:28:49.091035] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-28T18:28:49.559332] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-28T18:28:50.359335] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-28T18:28:50.707766] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T18:28:50.707600] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T18:28:50.716822] [INFO ] [REMOTE ] EE: Full fetch complete (44682 records). [2025-10-28T18:28:50.716962] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-28T18:28:51.109477] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-28T18:28:51.109558] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-28T18:28:51.110196] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-28T18:28:51.110259] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-28T18:28:51.111408] [DEBUG] [LOCAL ] EE: Trimmed 44682 records to 32418 (keeping 200 days of data) [2025-10-28T18:28:51.163438] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-28T18:28:51.311595] [DEBUG] [LOCAL ] EE: Primary data saved (32418 records). [2025-10-28T18:28:51.311791] [INFO ] [MAIN ] EE: Full history saved. [2025-10-28T18:28:51.311904] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EE took 37.8s. Estimated remaining: 3h 31m 21s. Rate: 7.9 symbols/min [2025-10-28T18:28:51.480031] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:51.494697] [DEBUG] [LOCAL ] EFR: Loaded 14825 existing records from primary storage. [2025-10-28T18:28:51.494912] [INFO ] [MAIN ] EFR: Loaded 14825 existing records. [2025-10-28T18:28:51.598415] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T18:28:51.677812] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:51.677983] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-28T18:28:51.678029] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-28T18:28:51.678414] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-28T18:28:51.678471] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-28T18:28:51.964501] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-28T18:28:52.036429] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:52.313299] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T18:28:52.759323] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-28T18:28:53.253847] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:28:53.254851] [INFO ] [REMOTE ] EEA: Full fetch complete (3749 records). [2025-10-28T18:28:53.254941] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-28T18:28:53.439023] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T18:28:53.439236] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:28:53.439303] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:28:53.439373] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-28T18:28:53.439436] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-28T18:28:53.439472] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-28T18:28:53.439513] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-28T18:28:53.439568] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EEA took 29.6s. Estimated remaining: 3h 31m 1s. Rate: 7.9 symbols/min [2025-10-28T18:28:53.564411] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-28T18:28:53.608273] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:53.623312] [DEBUG] [LOCAL ] EFT: Loaded 12689 existing records from primary storage. [2025-10-28T18:28:53.623542] [INFO ] [MAIN ] EFT: Loaded 12689 existing records. [2025-10-28T18:28:53.800946] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:53.801168] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-28T18:28:53.801216] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-28T18:28:53.801429] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-28T18:28:53.801486] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-28T18:28:54.156170] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:54.168905] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:28:54.359353] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-28T18:28:54.974310] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T18:28:55.159322] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-28T18:28:55.706435] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:28:55.959351] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-28T18:28:56.759348] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-28T18:28:57.131441] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T18:28:57.234681] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:28:57.559337] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-28T18:28:57.987754] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:28:58.359337] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-28T18:28:58.798170] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T18:28:59.159329] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-28T18:28:59.575623] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T18:28:59.959344] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-28T18:29:00.623435] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T18:29:00.627421] [INFO ] [REMOTE ] EEX: Full fetch complete (18095 records). [2025-10-28T18:29:00.627684] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-28T18:29:00.760777] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-28T18:29:01.056270] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-28T18:29:01.056357] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-28T18:29:01.056886] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-28T18:29:01.056986] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-28T18:29:01.057610] [DEBUG] [LOCAL ] EEX: Trimmed 18095 records to 9325 (keeping 200 days of data) [2025-10-28T18:29:01.113039] [DEBUG] [LOCAL ] EEX: Primary data saved (9325 records). [2025-10-28T18:29:01.113176] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-28T18:29:01.113250] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EEX took 23.8s. Estimated remaining: 3h 30m 53s. Rate: 7.9 symbols/min [2025-10-28T18:29:01.289361] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:01.341086] [DEBUG] [LOCAL ] EFX: Loaded 44559 existing records from primary storage. [2025-10-28T18:29:01.341371] [INFO ] [MAIN ] EFX: Loaded 44559 existing records. [2025-10-28T18:29:01.526987] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:01.527329] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-28T18:29:01.527428] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-28T18:29:01.527967] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-28T18:29:01.528035] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-28T18:29:01.561973] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-28T18:29:01.677849] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T18:29:01.928821] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:02.359362] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-28T18:29:02.973271] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:29:02.982113] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:29:03.159345] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-28T18:29:03.959383] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-28T18:29:04.596970] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:29:04.640964] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T18:29:04.759361] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-28T18:29:05.559355] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-28T18:29:05.878116] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:29:06.359398] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-28T18:29:06.998967] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:29:07.159304] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-28T18:29:07.212285] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:29:07.913116] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T18:29:07.959298] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-28T18:29:08.474829] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:29:08.759346] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-28T18:29:09.175601] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:29:09.559350] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-28T18:29:10.359333] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-28T18:29:10.852823] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:29:10.936823] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T18:29:11.159411] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-28T18:29:11.678723] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:29:11.959362] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-28T18:29:12.525751] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T18:29:12.759369] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-28T18:29:13.393462] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:29:13.559331] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-28T18:29:14.103244] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T18:29:14.359332] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-28T18:29:15.159347] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-28T18:29:15.762024] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:29:15.959295] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-28T18:29:15.979388] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:29:16.759334] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-28T18:29:17.288466] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:29:17.559331] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-28T18:29:17.884248] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:29:18.228708] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T18:29:18.359367] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-28T18:29:19.159481] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-28T18:29:19.217438] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T18:29:19.220498] [INFO ] [REMOTE ] EFT: Full fetch complete (17798 records). [2025-10-28T18:29:19.220579] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-28T18:29:19.573369] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-28T18:29:19.573444] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-28T18:29:19.573829] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-28T18:29:19.573893] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-28T18:29:19.574401] [DEBUG] [LOCAL ] EFT: Trimmed 17798 records to 12569 (keeping 200 days of data) [2025-10-28T18:29:19.648667] [DEBUG] [LOCAL ] EFT: Primary data saved (12569 records). [2025-10-28T18:29:19.648802] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-28T18:29:19.648877] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFT took 26.2s. Estimated remaining: 3h 31m 12s. Rate: 7.9 symbols/min [2025-10-28T18:29:19.814451] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:19.843073] [DEBUG] [LOCAL ] EFXT: Loaded 29414 existing records from primary storage. [2025-10-28T18:29:19.843356] [INFO ] [MAIN ] EFXT: Loaded 29414 existing records. [2025-10-28T18:29:19.964525] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-28T18:29:20.019664] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:20.019998] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-28T18:29:20.020050] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-28T18:29:20.020678] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-28T18:29:20.020741] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-28T18:29:20.390401] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:20.415872] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T18:29:20.759307] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-28T18:29:20.796011] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T18:29:20.799754] [INFO ] [REMOTE ] EFR: Full fetch complete (19752 records). [2025-10-28T18:29:20.799828] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-28T18:29:21.165617] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-28T18:29:21.165740] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-28T18:29:21.166162] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-28T18:29:21.166202] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-28T18:29:21.169854] [DEBUG] [LOCAL ] EFR: Trimmed 19752 records to 14666 (keeping 200 days of data) [2025-10-28T18:29:21.258072] [DEBUG] [LOCAL ] EFR: Primary data saved (14666 records). [2025-10-28T18:29:21.258223] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-28T18:29:21.258303] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EFR took 29.9s. Estimated remaining: 3h 30m 50s. Rate: 7.9 symbols/min [2025-10-28T18:29:21.428898] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:21.454242] [DEBUG] [LOCAL ] EG: Loaded 27095 existing records from primary storage. [2025-10-28T18:29:21.454503] [INFO ] [MAIN ] EG: Loaded 27095 existing records. [2025-10-28T18:29:21.564544] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-28T18:29:21.634292] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:21.634481] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-28T18:29:21.634527] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-28T18:29:21.635116] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-28T18:29:21.635175] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-28T18:29:21.994631] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:22.038335] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:29:22.359330] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-28T18:29:22.680322] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:29:23.159321] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-28T18:29:23.545699] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:29:23.959387] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-28T18:29:24.382222] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:29:24.759421] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-28T18:29:25.222347] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:29:25.548072] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T18:29:25.559290] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-28T18:29:26.359316] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-28T18:29:26.492270] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:29:27.159358] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-28T18:29:27.636130] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:29:27.959375] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-28T18:29:28.103772] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:29:28.759369] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-28T18:29:29.154145] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:29:29.559311] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-28T18:29:29.735983] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:29:30.359316] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-28T18:29:31.159418] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-28T18:29:31.558814] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T18:29:31.606815] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:29:31.959303] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-28T18:29:32.094049] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T18:29:32.759363] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-28T18:29:33.314548] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:29:33.324164] [INFO ] [REMOTE ] EFC: Full fetch complete (66843 records). [2025-10-28T18:29:33.324287] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-28T18:29:33.568410] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-28T18:29:33.719416] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-28T18:29:33.719495] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-28T18:29:33.720308] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-28T18:29:33.720370] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-28T18:29:33.721786] [DEBUG] [LOCAL ] EFC: Trimmed 66843 records to 46143 (keeping 200 days of data) [2025-10-28T18:29:33.999419] [DEBUG] [LOCAL ] EFC: Primary data saved (46143 records). [2025-10-28T18:29:33.999582] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-28T18:29:33.999771] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFC took 52.5s. Estimated remaining: 3h 30m 54s. Rate: 7.9 symbols/min [2025-10-28T18:29:34.172631] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:34.172845] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-28T18:29:34.172913] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-28T18:29:34.173055] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-28T18:29:34.173121] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-28T18:29:34.173227] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-28T18:29:34.173272] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-28T18:29:34.335859] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:29:34.362601] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-28T18:29:34.365340] [INFO ] [REMOTE ] EFX: Full fetch complete (65053 records). [2025-10-28T18:29:34.397333] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-28T18:29:34.677941] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:34.867880] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:29:35.004909] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-28T18:29:35.004993] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-28T18:29:35.006037] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-28T18:29:35.006103] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-28T18:29:35.007673] [DEBUG] [LOCAL ] EFX: Trimmed 65053 records to 44475 (keeping 200 days of data) [2025-10-28T18:29:35.187791] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-28T18:29:35.285425] [DEBUG] [LOCAL ] EFX: Primary data saved (44475 records). [2025-10-28T18:29:35.285539] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-28T18:29:35.285614] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFX took 34.2s. Estimated remaining: 3h 30m 32s. Rate: 7.9 symbols/min [2025-10-28T18:29:35.456580] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:35.456836] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-28T18:29:35.456935] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-28T18:29:35.457120] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-28T18:29:35.457221] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-28T18:29:35.457343] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-28T18:29:35.457439] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-28T18:29:35.623638] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:29:35.856151] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:35.959349] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-28T18:29:36.658239] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T18:29:36.759321] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-28T18:29:37.008527] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T18:29:37.559340] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-28T18:29:37.853375] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:29:38.359332] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-28T18:29:38.690477] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T18:29:39.159321] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-28T18:29:39.495955] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T18:29:39.934508] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:29:39.959309] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-28T18:29:40.759362] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-28T18:29:40.785003] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T18:29:41.559369] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-28T18:29:42.118365] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:29:42.335130] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:29:42.359341] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-28T18:29:43.159330] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-28T18:29:43.471826] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:29:43.959325] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-28T18:29:44.014322] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T18:29:44.759338] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-28T18:29:45.008964] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:29:45.559341] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-28T18:29:45.892142] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T18:29:46.359357] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-28T18:29:46.665590] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:29:47.159345] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-28T18:29:47.325978] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:29:47.959344] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-28T18:29:48.182691] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T18:29:48.189623] [INFO ] [REMOTE ] EFXT: Full fetch complete (44318 records). [2025-10-28T18:29:48.189769] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-28T18:29:48.581957] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-28T18:29:48.582034] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-28T18:29:48.582666] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-28T18:29:48.582726] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-28T18:29:48.583811] [DEBUG] [LOCAL ] EFXT: Trimmed 44318 records to 29387 (keeping 200 days of data) [2025-10-28T18:29:48.752349] [DEBUG] [LOCAL ] EFXT: Primary data saved (29387 records). [2025-10-28T18:29:48.752482] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-28T18:29:48.752584] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EFXT took 29.1s. Estimated remaining: 3h 30m 38s. Rate: 7.9 symbols/min [2025-10-28T18:29:48.760694] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-28T18:29:48.926760] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:48.964142] [DEBUG] [LOCAL ] EGY: Loaded 40974 existing records from primary storage. [2025-10-28T18:29:48.964422] [INFO ] [MAIN ] EGY: Loaded 40974 existing records. [2025-10-28T18:29:49.162604] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:49.163146] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-28T18:29:49.163269] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-28T18:29:49.163930] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-28T18:29:49.163988] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-28T18:29:49.360053] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:29:49.549118] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:49.559306] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-28T18:29:50.158386] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:29:50.359375] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-28T18:29:50.424361] [DEBUG] [REMOTE ] EG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-28T18:29:50.424755] [WARN ] [REMOTE ] EG: No data returned for month 2025-07 [2025-10-28T18:29:50.424841] [FATAL] [REMOTE ] EG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:29:50.424918] [FATAL] [MAIN ] EG: Failed to fetch primary data. [2025-10-28T18:29:50.424980] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:29:50.425049] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-28T18:29:50.425147] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-28T18:29:50.425189] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-10-28T18:29:50.425362] [DEBUG] [LOCAL ] EG: Deleted derivative data file. [2025-10-28T18:29:50.425444] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EG took 29.2s. Estimated remaining: 3h 30m 16s. Rate: 7.9 symbols/min [2025-10-28T18:29:50.600877] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:50.629754] [DEBUG] [LOCAL ] EHAB: Loaded 29072 existing records from primary storage. [2025-10-28T18:29:50.630063] [INFO ] [MAIN ] EHAB: Loaded 29072 existing records. [2025-10-28T18:29:50.818205] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:50.818639] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-28T18:29:50.818738] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-28T18:29:50.819032] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-28T18:29:50.819084] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-28T18:29:50.957177] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:29:51.166186] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-28T18:29:51.205152] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:51.959309] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-28T18:29:52.089608] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T18:29:52.759381] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-28T18:29:52.810132] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:29:53.559369] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-28T18:29:53.724136] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T18:29:54.359353] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-28T18:29:54.776374] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:29:55.159347] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-28T18:29:55.715249] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T18:29:55.959343] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-28T18:29:56.488148] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:29:56.659296] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:29:56.759325] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-28T18:29:57.559318] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-28T18:29:57.601784] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T18:29:58.359327] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-28T18:29:58.526228] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T18:29:59.159370] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-28T18:29:59.509124] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:29:59.964915] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-28T18:29:59.969593] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T18:30:00.759353] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-28T18:30:01.192097] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:30:01.559358] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-28T18:30:02.259972] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:30:02.359349] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-28T18:30:02.710142] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T18:30:03.159391] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-28T18:30:03.955128] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:30:03.964734] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-28T18:30:03.967051] [INFO ] [REMOTE ] EGO: Full fetch complete (74736 records). [2025-10-28T18:30:03.967155] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-28T18:30:04.370725] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-28T18:30:04.370908] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-28T18:30:04.371923] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-28T18:30:04.372013] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-28T18:30:04.394707] [DEBUG] [LOCAL ] EGO: Trimmed 74736 records to 51705 (keeping 200 days of data) [2025-10-28T18:30:04.400918] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:30:04.700275] [DEBUG] [LOCAL ] EGO: Primary data saved (51705 records). [2025-10-28T18:30:04.700414] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-28T18:30:04.700488] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGO took 30.7s. Estimated remaining: 3h 30m 24s. Rate: 7.9 symbols/min [2025-10-28T18:30:04.765435] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-28T18:30:04.880586] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:04.900678] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:30:04.942144] [DEBUG] [LOCAL ] EHC: Loaded 40655 existing records from primary storage. [2025-10-28T18:30:04.942450] [INFO ] [MAIN ] EHC: Loaded 40655 existing records. [2025-10-28T18:30:05.117947] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:05.118091] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-28T18:30:05.118137] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-28T18:30:05.118497] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-28T18:30:05.118540] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-28T18:30:05.461905] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:05.559306] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-28T18:30:05.962994] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:30:06.359381] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-28T18:30:06.955313] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:30:07.159343] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-28T18:30:07.517501] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:30:07.523314] [INFO ] [REMOTE ] EGP: Full fetch complete (45425 records). [2025-10-28T18:30:07.523443] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-28T18:30:07.524091] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:07.524175] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:07.524218] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:07.524256] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-28T18:30:07.524382] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-28T18:30:07.524438] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-10-28T18:30:07.524480] [DEBUG] [LOCAL ] EGP: No derivative data file found to delete. [2025-10-28T18:30:07.524536] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EGP took 32.2s. Estimated remaining: 3h 30m 5s. Rate: 7.9 symbols/min [2025-10-28T18:30:07.694439] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:07.706113] [DEBUG] [LOCAL ] EHI: Loaded 10481 existing records from primary storage. [2025-10-28T18:30:07.706342] [INFO ] [MAIN ] EHI: Loaded 10481 existing records. [2025-10-28T18:30:07.885958] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:07.886260] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-28T18:30:07.886335] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-28T18:30:07.913436] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-28T18:30:07.924290] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-28T18:30:07.957074] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T18:30:07.964427] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-28T18:30:08.314195] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:08.759359] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-28T18:30:09.139363] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:30:09.559310] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-28T18:30:09.745203] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T18:30:10.359395] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-28T18:30:10.685524] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:30:11.159483] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-28T18:30:11.498932] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:30:11.959406] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-28T18:30:12.759340] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-28T18:30:12.982161] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T18:30:13.559358] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-28T18:30:13.892413] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T18:30:14.284581] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-10-28T18:30:14.359345] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-28T18:30:14.585109] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T18:30:15.159353] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-28T18:30:15.612568] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:30:15.959359] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-28T18:30:16.504249] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:30:16.759358] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-28T18:30:17.149887] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:30:17.272077] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T18:30:17.559333] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-28T18:30:18.359331] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-28T18:30:18.842028] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:30:18.970911] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T18:30:19.159331] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-28T18:30:19.959358] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-28T18:30:20.348623] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T18:30:20.353816] [INFO ] [REMOTE ] EHAB: Full fetch complete (40901 records). [2025-10-28T18:30:20.353949] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-28T18:30:20.354554] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:20.354686] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:20.354760] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:20.354860] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-28T18:30:20.354940] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-28T18:30:20.354996] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-10-28T18:30:20.355198] [DEBUG] [LOCAL ] EHAB: Deleted derivative data file. [2025-10-28T18:30:20.355287] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EHAB took 29.9s. Estimated remaining: 3h 30m 10s. Rate: 7.9 symbols/min [2025-10-28T18:30:20.523496] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:20.523683] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-10-28T18:30:20.523734] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-10-28T18:30:20.523844] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-28T18:30:20.523884] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-28T18:30:20.523923] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-28T18:30:20.523954] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-28T18:30:20.764490] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-28T18:30:20.880865] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:21.102539] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T18:30:21.559333] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-28T18:30:21.675341] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:30:22.359370] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-28T18:30:23.062820] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:30:23.070628] [INFO ] [REMOTE ] EGY: Full fetch complete (60302 records). [2025-10-28T18:30:23.070837] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-28T18:30:23.071575] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:23.071706] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:23.071755] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:23.071823] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-28T18:30:23.071889] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-28T18:30:23.071925] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-28T18:30:23.072112] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-10-28T18:30:23.072210] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EGY took 34.3s. Estimated remaining: 3h 29m 51s. Rate: 7.9 symbols/min [2025-10-28T18:30:23.166317] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-28T18:30:23.253882] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:23.254060] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-28T18:30:23.254145] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-28T18:30:23.254227] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-28T18:30:23.254263] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-28T18:30:23.254302] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-28T18:30:23.254333] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-28T18:30:23.613187] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:23.636034] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:30:23.637821] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:30:23.959374] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-28T18:30:24.679375] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T18:30:24.759335] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-28T18:30:25.559402] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-28T18:30:26.070191] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T18:30:26.088141] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T18:30:26.359330] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-28T18:30:27.159344] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-28T18:30:27.913363] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:30:27.961669] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-28T18:30:27.966606] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T18:30:28.202448] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T18:30:28.759359] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-28T18:30:29.559409] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-28T18:30:29.635583] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T18:30:29.794348] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T18:30:30.359396] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-28T18:30:30.591806] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T18:30:31.159341] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-28T18:30:31.687600] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:30:31.959382] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-28T18:30:32.759418] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-28T18:30:33.263185] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T18:30:33.480999] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:30:33.559331] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-28T18:30:34.132499] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T18:30:34.359368] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-28T18:30:35.159374] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-28T18:30:35.468416] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T18:30:35.608298] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:30:35.959337] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-28T18:30:36.759327] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-28T18:30:37.010127] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T18:30:37.559371] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-28T18:30:37.640875] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T18:30:37.905666] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T18:30:37.906396] [INFO ] [REMOTE ] EICA: Full fetch complete (1154 records). [2025-10-28T18:30:37.906462] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-28T18:30:37.906865] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:37.906966] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:37.907035] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:37.907105] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-28T18:30:37.907167] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-28T18:30:37.907202] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-28T18:30:37.907241] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-28T18:30:37.907291] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EICA took 14.8s. Estimated remaining: 3h 30m 0s. Rate: 7.9 symbols/min [2025-10-28T18:30:38.071994] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:38.072179] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-28T18:30:38.072215] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-28T18:30:38.072326] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-28T18:30:38.072367] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-28T18:30:38.072413] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-28T18:30:38.072444] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-28T18:30:38.364419] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-28T18:30:38.421975] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:39.159338] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-28T18:30:39.339588] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T18:30:39.959341] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-28T18:30:40.357296] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T18:30:40.360017] [INFO ] [REMOTE ] EHI: Full fetch complete (15659 records). [2025-10-28T18:30:40.360118] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-28T18:30:40.717054] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-28T18:30:40.717135] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-28T18:30:40.717472] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-28T18:30:40.717512] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-28T18:30:40.718137] [DEBUG] [LOCAL ] EHI: Trimmed 15659 records to 10489 (keeping 200 days of data) [2025-10-28T18:30:40.760777] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-28T18:30:40.780922] [DEBUG] [LOCAL ] EHI: Primary data saved (10489 records). [2025-10-28T18:30:40.781019] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-28T18:30:40.781105] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EHI took 33.3s. Estimated remaining: 3h 29m 42s. Rate: 7.9 symbols/min [2025-10-28T18:30:40.957792] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:40.958036] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-28T18:30:40.958078] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-28T18:30:40.958149] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-28T18:30:40.958184] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-28T18:30:40.958223] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-28T18:30:40.958254] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-28T18:30:41.314341] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:41.486063] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T18:30:41.493831] [INFO ] [REMOTE ] EHC: Full fetch complete (58700 records). [2025-10-28T18:30:41.493977] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-28T18:30:41.567716] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-28T18:30:41.890709] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-28T18:30:41.890795] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-28T18:30:41.891509] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-28T18:30:41.891548] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-28T18:30:41.892779] [DEBUG] [LOCAL ] EHC: Trimmed 58700 records to 40562 (keeping 200 days of data) [2025-10-28T18:30:42.016877] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T18:30:42.156821] [DEBUG] [LOCAL ] EHC: Primary data saved (40562 records). [2025-10-28T18:30:42.157005] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-28T18:30:42.157970] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EHC took 37.5s. Estimated remaining: 3h 29m 20s. Rate: 7.9 symbols/min [2025-10-28T18:30:42.278850] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:30:42.346606] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:42.359563] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-28T18:30:42.368405] [DEBUG] [LOCAL ] EIG: Loaded 19836 existing records from primary storage. [2025-10-28T18:30:42.368688] [INFO ] [MAIN ] EIG: Loaded 19836 existing records. [2025-10-28T18:30:42.544722] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:42.544923] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-28T18:30:42.544969] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-28T18:30:42.545169] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-28T18:30:42.545225] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-28T18:30:42.825290] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:30:42.907125] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:43.159367] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-28T18:30:43.959342] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-28T18:30:44.036329] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:30:44.759323] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-28T18:30:44.814099] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T18:30:45.429600] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T18:30:45.559396] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-28T18:30:46.359317] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-28T18:30:46.445959] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:30:47.105472] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:30:47.159356] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-28T18:30:47.603086] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T18:30:47.959351] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-28T18:30:48.703837] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:30:48.759336] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-28T18:30:49.261357] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T18:30:49.559350] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-28T18:30:50.352598] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T18:30:50.359292] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-28T18:30:50.957356] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T18:30:51.159345] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-28T18:30:51.959341] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-28T18:30:52.222928] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:30:52.228457] [INFO ] [REMOTE ] EIC: Full fetch complete (33676 records). [2025-10-28T18:30:52.228667] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-28T18:30:52.229406] [FATAL] [VALIDATOR ] EIC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:52.229523] [FATAL] [MAIN ] EIC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:52.229612] [WARN ] [MAIN ] EIC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:52.229727] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-28T18:30:52.229817] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-28T18:30:52.229875] [INFO ] [LOCAL ] EIC: Starting deletion of derivative data. [2025-10-28T18:30:52.229943] [DEBUG] [LOCAL ] EIC: No derivative data file found to delete. [2025-10-28T18:30:52.230029] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EIC took 31.9s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-28T18:30:52.414923] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:52.445980] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:30:52.467173] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-10-28T18:30:52.467520] [INFO ] [MAIN ] EIX: Loaded 53339 existing records. [2025-10-28T18:30:52.643733] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:52.643943] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-28T18:30:52.643990] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-28T18:30:52.644881] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-28T18:30:52.644939] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-28T18:30:52.764434] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-28T18:30:53.007465] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:53.183224] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:30:53.559332] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-28T18:30:54.359336] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-28T18:30:54.750728] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:30:55.159343] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-28T18:30:55.779945] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-28T18:30:55.959314] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-28T18:30:56.232882] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T18:30:56.759368] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-28T18:30:57.217213] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:30:57.387053] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:30:57.559341] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-28T18:30:57.827812] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T18:30:58.359386] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-28T18:30:58.843508] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T18:30:59.159346] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-28T18:30:59.565402] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T18:30:59.959361] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-28T18:31:00.678817] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:31:00.759350] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-28T18:31:01.404882] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T18:31:01.559377] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-28T18:31:02.359374] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-28T18:31:02.861120] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:31:03.159368] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-28T18:31:03.598198] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:31:03.630624] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T18:31:03.633597] [INFO ] [REMOTE ] EICC: Full fetch complete (8451 records). [2025-10-28T18:31:03.633800] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-28T18:31:03.634495] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:31:03.634608] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:03.634707] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:03.634804] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-28T18:31:03.634906] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-28T18:31:03.634965] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-28T18:31:03.635032] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-28T18:31:03.635119] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EICC took 22.9s. Estimated remaining: 3h 29m 19s. Rate: 7.9 symbols/min [2025-10-28T18:31:03.959552] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-28T18:31:04.727932] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:31:04.759292] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-28T18:31:05.559313] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-28T18:31:05.578406] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T18:31:05.582431] [INFO ] [REMOTE ] EIG: Full fetch complete (27217 records). [2025-10-28T18:31:05.582534] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-28T18:31:05.583082] [FATAL] [VALIDATOR ] EIG: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:31:05.583162] [FATAL] [MAIN ] EIG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:05.583207] [WARN ] [MAIN ] EIG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:05.583274] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-28T18:31:05.583356] [DEBUG] [LOCAL ] EIG: No primary data file found to delete. [2025-10-28T18:31:05.583393] [INFO ] [LOCAL ] EIG: Starting deletion of derivative data. [2025-10-28T18:31:05.583554] [DEBUG] [LOCAL ] EIG: Deleted derivative data file. [2025-10-28T18:31:05.583682] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EIG took 23.4s. Estimated remaining: 3h 28m 58s. Rate: 7.9 symbols/min [2025-10-28T18:31:06.199460] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T18:31:06.359375] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-28T18:31:07.159376] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-28T18:31:07.452218] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:31:07.959386] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-28T18:31:08.429981] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T18:31:08.698583] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-28T18:31:08.759409] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-28T18:31:09.559397] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-28T18:31:09.696172] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:31:10.359393] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-28T18:31:10.673045] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T18:31:10.822039] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:31:11.159398] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-28T18:31:11.496506] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T18:31:11.959394] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-28T18:31:12.248483] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:31:12.759340] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-28T18:31:13.110801] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T18:31:13.111773] [INFO ] [REMOTE ] EICB: Full fetch complete (2631 records). [2025-10-28T18:31:13.111843] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-28T18:31:13.293757] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T18:31:13.293933] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:13.294007] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:13.294072] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-28T18:31:13.294133] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-28T18:31:13.294168] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-28T18:31:13.294207] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-28T18:31:13.294261] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. EICB took 35.4s. Estimated remaining: 3h 28m 51s. Rate: 7.9 symbols/min [2025-10-28T18:31:13.559349] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-28T18:31:15.217283] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T18:31:15.229335] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-28T18:31:16.838876] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T18:31:16.851330] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-28T18:31:18.256014] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T18:31:18.267185] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-28T18:31:20.265152] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T18:31:20.277018] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-28T18:31:21.222722] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T18:31:21.233514] [INFO ] [REMOTE ] EIX: Full fetch complete (77450 records). [2025-10-28T18:31:21.233709] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-28T18:31:21.636813] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-28T18:31:21.636937] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-28T18:31:21.637875] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-28T18:31:21.637937] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-28T18:31:21.639358] [DEBUG] [LOCAL ] EIX: Trimmed 77450 records to 53339 (keeping 200 days of data) [2025-10-28T18:31:21.961104] [DEBUG] [LOCAL ] EIX: Primary data saved (53339 records). [2025-10-28T18:31:21.961243] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-28T18:31:21.961338] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EIX took 29.7s. Estimated remaining: 3h 28m 46s. Rate: 7.9 symbols/min [2025-10-28T18:31:22.600153] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.587403] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.757307] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.756160] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.733157] [DEBUG] [LOCAL ] ELC: Loaded 3391 existing records from primary storage. [2025-10-28T18:31:22.758517] [INFO ] [MAIN ] ELC: Loaded 3391 existing records. [2025-10-28T18:31:23.008875] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:23.009785] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-28T18:31:23.009841] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-28T18:31:23.010057] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-28T18:31:23.010114] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-28T18:31:23.144185] [DEBUG] [LOCAL ] ELAN: Loaded 53308 existing records from primary storage. [2025-10-28T18:31:23.157304] [DEBUG] [LOCAL ] EL: Loaded 53370 existing records from primary storage. [2025-10-28T18:31:23.184811] [INFO ] [MAIN ] EL: Loaded 53370 existing records. [2025-10-28T18:31:23.179336] [DEBUG] [LOCAL ] ELF: Loaded 51744 existing records from primary storage. [2025-10-28T18:31:23.199289] [INFO ] [MAIN ] ELF: Loaded 51744 existing records. [2025-10-28T18:31:23.199110] [INFO ] [MAIN ] ELAN: Loaded 53308 existing records. [2025-10-28T18:31:23.949274] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:23.945507] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:23.956051] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-28T18:31:23.961502] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-28T18:31:23.961323] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-28T18:31:23.977215] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-28T18:31:24.008770] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-28T18:31:24.008668] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-28T18:31:24.059211] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-28T18:31:24.110187] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:24.125728] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-28T18:31:24.147526] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-28T18:31:24.159140] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-28T18:31:24.163270] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:24.202522] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-28T18:31:24.228705] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-28T18:31:24.202722] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-28T18:31:25.023400] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T18:31:25.193213] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-28T18:31:25.191766] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:25.199073] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-28T18:31:25.389154] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:25.389866] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-28T18:31:25.392827] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:25.393776] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-28T18:31:25.552912] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T18:31:25.554828] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-28T18:31:25.910602] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:31:25.912024] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-28T18:31:26.602928] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:31:26.604405] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-28T18:31:26.695566] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:31:26.706820] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-28T18:31:26.895590] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:31:26.908854] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-28T18:31:26.947839] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T18:31:26.950813] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-28T18:31:27.115195] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T18:31:27.125022] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-28T18:31:27.308119] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:31:27.309557] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-28T18:31:27.605772] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:31:27.920024] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T18:31:27.959294] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-28T18:31:28.485997] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T18:31:28.726893] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T18:31:28.759324] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-28T18:31:29.225527] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:31:29.559326] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-28T18:31:29.887044] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T18:31:30.146539] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:31:30.359325] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-28T18:31:31.159380] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-28T18:31:31.453828] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:31:31.959408] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-28T18:31:32.265349] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T18:31:32.759325] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-28T18:31:33.198817] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T18:31:33.559338] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-28T18:31:34.031291] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T18:31:34.032529] [INFO ] [REMOTE ] ELC: Full fetch complete (4899 records). [2025-10-28T18:31:34.032600] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-28T18:31:34.363694] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-28T18:31:34.435578] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-28T18:31:34.435779] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-28T18:31:34.436006] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-28T18:31:34.436151] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-28T18:31:34.436810] [DEBUG] [LOCAL ] ELC: Trimmed 4899 records to 3405 (keeping 200 days of data) [2025-10-28T18:31:34.459107] [DEBUG] [LOCAL ] ELC: Primary data saved (3405 records). [2025-10-28T18:31:34.459342] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-28T18:31:34.459457] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 12.5s. Estimated remaining: 3h 28m 49s. Rate: 7.9 symbols/min [2025-10-28T18:31:34.612979] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T18:31:34.692982] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:34.693193] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-28T18:31:34.693233] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-28T18:31:34.693348] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-28T18:31:34.693391] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-28T18:31:34.693432] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-28T18:31:34.693465] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-28T18:31:35.060522] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:35.159330] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-28T18:31:35.620950] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:31:35.959372] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-28T18:31:36.439125] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:31:36.759381] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-28T18:31:37.551222] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T18:31:37.561840] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-28T18:31:37.822727] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:31:38.359384] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-28T18:31:39.159327] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-28T18:31:39.811220] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-28T18:31:39.963017] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-28T18:31:39.968709] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T18:31:40.646504] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T18:31:40.759361] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-28T18:31:41.498201] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:31:41.559325] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-28T18:31:42.140826] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:31:42.359391] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-28T18:31:42.724488] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T18:31:43.159339] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-28T18:31:43.959318] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-28T18:31:44.061270] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T18:31:44.220052] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:31:44.759345] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-28T18:31:45.069902] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T18:31:45.559337] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-28T18:31:45.868955] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:31:46.359348] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-28T18:31:47.098300] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T18:31:47.159300] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-28T18:31:47.748757] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T18:31:47.959333] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-28T18:31:48.546473] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:31:48.759338] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-28T18:31:49.241586] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:31:49.559334] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-28T18:31:50.359340] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-28T18:31:50.619516] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-28T18:31:51.159502] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-28T18:31:51.394759] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:31:51.576626] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T18:31:51.589688] [INFO ] [REMOTE ] ELAN: Full fetch complete (77089 records). [2025-10-28T18:31:51.589911] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-28T18:31:51.967353] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-28T18:31:52.086191] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-28T18:31:52.086303] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-28T18:31:52.087507] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-28T18:31:52.087589] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-28T18:31:52.089297] [DEBUG] [LOCAL ] ELAN: Trimmed 77089 records to 53301 (keeping 200 days of data) [2025-10-28T18:31:52.437078] [DEBUG] [LOCAL ] ELAN: Primary data saved (53301 records). [2025-10-28T18:31:52.437183] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-28T18:31:52.438811] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELAN took 30.5s. Estimated remaining: 3h 29m 5s. Rate: 7.9 symbols/min [2025-10-28T18:31:52.571949] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T18:31:52.604122] [INFO ] [REMOTE ] EL: Full fetch complete (77431 records). [2025-10-28T18:31:52.621433] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-28T18:31:52.732212] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:52.759064] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-28T18:31:52.759449] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-28T18:31:52.759798] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-28T18:31:52.760060] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-28T18:31:52.761307] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-28T18:31:52.761407] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-28T18:31:52.767312] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-28T18:31:53.391886] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-28T18:31:53.397113] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-28T18:31:53.426745] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-28T18:31:53.447428] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-28T18:31:53.467736] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:53.484060] [DEBUG] [LOCAL ] EL: Trimmed 77431 records to 53368 (keeping 200 days of data) [2025-10-28T18:31:53.496818] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:31:53.562186] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-28T18:31:53.858319] [DEBUG] [LOCAL ] EL: Primary data saved (53368 records). [2025-10-28T18:31:53.858470] [INFO ] [MAIN ] EL: Full history saved. [2025-10-28T18:31:53.858552] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. EL took 31.9s. Estimated remaining: 3h 28m 43s. Rate: 7.9 symbols/min [2025-10-28T18:31:54.041739] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:54.041940] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-28T18:31:54.041977] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-28T18:31:54.042095] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-28T18:31:54.042137] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-28T18:31:54.042179] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-28T18:31:54.042211] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-28T18:31:54.361160] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-28T18:31:54.431981] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:54.465505] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T18:31:54.947065] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:31:55.159346] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-28T18:31:55.632214] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:31:55.959424] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-28T18:31:56.623567] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T18:31:56.645730] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T18:31:56.759398] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-28T18:31:57.559430] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-28T18:31:58.321493] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:31:58.359327] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-28T18:31:58.800536] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T18:31:58.810022] [INFO ] [REMOTE ] ELF: Full fetch complete (75109 records). [2025-10-28T18:31:58.810173] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-28T18:31:58.810876] [FATAL] [VALIDATOR ] ELF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:31:58.810977] [FATAL] [MAIN ] ELF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:58.811021] [WARN ] [MAIN ] ELF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:58.811083] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-28T18:31:58.811147] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-28T18:31:58.811183] [INFO ] [LOCAL ] ELF: Starting deletion of derivative data. [2025-10-28T18:31:58.811371] [DEBUG] [LOCAL ] ELF: Deleted derivative data file. [2025-10-28T18:31:58.811475] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELF took 36.8s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-28T18:31:58.988251] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:59.034384] [DEBUG] [LOCAL ] ELS: Loaded 49837 existing records from primary storage. [2025-10-28T18:31:59.034704] [INFO ] [MAIN ] ELS: Loaded 49837 existing records. [2025-10-28T18:31:59.163507] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-28T18:31:59.232930] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:59.234054] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:31:59.239009] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-28T18:31:59.239356] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-28T18:31:59.240100] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-28T18:31:59.240158] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-28T18:31:59.509852] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T18:31:59.598433] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:59.959308] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-28T18:32:00.181265] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-28T18:32:00.759335] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-28T18:32:01.559331] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-28T18:32:02.359336] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-28T18:32:02.398206] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:32:02.562951] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T18:32:02.642014] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T18:32:03.159334] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-28T18:32:03.959350] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-28T18:32:04.211772] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T18:32:04.759444] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-28T18:32:05.120195] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:32:05.559360] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-28T18:32:06.176098] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:32:06.359366] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-28T18:32:06.615712] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T18:32:06.830569] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:32:07.159390] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-28T18:32:07.486703] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-28T18:32:07.959346] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-28T18:32:08.204403] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T18:32:08.759400] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-28T18:32:09.559338] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-28T18:32:09.913494] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T18:32:09.921352] [INFO ] [REMOTE ] ELME: Full fetch complete (55844 records). [2025-10-28T18:32:09.921461] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-28T18:32:09.922194] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:32:09.922274] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:32:09.922316] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:32:09.922354] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-28T18:32:09.922409] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-28T18:32:09.922442] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-28T18:32:09.922480] [DEBUG] [LOCAL ] ELME: No derivative data file found to delete. [2025-10-28T18:32:09.922533] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELME took 35.5s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-28T18:32:10.099683] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:10.099856] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-28T18:32:10.099898] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-28T18:32:10.100006] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-28T18:32:10.100048] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-28T18:32:10.100089] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-28T18:32:10.100122] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-28T18:32:10.364559] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-28T18:32:10.534504] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:10.735207] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:32:11.159358] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-28T18:32:11.430458] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:32:11.959346] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-28T18:32:12.337744] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T18:32:12.759361] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-28T18:32:13.401747] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:32:13.559353] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-28T18:32:13.635872] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T18:32:14.359409] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-28T18:32:14.603126] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T18:32:14.740488] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:32:15.159410] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-28T18:32:15.374917] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-28T18:32:15.959366] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-28T18:32:16.407340] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T18:32:16.408124] [INFO ] [REMOTE ] ELPC: Full fetch complete (1266 records). [2025-10-28T18:32:16.408194] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-28T18:32:16.596165] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-28T18:32:16.596292] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:32:16.596372] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:32:16.596437] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-28T18:32:16.596495] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-28T18:32:16.596531] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-28T18:32:16.596622] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-28T18:32:16.596720] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. ELPC took 22.7s. Estimated remaining: 3h 28m 20s. Rate: 7.9 symbols/min [2025-10-28T18:32:16.764672] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-28T18:32:16.766801] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:16.767609] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-28T18:32:16.767691] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-28T18:32:16.767823] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-28T18:32:16.767886] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-28T18:32:16.767935] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-28T18:32:16.767969] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-28T18:32:17.123492] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:17.559340] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-28T18:32:17.677143] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T18:32:18.359383] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-28T18:32:18.558134] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:32:18.558464] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-28T18:32:18.558552] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:32:18.558664] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-28T18:32:18.558736] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:32:18.558807] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-28T18:32:18.558870] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-28T18:32:18.558905] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-28T18:32:18.558944] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-28T18:32:18.558988] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. EMA took 2.0s. Estimated remaining: 3h 27m 60s. Rate: 7.9 symbols/min [2025-10-28T18:32:18.737614] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:18.737867] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-28T18:32:18.737922] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-28T18:32:18.738178] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-28T18:32:18.738244] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-28T18:32:18.738334] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-28T18:32:18.738432] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-28T18:32:19.110152] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:19.141143] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T18:32:19.159296] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-28T18:32:19.959386] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-28T18:32:20.352389] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:32:20.759388] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-28T18:32:21.155125] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:32:21.559341] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-28T18:32:21.941508] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:32:22.359400] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-28T18:32:22.817529] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:32:23.158322] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T18:32:23.162548] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-28T18:32:23.959388] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-28T18:32:24.661166] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:32:24.672442] [INFO ] [REMOTE ] ELS: Full fetch complete (71406 records). [2025-10-28T18:32:24.672594] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-28T18:32:24.764460] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-28T18:32:24.980222] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T18:32:25.149946] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-28T18:32:25.150036] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-28T18:32:25.150880] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-28T18:32:25.150943] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-28T18:32:25.152378] [DEBUG] [LOCAL ] ELS: Trimmed 71406 records to 49824 (keeping 200 days of data) [2025-10-28T18:32:25.457815] [DEBUG] [LOCAL ] ELS: Primary data saved (49824 records). [2025-10-28T18:32:25.457991] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-28T18:32:25.458088] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELS took 26.6s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-10-28T18:32:25.559304] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-28T18:32:25.631469] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:25.660757] [DEBUG] [LOCAL ] EME: Loaded 30529 existing records from primary storage. [2025-10-28T18:32:25.660985] [INFO ] [MAIN ] EME: Loaded 30529 existing records. [2025-10-28T18:32:25.837495] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T18:32:25.860242] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:25.860546] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-28T18:32:25.860608] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-28T18:32:25.865821] [INFO ] [REMOTE ] ELP: Full fetch complete (36679 records). [2025-10-28T18:32:25.865921] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-28T18:32:25.866209] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-28T18:32:25.871753] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-28T18:32:26.393729] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-28T18:32:26.657751] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-28T18:32:26.651224] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:26.663243] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-28T18:32:26.663829] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-28T18:32:26.664042] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-28T18:32:26.665152] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:32:26.671332] [DEBUG] [LOCAL ] ELP: Trimmed 36679 records to 25193 (keeping 200 days of data) [2025-10-28T18:32:26.816900] [DEBUG] [LOCAL ] ELP: Primary data saved (25193 records). [2025-10-28T18:32:26.817025] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-28T18:32:26.817097] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. ELP took 34.4s. Estimated remaining: 3h 27m 29s. Rate: 7.9 symbols/min [2025-10-28T18:32:26.993214] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:26.998375] [DEBUG] [LOCAL ] EMF: Loaded 3001 existing records from primary storage. [2025-10-28T18:32:26.998556] [INFO ] [MAIN ] EMF: Loaded 3001 existing records. [2025-10-28T18:32:27.164422] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-28T18:32:27.212262] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:27.212752] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-28T18:32:27.212814] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-28T18:32:27.213048] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-28T18:32:27.213119] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-28T18:32:27.578326] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:27.877415] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T18:32:27.959315] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-28T18:32:28.031952] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:32:28.759350] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-28T18:32:29.020199] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T18:32:29.559355] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-28T18:32:30.049823] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:32:30.359346] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-28T18:32:30.403276] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:32:31.159357] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-28T18:32:31.660972] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T18:32:31.959386] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-28T18:32:32.193302] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:32:32.526602] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T18:32:32.759387] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-28T18:32:33.131114] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T18:32:33.559346] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-28T18:32:34.242150] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T18:32:34.359356] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-28T18:32:35.159397] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-28T18:32:35.425867] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:32:35.959325] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-28T18:32:36.099947] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:32:36.759338] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-28T18:32:37.108227] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:32:37.259480] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T18:32:37.559324] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-28T18:32:38.359332] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-28T18:32:38.778039] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:32:39.159321] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-28T18:32:39.444132] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T18:32:39.894227] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:32:39.959326] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-28T18:32:40.759314] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-28T18:32:41.016435] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:32:41.100165] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T18:32:41.559385] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-28T18:32:41.913359] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T18:32:42.359335] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-28T18:32:43.099860] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:32:43.159342] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-28T18:32:43.959344] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-28T18:32:44.708991] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:32:44.759332] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-28T18:32:44.933169] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:32:45.559347] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-28T18:32:46.033669] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T18:32:46.346201] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T18:32:46.359297] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-28T18:32:47.159332] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-28T18:32:47.824469] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T18:32:47.834532] [INFO ] [REMOTE ] ELV: Full fetch complete (73308 records). [2025-10-28T18:32:47.834706] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-28T18:32:47.963692] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-28T18:32:48.233295] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-28T18:32:48.233397] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-28T18:32:48.234353] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-28T18:32:48.234434] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-28T18:32:48.253041] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:32:48.252207] [DEBUG] [LOCAL ] ELV: Trimmed 73308 records to 50655 (keeping 200 days of data) [2025-10-28T18:32:48.567429] [DEBUG] [LOCAL ] ELV: Primary data saved (50655 records). [2025-10-28T18:32:48.567579] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-28T18:32:48.567675] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. ELV took 38.6s. Estimated remaining: 3h 27m 53s. Rate: 7.9 symbols/min [2025-10-28T18:32:48.735856] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:48.749468] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T18:32:48.759308] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-28T18:32:48.796010] [DEBUG] [LOCAL ] EMN: Loaded 50796 existing records from primary storage. [2025-10-28T18:32:48.796297] [INFO ] [MAIN ] EMN: Loaded 50796 existing records. [2025-10-28T18:32:48.974198] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:48.974390] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-28T18:32:48.974437] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-28T18:32:48.975445] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-28T18:32:48.975503] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-28T18:32:49.334750] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:49.559343] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-28T18:32:49.773984] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T18:32:49.778166] [INFO ] [REMOTE ] EMD: Full fetch complete (31795 records). [2025-10-28T18:32:49.778239] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-28T18:32:50.146993] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-28T18:32:50.147081] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-28T18:32:50.147797] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-28T18:32:50.147860] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-28T18:32:50.148765] [DEBUG] [LOCAL ] EMD: Trimmed 31795 records to 20344 (keeping 200 days of data) [2025-10-28T18:32:50.268563] [DEBUG] [LOCAL ] EMD: Primary data saved (20344 records). [2025-10-28T18:32:50.268711] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-28T18:32:50.268792] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMD took 31.7s. Estimated remaining: 3h 27m 32s. Rate: 7.9 symbols/min [2025-10-28T18:32:50.369147] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-28T18:32:50.444837] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:50.445038] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-10-28T18:32:50.445079] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-10-28T18:32:50.445150] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-28T18:32:50.445188] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-28T18:32:50.445242] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-28T18:32:50.445296] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-28T18:32:50.814912] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:51.159355] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-28T18:32:51.371273] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T18:32:51.584507] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:32:51.959388] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-28T18:32:52.074501] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:32:52.355106] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:32:52.759364] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-28T18:32:53.526786] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T18:32:53.559346] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-28T18:32:54.359321] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-28T18:32:55.159356] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-28T18:32:55.356403] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-28T18:32:55.635845] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T18:32:55.637074] [INFO ] [REMOTE ] EMF: Full fetch complete (5945 records). [2025-10-28T18:32:55.637143] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-28T18:32:55.964474] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-28T18:32:56.005966] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-28T18:32:56.006036] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-28T18:32:56.006218] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-28T18:32:56.006278] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-28T18:32:56.006719] [DEBUG] [LOCAL ] EMF: Trimmed 5945 records to 2985 (keeping 200 days of data) [2025-10-28T18:32:56.025575] [DEBUG] [LOCAL ] EMF: Primary data saved (2985 records). [2025-10-28T18:32:56.026137] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-28T18:32:56.026233] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMF took 29.2s. Estimated remaining: 3h 27m 20s. Rate: 7.9 symbols/min [2025-10-28T18:32:56.219315] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:56.224396] [DEBUG] [LOCAL ] EMP: Loaded 2836 existing records from primary storage. [2025-10-28T18:32:56.224545] [INFO ] [MAIN ] EMP: Loaded 2836 existing records. [2025-10-28T18:32:56.406674] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:56.406962] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-28T18:32:56.407035] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-28T18:32:56.407303] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-28T18:32:56.407432] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-28T18:32:56.585878] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-28T18:32:56.786627] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-28T18:32:56.791148] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:57.128521] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:32:57.559337] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-28T18:32:58.011257] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T18:32:58.359315] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-28T18:32:58.448714] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:32:58.455602] [INFO ] [REMOTE ] EME: Full fetch complete (47025 records). [2025-10-28T18:32:58.455769] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-28T18:32:58.765615] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T18:32:58.856405] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-28T18:32:58.856485] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-28T18:32:58.857273] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-28T18:32:58.857337] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-28T18:32:58.858373] [DEBUG] [LOCAL ] EME: Trimmed 47025 records to 30406 (keeping 200 days of data) [2025-10-28T18:32:59.046923] [DEBUG] [LOCAL ] EME: Primary data saved (30406 records). [2025-10-28T18:32:59.047062] [INFO ] [MAIN ] EME: Full history saved. [2025-10-28T18:32:59.047138] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EME took 33.6s. Estimated remaining: 3h 27m 3s. Rate: 7.9 symbols/min [2025-10-28T18:32:59.164449] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-28T18:32:59.221160] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:59.272684] [DEBUG] [LOCAL ] EMR: Loaded 53121 existing records from primary storage. [2025-10-28T18:32:59.273448] [INFO ] [MAIN ] EMR: Loaded 53121 existing records. [2025-10-28T18:32:59.471979] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:59.472196] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-28T18:32:59.472244] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-28T18:32:59.473169] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-28T18:32:59.473229] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-28T18:32:59.964790] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-28T18:32:59.971981] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:00.057162] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T18:33:00.278759] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:33:00.759331] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-28T18:33:01.334482] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T18:33:01.559353] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-28T18:33:02.359392] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-28T18:33:02.893292] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:33:03.159375] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-28T18:33:03.760267] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:33:03.761260] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T18:33:03.959314] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-28T18:33:04.587593] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T18:33:04.759356] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-28T18:33:05.559344] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-28T18:33:05.865745] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T18:33:06.191607] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T18:33:06.359302] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-28T18:33:07.159384] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-28T18:33:07.621973] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:33:07.777148] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T18:33:07.959343] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-28T18:33:08.759341] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-28T18:33:09.373367] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T18:33:09.406639] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T18:33:09.559311] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-28T18:33:10.359449] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-28T18:33:10.963131] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:33:10.983367] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T18:33:10.986896] [INFO ] [REMOTE ] EMO: Full fetch complete (17791 records). [2025-10-28T18:33:10.986965] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-28T18:33:11.169359] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-28T18:33:11.354314] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-28T18:33:11.354388] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-28T18:33:11.354771] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-28T18:33:11.354831] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-28T18:33:11.355329] [DEBUG] [LOCAL ] EMO: Trimmed 17791 records to 13310 (keeping 200 days of data) [2025-10-28T18:33:11.434451] [DEBUG] [LOCAL ] EMO: Primary data saved (13310 records). [2025-10-28T18:33:11.434586] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-28T18:33:11.434679] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EMO took 21.2s. Estimated remaining: 3h 27m 6s. Rate: 7.9 symbols/min [2025-10-28T18:33:11.598611] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:11.645257] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-28T18:33:11.645552] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-28T18:33:11.746815] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T18:33:11.827354] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:11.827557] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-28T18:33:11.827603] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-28T18:33:11.828457] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-28T18:33:11.828514] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-28T18:33:11.967767] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-28T18:33:12.178410] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:12.406494] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T18:33:12.759336] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-28T18:33:13.559337] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-28T18:33:13.926435] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T18:33:14.114890] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T18:33:14.359333] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-28T18:33:15.159349] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-28T18:33:15.739603] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:33:15.959347] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-28T18:33:16.298062] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T18:33:16.524790] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:33:16.759392] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-28T18:33:17.559339] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-28T18:33:17.925904] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:33:17.975747] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:33:18.359452] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-28T18:33:19.159324] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-28T18:33:19.931345] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T18:33:19.959297] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-28T18:33:20.720289] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T18:33:20.759292] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-28T18:33:21.311706] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:33:21.559314] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-28T18:33:22.098630] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:33:22.359326] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-28T18:33:22.939801] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:33:23.159317] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-28T18:33:23.741006] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T18:33:23.959380] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-28T18:33:24.765329] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-28T18:33:24.771119] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T18:33:25.270467] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T18:33:25.559359] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-28T18:33:26.359458] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-28T18:33:26.361510] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T18:33:26.379440] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T18:33:27.159353] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-28T18:33:27.549216] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T18:33:27.550480] [INFO ] [REMOTE ] EMP: Full fetch complete (4036 records). [2025-10-28T18:33:27.550816] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-28T18:33:27.955220] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-28T18:33:27.955340] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-28T18:33:27.955570] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-28T18:33:27.955616] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-28T18:33:27.956120] [DEBUG] [LOCAL ] EMP: Trimmed 4036 records to 2819 (keeping 200 days of data) [2025-10-28T18:33:27.963875] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-28T18:33:28.005429] [DEBUG] [LOCAL ] EMP: Primary data saved (2819 records). [2025-10-28T18:33:28.007420] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T18:33:28.007727] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-28T18:33:28.008331] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. EMP took 32.0s. Estimated remaining: 3h 27m 18s. Rate: 7.9 symbols/min [2025-10-28T18:33:28.202883] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:28.203152] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-28T18:33:28.203192] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-28T18:33:28.203342] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-28T18:33:28.203383] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-28T18:33:28.203424] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-28T18:33:28.203457] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-28T18:33:28.584923] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:28.759364] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-28T18:33:29.512883] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:33:29.559342] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-28T18:33:30.359344] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-28T18:33:30.424283] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:33:30.434547] [INFO ] [REMOTE ] EMR: Full fetch complete (76788 records). [2025-10-28T18:33:30.434708] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-28T18:33:30.435519] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:33:30.435622] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:33:30.435722] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:33:30.435816] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-28T18:33:30.435899] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-28T18:33:30.435936] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-28T18:33:30.436129] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-28T18:33:30.436728] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. EMR took 31.4s. Estimated remaining: 3h 26m 59s. Rate: 7.9 symbols/min [2025-10-28T18:33:30.608848] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:30.609031] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-28T18:33:30.609067] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-28T18:33:30.609202] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-28T18:33:30.609272] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-28T18:33:30.609331] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-28T18:33:30.609386] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-28T18:33:30.975734] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:31.123969] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T18:33:31.159314] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-28T18:33:31.811862] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:33:31.959338] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-28T18:33:32.759315] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-28T18:33:33.559334] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-28T18:33:33.599001] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:33:33.609343] [INFO ] [REMOTE ] EMN: Full fetch complete (72486 records). [2025-10-28T18:33:33.609481] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-28T18:33:33.749265] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-28T18:33:34.058107] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T18:33:34.059736] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-28T18:33:34.059825] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-28T18:33:34.060724] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-28T18:33:34.060842] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-28T18:33:34.081143] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T18:33:34.088242] [DEBUG] [LOCAL ] EMN: Trimmed 72486 records to 50800 (keeping 200 days of data) [2025-10-28T18:33:34.359435] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-28T18:33:34.398302] [DEBUG] [LOCAL ] EMN: Primary data saved (50800 records). [2025-10-28T18:33:34.398428] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-28T18:33:34.399110] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. EMN took 45.8s. Estimated remaining: 3h 26m 43s. Rate: 7.9 symbols/min [2025-10-28T18:33:34.573151] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:34.574066] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-28T18:33:34.574119] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-28T18:33:34.574304] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-28T18:33:34.574360] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-28T18:33:34.574405] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-28T18:33:34.574438] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-28T18:33:34.921019] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:35.159302] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-28T18:33:35.312684] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:33:35.959351] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-28T18:33:36.687308] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T18:33:36.759302] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-28T18:33:37.107754] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T18:33:37.559327] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-28T18:33:38.243820] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T18:33:38.254183] [INFO ] [REMOTE ] ENB: Full fetch complete (77273 records). [2025-10-28T18:33:38.254302] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-28T18:33:38.255091] [FATAL] [VALIDATOR ] ENB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:33:38.255201] [FATAL] [MAIN ] ENB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:33:38.255271] [WARN ] [MAIN ] ENB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:33:38.255369] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-28T18:33:38.255450] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-28T18:33:38.255487] [INFO ] [LOCAL ] ENB: Starting deletion of derivative data. [2025-10-28T18:33:38.255909] [DEBUG] [LOCAL ] ENB: Deleted derivative data file. [2025-10-28T18:33:38.256004] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. ENB took 26.8s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-10-28T18:33:38.364259] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-28T18:33:38.434983] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:38.471407] [DEBUG] [LOCAL ] ENR: Loaded 43645 existing records from primary storage. [2025-10-28T18:33:38.471736] [INFO ] [MAIN ] ENR: Loaded 43645 existing records. [2025-10-28T18:33:38.651722] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:38.651975] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-28T18:33:38.652024] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-28T18:33:38.652754] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-28T18:33:38.652810] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-28T18:33:39.030403] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:39.025226] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T18:33:39.159357] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-28T18:33:39.447146] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:33:39.959335] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-28T18:33:40.337949] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:33:40.759341] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-28T18:33:41.106762] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T18:33:41.559350] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-28T18:33:41.872553] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:33:42.040453] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:33:42.359337] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-28T18:33:43.159347] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-28T18:33:43.378150] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:33:43.474955] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T18:33:43.959340] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-28T18:33:44.759359] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-28T18:33:45.259822] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:33:45.559329] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-28T18:33:46.127379] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:33:46.359337] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-28T18:33:47.079529] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T18:33:47.159403] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-28T18:33:47.170412] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T18:33:47.959335] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-28T18:33:48.367541] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:33:48.759319] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-28T18:33:49.134127] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:33:49.559340] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-28T18:33:49.682309] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T18:33:49.843297] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-28T18:33:50.359363] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-28T18:33:51.159356] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-28T18:33:51.573956] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T18:33:51.959349] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-28T18:33:52.323254] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:33:52.759357] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-28T18:33:52.868206] [DEBUG] [REMOTE ] ENR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-28T18:33:52.871224] [WARN ] [REMOTE ] ENR: No data returned for month 2025-06 [2025-10-28T18:33:52.872850] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T18:33:52.882981] [FATAL] [REMOTE ] ENR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:33:52.883555] [FATAL] [MAIN ] ENR: Failed to fetch primary data. [2025-10-28T18:33:52.883665] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:33:52.883771] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-28T18:33:52.884179] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-10-28T18:33:52.884231] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-10-28T18:33:52.884419] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-10-28T18:33:52.884506] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENR took 14.6s. Estimated remaining: 3h 26m 35s. Rate: 7.9 symbols/min [2025-10-28T18:33:53.052484] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:53.081793] [DEBUG] [LOCAL ] ENS: Loaded 29376 existing records from primary storage. [2025-10-28T18:33:53.082049] [INFO ] [MAIN ] ENS: Loaded 29376 existing records. [2025-10-28T18:33:53.264253] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:53.264493] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-28T18:33:53.264555] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-28T18:33:53.264957] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-28T18:33:53.265016] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-28T18:33:53.564432] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-28T18:33:53.629851] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:54.359331] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-28T18:33:54.635335] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T18:33:54.750107] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:33:55.159411] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-28T18:33:55.448279] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T18:33:55.959378] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-28T18:33:56.298718] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:33:56.759354] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-28T18:33:57.104238] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:33:57.105112] [INFO ] [REMOTE ] ENO: Full fetch complete (2953 records). [2025-10-28T18:33:57.105180] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-28T18:33:57.483170] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-28T18:33:57.483245] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-28T18:33:57.483367] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-28T18:33:57.483431] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-28T18:33:57.483806] [DEBUG] [LOCAL ] ENO: Trimmed 2953 records to 1587 (keeping 200 days of data) [2025-10-28T18:33:57.493927] [DEBUG] [LOCAL ] ENO: Primary data saved (1587 records). [2025-10-28T18:33:57.493991] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-28T18:33:57.494050] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENO took 27.1s. Estimated remaining: 3h 26m 21s. Rate: 7.9 symbols/min [2025-10-28T18:33:57.564617] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-28T18:33:57.675994] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:57.701672] [DEBUG] [LOCAL ] ENVA: Loaded 25041 existing records from primary storage. [2025-10-28T18:33:57.701944] [INFO ] [MAIN ] ENVA: Loaded 25041 existing records. [2025-10-28T18:33:57.886190] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:57.886392] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-28T18:33:57.886441] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-28T18:33:57.886826] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-28T18:33:57.886884] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-28T18:33:58.236719] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:58.359370] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-28T18:33:58.921492] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:33:59.159326] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-28T18:33:59.959317] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-28T18:34:00.239917] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-28T18:34:00.245535] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:34:00.759353] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-28T18:34:01.427754] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T18:34:01.559373] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-28T18:34:02.359313] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-28T18:34:02.478923] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T18:34:03.049172] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-28T18:34:03.056843] [INFO ] [REMOTE ] ENOV: Full fetch complete (62908 records). [2025-10-28T18:34:03.056959] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-28T18:34:03.057612] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:34:03.057722] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:34:03.057764] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:34:03.057829] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-28T18:34:03.057895] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-28T18:34:03.057929] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-28T18:34:03.057969] [DEBUG] [LOCAL ] ENOV: No derivative data file found to delete. [2025-10-28T18:34:03.058023] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENOV took 28.7s. Estimated remaining: 3h 26m 9s. Rate: 7.9 symbols/min [2025-10-28T18:34:03.164488] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-28T18:34:03.226844] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:03.242434] [DEBUG] [LOCAL ] EOD: Loaded 14650 existing records from primary storage. [2025-10-28T18:34:03.242775] [INFO ] [MAIN ] EOD: Loaded 14650 existing records. [2025-10-28T18:34:03.438605] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:03.438885] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-28T18:34:03.438930] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-28T18:34:03.439212] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-28T18:34:03.439268] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-28T18:34:03.795713] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:03.959303] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-28T18:34:04.335695] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T18:34:04.359954] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:34:04.759329] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-28T18:34:04.890404] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:34:05.559304] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-28T18:34:05.699801] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T18:34:06.344270] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:34:06.359295] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-28T18:34:07.159342] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-28T18:34:07.292564] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:34:07.959348] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-28T18:34:08.199966] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:34:08.759314] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-28T18:34:08.972251] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:34:09.559329] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-28T18:34:09.726196] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T18:34:10.080456] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T18:34:10.359351] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-28T18:34:11.159337] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-28T18:34:11.465701] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:34:11.959360] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-28T18:34:12.151976] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T18:34:12.759348] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-28T18:34:13.219069] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T18:34:13.225589] [INFO ] [REMOTE ] ENIC: Full fetch complete (51123 records). [2025-10-28T18:34:13.225722] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-28T18:34:13.568387] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-28T18:34:13.611705] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-28T18:34:13.611795] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-28T18:34:13.612464] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-28T18:34:13.612504] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-28T18:34:13.613774] [DEBUG] [LOCAL ] ENIC: Trimmed 51123 records to 35951 (keeping 200 days of data) [2025-10-28T18:34:13.818196] [DEBUG] [LOCAL ] ENIC: Primary data saved (35951 records). [2025-10-28T18:34:13.818331] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-28T18:34:13.818401] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENIC took 45.8s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-10-28T18:34:13.996426] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:14.015250] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:34:14.070870] [DEBUG] [LOCAL ] EOG: Loaded 53389 existing records from primary storage. [2025-10-28T18:34:14.071173] [INFO ] [MAIN ] EOG: Loaded 53389 existing records. [2025-10-28T18:34:14.258182] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:14.258447] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-28T18:34:14.258503] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-28T18:34:14.259362] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-28T18:34:14.259421] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-28T18:34:14.364492] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-28T18:34:14.631954] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:15.159311] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-28T18:34:15.210289] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T18:34:15.342117] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T18:34:15.959331] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-28T18:34:16.166770] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T18:34:16.756337] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T18:34:16.761494] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-28T18:34:17.437812] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T18:34:17.559392] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-28T18:34:18.359370] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-28T18:34:18.418520] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T18:34:19.159340] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-28T18:34:19.372141] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T18:34:19.959363] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-28T18:34:20.011878] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T18:34:20.759325] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-28T18:34:20.813016] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:34:21.559372] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-28T18:34:22.161787] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T18:34:22.359304] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-28T18:34:23.094828] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T18:34:23.159309] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-28T18:34:23.469183] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-28T18:34:23.959375] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-28T18:34:24.022705] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:34:24.759305] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-28T18:34:25.099099] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T18:34:25.102534] [INFO ] [REMOTE ] EOD: Full fetch complete (20682 records). [2025-10-28T18:34:25.102619] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-28T18:34:25.103096] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:34:25.103178] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:34:25.103237] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:34:25.103320] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-28T18:34:25.103396] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-28T18:34:25.103447] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-28T18:34:25.103684] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-28T18:34:25.103796] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. EOD took 22.0s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-10-28T18:34:25.282485] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:25.294339] [DEBUG] [LOCAL ] EOI: Loaded 9956 existing records from primary storage. [2025-10-28T18:34:25.294556] [INFO ] [MAIN ] EOI: Loaded 9956 existing records. [2025-10-28T18:34:25.475908] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:25.476125] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-28T18:34:25.476172] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-28T18:34:25.476403] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-28T18:34:25.476460] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-28T18:34:25.564562] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-28T18:34:25.831581] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:26.019515] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:34:26.333453] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:34:26.359325] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-28T18:34:27.159344] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-28T18:34:27.959383] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-28T18:34:28.050600] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T18:34:28.068108] [INFO ] [REMOTE ] ENS: Full fetch complete (42864 records). [2025-10-28T18:34:28.068857] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-28T18:34:28.069252] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:34:28.472148] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-28T18:34:28.472232] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-28T18:34:28.472874] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-28T18:34:28.472961] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-28T18:34:28.473843] [DEBUG] [LOCAL ] ENS: Trimmed 42864 records to 29403 (keeping 200 days of data) [2025-10-28T18:34:28.647319] [DEBUG] [LOCAL ] ENS: Primary data saved (29403 records). [2025-10-28T18:34:28.647449] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-28T18:34:28.647527] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. ENS took 35.8s. Estimated remaining: 3h 25m 52s. Rate: 7.9 symbols/min [2025-10-28T18:34:28.764535] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-28T18:34:28.821999] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:28.837311] [DEBUG] [LOCAL ] EOS: Loaded 14302 existing records from primary storage. [2025-10-28T18:34:28.837516] [INFO ] [MAIN ] EOS: Loaded 14302 existing records. [2025-10-28T18:34:29.015597] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:29.015993] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-28T18:34:29.016197] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-28T18:34:29.016474] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-28T18:34:29.016575] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-28T18:34:29.121151] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:34:29.142524] [INFO ] [REMOTE ] ENVA: Full fetch complete (36684 records). [2025-10-28T18:34:29.152913] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-28T18:34:29.177234] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:34:29.195889] [FATAL] [MAIN ] ENVA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:34:29.213218] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:34:29.247588] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-28T18:34:29.271299] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-10-28T18:34:29.280388] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-10-28T18:34:29.296970] [DEBUG] [LOCAL ] ENVA: Deleted derivative data file. [2025-10-28T18:34:29.316072] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. ENVA took 31.8s. Estimated remaining: 3h 25m 29s. Rate: 7.9 symbols/min [2025-10-28T18:34:29.504861] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:29.520545] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:34:29.564868] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-28T18:34:29.592816] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:29.593050] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-28T18:34:29.593117] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-28T18:34:29.593237] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-28T18:34:29.593290] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-28T18:34:29.593345] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-28T18:34:29.593389] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-28T18:34:29.962424] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:30.359339] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-28T18:34:31.159374] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-28T18:34:31.535236] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:34:31.764284] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T18:34:31.959363] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-28T18:34:32.626729] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:34:32.759322] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-28T18:34:33.559380] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-28T18:34:33.593102] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:34:33.800381] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (4.24 seconds). [2025-10-28T18:34:34.088583] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T18:34:34.359427] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-28T18:34:35.159350] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-28T18:34:35.431045] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T18:34:35.549040] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:34:35.959371] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-28T18:34:36.574058] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:34:36.759344] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-28T18:34:37.559372] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-28T18:34:37.776132] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:34:38.173425] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T18:34:38.359335] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-28T18:34:39.141377] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:34:39.159336] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-28T18:34:39.959408] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-28T18:34:39.990994] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:34:40.759346] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-28T18:34:40.925552] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:34:41.465124] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T18:34:41.559335] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-28T18:34:42.335212] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:34:42.359382] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-28T18:34:43.159321] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-28T18:34:43.816008] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T18:34:43.939974] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T18:34:43.959313] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-28T18:34:44.759331] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-28T18:34:45.281960] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:34:45.364327] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:34:45.559340] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-28T18:34:46.202614] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T18:34:46.359402] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-28T18:34:47.062275] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T18:34:47.064911] [INFO ] [REMOTE ] EOI: Full fetch complete (15848 records). [2025-10-28T18:34:47.064993] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-28T18:34:47.164435] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-28T18:34:47.447322] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-28T18:34:47.447399] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-28T18:34:47.447822] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-28T18:34:47.447885] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-28T18:34:47.448392] [DEBUG] [LOCAL ] EOI: Trimmed 15848 records to 9917 (keeping 200 days of data) [2025-10-28T18:34:47.507171] [DEBUG] [LOCAL ] EOI: Primary data saved (9917 records). [2025-10-28T18:34:47.507296] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-28T18:34:47.507372] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EOI took 22.4s. Estimated remaining: 3h 25m 44s. Rate: 7.9 symbols/min [2025-10-28T18:34:47.687358] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:47.712157] [DEBUG] [LOCAL ] EPAC: Loaded 26063 existing records from primary storage. [2025-10-28T18:34:47.712370] [INFO ] [MAIN ] EPAC: Loaded 26063 existing records. [2025-10-28T18:34:47.900830] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:47.910691] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-28T18:34:47.911698] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T18:34:47.911316] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-28T18:34:47.916353] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-28T18:34:47.916412] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-28T18:34:47.968428] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-28T18:34:48.281117] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:48.468038] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T18:34:48.759357] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-28T18:34:49.559310] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-28T18:34:49.680901] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:34:50.359365] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-28T18:34:50.803844] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T18:34:51.159328] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-28T18:34:51.759077] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T18:34:51.959369] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-28T18:34:52.536408] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-10-28T18:34:52.759355] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-28T18:34:53.084988] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:34:53.559403] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-28T18:34:54.314022] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:34:54.338702] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:34:54.359302] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-28T18:34:55.159305] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-28T18:34:55.265379] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:34:55.959436] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-28T18:34:56.426344] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T18:34:56.584684] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T18:34:56.759351] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-28T18:34:57.559355] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-28T18:34:57.597879] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T18:34:57.601535] [INFO ] [REMOTE ] EOS: Full fetch complete (22757 records). [2025-10-28T18:34:57.601637] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-28T18:34:57.971415] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-28T18:34:57.971565] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-28T18:34:57.972068] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-28T18:34:57.972129] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-28T18:34:57.972776] [DEBUG] [LOCAL ] EOS: Trimmed 22757 records to 14269 (keeping 200 days of data) [2025-10-28T18:34:58.049228] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T18:34:58.067341] [DEBUG] [LOCAL ] EOS: Primary data saved (14269 records). [2025-10-28T18:34:58.067434] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-28T18:34:58.067503] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOS took 29.4s. Estimated remaining: 3h 25m 43s. Rate: 7.9 symbols/min [2025-10-28T18:34:58.240197] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:58.240368] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-28T18:34:58.240406] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-28T18:34:58.240516] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-28T18:34:58.240557] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-28T18:34:58.240599] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-28T18:34:58.240632] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-28T18:34:58.364496] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-28T18:34:58.612182] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:59.159297] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-28T18:34:59.227137] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T18:34:59.229327] [INFO ] [REMOTE ] EOT: Full fetch complete (10713 records). [2025-10-28T18:34:59.229395] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-28T18:34:59.584028] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-28T18:34:59.584101] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-28T18:34:59.584346] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-28T18:34:59.584383] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-28T18:34:59.584859] [DEBUG] [LOCAL ] EOT: Trimmed 10713 records to 6982 (keeping 200 days of data) [2025-10-28T18:34:59.626429] [DEBUG] [LOCAL ] EOT: Primary data saved (6982 records). [2025-10-28T18:34:59.626591] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-28T18:34:59.626689] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOT took 30.3s. Estimated remaining: 3h 25m 22s. Rate: 7.9 symbols/min [2025-10-28T18:34:59.837708] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:59.837920] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-28T18:34:59.837980] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-28T18:34:59.838096] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-28T18:34:59.838137] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-28T18:34:59.838179] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-28T18:34:59.838216] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-28T18:34:59.964515] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-28T18:35:00.211349] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:00.231961] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T18:35:00.759363] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-28T18:35:01.544557] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T18:35:01.559321] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-28T18:35:01.920946] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T18:35:02.359400] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-28T18:35:03.159328] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-28T18:35:03.749310] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:35:03.959357] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-28T18:35:04.128748] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-28T18:35:04.206285] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:35:04.759356] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-28T18:35:04.963855] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T18:35:05.559313] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-28T18:35:05.752767] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T18:35:06.359356] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-28T18:35:06.831473] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T18:35:07.159401] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-28T18:35:07.373232] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T18:35:07.959341] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-28T18:35:08.021842] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:35:08.759360] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-28T18:35:09.059289] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:35:09.559354] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-28T18:35:10.359307] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-28T18:35:10.548756] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T18:35:10.559592] [INFO ] [REMOTE ] EOG: Full fetch complete (77470 records). [2025-10-28T18:35:10.559772] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-28T18:35:10.976104] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-28T18:35:10.976251] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-28T18:35:10.977265] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-28T18:35:10.977389] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-28T18:35:11.003559] [DEBUG] [LOCAL ] EOG: Trimmed 77470 records to 53388 (keeping 200 days of data) [2025-10-28T18:35:11.005632] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T18:35:11.199353] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-28T18:35:11.386078] [DEBUG] [LOCAL ] EOG: Primary data saved (53388 records). [2025-10-28T18:35:11.386221] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-28T18:35:11.386299] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EOG took 57.6s. Estimated remaining: 3h 25m 24s. Rate: 7.9 symbols/min [2025-10-28T18:35:11.559620] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:11.582364] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T18:35:11.636358] [DEBUG] [LOCAL ] EPD: Loaded 53606 existing records from primary storage. [2025-10-28T18:35:11.636795] [INFO ] [MAIN ] EPD: Loaded 53606 existing records. [2025-10-28T18:35:11.812244] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:11.812457] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-28T18:35:11.812504] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-28T18:35:11.813031] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-28T18:35:11.813089] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-28T18:35:11.970284] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-28T18:35:12.201118] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:12.338240] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T18:35:12.759335] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-28T18:35:12.907728] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:35:13.559348] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-28T18:35:14.048508] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:35:14.359349] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-28T18:35:15.159388] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-28T18:35:15.292447] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T18:35:15.297837] [INFO ] [REMOTE ] EPAC: Full fetch complete (38710 records). [2025-10-28T18:35:15.297915] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-28T18:35:15.668482] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-28T18:35:15.668577] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-28T18:35:15.669229] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-28T18:35:15.669300] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-28T18:35:15.670317] [DEBUG] [LOCAL ] EPAC: Trimmed 38710 records to 25996 (keeping 200 days of data) [2025-10-28T18:35:15.779118] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:35:15.856971] [DEBUG] [LOCAL ] EPAC: Primary data saved (25996 records). [2025-10-28T18:35:15.857123] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-28T18:35:15.857235] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPAC took 28.3s. Estimated remaining: 3h 25m 9s. Rate: 7.9 symbols/min [2025-10-28T18:35:15.964738] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-28T18:35:16.025248] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:16.025393] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-10-28T18:35:16.025446] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-10-28T18:35:16.025548] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-28T18:35:16.025587] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-28T18:35:16.025627] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-28T18:35:16.025692] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-28T18:35:16.379061] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:16.759380] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-28T18:35:17.388812] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-28T18:35:17.559303] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-28T18:35:18.359325] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-28T18:35:18.441696] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-28T18:35:19.159367] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-28T18:35:19.372101] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-28T18:35:19.449540] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:35:19.583404] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-28T18:35:19.959337] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-28T18:35:20.759374] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-28T18:35:21.071889] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:35:21.559353] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-28T18:35:22.096341] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-28T18:35:22.359299] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-28T18:35:22.724167] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-28T18:35:23.159361] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-28T18:35:23.685189] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T18:35:23.959322] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-28T18:35:24.489395] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T18:35:24.759312] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-28T18:35:25.550075] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:35:25.561124] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-28T18:35:25.904852] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T18:35:26.365441] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-28T18:35:26.372415] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-10-28T18:35:27.159375] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-28T18:35:27.350840] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T18:35:27.643795] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T18:35:27.651391] [INFO ] [REMOTE ] EPAM: Full fetch complete (56755 records). [2025-10-28T18:35:27.651560] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-28T18:35:27.964514] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-28T18:35:28.047886] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-28T18:35:28.047969] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-28T18:35:28.048717] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-28T18:35:28.048780] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-28T18:35:28.049972] [DEBUG] [LOCAL ] EPAM: Trimmed 56755 records to 38976 (keeping 200 days of data) [2025-10-28T18:35:28.279703] [DEBUG] [LOCAL ] EPAM: Primary data saved (38976 records). [2025-10-28T18:35:28.279833] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-28T18:35:28.279903] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPAM took 30.2s. Estimated remaining: 3h 25m 12s. Rate: 7.9 symbols/min [2025-10-28T18:35:28.458826] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:28.503864] [DEBUG] [LOCAL ] EPRT: Loaded 48434 existing records from primary storage. [2025-10-28T18:35:28.504182] [INFO ] [MAIN ] EPRT: Loaded 48434 existing records. [2025-10-28T18:35:28.694112] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:28.694327] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-28T18:35:28.694377] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-28T18:35:28.694836] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-28T18:35:28.694894] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-28T18:35:28.762612] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-28T18:35:29.062599] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:29.559347] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-28T18:35:29.682034] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-28T18:35:30.359418] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-28T18:35:30.415988] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:35:30.625297] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-28T18:35:30.632916] [INFO ] [REMOTE ] EPC: Full fetch complete (57413 records). [2025-10-28T18:35:30.633039] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-28T18:35:31.052573] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-28T18:35:31.053164] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-28T18:35:31.053970] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-28T18:35:31.055078] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:35:31.055229] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-28T18:35:31.065171] [DEBUG] [LOCAL ] EPC: Trimmed 57413 records to 39562 (keeping 200 days of data) [2025-10-28T18:35:31.159396] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-28T18:35:31.298967] [DEBUG] [LOCAL ] EPC: Primary data saved (39562 records). [2025-10-28T18:35:31.299099] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-28T18:35:31.299245] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPC took 31.7s. Estimated remaining: 3h 24m 55s. Rate: 7.9 symbols/min [2025-10-28T18:35:31.500686] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:31.500904] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-28T18:35:31.500985] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-28T18:35:31.501116] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-28T18:35:31.501180] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-28T18:35:31.501357] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-28T18:35:31.501418] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-28T18:35:31.849594] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T18:35:31.937987] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:31.959316] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-28T18:35:32.212783] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:35:32.759341] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-28T18:35:33.559319] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-28T18:35:34.147998] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:35:34.359331] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-28T18:35:34.543962] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-28T18:35:35.159332] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-28T18:35:35.169925] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:35:35.218720] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T18:35:35.959340] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-28T18:35:36.349850] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:35:36.759374] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-28T18:35:37.246490] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T18:35:37.419399] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T18:35:37.559330] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-28T18:35:38.359342] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-28T18:35:38.873241] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:35:39.159348] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-28T18:35:39.677988] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T18:35:39.959341] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-28T18:35:40.347541] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T18:35:40.759341] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-28T18:35:41.109299] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T18:35:41.392294] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:35:41.559339] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-28T18:35:42.359335] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-28T18:35:43.134793] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T18:35:43.159296] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-28T18:35:43.623280] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:35:43.959337] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-28T18:35:44.720868] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T18:35:44.759307] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-28T18:35:45.467969] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:35:45.476613] [INFO ] [REMOTE ] EPR: Full fetch complete (63264 records). [2025-10-28T18:35:45.476782] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-28T18:35:45.559910] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-28T18:35:45.603622] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:35:45.884243] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-28T18:35:45.884330] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-28T18:35:45.885139] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-28T18:35:45.885201] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-28T18:35:45.886446] [DEBUG] [LOCAL ] EPR: Trimmed 63264 records to 43440 (keeping 200 days of data) [2025-10-28T18:35:46.144221] [DEBUG] [LOCAL ] EPR: Primary data saved (43440 records). [2025-10-28T18:35:46.144344] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-28T18:35:46.144416] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EPR took 30.3s. Estimated remaining: 3h 25m 2s. Rate: 7.9 symbols/min [2025-10-28T18:35:46.326442] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:46.359327] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-28T18:35:46.376630] [DEBUG] [LOCAL ] EQH: Loaded 52653 existing records from primary storage. [2025-10-28T18:35:46.376970] [INFO ] [MAIN ] EQH: Loaded 52653 existing records. [2025-10-28T18:35:46.568310] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:46.568577] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-28T18:35:46.568639] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-28T18:35:46.569199] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-28T18:35:46.569258] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-28T18:35:46.941171] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:46.947920] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:35:47.159329] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-28T18:35:47.662214] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-28T18:35:47.959350] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-28T18:35:48.450375] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T18:35:48.759332] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-28T18:35:49.142995] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:35:49.559319] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-28T18:35:50.359331] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-28T18:35:50.877167] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:35:51.047925] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T18:35:51.159314] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-28T18:35:51.738515] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (2.98 seconds). [2025-10-28T18:35:51.959321] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-28T18:35:52.759313] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-28T18:35:53.331385] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:35:53.559357] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-28T18:35:54.359387] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-28T18:35:55.081960] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:35:55.159315] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-28T18:35:55.234268] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (4.07 seconds). [2025-10-28T18:35:55.244728] [INFO ] [REMOTE ] EPRT: Full fetch complete (69698 records). [2025-10-28T18:35:55.244867] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-28T18:35:55.641393] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-28T18:35:55.641518] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-28T18:35:55.650611] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-28T18:35:55.651449] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-28T18:35:55.651140] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-28T18:35:55.656224] [DEBUG] [LOCAL ] EPRT: Trimmed 69698 records to 48419 (keeping 200 days of data) [2025-10-28T18:35:55.948972] [DEBUG] [LOCAL ] EPRT: Primary data saved (48419 records). [2025-10-28T18:35:55.949097] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-28T18:35:55.949173] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 27.7s. Estimated remaining: 3h 24m 59s. Rate: 7.9 symbols/min [2025-10-28T18:35:55.980499] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-28T18:35:56.119428] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:56.167757] [DEBUG] [LOCAL ] EQNR: Loaded 53043 existing records from primary storage. [2025-10-28T18:35:56.168050] [INFO ] [MAIN ] EQNR: Loaded 53043 existing records. [2025-10-28T18:35:56.346606] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:56.346817] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-28T18:35:56.346863] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-28T18:35:56.347595] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-28T18:35:56.347685] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-28T18:35:56.712622] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:56.742876] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T18:35:56.759302] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-28T18:35:57.329428] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:35:57.559315] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-28T18:35:58.003769] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:35:58.059943] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (3.70 seconds). [2025-10-28T18:35:58.174888] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T18:35:58.359348] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-28T18:35:59.159319] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-28T18:35:59.959351] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-28T18:36:00.759466] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-28T18:36:01.669627] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:36:01.672613] [INFO ] [REMOTE ] EQBK: Full fetch complete (15554 records). [2025-10-28T18:36:01.672734] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-28T18:36:01.673138] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:36:01.673220] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:36:01.673266] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:36:01.673306] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-28T18:36:01.673363] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-28T18:36:01.673399] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-28T18:36:01.673440] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-28T18:36:01.673492] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EQBK took 30.4s. Estimated remaining: 3h 24m 48s. Rate: 7.9 symbols/min [2025-10-28T18:36:01.880952] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:01.936479] [DEBUG] [LOCAL ] EQR: Loaded 51787 existing records from primary storage. [2025-10-28T18:36:01.936880] [INFO ] [MAIN ] EQR: Loaded 51787 existing records. [2025-10-28T18:36:02.139614] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:02.139879] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-28T18:36:02.139955] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-28T18:36:02.140413] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-28T18:36:02.140473] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-28T18:36:02.350702] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-28T18:36:02.429426] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-28T18:36:02.567341] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:02.581398] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-28T18:36:02.585077] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (4.23 seconds). [2025-10-28T18:36:02.597162] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-28T18:36:02.597357] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-28T18:36:03.013633] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-28T18:36:03.013745] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-28T18:36:03.014635] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-28T18:36:03.014721] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-28T18:36:03.016194] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53606 (keeping 200 days of data) [2025-10-28T18:36:03.328774] [DEBUG] [LOCAL ] EPD: Primary data saved (53606 records). [2025-10-28T18:36:03.329025] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-28T18:36:03.329173] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EPD took 51.9s. Estimated remaining: 3h 24m 27s. Rate: 7.9 symbols/min [2025-10-28T18:36:03.494884] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:03.495090] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-28T18:36:03.495141] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-28T18:36:03.495245] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-28T18:36:03.495303] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-28T18:36:03.495344] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-28T18:36:03.495390] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-28T18:36:03.855403] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:03.855945] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-28T18:36:03.885855] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T18:36:03.959318] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-28T18:36:04.487388] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:36:04.759376] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-28T18:36:05.080800] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T18:36:05.470764] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (6.31 seconds). [2025-10-28T18:36:05.559338] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-28T18:36:06.359388] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-28T18:36:06.653958] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T18:36:07.159371] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-28T18:36:07.442386] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T18:36:07.506304] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (4.92 seconds). [2025-10-28T18:36:07.959335] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-28T18:36:08.759371] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-28T18:36:09.050716] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T18:36:09.200680] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T18:36:09.559307] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-28T18:36:09.800700] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T18:36:10.050197] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (6.09 seconds). [2025-10-28T18:36:10.359382] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-28T18:36:10.732881] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-28T18:36:11.159313] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-28T18:36:11.737097] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:36:11.959321] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-28T18:36:12.759326] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-28T18:36:13.267639] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T18:36:13.323595] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (7.76 seconds). [2025-10-28T18:36:13.559345] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-28T18:36:14.249735] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:36:14.359308] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-28T18:36:14.872054] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:36:15.159314] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-28T18:36:15.959322] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-28T18:36:16.376789] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-28T18:36:16.389618] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T18:36:16.390722] [INFO ] [REMOTE ] EQS: Full fetch complete (2354 records). [2025-10-28T18:36:16.390790] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-28T18:36:16.578555] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-28T18:36:16.578876] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:36:16.578953] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:36:16.579112] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-28T18:36:16.579258] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-28T18:36:16.579318] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-28T18:36:16.579443] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-28T18:36:16.579536] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQS took 13.3s. Estimated remaining: 3h 24m 32s. Rate: 7.9 symbols/min [2025-10-28T18:36:16.609750] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:36:16.759307] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-28T18:36:17.559400] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-28T18:36:18.191949] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:36:18.359334] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-28T18:36:18.990335] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T18:36:19.159327] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-28T18:36:19.697180] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:36:19.959340] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-28T18:36:20.514881] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:36:20.525388] [INFO ] [REMOTE ] EQH: Full fetch complete (76596 records). [2025-10-28T18:36:20.525538] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-28T18:36:20.764740] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-28T18:36:20.917353] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-28T18:36:20.917434] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-28T18:36:20.918322] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-28T18:36:20.918384] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-28T18:36:20.919924] [DEBUG] [LOCAL ] EQH: Trimmed 76596 records to 52655 (keeping 200 days of data) [2025-10-28T18:36:21.233605] [DEBUG] [LOCAL ] EQH: Primary data saved (52655 records). [2025-10-28T18:36:21.233795] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-28T18:36:21.234572] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQH took 35.1s. Estimated remaining: 3h 24m 18s. Rate: 7.9 symbols/min [2025-10-28T18:36:22.537910] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T18:36:22.550237] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-28T18:36:23.998554] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T18:36:24.010245] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-28T18:36:25.269681] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (5.31 seconds). [2025-10-28T18:36:25.281197] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-28T18:36:28.144611] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (4.13 seconds). [2025-10-28T18:36:28.156866] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-28T18:36:31.387724] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (6.11 seconds). [2025-10-28T18:36:31.399394] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-28T18:36:32.556814] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (4.40 seconds). [2025-10-28T18:36:32.567923] [INFO ] [REMOTE ] EQNR: Full fetch complete (77018 records). [2025-10-28T18:36:32.568162] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-28T18:36:32.702785] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:36:32.775253] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-28T18:36:33.018927] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-28T18:36:33.019032] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-28T18:36:33.020005] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-28T18:36:33.020079] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-28T18:36:33.021553] [DEBUG] [LOCAL ] EQNR: Trimmed 77018 records to 53041 (keeping 200 days of data) [2025-10-28T18:36:33.356530] [DEBUG] [LOCAL ] EQNR: Primary data saved (53041 records). [2025-10-28T18:36:33.356695] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-28T18:36:33.356785] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQNR took 37.4s. Estimated remaining: 3h 24m 20s. Rate: 7.9 symbols/min [2025-10-28T18:36:34.108675] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:36:34.123115] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-28T18:36:39.144362] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (5.02 seconds). [2025-10-28T18:36:39.154697] [INFO ] [REMOTE ] EQR: Full fetch complete (74257 records). [2025-10-28T18:36:39.154850] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-28T18:36:39.155528] [FATAL] [VALIDATOR ] EQR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:36:39.155628] [FATAL] [MAIN ] EQR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:36:39.155732] [WARN ] [MAIN ] EQR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:36:39.155816] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-28T18:36:39.155917] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-28T18:36:39.155972] [INFO ] [LOCAL ] EQR: Starting deletion of derivative data. [2025-10-28T18:36:39.156152] [DEBUG] [LOCAL ] EQR: Deleted derivative data file. [2025-10-28T18:36:39.156248] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQR took 37.5s. Estimated remaining: 3h 24m 8s. Rate: 7.9 symbols/min [2025-10-28T18:36:39.901013] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.900090] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.974617] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.995311] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.998736] [DEBUG] [LOCAL ] EQV: Loaded 2764 existing records from primary storage. [2025-10-28T18:36:39.999912] [INFO ] [MAIN ] EQV: Loaded 2764 existing records. [2025-10-28T18:36:40.201706] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:40.202112] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-28T18:36:40.202171] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-28T18:36:40.215139] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-28T18:36:40.238915] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-28T18:36:40.240499] [DEBUG] [LOCAL ] ERO: Loaded 42023 existing records from primary storage. [2025-10-28T18:36:40.288840] [INFO ] [MAIN ] ERO: Loaded 42023 existing records. [2025-10-28T18:36:40.384323] [DEBUG] [LOCAL ] ERJ: Loaded 50207 existing records from primary storage. [2025-10-28T18:36:40.431372] [DEBUG] [LOCAL ] EQT: Loaded 53684 existing records from primary storage. [2025-10-28T18:36:40.430676] [INFO ] [MAIN ] ERJ: Loaded 50207 existing records. [2025-10-28T18:36:40.512801] [INFO ] [MAIN ] EQT: Loaded 53684 existing records. [2025-10-28T18:36:41.031161] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:41.082768] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:41.108784] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-28T18:36:41.126810] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-28T18:36:41.132073] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-28T18:36:41.158251] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-28T18:36:41.190766] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-28T18:36:41.188966] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-28T18:36:41.195297] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-28T18:36:41.198467] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:41.198892] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-28T18:36:41.204129] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-28T18:36:41.204206] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-28T18:36:41.261612] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-28T18:36:41.352763] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-28T18:36:41.460988] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:41.580201] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-28T18:36:42.364371] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:42.403471] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-28T18:36:42.438344] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:42.448911] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-28T18:36:42.450441] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T18:36:42.442554] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:42.452971] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-28T18:36:42.453228] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-28T18:36:42.868802] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T18:36:42.870427] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-28T18:36:43.249168] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T18:36:43.250491] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-28T18:36:43.549108] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T18:36:43.550440] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-28T18:36:43.612238] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:36:43.620631] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-28T18:36:43.831821] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:36:43.842510] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-28T18:36:43.946010] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T18:36:43.947780] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-28T18:36:43.973764] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T18:36:43.983575] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-28T18:36:44.446387] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T18:36:44.448022] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-28T18:36:44.674817] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:36:44.683134] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-28T18:36:44.812423] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T18:36:44.813600] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-28T18:36:45.170339] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T18:36:45.172181] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-28T18:36:45.341177] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T18:36:45.351617] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-28T18:36:45.470558] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T18:36:45.471844] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-28T18:36:45.722607] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T18:36:45.732023] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-28T18:36:46.075548] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-28T18:36:46.085631] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-28T18:36:46.220550] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T18:36:46.221889] [INFO ] [REMOTE ] EQV: Full fetch complete (4815 records). [2025-10-28T18:36:46.221966] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-28T18:36:46.590347] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-28T18:36:46.590432] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-28T18:36:46.590595] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-28T18:36:46.590760] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-28T18:36:46.591125] [DEBUG] [LOCAL ] EQV: Trimmed 4815 records to 2819 (keeping 200 days of data) [2025-10-28T18:36:46.607263] [DEBUG] [LOCAL ] EQV: Primary data saved (2819 records). [2025-10-28T18:36:46.607345] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-28T18:36:46.607495] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. EQV took 7.5s. Estimated remaining: 3h 24m 0s. Rate: 7.9 symbols/min [2025-10-28T18:36:46.784097] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:46.809743] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T18:36:46.819465] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-28T18:36:46.856878] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T18:36:46.869365] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-28T18:36:46.906432] [DEBUG] [LOCAL ] ES: Loaded 52682 existing records from primary storage. [2025-10-28T18:36:46.906780] [INFO ] [MAIN ] ES: Loaded 52682 existing records. [2025-10-28T18:36:47.089191] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:47.089410] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-28T18:36:47.089493] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-28T18:36:47.090100] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-28T18:36:47.090177] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-28T18:36:47.447017] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:47.447415] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-28T18:36:47.479320] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:36:47.490253] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-28T18:36:47.885403] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T18:36:47.893594] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-28T18:36:48.313326] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:36:48.324427] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-28T18:36:48.685274] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:36:48.696469] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-28T18:36:48.944958] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:36:48.955968] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-28T18:36:49.473243] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T18:36:49.559291] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-28T18:36:49.613856] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:36:50.188048] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:36:50.359347] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-28T18:36:50.737141] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-28T18:36:50.821202] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:36:51.159348] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-28T18:36:51.509888] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:36:51.959334] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-28T18:36:52.195533] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T18:36:52.759344] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-28T18:36:53.133446] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:36:53.559366] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-28T18:36:54.061311] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T18:36:54.359368] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-28T18:36:54.902688] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:36:55.159334] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-28T18:36:55.959329] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-28T18:36:56.685928] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-28T18:36:56.759315] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-28T18:36:57.134164] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:36:57.559417] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-28T18:36:58.359404] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-28T18:36:58.411447] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-10-28T18:36:59.063260] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T18:36:59.159333] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-28T18:36:59.827723] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:36:59.959309] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-28T18:37:00.113435] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (3.35 seconds). [2025-10-28T18:37:00.123018] [INFO ] [REMOTE ] ERO: Full fetch complete (60713 records). [2025-10-28T18:37:00.123127] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-28T18:37:00.500508] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-28T18:37:00.500579] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-28T18:37:00.501347] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-28T18:37:00.501409] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-28T18:37:00.502520] [DEBUG] [LOCAL ] ERO: Trimmed 60713 records to 41989 (keeping 200 days of data) [2025-10-28T18:37:00.739725] [DEBUG] [LOCAL ] ERO: Primary data saved (41989 records). [2025-10-28T18:37:00.739888] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-28T18:37:00.739981] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 21.6s. Estimated remaining: 3h 24m 6s. Rate: 7.9 symbols/min [2025-10-28T18:37:00.770945] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-28T18:37:00.910515] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:00.934845] [DEBUG] [LOCAL ] ESAB: Loaded 25775 existing records from primary storage. [2025-10-28T18:37:00.935082] [INFO ] [MAIN ] ESAB: Loaded 25775 existing records. [2025-10-28T18:37:01.109213] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:01.109401] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-28T18:37:01.109447] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-28T18:37:01.110047] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-28T18:37:01.110104] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-28T18:37:01.473547] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:01.514916] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T18:37:01.559377] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-28T18:37:01.868471] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-28T18:37:02.359369] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-28T18:37:02.681738] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-28T18:37:03.159396] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-28T18:37:03.365815] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T18:37:03.694313] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:37:03.959350] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-28T18:37:04.520118] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:37:04.759392] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-28T18:37:05.545767] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:37:05.559293] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-28T18:37:06.308226] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:37:06.318715] [INFO ] [REMOTE ] ES: Full fetch complete (76476 records). [2025-10-28T18:37:06.318846] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-28T18:37:06.364433] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-28T18:37:06.706234] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-28T18:37:06.706331] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-28T18:37:06.707442] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-28T18:37:06.707519] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-28T18:37:06.708929] [DEBUG] [LOCAL ] ES: Trimmed 76476 records to 52680 (keeping 200 days of data) [2025-10-28T18:37:07.025586] [DEBUG] [LOCAL ] ES: Primary data saved (52680 records). [2025-10-28T18:37:07.025762] [INFO ] [MAIN ] ES: Full history saved. [2025-10-28T18:37:07.026318] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ES took 20.4s. Estimated remaining: 3h 23m 56s. Rate: 7.9 symbols/min [2025-10-28T18:37:07.160399] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-28T18:37:07.170958] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T18:37:07.250178] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:07.268387] [DEBUG] [LOCAL ] ESE: Loaded 16199 existing records from primary storage. [2025-10-28T18:37:07.268617] [INFO ] [MAIN ] ESE: Loaded 16199 existing records. [2025-10-28T18:37:07.441451] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:07.441639] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-28T18:37:07.441718] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-28T18:37:07.442092] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-28T18:37:07.442147] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-28T18:37:07.786062] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:07.959360] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-28T18:37:08.055971] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T18:37:08.066534] [INFO ] [REMOTE ] ERJ: Full fetch complete (73173 records). [2025-10-28T18:37:08.066698] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-28T18:37:08.460595] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-28T18:37:08.460712] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-28T18:37:08.461575] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-28T18:37:08.461619] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-28T18:37:08.463053] [DEBUG] [LOCAL ] ERJ: Trimmed 73173 records to 50209 (keeping 200 days of data) [2025-10-28T18:37:08.673380] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T18:37:08.767867] [DEBUG] [LOCAL ] ERJ: Primary data saved (50209 records). [2025-10-28T18:37:08.763973] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-28T18:37:08.768006] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-28T18:37:08.768584] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. ERJ took 29.6s. Estimated remaining: 3h 23m 36s. Rate: 7.9 symbols/min [2025-10-28T18:37:08.939144] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:08.992468] [DEBUG] [LOCAL ] ESI: Loaded 50575 existing records from primary storage. [2025-10-28T18:37:08.992794] [INFO ] [MAIN ] ESI: Loaded 50575 existing records. [2025-10-28T18:37:09.194397] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:09.194616] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-28T18:37:09.194695] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-28T18:37:09.195171] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-28T18:37:09.195231] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-28T18:37:09.568457] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-28T18:37:09.572179] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:09.655141] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T18:37:09.666448] [INFO ] [REMOTE ] EQT: Full fetch complete (77469 records). [2025-10-28T18:37:09.666857] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-28T18:37:09.668006] [FATAL] [VALIDATOR ] EQT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:37:09.668163] [FATAL] [MAIN ] EQT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:37:09.668295] [WARN ] [MAIN ] EQT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:37:09.677582] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-28T18:37:09.683590] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-10-28T18:37:09.683897] [INFO ] [LOCAL ] EQT: Starting deletion of derivative data. [2025-10-28T18:37:09.684857] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T18:37:09.691103] [DEBUG] [LOCAL ] EQT: Deleted derivative data file. [2025-10-28T18:37:09.691515] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. EQT took 30.5s. Estimated remaining: 3h 23m 14s. Rate: 7.9 symbols/min [2025-10-28T18:37:09.854558] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:09.886351] [DEBUG] [LOCAL ] ESNT: Loaded 37618 existing records from primary storage. [2025-10-28T18:37:09.886666] [INFO ] [MAIN ] ESNT: Loaded 37618 existing records. [2025-10-28T18:37:10.068075] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:10.068253] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-28T18:37:10.068299] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-28T18:37:10.068981] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-28T18:37:10.069037] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-28T18:37:10.362448] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-28T18:37:10.442023] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T18:37:10.441001] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:11.159326] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-28T18:37:11.658601] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:37:11.959334] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-28T18:37:12.537393] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:37:12.759347] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-28T18:37:12.948522] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T18:37:13.559331] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-28T18:37:13.808084] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:37:14.359321] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-28T18:37:14.779248] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:37:15.091828] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T18:37:15.159440] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-28T18:37:15.959313] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-28T18:37:16.731060] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T18:37:16.759291] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-28T18:37:16.841088] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T18:37:17.559351] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-28T18:37:18.359373] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-28T18:37:18.533678] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T18:37:18.675406] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T18:37:19.097166] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:37:19.159304] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-28T18:37:19.829732] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:37:19.959372] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-28T18:37:20.704139] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:37:20.759307] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-28T18:37:21.559306] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-28T18:37:21.625403] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:37:22.359313] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-28T18:37:22.637102] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:37:23.159417] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-28T18:37:23.511567] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:37:23.959438] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-28T18:37:24.210788] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T18:37:24.759361] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-28T18:37:25.102753] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T18:37:25.559325] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-28T18:37:25.622673] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T18:37:26.239349] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T18:37:26.359371] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-28T18:37:27.091230] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:37:27.159378] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-28T18:37:27.959316] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-28T18:37:27.984193] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:37:28.759307] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-28T18:37:28.950266] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T18:37:28.955825] [INFO ] [REMOTE ] ESAB: Full fetch complete (36562 records). [2025-10-28T18:37:28.955908] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-28T18:37:29.340383] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-28T18:37:29.340450] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-28T18:37:29.341023] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-28T18:37:29.341085] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-28T18:37:29.341868] [DEBUG] [LOCAL ] ESAB: Trimmed 36562 records to 25690 (keeping 200 days of data) [2025-10-28T18:37:29.497893] [DEBUG] [LOCAL ] ESAB: Primary data saved (25690 records). [2025-10-28T18:37:29.498029] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-28T18:37:29.498158] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESAB took 28.8s. Estimated remaining: 3h 23m 32s. Rate: 7.9 symbols/min [2025-10-28T18:37:29.563132] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-28T18:37:29.677878] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:29.716459] [DEBUG] [LOCAL ] ESRT: Loaded 46460 existing records from primary storage. [2025-10-28T18:37:29.717011] [INFO ] [MAIN ] ESRT: Loaded 46460 existing records. [2025-10-28T18:37:29.811392] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:37:29.920341] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:29.920554] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-28T18:37:29.920602] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-28T18:37:29.921372] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-28T18:37:29.921429] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-28T18:37:30.276066] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:30.288103] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T18:37:30.359295] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-28T18:37:31.120601] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T18:37:31.123808] [INFO ] [REMOTE ] ESE: Full fetch complete (22954 records). [2025-10-28T18:37:31.123882] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-28T18:37:31.164493] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-28T18:37:31.488507] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-28T18:37:31.488578] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-28T18:37:31.489044] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-28T18:37:31.489104] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-28T18:37:31.489760] [DEBUG] [LOCAL ] ESE: Trimmed 22954 records to 16155 (keeping 200 days of data) [2025-10-28T18:37:31.588087] [DEBUG] [LOCAL ] ESE: Primary data saved (16155 records). [2025-10-28T18:37:31.588212] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-28T18:37:31.588284] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ESE took 24.6s. Estimated remaining: 3h 23m 13s. Rate: 7.9 symbols/min [2025-10-28T18:37:31.774576] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:31.812520] [DEBUG] [LOCAL ] ESS: Loaded 29996 existing records from primary storage. [2025-10-28T18:37:31.812877] [INFO ] [MAIN ] ESS: Loaded 29996 existing records. [2025-10-28T18:37:31.964435] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-28T18:37:31.992532] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:31.992702] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-28T18:37:31.992755] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-28T18:37:31.993300] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-28T18:37:31.993355] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-28T18:37:32.338856] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:32.549925] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:37:32.759395] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-28T18:37:33.334852] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:37:33.559332] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-28T18:37:34.177267] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:37:34.359308] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-28T18:37:34.612857] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T18:37:35.159325] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-28T18:37:35.346351] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T18:37:35.959369] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-28T18:37:36.267727] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T18:37:36.759328] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-28T18:37:37.160904] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:37:37.559372] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-28T18:37:37.806592] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T18:37:38.359340] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-28T18:37:38.801854] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T18:37:38.812291] [INFO ] [REMOTE ] ESNT: Full fetch complete (56641 records). [2025-10-28T18:37:38.812436] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-28T18:37:38.813136] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:37:38.813234] [FATAL] [MAIN ] ESNT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:37:38.813301] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:37:38.813396] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-28T18:37:38.813497] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-10-28T18:37:38.813568] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-10-28T18:37:38.813890] [DEBUG] [LOCAL ] ESNT: Deleted derivative data file. [2025-10-28T18:37:38.814028] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESNT took 29.1s. Estimated remaining: 3h 23m 4s. Rate: 7.9 symbols/min [2025-10-28T18:37:38.980962] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:39.022087] [DEBUG] [LOCAL ] ESTC: Loaded 50185 existing records from primary storage. [2025-10-28T18:37:39.022404] [INFO ] [MAIN ] ESTC: Loaded 50185 existing records. [2025-10-28T18:37:39.164453] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-28T18:37:39.200904] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:39.201074] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-28T18:37:39.201133] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-28T18:37:39.202022] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-28T18:37:39.202078] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-28T18:37:39.565218] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:39.581237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:37:39.959334] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-28T18:37:40.418534] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:37:40.752745] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:37:40.759289] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-28T18:37:41.559314] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-28T18:37:41.711574] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T18:37:42.359395] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-28T18:37:43.049977] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T18:37:43.159316] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-28T18:37:43.361443] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:37:43.959376] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-28T18:37:44.296133] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:37:44.759317] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-28T18:37:44.857009] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T18:37:45.559329] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-28T18:37:45.978740] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:37:46.359340] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-28T18:37:46.807255] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:37:47.159293] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-28T18:37:47.293507] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:37:47.959342] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-28T18:37:48.277928] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:37:48.759350] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-28T18:37:49.138875] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:37:49.559350] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-28T18:37:50.014065] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:37:50.359340] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-28T18:37:50.916284] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T18:37:51.159348] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-28T18:37:51.442052] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:37:51.959330] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-28T18:37:52.423440] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:37:52.759396] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-28T18:37:53.419501] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:37:53.559345] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-28T18:37:54.055338] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:37:54.359341] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-28T18:37:54.584901] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:37:55.159340] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-28T18:37:55.611721] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T18:37:55.621115] [INFO ] [REMOTE ] ESRT: Full fetch complete (66753 records). [2025-10-28T18:37:55.621228] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-28T18:37:55.961301] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-28T18:37:56.008098] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-28T18:37:56.008173] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-28T18:37:56.009084] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-28T18:37:56.009251] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-28T18:37:56.010615] [DEBUG] [LOCAL ] ESRT: Trimmed 66753 records to 46380 (keeping 200 days of data) [2025-10-28T18:37:56.270264] [DEBUG] [LOCAL ] ESRT: Primary data saved (46380 records). [2025-10-28T18:37:56.270390] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-28T18:37:56.270464] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ESRT took 26.8s. Estimated remaining: 3h 23m 17s. Rate: 7.9 symbols/min [2025-10-28T18:37:56.444237] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:56.492794] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-28T18:37:56.493086] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-28T18:37:56.672085] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:56.672373] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-28T18:37:56.672478] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-28T18:37:56.673625] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-28T18:37:56.673711] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-28T18:37:56.766327] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-28T18:37:56.975798] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T18:37:57.079723] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:57.098191] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:37:57.559387] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-28T18:37:58.194577] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T18:37:58.359349] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-28T18:37:59.159328] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-28T18:37:59.409544] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T18:37:59.618173] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:37:59.959332] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-28T18:38:00.350410] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:38:00.759344] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-28T18:38:01.564479] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-28T18:38:01.579393] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T18:38:02.073073] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T18:38:02.359366] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-28T18:38:03.013624] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:38:03.024186] [INFO ] [REMOTE ] ESI: Full fetch complete (73294 records). [2025-10-28T18:38:03.024349] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-28T18:38:03.168217] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-28T18:38:03.419216] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-28T18:38:03.419288] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-28T18:38:03.420124] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-28T18:38:03.420185] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-28T18:38:03.421552] [DEBUG] [LOCAL ] ESI: Trimmed 73294 records to 50572 (keeping 200 days of data) [2025-10-28T18:38:03.719726] [DEBUG] [LOCAL ] ESI: Primary data saved (50572 records). [2025-10-28T18:38:03.719848] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-28T18:38:03.719923] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ESI took 55.0s. Estimated remaining: 3h 23m 9s. Rate: 7.9 symbols/min [2025-10-28T18:38:03.893082] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:03.926967] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T18:38:03.942129] [DEBUG] [LOCAL ] ETB: Loaded 11479 existing records from primary storage. [2025-10-28T18:38:03.942474] [INFO ] [MAIN ] ETB: Loaded 11479 existing records. [2025-10-28T18:38:03.964408] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-28T18:38:04.118165] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:04.118318] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-28T18:38:04.118364] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-28T18:38:04.118556] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-28T18:38:04.118612] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-28T18:38:04.478067] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:04.759312] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-28T18:38:04.912859] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T18:38:05.181852] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:38:05.188722] [INFO ] [REMOTE ] ESS: Full fetch complete (43831 records). [2025-10-28T18:38:05.188886] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-28T18:38:05.564905] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-28T18:38:05.567331] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-28T18:38:05.567405] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-28T18:38:05.568843] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-28T18:38:05.568907] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-28T18:38:05.569992] [DEBUG] [LOCAL ] ESS: Trimmed 43831 records to 29980 (keeping 200 days of data) [2025-10-28T18:38:05.753684] [DEBUG] [LOCAL ] ESS: Primary data saved (29980 records). [2025-10-28T18:38:05.753813] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-28T18:38:05.753905] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESS took 34.2s. Estimated remaining: 3h 22m 50s. Rate: 7.9 symbols/min [2025-10-28T18:38:05.933178] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:05.958434] [DEBUG] [LOCAL ] ETD: Loaded 26664 existing records from primary storage. [2025-10-28T18:38:05.958704] [INFO ] [MAIN ] ETD: Loaded 26664 existing records. [2025-10-28T18:38:06.139937] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:06.140171] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-28T18:38:06.140268] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-28T18:38:06.140873] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-28T18:38:06.140940] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-28T18:38:06.370033] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-28T18:38:06.496043] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:06.530982] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T18:38:06.545234] [INFO ] [REMOTE ] ESTC: Full fetch complete (72501 records). [2025-10-28T18:38:06.545435] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-28T18:38:06.948887] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-28T18:38:06.949093] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-28T18:38:06.949984] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-28T18:38:06.950045] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-28T18:38:06.951354] [DEBUG] [LOCAL ] ESTC: Trimmed 72501 records to 50182 (keeping 200 days of data) [2025-10-28T18:38:07.049099] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T18:38:07.166186] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-28T18:38:07.255517] [DEBUG] [LOCAL ] ESTC: Primary data saved (50182 records). [2025-10-28T18:38:07.255878] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-28T18:38:07.255998] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ESTC took 28.4s. Estimated remaining: 3h 22m 30s. Rate: 7.9 symbols/min [2025-10-28T18:38:07.429036] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:07.473247] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T18:38:07.479044] [DEBUG] [LOCAL ] ETG: Loaded 16250 existing records from primary storage. [2025-10-28T18:38:07.491215] [INFO ] [MAIN ] ETG: Loaded 16250 existing records. [2025-10-28T18:38:07.667604] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:07.667871] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-28T18:38:07.667924] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-28T18:38:07.668275] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-28T18:38:07.668333] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-28T18:38:07.962162] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-28T18:38:08.068402] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:08.070332] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:38:08.759350] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-28T18:38:09.559356] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-28T18:38:09.911020] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T18:38:10.203913] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-28T18:38:10.359338] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-28T18:38:10.676813] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:38:10.992453] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:38:11.159386] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-28T18:38:11.959335] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-28T18:38:12.577566] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T18:38:12.708614] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:38:12.759357] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-28T18:38:13.409234] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T18:38:13.559324] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-28T18:38:14.218365] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T18:38:14.359332] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-28T18:38:15.055608] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T18:38:15.159352] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-28T18:38:15.959388] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-28T18:38:16.063849] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T18:38:16.759354] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-28T18:38:17.416798] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T18:38:17.560580] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-28T18:38:17.566234] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T18:38:18.302784] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T18:38:18.359298] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-28T18:38:18.914426] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T18:38:19.159377] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-28T18:38:19.693610] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T18:38:19.959352] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-28T18:38:20.759338] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-28T18:38:21.559354] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-28T18:38:21.824258] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T18:38:21.910675] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:38:21.934184] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:38:22.359372] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-28T18:38:23.117677] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T18:38:23.159379] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-28T18:38:23.669609] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:38:23.959354] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-28T18:38:24.759333] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-28T18:38:24.901599] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:38:25.323034] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T18:38:25.326294] [INFO ] [REMOTE ] ETB: Full fetch complete (18471 records). [2025-10-28T18:38:25.326429] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-28T18:38:25.564435] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-28T18:38:25.713272] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-28T18:38:25.713381] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-28T18:38:25.714298] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-28T18:38:25.714365] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-28T18:38:25.715083] [DEBUG] [LOCAL ] ETB: Trimmed 18471 records to 11398 (keeping 200 days of data) [2025-10-28T18:38:25.790430] [DEBUG] [LOCAL ] ETB: Primary data saved (11398 records). [2025-10-28T18:38:25.790618] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-28T18:38:25.790765] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETB took 22.1s. Estimated remaining: 3h 22m 44s. Rate: 7.9 symbols/min [2025-10-28T18:38:25.966130] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:25.983885] [DEBUG] [LOCAL ] ETJ: Loaded 15848 existing records from primary storage. [2025-10-28T18:38:25.984244] [INFO ] [MAIN ] ETJ: Loaded 15848 existing records. [2025-10-28T18:38:26.169129] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:26.169411] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-28T18:38:26.169462] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-28T18:38:26.169942] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-28T18:38:26.170003] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-28T18:38:26.364129] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-28T18:38:26.468675] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:38:26.580807] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:27.159383] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-28T18:38:27.243605] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:38:27.959351] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-28T18:38:28.010525] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:38:28.699220] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T18:38:28.759300] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-28T18:38:29.559308] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-28T18:38:29.619440] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:38:30.258861] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:38:30.359305] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-28T18:38:31.036316] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T18:38:31.159351] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-28T18:38:31.959315] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-28T18:38:32.056130] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T18:38:32.759347] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-28T18:38:33.499631] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T18:38:33.518147] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T18:38:33.559308] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-28T18:38:34.359322] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-28T18:38:35.052779] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:38:35.159339] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-28T18:38:35.373045] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T18:38:35.384623] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-28T18:38:35.384887] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-28T18:38:35.818417] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-28T18:38:35.818569] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-28T18:38:35.820225] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-28T18:38:35.820310] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-28T18:38:35.822699] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-28T18:38:35.962019] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-28T18:38:36.192090] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T18:38:36.199865] [INFO ] [REMOTE ] ETD: Full fetch complete (38328 records). [2025-10-28T18:38:36.200907] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-28T18:38:36.336282] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-28T18:38:36.346858] [INFO ] [MAIN ] ET: Full history saved. [2025-10-28T18:38:36.359082] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ET took 40.1s. Estimated remaining: 3h 22m 43s. Rate: 7.9 symbols/min [2025-10-28T18:38:36.736446] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:38:36.730404] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:36.763451] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-28T18:38:36.838458] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-28T18:38:36.838585] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-28T18:38:36.839764] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-28T18:38:36.841171] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-28T18:38:36.843448] [DEBUG] [LOCAL ] ETD: Trimmed 38328 records to 26545 (keeping 200 days of data) [2025-10-28T18:38:37.007279] [DEBUG] [LOCAL ] ETN: Loaded 52514 existing records from primary storage. [2025-10-28T18:38:37.027977] [INFO ] [MAIN ] ETN: Loaded 52514 existing records. [2025-10-28T18:38:37.216774] [DEBUG] [LOCAL ] ETD: Primary data saved (26545 records). [2025-10-28T18:38:37.236462] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-28T18:38:37.236695] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETD took 31.5s. Estimated remaining: 3h 22m 21s. Rate: 7.9 symbols/min [2025-10-28T18:38:37.236361] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:37.236928] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-28T18:38:37.237015] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-28T18:38:37.254892] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-28T18:38:37.278988] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-28T18:38:37.546569] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:37.579458] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-28T18:38:37.692424] [DEBUG] [LOCAL ] ETO: Loaded 6726 existing records from primary storage. [2025-10-28T18:38:37.703608] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T18:38:37.712380] [INFO ] [MAIN ] ETO: Loaded 6726 existing records. [2025-10-28T18:38:38.109088] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:38.132781] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:38.132998] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-28T18:38:38.133044] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-28T18:38:38.133267] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-28T18:38:38.133308] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-28T18:38:38.367472] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-28T18:38:38.408976] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T18:38:38.543085] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:39.159332] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-28T18:38:39.959323] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-28T18:38:40.050756] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T18:38:40.124152] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:38:40.596572] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T18:38:40.759361] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-28T18:38:41.559348] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-28T18:38:42.109040] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:38:42.129177] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T18:38:42.359373] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-28T18:38:43.124465] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:38:43.128241] [INFO ] [REMOTE ] ETG: Full fetch complete (24372 records). [2025-10-28T18:38:43.128327] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-28T18:38:43.164539] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-28T18:38:43.511628] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-28T18:38:43.511732] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-28T18:38:43.512246] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-28T18:38:43.512304] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-28T18:38:43.512982] [DEBUG] [LOCAL ] ETG: Trimmed 24372 records to 16124 (keeping 200 days of data) [2025-10-28T18:38:43.610237] [DEBUG] [LOCAL ] ETG: Primary data saved (16124 records). [2025-10-28T18:38:43.610382] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-28T18:38:43.610460] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETG took 36.4s. Estimated remaining: 3h 22m 11s. Rate: 7.9 symbols/min [2025-10-28T18:38:43.784704] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:43.829961] [DEBUG] [LOCAL ] ETR: Loaded 53171 existing records from primary storage. [2025-10-28T18:38:43.830282] [INFO ] [MAIN ] ETR: Loaded 53171 existing records. [2025-10-28T18:38:43.969761] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-28T18:38:44.010091] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:44.010542] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-28T18:38:44.010620] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-28T18:38:44.011679] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-28T18:38:44.011738] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-28T18:38:44.371291] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:44.441128] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:38:44.734843] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:38:44.759304] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-28T18:38:45.559334] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-28T18:38:46.103411] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T18:38:46.359339] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-28T18:38:46.411064] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:38:46.741538] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T18:38:47.159339] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-28T18:38:47.609373] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T18:38:47.959340] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-28T18:38:48.414940] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T18:38:48.759413] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-28T18:38:49.284080] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:38:49.559411] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-28T18:38:50.278992] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T18:38:50.359301] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-28T18:38:51.058874] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T18:38:51.062250] [INFO ] [REMOTE ] ETJ: Full fetch complete (25167 records). [2025-10-28T18:38:51.062326] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-28T18:38:51.159333] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-28T18:38:51.423320] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-28T18:38:51.423388] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-28T18:38:51.423809] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-28T18:38:51.423869] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-28T18:38:51.424431] [DEBUG] [LOCAL ] ETJ: Trimmed 25167 records to 15711 (keeping 200 days of data) [2025-10-28T18:38:51.512866] [DEBUG] [LOCAL ] ETJ: Primary data saved (15711 records). [2025-10-28T18:38:51.512986] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-28T18:38:51.513058] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETJ took 25.7s. Estimated remaining: 3h 22m 4s. Rate: 7.9 symbols/min [2025-10-28T18:38:51.678700] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:51.724311] [DEBUG] [LOCAL ] ETSY: Loaded 53555 existing records from primary storage. [2025-10-28T18:38:51.724594] [INFO ] [MAIN ] ETSY: Loaded 53555 existing records. [2025-10-28T18:38:51.900206] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:51.900372] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-28T18:38:51.900416] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-28T18:38:51.901220] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-28T18:38:51.901292] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-28T18:38:51.964539] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-28T18:38:52.247907] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:52.654991] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:38:52.759339] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-28T18:38:53.175120] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T18:38:53.265956] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:38:53.559329] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-28T18:38:54.359443] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-28T18:38:54.830793] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:38:55.159397] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-28T18:38:55.591097] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:38:55.612300] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:38:55.959337] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-28T18:38:56.759388] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-28T18:38:57.262704] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:38:57.559386] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-28T18:38:57.952348] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:38:58.162232] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:38:58.359350] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-28T18:38:59.004903] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:38:59.007097] [INFO ] [REMOTE ] ETO: Full fetch complete (9676 records). [2025-10-28T18:38:59.007169] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-28T18:38:59.161240] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-28T18:38:59.373289] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-28T18:38:59.373362] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-28T18:38:59.373593] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-28T18:38:59.373629] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-28T18:38:59.374066] [DEBUG] [LOCAL ] ETO: Trimmed 9676 records to 6682 (keeping 200 days of data) [2025-10-28T18:38:59.414707] [DEBUG] [LOCAL ] ETO: Primary data saved (6682 records). [2025-10-28T18:38:59.414810] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-28T18:38:59.414887] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETO took 22.2s. Estimated remaining: 3h 21m 57s. Rate: 7.9 symbols/min [2025-10-28T18:38:59.590315] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:59.610783] [DEBUG] [LOCAL ] ETV: Loaded 21341 existing records from primary storage. [2025-10-28T18:38:59.611037] [INFO ] [MAIN ] ETV: Loaded 21341 existing records. [2025-10-28T18:38:59.787116] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:59.787306] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-28T18:38:59.787353] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-28T18:38:59.787844] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-28T18:38:59.787902] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-28T18:38:59.971111] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-28T18:39:00.151805] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:00.734556] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T18:39:00.759296] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-28T18:39:01.433886] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T18:39:01.559334] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-28T18:39:02.359399] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-28T18:39:02.762292] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-28T18:39:03.159409] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-28T18:39:03.358544] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-28T18:39:03.552452] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:39:03.959350] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-28T18:39:04.479660] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:39:04.664046] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:39:04.759316] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-28T18:39:05.550892] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:39:05.559290] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-28T18:39:06.359358] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-28T18:39:06.500835] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:39:07.159344] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-28T18:39:07.855779] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T18:39:07.856758] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T18:39:07.959302] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-28T18:39:08.660112] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T18:39:08.759318] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-28T18:39:09.559338] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-28T18:39:10.373478] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-28T18:39:10.376575] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:39:10.387480] [INFO ] [REMOTE ] ETN: Full fetch complete (76597 records). [2025-10-28T18:39:10.387609] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-28T18:39:10.805128] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-28T18:39:10.805213] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-28T18:39:10.806095] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-28T18:39:10.806157] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-28T18:39:10.807612] [DEBUG] [LOCAL ] ETN: Trimmed 76597 records to 52498 (keeping 200 days of data) [2025-10-28T18:39:11.165497] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T18:39:11.163133] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-28T18:39:11.187980] [DEBUG] [LOCAL ] ETN: Primary data saved (52498 records). [2025-10-28T18:39:11.189352] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-28T18:39:11.189479] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETN took 34.8s. Estimated remaining: 3h 21m 58s. Rate: 7.9 symbols/min [2025-10-28T18:39:11.331479] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T18:39:11.391171] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:11.391358] [DEBUG] [LOCAL ] ETW: No existing data file found in primary storage. [2025-10-28T18:39:11.391394] [WARN ] [MAIN ] ETW: No existing data found, performing full refresh instead. [2025-10-28T18:39:11.391502] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-28T18:39:11.391543] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-28T18:39:11.391584] [DEBUG] [LOCAL ] ETW: No primary data file found to delete. [2025-10-28T18:39:11.391615] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-28T18:39:11.757965] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:11.959329] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-28T18:39:12.504830] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:39:12.759401] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-28T18:39:13.001858] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:39:13.559381] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-28T18:39:13.612981] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:39:14.359348] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-28T18:39:14.889596] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T18:39:15.049444] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T18:39:15.159303] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-28T18:39:15.959357] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-28T18:39:16.019066] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T18:39:16.708247] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:39:16.759306] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-28T18:39:17.559303] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-28T18:39:17.682241] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T18:39:17.687456] [INFO ] [REMOTE ] ETV: Full fetch complete (32083 records). [2025-10-28T18:39:17.687583] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-28T18:39:18.057864] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-28T18:39:18.057939] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-28T18:39:18.058472] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-28T18:39:18.058510] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-28T18:39:18.059268] [DEBUG] [LOCAL ] ETV: Trimmed 32083 records to 21314 (keeping 200 days of data) [2025-10-28T18:39:18.183685] [DEBUG] [LOCAL ] ETV: Primary data saved (21314 records). [2025-10-28T18:39:18.183811] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-28T18:39:18.183899] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETV took 18.8s. Estimated remaining: 3h 21m 49s. Rate: 7.9 symbols/min [2025-10-28T18:39:18.349586] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:18.349767] [DEBUG] [LOCAL ] ETX: No existing data file found in primary storage. [2025-10-28T18:39:18.349810] [WARN ] [MAIN ] ETX: No existing data found, performing full refresh instead. [2025-10-28T18:39:18.349917] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-28T18:39:18.349957] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-28T18:39:18.349997] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-28T18:39:18.350028] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-28T18:39:18.369797] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-28T18:39:18.716283] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:18.854054] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:39:19.159332] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-28T18:39:19.769118] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:39:19.959354] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-28T18:39:20.438340] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T18:39:20.759399] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-28T18:39:21.045040] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:39:21.559362] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-28T18:39:22.305037] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T18:39:22.359333] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-28T18:39:22.761174] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:39:23.159343] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-28T18:39:23.685049] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:39:23.959324] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-28T18:39:23.996019] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T18:39:24.691707] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T18:39:24.759358] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-28T18:39:25.447187] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T18:39:25.559325] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-28T18:39:26.359353] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-28T18:39:26.379762] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T18:39:27.159373] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-28T18:39:27.890285] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T18:39:27.928877] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T18:39:27.959308] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-28T18:39:28.759337] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-28T18:39:29.486690] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T18:39:29.497061] [INFO ] [REMOTE ] ETSY: Full fetch complete (77267 records). [2025-10-28T18:39:29.497210] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-28T18:39:29.498081] [FATAL] [VALIDATOR ] ETSY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:39:29.498172] [FATAL] [MAIN ] ETSY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:39:29.498216] [WARN ] [MAIN ] ETSY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:39:29.498280] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-28T18:39:29.498347] [DEBUG] [LOCAL ] ETSY: No primary data file found to delete. [2025-10-28T18:39:29.498385] [INFO ] [LOCAL ] ETSY: Starting deletion of derivative data. [2025-10-28T18:39:29.498924] [DEBUG] [LOCAL ] ETSY: Deleted derivative data file. [2025-10-28T18:39:29.499252] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETSY took 38.0s. Estimated remaining: 3h 21m 49s. Rate: 7.9 symbols/min [2025-10-28T18:39:29.564455] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-28T18:39:29.677078] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:29.677370] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-10-28T18:39:29.677415] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-10-28T18:39:29.677543] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-28T18:39:29.677586] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-28T18:39:29.677630] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-28T18:39:29.677703] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-28T18:39:30.089304] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:30.232025] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:39:30.360214] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-28T18:39:30.362354] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T18:39:30.760968] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:39:31.159351] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-28T18:39:31.959342] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-28T18:39:32.021020] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T18:39:32.027164] [INFO ] [REMOTE ] ETW: Full fetch complete (36417 records). [2025-10-28T18:39:32.027276] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-28T18:39:32.319489] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:39:32.418083] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-28T18:39:32.418162] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-28T18:39:32.418843] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-28T18:39:32.418905] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-28T18:39:32.419699] [DEBUG] [LOCAL ] ETW: Trimmed 36417 records to 24557 (keeping 200 days of data) [2025-10-28T18:39:32.559397] [DEBUG] [LOCAL ] ETW: Primary data saved (24557 records). [2025-10-28T18:39:32.559529] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-28T18:39:32.559598] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETW took 21.4s. Estimated remaining: 3h 21m 32s. Rate: 7.9 symbols/min [2025-10-28T18:39:32.723152] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:32.739136] [DEBUG] [LOCAL ] EVC: Loaded 17464 existing records from primary storage. [2025-10-28T18:39:32.739361] [INFO ] [MAIN ] EVC: Loaded 17464 existing records. [2025-10-28T18:39:32.767700] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-28T18:39:32.918948] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:32.920144] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-28T18:39:32.920204] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-28T18:39:32.921149] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-28T18:39:32.921244] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-28T18:39:33.251436] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:39:33.279297] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:33.559380] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-28T18:39:33.941586] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T18:39:34.359345] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-28T18:39:35.159359] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-28T18:39:35.490015] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:39:35.959345] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-28T18:39:36.520880] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T18:39:36.633671] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T18:39:36.644593] [INFO ] [REMOTE ] ETR: Full fetch complete (77261 records). [2025-10-28T18:39:36.644755] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-28T18:39:36.764445] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-28T18:39:37.058149] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-28T18:39:37.058245] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-28T18:39:37.059231] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-28T18:39:37.059294] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-28T18:39:37.060808] [DEBUG] [LOCAL ] ETR: Trimmed 77261 records to 53167 (keeping 200 days of data) [2025-10-28T18:39:37.373581] [DEBUG] [LOCAL ] ETR: Primary data saved (53167 records). [2025-10-28T18:39:37.373728] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-28T18:39:37.373822] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. ETR took 53.8s. Estimated remaining: 3h 21m 18s. Rate: 7.9 symbols/min [2025-10-28T18:39:37.547490] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:37.563702] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-28T18:39:37.578180] [DEBUG] [LOCAL ] EVEX: Loaded 33243 existing records from primary storage. [2025-10-28T18:39:37.578427] [INFO ] [MAIN ] EVEX: Loaded 33243 existing records. [2025-10-28T18:39:37.772079] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:39:37.771193] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:37.777776] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-28T18:39:37.777835] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-28T18:39:37.778277] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-28T18:39:37.778334] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-28T18:39:38.059949] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T18:39:38.136931] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:38.359326] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-28T18:39:39.159314] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-28T18:39:39.380252] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T18:39:39.910241] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:39:39.959319] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-28T18:39:40.759330] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-28T18:39:41.288123] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:39:41.529101] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:39:41.559307] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-28T18:39:42.316461] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T18:39:42.359301] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-28T18:39:43.050713] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:39:43.159350] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-28T18:39:43.925820] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:39:43.959298] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-28T18:39:44.739949] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:39:44.759293] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-28T18:39:45.509611] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T18:39:45.559335] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-28T18:39:46.008299] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:39:46.359332] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-28T18:39:47.159303] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-28T18:39:47.296681] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T18:39:47.606434] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T18:39:47.959345] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-28T18:39:48.759337] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-28T18:39:48.973920] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T18:39:49.559298] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-28T18:39:49.629252] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:39:50.022175] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T18:39:50.023559] [INFO ] [REMOTE ] ETX: Full fetch complete (6742 records). [2025-10-28T18:39:50.023630] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-28T18:39:50.024019] [FATAL] [VALIDATOR ] ETX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:39:50.024096] [FATAL] [MAIN ] ETX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:39:50.024138] [WARN ] [MAIN ] ETX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:39:50.024201] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-28T18:39:50.024261] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-28T18:39:50.024295] [INFO ] [LOCAL ] ETX: Starting deletion of derivative data. [2025-10-28T18:39:50.024332] [DEBUG] [LOCAL ] ETX: No derivative data file found to delete. [2025-10-28T18:39:50.024382] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. ETX took 31.8s. Estimated remaining: 3h 21m 21s. Rate: 7.9 symbols/min [2025-10-28T18:39:50.193707] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:50.203639] [DEBUG] [LOCAL ] EVF: Loaded 9436 existing records from primary storage. [2025-10-28T18:39:50.203873] [INFO ] [MAIN ] EVF: Loaded 9436 existing records. [2025-10-28T18:39:50.372534] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-28T18:39:50.378087] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:50.378954] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-28T18:39:50.379039] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-28T18:39:50.379276] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-28T18:39:50.379318] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-28T18:39:50.724060] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:51.119161] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:39:51.159307] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-28T18:39:51.959323] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-28T18:39:52.029980] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T18:39:52.759324] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-28T18:39:53.057365] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:39:53.481213] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T18:39:53.559328] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-28T18:39:54.359312] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-28T18:39:54.389213] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T18:39:55.159341] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-28T18:39:55.516345] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T18:39:55.627048] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T18:39:55.959341] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-28T18:39:56.759394] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-28T18:39:56.814375] [DEBUG] [REMOTE ] ETY: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-28T18:39:56.814704] [WARN ] [REMOTE ] ETY: No data returned for month 2025-05 [2025-10-28T18:39:56.814794] [FATAL] [REMOTE ] ETY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:39:56.814870] [FATAL] [MAIN ] ETY: Failed to fetch primary data. [2025-10-28T18:39:56.814933] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:39:56.815003] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-28T18:39:56.815066] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-28T18:39:56.815102] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-10-28T18:39:56.815142] [DEBUG] [LOCAL ] ETY: No derivative data file found to delete. [2025-10-28T18:39:56.815189] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. ETY took 27.3s. Estimated remaining: 3h 21m 12s. Rate: 7.9 symbols/min [2025-10-28T18:39:56.983775] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:56.990901] [DEBUG] [LOCAL ] EVG: Loaded 5652 existing records from primary storage. [2025-10-28T18:39:56.991098] [INFO ] [MAIN ] EVG: Loaded 5652 existing records. [2025-10-28T18:39:57.169065] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:57.169426] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-28T18:39:57.169486] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-28T18:39:57.169771] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-28T18:39:57.169828] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-28T18:39:57.530526] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:39:57.563197] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-28T18:39:57.568903] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:57.570418] [INFO ] [REMOTE ] EVEX: Full fetch complete (44338 records). [2025-10-28T18:39:57.570493] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-28T18:39:57.940784] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-28T18:39:57.940862] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-28T18:39:57.941480] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-28T18:39:57.941518] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-28T18:39:57.942401] [DEBUG] [LOCAL ] EVEX: Trimmed 44338 records to 33359 (keeping 200 days of data) [2025-10-28T18:39:58.118104] [DEBUG] [LOCAL ] EVEX: Primary data saved (33359 records). [2025-10-28T18:39:58.118229] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-28T18:39:58.118303] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. EVEX took 20.7s. Estimated remaining: 3h 20m 51s. Rate: 7.9 symbols/min [2025-10-28T18:39:58.284383] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:58.284546] [DEBUG] [LOCAL ] EVH: No existing data file found in primary storage. [2025-10-28T18:39:58.284585] [WARN ] [MAIN ] EVH: No existing data found, performing full refresh instead. [2025-10-28T18:39:58.284715] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-28T18:39:58.284767] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-28T18:39:58.284809] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-10-28T18:39:58.284840] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-28T18:39:58.360350] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-28T18:39:58.556732] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T18:39:58.663974] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:59.155033] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T18:39:59.159286] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-28T18:39:59.519255] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T18:39:59.959336] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-28T18:40:00.290540] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T18:40:00.759344] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-28T18:40:01.559369] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-28T18:40:02.118930] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T18:40:02.359318] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-28T18:40:02.515463] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T18:40:03.159328] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-28T18:40:03.179004] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:40:03.959346] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-28T18:40:04.392623] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:40:04.406940] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T18:40:04.759342] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-28T18:40:05.159410] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T18:40:05.559344] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-28T18:40:06.359352] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-28T18:40:06.788859] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T18:40:06.915022] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T18:40:07.159342] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-28T18:40:07.576025] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:40:07.959333] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-28T18:40:08.651507] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T18:40:08.759400] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-28T18:40:09.559348] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-28T18:40:09.952822] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:40:10.165544] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T18:40:10.359358] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-28T18:40:10.818506] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T18:40:11.159364] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-28T18:40:11.959359] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-28T18:40:12.463165] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:40:12.514304] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:40:12.759360] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-28T18:40:13.110126] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T18:40:13.559337] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-28T18:40:14.246981] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:40:14.359348] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-28T18:40:15.159377] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-28T18:40:15.627301] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T18:40:15.630840] [INFO ] [REMOTE ] EVC: Full fetch complete (28206 records). [2025-10-28T18:40:15.630915] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-28T18:40:15.741579] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:40:15.970632] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-28T18:40:16.017456] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-28T18:40:16.017527] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-28T18:40:16.018072] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-28T18:40:16.018132] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-28T18:40:16.018774] [DEBUG] [LOCAL ] EVC: Trimmed 28206 records to 17402 (keeping 200 days of data) [2025-10-28T18:40:16.114846] [DEBUG] [LOCAL ] EVC: Primary data saved (17402 records). [2025-10-28T18:40:16.114969] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-28T18:40:16.115046] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVC took 43.6s. Estimated remaining: 3h 21m 4s. Rate: 7.9 symbols/min [2025-10-28T18:40:16.281533] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:16.292497] [DEBUG] [LOCAL ] EVN: Loaded 10881 existing records from primary storage. [2025-10-28T18:40:16.292720] [INFO ] [MAIN ] EVN: Loaded 10881 existing records. [2025-10-28T18:40:16.466412] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:16.466626] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-28T18:40:16.466707] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-28T18:40:16.467014] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-28T18:40:16.467070] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-28T18:40:16.603613] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:40:16.766385] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-28T18:40:16.856165] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:17.239260] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:40:17.559398] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-28T18:40:18.359354] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-28T18:40:18.443734] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T18:40:18.445966] [INFO ] [REMOTE ] EVG: Full fetch complete (8133 records). [2025-10-28T18:40:18.446068] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-28T18:40:18.804459] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-28T18:40:18.804556] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-28T18:40:18.804765] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-28T18:40:18.804824] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-28T18:40:18.805213] [DEBUG] [LOCAL ] EVG: Trimmed 8133 records to 5672 (keeping 200 days of data) [2025-10-28T18:40:18.839050] [DEBUG] [LOCAL ] EVG: Primary data saved (5672 records). [2025-10-28T18:40:18.839174] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-28T18:40:18.839250] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVG took 22.0s. Estimated remaining: 3h 20m 47s. Rate: 7.9 symbols/min [2025-10-28T18:40:19.007255] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:19.040228] [DEBUG] [LOCAL ] EVR: Loaded 32984 existing records from primary storage. [2025-10-28T18:40:19.040497] [INFO ] [MAIN ] EVR: Loaded 32984 existing records. [2025-10-28T18:40:19.164468] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-28T18:40:19.220996] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:19.221376] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-28T18:40:19.221455] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-28T18:40:19.222150] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-28T18:40:19.222207] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-28T18:40:19.597691] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:19.698826] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:40:19.702004] [INFO ] [REMOTE ] EVF: Full fetch complete (12906 records). [2025-10-28T18:40:19.702107] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-28T18:40:19.964472] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-28T18:40:20.073866] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-28T18:40:20.073947] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-28T18:40:20.074231] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-28T18:40:20.074269] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-28T18:40:20.074808] [DEBUG] [LOCAL ] EVF: Trimmed 12906 records to 9375 (keeping 200 days of data) [2025-10-28T18:40:20.128959] [DEBUG] [LOCAL ] EVF: Primary data saved (9375 records). [2025-10-28T18:40:20.129092] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-28T18:40:20.129171] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVF took 30.1s. Estimated remaining: 3h 20m 27s. Rate: 7.9 symbols/min [2025-10-28T18:40:20.297632] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:20.312938] [DEBUG] [LOCAL ] EVT: Loaded 16213 existing records from primary storage. [2025-10-28T18:40:20.313192] [INFO ] [MAIN ] EVT: Loaded 16213 existing records. [2025-10-28T18:40:20.494032] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:20.494312] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-28T18:40:20.494374] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-28T18:40:20.494831] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-28T18:40:20.494889] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-28T18:40:20.767279] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-28T18:40:20.805403] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:40:20.896431] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:21.178611] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:40:21.559381] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-28T18:40:21.943669] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:40:22.359386] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-28T18:40:22.741046] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:40:23.159353] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-28T18:40:23.593805] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:40:23.693628] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T18:40:23.959356] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-28T18:40:24.759408] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-28T18:40:25.090047] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:40:25.365190] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:40:25.559353] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-28T18:40:26.133425] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T18:40:26.359345] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-28T18:40:27.159391] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-28T18:40:27.420289] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:40:27.959364] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-28T18:40:28.444318] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:40:28.759341] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-28T18:40:29.087286] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T18:40:29.228855] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T18:40:29.559354] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-28T18:40:30.218620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T18:40:30.359394] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-28T18:40:31.159318] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-28T18:40:31.217455] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T18:40:31.959334] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-28T18:40:32.532609] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T18:40:32.759343] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-28T18:40:32.835152] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:40:33.559334] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-28T18:40:33.746976] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T18:40:34.359368] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-28T18:40:34.476972] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:40:35.159357] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-28T18:40:35.839816] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T18:40:35.959314] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-28T18:40:36.000750] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:40:36.010624] [INFO ] [REMOTE ] EVH: Full fetch complete (71934 records). [2025-10-28T18:40:36.010808] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-28T18:40:36.403272] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-28T18:40:36.403348] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-28T18:40:36.404193] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-28T18:40:36.404255] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-28T18:40:36.405521] [DEBUG] [LOCAL ] EVH: Trimmed 71934 records to 49543 (keeping 200 days of data) [2025-10-28T18:40:36.696871] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:40:36.704140] [DEBUG] [LOCAL ] EVH: Primary data saved (49543 records). [2025-10-28T18:40:36.704214] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-28T18:40:36.704276] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVH took 38.6s. Estimated remaining: 3h 20m 37s. Rate: 7.9 symbols/min [2025-10-28T18:40:36.766857] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-28T18:40:36.878388] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:36.901125] [DEBUG] [LOCAL ] EVTC: Loaded 26579 existing records from primary storage. [2025-10-28T18:40:36.901346] [INFO ] [MAIN ] EVTC: Loaded 26579 existing records. [2025-10-28T18:40:37.075430] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:37.075626] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-28T18:40:37.075707] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-28T18:40:37.076232] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-28T18:40:37.076290] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-28T18:40:37.432151] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:37.443020] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:40:37.559299] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-28T18:40:38.359369] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-28T18:40:38.834775] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:40:39.159295] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-28T18:40:39.304681] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:40:39.791702] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T18:40:39.959307] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-28T18:40:40.691404] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:40:40.759301] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-28T18:40:41.559300] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-28T18:40:41.667486] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:40:42.359392] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-28T18:40:42.792974] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:40:43.159288] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-28T18:40:43.213557] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:40:43.959355] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-28T18:40:44.079150] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:40:44.759333] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-28T18:40:44.836039] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T18:40:45.559350] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-28T18:40:45.720246] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T18:40:46.359302] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-28T18:40:46.495508] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:40:47.159323] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-28T18:40:47.228158] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T18:40:47.959329] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-28T18:40:48.406281] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T18:40:48.412269] [INFO ] [REMOTE ] EVR: Full fetch complete (50338 records). [2025-10-28T18:40:48.412427] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-28T18:40:48.760419] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-28T18:40:48.802460] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-28T18:40:48.802548] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-28T18:40:48.803328] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-28T18:40:48.808518] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-28T18:40:48.817894] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T18:40:48.823995] [DEBUG] [LOCAL ] EVR: Trimmed 50338 records to 32859 (keeping 200 days of data) [2025-10-28T18:40:49.023802] [DEBUG] [LOCAL ] EVR: Primary data saved (32859 records). [2025-10-28T18:40:49.023956] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-28T18:40:49.024050] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVR took 30.2s. Estimated remaining: 3h 20m 39s. Rate: 7.8 symbols/min [2025-10-28T18:40:49.188131] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:49.225507] [DEBUG] [LOCAL ] EVTL: Loaded 41802 existing records from primary storage. [2025-10-28T18:40:49.225825] [INFO ] [MAIN ] EVTL: Loaded 41802 existing records. [2025-10-28T18:40:49.398264] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:49.398468] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-28T18:40:49.398515] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-28T18:40:49.399015] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-28T18:40:49.399075] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-28T18:40:49.571483] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-28T18:40:49.770544] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:49.779041] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T18:40:49.782229] [INFO ] [REMOTE ] EVT: Full fetch complete (24805 records). [2025-10-28T18:40:49.782297] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-28T18:40:50.139575] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-28T18:40:50.139691] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-28T18:40:50.140258] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-28T18:40:50.140300] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-28T18:40:50.141076] [DEBUG] [LOCAL ] EVT: Trimmed 24805 records to 16162 (keeping 200 days of data) [2025-10-28T18:40:50.257406] [DEBUG] [LOCAL ] EVT: Primary data saved (16162 records). [2025-10-28T18:40:50.258058] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-28T18:40:50.258355] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T18:40:50.258493] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVT took 30.1s. Estimated remaining: 3h 20m 18s. Rate: 7.9 symbols/min [2025-10-28T18:40:50.361746] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-28T18:40:50.432107] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:50.457328] [DEBUG] [LOCAL ] EVTR: Loaded 25721 existing records from primary storage. [2025-10-28T18:40:50.457567] [INFO ] [MAIN ] EVTR: Loaded 25721 existing records. [2025-10-28T18:40:50.631985] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:50.632177] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-28T18:40:50.632221] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-28T18:40:50.632577] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-28T18:40:50.632634] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-28T18:40:51.034362] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:51.159331] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-28T18:40:51.460959] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:40:51.959458] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-28T18:40:52.478131] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T18:40:52.721844] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T18:40:52.759298] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-28T18:40:53.559298] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-28T18:40:53.596047] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T18:40:54.343003] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T18:40:54.359305] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-28T18:40:54.910771] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T18:40:55.159355] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-28T18:40:55.959387] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-28T18:40:56.169847] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:40:56.725083] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:40:56.728091] [INFO ] [REMOTE ] EVN: Full fetch complete (16845 records). [2025-10-28T18:40:56.728192] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-28T18:40:56.764463] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-28T18:40:57.092302] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-28T18:40:57.092376] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-28T18:40:57.092698] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-28T18:40:57.092758] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-28T18:40:57.093223] [DEBUG] [LOCAL ] EVN: Trimmed 16845 records to 10875 (keeping 200 days of data) [2025-10-28T18:40:57.157425] [DEBUG] [LOCAL ] EVN: Primary data saved (10875 records). [2025-10-28T18:40:57.157561] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-28T18:40:57.157661] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVN took 41.0s. Estimated remaining: 3h 20m 9s. Rate: 7.9 symbols/min [2025-10-28T18:40:57.326943] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:57.375000] [DEBUG] [LOCAL ] EW: Loaded 53386 existing records from primary storage. [2025-10-28T18:40:57.375344] [INFO ] [MAIN ] EW: Loaded 53386 existing records. [2025-10-28T18:40:57.546718] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:57.546959] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-28T18:40:57.547005] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-28T18:40:57.547539] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-28T18:40:57.547595] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-28T18:40:57.567720] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-28T18:40:57.916422] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:57.939755] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:40:57.946759] [INFO ] [REMOTE ] EVTC: Full fetch complete (38482 records). [2025-10-28T18:40:57.946955] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-28T18:40:58.364556] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-28T18:40:58.640148] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-28T18:40:58.640562] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-28T18:40:58.644138] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:40:58.642520] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-28T18:40:58.652496] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-28T18:40:58.654679] [DEBUG] [LOCAL ] EVTC: Trimmed 38482 records to 26510 (keeping 200 days of data) [2025-10-28T18:40:58.854755] [DEBUG] [LOCAL ] EVTC: Primary data saved (26510 records). [2025-10-28T18:40:58.854937] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-28T18:40:58.855056] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EVTC took 22.2s. Estimated remaining: 3h 19m 50s. Rate: 7.9 symbols/min [2025-10-28T18:40:59.034300] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:59.066069] [DEBUG] [LOCAL ] EXG: Loaded 33130 existing records from primary storage. [2025-10-28T18:40:59.066364] [INFO ] [MAIN ] EXG: Loaded 33130 existing records. [2025-10-28T18:40:59.165762] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-28T18:40:59.253577] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:59.253810] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-28T18:40:59.253858] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-28T18:40:59.254142] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-28T18:40:59.254199] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-28T18:40:59.653163] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:59.920071] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:40:59.959314] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-28T18:40:59.991006] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T18:41:00.759338] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-28T18:41:01.538187] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T18:41:01.559343] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-28T18:41:01.880475] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:41:02.359322] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-28T18:41:02.522894] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T18:41:02.946182] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T18:41:03.159352] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-28T18:41:03.959338] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-28T18:41:04.112267] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T18:41:04.759377] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-28T18:41:05.168101] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:41:05.559324] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-28T18:41:05.872676] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:41:06.359367] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-28T18:41:06.617240] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:41:07.167150] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-28T18:41:07.170479] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T18:41:07.959373] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-28T18:41:08.759357] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-28T18:41:09.182347] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T18:41:09.316942] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-28T18:41:09.559334] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-28T18:41:10.022541] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:41:10.359331] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-28T18:41:10.764381] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T18:41:11.159337] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-28T18:41:11.370499] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T18:41:11.905890] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:41:11.959343] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-28T18:41:12.680598] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:41:12.759341] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-28T18:41:13.559334] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-28T18:41:14.149288] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:41:14.290592] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T18:41:14.359354] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-28T18:41:15.159397] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-28T18:41:15.641460] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:41:15.959399] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-28T18:41:16.169820] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:41:16.759398] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-28T18:41:17.030304] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:41:17.559397] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-28T18:41:18.172753] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T18:41:18.180343] [INFO ] [REMOTE ] EVTR: Full fetch complete (34542 records). [2025-10-28T18:41:18.180505] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-28T18:41:18.364796] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-28T18:41:18.548733] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-28T18:41:18.548807] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-28T18:41:18.549365] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-28T18:41:18.549403] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-28T18:41:18.550156] [DEBUG] [LOCAL ] EVTR: Trimmed 34542 records to 25713 (keeping 200 days of data) [2025-10-28T18:41:18.698717] [DEBUG] [LOCAL ] EVTR: Primary data saved (25713 records). [2025-10-28T18:41:18.698838] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-28T18:41:18.698911] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTR took 28.4s. Estimated remaining: 3h 20m 6s. Rate: 7.9 symbols/min [2025-10-28T18:41:18.875016] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:18.929482] [DEBUG] [LOCAL ] EXK: Loaded 53188 existing records from primary storage. [2025-10-28T18:41:18.929795] [INFO ] [MAIN ] EXK: Loaded 53188 existing records. [2025-10-28T18:41:19.137798] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:41:19.138056] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-28T18:41:19.138721] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-28T18:41:19.140140] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T18:41:19.149963] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-28T18:41:19.150034] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-28T18:41:19.164430] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-28T18:41:19.506980] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:19.526735] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:41:19.959336] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-28T18:41:20.636469] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:41:20.759387] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-28T18:41:21.100851] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:41:21.559367] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-28T18:41:22.020355] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:41:22.359397] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-28T18:41:23.026121] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T18:41:23.159302] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-28T18:41:23.566343] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T18:41:23.959363] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-28T18:41:24.465595] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T18:41:24.765117] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-28T18:41:24.779774] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:41:25.559393] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-28T18:41:26.179918] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:41:26.359337] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-28T18:41:26.394323] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T18:41:27.159341] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-28T18:41:27.966626] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-28T18:41:27.974837] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:41:27.986391] [INFO ] [REMOTE ] EVTL: Full fetch complete (55151 records). [2025-10-28T18:41:27.986937] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-28T18:41:27.988523] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:41:27.988676] [FATAL] [MAIN ] EVTL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:41:27.988735] [WARN ] [MAIN ] EVTL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:41:27.988781] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-28T18:41:27.988984] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-10-28T18:41:27.989029] [INFO ] [LOCAL ] EVTL: Starting deletion of derivative data. [2025-10-28T18:41:27.989216] [DEBUG] [LOCAL ] EVTL: Deleted derivative data file. [2025-10-28T18:41:27.989321] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EVTL took 39.0s. Estimated remaining: 3h 20m 2s. Rate: 7.8 symbols/min [2025-10-28T18:41:28.163027] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:28.163231] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-10-28T18:41:28.163287] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-10-28T18:41:28.163405] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-28T18:41:28.163448] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-28T18:41:28.163508] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-10-28T18:41:28.163540] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-28T18:41:28.520634] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:28.561728] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:41:28.759324] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-28T18:41:29.242399] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T18:41:29.248866] [INFO ] [REMOTE ] EXG: Full fetch complete (49211 records). [2025-10-28T18:41:29.249004] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-28T18:41:29.564568] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-28T18:41:29.641820] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-28T18:41:29.641900] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-28T18:41:29.642589] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-28T18:41:29.642628] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-28T18:41:29.643599] [DEBUG] [LOCAL ] EXG: Trimmed 49211 records to 32985 (keeping 200 days of data) [2025-10-28T18:41:29.857918] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T18:41:29.857269] [DEBUG] [LOCAL ] EXG: Primary data saved (32985 records). [2025-10-28T18:41:29.864138] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-28T18:41:29.864213] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EXG took 31.0s. Estimated remaining: 3h 19m 43s. Rate: 7.9 symbols/min [2025-10-28T18:41:30.359409] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-28T18:41:30.954099] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:41:31.159335] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-28T18:41:31.284576] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:41:31.959339] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-28T18:41:32.464886] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:41:32.759328] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-28T18:41:33.499360] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T18:41:33.510526] [INFO ] [REMOTE ] EW: Full fetch complete (77504 records). [2025-10-28T18:41:33.510762] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-28T18:41:33.571581] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-28T18:41:33.937252] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-28T18:41:33.937365] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-28T18:41:33.945573] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-28T18:41:33.960786] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-28T18:41:33.965415] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:41:33.972079] [DEBUG] [LOCAL ] EW: Trimmed 77504 records to 53386 (keeping 200 days of data) [2025-10-28T18:41:34.275425] [DEBUG] [LOCAL ] EW: Primary data saved (53386 records). [2025-10-28T18:41:34.275546] [INFO ] [MAIN ] EW: Full history saved. [2025-10-28T18:41:34.276318] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EW took 37.1s. Estimated remaining: 3h 19m 29s. Rate: 7.9 symbols/min [2025-10-28T18:41:34.359357] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-28T18:41:35.108583] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T18:41:35.159297] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-28T18:41:35.304025] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:41:35.959345] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-28T18:41:36.637140] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:41:36.759338] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-28T18:41:36.845845] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T18:41:37.559400] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-28T18:41:38.225256] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:41:38.359309] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-28T18:41:38.471610] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:41:39.159366] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-28T18:41:39.689040] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:41:39.959333] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-28T18:41:40.301040] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T18:41:40.759334] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-28T18:41:41.509301] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:41:41.559323] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-28T18:41:41.861102] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T18:41:41.871954] [INFO ] [REMOTE ] EXK: Full fetch complete (76883 records). [2025-10-28T18:41:41.872110] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-28T18:41:42.273133] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-28T18:41:42.273236] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-28T18:41:42.274457] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-28T18:41:42.274534] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-28T18:41:42.277594] [DEBUG] [LOCAL ] EXK: Trimmed 76883 records to 53188 (keeping 200 days of data) [2025-10-28T18:41:42.398489] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T18:41:42.408333] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-28T18:41:42.617278] [DEBUG] [LOCAL ] EXK: Primary data saved (53188 records). [2025-10-28T18:41:42.617406] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-28T18:41:42.618327] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXK took 23.9s. Estimated remaining: 3h 19m 23s. Rate: 7.9 symbols/min [2025-10-28T18:41:43.398661] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T18:41:43.404138] [INFO ] [REMOTE ] EXP: Full fetch complete (42818 records). [2025-10-28T18:41:43.404228] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-28T18:41:43.801215] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-28T18:41:43.801295] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-28T18:41:43.801986] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-28T18:41:43.802049] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-28T18:41:43.803124] [DEBUG] [LOCAL ] EXP: Trimmed 42818 records to 28717 (keeping 200 days of data) [2025-10-28T18:41:43.977273] [DEBUG] [LOCAL ] EXP: Primary data saved (28717 records). [2025-10-28T18:41:43.977396] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-28T18:41:43.977464] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXP took 16.0s. Estimated remaining: 3h 19m 3s. Rate: 7.9 symbols/min [2025-10-28T18:41:44.648867] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.699315] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.695890] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.717128] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.717323] [DEBUG] [LOCAL ] EXR: No existing data file found in primary storage. [2025-10-28T18:41:44.717564] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-10-28T18:41:44.717850] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-10-28T18:41:44.718243] [WARN ] [MAIN ] EXR: No existing data found, performing full refresh instead. [2025-10-28T18:41:44.718701] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-28T18:41:44.718596] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-28T18:41:44.718799] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-28T18:41:44.718943] [DEBUG] [LOCAL ] EXR: No primary data file found to delete. [2025-10-28T18:41:44.719042] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-28T18:41:44.719107] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-28T18:41:44.736498] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-28T18:41:44.757525] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-28T18:41:45.133915] [DEBUG] [LOCAL ] FAF: Loaded 41263 existing records from primary storage. [2025-10-28T18:41:45.167347] [INFO ] [MAIN ] FAF: Loaded 41263 existing records. [2025-10-28T18:41:45.334930] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-28T18:41:45.383184] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-28T18:41:45.727846] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:41:45.800253] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-28T18:41:45.800403] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-28T18:41:45.776701] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:45.868953] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:45.878043] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-28T18:41:45.877836] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-28T18:41:45.888087] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-28T18:41:45.888214] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-28T18:41:45.901243] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:41:45.913608] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-28T18:41:45.947404] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-28T18:41:45.971861] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-28T18:41:45.982681] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-28T18:41:46.665354] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:46.694078] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:46.694508] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-28T18:41:46.694911] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-28T18:41:47.156041] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:41:47.165605] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-28T18:41:47.513264] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T18:41:47.523226] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-28T18:41:47.783325] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:41:47.959334] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-28T18:41:48.364890] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:41:48.621723] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:41:48.660105] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-28T18:41:48.759301] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-28T18:41:48.940823] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T18:41:49.559338] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-28T18:41:49.939702] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:41:50.359381] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-28T18:41:51.159407] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-28T18:41:51.307970] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-28T18:41:51.595540] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T18:41:51.959442] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-28T18:41:52.299802] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T18:41:52.759338] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-28T18:41:53.559336] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-28T18:41:53.793808] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:41:53.847344] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T18:41:54.359320] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-28T18:41:54.676275] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:41:55.159370] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-28T18:41:55.959408] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-28T18:41:56.285242] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T18:41:56.323945] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:41:56.759376] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-28T18:41:57.374308] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:41:57.559332] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-28T18:41:57.863884] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T18:41:58.359383] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-28T18:41:59.159318] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-28T18:41:59.588315] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:41:59.629210] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-28T18:41:59.959336] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-28T18:42:00.544554] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:42:00.759333] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-28T18:42:01.034245] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:42:01.559453] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-28T18:42:01.953616] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:42:02.359360] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-28T18:42:02.717829] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:42:03.159377] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-28T18:42:03.475221] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T18:42:03.959347] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-28T18:42:04.560493] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T18:42:04.569486] [INFO ] [REMOTE ] EXR: Full fetch complete (66042 records). [2025-10-28T18:42:04.569611] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-28T18:42:04.767840] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-28T18:42:04.963354] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-28T18:42:04.963469] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-28T18:42:04.964347] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-28T18:42:04.964436] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-28T18:42:04.965963] [DEBUG] [LOCAL ] EXR: Trimmed 66042 records to 45173 (keeping 200 days of data) [2025-10-28T18:42:05.101309] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-28T18:42:05.288432] [DEBUG] [LOCAL ] EXR: Primary data saved (45173 records). [2025-10-28T18:42:05.288558] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-28T18:42:05.288627] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. EXR took 21.3s. Estimated remaining: 3h 19m 22s. Rate: 7.8 symbols/min [2025-10-28T18:42:05.452155] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:05.493026] [DEBUG] [LOCAL ] FBIN: Loaded 50259 existing records from primary storage. [2025-10-28T18:42:05.493332] [INFO ] [MAIN ] FBIN: Loaded 50259 existing records. [2025-10-28T18:42:05.566672] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-28T18:42:05.669733] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:05.669929] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-28T18:42:05.669976] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-28T18:42:05.670836] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-28T18:42:05.670909] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-28T18:42:06.025319] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:06.053279] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T18:42:06.359308] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-28T18:42:06.682355] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:42:07.159387] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-28T18:42:07.752893] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:42:07.959345] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-28T18:42:08.422703] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:42:08.759325] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-28T18:42:09.559341] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-28T18:42:09.961552] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T18:42:09.972266] [INFO ] [REMOTE ] EXPD: Full fetch complete (69282 records). [2025-10-28T18:42:09.972416] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-28T18:42:10.187413] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-28T18:42:10.364564] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-28T18:42:10.485396] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-28T18:42:10.485487] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-28T18:42:10.486866] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-28T18:42:10.486932] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-28T18:42:10.488535] [DEBUG] [LOCAL ] EXPD: Trimmed 69282 records to 47457 (keeping 200 days of data) [2025-10-28T18:42:10.822288] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:42:10.843744] [DEBUG] [LOCAL ] EXPD: Primary data saved (47457 records). [2025-10-28T18:42:10.843852] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-28T18:42:10.843922] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. EXPD took 26.9s. Estimated remaining: 3h 19m 10s. Rate: 7.9 symbols/min [2025-10-28T18:42:11.036300] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:11.061030] [DEBUG] [LOCAL ] FBK: Loaded 27185 existing records from primary storage. [2025-10-28T18:42:11.061290] [INFO ] [MAIN ] FBK: Loaded 27185 existing records. [2025-10-28T18:42:11.160034] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-28T18:42:11.240536] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:11.240775] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-28T18:42:11.240824] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-28T18:42:11.241328] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-28T18:42:11.241385] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-28T18:42:11.600701] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:11.635381] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:42:11.959387] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-28T18:42:12.447506] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:42:12.759349] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-28T18:42:13.207703] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T18:42:13.559371] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-28T18:42:14.359393] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-28T18:42:14.543555] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T18:42:14.733459] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:42:15.159325] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-28T18:42:15.192137] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T18:42:15.959419] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-28T18:42:16.395372] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T18:42:16.759365] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-28T18:42:16.985173] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:42:17.367584] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:42:17.559365] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-28T18:42:18.359367] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-28T18:42:18.957464] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:42:19.017344] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T18:42:19.159346] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-28T18:42:19.959335] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-28T18:42:20.008228] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:42:20.759358] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-28T18:42:21.559367] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-28T18:42:21.842824] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-28T18:42:21.882169] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T18:42:22.359379] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-28T18:42:22.779541] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:42:22.952425] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:42:23.159399] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-28T18:42:23.804420] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T18:42:23.959405] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-28T18:42:24.759368] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-28T18:42:25.286906] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:42:25.559378] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-28T18:42:25.856887] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:42:25.865682] [INFO ] [REMOTE ] FAF: Full fetch complete (58396 records). [2025-10-28T18:42:25.865912] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-28T18:42:26.292067] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-28T18:42:26.292184] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-28T18:42:26.293029] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-28T18:42:26.293091] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-28T18:42:26.294188] [DEBUG] [LOCAL ] FAF: Trimmed 58396 records to 41201 (keeping 200 days of data) [2025-10-28T18:42:26.379737] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-28T18:42:26.539682] [DEBUG] [LOCAL ] FAF: Primary data saved (41201 records). [2025-10-28T18:42:26.539809] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-28T18:42:26.539885] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. FAF took 42.5s. Estimated remaining: 3h 19m 18s. Rate: 7.8 symbols/min [2025-10-28T18:42:26.703910] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:26.744089] [DEBUG] [LOCAL ] FBP: Loaded 45446 existing records from primary storage. [2025-10-28T18:42:26.744381] [INFO ] [MAIN ] FBP: Loaded 45446 existing records. [2025-10-28T18:42:26.925064] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:26.925316] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-28T18:42:26.925489] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-28T18:42:26.926358] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-28T18:42:26.926473] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-28T18:42:27.121226] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T18:42:27.160045] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-28T18:42:27.343165] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:27.365540] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T18:42:27.932032] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:42:27.943319] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-28T18:42:27.943527] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-28T18:42:27.965222] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-28T18:42:28.367626] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-28T18:42:28.367775] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-28T18:42:28.369215] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-28T18:42:28.369284] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-28T18:42:28.371506] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-28T18:42:28.723226] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-28T18:42:28.723431] [INFO ] [MAIN ] F: Full history saved. [2025-10-28T18:42:28.723535] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. F took 44.7s. Estimated remaining: 3h 18m 60s. Rate: 7.8 symbols/min [2025-10-28T18:42:28.767447] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-28T18:42:28.899458] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:28.937683] [DEBUG] [LOCAL ] FBRT: Loaded 34825 existing records from primary storage. [2025-10-28T18:42:28.938052] [INFO ] [MAIN ] FBRT: Loaded 34825 existing records. [2025-10-28T18:42:29.116072] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:29.116385] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-28T18:42:29.116437] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-28T18:42:29.117265] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-28T18:42:29.117344] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-28T18:42:29.485668] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:29.570196] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-28T18:42:29.576829] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T18:42:30.029904] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:42:30.359317] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-28T18:42:30.462324] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T18:42:31.159406] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-28T18:42:31.378570] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:42:31.959336] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-28T18:42:32.168337] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:42:32.759369] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-28T18:42:33.356957] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:42:33.366898] [INFO ] [REMOTE ] FBIN: Full fetch complete (72840 records). [2025-10-28T18:42:33.367049] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-28T18:42:33.566102] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-28T18:42:33.770890] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-28T18:42:33.771023] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-28T18:42:33.771984] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-28T18:42:33.772095] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-28T18:42:33.773871] [DEBUG] [LOCAL ] FBIN: Trimmed 72840 records to 50171 (keeping 200 days of data) [2025-10-28T18:42:33.917783] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T18:42:34.108926] [DEBUG] [LOCAL ] FBIN: Primary data saved (50171 records). [2025-10-28T18:42:34.109051] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-28T18:42:34.109128] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FBIN took 28.8s. Estimated remaining: 3h 18m 48s. Rate: 7.9 symbols/min [2025-10-28T18:42:34.274404] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:34.287782] [DEBUG] [LOCAL ] FC: Loaded 13951 existing records from primary storage. [2025-10-28T18:42:34.288027] [INFO ] [MAIN ] FC: Loaded 13951 existing records. [2025-10-28T18:42:34.364419] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-28T18:42:34.468884] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:34.469093] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-28T18:42:34.469154] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-28T18:42:34.469560] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-28T18:42:34.469619] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-28T18:42:34.833390] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:34.851380] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T18:42:34.857952] [INFO ] [REMOTE ] FBK: Full fetch complete (35656 records). [2025-10-28T18:42:34.858060] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-28T18:42:35.164571] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-28T18:42:35.232002] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-28T18:42:35.232082] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-28T18:42:35.232711] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-28T18:42:35.232772] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-28T18:42:35.233515] [DEBUG] [LOCAL ] FBK: Trimmed 35656 records to 27079 (keeping 200 days of data) [2025-10-28T18:42:35.393673] [DEBUG] [LOCAL ] FBK: Primary data saved (27079 records). [2025-10-28T18:42:35.393920] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-28T18:42:35.394036] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBK took 24.6s. Estimated remaining: 3h 18m 28s. Rate: 7.9 symbols/min [2025-10-28T18:42:35.565134] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:35.594281] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T18:42:35.635053] [DEBUG] [LOCAL ] FCF: Loaded 38757 existing records from primary storage. [2025-10-28T18:42:35.635355] [INFO ] [MAIN ] FCF: Loaded 38757 existing records. [2025-10-28T18:42:35.826829] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:35.827052] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-28T18:42:35.827099] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-28T18:42:35.827858] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-28T18:42:35.827914] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-28T18:42:35.964458] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-28T18:42:36.207597] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:36.247695] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T18:42:36.759343] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-28T18:42:37.273042] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:42:37.559347] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-28T18:42:37.958931] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T18:42:38.359355] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-28T18:42:38.553712] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T18:42:38.853778] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:42:39.159352] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-28T18:42:39.959320] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-28T18:42:40.128411] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:42:40.478232] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T18:42:40.759336] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-28T18:42:41.559318] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-28T18:42:41.655353] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T18:42:42.198493] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T18:42:42.359326] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-28T18:42:43.159339] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-28T18:42:43.493724] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T18:42:43.959331] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-28T18:42:44.567497] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T18:42:44.759385] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-28T18:42:45.164701] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:42:45.559335] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-28T18:42:46.116806] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:42:46.359362] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-28T18:42:46.676848] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T18:42:47.031080] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:42:47.159366] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-28T18:42:47.692513] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:42:47.959370] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-28T18:42:48.759379] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-28T18:42:48.802660] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T18:42:49.559330] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-28T18:42:49.773213] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:42:50.359317] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-28T18:42:50.488329] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:42:51.159311] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-28T18:42:51.308506] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:42:51.959400] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-28T18:42:52.518094] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:42:52.527613] [INFO ] [REMOTE ] FBP: Full fetch complete (66769 records). [2025-10-28T18:42:52.527791] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-28T18:42:52.763775] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-28T18:42:52.931877] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-28T18:42:52.931991] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-28T18:42:52.932906] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-28T18:42:52.933023] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-28T18:42:52.953264] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T18:42:52.960541] [DEBUG] [LOCAL ] FBP: Trimmed 66769 records to 45412 (keeping 200 days of data) [2025-10-28T18:42:53.225050] [DEBUG] [LOCAL ] FBP: Primary data saved (45412 records). [2025-10-28T18:42:53.225169] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-28T18:42:53.225243] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FBP took 26.7s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-10-28T18:42:53.392822] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:53.416876] [DEBUG] [LOCAL ] FCN: Loaded 25826 existing records from primary storage. [2025-10-28T18:42:53.417124] [INFO ] [MAIN ] FCN: Loaded 25826 existing records. [2025-10-28T18:42:53.550837] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T18:42:53.563021] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-28T18:42:53.607134] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:53.607459] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-28T18:42:53.607520] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-28T18:42:53.608093] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-28T18:42:53.608160] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-28T18:42:53.962155] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:54.359317] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-28T18:42:54.780216] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:42:55.050454] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:42:55.159326] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-28T18:42:55.959301] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-28T18:42:56.128190] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:42:56.640742] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T18:42:56.759373] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-28T18:42:57.344878] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T18:42:57.559335] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-28T18:42:58.187478] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:42:58.359366] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-28T18:42:59.159322] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-28T18:42:59.430827] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T18:42:59.959335] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-28T18:43:00.205577] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:43:00.759315] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-28T18:43:00.788493] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T18:43:00.791511] [INFO ] [REMOTE ] FC: Full fetch complete (21786 records). [2025-10-28T18:43:00.791599] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-28T18:43:01.163190] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-28T18:43:01.163268] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-28T18:43:01.163789] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-28T18:43:01.163852] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-28T18:43:01.164445] [DEBUG] [LOCAL ] FC: Trimmed 21786 records to 13903 (keeping 200 days of data) [2025-10-28T18:43:01.244004] [DEBUG] [LOCAL ] FC: Primary data saved (13903 records). [2025-10-28T18:43:01.244139] [INFO ] [MAIN ] FC: Full history saved. [2025-10-28T18:43:01.244219] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FC took 27.1s. Estimated remaining: 3h 18m 33s. Rate: 7.8 symbols/min [2025-10-28T18:43:01.411152] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:01.445566] [DEBUG] [LOCAL ] FCPT: Loaded 36614 existing records from primary storage. [2025-10-28T18:43:01.445928] [INFO ] [MAIN ] FCPT: Loaded 36614 existing records. [2025-10-28T18:43:01.560283] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-28T18:43:01.641191] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:01.641417] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-28T18:43:01.641466] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-28T18:43:01.642108] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-28T18:43:01.642167] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-28T18:43:02.016258] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:02.030115] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T18:43:02.359397] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-28T18:43:02.865691] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T18:43:02.873820] [INFO ] [REMOTE ] FCF: Full fetch complete (57914 records). [2025-10-28T18:43:02.873944] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-28T18:43:03.161305] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-28T18:43:03.253567] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-28T18:43:03.253735] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-28T18:43:03.254542] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-28T18:43:03.254737] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-28T18:43:03.255849] [DEBUG] [LOCAL ] FCF: Trimmed 57914 records to 38576 (keeping 200 days of data) [2025-10-28T18:43:03.379824] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T18:43:03.508571] [DEBUG] [LOCAL ] FCF: Primary data saved (38576 records). [2025-10-28T18:43:03.508737] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-28T18:43:03.508827] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FCF took 28.1s. Estimated remaining: 3h 18m 15s. Rate: 7.9 symbols/min [2025-10-28T18:43:03.676928] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:03.677086] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-28T18:43:03.677123] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-28T18:43:03.677226] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-28T18:43:03.677265] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-28T18:43:03.677306] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-28T18:43:03.677337] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-28T18:43:03.963385] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-28T18:43:04.037625] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:04.056967] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T18:43:04.759362] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-28T18:43:05.144845] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:43:05.559382] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-28T18:43:05.771103] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:43:06.359376] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-28T18:43:06.414939] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T18:43:07.159386] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-28T18:43:07.511633] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T18:43:07.538764] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T18:43:07.959352] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-28T18:43:08.759330] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-28T18:43:08.997319] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T18:43:09.036023] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T18:43:09.559333] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-28T18:43:09.841307] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T18:43:10.359350] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-28T18:43:11.159367] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-28T18:43:11.445827] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:43:11.474600] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T18:43:11.959332] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-28T18:43:12.759332] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-28T18:43:13.060156] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T18:43:13.559391] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-28T18:43:14.014848] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T18:43:14.022680] [INFO ] [REMOTE ] FBRT: Full fetch complete (49460 records). [2025-10-28T18:43:14.022814] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-28T18:43:14.365061] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-28T18:43:14.416610] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-28T18:43:14.416715] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-28T18:43:14.417422] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-28T18:43:14.417470] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-28T18:43:14.418701] [DEBUG] [LOCAL ] FBRT: Trimmed 49460 records to 34679 (keeping 200 days of data) [2025-10-28T18:43:14.631417] [DEBUG] [LOCAL ] FBRT: Primary data saved (34679 records). [2025-10-28T18:43:14.631725] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-28T18:43:14.631839] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FBRT took 45.9s. Estimated remaining: 3h 18m 14s. Rate: 7.8 symbols/min [2025-10-28T18:43:14.768318] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:43:14.839778] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:14.839972] [DEBUG] [LOCAL ] FCT: No existing data file found in primary storage. [2025-10-28T18:43:14.840010] [WARN ] [MAIN ] FCT: No existing data found, performing full refresh instead. [2025-10-28T18:43:14.840118] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-28T18:43:14.840159] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-28T18:43:14.840199] [DEBUG] [LOCAL ] FCT: No primary data file found to delete. [2025-10-28T18:43:14.840230] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-28T18:43:15.164493] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-28T18:43:15.223673] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:15.441794] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:43:15.959366] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-28T18:43:16.262448] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:43:16.764469] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-28T18:43:16.773393] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T18:43:17.004918] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T18:43:17.559339] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-28T18:43:18.348957] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T18:43:18.359305] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-28T18:43:19.096941] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:43:19.159329] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-28T18:43:19.959305] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-28T18:43:20.141014] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T18:43:20.617866] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T18:43:20.759351] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-28T18:43:21.559315] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-28T18:43:21.712754] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T18:43:21.718821] [INFO ] [REMOTE ] FCN: Full fetch complete (36829 records). [2025-10-28T18:43:21.718937] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-28T18:43:22.153218] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-28T18:43:22.153300] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-28T18:43:22.153913] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-28T18:43:22.153975] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-28T18:43:22.154757] [DEBUG] [LOCAL ] FCN: Trimmed 36829 records to 25819 (keeping 200 days of data) [2025-10-28T18:43:22.318137] [DEBUG] [LOCAL ] FCN: Primary data saved (25819 records). [2025-10-28T18:43:22.318261] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-28T18:43:22.318339] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCN took 29.1s. Estimated remaining: 3h 18m 6s. Rate: 7.8 symbols/min [2025-10-28T18:43:22.365133] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-28T18:43:22.514055] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:22.514233] [DEBUG] [LOCAL ] FCX: No existing data file found in primary storage. [2025-10-28T18:43:22.514425] [WARN ] [MAIN ] FCX: No existing data found, performing full refresh instead. [2025-10-28T18:43:22.514694] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-28T18:43:22.514763] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-28T18:43:22.514956] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-10-28T18:43:22.515048] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-28T18:43:22.754904] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:43:22.847224] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T18:43:22.939811] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:23.159366] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-28T18:43:23.389813] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T18:43:23.959366] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-28T18:43:24.759527] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-28T18:43:25.511994] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:43:25.559300] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-28T18:43:25.767976] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:43:26.359359] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-28T18:43:26.922121] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T18:43:27.159370] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-28T18:43:27.443445] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T18:43:27.695959] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:43:27.703626] [INFO ] [REMOTE ] FCPT: Full fetch complete (53769 records). [2025-10-28T18:43:27.703787] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-28T18:43:27.964605] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-28T18:43:28.079592] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-28T18:43:28.079691] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-28T18:43:28.080485] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-28T18:43:28.080527] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-28T18:43:28.081612] [DEBUG] [LOCAL ] FCPT: Trimmed 53769 records to 36533 (keeping 200 days of data) [2025-10-28T18:43:28.294298] [DEBUG] [LOCAL ] FCPT: Primary data saved (36533 records). [2025-10-28T18:43:28.294424] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-28T18:43:28.294511] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCPT took 27.1s. Estimated remaining: 3h 17m 56s. Rate: 7.9 symbols/min [2025-10-28T18:43:28.458688] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:28.485008] [DEBUG] [LOCAL ] FDP: Loaded 29418 existing records from primary storage. [2025-10-28T18:43:28.485260] [INFO ] [MAIN ] FDP: Loaded 29418 existing records. [2025-10-28T18:43:28.648351] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:43:28.671514] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:28.671706] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-28T18:43:28.671762] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-28T18:43:28.672319] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-28T18:43:28.672376] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-28T18:43:28.767035] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-28T18:43:29.020768] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:29.046591] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:43:29.559345] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-28T18:43:30.359339] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-28T18:43:30.843706] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T18:43:31.067173] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T18:43:31.159348] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-28T18:43:31.803741] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T18:43:31.959481] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-28T18:43:32.285436] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T18:43:32.286323] [INFO ] [REMOTE ] FCRX: Full fetch complete (1619 records). [2025-10-28T18:43:32.286397] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-28T18:43:32.469749] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-28T18:43:32.469981] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:43:32.470060] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:43:32.470123] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-28T18:43:32.470188] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-28T18:43:32.470229] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-28T18:43:32.470272] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-28T18:43:32.470368] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FCRX took 29.0s. Estimated remaining: 3h 17m 41s. Rate: 7.9 symbols/min [2025-10-28T18:43:32.643488] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:32.672811] [DEBUG] [LOCAL ] FDS: Loaded 28149 existing records from primary storage. [2025-10-28T18:43:32.673149] [INFO ] [MAIN ] FDS: Loaded 28149 existing records. [2025-10-28T18:43:32.764506] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-28T18:43:32.868081] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:32.868471] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-28T18:43:32.868530] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-28T18:43:32.869457] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-28T18:43:32.869517] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-28T18:43:33.246272] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:33.559296] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-28T18:43:33.736057] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:43:34.359355] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-28T18:43:35.159338] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-28T18:43:35.186246] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:43:35.327579] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-28T18:43:35.687078] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:43:35.959334] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-28T18:43:36.759326] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-28T18:43:36.868129] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:43:37.504908] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:43:37.559307] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-28T18:43:38.359306] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-28T18:43:38.440369] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T18:43:39.159321] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-28T18:43:39.973766] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-28T18:43:39.976782] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T18:43:40.012826] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T18:43:40.759347] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-28T18:43:40.999614] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:43:41.559334] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-28T18:43:42.266876] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:43:42.292639] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T18:43:42.359340] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-28T18:43:42.970598] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T18:43:43.159334] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-28T18:43:43.959358] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-28T18:43:44.759301] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-28T18:43:44.871979] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T18:43:45.031386] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T18:43:45.559337] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-28T18:43:45.801696] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T18:43:46.160260] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T18:43:46.359424] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-28T18:43:47.159362] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-28T18:43:47.244989] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T18:43:47.959357] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-28T18:43:48.745416] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T18:43:48.747473] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:43:48.761667] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-28T18:43:49.559302] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-28T18:43:49.582256] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T18:43:50.282144] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T18:43:50.286156] [INFO ] [REMOTE ] FCT: Full fetch complete (21443 records). [2025-10-28T18:43:50.286227] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-28T18:43:50.364468] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-28T18:43:50.649911] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-28T18:43:50.649980] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-28T18:43:50.650448] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-28T18:43:50.650506] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-28T18:43:50.651080] [DEBUG] [LOCAL ] FCT: Trimmed 21443 records to 14513 (keeping 200 days of data) [2025-10-28T18:43:50.747441] [DEBUG] [LOCAL ] FCT: Primary data saved (14513 records). [2025-10-28T18:43:50.747563] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-28T18:43:50.747630] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FCT took 36.1s. Estimated remaining: 3h 17m 54s. Rate: 7.8 symbols/min [2025-10-28T18:43:50.920855] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:50.971738] [DEBUG] [LOCAL ] FDX: Loaded 51063 existing records from primary storage. [2025-10-28T18:43:50.972019] [INFO ] [MAIN ] FDX: Loaded 51063 existing records. [2025-10-28T18:43:51.145498] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:51.145729] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-28T18:43:51.145782] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-28T18:43:51.146753] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-28T18:43:51.146815] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-28T18:43:51.167337] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-28T18:43:51.502505] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:51.959317] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-28T18:43:52.082976] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:43:52.141091] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T18:43:52.759305] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-28T18:43:52.826285] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:43:53.559395] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-28T18:43:54.338973] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T18:43:54.359304] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-28T18:43:54.708541] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T18:43:54.719245] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-28T18:43:54.719368] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-28T18:43:55.108324] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-28T18:43:55.108419] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-28T18:43:55.109333] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-28T18:43:55.109534] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-28T18:43:55.111013] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53702 (keeping 200 days of data) [2025-10-28T18:43:55.163126] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-28T18:43:55.314545] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T18:43:55.462766] [DEBUG] [LOCAL ] FCX: Primary data saved (53702 records). [2025-10-28T18:43:55.462899] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-28T18:43:55.462970] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FCX took 33.1s. Estimated remaining: 3h 17m 41s. Rate: 7.8 symbols/min [2025-10-28T18:43:55.626397] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:55.671935] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-28T18:43:55.672232] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-28T18:43:55.843433] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:55.843633] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-28T18:43:55.843727] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-28T18:43:55.844634] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-28T18:43:55.844734] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-28T18:43:55.964460] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-28T18:43:56.232215] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:56.249626] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T18:43:56.759335] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-28T18:43:57.207161] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:43:57.559402] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-28T18:43:58.178742] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T18:43:58.359349] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-28T18:43:58.869692] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T18:43:59.159326] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-28T18:43:59.959309] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-28T18:44:00.759319] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-28T18:44:01.276155] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-28T18:44:01.284219] [INFO ] [REMOTE ] FDS: Full fetch complete (39791 records). [2025-10-28T18:44:01.284312] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-28T18:44:01.654357] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-28T18:44:01.654536] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-28T18:44:01.655245] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-28T18:44:01.655308] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-28T18:44:01.656213] [DEBUG] [LOCAL ] FDS: Trimmed 39791 records to 28214 (keeping 200 days of data) [2025-10-28T18:44:01.841170] [DEBUG] [LOCAL ] FDS: Primary data saved (28214 records). [2025-10-28T18:44:01.841321] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-28T18:44:01.841416] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FDS took 29.4s. Estimated remaining: 3h 17m 31s. Rate: 7.8 symbols/min [2025-10-28T18:44:02.041194] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:02.041509] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-28T18:44:02.041626] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-28T18:44:02.041763] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-28T18:44:02.041804] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-28T18:44:02.041845] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-28T18:44:02.041876] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-28T18:44:02.410721] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:02.411116] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-28T18:44:02.438924] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:44:02.449071] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-28T18:44:03.024302] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-28T18:44:03.044337] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:44:03.159350] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-28T18:44:03.244281] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-10-28T18:44:03.736536] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:44:03.959364] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-28T18:44:04.087965] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T18:44:04.093375] [INFO ] [REMOTE ] FDP: Full fetch complete (42785 records). [2025-10-28T18:44:04.093460] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-28T18:44:04.267896] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:44:04.476061] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-28T18:44:04.476148] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-28T18:44:04.476843] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-28T18:44:04.476905] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-28T18:44:04.477845] [DEBUG] [LOCAL ] FDP: Trimmed 42785 records to 29373 (keeping 200 days of data) [2025-10-28T18:44:04.648784] [DEBUG] [LOCAL ] FDP: Primary data saved (29373 records). [2025-10-28T18:44:04.648926] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-28T18:44:04.649010] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FDP took 36.4s. Estimated remaining: 3h 17m 14s. Rate: 7.9 symbols/min [2025-10-28T18:44:04.764533] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-28T18:44:04.821369] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:04.864501] [DEBUG] [LOCAL ] FERG: Loaded 48610 existing records from primary storage. [2025-10-28T18:44:04.864861] [INFO ] [MAIN ] FERG: Loaded 48610 existing records. [2025-10-28T18:44:05.042808] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:05.043002] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-28T18:44:05.043048] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-28T18:44:05.043944] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-28T18:44:05.044000] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-28T18:44:05.285841] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T18:44:05.397460] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:05.559319] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-28T18:44:06.359369] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-28T18:44:06.778920] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:44:06.967162] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:44:07.159321] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-28T18:44:07.959431] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-28T18:44:08.252842] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:44:08.759355] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-28T18:44:09.033081] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T18:44:09.559368] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-28T18:44:10.359464] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-28T18:44:10.939065] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:44:11.159309] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-28T18:44:11.637010] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:44:11.959410] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-28T18:44:12.344456] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:44:12.458809] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (4.50 seconds). [2025-10-28T18:44:12.759325] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-28T18:44:13.559311] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-28T18:44:14.121498] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:44:14.359321] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-28T18:44:14.722893] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:44:15.159366] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-28T18:44:15.410220] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T18:44:15.959345] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-28T18:44:16.759342] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-28T18:44:17.002334] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T18:44:17.349104] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T18:44:17.559360] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-28T18:44:18.295863] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (6.34 seconds). [2025-10-28T18:44:18.359320] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-28T18:44:18.728949] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T18:44:18.971041] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:44:19.159331] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-28T18:44:19.653760] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (6.09 seconds). [2025-10-28T18:44:19.959412] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-28T18:44:20.759330] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-28T18:44:21.324965] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:44:21.559332] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-28T18:44:22.079914] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:44:22.191201] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:44:22.192148] [INFO ] [REMOTE ] FENG: Full fetch complete (2254 records). [2025-10-28T18:44:22.192217] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-28T18:44:22.366189] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-28T18:44:22.372791] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T18:44:22.372980] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:44:22.374021] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:44:22.374094] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-28T18:44:22.374152] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-28T18:44:22.374189] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-28T18:44:22.374230] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-28T18:44:22.374301] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FENG took 20.5s. Estimated remaining: 3h 17m 25s. Rate: 7.8 symbols/min [2025-10-28T18:44:22.545025] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:22.558157] [DEBUG] [LOCAL ] FET: Loaded 12924 existing records from primary storage. [2025-10-28T18:44:22.558397] [INFO ] [MAIN ] FET: Loaded 12924 existing records. [2025-10-28T18:44:22.736785] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:22.737018] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-28T18:44:22.737066] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-28T18:44:22.737399] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-28T18:44:22.737455] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-28T18:44:23.094033] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:23.159315] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-28T18:44:23.682717] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T18:44:23.816388] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:44:23.959304] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-28T18:44:24.759324] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-28T18:44:25.060878] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (5.90 seconds). [2025-10-28T18:44:25.264118] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:44:25.559344] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-28T18:44:26.002164] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T18:44:26.038060] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T18:44:26.359328] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-28T18:44:26.980430] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T18:44:27.159388] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-28T18:44:27.959377] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-28T18:44:28.552065] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:44:28.759334] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-28T18:44:29.559339] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-28T18:44:30.184529] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T18:44:30.334554] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:44:30.345700] [INFO ] [REMOTE ] FE: Full fetch complete (77495 records). [2025-10-28T18:44:30.345831] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-28T18:44:30.367113] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-28T18:44:30.742918] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-28T18:44:30.742995] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-28T18:44:30.743895] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-28T18:44:30.743958] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-28T18:44:30.745379] [DEBUG] [LOCAL ] FE: Trimmed 77495 records to 53430 (keeping 200 days of data) [2025-10-28T18:44:31.061638] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-28T18:44:31.061796] [INFO ] [MAIN ] FE: Full history saved. [2025-10-28T18:44:31.061874] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FE took 35.6s. Estimated remaining: 3h 17m 20s. Rate: 7.8 symbols/min [2025-10-28T18:44:31.160462] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-28T18:44:31.230697] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:31.250981] [DEBUG] [LOCAL ] FF: Loaded 23163 existing records from primary storage. [2025-10-28T18:44:31.251222] [INFO ] [MAIN ] FF: Loaded 23163 existing records. [2025-10-28T18:44:31.424407] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:31.424600] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-28T18:44:31.424714] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-28T18:44:31.425175] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-28T18:44:31.425235] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-28T18:44:31.813496] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:31.959377] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-28T18:44:32.778095] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T18:44:32.789584] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-28T18:44:32.837824] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:44:33.092516] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (5.13 seconds). [2025-10-28T18:44:33.559334] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-28T18:44:34.306037] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T18:44:34.359585] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-28T18:44:34.462872] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (4.10 seconds). [2025-10-28T18:44:35.159392] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-28T18:44:35.959332] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-28T18:44:37.508304] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T18:44:37.519253] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-28T18:44:38.813381] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (4.45 seconds). [2025-10-28T18:44:38.820411] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-28T18:44:38.950423] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T18:44:38.961512] [INFO ] [REMOTE ] FERG: Full fetch complete (71184 records). [2025-10-28T18:44:38.961715] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-28T18:44:39.371204] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-28T18:44:39.371282] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-28T18:44:39.372273] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-28T18:44:39.372342] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-28T18:44:39.373778] [DEBUG] [LOCAL ] FERG: Trimmed 71184 records to 48558 (keeping 200 days of data) [2025-10-28T18:44:39.678977] [DEBUG] [LOCAL ] FERG: Primary data saved (48558 records). [2025-10-28T18:44:39.679209] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-28T18:44:39.679940] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FERG took 35.0s. Estimated remaining: 3h 17m 14s. Rate: 7.8 symbols/min [2025-10-28T18:44:39.802490] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T18:44:39.850207] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-28T18:44:39.883077] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:39.890032] [DEBUG] [LOCAL ] FFA: Loaded 5303 existing records from primary storage. [2025-10-28T18:44:39.890239] [INFO ] [MAIN ] FFA: Loaded 5303 existing records. [2025-10-28T18:44:40.081682] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:40.081877] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-28T18:44:40.081927] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-28T18:44:40.082185] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-28T18:44:40.082243] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-28T18:44:40.408359] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (7.62 seconds). [2025-10-28T18:44:40.471913] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-28T18:44:40.490605] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:40.491534] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-28T18:44:40.560608] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (5.40 seconds). [2025-10-28T18:44:40.759366] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-28T18:44:40.847923] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:44:41.330917] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T18:44:41.394992] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T18:44:41.559347] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-28T18:44:41.896590] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T18:44:41.906257] [INFO ] [REMOTE ] FDX: Full fetch complete (73777 records). [2025-10-28T18:44:41.906377] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-28T18:44:41.907118] [FATAL] [VALIDATOR ] FDX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:44:41.907220] [FATAL] [MAIN ] FDX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:44:41.907265] [WARN ] [MAIN ] FDX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:44:41.907329] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-28T18:44:41.907392] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-10-28T18:44:41.907434] [INFO ] [LOCAL ] FDX: Starting deletion of derivative data. [2025-10-28T18:44:41.907604] [DEBUG] [LOCAL ] FDX: Deleted derivative data file. [2025-10-28T18:44:41.908312] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FDX took 51.2s. Estimated remaining: 3h 16m 56s. Rate: 7.8 symbols/min [2025-10-28T18:44:42.029827] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:44:42.102880] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:42.119450] [DEBUG] [LOCAL ] FFC: Loaded 16365 existing records from primary storage. [2025-10-28T18:44:42.119691] [INFO ] [MAIN ] FFC: Loaded 16365 existing records. [2025-10-28T18:44:42.293676] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:42.293883] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-28T18:44:42.293929] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-28T18:44:42.294273] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-28T18:44:42.294329] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-28T18:44:42.364513] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-28T18:44:42.660948] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:43.159307] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-28T18:44:43.310313] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:44:43.959334] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-28T18:44:44.272418] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T18:44:44.647795] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T18:44:44.759322] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-28T18:44:45.450085] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:44:45.559361] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-28T18:44:46.359334] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-28T18:44:46.663676] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:44:46.667096] [INFO ] [REMOTE ] FET: Full fetch complete (18667 records). [2025-10-28T18:44:46.667181] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-28T18:44:47.026694] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-28T18:44:47.026808] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-28T18:44:47.035942] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-28T18:44:47.036074] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-28T18:44:47.036960] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:44:47.041335] [DEBUG] [LOCAL ] FET: Trimmed 18667 records to 12901 (keeping 200 days of data) [2025-10-28T18:44:47.112336] [DEBUG] [LOCAL ] FET: Primary data saved (12901 records). [2025-10-28T18:44:47.112455] [INFO ] [MAIN ] FET: Full history saved. [2025-10-28T18:44:47.112528] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FET took 24.7s. Estimated remaining: 3h 16m 44s. Rate: 7.8 symbols/min [2025-10-28T18:44:47.164489] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-28T18:44:47.281794] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:47.313765] [DEBUG] [LOCAL ] FFWM: Loaded 35352 existing records from primary storage. [2025-10-28T18:44:47.314004] [INFO ] [MAIN ] FFWM: Loaded 35352 existing records. [2025-10-28T18:44:47.488005] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:47.488213] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-28T18:44:47.488258] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-28T18:44:47.488707] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-28T18:44:47.488814] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-28T18:44:47.833752] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:47.927086] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T18:44:47.959289] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-28T18:44:48.760268] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-28T18:44:48.767326] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T18:44:49.559341] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-28T18:44:49.949605] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:44:50.288017] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T18:44:50.359311] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-28T18:44:51.159341] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-28T18:44:51.959390] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-28T18:44:52.506808] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:44:52.559841] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T18:44:52.759332] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-28T18:44:52.963775] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-28T18:44:52.968702] [INFO ] [REMOTE ] FF: Full fetch complete (36189 records). [2025-10-28T18:44:52.968806] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-28T18:44:53.357511] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T18:44:53.357300] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-28T18:44:53.357682] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-28T18:44:53.361138] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-28T18:44:53.361199] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-28T18:44:53.361948] [DEBUG] [LOCAL ] FF: Trimmed 36189 records to 23037 (keeping 200 days of data) [2025-10-28T18:44:53.489133] [DEBUG] [LOCAL ] FF: Primary data saved (23037 records). [2025-10-28T18:44:53.489255] [INFO ] [MAIN ] FF: Full history saved. [2025-10-28T18:44:53.489329] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FF took 22.4s. Estimated remaining: 3h 16m 34s. Rate: 7.8 symbols/min [2025-10-28T18:44:53.564497] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-28T18:44:53.657874] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:53.678187] [DEBUG] [LOCAL ] FG: Loaded 20750 existing records from primary storage. [2025-10-28T18:44:53.678426] [INFO ] [MAIN ] FG: Loaded 20750 existing records. [2025-10-28T18:44:53.852756] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:53.852983] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-28T18:44:53.853029] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-28T18:44:53.853362] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-28T18:44:53.853419] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-28T18:44:54.204145] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:54.208723] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T18:44:54.359315] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-28T18:44:55.159374] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-28T18:44:55.959374] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-28T18:44:56.163667] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T18:44:56.433723] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:44:56.759374] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-28T18:44:57.290160] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T18:44:57.559322] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-28T18:44:58.359312] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-28T18:44:58.430486] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:44:59.159299] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-28T18:44:59.804614] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T18:44:59.959347] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-28T18:45:00.351694] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (5.19 seconds). [2025-10-28T18:45:00.759313] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-28T18:45:01.308371] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-28T18:45:01.356454] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T18:45:01.559335] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-28T18:45:01.968574] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T18:45:02.363565] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-28T18:45:02.366044] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T18:45:03.143687] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:45:03.159340] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-28T18:45:03.959343] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-28T18:45:04.017284] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T18:45:04.759327] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-28T18:45:05.131543] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:45:05.559418] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-28T18:45:05.727474] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T18:45:06.359400] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-28T18:45:06.847477] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:45:06.986852] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:45:06.988819] [INFO ] [REMOTE ] FFA: Full fetch complete (8603 records). [2025-10-28T18:45:06.988889] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-28T18:45:07.167734] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-28T18:45:07.367605] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-28T18:45:07.367717] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-28T18:45:07.367989] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-28T18:45:07.368032] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-28T18:45:07.368466] [DEBUG] [LOCAL ] FFA: Trimmed 8603 records to 5236 (keeping 200 days of data) [2025-10-28T18:45:07.398543] [DEBUG] [LOCAL ] FFA: Primary data saved (5236 records). [2025-10-28T18:45:07.398614] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-28T18:45:07.398709] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FFA took 27.7s. Estimated remaining: 3h 16m 38s. Rate: 7.8 symbols/min [2025-10-28T18:45:07.571334] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:07.571502] [DEBUG] [LOCAL ] FGN: No existing data file found in primary storage. [2025-10-28T18:45:07.571540] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-10-28T18:45:07.571666] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-28T18:45:07.571724] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-28T18:45:07.571772] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-28T18:45:07.571806] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-28T18:45:07.940457] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:07.959292] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-28T18:45:08.127627] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T18:45:08.450758] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:45:08.759349] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-28T18:45:09.487489] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T18:45:09.559331] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-28T18:45:10.359319] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-28T18:45:10.488567] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:45:11.159304] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-28T18:45:11.619937] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T18:45:11.744272] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T18:45:11.959347] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-28T18:45:12.738241] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T18:45:12.743334] [INFO ] [REMOTE ] FFC: Full fetch complete (24469 records). [2025-10-28T18:45:12.743501] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-28T18:45:12.768154] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-28T18:45:13.129229] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-28T18:45:13.129310] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-28T18:45:13.129972] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-28T18:45:13.130034] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-28T18:45:13.130793] [DEBUG] [LOCAL ] FFC: Trimmed 24469 records to 16268 (keeping 200 days of data) [2025-10-28T18:45:13.230360] [DEBUG] [LOCAL ] FFC: Primary data saved (16268 records). [2025-10-28T18:45:13.230501] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-28T18:45:13.230581] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFC took 31.3s. Estimated remaining: 3h 16m 27s. Rate: 7.8 symbols/min [2025-10-28T18:45:13.411603] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:13.411778] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-28T18:45:13.411821] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-28T18:45:13.411928] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-28T18:45:13.411969] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-28T18:45:13.412009] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-28T18:45:13.412073] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-28T18:45:13.564445] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-28T18:45:13.802351] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:13.830138] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:45:14.283609] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T18:45:14.359393] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-28T18:45:15.159382] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-28T18:45:15.523260] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:45:15.959394] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-28T18:45:16.365218] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T18:45:16.759374] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-28T18:45:17.539990] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T18:45:17.559293] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-28T18:45:17.618897] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (3.26 seconds). [2025-10-28T18:45:18.359324] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-28T18:45:18.481061] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:45:19.017063] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:45:19.159336] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-28T18:45:19.720020] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:45:19.959354] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-28T18:45:20.369806] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T18:45:20.759360] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-28T18:45:21.106858] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T18:45:21.559320] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-28T18:45:22.359353] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-28T18:45:22.760017] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:45:23.159315] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-28T18:45:23.287115] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T18:45:23.903227] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T18:45:23.959350] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-28T18:45:24.759314] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-28T18:45:25.098241] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:45:25.559354] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-28T18:45:26.359443] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-28T18:45:26.759786] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:45:27.044984] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-10-28T18:45:27.083038] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T18:45:27.084322] [INFO ] [REMOTE ] FGN: Full fetch complete (5372 records). [2025-10-28T18:45:27.084396] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-28T18:45:27.085482] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:45:27.085729] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:45:27.085815] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:45:27.085896] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-28T18:45:27.085970] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-28T18:45:27.086008] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-10-28T18:45:27.086048] [DEBUG] [LOCAL ] FGN: No derivative data file found to delete. [2025-10-28T18:45:27.086134] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FGN took 19.7s. Estimated remaining: 3h 16m 31s. Rate: 7.8 symbols/min [2025-10-28T18:45:27.164626] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-28T18:45:27.267157] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:27.304080] [DEBUG] [LOCAL ] FHI: Loaded 39290 existing records from primary storage. [2025-10-28T18:45:27.304367] [INFO ] [MAIN ] FHI: Loaded 39290 existing records. [2025-10-28T18:45:27.516806] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:27.517027] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-28T18:45:27.517077] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-28T18:45:27.517839] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-28T18:45:27.517899] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-28T18:45:27.638735] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T18:45:27.926007] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:27.959332] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-28T18:45:28.759381] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-28T18:45:29.559371] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-28T18:45:29.916698] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:45:29.924988] [INFO ] [REMOTE ] FFWM: Full fetch complete (52058 records). [2025-10-28T18:45:29.925260] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-28T18:45:30.337430] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-28T18:45:30.337589] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-28T18:45:30.338781] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-28T18:45:30.338856] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-28T18:45:30.340386] [DEBUG] [LOCAL ] FFWM: Trimmed 52058 records to 35414 (keeping 200 days of data) [2025-10-28T18:45:30.385256] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-28T18:45:30.438137] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T18:45:30.550840] [DEBUG] [LOCAL ] FFWM: Primary data saved (35414 records). [2025-10-28T18:45:30.550985] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-28T18:45:30.551084] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FFWM took 43.4s. Estimated remaining: 3h 16m 15s. Rate: 7.8 symbols/min [2025-10-28T18:45:30.715363] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:30.761457] [DEBUG] [LOCAL ] FHN: Loaded 53398 existing records from primary storage. [2025-10-28T18:45:30.761793] [INFO ] [MAIN ] FHN: Loaded 53398 existing records. [2025-10-28T18:45:30.938268] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:30.938667] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-28T18:45:30.938728] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-28T18:45:30.939853] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-28T18:45:30.939911] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-28T18:45:31.164812] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-28T18:45:31.242399] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (3.28 seconds). [2025-10-28T18:45:31.333716] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:31.345483] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T18:45:31.349700] [INFO ] [REMOTE ] FG: Full fetch complete (29014 records). [2025-10-28T18:45:31.349774] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-28T18:45:31.619553] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T18:45:31.733920] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-28T18:45:31.734006] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-28T18:45:31.734691] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-28T18:45:31.734764] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-28T18:45:31.735575] [DEBUG] [LOCAL ] FG: Trimmed 29014 records to 20582 (keeping 200 days of data) [2025-10-28T18:45:31.878928] [DEBUG] [LOCAL ] FG: Primary data saved (20582 records). [2025-10-28T18:45:31.879056] [INFO ] [MAIN ] FG: Full history saved. [2025-10-28T18:45:31.879135] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FG took 38.4s. Estimated remaining: 3h 15m 56s. Rate: 7.8 symbols/min [2025-10-28T18:45:31.964609] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-28T18:45:32.061698] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:32.110980] [DEBUG] [LOCAL ] FI: Loaded 53574 existing records from primary storage. [2025-10-28T18:45:32.111328] [INFO ] [MAIN ] FI: Loaded 53574 existing records. [2025-10-28T18:45:32.286149] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:32.286398] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-28T18:45:32.286445] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-28T18:45:32.287461] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-28T18:45:32.287521] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-28T18:45:32.628967] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:32.759372] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-28T18:45:33.157391] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T18:45:33.559318] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-28T18:45:33.979024] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T18:45:34.359338] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-28T18:45:35.159337] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-28T18:45:35.532618] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:45:35.601748] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:45:35.770152] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (3.81 seconds). [2025-10-28T18:45:35.959310] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-28T18:45:36.759321] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-28T18:45:37.174982] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:45:37.559327] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-28T18:45:37.925951] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T18:45:38.125967] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T18:45:38.359356] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-28T18:45:38.898062] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T18:45:38.899292] [INFO ] [REMOTE ] FGSN: Full fetch complete (8156 records). [2025-10-28T18:45:38.899359] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-28T18:45:39.077481] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T18:45:39.077779] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:45:39.077856] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:45:39.077932] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-28T18:45:39.077997] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-28T18:45:39.078036] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-28T18:45:39.078078] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-28T18:45:39.078137] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FGSN took 25.8s. Estimated remaining: 3h 15m 47s. Rate: 7.9 symbols/min [2025-10-28T18:45:39.164411] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-28T18:45:39.286446] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:39.307595] [DEBUG] [LOCAL ] FICO: Loaded 21863 existing records from primary storage. [2025-10-28T18:45:39.307869] [INFO ] [MAIN ] FICO: Loaded 21863 existing records. [2025-10-28T18:45:39.479047] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:39.479233] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-28T18:45:39.479279] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-28T18:45:39.479751] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-28T18:45:39.479808] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-28T18:45:39.851419] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:39.959327] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-28T18:45:40.759321] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-28T18:45:41.559334] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-28T18:45:41.920929] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:45:42.265197] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-28T18:45:42.359322] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-28T18:45:43.035060] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T18:45:43.073256] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T18:45:43.159313] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-28T18:45:43.959306] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-28T18:45:44.427722] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:45:44.759316] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-28T18:45:45.139343] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (5.97 seconds). [2025-10-28T18:45:45.374985] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:45:45.559350] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-28T18:45:46.359365] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-28T18:45:46.872052] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-28T18:45:47.159327] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-28T18:45:47.618529] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:45:47.959304] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-28T18:45:48.100935] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:45:48.759328] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-28T18:45:49.559358] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-28T18:45:50.089210] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:45:50.318050] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T18:45:50.359337] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-28T18:45:50.594085] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (5.03 seconds). [2025-10-28T18:45:51.159380] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-28T18:45:51.444955] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:45:51.959399] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-28T18:45:52.759312] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-28T18:45:52.839004] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T18:45:53.559397] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-28T18:45:54.350669] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (6.39 seconds). [2025-10-28T18:45:54.362417] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-28T18:45:54.471869] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T18:45:54.494709] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:45:54.568637] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (3.41 seconds). [2025-10-28T18:45:55.159352] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-28T18:45:55.797696] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T18:45:55.959393] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-28T18:45:56.367566] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T18:45:56.373471] [INFO ] [REMOTE ] FICO: Full fetch complete (30106 records). [2025-10-28T18:45:56.373625] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-28T18:45:56.374175] [FATAL] [VALIDATOR ] FICO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:45:56.374273] [FATAL] [MAIN ] FICO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:45:56.374369] [WARN ] [MAIN ] FICO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:45:56.374460] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-28T18:45:56.374540] [DEBUG] [LOCAL ] FICO: No primary data file found to delete. [2025-10-28T18:45:56.374578] [INFO ] [LOCAL ] FICO: Starting deletion of derivative data. [2025-10-28T18:45:56.374886] [DEBUG] [LOCAL ] FICO: Deleted derivative data file. [2025-10-28T18:45:56.374980] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FICO took 17.3s. Estimated remaining: 3h 15m 58s. Rate: 7.8 symbols/min [2025-10-28T18:45:56.548009] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:56.548198] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-28T18:45:56.548236] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-28T18:45:56.548349] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-28T18:45:56.548414] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-28T18:45:56.548478] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-28T18:45:56.548522] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-28T18:45:56.766408] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-28T18:45:56.925337] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:57.559325] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-28T18:45:57.986027] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:45:58.359342] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-28T18:45:58.873907] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T18:45:58.876403] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:45:59.159309] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-28T18:45:59.959320] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-28T18:46:00.183716] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T18:46:00.364142] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:46:00.759355] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-28T18:46:01.559354] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-28T18:46:02.359437] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-28T18:46:02.587186] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-28T18:46:02.590203] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (6.63 seconds). [2025-10-28T18:46:03.154743] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T18:46:03.165338] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-28T18:46:03.412107] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-28T18:46:03.959351] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-28T18:46:04.171454] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-28T18:46:04.759309] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-28T18:46:04.906305] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:46:04.906692] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-28T18:46:04.906762] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:46:04.906831] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-28T18:46:04.906909] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:46:04.906980] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-28T18:46:04.907043] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-28T18:46:04.907078] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-28T18:46:04.907117] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-28T18:46:04.907160] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FIG took 8.5s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-28T18:46:05.076982] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:05.118461] [DEBUG] [LOCAL ] FIGS: Loaded 48361 existing records from primary storage. [2025-10-28T18:46:05.118803] [INFO ] [MAIN ] FIGS: Loaded 48361 existing records. [2025-10-28T18:46:05.292299] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:05.292523] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-28T18:46:05.292575] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-28T18:46:05.293282] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-28T18:46:05.293338] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-28T18:46:05.565258] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-28T18:46:05.646044] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:06.359312] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-28T18:46:06.640957] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (4.28 seconds). [2025-10-28T18:46:06.956366] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:46:07.159368] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-28T18:46:07.959347] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-28T18:46:08.572982] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:46:08.759345] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-28T18:46:09.016703] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:46:09.024004] [INFO ] [REMOTE ] FHI: Full fetch complete (57322 records). [2025-10-28T18:46:09.024137] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-28T18:46:09.399896] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-28T18:46:09.399965] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-28T18:46:09.400704] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-28T18:46:09.400766] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-28T18:46:09.401834] [DEBUG] [LOCAL ] FHI: Trimmed 57322 records to 39205 (keeping 200 days of data) [2025-10-28T18:46:09.565365] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-28T18:46:09.635715] [DEBUG] [LOCAL ] FHI: Primary data saved (39205 records). [2025-10-28T18:46:09.635842] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-28T18:46:09.635920] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FHI took 42.5s. Estimated remaining: 3h 15m 38s. Rate: 7.8 symbols/min [2025-10-28T18:46:09.802686] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:09.840093] [DEBUG] [LOCAL ] FIHL: Loaded 38701 existing records from primary storage. [2025-10-28T18:46:09.840372] [INFO ] [MAIN ] FIHL: Loaded 38701 existing records. [2025-10-28T18:46:10.015082] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:10.015325] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-28T18:46:10.015385] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-28T18:46:10.015899] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-28T18:46:10.015956] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-28T18:46:10.374533] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:10.374928] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-28T18:46:10.404712] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T18:46:10.415590] [INFO ] [REMOTE ] FHN: Full fetch complete (77483 records). [2025-10-28T18:46:10.415740] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-28T18:46:10.800169] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-28T18:46:10.800234] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-28T18:46:10.801112] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-28T18:46:10.801172] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-28T18:46:10.802459] [DEBUG] [LOCAL ] FHN: Trimmed 77483 records to 53398 (keeping 200 days of data) [2025-10-28T18:46:11.112890] [DEBUG] [LOCAL ] FHN: Primary data saved (53398 records). [2025-10-28T18:46:11.113002] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-28T18:46:11.113076] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FHN took 40.6s. Estimated remaining: 3h 15m 19s. Rate: 7.8 symbols/min [2025-10-28T18:46:11.288113] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:11.328621] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T18:46:11.326589] [DEBUG] [LOCAL ] FINS: Loaded 8194 existing records from primary storage. [2025-10-28T18:46:11.341083] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-28T18:46:11.341311] [INFO ] [MAIN ] FINS: Loaded 8194 existing records. [2025-10-28T18:46:11.419041] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:46:11.551023] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:11.551264] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-28T18:46:11.551312] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-28T18:46:11.551592] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-28T18:46:11.551688] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-28T18:46:11.905304] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:11.959312] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-28T18:46:12.172343] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (5.81 seconds). [2025-10-28T18:46:12.439496] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T18:46:12.759326] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-28T18:46:13.559378] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-28T18:46:13.858909] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:46:14.359351] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-28T18:46:14.450777] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T18:46:14.674519] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T18:46:15.159324] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-28T18:46:15.552265] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T18:46:15.959347] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-28T18:46:16.519488] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T18:46:16.716787] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (5.38 seconds). [2025-10-28T18:46:16.759301] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-28T18:46:17.559342] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-28T18:46:18.125097] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:46:18.145764] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:46:18.359347] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-28T18:46:19.159324] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-28T18:46:19.959369] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-28T18:46:20.713015] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:46:20.759384] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-28T18:46:21.559361] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-28T18:46:22.072633] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T18:46:22.359406] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-28T18:46:22.592289] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (4.23 seconds). [2025-10-28T18:46:22.603117] [INFO ] [REMOTE ] FI: Full fetch complete (77497 records). [2025-10-28T18:46:22.603268] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-28T18:46:22.874756] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:46:23.027232] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-28T18:46:23.027310] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-28T18:46:23.028272] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-28T18:46:23.028336] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-28T18:46:23.029750] [DEBUG] [LOCAL ] FI: Trimmed 77497 records to 53573 (keeping 200 days of data) [2025-10-28T18:46:23.201450] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-28T18:46:23.355620] [DEBUG] [LOCAL ] FI: Primary data saved (53573 records). [2025-10-28T18:46:23.355787] [INFO ] [MAIN ] FI: Full history saved. [2025-10-28T18:46:23.355871] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FI took 51.5s. Estimated remaining: 3h 15m 20s. Rate: 7.8 symbols/min [2025-10-28T18:46:23.569112] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:23.572479] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-10-28T18:46:23.624050] [DEBUG] [LOCAL ] FINV: Loaded 45169 existing records from primary storage. [2025-10-28T18:46:23.624329] [INFO ] [MAIN ] FINV: Loaded 45169 existing records. [2025-10-28T18:46:23.723059] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:46:23.815004] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:23.815248] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-28T18:46:23.815296] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-28T18:46:23.816309] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-28T18:46:23.816367] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-28T18:46:23.968027] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-28T18:46:24.189975] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:24.612131] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T18:46:24.613729] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (5.45 seconds). [2025-10-28T18:46:24.626218] [INFO ] [REMOTE ] FINS: Full fetch complete (11500 records). [2025-10-28T18:46:24.626677] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-28T18:46:24.764434] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-28T18:46:25.035394] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-28T18:46:25.035469] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-28T18:46:25.035757] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-28T18:46:25.035815] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-28T18:46:25.036227] [DEBUG] [LOCAL ] FINS: Trimmed 11500 records to 8142 (keeping 200 days of data) [2025-10-28T18:46:25.083936] [DEBUG] [LOCAL ] FINS: Primary data saved (8142 records). [2025-10-28T18:46:25.084064] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-28T18:46:25.084143] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FINS took 14.0s. Estimated remaining: 3h 15m 2s. Rate: 7.9 symbols/min [2025-10-28T18:46:25.251572] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:25.298999] [DEBUG] [LOCAL ] FIS: Loaded 53324 existing records from primary storage. [2025-10-28T18:46:25.299289] [INFO ] [MAIN ] FIS: Loaded 53324 existing records. [2025-10-28T18:46:25.473749] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:25.473933] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-28T18:46:25.473978] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-28T18:46:25.474543] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-28T18:46:25.474600] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-28T18:46:25.567043] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-28T18:46:25.828351] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:26.033306] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:46:26.359356] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-28T18:46:27.159362] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-28T18:46:27.959336] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-28T18:46:30.133419] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (4.57 seconds). [2025-10-28T18:46:30.142866] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-28T18:46:31.730822] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T18:46:31.739381] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-28T18:46:32.257376] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (5.90 seconds). [2025-10-28T18:46:32.267840] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-28T18:46:32.773890] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:46:32.782259] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-28T18:46:33.383034] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:46:33.393203] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-28T18:46:33.745858] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T18:46:33.754062] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-28T18:46:34.680050] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:46:34.690610] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-28T18:46:34.829017] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:46:34.837888] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-28T18:46:35.918957] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:46:35.930152] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-28T18:46:37.150382] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T18:46:37.160970] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-28T18:46:38.362146] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (11.20 seconds). [2025-10-28T18:46:38.372425] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-28T18:46:38.496000] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:46:38.505287] [INFO ] [REMOTE ] FIGS: Full fetch complete (70716 records). [2025-10-28T18:46:38.505400] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-28T18:46:38.723315] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (10.76 seconds). [2025-10-28T18:46:38.810805] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-28T18:46:38.930174] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-28T18:46:38.930258] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-28T18:46:38.931107] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-28T18:46:38.931168] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-28T18:46:38.932503] [DEBUG] [LOCAL ] FIGS: Trimmed 70716 records to 48318 (keeping 200 days of data) [2025-10-28T18:46:39.196957] [DEBUG] [LOCAL ] FIGS: Primary data saved (48318 records). [2025-10-28T18:46:39.197075] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-28T18:46:39.197856] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FIGS took 34.3s. Estimated remaining: 3h 15m 6s. Rate: 7.8 symbols/min [2025-10-28T18:46:39.368221] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:39.396543] [DEBUG] [LOCAL ] FIX: Loaded 28309 existing records from primary storage. [2025-10-28T18:46:39.396850] [INFO ] [MAIN ] FIX: Loaded 28309 existing records. [2025-10-28T18:46:39.575035] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (4.74 seconds). [2025-10-28T18:46:39.603535] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:39.611616] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-28T18:46:39.611881] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-28T18:46:39.612499] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-28T18:46:39.612579] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-28T18:46:39.612460] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-28T18:46:39.983965] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:39.984344] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-28T18:46:40.008806] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:46:40.017368] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-28T18:46:40.832283] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:46:40.841303] [INFO ] [REMOTE ] FIHL: Full fetch complete (56294 records). [2025-10-28T18:46:40.841485] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-28T18:46:41.248098] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-28T18:46:41.248352] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-28T18:46:41.249764] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-28T18:46:41.249874] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-28T18:46:41.275074] [DEBUG] [LOCAL ] FIHL: Trimmed 56294 records to 38617 (keeping 200 days of data) [2025-10-28T18:46:41.276387] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:46:41.286477] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-28T18:46:41.530170] [DEBUG] [LOCAL ] FIHL: Primary data saved (38617 records). [2025-10-28T18:46:41.530448] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-28T18:46:41.530546] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FIHL took 31.9s. Estimated remaining: 3h 14m 49s. Rate: 7.8 symbols/min [2025-10-28T18:46:42.446712] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T18:46:42.456413] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-28T18:46:43.301904] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (4.93 seconds). [2025-10-28T18:46:43.312317] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-28T18:46:43.505973] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T18:46:43.514448] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-28T18:46:44.544700] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:46:44.554335] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-28T18:46:44.643297] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:46:44.759366] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-28T18:46:45.719510] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:46:45.730434] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-28T18:46:45.946813] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:46:46.359314] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-28T18:46:46.987123] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:46:47.159366] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-28T18:46:47.318017] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (7.33 seconds). [2025-10-28T18:46:47.561543] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:46:47.959348] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-28T18:46:48.759368] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-28T18:46:49.980103] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:46:49.994032] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-28T18:46:50.796098] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (2.84 seconds). [2025-10-28T18:46:50.803427] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-28T18:46:51.288130] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:46:51.301202] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-28T18:46:52.058537] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:46:52.088121] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-28T18:46:52.092823] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (4.93 seconds). [2025-10-28T18:46:52.759327] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-28T18:46:53.194878] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:46:53.559333] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-28T18:46:54.000865] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T18:46:54.010231] [INFO ] [REMOTE ] FINV: Full fetch complete (65030 records). [2025-10-28T18:46:54.010353] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-28T18:46:54.400326] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-28T18:46:54.400500] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-28T18:46:54.401382] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-28T18:46:54.401443] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-28T18:46:54.402663] [DEBUG] [LOCAL ] FINV: Trimmed 65030 records to 45195 (keeping 200 days of data) [2025-10-28T18:46:54.590395] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T18:46:54.656229] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-28T18:46:54.665935] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.36 seconds). [2025-10-28T18:46:54.739343] [DEBUG] [LOCAL ] FINV: Primary data saved (45195 records). [2025-10-28T18:46:54.739490] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-28T18:46:54.739586] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FINV took 31.4s. Estimated remaining: 3h 14m 51s. Rate: 7.8 symbols/min [2025-10-28T18:46:55.159352] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-28T18:46:55.522464] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T18:46:55.959413] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-28T18:46:58.860118] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-28T18:46:58.866690] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-28T18:46:59.857082] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T18:46:59.863186] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-28T18:47:00.185020] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (5.03 seconds). [2025-10-28T18:47:00.196763] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-28T18:47:01.002735] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:47:01.009070] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-28T18:47:01.346317] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T18:47:01.357033] [INFO ] [REMOTE ] FIS: Full fetch complete (77398 records). [2025-10-28T18:47:01.357182] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-28T18:47:01.755882] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-28T18:47:01.755962] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-28T18:47:01.757105] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-28T18:47:01.757171] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-28T18:47:01.758810] [DEBUG] [LOCAL ] FIS: Trimmed 77398 records to 53324 (keeping 200 days of data) [2025-10-28T18:47:02.080392] [DEBUG] [LOCAL ] FIS: Primary data saved (53324 records). [2025-10-28T18:47:02.080503] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-28T18:47:02.080580] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIS took 37.0s. Estimated remaining: 3h 14m 43s. Rate: 7.8 symbols/min [2025-10-28T18:47:02.807810] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T18:47:02.813768] [INFO ] [REMOTE ] FIX: Full fetch complete (45704 records). [2025-10-28T18:47:02.813913] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-28T18:47:03.217792] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-28T18:47:03.217910] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-28T18:47:03.218592] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-28T18:47:03.218633] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-28T18:47:03.219689] [DEBUG] [LOCAL ] FIX: Trimmed 45704 records to 28232 (keeping 200 days of data) [2025-10-28T18:47:03.392531] [DEBUG] [LOCAL ] FIX: Primary data saved (28232 records). [2025-10-28T18:47:03.392700] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-28T18:47:03.392796] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIX took 24.2s. Estimated remaining: 3h 14m 24s. Rate: 7.8 symbols/min [2025-10-28T18:47:04.025841] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.037475] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.082545] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.111214] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.113338] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-28T18:47:04.113428] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-28T18:47:04.113585] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-28T18:47:04.113666] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-28T18:47:04.113799] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-28T18:47:04.113853] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-28T18:47:04.193012] [DEBUG] [LOCAL ] FLC: Loaded 5167 existing records from primary storage. [2025-10-28T18:47:04.216384] [INFO ] [MAIN ] FLC: Loaded 5167 existing records. [2025-10-28T18:47:04.553795] [DEBUG] [LOCAL ] FLNG: Loaded 32921 existing records from primary storage. [2025-10-28T18:47:04.554532] [DEBUG] [LOCAL ] FLG: Loaded 53317 existing records from primary storage. [2025-10-28T18:47:04.594357] [INFO ] [MAIN ] FLNG: Loaded 32921 existing records. [2025-10-28T18:47:04.593808] [INFO ] [MAIN ] FLG: Loaded 53317 existing records. [2025-10-28T18:47:04.663296] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:04.823732] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-28T18:47:04.839356] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-28T18:47:04.861618] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-28T18:47:04.879076] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-28T18:47:05.170902] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:05.195956] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:05.167578] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:05.228977] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-28T18:47:05.229728] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-28T18:47:05.229826] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-28T18:47:05.229938] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-28T18:47:05.230406] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-28T18:47:05.230471] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-28T18:47:05.257516] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-28T18:47:05.229597] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-28T18:47:05.330752] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-28T18:47:05.570872] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:47:05.630125] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-28T18:47:05.645253] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:47:05.660848] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-28T18:47:05.692192] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:47:05.896055] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-28T18:47:05.998167] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-28T18:47:06.064308] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:06.080123] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-28T18:47:06.080464] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-28T18:47:06.106137] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-28T18:47:06.164801] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 14m 7s. Rate: 7.9 symbols/min [2025-10-28T18:47:06.214511] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:06.224870] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-28T18:47:06.289238] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:06.305723] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-28T18:47:06.437931] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:06.484098] [DEBUG] [LOCAL ] FLO: Loaded 52066 existing records from primary storage. [2025-10-28T18:47:06.484387] [INFO ] [MAIN ] FLO: Loaded 52066 existing records. [2025-10-28T18:47:06.656308] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:06.656537] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-28T18:47:06.656606] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-28T18:47:06.657502] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-28T18:47:06.657559] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-28T18:47:06.933161] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:47:06.945506] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-28T18:47:07.011496] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:07.011790] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-28T18:47:07.377374] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:47:07.378901] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-28T18:47:07.400040] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:47:07.407294] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-28T18:47:07.647986] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:47:07.658498] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-28T18:47:08.114021] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:47:08.116307] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-28T18:47:08.260294] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:47:08.270186] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-28T18:47:08.410853] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T18:47:08.556696] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T18:47:08.759375] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-28T18:47:08.861055] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:47:09.559327] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-28T18:47:09.570874] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T18:47:10.359366] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-28T18:47:10.733946] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T18:47:11.120288] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T18:47:11.159304] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-28T18:47:11.959351] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-28T18:47:12.357387] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T18:47:12.480782] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:47:12.544925] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (4.27 seconds). [2025-10-28T18:47:12.759362] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-28T18:47:13.559372] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-28T18:47:13.981963] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:47:14.359390] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-28T18:47:15.159332] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-28T18:47:15.736027] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:47:15.959355] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-28T18:47:16.664357] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T18:47:16.759335] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-28T18:47:17.124969] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:47:17.216231] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:47:17.559339] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-28T18:47:18.359305] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-28T18:47:18.778803] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:47:19.159330] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-28T18:47:19.959321] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-28T18:47:21.252008] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (7.69 seconds). [2025-10-28T18:47:21.260856] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-28T18:47:22.270943] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T18:47:22.278283] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-28T18:47:23.185621] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T18:47:23.191919] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-28T18:47:24.279862] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:47:24.286882] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-28T18:47:25.454494] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:47:25.462820] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-28T18:47:28.457436] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (10.10 seconds). [2025-10-28T18:47:28.468556] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-28T18:47:29.845967] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:47:29.857635] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-28T18:47:31.156346] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:47:31.168206] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-28T18:47:32.531420] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:47:32.543722] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-28T18:47:33.944799] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:47:33.956002] [INFO ] [REMOTE ] FLG: Full fetch complete (77425 records). [2025-10-28T18:47:33.956147] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-28T18:47:34.372889] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-28T18:47:34.372970] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-28T18:47:34.373912] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-28T18:47:34.373975] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-28T18:47:34.375443] [DEBUG] [LOCAL ] FLG: Trimmed 77425 records to 53316 (keeping 200 days of data) [2025-10-28T18:47:34.717885] [DEBUG] [LOCAL ] FLG: Primary data saved (53316 records). [2025-10-28T18:47:34.718075] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-28T18:47:34.719116] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLG took 31.3s. Estimated remaining: 3h 14m 37s. Rate: 7.8 symbols/min [2025-10-28T18:47:34.889347] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:34.889556] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-28T18:47:34.889610] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-28T18:47:34.889741] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-28T18:47:34.889782] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-28T18:47:34.889823] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-28T18:47:34.889855] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-28T18:47:35.236293] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:35.236661] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-28T18:47:46.593605] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (27.43 seconds). [2025-10-28T18:47:46.605189] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-28T18:47:47.943039] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:47:47.954865] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-28T18:47:48.158629] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (28.20 seconds). [2025-10-28T18:47:48.160293] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-28T18:47:48.651290] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:47:48.652873] [INFO ] [REMOTE ] FLC: Full fetch complete (7802 records). [2025-10-28T18:47:48.652949] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-28T18:47:49.029806] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-28T18:47:49.029923] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-28T18:47:49.030151] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-28T18:47:49.030212] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-28T18:47:49.030597] [DEBUG] [LOCAL ] FLC: Trimmed 7802 records to 5080 (keeping 200 days of data) [2025-10-28T18:47:49.060692] [DEBUG] [LOCAL ] FLC: Primary data saved (5080 records). [2025-10-28T18:47:49.060788] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-28T18:47:49.060861] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLC took 45.7s. Estimated remaining: 3h 14m 42s. Rate: 7.8 symbols/min [2025-10-28T18:47:49.240258] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:49.288013] [DEBUG] [LOCAL ] FLR: Loaded 53242 existing records from primary storage. [2025-10-28T18:47:49.288445] [INFO ] [MAIN ] FLR: Loaded 53242 existing records. [2025-10-28T18:47:49.480762] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T18:47:49.512183] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:49.513583] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-28T18:47:49.513809] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-28T18:47:49.514263] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-28T18:47:49.515114] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-28T18:47:49.515189] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-28T18:47:49.869967] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:49.870634] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-28T18:47:51.100187] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:47:51.110855] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-28T18:47:51.178241] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:47:51.189310] [INFO ] [REMOTE ] FLO: Full fetch complete (75400 records). [2025-10-28T18:47:51.189456] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-28T18:47:51.628290] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-28T18:47:51.628372] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-28T18:47:51.629418] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-28T18:47:51.629483] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-28T18:47:51.631057] [DEBUG] [LOCAL ] FLO: Trimmed 75400 records to 52068 (keeping 200 days of data) [2025-10-28T18:47:51.957533] [DEBUG] [LOCAL ] FLO: Primary data saved (52068 records). [2025-10-28T18:47:51.957682] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-28T18:47:51.957787] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 45.8s. Estimated remaining: 3h 14m 26s. Rate: 7.8 symbols/min [2025-10-28T18:47:52.126197] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:52.170517] [DEBUG] [LOCAL ] FLS: Loaded 50378 existing records from primary storage. [2025-10-28T18:47:52.170831] [INFO ] [MAIN ] FLS: Loaded 50378 existing records. [2025-10-28T18:47:52.342839] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:52.343056] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-28T18:47:52.343102] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-28T18:47:52.343680] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-28T18:47:52.343750] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-28T18:47:52.687577] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:52.687908] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-28T18:47:53.949870] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:47:53.959260] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-28T18:47:54.939870] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T18:47:54.948862] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-28T18:47:55.122829] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (29.66 seconds). [2025-10-28T18:47:55.130556] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-28T18:47:56.116909] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T18:47:56.125628] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-28T18:47:56.162149] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:47:56.173006] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-28T18:47:57.203844] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T18:47:57.209954] [INFO ] [REMOTE ] FLNG: Full fetch complete (49602 records). [2025-10-28T18:47:57.210050] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-28T18:47:57.593496] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-28T18:47:57.593666] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-28T18:47:57.594402] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-28T18:47:57.594457] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-28T18:47:57.595661] [DEBUG] [LOCAL ] FLNG: Trimmed 49602 records to 32849 (keeping 200 days of data) [2025-10-28T18:47:57.626215] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T18:47:57.726179] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-28T18:47:57.835503] [DEBUG] [LOCAL ] FLNG: Primary data saved (32849 records). [2025-10-28T18:47:57.835637] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-28T18:47:57.835752] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLNG took 54.4s. Estimated remaining: 3h 14m 15s. Rate: 7.8 symbols/min [2025-10-28T18:47:58.011670] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:58.058861] [DEBUG] [LOCAL ] FLUT: Loaded 50601 existing records from primary storage. [2025-10-28T18:47:58.059171] [INFO ] [MAIN ] FLUT: Loaded 50601 existing records. [2025-10-28T18:47:58.235137] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:58.235356] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-28T18:47:58.235402] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-28T18:47:58.235744] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-28T18:47:58.235800] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-28T18:47:58.580919] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:58.581240] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-28T18:47:58.873074] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T18:47:58.882911] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-28T18:47:59.840236] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:47:59.849807] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-28T18:48:01.161310] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:48:01.171272] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-28T18:48:01.226118] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (25.99 seconds). [2025-10-28T18:48:01.230925] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-28T18:48:02.087233] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T18:48:02.093295] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-28T18:48:02.542938] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:48:02.553761] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-28T18:48:03.098715] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T18:48:03.106232] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-28T18:48:04.029442] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:48:04.035601] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-28T18:48:04.977455] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:48:04.984796] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-28T18:48:13.640668] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (22.53 seconds). [2025-10-28T18:48:13.650922] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-28T18:48:14.902792] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T18:48:14.913639] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-28T18:48:15.271587] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (12.72 seconds). [2025-10-28T18:48:15.284027] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-28T18:48:16.180962] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:48:16.191785] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-28T18:48:17.474462] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:48:17.485588] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-28T18:48:18.853971] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T18:48:18.864544] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-28T18:48:20.321029] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:48:20.332451] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-28T18:48:21.800769] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:48:21.812282] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-28T18:48:23.172308] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:48:23.183546] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-28T18:48:25.823913] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (26.94 seconds). [2025-10-28T18:48:25.834466] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-28T18:48:27.039533] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T18:48:27.050634] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-28T18:48:28.322522] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:48:28.332737] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-28T18:48:29.771847] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T18:48:29.782904] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-28T18:48:30.921676] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (15.64 seconds). [2025-10-28T18:48:30.932446] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-28T18:48:31.259318] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T18:48:31.270137] [INFO ] [REMOTE ] FLS: Full fetch complete (72638 records). [2025-10-28T18:48:31.270287] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-28T18:48:31.661625] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-28T18:48:31.661730] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-28T18:48:31.662577] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-28T18:48:31.662638] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-28T18:48:31.664120] [DEBUG] [LOCAL ] FLS: Trimmed 72638 records to 50389 (keeping 200 days of data) [2025-10-28T18:48:31.962166] [DEBUG] [LOCAL ] FLS: Primary data saved (50389 records). [2025-10-28T18:48:31.962287] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-28T18:48:31.962363] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLS took 40.0s. Estimated remaining: 3h 14m 55s. Rate: 7.8 symbols/min [2025-10-28T18:48:32.136068] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:32.170995] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:48:32.181467] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-28T18:48:32.189593] [DEBUG] [LOCAL ] FLXR: Loaded 21635 existing records from primary storage. [2025-10-28T18:48:32.189998] [INFO ] [MAIN ] FLXR: Loaded 21635 existing records. [2025-10-28T18:48:32.365233] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:32.365428] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-28T18:48:32.365473] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-28T18:48:32.365987] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-28T18:48:32.366047] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-28T18:48:32.717188] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:32.717474] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-28T18:48:33.182458] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T18:48:33.185069] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-28T18:48:33.268527] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (28.28 seconds). [2025-10-28T18:48:33.274661] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-28T18:48:33.465725] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:48:33.476909] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-28T18:48:34.077594] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T18:48:34.083614] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-28T18:48:34.726019] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:48:34.736496] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-28T18:48:36.057928] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T18:48:36.068841] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-28T18:48:38.721122] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-28T18:48:38.732452] [INFO ] [REMOTE ] FLUT: Full fetch complete (73388 records). [2025-10-28T18:48:38.732714] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-28T18:48:39.125624] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-28T18:48:39.125756] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-28T18:48:39.126777] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-28T18:48:39.126839] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-28T18:48:39.128319] [DEBUG] [LOCAL ] FLUT: Trimmed 73388 records to 50602 (keeping 200 days of data) [2025-10-28T18:48:39.429865] [DEBUG] [LOCAL ] FLUT: Primary data saved (50602 records). [2025-10-28T18:48:39.429998] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-28T18:48:39.430899] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLUT took 41.6s. Estimated remaining: 3h 14m 47s. Rate: 7.8 symbols/min [2025-10-28T18:48:39.597362] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:39.645548] [DEBUG] [LOCAL ] FMC: Loaded 51842 existing records from primary storage. [2025-10-28T18:48:39.645901] [INFO ] [MAIN ] FMC: Loaded 51842 existing records. [2025-10-28T18:48:39.820173] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:39.820371] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-28T18:48:39.820417] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-28T18:48:39.821278] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-28T18:48:39.821334] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-28T18:48:40.171079] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:40.171404] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-28T18:48:43.541909] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (9.46 seconds). [2025-10-28T18:48:43.550143] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-28T18:48:45.029097] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:48:45.034622] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-28T18:48:45.626629] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (22.44 seconds). [2025-10-28T18:48:45.637363] [INFO ] [REMOTE ] FLR: Full fetch complete (76932 records). [2025-10-28T18:48:45.637482] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-28T18:48:46.028762] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-28T18:48:46.028891] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-28T18:48:46.029818] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-28T18:48:46.029880] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-28T18:48:46.031319] [DEBUG] [LOCAL ] FLR: Trimmed 76932 records to 53241 (keeping 200 days of data) [2025-10-28T18:48:46.241885] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T18:48:46.259394] [INFO ] [REMOTE ] FLOC: Full fetch complete (41754 records). [2025-10-28T18:48:46.272123] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-28T18:48:46.543056] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T18:48:46.551605] [DEBUG] [LOCAL ] FLR: Primary data saved (53241 records). [2025-10-28T18:48:46.549623] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:48:46.551751] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-28T18:48:46.551908] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLR took 57.5s. Estimated remaining: 3h 14m 38s. Rate: 7.8 symbols/min [2025-10-28T18:48:46.551825] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:48:46.583200] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-28T18:48:46.631229] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-28T18:48:46.651830] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-28T18:48:46.651958] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-28T18:48:46.657631] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FLOC took 1m 12s. Estimated remaining: 3h 14m 17s. Rate: 7.8 symbols/min [2025-10-28T18:48:46.818674] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:46.907334] [DEBUG] [LOCAL ] FMN: Loaded 5419 existing records from primary storage. [2025-10-28T18:48:46.904593] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:46.907556] [INFO ] [MAIN ] FMN: Loaded 5419 existing records. [2025-10-28T18:48:47.098549] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:47.108590] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-28T18:48:47.108709] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-28T18:48:47.108967] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-28T18:48:47.109032] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-28T18:48:47.141725] [DEBUG] [LOCAL ] FMS: Loaded 30079 existing records from primary storage. [2025-10-28T18:48:47.173684] [INFO ] [MAIN ] FMS: Loaded 30079 existing records. [2025-10-28T18:48:47.588232] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:47.592428] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-28T18:48:47.598036] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-28T18:48:47.614343] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-28T18:48:47.631753] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-28T18:48:47.713967] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:47.762992] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-28T18:48:47.786191] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (14.60 seconds). [2025-10-28T18:48:47.837006] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-28T18:48:48.048553] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:48.049018] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-28T18:48:48.411893] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T18:48:48.414578] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-28T18:48:48.560571] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T18:48:48.564464] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-28T18:48:48.895103] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:48:48.901091] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-28T18:48:48.964005] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T18:48:48.966366] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-28T18:48:49.486945] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T18:48:49.489811] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-28T18:48:49.698284] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T18:48:49.703431] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-28T18:48:51.427573] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T18:48:51.434222] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-28T18:48:52.536915] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T18:48:52.544319] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-28T18:48:52.674291] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (3.18 seconds). [2025-10-28T18:48:52.676574] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-28T18:48:53.050863] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T18:48:53.052371] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-28T18:48:54.690071] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:48:54.691985] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-28T18:48:55.269212] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (15.10 seconds). [2025-10-28T18:48:55.281138] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-28T18:48:55.918031] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:48:55.920272] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-28T18:48:56.767226] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:48:56.769054] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-28T18:48:56.963004] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:48:56.973539] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-28T18:48:57.187910] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T18:48:57.189907] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-28T18:48:57.842460] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:48:57.844556] [INFO ] [REMOTE ] FMN: Full fetch complete (9796 records). [2025-10-28T18:48:57.844626] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-28T18:48:58.258752] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-28T18:48:58.258856] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-28T18:48:58.259219] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-28T18:48:58.259268] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-28T18:48:58.259856] [DEBUG] [LOCAL ] FMN: Trimmed 9796 records to 5507 (keeping 200 days of data) [2025-10-28T18:48:58.295149] [DEBUG] [LOCAL ] FMN: Primary data saved (5507 records). [2025-10-28T18:48:58.295326] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-28T18:48:58.295432] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FMN took 11.7s. Estimated remaining: 3h 14m 16s. Rate: 7.8 symbols/min [2025-10-28T18:48:58.474930] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:58.516047] [DEBUG] [LOCAL ] FMX: Loaded 39996 existing records from primary storage. [2025-10-28T18:48:58.516626] [INFO ] [MAIN ] FMX: Loaded 39996 existing records. [2025-10-28T18:48:58.710603] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:58.710993] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-28T18:48:58.711138] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-28T18:48:58.723903] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-28T18:48:58.742307] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-28T18:48:58.750554] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-28T18:48:58.856030] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-28T18:48:59.139249] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:59.139625] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-28T18:49:00.215212] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (11.65 seconds). [2025-10-28T18:49:00.219321] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-28T18:49:00.645479] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T18:49:00.666309] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-28T18:49:00.845428] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T18:49:00.852580] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-28T18:49:01.487319] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:49:01.491557] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-28T18:49:02.551186] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T18:49:02.555997] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-28T18:49:03.511126] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T18:49:03.516299] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-28T18:49:04.426586] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T18:49:04.432432] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-28T18:49:05.493924] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:49:05.501400] [INFO ] [REMOTE ] FLXR: Full fetch complete (28072 records). [2025-10-28T18:49:05.501544] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-28T18:49:05.878477] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-28T18:49:05.878541] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-28T18:49:05.879141] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-28T18:49:05.879201] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-28T18:49:05.880030] [DEBUG] [LOCAL ] FLXR: Trimmed 28072 records to 21694 (keeping 200 days of data) [2025-10-28T18:49:06.022391] [DEBUG] [LOCAL ] FLXR: Primary data saved (21694 records). [2025-10-28T18:49:06.022515] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-28T18:49:06.022595] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FLXR took 34.1s. Estimated remaining: 3h 14m 8s. Rate: 7.8 symbols/min [2025-10-28T18:49:06.210576] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:06.213436] [DEBUG] [LOCAL ] FMY: Loaded 1320 existing records from primary storage. [2025-10-28T18:49:06.213580] [INFO ] [MAIN ] FMY: Loaded 1320 existing records. [2025-10-28T18:49:06.386666] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:06.386903] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-28T18:49:06.386952] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-28T18:49:06.387096] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-28T18:49:06.387134] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-28T18:49:06.731054] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:06.731341] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-28T18:49:06.973137] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-28T18:49:06.974032] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-28T18:49:09.646759] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (17.10 seconds). [2025-10-28T18:49:09.654291] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-28T18:49:10.566445] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:49:10.572882] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-28T18:49:15.656953] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (14.99 seconds). [2025-10-28T18:49:15.670884] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-28T18:49:16.114693] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (9.14 seconds). [2025-10-28T18:49:16.115767] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-28T18:49:16.383600] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T18:49:16.384573] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-28T18:49:16.768268] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:49:16.769802] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-28T18:49:17.019470] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T18:49:17.020473] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-28T18:49:17.124609] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T18:49:17.135418] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-28T18:49:18.461320] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:49:18.472310] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-28T18:49:19.546870] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (20.41 seconds). [2025-10-28T18:49:19.553983] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-28T18:49:19.826843] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:49:19.838008] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-28T18:49:20.627915] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T18:49:20.635489] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-28T18:49:21.574330] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (11.00 seconds). [2025-10-28T18:49:21.580319] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-28T18:49:21.684549] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (4.66 seconds). [2025-10-28T18:49:21.685499] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-28T18:49:21.974340] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T18:49:21.975395] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-28T18:49:30.862688] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (9.28 seconds). [2025-10-28T18:49:30.868839] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-28T18:49:31.866763] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T18:49:31.873600] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-28T18:49:32.914502] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:49:32.921148] [INFO ] [REMOTE ] FMS: Full fetch complete (43184 records). [2025-10-28T18:49:32.921286] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-28T18:49:33.334353] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-28T18:49:33.334444] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-28T18:49:33.335183] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-28T18:49:33.335247] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-28T18:49:33.336408] [DEBUG] [LOCAL ] FMS: Trimmed 43184 records to 30062 (keeping 200 days of data) [2025-10-28T18:49:33.511364] [DEBUG] [LOCAL ] FMS: Primary data saved (30062 records). [2025-10-28T18:49:33.511487] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-28T18:49:33.511563] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMS took 46.8s. Estimated remaining: 3h 14m 36s. Rate: 7.8 symbols/min [2025-10-28T18:49:33.691880] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:33.726132] [DEBUG] [LOCAL ] FN: Loaded 37005 existing records from primary storage. [2025-10-28T18:49:33.726435] [INFO ] [MAIN ] FN: Loaded 37005 existing records. [2025-10-28T18:49:33.922542] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:33.922801] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-28T18:49:33.922849] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-28T18:49:33.923058] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-28T18:49:33.923113] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-28T18:49:34.307217] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:34.307756] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-28T18:49:38.795044] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (18.96 seconds). [2025-10-28T18:49:38.806202] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-28T18:49:40.473282] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T18:49:40.483844] [INFO ] [REMOTE ] FMC: Full fetch complete (75435 records). [2025-10-28T18:49:40.483980] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-28T18:49:40.885124] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-28T18:49:40.885216] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-28T18:49:40.886318] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-28T18:49:40.886389] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-28T18:49:40.887951] [DEBUG] [LOCAL ] FMC: Trimmed 75435 records to 51833 (keeping 200 days of data) [2025-10-28T18:49:41.196911] [DEBUG] [LOCAL ] FMC: Primary data saved (51833 records). [2025-10-28T18:49:41.197045] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-28T18:49:41.197753] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMC took 1m 2s. Estimated remaining: 3h 14m 28s. Rate: 7.8 symbols/min [2025-10-28T18:49:41.362839] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:41.416098] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-28T18:49:41.416405] [INFO ] [MAIN ] FNB: Loaded 52602 existing records. [2025-10-28T18:49:41.588947] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:41.589132] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-28T18:49:41.589177] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-28T18:49:41.589637] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-28T18:49:41.589727] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-28T18:49:41.977729] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:41.978107] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-28T18:49:43.338245] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T18:49:43.348408] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-28T18:49:44.375847] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (22.40 seconds). [2025-10-28T18:49:44.377252] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-28T18:49:44.619096] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T18:49:44.629136] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-28T18:49:44.685618] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T18:49:44.686779] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-28T18:49:45.168037] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T18:49:45.169063] [INFO ] [REMOTE ] FMY: Full fetch complete (1936 records). [2025-10-28T18:49:45.169136] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-28T18:49:45.544808] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-28T18:49:45.544903] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-28T18:49:45.545016] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-28T18:49:45.545056] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-28T18:49:45.545380] [DEBUG] [LOCAL ] FMY: Trimmed 1936 records to 1325 (keeping 200 days of data) [2025-10-28T18:49:45.553760] [DEBUG] [LOCAL ] FMY: Primary data saved (1325 records). [2025-10-28T18:49:45.553819] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-28T18:49:45.553884] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FMY took 39.5s. Estimated remaining: 3h 14m 14s. Rate: 7.8 symbols/min [2025-10-28T18:49:45.725806] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:45.772800] [DEBUG] [LOCAL ] FND: Loaded 52045 existing records from primary storage. [2025-10-28T18:49:45.773164] [INFO ] [MAIN ] FND: Loaded 52045 existing records. [2025-10-28T18:49:45.961367] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:45.961623] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-28T18:49:45.961861] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-28T18:49:45.962277] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-28T18:49:45.962334] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-28T18:49:46.275835] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T18:49:46.340593] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-28T18:49:46.360233] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:46.361393] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-28T18:49:47.713686] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T18:49:47.723973] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-28T18:49:47.786849] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T18:49:47.799627] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-28T18:49:48.271378] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (27.64 seconds). [2025-10-28T18:49:48.283627] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-28T18:49:49.025975] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T18:49:49.035535] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-28T18:49:49.222678] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:49:49.233487] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-28T18:49:49.598291] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T18:49:49.607489] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-28T18:49:50.447919] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:49:50.459318] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-28T18:49:50.720782] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:49:50.728548] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-28T18:49:51.768072] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:49:51.775863] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-28T18:50:01.178941] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (26.87 seconds). [2025-10-28T18:50:01.186392] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-28T18:50:01.574981] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (12.34 seconds). [2025-10-28T18:50:01.589393] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-28T18:50:02.956871] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:50:02.968478] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-28T18:50:04.306768] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:50:04.318357] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-28T18:50:10.981567] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (19.21 seconds). [2025-10-28T18:50:10.990414] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-28T18:50:14.821518] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (24.36 seconds). [2025-10-28T18:50:14.832382] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-28T18:50:16.335764] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:50:16.346751] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-28T18:50:23.572602] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (22.39 seconds). [2025-10-28T18:50:23.581149] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-28T18:50:24.757741] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (20.44 seconds). [2025-10-28T18:50:24.769391] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-28T18:50:24.796470] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:50:24.807412] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-28T18:50:25.988181] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:50:26.001549] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-28T18:50:26.350571] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:50:26.361556] [INFO ] [REMOTE ] FNB: Full fetch complete (76249 records). [2025-10-28T18:50:26.361754] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-28T18:50:26.751047] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-28T18:50:26.751127] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-28T18:50:26.752037] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-28T18:50:26.752106] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-28T18:50:26.753686] [DEBUG] [LOCAL ] FNB: Trimmed 76249 records to 52602 (keeping 200 days of data) [2025-10-28T18:50:27.070937] [DEBUG] [LOCAL ] FNB: Primary data saved (52602 records). [2025-10-28T18:50:27.071085] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-28T18:50:27.071733] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FNB took 45.9s. Estimated remaining: 3h 15m 6s. Rate: 7.7 symbols/min [2025-10-28T18:50:27.244671] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:27.290244] [DEBUG] [LOCAL ] FNF: Loaded 48527 existing records from primary storage. [2025-10-28T18:50:27.290521] [INFO ] [MAIN ] FNF: Loaded 48527 existing records. [2025-10-28T18:50:27.466864] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:27.467010] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-28T18:50:27.467057] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-28T18:50:27.467365] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-28T18:50:27.467406] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-28T18:50:27.829248] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:50:27.829670] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-28T18:50:28.874100] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:50:28.882936] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-28T18:50:30.028502] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:50:30.037492] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-28T18:50:31.222860] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:50:31.233186] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-28T18:50:35.918230] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (24.93 seconds). [2025-10-28T18:50:35.927531] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-28T18:50:46.116557] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (14.88 seconds). [2025-10-28T18:50:46.127137] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-28T18:50:47.338791] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T18:50:47.349571] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-28T18:50:48.519187] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:50:48.530480] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-28T18:50:48.635979] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (32.29 seconds). [2025-10-28T18:50:48.646184] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-28T18:50:49.758550] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:50:49.770195] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-28T18:50:49.821607] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:50:49.832751] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-28T18:50:50.997596] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:50:51.008092] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-28T18:50:51.114632] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T18:50:51.125594] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-28T18:50:52.117211] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T18:50:52.127475] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-28T18:50:52.379337] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:50:52.390551] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-28T18:50:53.351971] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:50:53.361996] [INFO ] [REMOTE ] FNF: Full fetch complete (69832 records). [2025-10-28T18:50:53.362233] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-28T18:50:53.786933] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-28T18:50:53.787152] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-28T18:50:53.788204] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-28T18:50:53.788286] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-28T18:50:53.789831] [DEBUG] [LOCAL ] FNF: Trimmed 69832 records to 48424 (keeping 200 days of data) [2025-10-28T18:50:53.911158] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T18:50:53.937808] [INFO ] [REMOTE ] FND: Full fetch complete (75095 records). [2025-10-28T18:50:53.944519] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-28T18:50:54.542282] [DEBUG] [LOCAL ] FNF: Primary data saved (48424 records). [2025-10-28T18:50:54.560421] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-28T18:50:54.561322] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FNF took 27.5s. Estimated remaining: 3h 15m 33s. Rate: 7.7 symbols/min [2025-10-28T18:50:54.561806] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-28T18:50:54.567044] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-28T18:50:54.578070] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-28T18:50:54.600598] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-28T18:50:54.680443] [DEBUG] [LOCAL ] FND: Trimmed 75095 records to 52022 (keeping 200 days of data) [2025-10-28T18:50:54.828075] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:55.074727] [DEBUG] [LOCAL ] FND: Primary data saved (52022 records). [2025-10-28T18:50:55.086294] [INFO ] [MAIN ] FND: Full history saved. [2025-10-28T18:50:55.087409] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FND took 1m 10s. Estimated remaining: 3h 15m 13s. Rate: 7.7 symbols/min [2025-10-28T18:50:55.110060] [DEBUG] [LOCAL ] FNV: Loaded 45932 existing records from primary storage. [2025-10-28T18:50:55.133054] [INFO ] [MAIN ] FNV: Loaded 45932 existing records. [2025-10-28T18:50:55.399048] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:55.466303] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:55.473345] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-28T18:50:55.473511] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-28T18:50:55.474598] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-28T18:50:55.474694] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-28T18:50:55.563274] [DEBUG] [LOCAL ] FOA: Loaded 12847 existing records from primary storage. [2025-10-28T18:50:55.586074] [INFO ] [MAIN ] FOA: Loaded 12847 existing records. [2025-10-28T18:50:55.975025] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:56.004988] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-28T18:50:56.010828] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-28T18:50:56.021447] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-28T18:50:56.026876] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-28T18:50:56.186730] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:50:56.216997] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-28T18:50:56.657023] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:50:56.657434] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-28T18:50:57.466034] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:50:57.474713] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-28T18:50:57.523523] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (21.60 seconds). [2025-10-28T18:50:57.533813] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-28T18:50:58.575625] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (32.57 seconds). [2025-10-28T18:50:58.585322] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-28T18:50:58.628724] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T18:50:58.636581] [INFO ] [REMOTE ] FMX: Full fetch complete (57856 records). [2025-10-28T18:50:58.636828] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-28T18:50:59.055099] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-28T18:50:59.055301] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-28T18:50:59.056309] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-28T18:50:59.056374] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-28T18:50:59.057709] [DEBUG] [LOCAL ] FMX: Trimmed 57856 records to 39942 (keeping 200 days of data) [2025-10-28T18:50:59.320422] [DEBUG] [LOCAL ] FMX: Primary data saved (39942 records). [2025-10-28T18:50:59.320558] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-28T18:50:59.320636] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FMX took 2m 1s. Estimated remaining: 3h 14m 59s. Rate: 7.7 symbols/min [2025-10-28T18:50:59.504427] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:59.514700] [DEBUG] [LOCAL ] FOF: Loaded 8138 existing records from primary storage. [2025-10-28T18:50:59.514936] [INFO ] [MAIN ] FOF: Loaded 8138 existing records. [2025-10-28T18:50:59.714325] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:59.714701] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-28T18:50:59.714892] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-28T18:50:59.715151] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-28T18:50:59.715233] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-28T18:50:59.864813] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T18:50:59.948378] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-28T18:51:00.129629] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:00.129961] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-28T18:51:01.237702] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:51:01.245408] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-28T18:51:02.449809] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:51:02.459151] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-28T18:51:08.214792] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (11.56 seconds). [2025-10-28T18:51:08.219752] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-28T18:51:09.122695] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (11.65 seconds). [2025-10-28T18:51:09.132801] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-28T18:51:10.256836] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (10.13 seconds). [2025-10-28T18:51:10.258928] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-28T18:51:10.713058] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T18:51:10.715162] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-28T18:51:11.192263] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T18:51:11.194346] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-28T18:51:13.795073] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-28T18:51:13.798056] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-28T18:51:14.284550] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T18:51:14.286935] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-28T18:51:14.735503] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T18:51:14.737716] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-28T18:51:17.436335] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-28T18:51:17.438771] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-28T18:51:17.989694] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T18:51:17.992219] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-28T18:51:18.485742] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T18:51:18.488579] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-28T18:51:18.993845] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (16.53 seconds). [2025-10-28T18:51:19.001696] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-28T18:51:19.043806] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T18:51:19.045911] [INFO ] [REMOTE ] FOF: Full fetch complete (11909 records). [2025-10-28T18:51:19.045980] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-28T18:51:19.419909] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-28T18:51:19.419983] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-28T18:51:19.420285] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-28T18:51:19.420349] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-28T18:51:19.420848] [DEBUG] [LOCAL ] FOF: Trimmed 11909 records to 8130 (keeping 200 days of data) [2025-10-28T18:51:19.469883] [DEBUG] [LOCAL ] FOF: Primary data saved (8130 records). [2025-10-28T18:51:19.470008] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-28T18:51:19.470086] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FOF took 20.1s. Estimated remaining: 3h 15m 13s. Rate: 7.7 symbols/min [2025-10-28T18:51:19.645680] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:51:19.664167] [DEBUG] [LOCAL ] FOR: Loaded 19027 existing records from primary storage. [2025-10-28T18:51:19.664394] [INFO ] [MAIN ] FOR: Loaded 19027 existing records. [2025-10-28T18:51:19.844616] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:51:19.844834] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-28T18:51:19.844882] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-28T18:51:19.845056] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-28T18:51:19.845111] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-28T18:51:20.205759] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:20.206106] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-28T18:51:20.225392] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:51:20.232791] [INFO ] [REMOTE ] FN: Full fetch complete (56441 records). [2025-10-28T18:51:20.233002] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-28T18:51:20.607439] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-28T18:51:20.607516] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-28T18:51:20.608395] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-28T18:51:20.608456] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-28T18:51:20.609564] [DEBUG] [LOCAL ] FN: Trimmed 56441 records to 36887 (keeping 200 days of data) [2025-10-28T18:51:20.829373] [DEBUG] [LOCAL ] FN: Primary data saved (36887 records). [2025-10-28T18:51:20.829514] [INFO ] [MAIN ] FN: Full history saved. [2025-10-28T18:51:20.829597] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FN took 1m 47s. Estimated remaining: 3h 14m 54s. Rate: 7.7 symbols/min [2025-10-28T18:51:20.998934] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:51:21.016574] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:51:21.022082] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-28T18:51:21.061753] [DEBUG] [LOCAL ] FOUR: Loaded 49574 existing records from primary storage. [2025-10-28T18:51:21.062042] [INFO ] [MAIN ] FOUR: Loaded 49574 existing records. [2025-10-28T18:51:21.242483] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:51:21.242733] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-28T18:51:21.242786] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-28T18:51:21.242970] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-28T18:51:21.243009] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-28T18:51:21.597818] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:21.598156] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-28T18:51:22.888903] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T18:51:22.898638] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-28T18:51:25.924486] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (17.70 seconds). [2025-10-28T18:51:25.928331] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-28T18:51:26.560508] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:51:26.564387] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-28T18:51:27.204237] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T18:51:27.207792] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-28T18:51:27.768899] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:51:27.772105] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-28T18:51:28.296210] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:51:28.299082] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-28T18:51:35.206898] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (26.07 seconds). [2025-10-28T18:51:35.216952] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-28T18:51:36.441196] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T18:51:36.452314] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-28T18:51:38.189027] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (15.29 seconds). [2025-10-28T18:51:38.198693] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-28T18:51:40.242709] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (19.22 seconds). [2025-10-28T18:51:40.247347] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-28T18:51:40.841335] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (12.54 seconds). [2025-10-28T18:51:40.844726] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-28T18:51:40.987429] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:51:40.992587] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-28T18:51:52.041734] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (13.84 seconds). [2025-10-28T18:51:52.052319] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-28T18:51:53.336752] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:51:53.350605] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (16.90 seconds). [2025-10-28T18:51:53.361005] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-28T18:51:53.362988] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-28T18:51:54.633093] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T18:51:54.644279] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-28T18:51:54.787474] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T18:51:54.797892] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-28T18:51:55.846049] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T18:51:55.855848] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-28T18:51:55.906941] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T18:51:55.916751] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-28T18:51:57.028458] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T18:51:57.039289] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-28T18:51:57.198169] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (16.35 seconds). [2025-10-28T18:51:57.201736] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-28T18:51:57.897071] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T18:51:57.901319] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-28T18:51:57.983316] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (16.99 seconds). [2025-10-28T18:51:57.989688] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-28T18:51:58.298108] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:51:58.307939] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-28T18:51:58.496114] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:51:58.499141] [INFO ] [REMOTE ] FOA: Full fetch complete (20542 records). [2025-10-28T18:51:58.499211] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-28T18:51:58.794530] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T18:51:58.815231] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-28T18:51:58.880918] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-28T18:51:58.880982] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-28T18:51:58.881396] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-28T18:51:58.881435] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-28T18:51:58.881981] [DEBUG] [LOCAL ] FOA: Trimmed 20542 records to 12715 (keeping 200 days of data) [2025-10-28T18:51:58.952026] [DEBUG] [LOCAL ] FOA: Primary data saved (12715 records). [2025-10-28T18:51:58.952144] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-28T18:51:58.952219] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FOA took 1m 4s. Estimated remaining: 3h 15m 39s. Rate: 7.7 symbols/min [2025-10-28T18:51:59.119692] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:51:59.138367] [DEBUG] [LOCAL ] FPF: Loaded 18490 existing records from primary storage. [2025-10-28T18:51:59.138581] [INFO ] [MAIN ] FPF: Loaded 18490 existing records. [2025-10-28T18:51:59.317760] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:51:59.317933] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-28T18:51:59.317995] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-28T18:51:59.318242] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-28T18:51:59.318301] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-28T18:51:59.679705] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:59.685295] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-28T18:51:59.694893] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:51:59.700419] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-28T18:51:59.730247] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T18:51:59.739746] [INFO ] [REMOTE ] FNV: Full fetch complete (66968 records). [2025-10-28T18:51:59.739900] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-28T18:52:00.115910] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-28T18:52:00.115981] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-28T18:52:00.116827] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-28T18:52:00.116889] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-28T18:52:00.118126] [DEBUG] [LOCAL ] FNV: Trimmed 66968 records to 45877 (keeping 200 days of data) [2025-10-28T18:52:00.412430] [DEBUG] [LOCAL ] FNV: Primary data saved (45877 records). [2025-10-28T18:52:00.412662] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-28T18:52:00.413749] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FNV took 1m 6s. Estimated remaining: 3h 15m 20s. Rate: 7.7 symbols/min [2025-10-28T18:52:00.424575] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:52:00.454483] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T18:52:00.473715] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-28T18:52:00.517571] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-28T18:52:00.611881] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:00.631507] [DEBUG] [LOCAL ] FPH: Loaded 19064 existing records from primary storage. [2025-10-28T18:52:00.631768] [INFO ] [MAIN ] FPH: Loaded 19064 existing records. [2025-10-28T18:52:00.806959] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:00.807118] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-28T18:52:00.807165] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-28T18:52:00.807370] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-28T18:52:00.807426] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-28T18:52:01.154723] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:01.155057] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-28T18:52:01.215687] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:52:01.219505] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-28T18:52:01.343580] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T18:52:01.347969] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-28T18:52:01.849758] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:52:01.853932] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-28T18:52:01.932383] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T18:52:01.938472] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-28T18:52:02.696073] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:52:02.702296] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-28T18:52:02.822424] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T18:52:02.828915] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-28T18:52:03.396917] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T18:52:03.401469] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-28T18:52:03.702204] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:52:03.708276] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-28T18:52:04.138297] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:52:04.143210] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-28T18:52:04.653836] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T18:52:04.658901] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-28T18:52:04.797266] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T18:52:04.801840] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-28T18:52:05.331137] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T18:52:05.335292] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-28T18:52:05.475329] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:52:05.479707] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-28T18:52:06.016577] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T18:52:06.020561] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-28T18:52:06.143440] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T18:52:06.148084] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-28T18:52:06.706676] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:52:06.712112] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-28T18:52:07.156312] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T18:52:07.161113] [INFO ] [REMOTE ] FPF: Full fetch complete (26578 records). [2025-10-28T18:52:07.161185] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-28T18:52:07.523026] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-28T18:52:07.523103] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-28T18:52:07.523774] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-28T18:52:07.523835] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-28T18:52:07.524499] [DEBUG] [LOCAL ] FPF: Trimmed 26578 records to 18437 (keeping 200 days of data) [2025-10-28T18:52:07.631407] [DEBUG] [LOCAL ] FPF: Primary data saved (18437 records). [2025-10-28T18:52:07.631542] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-28T18:52:07.631620] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FPF took 8.7s. Estimated remaining: 3h 15m 12s. Rate: 7.7 symbols/min [2025-10-28T18:52:07.797780] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:07.829393] [DEBUG] [LOCAL ] FPI: Loaded 31057 existing records from primary storage. [2025-10-28T18:52:07.829703] [INFO ] [MAIN ] FPI: Loaded 31057 existing records. [2025-10-28T18:52:08.007317] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:08.007551] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-28T18:52:08.007598] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-28T18:52:08.007835] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-28T18:52:08.007893] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-28T18:52:08.360954] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:08.361274] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-28T18:52:09.177123] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:52:09.184238] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-28T18:52:09.924856] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:52:09.930587] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-28T18:52:09.997733] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (14.14 seconds). [2025-10-28T18:52:10.007983] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-28T18:52:10.996750] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:52:11.003276] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-28T18:52:11.926170] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:52:11.933243] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-28T18:52:12.893971] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T18:52:12.901246] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-28T18:52:13.563732] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (12.22 seconds). [2025-10-28T18:52:13.568356] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-28T18:52:13.862832] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T18:52:13.869604] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-28T18:52:14.292301] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T18:52:14.295734] [INFO ] [REMOTE ] FOR: Full fetch complete (29424 records). [2025-10-28T18:52:14.295807] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-28T18:52:14.681706] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-28T18:52:14.681787] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-28T18:52:14.682358] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-28T18:52:14.682417] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-28T18:52:14.683160] [DEBUG] [LOCAL ] FOR: Trimmed 29424 records to 18946 (keeping 200 days of data) [2025-10-28T18:52:14.789009] [DEBUG] [LOCAL ] FOR: Primary data saved (18946 records). [2025-10-28T18:52:14.789133] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-28T18:52:14.789211] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FOR took 55.3s. Estimated remaining: 3h 15m 3s. Rate: 7.7 symbols/min [2025-10-28T18:52:14.905820] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (8.19 seconds). [2025-10-28T18:52:14.932137] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-28T18:52:14.987222] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T18:52:15.007150] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:15.014899] [DEBUG] [LOCAL ] FR: No existing data file found in primary storage. [2025-10-28T18:52:15.014982] [WARN ] [MAIN ] FR: No existing data found, performing full refresh instead. [2025-10-28T18:52:15.015631] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-28T18:52:15.015326] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-28T18:52:15.015846] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-28T18:52:15.016723] [DEBUG] [LOCAL ] FR: No primary data file found to delete. [2025-10-28T18:52:15.016770] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-28T18:52:15.399016] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:15.399330] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-28T18:52:15.707441] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T18:52:15.712123] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-28T18:52:16.011601] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T18:52:16.018082] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-28T18:52:16.424564] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:52:16.433407] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-28T18:52:16.516921] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:52:16.520942] [INFO ] [REMOTE ] FPH: Full fetch complete (30816 records). [2025-10-28T18:52:16.521023] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-28T18:52:16.884182] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-28T18:52:16.884258] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-28T18:52:16.884841] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-28T18:52:16.884900] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-28T18:52:16.885585] [DEBUG] [LOCAL ] FPH: Trimmed 30816 records to 19084 (keeping 200 days of data) [2025-10-28T18:52:16.989979] [DEBUG] [LOCAL ] FPH: Primary data saved (19084 records). [2025-10-28T18:52:16.990111] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-28T18:52:16.990192] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FPH took 16.6s. Estimated remaining: 3h 14m 45s. Rate: 7.7 symbols/min [2025-10-28T18:52:17.158029] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:17.173214] [DEBUG] [LOCAL ] FRA: Loaded 13514 existing records from primary storage. [2025-10-28T18:52:17.173481] [INFO ] [MAIN ] FRA: Loaded 13514 existing records. [2025-10-28T18:52:17.345435] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:17.345662] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-28T18:52:17.345738] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-28T18:52:17.346016] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-28T18:52:17.346084] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-28T18:52:17.731508] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:17.732095] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-28T18:52:17.755557] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:52:17.764713] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-28T18:52:18.613960] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:52:18.619857] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-28T18:52:18.958533] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:52:18.968433] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-28T18:52:19.144308] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (9.14 seconds). [2025-10-28T18:52:19.155574] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-28T18:52:19.773826] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (3.76 seconds). [2025-10-28T18:52:19.780565] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-28T18:52:20.271423] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:52:20.281815] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-28T18:52:20.543371] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:52:20.554246] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-28T18:52:20.705854] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-28T18:52:20.712412] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-28T18:52:20.955556] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T18:52:20.961744] [INFO ] [REMOTE ] FPI: Full fetch complete (43618 records). [2025-10-28T18:52:20.961838] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-28T18:52:21.332520] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-28T18:52:21.332677] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-28T18:52:21.333347] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-28T18:52:21.333388] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-28T18:52:21.334324] [DEBUG] [LOCAL ] FPI: Trimmed 43618 records to 30983 (keeping 200 days of data) [2025-10-28T18:52:21.433821] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T18:52:21.450191] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-28T18:52:21.539902] [DEBUG] [LOCAL ] FPI: Primary data saved (30983 records). [2025-10-28T18:52:21.540038] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-28T18:52:21.540136] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FPI took 13.9s. Estimated remaining: 3h 14m 32s. Rate: 7.7 symbols/min [2025-10-28T18:52:21.707059] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:21.723341] [DEBUG] [LOCAL ] FRGE: Loaded 15237 existing records from primary storage. [2025-10-28T18:52:21.723774] [INFO ] [MAIN ] FRGE: Loaded 15237 existing records. [2025-10-28T18:52:21.898309] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:21.898614] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-28T18:52:21.898696] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-28T18:52:21.898879] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-28T18:52:21.898918] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-28T18:52:22.249270] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:22.249584] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-28T18:52:22.260887] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T18:52:22.265211] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-28T18:52:22.812424] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T18:52:22.815904] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-28T18:52:23.259746] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:52:23.266989] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-28T18:52:23.438816] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (3.16 seconds). [2025-10-28T18:52:23.449091] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-28T18:52:23.546674] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T18:52:23.550623] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-28T18:52:24.201415] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:52:24.208297] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-28T18:52:24.512348] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:52:24.522455] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-28T18:52:24.789721] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T18:52:24.793415] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-28T18:52:25.162029] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T18:52:25.168537] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-28T18:52:25.317234] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:52:25.320374] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-28T18:52:25.843396] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (5.29 seconds). [2025-10-28T18:52:25.854359] [INFO ] [REMOTE ] FOUR: Full fetch complete (72269 records). [2025-10-28T18:52:25.854514] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-28T18:52:26.013379] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:52:26.033518] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-28T18:52:26.246990] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T18:52:26.293740] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-28T18:52:26.311697] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-28T18:52:26.311757] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-28T18:52:26.312611] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-28T18:52:26.313114] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-28T18:52:26.314552] [DEBUG] [LOCAL ] FOUR: Trimmed 72269 records to 49590 (keeping 200 days of data) [2025-10-28T18:52:26.601233] [DEBUG] [LOCAL ] FOUR: Primary data saved (49590 records). [2025-10-28T18:52:26.601357] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-28T18:52:26.601433] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FOUR took 1m 6s. Estimated remaining: 3h 14m 19s. Rate: 7.7 symbols/min [2025-10-28T18:52:26.769354] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:26.815856] [DEBUG] [LOCAL ] FRO: Loaded 51628 existing records from primary storage. [2025-10-28T18:52:26.816146] [INFO ] [MAIN ] FRO: Loaded 51628 existing records. [2025-10-28T18:52:26.997887] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:26.998616] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-28T18:52:27.006507] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-28T18:52:27.007711] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T18:52:27.007387] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-28T18:52:27.011146] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-28T18:52:27.011286] [INFO ] [REMOTE ] FRA: Full fetch complete (23022 records). [2025-10-28T18:52:27.022591] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-28T18:52:27.312472] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-28T18:52:27.499734] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-28T18:52:27.587121] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:52:27.684531] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-28T18:52:27.727295] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:27.748341] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-28T18:52:27.805771] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-28T18:52:27.805851] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-28T18:52:27.806347] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-28T18:52:27.806384] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-28T18:52:27.807053] [DEBUG] [LOCAL ] FRA: Trimmed 23022 records to 13295 (keeping 200 days of data) [2025-10-28T18:52:27.884918] [DEBUG] [LOCAL ] FRA: Primary data saved (13295 records). [2025-10-28T18:52:27.885036] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-28T18:52:27.885110] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FRA took 10.9s. Estimated remaining: 3h 14m 0s. Rate: 7.7 symbols/min [2025-10-28T18:52:28.047279] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:28.085114] [DEBUG] [LOCAL ] FRT: Loaded 41110 existing records from primary storage. [2025-10-28T18:52:28.085385] [INFO ] [MAIN ] FRT: Loaded 41110 existing records. [2025-10-28T18:52:28.257112] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:28.257354] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-28T18:52:28.257400] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-28T18:52:28.257834] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-28T18:52:28.257890] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-28T18:52:28.419959] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:52:28.485307] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-28T18:52:28.620433] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:28.620710] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-28T18:52:28.748799] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:52:28.757804] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-28T18:52:29.204467] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:52:29.208442] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-28T18:52:29.285361] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T18:52:29.295339] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-28T18:52:29.870201] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:52:29.874379] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-28T18:52:30.018745] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:52:30.029716] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-28T18:52:30.375816] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T18:52:30.384849] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-28T18:52:30.393960] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:52:30.397280] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-28T18:52:30.781713] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T18:52:30.791846] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-28T18:52:31.304828] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:52:31.307939] [INFO ] [REMOTE ] FRGE: Full fetch complete (29641 records). [2025-10-28T18:52:31.308041] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-28T18:52:31.706940] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-28T18:52:31.707115] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-28T18:52:31.707825] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-28T18:52:31.708037] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-28T18:52:31.718093] [DEBUG] [LOCAL ] FRGE: Trimmed 29641 records to 15273 (keeping 200 days of data) [2025-10-28T18:52:31.735474] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:52:31.810145] [INFO ] [REMOTE ] FR: Full fetch complete (67453 records). [2025-10-28T18:52:31.810885] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-28T18:52:31.921102] [DEBUG] [LOCAL ] FRGE: Primary data saved (15273 records). [2025-10-28T18:52:31.932269] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-28T18:52:31.940549] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRGE took 10.4s. Estimated remaining: 3h 13m 46s. Rate: 7.7 symbols/min [2025-10-28T18:52:32.177757] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T18:52:32.283575] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-28T18:52:32.342215] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:32.448914] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-28T18:52:32.448993] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-28T18:52:32.449794] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-28T18:52:32.449873] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-28T18:52:32.460053] [DEBUG] [LOCAL ] FR: Trimmed 67453 records to 46483 (keeping 200 days of data) [2025-10-28T18:52:32.560959] [DEBUG] [LOCAL ] FSCO: Loaded 38336 existing records from primary storage. [2025-10-28T18:52:32.563113] [INFO ] [MAIN ] FSCO: Loaded 38336 existing records. [2025-10-28T18:52:32.779699] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:32.832341] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-28T18:52:32.832601] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-28T18:52:32.870338] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-28T18:52:32.870449] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-28T18:52:33.243504] [DEBUG] [LOCAL ] FR: Primary data saved (46483 records). [2025-10-28T18:52:33.259501] [INFO ] [MAIN ] FR: Full history saved. [2025-10-28T18:52:33.259681] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FR took 18.5s. Estimated remaining: 3h 13m 27s. Rate: 7.7 symbols/min [2025-10-28T18:52:33.376818] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:33.377168] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-28T18:52:33.507128] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-28T18:52:33.542189] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:33.543527] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-28T18:52:33.571423] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:52:33.581757] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-28T18:52:33.618841] [DEBUG] [LOCAL ] FSK: Loaded 49397 existing records from primary storage. [2025-10-28T18:52:33.619153] [INFO ] [MAIN ] FSK: Loaded 49397 existing records. [2025-10-28T18:52:33.790999] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:33.791142] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-28T18:52:33.791186] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-28T18:52:33.791981] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-28T18:52:33.792038] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-28T18:52:34.134149] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:34.134432] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-28T18:52:34.520595] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:52:34.529059] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-28T18:52:34.747984] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:52:34.757790] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-28T18:52:34.902541] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:52:34.919078] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-28T18:52:35.198769] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T18:52:35.214376] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-28T18:52:35.430753] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:52:35.443056] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-28T18:52:35.730222] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T18:52:35.740782] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-28T18:52:36.148964] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:52:36.160112] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-28T18:52:36.578575] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T18:52:36.588083] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-28T18:52:36.858225] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:52:36.866433] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-28T18:52:37.511531] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T18:52:37.518984] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-28T18:52:37.704670] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T18:52:37.717434] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-28T18:52:37.779866] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:52:37.790479] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-28T18:52:38.057617] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:52:38.067332] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-28T18:52:38.527755] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T18:52:38.536583] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-28T18:52:39.064290] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:52:39.075446] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-28T18:52:39.238265] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T18:52:39.249569] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-28T18:52:39.394086] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:52:39.403238] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-28T18:52:40.202298] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T18:52:40.212458] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-28T18:52:40.332747] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:52:40.340756] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-28T18:52:40.498583] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-28T18:52:40.510737] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-28T18:52:40.772150] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T18:52:40.783995] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-28T18:52:41.279460] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:52:41.290133] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-28T18:52:41.701889] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:52:41.710712] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-28T18:52:42.017110] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T18:52:42.025709] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-28T18:52:42.115181] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:52:42.125978] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-28T18:52:42.948114] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:52:42.956261] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-28T18:52:43.241264] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-28T18:52:43.252559] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-28T18:52:43.781017] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:52:43.791507] [INFO ] [REMOTE ] FRO: Full fetch complete (75318 records). [2025-10-28T18:52:43.791674] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-28T18:52:43.914736] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-28T18:52:43.949586] [INFO ] [REMOTE ] FRT: Full fetch complete (60377 records). [2025-10-28T18:52:43.972247] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-28T18:52:44.403204] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-28T18:52:44.423759] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-28T18:52:44.424857] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-28T18:52:44.433164] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-28T18:52:44.516738] [DEBUG] [LOCAL ] FRO: Trimmed 75318 records to 51591 (keeping 200 days of data) [2025-10-28T18:52:44.723785] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-28T18:52:44.741620] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-28T18:52:44.755088] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-28T18:52:44.755377] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-28T18:52:44.767512] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T18:52:44.775936] [DEBUG] [LOCAL ] FRT: Trimmed 60377 records to 41037 (keeping 200 days of data) [2025-10-28T18:52:44.795956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-28T18:52:45.198903] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-28T18:52:45.297740] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-28T18:52:45.306618] [DEBUG] [LOCAL ] FRO: Primary data saved (51591 records). [2025-10-28T18:52:45.312722] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-28T18:52:45.314784] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 18.7s. Estimated remaining: 3h 13m 27s. Rate: 7.7 symbols/min [2025-10-28T18:52:45.408344] [DEBUG] [LOCAL ] FRT: Primary data saved (41037 records). [2025-10-28T18:52:45.424230] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-28T18:52:45.433038] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FRT took 17.5s. Estimated remaining: 3h 13m 6s. Rate: 7.7 symbols/min [2025-10-28T18:52:45.632513] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:45.704627] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:45.749476] [DEBUG] [LOCAL ] FSLY: Loaded 51237 existing records from primary storage. [2025-10-28T18:52:45.749872] [INFO ] [MAIN ] FSLY: Loaded 51237 existing records. [2025-10-28T18:52:45.938166] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-28T18:52:45.960032] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:45.957038] [INFO ] [MAIN ] FSM: Loaded 53298 existing records. [2025-10-28T18:52:45.991157] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-28T18:52:45.996539] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-28T18:52:46.029498] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-28T18:52:46.035712] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-28T18:52:46.271163] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:46.290035] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-28T18:52:46.300317] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-28T18:52:46.309228] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-28T18:52:46.313921] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-28T18:52:46.597568] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T18:52:46.638488] [INFO ] [REMOTE ] FSCO: Full fetch complete (55335 records). [2025-10-28T18:52:46.703611] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-28T18:52:46.768085] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:46.809607] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-28T18:52:47.216670] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:47.224589] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-28T18:52:47.380177] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-28T18:52:47.419852] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-28T18:52:47.434565] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-28T18:52:47.435616] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-28T18:52:47.436440] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-28T18:52:47.436629] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-28T18:52:47.438039] [DEBUG] [LOCAL ] FSCO: Trimmed 55335 records to 38332 (keeping 200 days of data) [2025-10-28T18:52:47.660035] [DEBUG] [LOCAL ] FSCO: Primary data saved (38332 records). [2025-10-28T18:52:47.660199] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-28T18:52:47.660285] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSCO took 15.7s. Estimated remaining: 3h 12m 49s. Rate: 7.7 symbols/min [2025-10-28T18:52:47.843920] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:47.875295] [DEBUG] [LOCAL ] FSS: Loaded 32611 existing records from primary storage. [2025-10-28T18:52:47.875583] [INFO ] [MAIN ] FSS: Loaded 32611 existing records. [2025-10-28T18:52:48.061150] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:48.061503] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-28T18:52:48.061568] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-28T18:52:48.062206] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-28T18:52:48.062266] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-28T18:52:48.438477] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:48.439017] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-28T18:52:48.469673] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-28T18:52:48.480527] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-28T18:52:48.510510] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T18:52:48.520618] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-28T18:52:48.814758] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:52:48.825246] [INFO ] [REMOTE ] FSK: Full fetch complete (72136 records). [2025-10-28T18:52:48.825356] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-28T18:52:49.211084] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-28T18:52:49.211155] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-28T18:52:49.212063] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-28T18:52:49.212124] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-28T18:52:49.213744] [DEBUG] [LOCAL ] FSK: Trimmed 72136 records to 49374 (keeping 200 days of data) [2025-10-28T18:52:49.364256] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:52:49.421443] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-28T18:52:49.547722] [DEBUG] [LOCAL ] FSK: Primary data saved (49374 records). [2025-10-28T18:52:49.547872] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-28T18:52:49.548004] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSK took 16.3s. Estimated remaining: 3h 12m 31s. Rate: 7.7 symbols/min [2025-10-28T18:52:49.722854] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:49.755462] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:52:49.755733] [DEBUG] [LOCAL ] FT: Loaded 6749 existing records from primary storage. [2025-10-28T18:52:49.765362] [INFO ] [MAIN ] FT: Loaded 6749 existing records. [2025-10-28T18:52:49.819944] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-28T18:52:49.948050] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:49.948364] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-28T18:52:49.948420] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-28T18:52:49.948736] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-28T18:52:49.948794] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-28T18:52:50.322682] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:50.323154] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-28T18:52:50.350222] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:52:50.356919] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-28T18:52:50.418143] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T18:52:50.428361] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-28T18:52:50.747124] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T18:52:50.748960] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-28T18:52:51.170243] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T18:52:51.171954] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-28T18:52:51.421672] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:52:51.429969] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-28T18:52:51.721222] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:52:51.732178] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-28T18:52:51.948828] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T18:52:51.950508] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-28T18:52:52.327908] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-28T18:52:52.338788] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-28T18:52:52.624629] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:52:52.634016] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-28T18:52:52.924681] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T18:52:52.926861] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-28T18:52:52.981363] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:52:52.992162] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-28T18:52:53.384750] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T18:52:53.387037] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-28T18:52:53.640800] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:52:53.651981] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-28T18:52:54.213137] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T18:52:54.224165] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-28T18:52:54.799115] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-28T18:52:54.807263] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-28T18:52:54.895796] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:52:54.897480] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-28T18:52:54.942162] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:52:54.953577] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-28T18:52:55.456943] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:52:55.459006] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-28T18:52:55.575188] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:52:55.585564] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-28T18:52:55.738750] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:52:55.745816] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-28T18:52:55.961139] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T18:52:55.963556] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-28T18:52:56.232867] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T18:52:56.243897] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-28T18:52:56.712135] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:52:56.714415] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-28T18:52:56.859309] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T18:52:56.870960] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-28T18:52:57.306940] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:52:57.309346] [INFO ] [REMOTE ] FT: Full fetch complete (9383 records). [2025-10-28T18:52:57.309505] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-28T18:52:57.698166] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-28T18:52:57.698262] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-28T18:52:57.698594] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-28T18:52:57.698719] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-28T18:52:57.699399] [DEBUG] [LOCAL ] FT: Trimmed 9383 records to 6758 (keeping 200 days of data) [2025-10-28T18:52:57.759485] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T18:52:57.779910] [DEBUG] [LOCAL ] FT: Primary data saved (6758 records). [2025-10-28T18:52:57.780109] [INFO ] [MAIN ] FT: Full history saved. [2025-10-28T18:52:57.780192] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FT took 8.2s. Estimated remaining: 3h 12m 24s. Rate: 7.7 symbols/min [2025-10-28T18:52:57.791898] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-28T18:52:57.954049] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:57.965818] [DEBUG] [LOCAL ] FTHY: Loaded 12001 existing records from primary storage. [2025-10-28T18:52:57.966140] [INFO ] [MAIN ] FTHY: Loaded 12001 existing records. [2025-10-28T18:52:58.142515] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:58.142832] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-28T18:52:58.143034] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-28T18:52:58.143407] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-28T18:52:58.143519] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-28T18:52:58.316670] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T18:52:58.414942] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-28T18:52:58.574924] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-28T18:52:58.579412] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:58.579899] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-28T18:52:58.589779] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-28T18:52:59.230512] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:52:59.243204] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-28T18:52:59.438728] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:52:59.445482] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-28T18:52:59.787371] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:52:59.798482] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-28T18:53:00.283299] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T18:53:00.282925] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T18:53:00.561142] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-28T18:53:00.638824] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T18:53:01.167307] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:53:01.361173] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-28T18:53:01.716118] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T18:53:01.727332] [INFO ] [REMOTE ] FSLY: Full fetch complete (74840 records). [2025-10-28T18:53:01.727499] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-28T18:53:02.118227] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-28T18:53:02.118317] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-28T18:53:02.119375] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-28T18:53:02.119440] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-28T18:53:02.120955] [DEBUG] [LOCAL ] FSLY: Trimmed 74840 records to 51200 (keeping 200 days of data) [2025-10-28T18:53:02.167409] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-28T18:53:02.413729] [DEBUG] [LOCAL ] FSLY: Primary data saved (51200 records). [2025-10-28T18:53:02.413879] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-28T18:53:02.413992] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FSLY took 17.1s. Estimated remaining: 3h 12m 11s. Rate: 7.8 symbols/min [2025-10-28T18:53:02.583934] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:02.632873] [DEBUG] [LOCAL ] FTI: Loaded 53292 existing records from primary storage. [2025-10-28T18:53:02.633281] [INFO ] [MAIN ] FTI: Loaded 53292 existing records. [2025-10-28T18:53:02.746760] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:53:02.777501] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:53:02.776404] [INFO ] [REMOTE ] FSS: Full fetch complete (48340 records). [2025-10-28T18:53:02.783494] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-28T18:53:02.964741] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-28T18:53:02.964606] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:02.976120] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-28T18:53:02.988435] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-28T18:53:02.999841] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-28T18:53:03.018832] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-28T18:53:03.549145] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-28T18:53:03.554519] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-28T18:53:03.555480] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-28T18:53:03.555615] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-28T18:53:03.661847] [DEBUG] [LOCAL ] FSS: Trimmed 48340 records to 32538 (keeping 200 days of data) [2025-10-28T18:53:03.666109] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:03.739029] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:53:03.768522] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-28T18:53:03.885959] [DEBUG] [LOCAL ] FSS: Primary data saved (32538 records). [2025-10-28T18:53:03.886105] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-28T18:53:03.886190] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FSS took 16.2s. Estimated remaining: 3h 11m 53s. Rate: 7.8 symbols/min [2025-10-28T18:53:04.561141] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-28T18:53:05.361190] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-28T18:53:05.863106] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T18:53:06.161216] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-28T18:53:06.685222] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:53:06.961118] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-28T18:53:07.519134] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:53:07.538955] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (3.77 seconds). [2025-10-28T18:53:07.550491] [INFO ] [REMOTE ] FSM: Full fetch complete (77222 records). [2025-10-28T18:53:07.550632] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-28T18:53:07.772773] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-28T18:53:07.950805] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-28T18:53:07.950887] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-28T18:53:07.951848] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-28T18:53:07.951909] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-28T18:53:07.953371] [DEBUG] [LOCAL ] FSM: Trimmed 77222 records to 53298 (keeping 200 days of data) [2025-10-28T18:53:08.260369] [DEBUG] [LOCAL ] FSM: Primary data saved (53298 records). [2025-10-28T18:53:08.260512] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-28T18:53:08.260592] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FSM took 22.8s. Estimated remaining: 3h 11m 39s. Rate: 7.8 symbols/min [2025-10-28T18:53:08.433582] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:53:08.561138] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-28T18:53:09.021430] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (4.46 seconds). [2025-10-28T18:53:09.194170] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:53:09.361116] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-28T18:53:10.132546] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:53:10.135711] [INFO ] [REMOTE ] FTHY: Full fetch complete (17244 records). [2025-10-28T18:53:10.135785] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-28T18:53:10.169610] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-28T18:53:10.522637] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-28T18:53:10.522757] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-28T18:53:10.523130] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-28T18:53:10.523169] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-28T18:53:10.523957] [DEBUG] [LOCAL ] FTHY: Trimmed 17244 records to 11966 (keeping 200 days of data) [2025-10-28T18:53:10.594982] [DEBUG] [LOCAL ] FTHY: Primary data saved (11966 records). [2025-10-28T18:53:10.595118] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-28T18:53:10.595195] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTHY took 12.8s. Estimated remaining: 3h 11m 23s. Rate: 7.8 symbols/min [2025-10-28T18:53:13.030892] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-28T18:53:13.040999] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-28T18:53:14.449909] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:53:14.464302] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-28T18:53:17.523078] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (3.06 seconds). [2025-10-28T18:53:17.534700] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-28T18:53:19.032197] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:53:19.044426] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-28T18:53:20.425377] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T18:53:20.437045] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-28T18:53:21.758538] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:53:21.770413] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-28T18:53:23.251678] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:53:23.263059] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-28T18:53:24.462883] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:53:24.474098] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-28T18:53:26.070077] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:53:26.080823] [INFO ] [REMOTE ] FTI: Full fetch complete (77335 records). [2025-10-28T18:53:26.080974] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-28T18:53:26.468102] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-28T18:53:26.468183] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-28T18:53:26.469143] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-28T18:53:26.469207] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-28T18:53:26.470605] [DEBUG] [LOCAL ] FTI: Trimmed 77335 records to 53291 (keeping 200 days of data) [2025-10-28T18:53:26.782500] [DEBUG] [LOCAL ] FTI: Primary data saved (53291 records). [2025-10-28T18:53:26.782625] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-28T18:53:26.782738] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTI took 24.4s. Estimated remaining: 3h 11m 29s. Rate: 7.8 symbols/min [2025-10-28T18:53:27.384138] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.501301] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.494589] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.527693] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.533387] [DEBUG] [LOCAL ] FTWO: Loaded 1917 existing records from primary storage. [2025-10-28T18:53:27.533724] [INFO ] [MAIN ] FTWO: Loaded 1917 existing records. [2025-10-28T18:53:27.782345] [DEBUG] [LOCAL ] FTK: Loaded 33051 existing records from primary storage. [2025-10-28T18:53:27.783634] [DEBUG] [LOCAL ] FTS: Loaded 42295 existing records from primary storage. [2025-10-28T18:53:27.781406] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:27.798034] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-28T18:53:27.798166] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-28T18:53:27.797976] [INFO ] [MAIN ] FTK: Loaded 33051 existing records. [2025-10-28T18:53:27.798458] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-28T18:53:27.798573] [INFO ] [MAIN ] FTS: Loaded 42295 existing records. [2025-10-28T18:53:27.799221] [DEBUG] [LOCAL ] FTV: Loaded 52997 existing records from primary storage. [2025-10-28T18:53:27.799407] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-28T18:53:27.841357] [INFO ] [MAIN ] FTV: Loaded 52997 existing records. [2025-10-28T18:53:28.408875] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:28.483174] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:28.490168] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-28T18:53:28.490337] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-28T18:53:28.514044] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-28T18:53:28.505028] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-28T18:53:28.553639] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-28T18:53:28.596907] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-28T18:53:28.565509] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-28T18:53:28.618078] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-28T18:53:28.612805] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:28.654837] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-28T18:53:28.655111] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-28T18:53:28.724230] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-28T18:53:28.770576] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-28T18:53:28.977929] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.020910] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-28T18:53:29.760477] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.773898] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-28T18:53:29.823671] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.831585] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-28T18:53:29.830406] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:53:29.865961] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.866271] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-28T18:53:29.838062] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-28T18:53:30.173125] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T18:53:30.174453] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-28T18:53:30.538528] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:53:30.539917] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-28T18:53:30.815567] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T18:53:30.816905] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-28T18:53:30.947963] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:53:30.956443] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-28T18:53:31.002731] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:53:31.014453] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-28T18:53:31.018149] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-28T18:53:31.019301] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-28T18:53:31.368548] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T18:53:31.369755] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-28T18:53:31.676553] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T18:53:31.677700] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-28T18:53:31.929427] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-28T18:53:31.934711] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-28T18:53:32.016075] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:53:32.024140] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-28T18:53:32.127424] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:53:32.128561] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-28T18:53:32.243683] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:53:32.253836] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-28T18:53:32.424465] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T18:53:32.425607] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-28T18:53:32.600736] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T18:53:32.605041] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-28T18:53:32.919382] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:53:32.920460] [INFO ] [REMOTE ] FTWO: Full fetch complete (3300 records). [2025-10-28T18:53:32.920526] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-28T18:53:33.299372] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-28T18:53:33.306968] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-28T18:53:33.307104] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-28T18:53:33.307174] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-28T18:53:33.308751] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:53:33.308972] [DEBUG] [LOCAL ] FTWO: Trimmed 3300 records to 1923 (keeping 200 days of data) [2025-10-28T18:53:33.317882] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-28T18:53:33.330199] [DEBUG] [LOCAL ] FTWO: Primary data saved (1923 records). [2025-10-28T18:53:33.330275] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-28T18:53:33.330370] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 6.5s. Estimated remaining: 3h 11m 19s. Rate: 7.8 symbols/min [2025-10-28T18:53:33.508571] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:33.557130] [DEBUG] [LOCAL ] FUBO: Loaded 53714 existing records from primary storage. [2025-10-28T18:53:33.557450] [INFO ] [MAIN ] FUBO: Loaded 53714 existing records. [2025-10-28T18:53:33.739104] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:33.739333] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-28T18:53:33.739533] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-28T18:53:33.739823] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-28T18:53:33.739946] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-28T18:53:34.001007] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-28T18:53:34.072006] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-28T18:53:34.150127] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:34.161120] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-28T18:53:34.811588] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-28T18:53:34.961113] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-28T18:53:35.470445] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:53:35.761154] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-28T18:53:35.868468] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T18:53:36.561130] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-28T18:53:37.074396] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:53:37.114920] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (3.80 seconds). [2025-10-28T18:53:37.361167] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-28T18:53:38.161201] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-28T18:53:38.422205] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-10-28T18:53:38.541855] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-28T18:53:38.961096] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-28T18:53:39.372605] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:53:39.761184] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-28T18:53:39.836060] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-28T18:53:40.561157] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-28T18:53:40.747192] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-28T18:53:41.361118] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-28T18:53:41.601004] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:53:42.161110] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-28T18:53:42.376309] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-28T18:53:42.961129] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-28T18:53:43.706366] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-28T18:53:43.760499] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T18:53:43.770724] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-28T18:53:43.884437] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:53:44.561129] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-28T18:53:45.361105] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-28T18:53:45.912450] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-28T18:53:46.161172] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-28T18:53:46.732044] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-28T18:53:46.961102] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-28T18:53:47.184322] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T18:53:47.282592] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T18:53:47.761172] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-28T18:53:48.396410] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T18:53:48.561155] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-28T18:53:48.728362] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:53:49.361183] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-28T18:53:50.161142] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-28T18:53:50.493554] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:53:50.535239] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-28T18:53:50.961177] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-28T18:53:51.761141] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-28T18:53:52.367120] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-28T18:53:52.561123] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-28T18:53:52.919799] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-28T18:53:53.090363] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T18:53:53.097321] [INFO ] [REMOTE ] FTK: Full fetch complete (44122 records). [2025-10-28T18:53:53.097479] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-28T18:53:53.367704] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-28T18:53:53.491608] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-28T18:53:53.491760] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-28T18:53:53.492895] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-28T18:53:53.492973] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-28T18:53:53.494239] [DEBUG] [LOCAL ] FTK: Trimmed 44122 records to 33060 (keeping 200 days of data) [2025-10-28T18:53:53.693931] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:53:53.725117] [DEBUG] [LOCAL ] FTK: Primary data saved (33060 records). [2025-10-28T18:53:53.725498] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-28T18:53:53.725601] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FTK took 26.9s. Estimated remaining: 3h 11m 33s. Rate: 7.7 symbols/min [2025-10-28T18:53:53.893684] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:53.923525] [DEBUG] [LOCAL ] FUL: Loaded 31762 existing records from primary storage. [2025-10-28T18:53:53.923842] [INFO ] [MAIN ] FUL: Loaded 31762 existing records. [2025-10-28T18:53:54.097874] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:54.098081] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-28T18:53:54.098129] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-28T18:53:54.098499] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-28T18:53:54.098543] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-28T18:53:54.166290] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-28T18:53:54.451060] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:54.961189] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-28T18:53:55.100614] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T18:53:55.761105] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-28T18:53:55.918585] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:53:56.561110] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-28T18:53:56.646938] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-28T18:53:57.097416] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:53:57.106178] [INFO ] [REMOTE ] FTS: Full fetch complete (60953 records). [2025-10-28T18:53:57.106302] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-28T18:53:57.366391] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-28T18:53:57.502996] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-28T18:53:57.503101] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-28T18:53:57.504013] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-28T18:53:57.504083] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-28T18:53:57.505412] [DEBUG] [LOCAL ] FTS: Trimmed 60953 records to 42265 (keeping 200 days of data) [2025-10-28T18:53:57.756833] [DEBUG] [LOCAL ] FTS: Primary data saved (42265 records). [2025-10-28T18:53:57.756971] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-28T18:53:57.757046] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FTS took 31.0s. Estimated remaining: 3h 11m 19s. Rate: 7.8 symbols/min [2025-10-28T18:53:57.927937] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:57.959306] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:53:57.970290] [INFO ] [REMOTE ] FTV: Full fetch complete (76624 records). [2025-10-28T18:53:57.970498] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-28T18:53:58.178052] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-28T18:53:58.229563] [DEBUG] [LOCAL ] FUN: Loaded 52033 existing records from primary storage. [2025-10-28T18:53:58.263507] [INFO ] [MAIN ] FUN: Loaded 52033 existing records. [2025-10-28T18:53:58.598674] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-28T18:53:58.598829] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-28T18:53:58.598363] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:58.599267] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-28T18:53:58.600366] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-28T18:53:58.600452] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-28T18:53:58.600532] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-28T18:53:58.601010] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-28T18:53:58.601069] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-28T18:53:58.700448] [DEBUG] [LOCAL ] FTV: Trimmed 76624 records to 52998 (keeping 200 days of data) [2025-10-28T18:53:58.960815] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T18:53:59.027318] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-28T18:53:59.181031] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:59.318550] [DEBUG] [LOCAL ] FTV: Primary data saved (52998 records). [2025-10-28T18:53:59.318714] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-28T18:53:59.319161] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FTV took 32.5s. Estimated remaining: 3h 11m 1s. Rate: 7.8 symbols/min [2025-10-28T18:53:59.496637] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:59.518138] [DEBUG] [LOCAL ] FVR: Loaded 20577 existing records from primary storage. [2025-10-28T18:53:59.518392] [INFO ] [MAIN ] FVR: Loaded 20577 existing records. [2025-10-28T18:53:59.694968] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:59.695192] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-28T18:53:59.695237] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-28T18:53:59.695433] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-28T18:53:59.695488] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-28T18:53:59.766375] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-28T18:54:00.091048] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:00.234877] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:54:00.561096] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-28T18:54:01.016905] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:54:01.248379] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T18:54:01.361144] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-28T18:54:01.674067] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (3.50 seconds). [2025-10-28T18:54:01.684867] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-28T18:54:01.685005] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-28T18:54:02.077851] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-28T18:54:02.077930] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-28T18:54:02.078862] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-28T18:54:02.078924] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-28T18:54:02.080352] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 53714 (keeping 200 days of data) [2025-10-28T18:54:02.161889] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-28T18:54:02.379192] [DEBUG] [LOCAL ] FUBO: Primary data saved (53714 records). [2025-10-28T18:54:02.379318] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-28T18:54:02.379393] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUBO took 29.0s. Estimated remaining: 3h 10m 45s. Rate: 7.8 symbols/min [2025-10-28T18:54:02.552230] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:02.588219] [DEBUG] [LOCAL ] FVRR: Loaded 40434 existing records from primary storage. [2025-10-28T18:54:02.588552] [INFO ] [MAIN ] FVRR: Loaded 40434 existing records. [2025-10-28T18:54:02.767832] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:02.768161] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-28T18:54:02.768275] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-28T18:54:02.768563] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-28T18:54:02.768687] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-28T18:54:02.961706] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-28T18:54:02.980060] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T18:54:03.177864] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:03.271270] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:54:03.637915] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:54:03.761161] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-28T18:54:04.561140] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-28T18:54:04.688229] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:54:05.361150] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-28T18:54:05.447031] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T18:54:06.161141] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-28T18:54:06.708329] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T18:54:06.961128] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-28T18:54:07.761137] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-28T18:54:07.865777] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T18:54:07.877247] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:54:08.561163] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-28T18:54:08.849196] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:54:09.361120] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-28T18:54:09.650845] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:54:10.161190] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-28T18:54:10.435405] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:54:10.961148] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-28T18:54:11.364885] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:54:11.761163] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-28T18:54:11.901753] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:54:12.561127] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-28T18:54:12.761129] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T18:54:13.361158] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-28T18:54:13.932346] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:54:14.161143] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-28T18:54:14.594451] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:54:14.961106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-28T18:54:15.655163] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T18:54:15.761133] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-28T18:54:16.402801] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:54:16.561127] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-28T18:54:16.945145] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:54:17.361130] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-28T18:54:17.828729] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:54:18.161139] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-28T18:54:18.413008] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:54:18.961122] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-28T18:54:19.761113] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-28T18:54:20.037069] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T18:54:20.043701] [INFO ] [REMOTE ] FUL: Full fetch complete (47803 records). [2025-10-28T18:54:20.043913] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-28T18:54:20.451395] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-28T18:54:20.451730] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-28T18:54:20.452629] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-28T18:54:20.452825] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-28T18:54:20.454086] [DEBUG] [LOCAL ] FUL: Trimmed 47803 records to 31642 (keeping 200 days of data) [2025-10-28T18:54:20.577173] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-28T18:54:20.629601] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:54:20.682477] [DEBUG] [LOCAL ] FUL: Primary data saved (31642 records). [2025-10-28T18:54:20.682684] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-28T18:54:20.682806] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FUL took 27.0s. Estimated remaining: 3h 10m 55s. Rate: 7.8 symbols/min [2025-10-28T18:54:20.859934] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:20.863589] [DEBUG] [LOCAL ] FXED: Loaded 1221 existing records from primary storage. [2025-10-28T18:54:20.863759] [INFO ] [MAIN ] FXED: Loaded 1221 existing records. [2025-10-28T18:54:21.057447] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-28T18:54:21.091054] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:21.091587] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-28T18:54:21.091673] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-28T18:54:21.092136] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-28T18:54:21.092195] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-28T18:54:21.368147] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-28T18:54:21.458903] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:21.668546] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:54:22.161132] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-28T18:54:22.961162] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-28T18:54:23.314283] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T18:54:23.761122] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-28T18:54:24.300470] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-28T18:54:24.352863] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:54:24.561112] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-28T18:54:24.787144] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T18:54:24.834207] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:54:25.361139] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-28T18:54:26.150270] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T18:54:26.161080] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-28T18:54:26.842946] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T18:54:26.961120] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-28T18:54:27.761159] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-28T18:54:28.110008] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T18:54:28.355474] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:54:28.359522] [INFO ] [REMOTE ] FVR: Full fetch complete (29094 records). [2025-10-28T18:54:28.359624] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-28T18:54:28.566368] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-28T18:54:28.783752] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-28T18:54:28.783837] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-28T18:54:28.784501] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-28T18:54:28.784575] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-28T18:54:28.785407] [DEBUG] [LOCAL ] FVR: Trimmed 29094 records to 20491 (keeping 200 days of data) [2025-10-28T18:54:28.921501] [DEBUG] [LOCAL ] FVR: Primary data saved (20491 records). [2025-10-28T18:54:28.921620] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-28T18:54:28.921728] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FVR took 29.6s. Estimated remaining: 3h 10m 48s. Rate: 7.8 symbols/min [2025-10-28T18:54:29.118788] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:29.165236] [DEBUG] [LOCAL ] G: Loaded 50010 existing records from primary storage. [2025-10-28T18:54:29.165567] [INFO ] [MAIN ] G: Loaded 50010 existing records. [2025-10-28T18:54:29.366411] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-28T18:54:29.372278] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:29.372595] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-28T18:54:29.372670] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-28T18:54:29.373461] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-28T18:54:29.373519] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-28T18:54:29.779959] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:30.161152] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-28T18:54:30.680720] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T18:54:30.689097] [INFO ] [REMOTE ] FVRR: Full fetch complete (59272 records). [2025-10-28T18:54:30.689229] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-28T18:54:30.968229] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-28T18:54:31.100625] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-28T18:54:31.100766] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-28T18:54:31.101637] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-28T18:54:31.101901] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-28T18:54:31.103979] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-28T18:54:31.115959] [DEBUG] [LOCAL ] FVRR: Trimmed 59272 records to 40391 (keeping 200 days of data) [2025-10-28T18:54:31.324916] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:54:31.358916] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T18:54:31.392309] [DEBUG] [LOCAL ] FVRR: Primary data saved (40391 records). [2025-10-28T18:54:31.392416] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-28T18:54:31.392485] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVRR took 29.0s. Estimated remaining: 3h 10m 32s. Rate: 7.8 symbols/min [2025-10-28T18:54:31.563345] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:31.588416] [DEBUG] [LOCAL ] GAB: Loaded 26973 existing records from primary storage. [2025-10-28T18:54:31.588713] [INFO ] [MAIN ] GAB: Loaded 26973 existing records. [2025-10-28T18:54:31.770315] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-28T18:54:31.776995] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:31.777268] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-28T18:54:31.778167] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-28T18:54:31.778384] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-28T18:54:31.778442] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-28T18:54:32.323582] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:32.561194] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-28T18:54:32.800406] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T18:54:33.361145] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-28T18:54:34.161312] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-28T18:54:34.272407] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-28T18:54:34.283669] [INFO ] [REMOTE ] FUN: Full fetch complete (73714 records). [2025-10-28T18:54:34.283883] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-28T18:54:34.466979] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T18:54:34.696754] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-28T18:54:34.696842] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-28T18:54:34.697856] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-28T18:54:34.697918] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-28T18:54:34.699340] [DEBUG] [LOCAL ] FUN: Trimmed 73714 records to 52036 (keeping 200 days of data) [2025-10-28T18:54:34.963925] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-28T18:54:35.002175] [DEBUG] [LOCAL ] FUN: Primary data saved (52036 records). [2025-10-28T18:54:35.002286] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-28T18:54:35.003047] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. FUN took 37.2s. Estimated remaining: 3h 10m 17s. Rate: 7.8 symbols/min [2025-10-28T18:54:35.171774] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:35.178448] [DEBUG] [LOCAL ] GAM: Loaded 3682 existing records from primary storage. [2025-10-28T18:54:35.178660] [INFO ] [MAIN ] GAM: Loaded 3682 existing records. [2025-10-28T18:54:35.352241] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:35.352490] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-28T18:54:35.352537] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-28T18:54:35.352725] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-28T18:54:35.352781] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-28T18:54:35.702666] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:35.733948] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-28T18:54:35.761089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-28T18:54:36.374438] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:54:36.561123] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-28T18:54:36.870102] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T18:54:37.057773] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:54:37.361114] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-28T18:54:38.093539] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:54:38.161096] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-28T18:54:38.961162] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-28T18:54:39.067879] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:54:39.249351] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T18:54:39.761153] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-28T18:54:40.098407] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T18:54:40.561152] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-28T18:54:40.829502] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-28T18:54:41.361182] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-28T18:54:42.161141] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-28T18:54:42.380156] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T18:54:42.961256] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-28T18:54:43.340962] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T18:54:43.345017] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:54:43.761145] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-28T18:54:44.197658] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T18:54:44.561158] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-28T18:54:45.361209] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-28T18:54:46.104743] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:54:46.130708] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:54:46.161092] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-28T18:54:46.961099] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-28T18:54:47.055961] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T18:54:47.428828] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T18:54:47.761131] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-28T18:54:48.561112] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-28T18:54:48.673947] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T18:54:49.361186] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-28T18:54:49.693924] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T18:54:50.144470] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:54:50.161088] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-28T18:54:50.961226] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-28T18:54:51.139499] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T18:54:51.304835] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:54:51.305610] [INFO ] [REMOTE ] FXED: Full fetch complete (1769 records). [2025-10-28T18:54:51.305707] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-28T18:54:51.664832] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-28T18:54:51.664921] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-28T18:54:51.665025] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-28T18:54:51.665085] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-28T18:54:51.665404] [DEBUG] [LOCAL ] FXED: Trimmed 1769 records to 1212 (keeping 200 days of data) [2025-10-28T18:54:51.673239] [DEBUG] [LOCAL ] FXED: Primary data saved (1212 records). [2025-10-28T18:54:51.673299] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-28T18:54:51.673366] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. FXED took 31.0s. Estimated remaining: 3h 10m 24s. Rate: 7.8 symbols/min [2025-10-28T18:54:51.770284] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-28T18:54:51.844089] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:51.894631] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-28T18:54:51.894953] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-28T18:54:52.072601] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:52.072851] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-28T18:54:52.072905] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-28T18:54:52.073511] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-28T18:54:52.073570] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-28T18:54:52.356734] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T18:54:52.435477] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:52.561136] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-28T18:54:53.361251] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-28T18:54:53.727502] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T18:54:53.925667] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T18:54:54.161111] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-28T18:54:54.726211] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T18:54:54.961164] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-28T18:54:55.387313] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T18:54:55.761166] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-28T18:54:56.561164] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-28T18:54:56.876992] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T18:54:57.319564] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T18:54:57.325746] [INFO ] [REMOTE ] GAB: Full fetch complete (39272 records). [2025-10-28T18:54:57.325857] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-28T18:54:57.366472] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-28T18:54:57.722367] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-28T18:54:57.722521] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-28T18:54:57.724690] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-28T18:54:57.724761] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-28T18:54:57.726389] [DEBUG] [LOCAL ] GAB: Trimmed 39272 records to 26834 (keeping 200 days of data) [2025-10-28T18:54:57.887884] [DEBUG] [LOCAL ] GAB: Primary data saved (26834 records). [2025-10-28T18:54:57.888068] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-28T18:54:57.888174] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. GAB took 26.5s. Estimated remaining: 3h 10m 14s. Rate: 7.8 symbols/min [2025-10-28T18:54:58.115759] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:58.136954] [DEBUG] [LOCAL ] GATX: Loaded 17782 existing records from primary storage. [2025-10-28T18:54:58.137268] [INFO ] [MAIN ] GATX: Loaded 17782 existing records. [2025-10-28T18:54:58.168723] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-28T18:54:58.324713] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:58.324983] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-28T18:54:58.325036] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-28T18:54:58.325345] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-28T18:54:58.325407] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-28T18:54:58.706939] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:58.708568] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T18:54:58.747269] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T18:54:58.961157] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-28T18:54:59.761200] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-28T18:55:00.192857] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T18:55:00.561202] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-28T18:55:01.361128] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-28T18:55:01.504410] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:55:01.752348] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:55:02.161126] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-28T18:55:02.290613] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-28T18:55:02.710285] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T18:55:02.711664] [INFO ] [REMOTE ] GAM: Full fetch complete (6399 records). [2025-10-28T18:55:02.711737] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-28T18:55:02.966212] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-28T18:55:03.076285] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-28T18:55:03.076362] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-28T18:55:03.076587] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-28T18:55:03.076667] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-28T18:55:03.077076] [DEBUG] [LOCAL ] GAM: Trimmed 6399 records to 3674 (keeping 200 days of data) [2025-10-28T18:55:03.099154] [DEBUG] [LOCAL ] GAM: Primary data saved (3674 records). [2025-10-28T18:55:03.099252] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-28T18:55:03.099324] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GAM took 28.1s. Estimated remaining: 3h 10m 2s. Rate: 7.8 symbols/min [2025-10-28T18:55:03.270598] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:03.284944] [DEBUG] [LOCAL ] GBAB: Loaded 12396 existing records from primary storage. [2025-10-28T18:55:03.285156] [INFO ] [MAIN ] GBAB: Loaded 12396 existing records. [2025-10-28T18:55:03.460139] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:03.460335] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-28T18:55:03.460381] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-28T18:55:03.460622] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-28T18:55:03.460705] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-28T18:55:03.766204] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-28T18:55:03.816271] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:04.418919] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:55:04.429340] [INFO ] [REMOTE ] G: Full fetch complete (72315 records). [2025-10-28T18:55:04.429462] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-28T18:55:04.569094] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-28T18:55:04.830768] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-28T18:55:04.830870] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-28T18:55:04.831838] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-28T18:55:04.831914] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-28T18:55:04.833400] [DEBUG] [LOCAL ] G: Trimmed 72315 records to 50000 (keeping 200 days of data) [2025-10-28T18:55:05.132807] [DEBUG] [LOCAL ] G: Primary data saved (50000 records). [2025-10-28T18:55:05.132950] [INFO ] [MAIN ] G: Full history saved. [2025-10-28T18:55:05.133034] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. G took 36.2s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-10-28T18:55:05.314191] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:05.325921] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T18:55:05.367529] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-28T18:55:05.370877] [DEBUG] [LOCAL ] GBCI: Loaded 41110 existing records from primary storage. [2025-10-28T18:55:05.371299] [INFO ] [MAIN ] GBCI: Loaded 41110 existing records. [2025-10-28T18:55:05.566323] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:05.566639] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-28T18:55:05.566730] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-28T18:55:05.567059] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-28T18:55:05.567104] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-28T18:55:05.970543] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:06.068471] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:55:06.161129] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-28T18:55:06.558669] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-28T18:55:06.746478] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T18:55:06.961127] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-28T18:55:07.766851] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-28T18:55:07.770288] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T18:55:08.561161] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-28T18:55:08.722321] [DEBUG] [REMOTE ] GBAB: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-28T18:55:08.722604] [WARN ] [REMOTE ] GBAB: No data returned for month 2025-03 [2025-10-28T18:55:08.722709] [FATAL] [REMOTE ] GBAB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:55:08.722808] [FATAL] [MAIN ] GBAB: Failed to fetch primary data. [2025-10-28T18:55:08.722873] [WARN ] [MAIN ] GBAB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:55:08.722941] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-28T18:55:08.723022] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-10-28T18:55:08.723059] [INFO ] [LOCAL ] GBAB: Starting deletion of derivative data. [2025-10-28T18:55:08.723260] [DEBUG] [LOCAL ] GBAB: Deleted derivative data file. [2025-10-28T18:55:08.723343] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GBAB took 5.6s. Estimated remaining: 3h 9m 31s. Rate: 7.8 symbols/min [2025-10-28T18:55:08.891119] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:08.891301] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-28T18:55:08.891339] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-28T18:55:08.891442] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-28T18:55:08.891482] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-28T18:55:08.891522] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-28T18:55:08.891553] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-28T18:55:09.251476] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:09.297485] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T18:55:09.361144] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-28T18:55:10.132386] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:55:10.161151] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-28T18:55:10.961168] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-28T18:55:11.204151] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:55:11.761144] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-28T18:55:12.277937] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T18:55:12.561114] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-28T18:55:12.711289] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:55:13.361132] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-28T18:55:13.661049] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-28T18:55:13.855059] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T18:55:14.161102] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-28T18:55:14.961159] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-28T18:55:15.761176] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-28T18:55:15.837739] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T18:55:16.125481] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T18:55:16.561174] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-28T18:55:16.760018] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:55:16.991579] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:55:17.361096] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-28T18:55:17.620707] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-28T18:55:18.161135] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-28T18:55:18.872041] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T18:55:18.961157] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-28T18:55:19.254346] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:55:19.761192] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-28T18:55:20.110205] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T18:55:20.561181] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-28T18:55:21.361142] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-28T18:55:22.161127] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-28T18:55:22.492727] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T18:55:22.961165] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-28T18:55:23.761170] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-28T18:55:24.010007] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T18:55:24.445494] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T18:55:24.561206] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-28T18:55:25.361151] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-28T18:55:25.552688] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (4.99 seconds). [2025-10-28T18:55:25.566456] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (3.41 seconds). [2025-10-28T18:55:26.132586] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:55:26.161121] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-28T18:55:26.366925] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-28T18:55:26.961153] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-28T18:55:27.096401] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-28T18:55:27.761114] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-28T18:55:28.371936] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:55:28.561131] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-28T18:55:28.962420] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T18:55:28.965993] [INFO ] [REMOTE ] GATX: Full fetch complete (25157 records). [2025-10-28T18:55:28.966066] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-28T18:55:29.331976] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-28T18:55:29.332049] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-28T18:55:29.332549] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-28T18:55:29.332589] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-28T18:55:29.333194] [DEBUG] [LOCAL ] GATX: Trimmed 25157 records to 17729 (keeping 200 days of data) [2025-10-28T18:55:29.380008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-28T18:55:29.445587] [DEBUG] [LOCAL ] GATX: Primary data saved (17729 records). [2025-10-28T18:55:29.445761] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-28T18:55:29.445849] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GATX took 31.6s. Estimated remaining: 3h 9m 44s. Rate: 7.8 symbols/min [2025-10-28T18:55:29.621133] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:29.656057] [DEBUG] [LOCAL ] GBTG: Loaded 39966 existing records from primary storage. [2025-10-28T18:55:29.656340] [INFO ] [MAIN ] GBTG: Loaded 39966 existing records. [2025-10-28T18:55:29.815702] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T18:55:29.845015] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:29.845199] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-28T18:55:29.845266] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-28T18:55:29.845613] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-28T18:55:29.845698] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-28T18:55:30.166014] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-28T18:55:30.206677] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:30.239440] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T18:55:30.250321] [INFO ] [REMOTE ] GAP: Full fetch complete (77815 records). [2025-10-28T18:55:30.250446] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-28T18:55:30.504254] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:55:30.664050] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-28T18:55:30.664152] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-28T18:55:30.665165] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-28T18:55:30.665226] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-28T18:55:30.666636] [DEBUG] [LOCAL ] GAP: Trimmed 77815 records to 53653 (keeping 200 days of data) [2025-10-28T18:55:30.967302] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-28T18:55:30.991359] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-28T18:55:30.991624] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-28T18:55:30.991765] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GAP took 39.3s. Estimated remaining: 3h 9m 26s. Rate: 7.8 symbols/min [2025-10-28T18:55:31.168707] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:31.195022] [DEBUG] [LOCAL ] GBX: Loaded 27618 existing records from primary storage. [2025-10-28T18:55:31.195279] [INFO ] [MAIN ] GBX: Loaded 27618 existing records. [2025-10-28T18:55:31.376817] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:31.377047] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-28T18:55:31.377094] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-28T18:55:31.377329] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-28T18:55:31.377370] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-28T18:55:31.749260] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:31.761099] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-28T18:55:32.561139] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-28T18:55:32.777150] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T18:55:32.895945] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T18:55:32.896985] [INFO ] [REMOTE ] GBLI: Full fetch complete (1276 records). [2025-10-28T18:55:32.897161] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-28T18:55:33.099130] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-28T18:55:33.099363] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:55:33.099459] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:55:33.099561] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-28T18:55:33.099680] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-28T18:55:33.099757] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-28T18:55:33.099826] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-28T18:55:33.099909] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBLI took 24.4s. Estimated remaining: 3h 9m 9s. Rate: 7.8 symbols/min [2025-10-28T18:55:33.296751] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:33.341065] [DEBUG] [LOCAL ] GCI: Loaded 43427 existing records from primary storage. [2025-10-28T18:55:33.341491] [INFO ] [MAIN ] GCI: Loaded 43427 existing records. [2025-10-28T18:55:33.366329] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-28T18:55:33.539937] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:33.540211] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-28T18:55:33.540267] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-28T18:55:33.540478] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-28T18:55:33.540535] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-28T18:55:33.876894] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-10-28T18:55:33.924388] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:34.161123] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-28T18:55:34.322939] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T18:55:34.961147] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-28T18:55:35.421434] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:55:35.761143] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-28T18:55:35.933026] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:55:36.561147] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-28T18:55:36.900536] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:55:37.361133] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-28T18:55:37.503108] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:55:38.161105] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-28T18:55:38.961185] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-28T18:55:39.722761] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-28T18:55:39.761105] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-28T18:55:39.993449] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:55:40.368723] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-28T18:55:40.561153] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-28T18:55:40.807090] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T18:55:41.361214] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-28T18:55:41.621941] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T18:55:42.161168] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-28T18:55:42.961184] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-28T18:55:43.409394] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T18:55:43.418854] [INFO ] [REMOTE ] GBCI: Full fetch complete (59501 records). [2025-10-28T18:55:43.419014] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-28T18:55:43.774685] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-28T18:55:43.833365] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-28T18:55:43.833515] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-28T18:55:43.834475] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-28T18:55:43.834728] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-28T18:55:43.842318] [DEBUG] [LOCAL ] GBCI: Trimmed 59501 records to 41010 (keeping 200 days of data) [2025-10-28T18:55:43.855554] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T18:55:43.993848] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-28T18:55:44.147418] [DEBUG] [LOCAL ] GBCI: Primary data saved (41010 records). [2025-10-28T18:55:44.147539] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-28T18:55:44.147615] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBCI took 39.0s. Estimated remaining: 3h 9m 7s. Rate: 7.8 symbols/min [2025-10-28T18:55:44.324155] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:44.345679] [DEBUG] [LOCAL ] GCO: Loaded 22201 existing records from primary storage. [2025-10-28T18:55:44.345940] [INFO ] [MAIN ] GCO: Loaded 22201 existing records. [2025-10-28T18:55:44.535323] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:44.535523] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-28T18:55:44.535571] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-28T18:55:44.535818] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-28T18:55:44.535879] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-28T18:55:44.568761] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-28T18:55:44.898177] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:45.361160] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-28T18:55:45.796371] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T18:55:46.161122] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-28T18:55:46.294865] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-28T18:55:46.794118] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:55:46.961227] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-28T18:55:47.252242] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:55:47.761101] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-28T18:55:47.844013] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T18:55:48.561166] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-28T18:55:48.711961] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:55:49.286091] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T18:55:49.361134] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-28T18:55:50.161162] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-28T18:55:50.417758] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:55:50.945634] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T18:55:50.961114] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-28T18:55:51.761103] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-28T18:55:51.776461] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T18:55:52.561145] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-28T18:55:52.746358] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T18:55:53.361189] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-28T18:55:53.718412] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:55:54.161093] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-28T18:55:54.357440] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T18:55:54.961104] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-28T18:55:55.679488] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T18:55:55.761100] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-28T18:55:56.567475] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-28T18:55:56.569637] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T18:55:57.361143] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-28T18:55:57.457731] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (3.30 seconds). [2025-10-28T18:55:58.161118] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-28T18:55:58.212826] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T18:55:58.218485] [INFO ] [REMOTE ] GBX: Full fetch complete (42470 records). [2025-10-28T18:55:58.218600] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-28T18:55:58.603663] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-28T18:55:58.603754] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-28T18:55:58.604433] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-28T18:55:58.604473] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-28T18:55:58.605422] [DEBUG] [LOCAL ] GBX: Trimmed 42470 records to 27555 (keeping 200 days of data) [2025-10-28T18:55:58.766864] [DEBUG] [LOCAL ] GBX: Primary data saved (27555 records). [2025-10-28T18:55:58.767004] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-28T18:55:58.767084] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GBX took 27.8s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min [2025-10-28T18:55:58.950163] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:58.961123] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-28T18:55:58.970879] [DEBUG] [LOCAL ] GCTS: Loaded 20201 existing records from primary storage. [2025-10-28T18:55:58.971557] [INFO ] [MAIN ] GCTS: Loaded 20201 existing records. [2025-10-28T18:55:59.163539] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:59.164072] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-28T18:55:59.164302] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-28T18:55:59.164876] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-28T18:55:59.165034] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-28T18:55:59.369376] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T18:55:59.561076] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:59.761097] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-28T18:55:59.949371] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T18:56:00.336843] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (3.77 seconds). [2025-10-28T18:56:00.561094] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-28T18:56:00.705938] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:56:01.361252] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-28T18:56:02.039500] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T18:56:02.161201] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-28T18:56:02.545455] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T18:56:02.961097] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-28T18:56:03.711019] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:56:03.761098] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-28T18:56:04.018543] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T18:56:04.561144] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-28T18:56:04.865839] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:56:04.874469] [INFO ] [REMOTE ] GCI: Full fetch complete (63268 records). [2025-10-28T18:56:04.874583] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-28T18:56:05.254936] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-28T18:56:05.255013] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-28T18:56:05.255880] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-28T18:56:05.255942] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-28T18:56:05.257318] [DEBUG] [LOCAL ] GCI: Trimmed 63268 records to 43464 (keeping 200 days of data) [2025-10-28T18:56:05.362955] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-28T18:56:05.497786] [DEBUG] [LOCAL ] GCI: Primary data saved (43464 records). [2025-10-28T18:56:05.497900] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-28T18:56:05.498603] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GCI took 32.4s. Estimated remaining: 3h 9m 1s. Rate: 7.8 symbols/min [2025-10-28T18:56:05.671179] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:05.681597] [DEBUG] [LOCAL ] GCV: Loaded 7919 existing records from primary storage. [2025-10-28T18:56:05.681881] [INFO ] [MAIN ] GCV: Loaded 7919 existing records. [2025-10-28T18:56:05.855774] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:05.856052] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-28T18:56:05.856105] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-28T18:56:05.856262] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-28T18:56:05.856329] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-28T18:56:06.139388] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T18:56:06.166219] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-28T18:56:06.233527] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:06.537368] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T18:56:06.545254] [INFO ] [REMOTE ] GBTG: Full fetch complete (56838 records). [2025-10-28T18:56:06.545356] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-28T18:56:06.921273] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-28T18:56:06.921349] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-28T18:56:06.922127] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-28T18:56:06.922188] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-28T18:56:06.923261] [DEBUG] [LOCAL ] GBTG: Trimmed 56838 records to 39877 (keeping 200 days of data) [2025-10-28T18:56:06.965697] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-28T18:56:07.142727] [DEBUG] [LOCAL ] GBTG: Primary data saved (39877 records). [2025-10-28T18:56:07.142857] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-28T18:56:07.142931] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GBTG took 37.7s. Estimated remaining: 3h 8m 44s. Rate: 7.8 symbols/min [2025-10-28T18:56:07.311176] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:07.351614] [DEBUG] [LOCAL ] GD: Loaded 46417 existing records from primary storage. [2025-10-28T18:56:07.351940] [INFO ] [MAIN ] GD: Loaded 46417 existing records. [2025-10-28T18:56:07.528117] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:07.528304] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-28T18:56:07.528349] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-28T18:56:07.528697] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-28T18:56:07.528755] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-28T18:56:07.684547] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T18:56:07.767284] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-28T18:56:07.902509] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:08.072305] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-28T18:56:08.233178] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T18:56:08.561157] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-28T18:56:09.299266] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T18:56:09.361156] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-28T18:56:10.161132] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-28T18:56:10.728394] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T18:56:10.961135] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-28T18:56:11.684368] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T18:56:11.690254] [INFO ] [REMOTE ] GCO: Full fetch complete (34407 records). [2025-10-28T18:56:11.690419] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-28T18:56:11.767440] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-28T18:56:12.165120] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-28T18:56:12.165219] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-28T18:56:12.166031] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-28T18:56:12.166098] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-28T18:56:12.167155] [DEBUG] [LOCAL ] GCO: Trimmed 34407 records to 21977 (keeping 200 days of data) [2025-10-28T18:56:12.298819] [DEBUG] [LOCAL ] GCO: Primary data saved (21977 records). [2025-10-28T18:56:12.298956] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-28T18:56:12.299041] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCO took 28.2s. Estimated remaining: 3h 8m 32s. Rate: 7.8 symbols/min [2025-10-28T18:56:12.432065] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T18:56:12.491731] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:12.537294] [DEBUG] [LOCAL ] GDDY: Loaded 49453 existing records from primary storage. [2025-10-28T18:56:12.537611] [INFO ] [MAIN ] GDDY: Loaded 49453 existing records. [2025-10-28T18:56:12.569453] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-28T18:56:12.725378] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:12.725618] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-28T18:56:12.725707] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-28T18:56:12.726035] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-28T18:56:12.726094] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-28T18:56:13.082859] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:13.361153] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-28T18:56:14.146082] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (4.78 seconds). [2025-10-28T18:56:14.161097] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-28T18:56:14.332903] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-28T18:56:14.558840] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T18:56:14.961140] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-28T18:56:15.299557] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:56:15.761161] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-28T18:56:16.219371] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:56:16.561137] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-28T18:56:17.361159] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-28T18:56:17.858088] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T18:56:17.887179] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:56:18.161150] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-28T18:56:18.496301] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-28T18:56:18.961219] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-28T18:56:19.219209] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:56:19.761213] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-28T18:56:20.561156] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-28T18:56:21.105627] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T18:56:21.331404] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T18:56:21.361134] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-28T18:56:22.161154] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-28T18:56:22.307805] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-10-28T18:56:22.597838] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T18:56:22.961176] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-28T18:56:23.379207] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:56:23.761126] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-28T18:56:24.561172] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-28T18:56:24.804701] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (3.44 seconds). [2025-10-28T18:56:25.147967] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:56:25.361183] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-28T18:56:26.000010] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:56:26.161176] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-28T18:56:26.559797] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:56:26.703117] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T18:56:26.961115] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-28T18:56:27.761192] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-28T18:56:28.242586] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:56:28.241125] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:56:28.561147] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-28T18:56:29.361177] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-28T18:56:29.863816] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:56:30.161176] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-28T18:56:30.441496] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T18:56:30.714718] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T18:56:30.961128] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-28T18:56:31.761178] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-28T18:56:32.218757] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:56:32.561175] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-28T18:56:32.968018] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T18:56:32.971909] [INFO ] [REMOTE ] GCTS: Full fetch complete (26632 records). [2025-10-28T18:56:32.972011] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-28T18:56:33.350444] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-28T18:56:33.350516] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-28T18:56:33.351048] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-28T18:56:33.351107] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-28T18:56:33.351759] [DEBUG] [LOCAL ] GCTS: Trimmed 26632 records to 20155 (keeping 200 days of data) [2025-10-28T18:56:33.394507] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-28T18:56:33.464698] [DEBUG] [LOCAL ] GCTS: Primary data saved (20155 records). [2025-10-28T18:56:33.464831] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-28T18:56:33.464910] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GCTS took 34.7s. Estimated remaining: 3h 8m 46s. Rate: 7.8 symbols/min [2025-10-28T18:56:33.642406] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:33.648165] [DEBUG] [LOCAL ] GDIV: Loaded 3405 existing records from primary storage. [2025-10-28T18:56:33.648315] [INFO ] [MAIN ] GDIV: Loaded 3405 existing records. [2025-10-28T18:56:33.830684] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:33.830907] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-28T18:56:33.830955] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-28T18:56:33.831087] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-28T18:56:33.831126] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-28T18:56:34.166285] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-28T18:56:34.207073] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:34.810716] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T18:56:34.871617] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:56:34.874418] [INFO ] [REMOTE ] GCV: Full fetch complete (10243 records). [2025-10-28T18:56:34.874489] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-28T18:56:34.964015] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-28T18:56:35.238335] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-28T18:56:35.238434] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-28T18:56:35.238708] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-28T18:56:35.238767] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-28T18:56:35.239192] [DEBUG] [LOCAL ] GCV: Trimmed 10243 records to 7933 (keeping 200 days of data) [2025-10-28T18:56:35.285217] [DEBUG] [LOCAL ] GCV: Primary data saved (7933 records). [2025-10-28T18:56:35.285392] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-28T18:56:35.285477] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GCV took 29.8s. Estimated remaining: 3h 8m 28s. Rate: 7.8 symbols/min [2025-10-28T18:56:35.450087] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:35.455004] [DEBUG] [LOCAL ] GDL: Loaded 2495 existing records from primary storage. [2025-10-28T18:56:35.455163] [INFO ] [MAIN ] GDL: Loaded 2495 existing records. [2025-10-28T18:56:35.629542] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:35.629771] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-28T18:56:35.629820] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-28T18:56:35.629992] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-28T18:56:35.630048] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-28T18:56:35.767898] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-28T18:56:35.944732] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (3.38 seconds). [2025-10-28T18:56:36.032051] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:36.230170] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T18:56:36.403293] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T18:56:36.561142] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-28T18:56:37.361144] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-28T18:56:37.844988] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T18:56:38.161103] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-28T18:56:38.516772] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:56:38.919731] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-28T18:56:38.961105] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-28T18:56:39.417360] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T18:56:39.761172] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-28T18:56:40.156898] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T18:56:40.561130] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-28T18:56:41.114471] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T18:56:41.361137] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-28T18:56:42.161130] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-28T18:56:42.431983] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T18:56:42.546342] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:56:42.961140] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-28T18:56:43.761185] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-28T18:56:44.108430] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T18:56:44.362478] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:56:44.373249] [INFO ] [REMOTE ] GDDY: Full fetch complete (72039 records). [2025-10-28T18:56:44.373440] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-28T18:56:44.566443] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-28T18:56:44.759716] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-28T18:56:44.759813] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-28T18:56:44.760782] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-28T18:56:44.760845] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-28T18:56:44.762241] [DEBUG] [LOCAL ] GDDY: Trimmed 72039 records to 49387 (keeping 200 days of data) [2025-10-28T18:56:45.043969] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T18:56:45.063934] [DEBUG] [LOCAL ] GDDY: Primary data saved (49387 records). [2025-10-28T18:56:45.064110] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-28T18:56:45.064204] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GDDY took 32.8s. Estimated remaining: 3h 8m 24s. Rate: 7.8 symbols/min [2025-10-28T18:56:45.234747] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:45.242455] [DEBUG] [LOCAL ] GDO: Loaded 5681 existing records from primary storage. [2025-10-28T18:56:45.242681] [INFO ] [MAIN ] GDO: Loaded 5681 existing records. [2025-10-28T18:56:45.366410] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-28T18:56:45.419190] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:45.419743] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-28T18:56:45.419803] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-28T18:56:45.420441] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-28T18:56:45.420500] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-28T18:56:45.776989] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:45.778303] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T18:56:46.161188] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-28T18:56:46.961140] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-28T18:56:47.248212] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T18:56:47.391554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T18:56:47.761133] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-28T18:56:48.561186] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-28T18:56:49.001781] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T18:56:49.269456] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:56:49.278670] [INFO ] [REMOTE ] GD: Full fetch complete (69585 records). [2025-10-28T18:56:49.278819] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-28T18:56:49.366191] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-28T18:56:49.680401] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-28T18:56:49.680479] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-28T18:56:49.681423] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-28T18:56:49.681503] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-28T18:56:49.682892] [DEBUG] [LOCAL ] GD: Trimmed 69585 records to 46355 (keeping 200 days of data) [2025-10-28T18:56:49.776041] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:56:49.993949] [DEBUG] [LOCAL ] GD: Primary data saved (46355 records). [2025-10-28T18:56:49.994076] [INFO ] [MAIN ] GD: Full history saved. [2025-10-28T18:56:49.995008] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GD took 42.9s. Estimated remaining: 3h 8m 12s. Rate: 7.8 symbols/min [2025-10-28T18:56:50.183205] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:50.179687] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-28T18:56:50.222096] [DEBUG] [LOCAL ] GDOT: Loaded 37431 existing records from primary storage. [2025-10-28T18:56:50.222378] [INFO ] [MAIN ] GDOT: Loaded 37431 existing records. [2025-10-28T18:56:50.406218] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:50.406451] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-28T18:56:50.406518] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-28T18:56:50.406884] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-28T18:56:50.406941] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-28T18:56:50.767209] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:50.770527] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:56:50.771614] [INFO ] [REMOTE ] GDIV: Full fetch complete (5397 records). [2025-10-28T18:56:50.771721] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-28T18:56:50.966265] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-28T18:56:51.132784] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-28T18:56:51.132860] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-28T18:56:51.133026] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-28T18:56:51.133064] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-28T18:56:51.133421] [DEBUG] [LOCAL ] GDIV: Trimmed 5397 records to 3395 (keeping 200 days of data) [2025-10-28T18:56:51.153584] [DEBUG] [LOCAL ] GDIV: Primary data saved (3395 records). [2025-10-28T18:56:51.153685] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-28T18:56:51.153773] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDIV took 17.7s. Estimated remaining: 3h 7m 53s. Rate: 7.8 symbols/min [2025-10-28T18:56:51.324457] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:51.341905] [DEBUG] [LOCAL ] GDV: Loaded 18804 existing records from primary storage. [2025-10-28T18:56:51.342157] [INFO ] [MAIN ] GDV: Loaded 18804 existing records. [2025-10-28T18:56:51.522143] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:51.522342] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-28T18:56:51.522389] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-28T18:56:51.522964] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-28T18:56:51.523023] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-28T18:56:51.766225] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-28T18:56:51.886443] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:52.211352] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T18:56:52.463512] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:56:52.561116] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-28T18:56:52.881768] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T18:56:53.361223] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-28T18:56:54.022222] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:56:54.161109] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-28T18:56:54.462246] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T18:56:54.961187] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-28T18:56:55.260101] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:56:55.761155] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-28T18:56:56.137084] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:56:56.561150] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-28T18:56:56.947913] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T18:56:57.361161] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-28T18:56:58.018813] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T18:56:58.161151] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-28T18:56:58.554487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T18:56:58.961199] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-28T18:56:59.406158] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T18:56:59.761170] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-28T18:57:00.561111] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-28T18:57:01.042279] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:57:01.288003] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:57:01.361131] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-28T18:57:02.150626] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:57:02.161115] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-28T18:57:02.961109] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-28T18:57:03.277085] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T18:57:03.603434] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:57:03.761131] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-28T18:57:04.105678] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:57:04.561198] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-28T18:57:05.283336] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T18:57:05.361157] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-28T18:57:06.062145] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T18:57:06.161127] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-28T18:57:06.495303] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T18:57:06.961156] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-28T18:57:07.761106] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-28T18:57:07.778378] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T18:57:08.367260] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T18:57:08.561151] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-28T18:57:08.955599] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T18:57:08.956637] [INFO ] [REMOTE ] GDL: Full fetch complete (3445 records). [2025-10-28T18:57:08.956738] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-28T18:57:09.342897] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-28T18:57:09.342973] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-28T18:57:09.343092] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-28T18:57:09.343128] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-28T18:57:09.343458] [DEBUG] [LOCAL ] GDL: Trimmed 3445 records to 2505 (keeping 200 days of data) [2025-10-28T18:57:09.358472] [DEBUG] [LOCAL ] GDL: Primary data saved (2505 records). [2025-10-28T18:57:09.358543] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-28T18:57:09.358611] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDL took 34.1s. Estimated remaining: 3h 8m 2s. Rate: 7.8 symbols/min [2025-10-28T18:57:09.369522] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-28T18:57:09.535276] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:09.583792] [DEBUG] [LOCAL ] GE: Loaded 53689 existing records from primary storage. [2025-10-28T18:57:09.584119] [INFO ] [MAIN ] GE: Loaded 53689 existing records. [2025-10-28T18:57:09.764543] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:09.764797] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-28T18:57:09.764855] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-28T18:57:09.765825] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-28T18:57:09.765883] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-28T18:57:10.124555] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:10.161085] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-28T18:57:10.240787] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T18:57:10.961138] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-28T18:57:11.632173] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:57:11.761137] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-28T18:57:12.561155] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-28T18:57:13.361144] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-28T18:57:13.706620] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:57:13.887154] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (3.73 seconds). [2025-10-28T18:57:14.029887] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T18:57:14.031580] [INFO ] [REMOTE ] GDO: Full fetch complete (8380 records). [2025-10-28T18:57:14.031691] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-28T18:57:14.176146] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-28T18:57:14.404488] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-28T18:57:14.404558] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-28T18:57:14.404781] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-28T18:57:14.404840] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-28T18:57:14.405228] [DEBUG] [LOCAL ] GDO: Trimmed 8380 records to 5703 (keeping 200 days of data) [2025-10-28T18:57:14.443001] [DEBUG] [LOCAL ] GDO: Primary data saved (5703 records). [2025-10-28T18:57:14.443139] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-28T18:57:14.443236] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GDO took 29.4s. Estimated remaining: 3h 7m 50s. Rate: 7.8 symbols/min [2025-10-28T18:57:14.613176] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:14.631354] [DEBUG] [LOCAL ] GEF: Loaded 20495 existing records from primary storage. [2025-10-28T18:57:14.631577] [INFO ] [MAIN ] GEF: Loaded 20495 existing records. [2025-10-28T18:57:14.815009] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-10-28T18:57:14.819670] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:14.819880] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-28T18:57:14.819958] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-28T18:57:14.824227] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-28T18:57:14.824289] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-28T18:57:14.966213] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-28T18:57:15.198716] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:15.761168] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-28T18:57:16.130443] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T18:57:16.561128] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-28T18:57:16.808832] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-28T18:57:16.860061] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:57:16.863825] [INFO ] [REMOTE ] GDV: Full fetch complete (28134 records). [2025-10-28T18:57:16.863900] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-28T18:57:17.227412] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-28T18:57:17.227500] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-28T18:57:17.228093] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-28T18:57:17.228156] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-28T18:57:17.229038] [DEBUG] [LOCAL ] GDV: Trimmed 28134 records to 18696 (keeping 200 days of data) [2025-10-28T18:57:17.339984] [DEBUG] [LOCAL ] GDV: Primary data saved (18696 records). [2025-10-28T18:57:17.340098] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-28T18:57:17.340175] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDV took 26.2s. Estimated remaining: 3h 7m 35s. Rate: 7.8 symbols/min [2025-10-28T18:57:17.370712] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-28T18:57:17.537616] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:17.549550] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T18:57:17.580962] [DEBUG] [LOCAL ] GEL: Loaded 30690 existing records from primary storage. [2025-10-28T18:57:17.581211] [INFO ] [MAIN ] GEL: Loaded 30690 existing records. [2025-10-28T18:57:17.755452] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:17.755686] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-28T18:57:17.755751] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-28T18:57:17.756058] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-28T18:57:17.756114] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-28T18:57:18.103596] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:18.161107] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-28T18:57:18.961192] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-28T18:57:19.743069] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-28T18:57:19.761094] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-28T18:57:20.256631] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T18:57:20.561169] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-28T18:57:20.711720] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:57:21.271902] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T18:57:21.361135] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-28T18:57:22.082705] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T18:57:22.161097] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-28T18:57:22.564189] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (4.40 seconds). [2025-10-28T18:57:22.759834] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T18:57:22.961173] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-28T18:57:23.761172] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-28T18:57:24.138617] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:57:24.561146] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-28T18:57:24.690547] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:57:25.361546] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-28T18:57:26.161164] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-28T18:57:26.489680] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T18:57:26.961183] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-28T18:57:26.996594] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T18:57:27.761170] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-28T18:57:28.194742] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:57:28.544524] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:57:28.561134] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-28T18:57:29.361118] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-28T18:57:30.161125] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-28T18:57:30.667328] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:57:30.926067] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T18:57:30.961088] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-28T18:57:31.381529] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (5.22 seconds). [2025-10-28T18:57:31.756177] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:57:31.760776] [INFO ] [REMOTE ] GEF: Full fetch complete (29294 records). [2025-10-28T18:57:31.760855] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-28T18:57:31.772496] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-28T18:57:32.130115] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-28T18:57:32.130200] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-28T18:57:32.130802] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-28T18:57:32.130883] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-28T18:57:32.131558] [DEBUG] [LOCAL ] GEF: Trimmed 29294 records to 20496 (keeping 200 days of data) [2025-10-28T18:57:32.254108] [DEBUG] [LOCAL ] GEF: Primary data saved (20496 records). [2025-10-28T18:57:32.254223] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-28T18:57:32.254295] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GEF took 17.8s. Estimated remaining: 3h 7m 39s. Rate: 7.8 symbols/min [2025-10-28T18:57:32.424826] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:32.473635] [DEBUG] [LOCAL ] GENI: Loaded 52863 existing records from primary storage. [2025-10-28T18:57:32.473961] [INFO ] [MAIN ] GENI: Loaded 52863 existing records. [2025-10-28T18:57:32.566285] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-28T18:57:32.652124] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:32.652301] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-28T18:57:32.652346] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-28T18:57:32.652662] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-28T18:57:32.652721] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-28T18:57:33.006560] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:33.303069] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (4.74 seconds). [2025-10-28T18:57:33.361085] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-28T18:57:33.699593] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-28T18:57:34.161120] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-28T18:57:34.542501] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:57:34.961108] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-28T18:57:35.220722] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-28T18:57:35.228223] [INFO ] [REMOTE ] GDOT: Full fetch complete (53699 records). [2025-10-28T18:57:35.228385] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-28T18:57:35.612350] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-28T18:57:35.612432] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-28T18:57:35.613174] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-28T18:57:35.613234] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-28T18:57:35.614330] [DEBUG] [LOCAL ] GDOT: Trimmed 53699 records to 37323 (keeping 200 days of data) [2025-10-28T18:57:35.767725] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-28T18:57:35.827062] [DEBUG] [LOCAL ] GDOT: Primary data saved (37323 records). [2025-10-28T18:57:35.827166] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-28T18:57:35.827238] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GDOT took 45.8s. Estimated remaining: 3h 7m 24s. Rate: 7.8 symbols/min [2025-10-28T18:57:36.001694] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:36.019345] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:57:36.071768] [DEBUG] [LOCAL ] GEO: Loaded 51578 existing records from primary storage. [2025-10-28T18:57:36.072098] [INFO ] [MAIN ] GEO: Loaded 51578 existing records. [2025-10-28T18:57:36.253940] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:36.254102] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-28T18:57:36.254214] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-28T18:57:36.254445] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-28T18:57:36.254514] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-28T18:57:36.569366] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-28T18:57:36.607760] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:37.347411] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T18:57:37.361082] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-28T18:57:38.161143] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-28T18:57:38.392118] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (4.23 seconds). [2025-10-28T18:57:38.961143] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-28T18:57:39.369466] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-28T18:57:39.630572] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T18:57:39.761196] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-28T18:57:39.815999] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-10-28T18:57:39.929336] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:57:40.561189] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-28T18:57:41.361152] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-28T18:57:41.414125] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T18:57:41.950344] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:57:42.161155] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-28T18:57:42.419311] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:57:42.961194] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-28T18:57:43.761103] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-28T18:57:44.561161] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-28T18:57:45.880016] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T18:57:45.891763] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-28T18:57:46.917424] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (4.76 seconds). [2025-10-28T18:57:46.928279] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-28T18:57:47.277815] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:57:47.289050] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-28T18:57:48.059736] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T18:57:48.070860] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-28T18:57:48.808875] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:57:48.820317] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-28T18:57:49.444317] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:57:49.456141] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-28T18:57:50.224861] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:57:50.236977] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-28T18:57:50.707313] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:57:50.961139] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-28T18:57:51.280713] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (8.32 seconds). [2025-10-28T18:57:51.463338] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:57:51.761133] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-28T18:57:52.561108] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-28T18:57:52.654119] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T18:57:53.361169] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-28T18:57:53.893870] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:57:54.134476] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:57:54.161094] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-28T18:57:54.965119] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-28T18:57:54.966062] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:57:54.971615] [INFO ] [REMOTE ] GEL: Full fetch complete (47825 records). [2025-10-28T18:57:54.971746] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-28T18:57:55.355768] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-28T18:57:55.355860] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-28T18:57:55.356598] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-28T18:57:55.356691] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-28T18:57:55.357768] [DEBUG] [LOCAL ] GEL: Trimmed 47825 records to 30623 (keeping 200 days of data) [2025-10-28T18:57:55.536785] [DEBUG] [LOCAL ] GEL: Primary data saved (30623 records). [2025-10-28T18:57:55.536910] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-28T18:57:55.536991] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GEL took 38.2s. Estimated remaining: 3h 7m 36s. Rate: 7.7 symbols/min [2025-10-28T18:57:55.711755] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:55.748870] [DEBUG] [LOCAL ] GES: Loaded 37496 existing records from primary storage. [2025-10-28T18:57:55.749190] [INFO ] [MAIN ] GES: Loaded 37496 existing records. [2025-10-28T18:57:55.954155] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:55.954438] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-28T18:57:55.954491] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-28T18:57:55.954799] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-28T18:57:55.954859] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-28T18:57:56.312713] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:56.313129] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-28T18:57:56.346112] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T18:57:56.561133] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-28T18:57:57.991690] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T18:57:58.002398] [INFO ] [REMOTE ] GENI: Full fetch complete (76065 records). [2025-10-28T18:57:58.002598] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-28T18:57:58.390489] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-28T18:57:58.390625] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-28T18:57:58.391797] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-28T18:57:58.391864] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-28T18:57:58.393232] [DEBUG] [LOCAL ] GENI: Trimmed 76065 records to 52850 (keeping 200 days of data) [2025-10-28T18:57:58.699126] [DEBUG] [LOCAL ] GENI: Primary data saved (52850 records). [2025-10-28T18:57:58.699261] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-28T18:57:58.699357] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GENI took 26.4s. Estimated remaining: 3h 7m 21s. Rate: 7.8 symbols/min [2025-10-28T18:57:58.876874] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:58.909201] [DEBUG] [LOCAL ] GETY: Loaded 35015 existing records from primary storage. [2025-10-28T18:57:58.909452] [INFO ] [MAIN ] GETY: Loaded 35015 existing records. [2025-10-28T18:57:59.082820] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:59.083093] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-28T18:57:59.083145] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-28T18:57:59.083494] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-28T18:57:59.083553] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-28T18:57:59.443903] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:59.444189] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-28T18:58:03.460005] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (19.70 seconds). [2025-10-28T18:58:03.471602] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-28T18:58:05.566755] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T18:58:05.578496] [INFO ] [REMOTE ] GE: Full fetch complete (77857 records). [2025-10-28T18:58:05.578699] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-28T18:58:05.990078] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-28T18:58:05.990162] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-28T18:58:05.991237] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-28T18:58:05.991302] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-28T18:58:05.992853] [DEBUG] [LOCAL ] GE: Trimmed 77857 records to 53688 (keeping 200 days of data) [2025-10-28T18:58:06.351420] [DEBUG] [LOCAL ] GE: Primary data saved (53688 records). [2025-10-28T18:58:06.351564] [INFO ] [MAIN ] GE: Full history saved. [2025-10-28T18:58:06.352570] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GE took 57.0s. Estimated remaining: 3h 7m 13s. Rate: 7.8 symbols/min [2025-10-28T18:58:06.581554] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:58:06.653032] [DEBUG] [LOCAL ] GEV: Loaded 52985 existing records from primary storage. [2025-10-28T18:58:06.653507] [INFO ] [MAIN ] GEV: Loaded 52985 existing records. [2025-10-28T18:58:06.926670] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:58:06.926938] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-28T18:58:06.926997] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-28T18:58:06.927310] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-28T18:58:06.927368] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-28T18:58:07.166069] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (10.85 seconds). [2025-10-28T18:58:07.208516] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-28T18:58:07.449962] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:58:07.450283] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-28T18:58:08.340719] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T18:58:08.349441] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-28T18:58:09.598557] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T18:58:09.608842] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-28T18:58:10.812105] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:58:10.822150] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-28T18:58:11.884818] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:58:11.892828] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-28T18:58:12.971140] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T18:58:12.979523] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-28T18:58:17.352764] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (17.91 seconds). [2025-10-28T18:58:17.362339] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-28T18:58:17.617312] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (26.66 seconds). [2025-10-28T18:58:17.629064] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-28T18:58:18.583438] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:58:18.592063] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-28T18:58:19.046676] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:58:19.059591] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-28T18:58:20.454338] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:58:20.465100] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-28T18:58:22.040587] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:58:22.052770] [INFO ] [REMOTE ] GEO: Full fetch complete (75374 records). [2025-10-28T18:58:22.052947] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-28T18:58:22.442147] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-28T18:58:22.442243] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-28T18:58:22.443181] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-28T18:58:22.443246] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-28T18:58:22.444709] [DEBUG] [LOCAL ] GEO: Trimmed 75374 records to 51534 (keeping 200 days of data) [2025-10-28T18:58:22.738704] [DEBUG] [LOCAL ] GEO: Primary data saved (51534 records). [2025-10-28T18:58:22.738843] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-28T18:58:22.738920] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GEO took 46.9s. Estimated remaining: 3h 7m 19s. Rate: 7.7 symbols/min [2025-10-28T18:58:22.906387] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:58:22.911220] [DEBUG] [LOCAL ] GF: Loaded 2566 existing records from primary storage. [2025-10-28T18:58:22.911359] [INFO ] [MAIN ] GF: Loaded 2566 existing records. [2025-10-28T18:58:23.084537] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:58:23.084750] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-28T18:58:23.084815] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-28T18:58:23.084936] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-28T18:58:23.084974] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-28T18:58:23.435138] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:58:23.435477] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-28T18:58:32.479550] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (13.89 seconds). [2025-10-28T18:58:32.489255] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-28T18:58:32.550545] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (25.10 seconds). [2025-10-28T18:58:32.561384] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-28T18:58:33.595536] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:58:33.603941] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-28T18:58:34.339743] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T18:58:34.349842] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-28T18:58:34.531607] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:58:34.539144] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-28T18:58:35.589306] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:58:35.597249] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-28T18:58:36.046710] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T18:58:36.057958] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-28T18:58:37.778260] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (14.34 seconds). [2025-10-28T18:58:37.779539] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-28T18:58:37.982533] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T18:58:37.993678] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-28T18:58:38.220595] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T18:58:38.222130] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-28T18:58:38.696554] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T18:58:38.698598] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-28T18:58:39.073674] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:58:39.075101] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-28T18:58:39.909129] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T18:58:39.920434] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-28T18:58:41.634551] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-28T18:58:41.645388] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-28T18:58:43.058437] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (30.08 seconds). [2025-10-28T18:58:43.066797] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-28T18:58:44.190315] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T18:58:44.198837] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-28T18:58:45.146234] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T18:58:45.154622] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-28T18:58:51.128992] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (15.53 seconds). [2025-10-28T18:58:51.137875] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-28T18:58:52.171888] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:58:52.179854] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-28T18:58:52.437248] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (13.36 seconds). [2025-10-28T18:58:52.439040] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-28T18:58:52.749583] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T18:58:52.750962] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-28T18:58:53.054315] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:58:53.055679] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-28T18:58:53.074964] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T18:58:53.082634] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-28T18:58:53.434271] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:58:53.435510] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-28T18:58:53.719158] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:58:53.720883] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-28T18:58:54.118105] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:58:54.135140] [INFO ] [REMOTE ] GETY: Full fetch complete (55178 records). [2025-10-28T18:58:54.135361] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-28T18:58:54.331600] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:58:54.339525] [INFO ] [REMOTE ] GF: Full fetch complete (4816 records). [2025-10-28T18:58:54.361502] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-28T18:58:55.061226] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-28T18:58:55.061586] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-28T18:58:55.072914] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-28T18:58:55.078135] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-28T18:58:55.136707] [DEBUG] [LOCAL ] GETY: Trimmed 55178 records to 34895 (keeping 200 days of data) [2025-10-28T18:58:55.143588] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-28T18:58:55.143725] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-28T18:58:55.144050] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-28T18:58:55.144116] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-28T18:58:55.144735] [DEBUG] [LOCAL ] GF: Trimmed 4816 records to 2523 (keeping 200 days of data) [2025-10-28T18:58:55.237429] [DEBUG] [LOCAL ] GF: Primary data saved (2523 records). [2025-10-28T18:58:55.246759] [INFO ] [MAIN ] GF: Full history saved. [2025-10-28T18:58:55.248428] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GF took 32.5s. Estimated remaining: 3h 7m 50s. Rate: 7.7 symbols/min [2025-10-28T18:58:55.351296] [DEBUG] [LOCAL ] GETY: Primary data saved (34895 records). [2025-10-28T18:58:55.351459] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-28T18:58:55.351560] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GETY took 56.7s. Estimated remaining: 3h 7m 30s. Rate: 7.7 symbols/min [2025-10-28T18:58:56.874751] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (11.72 seconds). [2025-10-28T18:58:56.883085] [INFO ] [REMOTE ] GES: Full fetch complete (58055 records). [2025-10-28T18:58:56.883384] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-28T18:58:57.282884] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-28T18:58:57.282971] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-28T18:58:57.283830] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-28T18:58:57.283893] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-28T18:58:57.285409] [DEBUG] [LOCAL ] GES: Trimmed 58055 records to 37330 (keeping 200 days of data) [2025-10-28T18:58:57.508821] [DEBUG] [LOCAL ] GES: Primary data saved (37330 records). [2025-10-28T18:58:57.508965] [INFO ] [MAIN ] GES: Full history saved. [2025-10-28T18:58:57.509069] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GES took 1m 2s. Estimated remaining: 3h 7m 14s. Rate: 7.7 symbols/min [2025-10-28T18:59:06.613865] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (24.97 seconds). [2025-10-28T18:59:06.627033] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-28T18:59:08.673623] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-28T18:59:08.684529] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-28T18:59:10.781835] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-28T18:59:10.793196] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-28T18:59:23.563014] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (12.77 seconds). [2025-10-28T18:59:23.573816] [INFO ] [REMOTE ] GEV: Full fetch complete (77059 records). [2025-10-28T18:59:23.573948] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-28T18:59:23.964498] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-28T18:59:23.964574] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-28T18:59:23.965548] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-28T18:59:23.965614] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-28T18:59:23.967179] [DEBUG] [LOCAL ] GEV: Trimmed 77059 records to 52982 (keeping 200 days of data) [2025-10-28T18:59:24.301468] [DEBUG] [LOCAL ] GEV: Primary data saved (52982 records). [2025-10-28T18:59:24.301611] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-28T18:59:24.302558] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GEV took 1m 18s. Estimated remaining: 3h 7m 36s. Rate: 7.7 symbols/min [2025-10-28T18:59:24.829816] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:24.953308] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:25.019201] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:25.038311] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:25.055340] [DEBUG] [LOCAL ] GFR: Loaded 6925 existing records from primary storage. [2025-10-28T18:59:25.055824] [INFO ] [MAIN ] GFR: Loaded 6925 existing records. [2025-10-28T18:59:25.154581] [DEBUG] [LOCAL ] GFF: Loaded 28918 existing records from primary storage. [2025-10-28T18:59:25.181123] [INFO ] [MAIN ] GFF: Loaded 28918 existing records. [2025-10-28T18:59:25.346043] [DEBUG] [LOCAL ] GFI: Loaded 53115 existing records from primary storage. [2025-10-28T18:59:25.381954] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:25.393259] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-28T18:59:25.387829] [INFO ] [MAIN ] GFI: Loaded 53115 existing records. [2025-10-28T18:59:25.406427] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-28T18:59:25.416409] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-28T18:59:25.452549] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-28T18:59:25.490802] [DEBUG] [LOCAL ] GFL: Loaded 47263 existing records from primary storage. [2025-10-28T18:59:25.585748] [INFO ] [MAIN ] GFL: Loaded 47263 existing records. [2025-10-28T18:59:25.703236] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:25.754525] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-28T18:59:25.759936] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-28T18:59:25.789481] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-28T18:59:25.822595] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-28T18:59:26.018591] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:26.186344] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-28T18:59:26.223457] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-28T18:59:26.273831] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:26.289534] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-28T18:59:26.294766] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-28T18:59:26.345329] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-28T18:59:26.350509] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-28T18:59:26.393715] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-28T18:59:26.387778] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-28T18:59:26.787704] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:26.798699] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-28T18:59:27.013144] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:27.109958] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-28T18:59:27.401054] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:27.407357] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-28T18:59:27.443963] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:27.444256] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-28T18:59:28.515991] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T18:59:28.525189] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-28T18:59:28.627403] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:59:28.637470] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-28T18:59:29.984288] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:59:29.994283] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-28T18:59:30.107016] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (3.31 seconds). [2025-10-28T18:59:30.109431] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-28T18:59:30.786371] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:59:30.788615] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-28T18:59:31.767749] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T18:59:31.778785] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-28T18:59:36.630176] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (9.52 seconds). [2025-10-28T18:59:36.636190] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-28T18:59:37.746178] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:59:37.755512] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-28T18:59:38.697022] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T18:59:38.705071] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-28T18:59:39.878110] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:59:39.886633] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-28T18:59:42.990753] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (14.47 seconds). [2025-10-28T18:59:42.999751] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-28T18:59:44.301546] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:59:44.312240] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-28T18:59:45.584486] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:59:45.595061] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-28T18:59:46.135991] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (15.35 seconds). [2025-10-28T18:59:46.139271] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-28T18:59:46.223164] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (14.44 seconds). [2025-10-28T18:59:46.238806] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-28T18:59:46.743081] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T18:59:46.747717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-28T18:59:46.967770] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:59:46.978576] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-28T18:59:47.274456] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:59:47.277668] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-28T18:59:47.783437] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T18:59:47.786292] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T18:59:47.800729] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-28T18:59:47.802441] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-28T18:59:47.898881] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (8.01 seconds). [2025-10-28T18:59:47.906168] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-28T18:59:48.116309] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T18:59:48.118551] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-28T18:59:48.564516] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:59:48.567011] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-28T18:59:48.829448] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:59:48.835530] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-28T18:59:49.034211] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:59:49.036733] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-28T18:59:49.388326] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T18:59:49.398915] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-28T18:59:49.723991] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:59:49.730098] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-28T18:59:51.034142] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T18:59:51.045797] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-28T18:59:52.673412] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T18:59:52.684549] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-28T19:00:00.943176] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (11.21 seconds). [2025-10-28T19:00:00.950864] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-28T19:00:01.788030] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T19:00:01.794304] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-28T19:00:03.003396] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T19:00:03.013910] [INFO ] [REMOTE ] GFF: Full fetch complete (43408 records). [2025-10-28T19:00:03.014161] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-28T19:00:03.411065] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-28T19:00:03.411157] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-28T19:00:03.411896] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-28T19:00:03.411958] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-28T19:00:03.413039] [DEBUG] [LOCAL ] GFF: Trimmed 43408 records to 28815 (keeping 200 days of data) [2025-10-28T19:00:03.586404] [DEBUG] [LOCAL ] GFF: Primary data saved (28815 records). [2025-10-28T19:00:03.586575] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-28T19:00:03.587588] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFF took 39.3s. Estimated remaining: 3h 8m 17s. Rate: 7.7 symbols/min [2025-10-28T19:00:03.760287] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:00:03.812625] [DEBUG] [LOCAL ] GGB: Loaded 51546 existing records from primary storage. [2025-10-28T19:00:03.812965] [INFO ] [MAIN ] GGB: Loaded 51546 existing records. [2025-10-28T19:00:03.991357] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:00:03.991599] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-28T19:00:03.991670] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-28T19:00:03.992246] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-28T19:00:03.992303] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-28T19:00:04.342954] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:00:04.343242] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-28T19:00:05.890514] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T19:00:05.900825] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-28T19:00:14.189087] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (27.21 seconds). [2025-10-28T19:00:14.198629] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-28T19:00:15.773620] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (26.74 seconds). [2025-10-28T19:00:15.775324] [INFO ] [REMOTE ] GFR: Full fetch complete (11848 records). [2025-10-28T19:00:15.775398] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-28T19:00:16.169096] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-28T19:00:16.169188] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-28T19:00:16.169532] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-28T19:00:16.169576] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-28T19:00:16.170065] [DEBUG] [LOCAL ] GFR: Trimmed 11848 records to 6871 (keeping 200 days of data) [2025-10-28T19:00:16.210966] [DEBUG] [LOCAL ] GFR: Primary data saved (6871 records). [2025-10-28T19:00:16.211101] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-28T19:00:16.211221] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GFR took 51.9s. Estimated remaining: 3h 8m 17s. Rate: 7.7 symbols/min [2025-10-28T19:00:16.409017] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:00:16.447965] [DEBUG] [LOCAL ] GGG: Loaded 40459 existing records from primary storage. [2025-10-28T19:00:16.448269] [INFO ] [MAIN ] GGG: Loaded 40459 existing records. [2025-10-28T19:00:16.673320] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:00:16.673612] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-28T19:00:16.673708] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-28T19:00:16.674172] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-28T19:00:16.674239] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-28T19:00:17.033003] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:00:17.033317] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-28T19:00:18.475135] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T19:00:18.483533] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-28T19:00:19.735455] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:00:19.743347] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-28T19:00:35.785019] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (43.10 seconds). [2025-10-28T19:00:35.796773] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-28T19:00:37.935102] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-28T19:00:37.945791] [INFO ] [REMOTE ] GFI: Full fetch complete (77030 records). [2025-10-28T19:00:37.945916] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-28T19:00:38.339884] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-28T19:00:38.340096] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-28T19:00:38.341105] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-28T19:00:38.341178] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-28T19:00:38.365760] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (18.62 seconds). [2025-10-28T19:00:38.374679] [DEBUG] [LOCAL ] GFI: Trimmed 77030 records to 53115 (keeping 200 days of data) [2025-10-28T19:00:38.375495] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-28T19:00:38.695685] [DEBUG] [LOCAL ] GFI: Primary data saved (53115 records). [2025-10-28T19:00:38.695834] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-28T19:00:38.695915] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GFI took 1m 14s. Estimated remaining: 3h 8m 32s. Rate: 7.7 symbols/min [2025-10-28T19:00:38.863148] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:00:38.914998] [DEBUG] [LOCAL ] GGT: Loaded 14417 existing records from primary storage. [2025-10-28T19:00:38.915261] [INFO ] [MAIN ] GGT: Loaded 14417 existing records. [2025-10-28T19:00:39.103506] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:00:39.103734] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-28T19:00:39.103787] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-28T19:00:39.104025] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-28T19:00:39.104067] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-28T19:00:39.464100] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:00:39.464536] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-28T19:00:39.631709] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:00:39.641811] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-28T19:00:40.009158] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:00:40.011263] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-28T19:00:40.572722] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T19:00:40.575106] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-28T19:00:40.804890] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T19:00:40.813580] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-28T19:00:41.870289] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:00:41.880736] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-28T19:00:43.076093] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T19:00:43.085613] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-28T19:00:46.798083] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (6.22 seconds). [2025-10-28T19:00:46.802341] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-28T19:00:51.474188] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (45.57 seconds). [2025-10-28T19:00:51.483803] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-28T19:00:52.741095] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:00:52.752434] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-28T19:01:02.048534] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (18.96 seconds). [2025-10-28T19:01:02.056990] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-28T19:01:03.105831] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:01:03.114416] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-28T19:01:05.815277] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (19.01 seconds). [2025-10-28T19:01:05.818452] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-28T19:01:06.498705] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T19:01:06.503638] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-28T19:01:07.187622] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T19:01:07.191728] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-28T19:01:07.804569] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:01:07.808489] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-28T19:01:08.368718] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:01:08.372072] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-28T19:01:09.027195] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:01:09.031023] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-28T19:01:17.862139] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (63.66 seconds). [2025-10-28T19:01:17.872306] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-28T19:01:22.320668] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (29.57 seconds). [2025-10-28T19:01:22.331267] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-28T19:01:23.768538] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T19:01:23.779610] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-28T19:01:36.853628] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (33.74 seconds). [2025-10-28T19:01:36.862264] [INFO ] [REMOTE ] GGG: Full fetch complete (59611 records). [2025-10-28T19:01:36.862442] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-28T19:01:37.315447] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-28T19:01:37.315598] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-28T19:01:37.316465] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-28T19:01:37.316547] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-28T19:01:37.317858] [DEBUG] [LOCAL ] GGG: Trimmed 59611 records to 40372 (keeping 200 days of data) [2025-10-28T19:01:37.572357] [DEBUG] [LOCAL ] GGG: Primary data saved (40372 records). [2025-10-28T19:01:37.572485] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-28T19:01:37.573286] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GGG took 1m 21s. Estimated remaining: 3h 9m 44s. Rate: 7.6 symbols/min [2025-10-28T19:01:37.738953] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:01:37.744491] [DEBUG] [LOCAL ] GGZ: Loaded 2291 existing records from primary storage. [2025-10-28T19:01:37.744721] [INFO ] [MAIN ] GGZ: Loaded 2291 existing records. [2025-10-28T19:01:37.916064] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:01:37.916306] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-28T19:01:37.916353] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-28T19:01:37.916549] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-28T19:01:37.916607] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-28T19:01:38.270732] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:01:38.271058] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-28T19:01:38.642482] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:01:38.644217] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-28T19:01:38.931188] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:01:38.932963] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-28T19:01:39.258102] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T19:01:39.259434] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-28T19:01:39.571393] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T19:01:39.573094] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-28T19:01:39.932240] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (30.90 seconds). [2025-10-28T19:01:39.935625] [INFO ] [REMOTE ] GGT: Full fetch complete (19111 records). [2025-10-28T19:01:39.935722] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-28T19:01:40.307836] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-28T19:01:40.307927] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-28T19:01:40.308332] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-28T19:01:40.308390] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-28T19:01:40.308967] [DEBUG] [LOCAL ] GGT: Trimmed 19111 records to 14413 (keeping 200 days of data) [2025-10-28T19:01:40.390731] [DEBUG] [LOCAL ] GGT: Primary data saved (14413 records). [2025-10-28T19:01:40.390859] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-28T19:01:40.390932] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGT took 1m 2s. Estimated remaining: 3h 9m 28s. Rate: 7.6 symbols/min [2025-10-28T19:01:40.559429] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:01:40.564541] [DEBUG] [LOCAL ] GHC: Loaded 2950 existing records from primary storage. [2025-10-28T19:01:40.564718] [INFO ] [MAIN ] GHC: Loaded 2950 existing records. [2025-10-28T19:01:40.739511] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:01:40.739752] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-28T19:01:40.739807] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-28T19:01:40.739932] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-28T19:01:40.739971] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-28T19:01:41.105436] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:01:41.105803] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-28T19:01:41.476046] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:01:41.477876] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-28T19:01:41.840274] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T19:01:41.842016] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-28T19:01:42.221873] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T19:01:42.223334] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-28T19:01:42.668175] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T19:01:42.669405] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-28T19:01:43.028018] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T19:01:43.029378] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-28T19:01:43.450671] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T19:01:43.452682] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-28T19:01:46.513606] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (28.64 seconds). [2025-10-28T19:01:46.523353] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-28T19:01:47.777405] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T19:01:47.788155] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-28T19:01:49.093228] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T19:01:49.104203] [INFO ] [REMOTE ] GFL: Full fetch complete (69552 records). [2025-10-28T19:01:49.104416] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-28T19:01:49.510379] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-28T19:01:49.510471] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-28T19:01:49.511380] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-28T19:01:49.511443] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-28T19:01:49.512860] [DEBUG] [LOCAL ] GFL: Trimmed 69552 records to 47208 (keeping 200 days of data) [2025-10-28T19:01:49.798279] [DEBUG] [LOCAL ] GFL: Primary data saved (47208 records). [2025-10-28T19:01:49.798420] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-28T19:01:49.798519] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GFL took 2m 25s. Estimated remaining: 3h 9m 23s. Rate: 7.6 symbols/min [2025-10-28T19:01:49.973907] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:01:49.979785] [DEBUG] [LOCAL ] GHG: Loaded 3268 existing records from primary storage. [2025-10-28T19:01:49.979974] [INFO ] [MAIN ] GHG: Loaded 3268 existing records. [2025-10-28T19:01:50.161270] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:01:50.161500] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-28T19:01:50.161548] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-28T19:01:50.161831] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-28T19:01:50.161902] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-28T19:01:50.533446] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:01:50.533818] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-28T19:01:50.814606] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-28T19:01:50.815574] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-28T19:01:51.109615] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:01:51.111002] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-28T19:02:06.420762] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (42.64 seconds). [2025-10-28T19:02:06.433938] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-28T19:02:07.877689] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (28.30 seconds). [2025-10-28T19:02:07.879637] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-28T19:02:07.881217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T19:02:07.893579] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-28T19:02:08.174830] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T19:02:08.176021] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-28T19:02:08.478765] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:02:08.480148] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-28T19:02:08.800995] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (25.35 seconds). [2025-10-28T19:02:08.802387] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-28T19:02:08.822121] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T19:02:08.823300] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-28T19:02:09.081708] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-28T19:02:09.082922] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-28T19:02:09.433370] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T19:02:09.434740] [INFO ] [REMOTE ] GGZ: Full fetch complete (3763 records). [2025-10-28T19:02:09.434826] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-28T19:02:09.714820] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (18.60 seconds). [2025-10-28T19:02:09.751874] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-28T19:02:09.839570] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-28T19:02:09.839714] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-28T19:02:09.839974] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-28T19:02:09.840042] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-28T19:02:09.840610] [DEBUG] [LOCAL ] GGZ: Trimmed 3763 records to 2283 (keeping 200 days of data) [2025-10-28T19:02:09.860903] [DEBUG] [LOCAL ] GGZ: Primary data saved (2283 records). [2025-10-28T19:02:09.861037] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-28T19:02:09.861123] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GGZ took 32.3s. Estimated remaining: 3h 9m 34s. Rate: 7.6 symbols/min [2025-10-28T19:02:10.055934] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:10.067116] [DEBUG] [LOCAL ] GHI: Loaded 8001 existing records from primary storage. [2025-10-28T19:02:10.067325] [INFO ] [MAIN ] GHI: Loaded 8001 existing records. [2025-10-28T19:02:10.182880] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T19:02:10.195313] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-28T19:02:10.262370] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:10.262596] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-28T19:02:10.262662] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-28T19:02:10.263060] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-28T19:02:10.263121] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-28T19:02:10.640607] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:10.645163] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-28T19:02:10.646763] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:02:10.648869] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-28T19:02:11.287390] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T19:02:11.290201] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-28T19:02:11.428480] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T19:02:11.429560] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-28T19:02:11.696235] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:02:11.698140] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-28T19:02:11.822443] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T19:02:11.823949] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-28T19:02:12.114880] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T19:02:12.116105] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-28T19:02:12.184185] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T19:02:12.186825] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-28T19:02:12.417521] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T19:02:12.419956] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-28T19:02:13.133129] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T19:02:13.134410] [INFO ] [REMOTE ] GHG: Full fetch complete (4220 records). [2025-10-28T19:02:13.134488] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-28T19:02:13.513158] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-28T19:02:13.513237] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-28T19:02:13.513383] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-28T19:02:13.513423] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-28T19:02:13.513830] [DEBUG] [LOCAL ] GHG: Trimmed 4220 records to 3266 (keeping 200 days of data) [2025-10-28T19:02:13.531960] [DEBUG] [LOCAL ] GHG: Primary data saved (3266 records). [2025-10-28T19:02:13.532036] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-28T19:02:13.532105] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GHG took 23.7s. Estimated remaining: 3h 9m 19s. Rate: 7.6 symbols/min [2025-10-28T19:02:13.708159] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:13.715093] [DEBUG] [LOCAL ] GHLD: Loaded 4334 existing records from primary storage. [2025-10-28T19:02:13.715281] [INFO ] [MAIN ] GHLD: Loaded 4334 existing records. [2025-10-28T19:02:13.910254] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:13.910473] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-28T19:02:13.910559] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-28T19:02:13.910745] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-28T19:02:13.910809] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-28T19:02:14.263109] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:14.263413] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-28T19:02:15.463636] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (3.28 seconds). [2025-10-28T19:02:15.465881] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-28T19:02:15.849279] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T19:02:15.850237] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-28T19:02:17.222866] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T19:02:17.223805] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-28T19:02:17.563382] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T19:02:17.564750] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-28T19:02:17.661525] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-28T19:02:17.663522] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-28T19:02:17.880302] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-28T19:02:17.881637] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-28T19:02:18.187078] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T19:02:18.188529] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-28T19:02:18.649890] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T19:02:18.652470] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-28T19:02:20.368929] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-28T19:02:20.371353] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-28T19:02:20.888847] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T19:02:20.892242] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-28T19:02:21.475741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:02:21.478433] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-28T19:02:21.965370] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T19:02:21.967977] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-28T19:02:23.101031] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (4.45 seconds). [2025-10-28T19:02:23.102959] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-28T19:02:32.680733] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (24.79 seconds). [2025-10-28T19:02:32.691746] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-28T19:02:33.202165] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (24.40 seconds). [2025-10-28T19:02:33.203460] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-28T19:02:33.937436] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T19:02:33.952772] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-28T19:02:34.414203] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:02:34.415832] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-28T19:02:34.939543] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:02:34.941205] [INFO ] [REMOTE ] GHC: Full fetch complete (3717 records). [2025-10-28T19:02:34.941277] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-28T19:02:35.331209] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-28T19:02:35.331352] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-28T19:02:35.331535] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-28T19:02:35.331691] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-28T19:02:35.332331] [DEBUG] [LOCAL ] GHC: Trimmed 3717 records to 2943 (keeping 200 days of data) [2025-10-28T19:02:35.352546] [DEBUG] [LOCAL ] GHC: Primary data saved (2943 records). [2025-10-28T19:02:35.352767] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-28T19:02:35.352880] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GHC took 55.0s. Estimated remaining: 3h 9m 33s. Rate: 7.6 symbols/min [2025-10-28T19:02:35.510475] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T19:02:35.577082] [INFO ] [REMOTE ] GGB: Full fetch complete (74374 records). [2025-10-28T19:02:35.578898] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-28T19:02:35.578639] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:35.720366] [DEBUG] [LOCAL ] GHM: Loaded 14338 existing records from primary storage. [2025-10-28T19:02:35.736223] [INFO ] [MAIN ] GHM: Loaded 14338 existing records. [2025-10-28T19:02:36.142102] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:36.162809] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-28T19:02:36.179112] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-28T19:02:36.234727] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-28T19:02:36.234816] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-28T19:02:36.234917] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-28T19:02:36.235080] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-28T19:02:36.236261] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-28T19:02:36.279538] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-28T19:02:36.361962] [DEBUG] [LOCAL ] GGB: Trimmed 74374 records to 51530 (keeping 200 days of data) [2025-10-28T19:02:36.731611] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:36.736009] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-28T19:02:36.943481] [DEBUG] [LOCAL ] GGB: Primary data saved (51530 records). [2025-10-28T19:02:36.943627] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-28T19:02:36.943767] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GGB took 2m 33s. Estimated remaining: 3h 9m 15s. Rate: 7.6 symbols/min [2025-10-28T19:02:37.116075] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:37.137724] [DEBUG] [LOCAL ] GHY: Loaded 20669 existing records from primary storage. [2025-10-28T19:02:37.137974] [INFO ] [MAIN ] GHY: Loaded 20669 existing records. [2025-10-28T19:02:37.320497] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:37.320790] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-28T19:02:37.320840] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-28T19:02:37.320998] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-28T19:02:37.321036] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-28T19:02:37.499311] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T19:02:37.520458] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-28T19:02:37.757425] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:37.757891] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-28T19:02:38.662472] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T19:02:38.669272] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-28T19:02:39.062782] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (17.09 seconds). [2025-10-28T19:02:39.066370] [INFO ] [REMOTE ] GHI: Full fetch complete (11344 records). [2025-10-28T19:02:39.066449] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-28T19:02:39.504330] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-28T19:02:39.504409] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-28T19:02:39.504974] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-28T19:02:39.505039] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-28T19:02:39.505546] [DEBUG] [LOCAL ] GHI: Trimmed 11344 records to 8022 (keeping 200 days of data) [2025-10-28T19:02:39.557211] [DEBUG] [LOCAL ] GHI: Primary data saved (8022 records). [2025-10-28T19:02:39.557329] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-28T19:02:39.557406] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHI took 29.7s. Estimated remaining: 3h 8m 59s. Rate: 7.6 symbols/min [2025-10-28T19:02:39.731139] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:39.762686] [DEBUG] [LOCAL ] GIB: Loaded 30975 existing records from primary storage. [2025-10-28T19:02:39.762989] [INFO ] [MAIN ] GIB: Loaded 30975 existing records. [2025-10-28T19:02:39.936126] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:39.936316] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-28T19:02:39.936363] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-28T19:02:39.936613] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-28T19:02:39.936912] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-28T19:02:40.283133] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:40.283460] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-28T19:02:41.137982] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (18.04 seconds). [2025-10-28T19:02:41.149988] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-28T19:02:41.152238] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:02:41.158711] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-28T19:02:41.527517] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T19:02:41.529264] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-28T19:02:42.005997] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T19:02:42.011022] [INFO ] [REMOTE ] GHLD: Full fetch complete (5189 records). [2025-10-28T19:02:42.011166] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-28T19:02:42.363964] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-28T19:02:42.364112] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-28T19:02:42.364289] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-28T19:02:42.364330] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-28T19:02:42.364736] [DEBUG] [LOCAL ] GHLD: Trimmed 5189 records to 4340 (keeping 200 days of data) [2025-10-28T19:02:42.389758] [DEBUG] [LOCAL ] GHLD: Primary data saved (4340 records). [2025-10-28T19:02:42.389825] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-28T19:02:42.389893] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GHLD took 28.9s. Estimated remaining: 3h 8m 43s. Rate: 7.6 symbols/min [2025-10-28T19:02:42.556261] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:42.571334] [DEBUG] [LOCAL ] GIC: Loaded 12968 existing records from primary storage. [2025-10-28T19:02:42.571559] [INFO ] [MAIN ] GIC: Loaded 12968 existing records. [2025-10-28T19:02:42.747423] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:42.747733] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-28T19:02:42.747801] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-28T19:02:42.747999] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-28T19:02:42.748075] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-28T19:02:43.116485] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:43.116855] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-28T19:02:43.169390] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (5.65 seconds). [2025-10-28T19:02:43.174329] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-28T19:02:43.745077] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T19:02:43.749701] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-28T19:02:43.775940] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:02:43.779887] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-28T19:02:44.243748] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T19:02:44.247278] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-28T19:02:44.309610] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T19:02:44.312780] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-28T19:02:44.870455] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:02:44.873949] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-28T19:02:45.548226] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:02:45.552915] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-28T19:02:45.584785] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (6.92 seconds). [2025-10-28T19:02:45.589328] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-28T19:02:49.496734] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (5.25 seconds). [2025-10-28T19:02:49.500235] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-28T19:02:50.034290] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (8.88 seconds). [2025-10-28T19:02:50.040735] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-28T19:02:50.279452] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:02:50.283544] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-28T19:02:50.812722] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T19:02:50.815933] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-28T19:02:51.288369] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T19:02:51.297174] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-28T19:02:51.449990] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T19:02:51.454629] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-28T19:02:52.016153] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T19:02:52.020075] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-28T19:02:52.726356] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T19:02:52.731034] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-28T19:02:53.334813] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:02:53.339323] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-28T19:02:53.883573] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (8.33 seconds). [2025-10-28T19:02:53.888277] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-28T19:02:54.132774] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T19:02:54.136069] [INFO ] [REMOTE ] GIC: Full fetch complete (19577 records). [2025-10-28T19:02:54.136255] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-28T19:02:54.554202] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-28T19:02:54.554630] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-28T19:02:54.555401] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-28T19:02:54.555517] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-28T19:02:54.562274] [DEBUG] [LOCAL ] GIC: Trimmed 19577 records to 12937 (keeping 200 days of data) [2025-10-28T19:02:54.572452] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T19:02:54.611858] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-28T19:02:54.671175] [DEBUG] [LOCAL ] GIC: Primary data saved (12937 records). [2025-10-28T19:02:54.671404] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-28T19:02:54.671533] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GIC took 12.3s. Estimated remaining: 3h 8m 42s. Rate: 7.6 symbols/min [2025-10-28T19:02:54.778794] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (9.19 seconds). [2025-10-28T19:02:54.811022] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-28T19:02:54.884781] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:54.924040] [DEBUG] [LOCAL ] GIL: Loaded 43844 existing records from primary storage. [2025-10-28T19:02:54.924322] [INFO ] [MAIN ] GIL: Loaded 43844 existing records. [2025-10-28T19:02:55.103058] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:55.103240] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-28T19:02:55.103286] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-28T19:02:55.103534] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-28T19:02:55.103590] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-28T19:02:55.423971] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T19:02:55.462877] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-28T19:02:55.495604] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:55.496204] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-28T19:02:55.649223] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T19:02:55.655831] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-28T19:02:56.140413] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T19:02:56.144059] [INFO ] [REMOTE ] GHM: Full fetch complete (21894 records). [2025-10-28T19:02:56.144134] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-28T19:02:56.523452] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-28T19:02:56.523623] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-28T19:02:56.524215] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-28T19:02:56.524318] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-28T19:02:56.525230] [DEBUG] [LOCAL ] GHM: Trimmed 21894 records to 14314 (keeping 200 days of data) [2025-10-28T19:02:56.605309] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:02:56.616289] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-28T19:02:56.638114] [DEBUG] [LOCAL ] GHM: Primary data saved (14314 records). [2025-10-28T19:02:56.638250] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-28T19:02:56.638332] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GHM took 21.3s. Estimated remaining: 3h 8m 25s. Rate: 7.6 symbols/min [2025-10-28T19:02:56.808938] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:56.855091] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-28T19:02:56.855375] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-28T19:02:57.028913] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:57.029108] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-28T19:02:57.029155] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-28T19:02:57.029339] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-28T19:02:57.029376] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-28T19:02:57.384394] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:57.384732] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-28T19:02:58.876038] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T19:02:58.887004] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-28T19:03:00.291338] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:03:00.301435] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-28T19:03:01.187429] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (9.89 seconds). [2025-10-28T19:03:01.195399] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-28T19:03:01.953941] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T19:03:01.965406] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-28T19:03:03.645245] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T19:03:03.656978] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-28T19:03:04.312792] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (7.70 seconds). [2025-10-28T19:03:04.321103] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-28T19:03:05.379857] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T19:03:05.391046] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-28T19:03:06.854275] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (11.20 seconds). [2025-10-28T19:03:06.859389] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-28T19:03:07.447427] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T19:03:07.451314] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-28T19:03:08.222113] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:03:08.229904] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-28T19:03:08.954982] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T19:03:08.960035] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-28T19:03:09.657520] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T19:03:09.662435] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-28T19:03:10.590929] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T19:03:10.596352] [INFO ] [REMOTE ] GHY: Full fetch complete (32116 records). [2025-10-28T19:03:10.596455] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-28T19:03:10.866079] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (9.67 seconds). [2025-10-28T19:03:10.922086] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-28T19:03:11.022041] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-28T19:03:11.022128] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-28T19:03:11.022809] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-28T19:03:11.022871] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-28T19:03:11.023769] [DEBUG] [LOCAL ] GHY: Trimmed 32116 records to 20622 (keeping 200 days of data) [2025-10-28T19:03:11.150556] [DEBUG] [LOCAL ] GHY: Primary data saved (20622 records). [2025-10-28T19:03:11.150714] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-28T19:03:11.150806] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GHY took 34.2s. Estimated remaining: 3h 8m 27s. Rate: 7.6 symbols/min [2025-10-28T19:03:11.328246] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:11.368097] [DEBUG] [LOCAL ] GKOS: Loaded 42292 existing records from primary storage. [2025-10-28T19:03:11.368460] [INFO ] [MAIN ] GKOS: Loaded 42292 existing records. [2025-10-28T19:03:11.552276] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:11.552469] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-28T19:03:11.552523] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-28T19:03:11.552836] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-28T19:03:11.552895] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-28T19:03:11.929934] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:11.930349] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-28T19:03:11.951827] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:03:11.959416] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-28T19:03:12.955955] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:03:12.964616] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-28T19:03:13.009480] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:03:13.017029] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-28T19:03:14.097275] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:03:14.105693] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-28T19:03:14.143346] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (8.75 seconds). [2025-10-28T19:03:14.155342] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-28T19:03:18.395724] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (14.07 seconds). [2025-10-28T19:03:18.405200] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-28T19:03:19.921688] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (6.90 seconds). [2025-10-28T19:03:19.930374] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-28T19:03:21.015367] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:03:21.024889] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-28T19:03:22.950128] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (8.84 seconds). [2025-10-28T19:03:22.957583] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-28T19:03:23.948505] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T19:03:23.971444] [INFO ] [REMOTE ] GIB: Full fetch complete (46491 records). [2025-10-28T19:03:23.986388] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-28T19:03:24.000337] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (9.84 seconds). [2025-10-28T19:03:24.120199] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-28T19:03:24.440614] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-28T19:03:24.440741] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-28T19:03:24.441459] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-28T19:03:24.441521] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-28T19:03:24.442604] [DEBUG] [LOCAL ] GIB: Trimmed 46491 records to 30851 (keeping 200 days of data) [2025-10-28T19:03:24.626705] [DEBUG] [LOCAL ] GIB: Primary data saved (30851 records). [2025-10-28T19:03:24.626828] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-28T19:03:24.626918] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIB took 45.1s. Estimated remaining: 3h 8m 28s. Rate: 7.6 symbols/min [2025-10-28T19:03:24.793315] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:24.828969] [DEBUG] [LOCAL ] GL: Loaded 37258 existing records from primary storage. [2025-10-28T19:03:24.829232] [INFO ] [MAIN ] GL: Loaded 37258 existing records. [2025-10-28T19:03:25.004409] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:25.004597] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-28T19:03:25.004664] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-28T19:03:25.004889] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-28T19:03:25.004931] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-28T19:03:25.354893] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:25.355190] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-28T19:03:25.557613] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:03:25.569239] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-28T19:03:26.512241] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:03:26.519969] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-28T19:03:27.034180] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T19:03:27.045743] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (8.64 seconds). [2025-10-28T19:03:27.056675] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-28T19:03:27.056338] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-28T19:03:28.263185] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T19:03:28.272177] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-28T19:03:31.058240] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (4.54 seconds). [2025-10-28T19:03:31.066183] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-28T19:03:31.152277] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (10.13 seconds). [2025-10-28T19:03:31.161832] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-28T19:03:32.378685] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:03:32.388310] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-28T19:03:32.421158] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:03:32.430837] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-28T19:03:33.539723] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:03:33.548946] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-28T19:03:33.637112] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:03:33.646686] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-28T19:03:34.695786] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:03:34.705362] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-28T19:03:34.878896] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:03:34.887452] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-28T19:03:35.862577] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:03:35.869535] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-28T19:03:37.103110] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:03:37.112747] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-28T19:03:37.342601] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (9.07 seconds). [2025-10-28T19:03:37.350966] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-28T19:03:38.571711] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T19:03:38.580762] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-28T19:03:39.371349] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (12.31 seconds). [2025-10-28T19:03:39.384606] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-28T19:03:39.384933] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-28T19:03:39.818571] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-28T19:03:39.818720] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-28T19:03:39.820132] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-28T19:03:39.820200] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-28T19:03:39.822345] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-28T19:03:40.184408] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-28T19:03:40.184608] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-28T19:03:40.184742] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GIS took 43.5s. Estimated remaining: 3h 8m 32s. Rate: 7.6 symbols/min [2025-10-28T19:03:40.364956] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:40.414939] [DEBUG] [LOCAL ] GLOB: Loaded 48001 existing records from primary storage. [2025-10-28T19:03:40.415349] [INFO ] [MAIN ] GLOB: Loaded 48001 existing records. [2025-10-28T19:03:40.618889] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:40.619154] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-28T19:03:40.619206] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-28T19:03:40.620236] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-28T19:03:40.620297] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-28T19:03:41.024769] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:41.025183] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-28T19:03:42.173388] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:03:42.180756] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-28T19:03:43.263970] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T19:03:43.271628] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-28T19:03:44.286525] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (9.58 seconds). [2025-10-28T19:03:44.296402] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-28T19:03:44.547953] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (5.97 seconds). [2025-10-28T19:03:44.558389] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-28T19:03:44.585048] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:03:44.594947] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-28T19:03:45.383674] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T19:03:45.392599] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-28T19:03:45.656404] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:03:45.667287] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-28T19:03:45.835732] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:03:45.844964] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-28T19:03:46.649731] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T19:03:46.658938] [INFO ] [REMOTE ] GKOS: Full fetch complete (60751 records). [2025-10-28T19:03:46.659123] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-28T19:03:47.082447] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-28T19:03:47.082635] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-28T19:03:47.083974] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-28T19:03:47.084063] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-28T19:03:47.110576] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:03:47.120033] [DEBUG] [LOCAL ] GKOS: Trimmed 60751 records to 42280 (keeping 200 days of data) [2025-10-28T19:03:47.121312] [INFO ] [REMOTE ] GIL: Full fetch complete (62689 records). [2025-10-28T19:03:47.121870] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-28T19:03:47.791850] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-28T19:03:47.788548] [DEBUG] [LOCAL ] GKOS: Primary data saved (42280 records). [2025-10-28T19:03:47.792048] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-28T19:03:47.793176] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-28T19:03:47.793266] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-28T19:03:47.793397] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-28T19:03:47.793755] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GKOS took 36.6s. Estimated remaining: 3h 8m 23s. Rate: 7.6 symbols/min [2025-10-28T19:03:47.871866] [DEBUG] [LOCAL ] GIL: Trimmed 62689 records to 43779 (keeping 200 days of data) [2025-10-28T19:03:48.091850] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:48.210543] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (11.10 seconds). [2025-10-28T19:03:48.280985] [DEBUG] [LOCAL ] GLP: Loaded 9104 existing records from primary storage. [2025-10-28T19:03:48.271253] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-28T19:03:48.303332] [INFO ] [MAIN ] GLP: Loaded 9104 existing records. [2025-10-28T19:03:48.320674] [DEBUG] [LOCAL ] GIL: Primary data saved (43779 records). [2025-10-28T19:03:48.355853] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-28T19:03:48.380578] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GIL took 53.7s. Estimated remaining: 3h 8m 4s. Rate: 7.6 symbols/min [2025-10-28T19:03:48.673827] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:48.709764] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:48.709863] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-28T19:03:48.710469] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-28T19:03:48.710993] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-28T19:03:48.711068] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-28T19:03:49.094797] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-28T19:03:49.106594] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-28T19:03:49.226680] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:49.250833] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-28T19:03:49.343559] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:49.343879] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-28T19:03:49.343931] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-28T19:03:49.345127] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-28T19:03:49.345189] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-28T19:03:49.727090] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:49.727468] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-28T19:03:50.050509] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:03:50.053789] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-28T19:03:50.695715] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:03:50.699029] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-28T19:03:51.037617] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:03:51.049012] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-28T19:03:51.272520] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T19:03:51.276088] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-28T19:03:51.753595] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T19:03:51.755983] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-28T19:03:52.240178] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T19:03:52.243295] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-28T19:03:52.336997] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:03:52.351302] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-28T19:03:52.618481] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:03:52.621718] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-28T19:03:52.746408] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (6.90 seconds). [2025-10-28T19:03:52.757929] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-28T19:03:52.959253] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (4.69 seconds). [2025-10-28T19:03:52.966553] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-28T19:03:53.102199] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:03:53.104557] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-28T19:03:53.624743] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T19:03:53.627847] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-28T19:03:53.876574] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:03:53.887327] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-28T19:03:53.942228] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T19:03:53.957488] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-28T19:03:54.193746] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T19:03:54.197276] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-28T19:03:54.944540] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:03:54.955364] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-28T19:03:55.367836] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:03:55.379180] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-28T19:03:56.062748] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T19:03:56.064881] [INFO ] [REMOTE ] GLP: Full fetch complete (14257 records). [2025-10-28T19:03:56.064969] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-28T19:03:56.430474] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-28T19:03:56.430559] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-28T19:03:56.430930] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-28T19:03:56.430997] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-28T19:03:56.431621] [DEBUG] [LOCAL ] GLP: Trimmed 14257 records to 9089 (keeping 200 days of data) [2025-10-28T19:03:56.486904] [DEBUG] [LOCAL ] GLP: Primary data saved (9089 records). [2025-10-28T19:03:56.487035] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-28T19:03:56.487112] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GLP took 8.7s. Estimated remaining: 3h 7m 57s. Rate: 7.6 symbols/min [2025-10-28T19:03:56.660639] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:56.713162] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-28T19:03:56.713574] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-28T19:03:56.910286] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:56.910910] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-28T19:03:56.910998] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-28T19:03:56.911240] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-28T19:03:56.911282] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-28T19:03:57.136381] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T19:03:57.232219] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-28T19:03:57.360301] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:57.360938] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-28T19:03:58.922393] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T19:03:58.924608] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (5.96 seconds). [2025-10-28T19:03:58.945862] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-28T19:03:58.946067] [INFO ] [REMOTE ] GL: Full fetch complete (54798 records). [2025-10-28T19:03:58.946453] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-28T19:03:59.342072] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-28T19:03:59.342177] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-28T19:03:59.343108] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-28T19:03:59.343214] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-28T19:03:59.344714] [DEBUG] [LOCAL ] GL: Trimmed 54798 records to 37187 (keeping 200 days of data) [2025-10-28T19:03:59.477025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-28T19:03:59.489377] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-28T19:03:59.612325] [DEBUG] [LOCAL ] GL: Primary data saved (37187 records). [2025-10-28T19:03:59.612461] [INFO ] [MAIN ] GL: Full history saved. [2025-10-28T19:03:59.612553] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GL took 35.0s. Estimated remaining: 3h 7m 42s. Rate: 7.6 symbols/min [2025-10-28T19:03:59.777768] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:59.828429] [DEBUG] [LOCAL ] GME: Loaded 53777 existing records from primary storage. [2025-10-28T19:03:59.828771] [INFO ] [MAIN ] GME: Loaded 53777 existing records. [2025-10-28T19:04:00.005167] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:00.005352] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-28T19:04:00.005399] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-28T19:04:00.005727] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-28T19:04:00.005783] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-28T19:04:00.353559] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:00.353887] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-28T19:04:01.213215] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T19:04:01.223292] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-28T19:04:02.326267] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-28T19:04:02.336787] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-28T19:04:02.489680] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (7.53 seconds). [2025-10-28T19:04:02.500791] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-28T19:04:02.821887] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T19:04:02.832918] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-28T19:04:03.844904] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:04:03.855718] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-28T19:04:04.708206] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-28T19:04:04.719379] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-28T19:04:05.233850] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:04:05.244221] [INFO ] [REMOTE ] GLOB: Full fetch complete (66724 records). [2025-10-28T19:04:05.244381] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-28T19:04:05.656716] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-28T19:04:05.656872] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-28T19:04:05.658092] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-28T19:04:05.658162] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-28T19:04:05.660097] [DEBUG] [LOCAL ] GLOB: Trimmed 66724 records to 48028 (keeping 200 days of data) [2025-10-28T19:04:05.981177] [DEBUG] [LOCAL ] GLOB: Primary data saved (48028 records). [2025-10-28T19:04:05.981337] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-28T19:04:05.981427] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GLOB took 25.8s. Estimated remaining: 3h 7m 31s. Rate: 7.6 symbols/min [2025-10-28T19:04:06.154754] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:06.195534] [DEBUG] [LOCAL ] GMED: Loaded 48055 existing records from primary storage. [2025-10-28T19:04:06.195843] [INFO ] [MAIN ] GMED: Loaded 48055 existing records. [2025-10-28T19:04:06.382897] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:06.383713] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-28T19:04:06.383781] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-28T19:04:06.384801] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-28T19:04:06.384866] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-28T19:04:06.531391] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (7.59 seconds). [2025-10-28T19:04:06.592848] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-28T19:04:06.739113] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-28T19:04:06.792632] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-28T19:04:06.880738] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:06.881139] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-28T19:04:08.185004] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T19:04:08.196819] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-28T19:04:08.229107] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T19:04:08.238699] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-28T19:04:08.317574] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T19:04:08.328856] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-28T19:04:09.504023] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:04:09.515733] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-28T19:04:09.912311] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T19:04:09.923717] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-28T19:04:10.915529] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:04:10.927395] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-28T19:04:11.740311] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T19:04:11.752813] [INFO ] [REMOTE ] GLW: Full fetch complete (77799 records). [2025-10-28T19:04:11.753283] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-28T19:04:12.219273] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-28T19:04:12.219379] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-28T19:04:12.220437] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-28T19:04:12.220500] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-28T19:04:12.222054] [DEBUG] [LOCAL ] GLW: Trimmed 77799 records to 53635 (keeping 200 days of data) [2025-10-28T19:04:12.542766] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-28T19:04:12.542903] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-28T19:04:12.542981] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GLW took 24.1s. Estimated remaining: 3h 7m 21s. Rate: 7.6 symbols/min [2025-10-28T19:04:12.727735] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:12.748993] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (10.41 seconds). [2025-10-28T19:04:12.759935] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-28T19:04:12.791345] [DEBUG] [LOCAL ] GMRE: Loaded 35708 existing records from primary storage. [2025-10-28T19:04:12.791625] [INFO ] [MAIN ] GMRE: Loaded 35708 existing records. [2025-10-28T19:04:12.975249] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:12.975566] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-28T19:04:12.975615] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-28T19:04:12.975955] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-28T19:04:12.976016] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-28T19:04:13.333698] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:13.333997] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-28T19:04:14.653606] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T19:04:14.665118] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-28T19:04:18.706287] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (5.37 seconds). [2025-10-28T19:04:18.713705] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-28T19:04:19.705412] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:04:19.712319] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-28T19:04:20.693333] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T19:04:20.702180] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-28T19:04:20.848080] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (12.52 seconds). [2025-10-28T19:04:20.859814] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-28T19:04:21.822508] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:04:21.832371] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-28T19:04:22.838792] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:04:22.847428] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-28T19:04:23.769185] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (9.10 seconds). [2025-10-28T19:04:23.780146] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-28T19:04:24.018623] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:04:24.028115] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-28T19:04:25.946181] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-28T19:04:25.957767] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-28T19:04:28.106724] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-28T19:04:28.117613] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-28T19:04:28.968969] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (18.04 seconds). [2025-10-28T19:04:28.979230] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-28T19:04:29.777861] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (8.92 seconds). [2025-10-28T19:04:29.789299] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-28T19:04:30.054165] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-28T19:04:30.066428] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-28T19:04:30.255103] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:04:30.266277] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-28T19:04:31.158259] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:04:31.171465] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-28T19:04:31.343596] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:04:31.353357] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-28T19:04:34.420705] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (10.39 seconds). [2025-10-28T19:04:34.429177] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-28T19:04:35.565207] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:04:35.573604] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-28T19:04:36.646033] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:04:36.654287] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-28T19:04:37.572354] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:04:37.577490] [INFO ] [REMOTE ] GMRE: Full fetch complete (51232 records). [2025-10-28T19:04:37.577613] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-28T19:04:37.986117] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (6.81 seconds). [2025-10-28T19:04:38.013790] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-28T19:04:38.014000] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-28T19:04:38.015047] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-28T19:04:38.015169] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-28T19:04:38.015402] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-28T19:04:38.015490] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-28T19:04:38.016516] [DEBUG] [LOCAL ] GMRE: Trimmed 51232 records to 35511 (keeping 200 days of data) [2025-10-28T19:04:38.629144] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-28T19:04:38.629349] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-28T19:04:38.630920] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-28T19:04:38.632637] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-28T19:04:38.650219] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-28T19:04:38.709791] [DEBUG] [LOCAL ] GMRE: Primary data saved (35511 records). [2025-10-28T19:04:38.718513] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-28T19:04:38.718718] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GMRE took 26.2s. Estimated remaining: 3h 7m 41s. Rate: 7.6 symbols/min [2025-10-28T19:04:38.941265] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:39.064129] [DEBUG] [LOCAL ] GNE: Loaded 18127 existing records from primary storage. [2025-10-28T19:04:39.068950] [INFO ] [MAIN ] GNE: Loaded 18127 existing records. [2025-10-28T19:04:39.330366] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:39.342735] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-28T19:04:39.344724] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-28T19:04:39.347898] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-28T19:04:39.348471] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-28T19:04:39.392938] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-28T19:04:39.414284] [INFO ] [MAIN ] GM: Full history saved. [2025-10-28T19:04:39.414441] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GM took 42.9s. Estimated remaining: 3h 7m 22s. Rate: 7.6 symbols/min [2025-10-28T19:04:39.801011] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:39.888832] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:39.889216] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-28T19:04:39.921028] [DEBUG] [LOCAL ] GNK: Loaded 39008 existing records from primary storage. [2025-10-28T19:04:39.921327] [INFO ] [MAIN ] GNK: Loaded 39008 existing records. [2025-10-28T19:04:40.102239] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:40.102512] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-28T19:04:40.102569] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-28T19:04:40.102905] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-28T19:04:40.102963] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-28T19:04:40.468414] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:40.468943] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-28T19:04:40.480553] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T19:04:40.484094] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-28T19:04:40.959297] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:04:40.961889] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-28T19:04:41.533070] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:04:41.540421] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-28T19:04:42.526047] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:04:42.533561] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-28T19:04:42.634364] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T19:04:42.637181] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-28T19:04:43.247347] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T19:04:43.250341] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-28T19:04:43.850696] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T19:04:43.854439] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-28T19:04:44.301745] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (14.24 seconds). [2025-10-28T19:04:44.313216] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-28T19:04:44.655729] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T19:04:44.661495] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-28T19:04:45.459106] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T19:04:45.464769] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-28T19:04:46.096283] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T19:04:46.107880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-28T19:04:47.776112] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (5.24 seconds). [2025-10-28T19:04:47.785369] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-28T19:04:48.012523] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (16.66 seconds). [2025-10-28T19:04:48.023383] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-28T19:04:48.208203] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T19:04:48.219373] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-10-28T19:04:48.219541] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-28T19:04:48.618541] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-28T19:04:48.618622] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-28T19:04:48.619952] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-28T19:04:48.620025] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-28T19:04:48.621756] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 53776 (keeping 200 days of data) [2025-10-28T19:04:48.959359] [DEBUG] [LOCAL ] GME: Primary data saved (53776 records). [2025-10-28T19:04:48.959492] [INFO ] [MAIN ] GME: Full history saved. [2025-10-28T19:04:48.960078] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GME took 49.3s. Estimated remaining: 3h 7m 17s. Rate: 7.6 symbols/min [2025-10-28T19:04:49.126837] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:49.172934] [DEBUG] [LOCAL ] GNL: Loaded 46279 existing records from primary storage. [2025-10-28T19:04:49.173224] [INFO ] [MAIN ] GNL: Loaded 46279 existing records. [2025-10-28T19:04:49.348284] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:49.348516] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-28T19:04:49.348561] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-28T19:04:49.348907] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-28T19:04:49.348964] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-28T19:04:49.696720] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:49.697020] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-28T19:04:50.481580] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (5.02 seconds). [2025-10-28T19:04:50.487479] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-28T19:04:51.123291] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:04:51.127719] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-28T19:04:51.854441] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T19:04:51.857707] [INFO ] [REMOTE ] GNE: Full fetch complete (22622 records). [2025-10-28T19:04:51.857788] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-28T19:04:52.224139] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-28T19:04:52.224213] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-28T19:04:52.224746] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-28T19:04:52.224825] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-28T19:04:52.225441] [DEBUG] [LOCAL ] GNE: Trimmed 22622 records to 18106 (keeping 200 days of data) [2025-10-28T19:04:52.330673] [DEBUG] [LOCAL ] GNE: Primary data saved (18106 records). [2025-10-28T19:04:52.330828] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-28T19:04:52.330920] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNE took 13.6s. Estimated remaining: 3h 7m 2s. Rate: 7.6 symbols/min [2025-10-28T19:04:52.463341] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (4.68 seconds). [2025-10-28T19:04:52.512925] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-28T19:04:52.544093] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:52.586009] [DEBUG] [LOCAL ] GNRC: Loaded 45165 existing records from primary storage. [2025-10-28T19:04:52.586292] [INFO ] [MAIN ] GNRC: Loaded 45165 existing records. [2025-10-28T19:04:52.775554] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:52.775803] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-28T19:04:52.775854] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-28T19:04:52.776098] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-28T19:04:52.776139] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-28T19:04:53.135436] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:53.135754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-28T19:04:53.559056] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T19:04:53.567993] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-28T19:04:54.436742] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:04:54.446949] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-28T19:04:54.566599] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:04:54.575811] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-28T19:04:55.580723] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:04:55.589615] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-28T19:04:55.732858] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T19:04:55.742859] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-28T19:04:56.167036] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (8.14 seconds). [2025-10-28T19:04:56.177960] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-28T19:04:56.726538] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:04:56.736295] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-28T19:04:57.307453] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:04:57.318882] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-28T19:04:57.364858] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (7.67 seconds). [2025-10-28T19:04:57.374418] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-28T19:04:57.936206] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:04:57.946490] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-28T19:04:58.416144] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T19:04:58.425965] [INFO ] [REMOTE ] GMED: Full fetch complete (70166 records). [2025-10-28T19:04:58.426089] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-28T19:04:58.825364] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-28T19:04:58.825442] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-28T19:04:58.826339] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-28T19:04:58.826424] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-28T19:04:58.827840] [DEBUG] [LOCAL ] GMED: Trimmed 70166 records to 48070 (keeping 200 days of data) [2025-10-28T19:04:59.110762] [DEBUG] [LOCAL ] GMED: Primary data saved (48070 records). [2025-10-28T19:04:59.110991] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-28T19:04:59.111118] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GMED took 53.1s. Estimated remaining: 3h 6m 53s. Rate: 7.6 symbols/min [2025-10-28T19:04:59.307164] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:59.318635] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:04:59.328583] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-28T19:04:59.336365] [DEBUG] [LOCAL ] GNT: Loaded 8608 existing records from primary storage. [2025-10-28T19:04:59.336733] [INFO ] [MAIN ] GNT: Loaded 8608 existing records. [2025-10-28T19:04:59.513841] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:59.514054] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-28T19:04:59.514101] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-28T19:04:59.514293] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-28T19:04:59.514350] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-28T19:04:59.866073] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:59.866390] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-28T19:05:00.252408] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:05:00.254298] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-28T19:05:00.506373] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:05:00.516258] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-28T19:05:00.673450] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:05:00.675284] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-28T19:05:01.142201] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T19:05:01.144415] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-28T19:05:01.633137] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T19:05:01.635794] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-28T19:05:02.130900] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:05:02.130610] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T19:05:02.143067] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-28T19:05:02.144982] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-28T19:05:02.700037] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T19:05:02.703165] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-28T19:05:03.401731] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (7.66 seconds). [2025-10-28T19:05:03.411421] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-28T19:05:03.490439] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:05:03.500710] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-28T19:05:04.387943] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:05:04.396248] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-28T19:05:04.568824] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:05:04.579098] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-28T19:05:05.464275] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T19:05:05.471549] [INFO ] [REMOTE ] GNK: Full fetch complete (56996 records). [2025-10-28T19:05:05.471723] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-28T19:05:05.896171] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-28T19:05:05.896317] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-28T19:05:05.897399] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-28T19:05:05.897533] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-28T19:05:05.898858] [DEBUG] [LOCAL ] GNK: Trimmed 56996 records to 38830 (keeping 200 days of data) [2025-10-28T19:05:06.133326] [DEBUG] [LOCAL ] GNK: Primary data saved (38830 records). [2025-10-28T19:05:06.133459] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-28T19:05:06.133538] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNK took 26.7s. Estimated remaining: 3h 6m 43s. Rate: 7.6 symbols/min [2025-10-28T19:05:06.307830] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:06.355162] [DEBUG] [LOCAL ] GNW: Loaded 51289 existing records from primary storage. [2025-10-28T19:05:06.355454] [INFO ] [MAIN ] GNW: Loaded 51289 existing records. [2025-10-28T19:05:06.549213] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:06.549443] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-28T19:05:06.549497] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-28T19:05:06.549779] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-28T19:05:06.549839] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-28T19:05:06.908201] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:06.908521] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-28T19:05:07.998613] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (10.62 seconds). [2025-10-28T19:05:08.007857] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-28T19:05:08.133469] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:05:08.143092] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-28T19:05:09.154768] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T19:05:09.166427] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-28T19:05:09.305740] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:05:09.315289] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-28T19:05:10.627108] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:05:10.637714] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-28T19:05:10.836977] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (8.13 seconds). [2025-10-28T19:05:10.839196] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-28T19:05:11.190996] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T19:05:11.193160] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-28T19:05:11.669896] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T19:05:11.673564] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-28T19:05:11.779744] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T19:05:11.790558] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-28T19:05:12.192288] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:05:12.195517] [INFO ] [REMOTE ] GNT: Full fetch complete (11480 records). [2025-10-28T19:05:12.195633] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-28T19:05:12.613358] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-28T19:05:12.613460] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-28T19:05:12.613937] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-28T19:05:12.614015] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-28T19:05:12.614700] [DEBUG] [LOCAL ] GNT: Trimmed 11480 records to 8606 (keeping 200 days of data) [2025-10-28T19:05:12.673195] [DEBUG] [LOCAL ] GNT: Primary data saved (8606 records). [2025-10-28T19:05:12.673335] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-28T19:05:12.673416] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GNT took 13.6s. Estimated remaining: 3h 6m 33s. Rate: 7.6 symbols/min [2025-10-28T19:05:12.841764] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:12.886127] [DEBUG] [LOCAL ] GOF: Loaded 42668 existing records from primary storage. [2025-10-28T19:05:12.886420] [INFO ] [MAIN ] GOF: Loaded 42668 existing records. [2025-10-28T19:05:13.063153] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:13.063482] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-28T19:05:13.063538] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-28T19:05:13.063827] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-28T19:05:13.063885] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-28T19:05:13.430515] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:13.430936] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-28T19:05:14.753233] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:05:14.762889] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-28T19:05:18.814891] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (14.24 seconds). [2025-10-28T19:05:18.824149] [INFO ] [REMOTE ] GNRC: Full fetch complete (65721 records). [2025-10-28T19:05:18.824271] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-28T19:05:19.215551] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-28T19:05:19.215624] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-28T19:05:19.216715] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-28T19:05:19.216785] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-28T19:05:19.218090] [DEBUG] [LOCAL ] GNRC: Trimmed 65721 records to 45153 (keeping 200 days of data) [2025-10-28T19:05:19.489356] [DEBUG] [LOCAL ] GNRC: Primary data saved (45153 records). [2025-10-28T19:05:19.489478] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-28T19:05:19.489555] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 27.2s. Estimated remaining: 3h 6m 24s. Rate: 7.6 symbols/min [2025-10-28T19:05:19.667193] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:19.697299] [DEBUG] [LOCAL ] GOLF: Loaded 29787 existing records from primary storage. [2025-10-28T19:05:19.697729] [INFO ] [MAIN ] GOLF: Loaded 29787 existing records. [2025-10-28T19:05:19.886708] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:19.886950] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-28T19:05:19.887001] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-28T19:05:19.887241] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-28T19:05:19.887311] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-28T19:05:20.253615] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:20.254009] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-28T19:05:21.152808] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T19:05:21.158456] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-28T19:05:22.154611] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T19:05:22.161887] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-28T19:05:23.202208] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:05:23.209551] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-28T19:05:27.901373] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (18.73 seconds). [2025-10-28T19:05:27.913135] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-28T19:05:30.192870] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (6.98 seconds). [2025-10-28T19:05:30.200872] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-28T19:05:31.167186] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T19:05:31.174300] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-28T19:05:32.074543] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T19:05:32.080963] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-28T19:05:32.995692] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T19:05:33.002760] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-28T19:05:33.908424] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:05:33.915253] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-28T19:05:34.817805] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T19:05:34.823755] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-28T19:05:35.725359] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:05:35.731007] [INFO ] [REMOTE ] GOLF: Full fetch complete (45189 records). [2025-10-28T19:05:35.731106] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-28T19:05:36.103901] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-28T19:05:36.104034] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-28T19:05:36.104880] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-28T19:05:36.104945] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-28T19:05:36.105931] [DEBUG] [LOCAL ] GOLF: Trimmed 45189 records to 29624 (keeping 200 days of data) [2025-10-28T19:05:36.286905] [DEBUG] [LOCAL ] GOLF: Primary data saved (29624 records). [2025-10-28T19:05:36.287066] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-28T19:05:36.287178] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GOLF took 16.8s. Estimated remaining: 3h 6m 29s. Rate: 7.6 symbols/min [2025-10-28T19:05:36.472245] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:36.515623] [DEBUG] [LOCAL ] GOOS: Loaded 43756 existing records from primary storage. [2025-10-28T19:05:36.515952] [INFO ] [MAIN ] GOOS: Loaded 43756 existing records. [2025-10-28T19:05:36.740395] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (24.95 seconds). [2025-10-28T19:05:36.745312] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:36.745712] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-28T19:05:36.745938] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-28T19:05:36.756765] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-28T19:05:36.756725] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-28T19:05:36.756882] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-28T19:05:37.124953] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (9.21 seconds). [2025-10-28T19:05:37.165148] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:37.166342] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-28T19:05:37.167840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-28T19:05:38.205186] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T19:05:38.216725] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-28T19:05:38.324823] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:05:38.333894] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-28T19:05:38.397894] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:05:38.409260] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-28T19:05:39.318710] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:05:39.332373] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-28T19:05:40.545803] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T19:05:40.560959] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-28T19:05:41.801127] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:05:41.811856] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-28T19:05:43.054832] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (28.29 seconds). [2025-10-28T19:05:43.063130] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-28T19:05:43.159076] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:05:43.169199] [INFO ] [REMOTE ] GNW: Full fetch complete (73866 records). [2025-10-28T19:05:43.169329] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-28T19:05:43.547121] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-28T19:05:43.547202] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-28T19:05:43.548133] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-28T19:05:43.548197] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-28T19:05:43.549524] [DEBUG] [LOCAL ] GNW: Trimmed 73866 records to 51232 (keeping 200 days of data) [2025-10-28T19:05:43.836910] [DEBUG] [LOCAL ] GNW: Primary data saved (51232 records). [2025-10-28T19:05:43.837079] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-28T19:05:43.837204] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GNW took 37.7s. Estimated remaining: 3h 6m 21s. Rate: 7.6 symbols/min [2025-10-28T19:05:44.002326] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:44.034197] [DEBUG] [LOCAL ] GOTU: Loaded 36496 existing records from primary storage. [2025-10-28T19:05:44.034479] [INFO ] [MAIN ] GOTU: Loaded 36496 existing records. [2025-10-28T19:05:44.209250] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:44.209423] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-28T19:05:44.209469] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-28T19:05:44.209673] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-28T19:05:44.209730] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-28T19:05:44.595505] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T19:05:44.594153] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:44.595889] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-28T19:05:44.605987] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-28T19:05:45.689446] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:05:45.698410] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-28T19:05:45.883264] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:05:45.896666] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-28T19:05:46.861324] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:05:46.870452] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-28T19:05:47.190908] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T19:05:47.199977] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-28T19:05:47.899545] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T19:05:47.910350] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-28T19:05:48.245555] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T19:05:48.253950] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-28T19:05:48.956858] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T19:05:48.965723] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-28T19:05:49.563211] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:05:49.573121] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-28T19:05:49.892421] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:05:49.901534] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-28T19:05:50.859456] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:05:50.867889] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-28T19:05:50.909591] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:05:50.919126] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-28T19:05:51.500779] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (13.17 seconds). [2025-10-28T19:05:51.509859] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-28T19:05:51.897033] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:05:51.904911] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-28T19:05:52.218163] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:05:52.227171] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-28T19:05:52.615627] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:05:52.625704] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-28T19:05:52.911930] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:05:52.920060] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-28T19:05:53.753022] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T19:05:53.762332] [INFO ] [REMOTE ] GOF: Full fetch complete (62853 records). [2025-10-28T19:05:53.762438] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-28T19:05:54.097632] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:05:54.136026] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-28T19:05:54.209624] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-28T19:05:54.209744] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-28T19:05:54.210717] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-28T19:05:54.210780] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-28T19:05:54.212075] [DEBUG] [LOCAL ] GOF: Trimmed 62853 records to 42723 (keeping 200 days of data) [2025-10-28T19:05:54.465069] [DEBUG] [LOCAL ] GOF: Primary data saved (42723 records). [2025-10-28T19:05:54.465184] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-28T19:05:54.465255] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GOF took 41.8s. Estimated remaining: 3h 6m 17s. Rate: 7.6 symbols/min [2025-10-28T19:05:54.632440] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:54.674980] [DEBUG] [LOCAL ] GPC: Loaded 45800 existing records from primary storage. [2025-10-28T19:05:54.675259] [INFO ] [MAIN ] GPC: Loaded 45800 existing records. [2025-10-28T19:05:54.848934] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:54.849120] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-28T19:05:54.849169] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-28T19:05:54.849621] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-28T19:05:54.849712] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-28T19:05:55.200180] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:55.200460] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-28T19:05:55.352515] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:05:55.359496] [INFO ] [REMOTE ] GOTU: Full fetch complete (57869 records). [2025-10-28T19:05:55.359601] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-28T19:05:55.755684] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-28T19:05:55.755768] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-28T19:05:55.756807] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-28T19:05:55.756866] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-28T19:05:55.757925] [DEBUG] [LOCAL ] GOTU: Trimmed 57869 records to 36448 (keeping 200 days of data) [2025-10-28T19:05:55.963160] [DEBUG] [LOCAL ] GOTU: Primary data saved (36448 records). [2025-10-28T19:05:55.963306] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-28T19:05:55.963386] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GOTU took 12.1s. Estimated remaining: 3h 5m 59s. Rate: 7.6 symbols/min [2025-10-28T19:05:56.132704] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:56.147950] [DEBUG] [LOCAL ] GPI: Loaded 14518 existing records from primary storage. [2025-10-28T19:05:56.148164] [INFO ] [MAIN ] GPI: Loaded 14518 existing records. [2025-10-28T19:05:56.322903] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:56.323097] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-28T19:05:56.323143] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-28T19:05:56.323510] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-28T19:05:56.323567] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-28T19:05:56.655601] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (18.25 seconds). [2025-10-28T19:05:56.704694] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-28T19:05:56.717035] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:56.717958] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-28T19:05:57.339222] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:05:57.342518] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-28T19:05:57.883945] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T19:05:57.893729] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-28T19:05:57.923362] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T19:05:57.926816] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-28T19:05:58.704622] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:05:58.708911] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-28T19:05:59.425850] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T19:05:59.432934] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-28T19:05:59.489413] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (6.86 seconds). [2025-10-28T19:05:59.499677] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-28T19:06:00.036347] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T19:06:00.039859] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-28T19:06:00.779796] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T19:06:00.783438] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-28T19:06:00.873084] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:06:00.882520] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-28T19:06:01.614929] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:06:01.619239] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-28T19:06:02.093906] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T19:06:02.103200] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-28T19:06:02.286740] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:06:02.290347] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-28T19:06:04.568886] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (9.37 seconds). [2025-10-28T19:06:04.580426] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-28T19:06:05.781459] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:06:05.792405] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-28T19:06:07.052405] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:06:07.062796] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-28T19:06:08.337612] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T19:06:08.350843] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-28T19:06:09.695446] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T19:06:09.705823] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-28T19:06:10.462012] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (12.57 seconds). [2025-10-28T19:06:10.471604] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-28T19:06:10.875956] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:06:10.885174] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-28T19:06:12.066158] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:06:12.076402] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-28T19:06:13.154362] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:06:13.163497] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-28T19:06:13.610203] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (11.32 seconds). [2025-10-28T19:06:13.613806] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-28T19:06:14.431679] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:06:14.441916] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-28T19:06:14.467506] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:06:14.471695] [INFO ] [REMOTE ] GPI: Full fetch complete (22132 records). [2025-10-28T19:06:14.471811] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-28T19:06:14.842723] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-28T19:06:14.842819] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-28T19:06:14.843331] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-28T19:06:14.843374] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-28T19:06:14.844132] [DEBUG] [LOCAL ] GPI: Trimmed 22132 records to 14578 (keeping 200 days of data) [2025-10-28T19:06:14.932251] [DEBUG] [LOCAL ] GPI: Primary data saved (14578 records). [2025-10-28T19:06:14.932375] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-28T19:06:14.932452] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GPI took 19.0s. Estimated remaining: 3h 6m 8s. Rate: 7.6 symbols/min [2025-10-28T19:06:15.101273] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:15.107207] [DEBUG] [LOCAL ] GPJA: Loaded 4035 existing records from primary storage. [2025-10-28T19:06:15.107366] [INFO ] [MAIN ] GPJA: Loaded 4035 existing records. [2025-10-28T19:06:15.303153] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:15.303354] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-28T19:06:15.303400] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-28T19:06:15.303575] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-28T19:06:15.303632] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-28T19:06:15.651919] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:15.652210] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-28T19:06:15.903057] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:06:15.912537] [INFO ] [REMOTE ] GPC: Full fetch complete (68633 records). [2025-10-28T19:06:15.912717] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-28T19:06:16.297790] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-28T19:06:16.297867] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-28T19:06:16.298745] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-28T19:06:16.298811] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-28T19:06:16.300042] [DEBUG] [LOCAL ] GPC: Trimmed 68633 records to 45740 (keeping 200 days of data) [2025-10-28T19:06:16.580622] [DEBUG] [LOCAL ] GPC: Primary data saved (45740 records). [2025-10-28T19:06:16.580769] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-28T19:06:16.580874] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GPC took 22.1s. Estimated remaining: 3h 5m 51s. Rate: 7.6 symbols/min [2025-10-28T19:06:19.339234] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (17.24 seconds). [2025-10-28T19:06:19.349629] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-28T19:06:30.871786] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (20.40 seconds). [2025-10-28T19:06:30.883826] [INFO ] [REMOTE ] GNL: Full fetch complete (67923 records). [2025-10-28T19:06:30.883998] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-28T19:06:31.272712] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-28T19:06:31.272799] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-28T19:06:31.273790] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-28T19:06:31.273852] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-28T19:06:31.275223] [DEBUG] [LOCAL ] GNL: Trimmed 67923 records to 46178 (keeping 200 days of data) [2025-10-28T19:06:31.563621] [DEBUG] [LOCAL ] GNL: Primary data saved (46178 records). [2025-10-28T19:06:31.563782] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-28T19:06:31.564531] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GNL took 1m 43s. Estimated remaining: 3h 5m 53s. Rate: 7.6 symbols/min [2025-10-28T19:06:32.280013] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (16.63 seconds). [2025-10-28T19:06:32.283174] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-28T19:06:32.610966] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T19:06:32.612403] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-28T19:06:32.982205] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T19:06:32.983530] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-28T19:06:33.314159] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T19:06:33.315686] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-28T19:06:33.689079] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T19:06:33.690358] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-28T19:06:34.067519] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:06:34.069278] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-28T19:06:34.453619] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T19:06:34.455259] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-28T19:06:34.819092] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:06:34.820774] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-28T19:06:40.358041] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (21.01 seconds). [2025-10-28T19:06:40.367970] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-28T19:06:41.515422] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T19:06:41.526861] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-28T19:06:41.786206] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (6.97 seconds). [2025-10-28T19:06:41.788157] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-28T19:06:42.676134] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:06:42.677452] [INFO ] [REMOTE ] GPJA: Full fetch complete (6760 records). [2025-10-28T19:06:42.677523] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-28T19:06:43.050293] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-28T19:06:43.050378] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-28T19:06:43.050579] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-28T19:06:43.050618] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-28T19:06:43.051112] [DEBUG] [LOCAL ] GPJA: Trimmed 6760 records to 4026 (keeping 200 days of data) [2025-10-28T19:06:43.075449] [DEBUG] [LOCAL ] GPJA: Primary data saved (4026 records). [2025-10-28T19:06:43.075566] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-28T19:06:43.075664] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPJA took 28.1s. Estimated remaining: 3h 5m 50s. Rate: 7.6 symbols/min [2025-10-28T19:06:49.561576] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (8.03 seconds). [2025-10-28T19:06:49.569552] [INFO ] [REMOTE ] GOOS: Full fetch complete (64500 records). [2025-10-28T19:06:49.569751] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-28T19:06:49.967841] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-28T19:06:49.967916] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-28T19:06:49.968813] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-28T19:06:49.968897] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-28T19:06:49.970059] [DEBUG] [LOCAL ] GOOS: Trimmed 64500 records to 43634 (keeping 200 days of data) [2025-10-28T19:06:50.226052] [DEBUG] [LOCAL ] GOOS: Primary data saved (43634 records). [2025-10-28T19:06:50.226171] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-28T19:06:50.226245] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GOOS took 1m 14s. Estimated remaining: 3h 5m 41s. Rate: 7.6 symbols/min [2025-10-28T19:06:50.858409] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.808253] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.951445] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.953008] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.986987] [DEBUG] [LOCAL ] GPMT: Loaded 25517 existing records from primary storage. [2025-10-28T19:06:50.988188] [INFO ] [MAIN ] GPMT: Loaded 25517 existing records. [2025-10-28T19:06:50.988621] [DEBUG] [LOCAL ] GPOR: Loaded 23320 existing records from primary storage. [2025-10-28T19:06:50.999612] [INFO ] [MAIN ] GPOR: Loaded 23320 existing records. [2025-10-28T19:06:51.391716] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:51.411959] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:51.429539] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-28T19:06:51.430547] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-28T19:06:51.430300] [DEBUG] [LOCAL ] GPN: Loaded 51720 existing records from primary storage. [2025-10-28T19:06:51.431944] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-28T19:06:51.431755] [DEBUG] [LOCAL ] GPK: Loaded 52765 existing records from primary storage. [2025-10-28T19:06:51.432310] [INFO ] [MAIN ] GPN: Loaded 51720 existing records. [2025-10-28T19:06:51.432573] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-28T19:06:51.437880] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-28T19:06:51.444016] [INFO ] [MAIN ] GPK: Loaded 52765 existing records. [2025-10-28T19:06:51.479222] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-28T19:06:51.494494] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-28T19:06:51.484547] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-28T19:06:51.992799] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:52.048106] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-28T19:06:52.099600] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-28T19:06:52.204685] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:52.257582] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-28T19:06:52.317993] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-28T19:06:52.252275] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-28T19:06:52.328550] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-28T19:06:52.407878] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-28T19:06:52.466190] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-28T19:06:52.689224] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:52.780120] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-28T19:06:52.895095] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:52.990214] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-28T19:06:53.392350] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:53.409315] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-28T19:06:53.413350] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:53.413996] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-28T19:06:53.755356] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T19:06:53.760413] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-28T19:06:54.095168] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:06:54.102786] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-28T19:06:54.498487] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T19:06:54.506393] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-28T19:06:54.732871] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:06:54.743037] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-28T19:06:55.154405] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T19:06:55.159894] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-28T19:06:55.946521] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:06:55.957173] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-28T19:06:56.080265] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:06:56.092400] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-28T19:06:57.030515] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:06:57.037756] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-28T19:06:58.199460] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T19:06:58.207866] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-28T19:06:59.093498] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T19:06:59.099260] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-28T19:06:59.444455] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (5.34 seconds). [2025-10-28T19:06:59.449354] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-28T19:06:59.833327] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T19:06:59.839694] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-28T19:07:00.357928] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:07:00.363445] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-28T19:07:00.547125] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T19:07:00.551166] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-28T19:07:01.126569] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:07:01.131812] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-28T19:07:01.442158] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:07:01.446963] [INFO ] [REMOTE ] GPMT: Full fetch complete (35979 records). [2025-10-28T19:07:01.447122] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-28T19:07:01.891516] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-28T19:07:01.891677] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-28T19:07:01.893442] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-28T19:07:01.893535] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-28T19:07:01.895122] [DEBUG] [LOCAL ] GPMT: Trimmed 35979 records to 25367 (keeping 200 days of data) [2025-10-28T19:07:02.072102] [DEBUG] [LOCAL ] GPMT: Primary data saved (25367 records). [2025-10-28T19:07:02.081901] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-28T19:07:02.083543] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T19:07:02.083967] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GPMT took 11.8s. Estimated remaining: 3h 5m 39s. Rate: 7.6 symbols/min [2025-10-28T19:07:02.124839] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-28T19:07:02.281086] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:02.323766] [DEBUG] [LOCAL ] GPRK: Loaded 39943 existing records from primary storage. [2025-10-28T19:07:02.324222] [INFO ] [MAIN ] GPRK: Loaded 39943 existing records. [2025-10-28T19:07:02.554435] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (9.14 seconds). [2025-10-28T19:07:02.559091] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:02.569699] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-28T19:07:02.569942] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-28T19:07:02.570944] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-28T19:07:02.571560] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-28T19:07:02.571621] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-28T19:07:03.019861] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:03.020266] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-28T19:07:03.980672] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T19:07:03.990670] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-28T19:07:04.114949] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:07:04.123984] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-28T19:07:05.446689] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-10-28T19:07:05.451277] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-28T19:07:06.065409] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (10.11 seconds). [2025-10-28T19:07:06.075995] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-28T19:07:06.281251] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:07:06.286769] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-28T19:07:07.285723] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:07:07.297361] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-28T19:07:09.169028] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-28T19:07:09.174446] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-28T19:07:10.217771] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (6.23 seconds). [2025-10-28T19:07:10.229373] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-28T19:07:11.192599] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (7.07 seconds). [2025-10-28T19:07:11.200732] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-28T19:07:11.595677] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:07:11.606978] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-28T19:07:12.109871] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (4.81 seconds). [2025-10-28T19:07:12.121902] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-28T19:07:12.354394] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (3.18 seconds). [2025-10-28T19:07:12.360694] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-28T19:07:12.605322] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:07:12.614013] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-28T19:07:12.916504] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:07:12.927455] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-28T19:07:13.349359] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:07:13.360510] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-28T19:07:13.407533] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:07:13.413535] [INFO ] [REMOTE ] GPOR: Full fetch complete (34896 records). [2025-10-28T19:07:13.413618] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-28T19:07:13.799070] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-28T19:07:13.807088] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-28T19:07:13.821032] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-28T19:07:13.821129] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-28T19:07:13.823243] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:07:13.832273] [DEBUG] [LOCAL ] GPOR: Trimmed 34896 records to 23382 (keeping 200 days of data) [2025-10-28T19:07:13.832566] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-28T19:07:13.969411] [DEBUG] [LOCAL ] GPOR: Primary data saved (23382 records). [2025-10-28T19:07:13.969543] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-28T19:07:13.969622] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPOR took 23.7s. Estimated remaining: 3h 5m 37s. Rate: 7.6 symbols/min [2025-10-28T19:07:14.139202] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:14.163380] [DEBUG] [LOCAL ] GRBK: Loaded 26261 existing records from primary storage. [2025-10-28T19:07:14.163622] [INFO ] [MAIN ] GRBK: Loaded 26261 existing records. [2025-10-28T19:07:14.344062] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:14.344699] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-28T19:07:14.344781] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-28T19:07:14.345342] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-28T19:07:14.345405] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-28T19:07:14.568348] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T19:07:14.653380] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-28T19:07:14.754897] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:14.755374] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-28T19:07:14.786302] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T19:07:14.799000] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-28T19:07:15.014012] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:07:15.023565] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-28T19:07:15.816995] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:07:15.822923] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-28T19:07:16.040031] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T19:07:16.051960] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-28T19:07:16.083926] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:07:16.110167] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-28T19:07:16.112476] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T19:07:16.124528] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-28T19:07:16.631259] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T19:07:16.637337] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-28T19:07:17.128109] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:07:17.136394] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-28T19:07:17.405831] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:07:17.418288] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-28T19:07:17.506890] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T19:07:17.513478] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-28T19:07:17.560856] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T19:07:17.571995] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-28T19:07:17.972214] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T19:07:17.980261] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-28T19:07:18.572042] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T19:07:18.578964] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-28T19:07:18.677468] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:07:18.688369] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-28T19:07:18.996318] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:07:19.005542] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-28T19:07:19.061912] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:07:19.072946] [INFO ] [REMOTE ] GPK: Full fetch complete (76117 records). [2025-10-28T19:07:19.073102] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-28T19:07:19.495930] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-28T19:07:19.496072] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-28T19:07:19.497091] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-28T19:07:19.497176] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-28T19:07:19.515189] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:07:19.522283] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-28T19:07:19.521949] [DEBUG] [LOCAL ] GPK: Trimmed 76117 records to 52757 (keeping 200 days of data) [2025-10-28T19:07:19.836682] [DEBUG] [LOCAL ] GPK: Primary data saved (52757 records). [2025-10-28T19:07:19.836811] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-28T19:07:19.836931] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPK took 29.6s. Estimated remaining: 3h 5m 26s. Rate: 7.6 symbols/min [2025-10-28T19:07:20.005590] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:20.015454] [DEBUG] [LOCAL ] GRC: Loaded 9285 existing records from primary storage. [2025-10-28T19:07:20.015704] [INFO ] [MAIN ] GRC: Loaded 9285 existing records. [2025-10-28T19:07:20.194365] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:20.194737] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-28T19:07:20.194908] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-28T19:07:20.195309] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-28T19:07:20.195368] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-28T19:07:20.541032] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:07:20.612968] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:20.613590] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-28T19:07:20.614007] [INFO ] [REMOTE ] GPRK: Full fetch complete (58567 records). [2025-10-28T19:07:20.630418] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-28T19:07:20.631968] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:07:20.682390] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-28T19:07:21.034185] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-28T19:07:21.034331] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-28T19:07:21.035159] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-28T19:07:21.035220] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-28T19:07:21.036311] [DEBUG] [LOCAL ] GPRK: Trimmed 58567 records to 39986 (keeping 200 days of data) [2025-10-28T19:07:21.264951] [DEBUG] [LOCAL ] GPRK: Primary data saved (39986 records). [2025-10-28T19:07:21.265213] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-28T19:07:21.272105] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPRK took 19.2s. Estimated remaining: 3h 5m 9s. Rate: 7.6 symbols/min [2025-10-28T19:07:21.284430] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:07:21.308133] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-28T19:07:21.455143] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:21.477266] [DEBUG] [LOCAL ] GRDN: Loaded 21538 existing records from primary storage. [2025-10-28T19:07:21.477495] [INFO ] [MAIN ] GRDN: Loaded 21538 existing records. [2025-10-28T19:07:21.683992] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-28T19:07:21.689677] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:21.700504] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-28T19:07:21.700858] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-28T19:07:21.707152] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-28T19:07:21.717088] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-28T19:07:21.716997] [INFO ] [REMOTE ] GPN: Full fetch complete (74960 records). [2025-10-28T19:07:21.739456] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-28T19:07:21.751987] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T19:07:21.835542] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-28T19:07:21.999439] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T19:07:22.029787] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-28T19:07:22.519578] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:22.539567] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-28T19:07:22.558528] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-28T19:07:22.558625] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-28T19:07:22.559830] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-28T19:07:22.560144] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-28T19:07:22.562054] [DEBUG] [LOCAL ] GPN: Trimmed 74960 records to 51691 (keeping 200 days of data) [2025-10-28T19:07:22.809202] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:07:22.865196] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-28T19:07:22.907466] [DEBUG] [LOCAL ] GPN: Primary data saved (51691 records). [2025-10-28T19:07:22.907998] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-28T19:07:22.908113] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GPN took 32.6s. Estimated remaining: 3h 4m 52s. Rate: 7.6 symbols/min [2025-10-28T19:07:22.970991] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:07:23.035404] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-28T19:07:23.106037] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:23.140467] [DEBUG] [LOCAL ] GRMN: Loaded 39400 existing records from primary storage. [2025-10-28T19:07:23.140781] [INFO ] [MAIN ] GRMN: Loaded 39400 existing records. [2025-10-28T19:07:23.264078] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:07:23.277376] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-28T19:07:23.329538] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:23.330182] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-28T19:07:23.330238] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-28T19:07:23.331004] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-28T19:07:23.331061] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-28T19:07:23.624135] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:07:23.655311] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-28T19:07:23.696509] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:23.696985] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-28T19:07:23.705566] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T19:07:23.708517] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-28T19:07:23.958563] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:07:23.966566] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-28T19:07:24.164811] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:07:24.167248] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-28T19:07:24.306772] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:07:24.310426] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-28T19:07:24.621290] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:07:24.623696] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-28T19:07:24.776876] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:07:24.785287] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-28T19:07:24.888709] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:07:24.894261] [INFO ] [REMOTE ] GRBK: Full fetch complete (39820 records). [2025-10-28T19:07:24.894392] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-28T19:07:25.140752] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T19:07:25.180689] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-28T19:07:25.257610] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:07:25.299561] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-28T19:07:25.332524] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-28T19:07:25.332611] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-28T19:07:25.333461] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-28T19:07:25.333520] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-28T19:07:25.334367] [DEBUG] [LOCAL ] GRBK: Trimmed 39820 records to 26209 (keeping 200 days of data) [2025-10-28T19:07:25.481972] [DEBUG] [LOCAL ] GRBK: Primary data saved (26209 records). [2025-10-28T19:07:25.482109] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-28T19:07:25.482188] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRBK took 11.5s. Estimated remaining: 3h 4m 36s. Rate: 7.6 symbols/min [2025-10-28T19:07:25.650087] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:25.693510] [DEBUG] [LOCAL ] GRND: Loaded 50170 existing records from primary storage. [2025-10-28T19:07:25.693845] [INFO ] [MAIN ] GRND: Loaded 50170 existing records. [2025-10-28T19:07:25.879193] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:25.879453] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-28T19:07:25.879502] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-28T19:07:25.879801] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-28T19:07:25.879865] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-28T19:07:25.989478] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T19:07:26.009423] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-28T19:07:26.298292] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:26.327200] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:07:26.333678] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-28T19:07:26.328127] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-28T19:07:26.335456] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T19:07:26.347364] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-28T19:07:26.619683] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T19:07:26.623212] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-28T19:07:27.005306] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:07:27.010433] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-28T19:07:27.308463] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T19:07:27.311577] [INFO ] [REMOTE ] GRC: Full fetch complete (13608 records). [2025-10-28T19:07:27.311693] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-28T19:07:27.702839] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-28T19:07:27.703011] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-28T19:07:27.715739] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T19:07:27.715202] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-28T19:07:27.721057] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-28T19:07:27.720757] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-28T19:07:27.723048] [DEBUG] [LOCAL ] GRC: Trimmed 13608 records to 9304 (keeping 200 days of data) [2025-10-28T19:07:27.806107] [DEBUG] [LOCAL ] GRC: Primary data saved (9304 records). [2025-10-28T19:07:27.807020] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-28T19:07:27.808083] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T19:07:27.816621] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRC took 8.0s. Estimated remaining: 3h 4m 20s. Rate: 7.6 symbols/min [2025-10-28T19:07:27.817853] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-28T19:07:28.019285] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:28.020751] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T19:07:28.031180] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-28T19:07:28.063096] [DEBUG] [LOCAL ] GRNT: Loaded 33640 existing records from primary storage. [2025-10-28T19:07:28.063395] [INFO ] [MAIN ] GRNT: Loaded 33640 existing records. [2025-10-28T19:07:28.239519] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:28.239754] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-28T19:07:28.239806] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-28T19:07:28.240044] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-28T19:07:28.240086] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-28T19:07:28.617672] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:28.625948] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-28T19:07:28.626436] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:07:28.632539] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-28T19:07:29.175212] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T19:07:29.184090] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-28T19:07:29.327343] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:07:29.338538] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-28T19:07:29.483794] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T19:07:29.491820] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-28T19:07:29.541634] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:07:29.549185] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-28T19:07:30.409821] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:07:30.416732] [INFO ] [REMOTE ] GRDN: Full fetch complete (27033 records). [2025-10-28T19:07:30.416842] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-28T19:07:30.752564] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:07:30.759616] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-28T19:07:30.903272] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T19:07:30.921696] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-28T19:07:30.921789] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-28T19:07:30.925691] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-28T19:07:30.924407] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T19:07:30.924848] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-28T19:07:30.934927] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-28T19:07:30.935889] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-28T19:07:30.937084] [DEBUG] [LOCAL ] GRDN: Trimmed 27033 records to 21652 (keeping 200 days of data) [2025-10-28T19:07:31.060173] [DEBUG] [LOCAL ] GRDN: Primary data saved (21652 records). [2025-10-28T19:07:31.060297] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-28T19:07:31.060371] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRDN took 9.8s. Estimated remaining: 3h 4m 5s. Rate: 7.6 symbols/min [2025-10-28T19:07:31.224458] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:31.234224] [DEBUG] [LOCAL ] GROV: Loaded 8633 existing records from primary storage. [2025-10-28T19:07:31.234395] [INFO ] [MAIN ] GROV: Loaded 8633 existing records. [2025-10-28T19:07:31.408968] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:31.409190] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-28T19:07:31.409237] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-28T19:07:31.409383] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-28T19:07:31.409420] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-28T19:07:31.824095] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:31.824501] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-28T19:07:31.844615] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:07:31.852112] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-28T19:07:32.127862] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:07:32.136542] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-28T19:07:32.295983] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:07:32.306874] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-28T19:07:32.439613] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:07:32.442853] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-28T19:07:32.856066] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T19:07:32.864484] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-28T19:07:33.051626] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T19:07:33.054192] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-28T19:07:33.319969] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:07:33.328949] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-28T19:07:33.672122] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:07:33.692451] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-28T19:07:33.704957] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:07:33.711604] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-28T19:07:33.741702] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T19:07:33.744377] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-28T19:07:34.246801] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:07:34.249629] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-28T19:07:34.340913] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:07:34.349760] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-28T19:07:34.661335] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T19:07:34.669922] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-28T19:07:34.787181] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T19:07:34.803945] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-28T19:07:34.805606] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:07:34.808743] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-28T19:07:35.347683] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T19:07:35.349984] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-28T19:07:35.458272] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T19:07:35.467019] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-28T19:07:35.615412] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T19:07:35.623004] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-28T19:07:35.859189] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T19:07:35.863322] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-28T19:07:36.096522] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T19:07:36.107425] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-28T19:07:36.327003] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T19:07:36.329853] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-28T19:07:36.654012] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:07:36.662542] [INFO ] [REMOTE ] GRMN: Full fetch complete (59335 records). [2025-10-28T19:07:36.684999] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-28T19:07:36.687162] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T19:07:36.745334] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-28T19:07:36.776308] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T19:07:36.796030] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-28T19:07:37.125355] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-28T19:07:37.125476] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-28T19:07:37.126309] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-28T19:07:37.126370] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-28T19:07:37.127507] [DEBUG] [LOCAL ] GRMN: Trimmed 59335 records to 39341 (keeping 200 days of data) [2025-10-28T19:07:37.372486] [DEBUG] [LOCAL ] GRMN: Primary data saved (39341 records). [2025-10-28T19:07:37.372675] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-28T19:07:37.373501] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRMN took 14.5s. Estimated remaining: 3h 3m 55s. Rate: 7.6 symbols/min [2025-10-28T19:07:37.552821] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:37.560173] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T19:07:37.563171] [INFO ] [REMOTE ] GROV: Full fetch complete (13443 records). [2025-10-28T19:07:37.564566] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-28T19:07:37.622193] [DEBUG] [LOCAL ] GRX: Loaded 4811 existing records from primary storage. [2025-10-28T19:07:37.647913] [INFO ] [MAIN ] GRX: Loaded 4811 existing records. [2025-10-28T19:07:38.040975] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:38.026512] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-28T19:07:38.079998] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:07:38.072031] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-28T19:07:38.134396] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-28T19:07:38.138146] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-28T19:07:38.122499] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-28T19:07:38.138285] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-28T19:07:38.150471] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-28T19:07:38.282069] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-28T19:07:38.303515] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-28T19:07:38.309124] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-28T19:07:38.320251] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-28T19:07:38.341754] [DEBUG] [LOCAL ] GROV: Trimmed 13443 records to 8721 (keeping 200 days of data) [2025-10-28T19:07:38.500497] [DEBUG] [LOCAL ] GROV: Primary data saved (8721 records). [2025-10-28T19:07:38.521421] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-28T19:07:38.538556] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GROV took 7.5s. Estimated remaining: 3h 3m 38s. Rate: 7.6 symbols/min [2025-10-28T19:07:38.756359] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:38.767067] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-28T19:07:38.829090] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:38.877331] [DEBUG] [LOCAL ] GS: Loaded 51743 existing records from primary storage. [2025-10-28T19:07:38.877614] [INFO ] [MAIN ] GS: Loaded 51743 existing records. [2025-10-28T19:07:39.084627] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:39.084946] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-28T19:07:39.084999] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-28T19:07:39.085468] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-28T19:07:39.085538] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-28T19:07:39.200121] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T19:07:39.241998] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-28T19:07:39.452315] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T19:07:39.491489] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:39.498209] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-28T19:07:39.499760] [INFO ] [REMOTE ] GRNT: Full fetch complete (48243 records). [2025-10-28T19:07:39.500198] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-28T19:07:39.614188] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T19:07:39.646636] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-28T19:07:39.779085] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T19:07:39.875880] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-28T19:07:39.978863] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-28T19:07:39.978937] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-28T19:07:39.979754] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-28T19:07:39.979818] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-28T19:07:39.980853] [DEBUG] [LOCAL ] GRNT: Trimmed 48243 records to 33544 (keeping 200 days of data) [2025-10-28T19:07:40.172455] [DEBUG] [LOCAL ] GRNT: Primary data saved (33544 records). [2025-10-28T19:07:40.172576] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-28T19:07:40.172670] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GRNT took 12.4s. Estimated remaining: 3h 3m 21s. Rate: 7.6 symbols/min [2025-10-28T19:07:40.274472] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T19:07:40.278326] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-28T19:07:40.346846] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:40.383110] [DEBUG] [LOCAL ] GSBD: Loaded 39315 existing records from primary storage. [2025-10-28T19:07:40.383373] [INFO ] [MAIN ] GSBD: Loaded 39315 existing records. [2025-10-28T19:07:40.556777] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:40.556963] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-28T19:07:40.557009] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-28T19:07:40.557314] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-28T19:07:40.557377] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-28T19:07:40.842553] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T19:07:40.860234] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-28T19:07:40.922418] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:40.922749] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-28T19:07:41.200216] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T19:07:41.210797] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-28T19:07:41.292010] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T19:07:41.293994] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-28T19:07:41.570089] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T19:07:41.581006] [INFO ] [REMOTE ] GRND: Full fetch complete (72082 records). [2025-10-28T19:07:41.581149] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-28T19:07:41.696898] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T19:07:41.708988] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-28T19:07:42.015472] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-28T19:07:42.015613] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-28T19:07:42.016613] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-28T19:07:42.016708] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-28T19:07:42.032016] [DEBUG] [LOCAL ] GRND: Trimmed 72082 records to 50168 (keeping 200 days of data) [2025-10-28T19:07:42.046150] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:07:42.115189] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-28T19:07:42.150247] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T19:07:42.154375] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-28T19:07:42.356338] [DEBUG] [LOCAL ] GRND: Primary data saved (50168 records). [2025-10-28T19:07:42.356498] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-28T19:07:42.356585] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GRND took 16.9s. Estimated remaining: 3h 3m 5s. Rate: 7.6 symbols/min [2025-10-28T19:07:42.524207] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:42.558320] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:07:42.561113] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-28T19:07:42.579872] [DEBUG] [LOCAL ] GSK: Loaded 53510 existing records from primary storage. [2025-10-28T19:07:42.580189] [INFO ] [MAIN ] GSK: Loaded 53510 existing records. [2025-10-28T19:07:42.758224] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:42.758427] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-28T19:07:42.758482] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-28T19:07:42.758784] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-28T19:07:42.758844] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-28T19:07:43.142274] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:43.149609] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-28T19:07:43.149963] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T19:07:43.179624] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-28T19:07:43.180631] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-28T19:07:43.192695] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-28T19:07:43.331312] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T19:07:43.338843] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-28T19:07:43.732219] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T19:07:43.734045] [INFO ] [REMOTE ] GRX: Full fetch complete (6532 records). [2025-10-28T19:07:43.734126] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-28T19:07:44.298676] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-28T19:07:44.298773] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-28T19:07:44.298987] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-28T19:07:44.299050] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-28T19:07:44.299738] [DEBUG] [LOCAL ] GRX: Trimmed 6532 records to 4799 (keeping 200 days of data) [2025-10-28T19:07:44.337032] [DEBUG] [LOCAL ] GRX: Primary data saved (4799 records). [2025-10-28T19:07:44.337175] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-28T19:07:44.337263] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GRX took 7.0s. Estimated remaining: 3h 2m 48s. Rate: 7.6 symbols/min [2025-10-28T19:07:44.588473] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:44.620215] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:07:44.630514] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-28T19:07:44.678688] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T19:07:44.689951] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-28T19:07:44.708636] [DEBUG] [LOCAL ] GSL: Loaded 32535 existing records from primary storage. [2025-10-28T19:07:44.709214] [INFO ] [MAIN ] GSL: Loaded 32535 existing records. [2025-10-28T19:07:44.897873] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:44.898218] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-28T19:07:44.898389] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-28T19:07:44.899191] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-28T19:07:44.899265] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-28T19:07:45.219238] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-28T19:07:45.246733] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-28T19:07:45.309890] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:45.580359] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-28T19:07:45.937833] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:07:46.109485] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T19:07:46.380242] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-28T19:07:46.439589] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T19:07:47.011605] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T19:07:47.180260] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-28T19:07:47.340400] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T19:07:47.980249] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-28T19:07:48.780254] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-28T19:07:48.854940] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T19:07:48.914717] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T19:07:49.580279] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-28T19:07:50.257407] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T19:07:50.380268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-28T19:07:50.696267] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:07:51.180303] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-28T19:07:51.901790] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T19:07:51.980266] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-28T19:07:52.232730] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:07:52.780281] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-28T19:07:53.563540] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T19:07:53.580215] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-28T19:07:53.797347] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T19:07:54.380277] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-28T19:07:55.183877] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-28T19:07:55.185852] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T19:07:55.424875] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T19:07:55.980288] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-28T19:07:56.744243] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T19:07:56.780210] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-28T19:07:57.422263] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:07:57.580254] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-28T19:07:58.062561] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:07:58.380309] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-28T19:07:59.180283] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-28T19:07:59.235257] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T19:07:59.841178] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T19:07:59.980256] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-28T19:08:00.234144] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:08:00.780313] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-28T19:08:01.520394] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:08:01.580301] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-28T19:08:01.943338] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:08:02.380277] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-28T19:08:03.180348] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-28T19:08:03.649284] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-28T19:08:03.660292] [INFO ] [REMOTE ] GS: Full fetch complete (75819 records). [2025-10-28T19:08:03.660450] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-28T19:08:03.973899] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:08:03.989793] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-28T19:08:04.055328] [INFO ] [REMOTE ] GSBD: Full fetch complete (58494 records). [2025-10-28T19:08:04.074603] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-28T19:08:04.131754] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-28T19:08:04.145336] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-28T19:08:04.171554] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-28T19:08:04.197590] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-28T19:08:04.241115] [DEBUG] [LOCAL ] GS: Trimmed 75819 records to 51731 (keeping 200 days of data) [2025-10-28T19:08:04.639519] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-28T19:08:04.655487] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-28T19:08:04.656521] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-28T19:08:04.711234] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-28T19:08:04.752716] [DEBUG] [LOCAL ] GSBD: Trimmed 58494 records to 39288 (keeping 200 days of data) [2025-10-28T19:08:05.068867] [DEBUG] [LOCAL ] GS: Primary data saved (51731 records). [2025-10-28T19:08:05.072427] [INFO ] [MAIN ] GS: Full history saved. [2025-10-28T19:08:05.072755] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GS took 26.5s. Estimated remaining: 3h 2m 59s. Rate: 7.6 symbols/min [2025-10-28T19:08:05.148246] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-28T19:08:05.242989] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-28T19:08:05.331039] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:05.359052] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:08:05.384925] [DEBUG] [LOCAL ] GSBD: Primary data saved (39288 records). [2025-10-28T19:08:05.385491] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-28T19:08:05.385590] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSBD took 25.2s. Estimated remaining: 3h 2m 40s. Rate: 7.6 symbols/min [2025-10-28T19:08:05.581119] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-28T19:08:05.582700] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:05.599157] [DEBUG] [LOCAL ] GTES: Loaded 50229 existing records from primary storage. [2025-10-28T19:08:05.599425] [INFO ] [MAIN ] GTES: Loaded 50229 existing records. [2025-10-28T19:08:05.797577] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:05.797879] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-28T19:08:05.797926] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-28T19:08:05.798329] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-28T19:08:05.798371] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-28T19:08:05.919498] [DEBUG] [LOCAL ] GTLS: Loaded 42877 existing records from primary storage. [2025-10-28T19:08:05.930578] [INFO ] [MAIN ] GTLS: Loaded 42877 existing records. [2025-10-28T19:08:06.330397] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:06.358975] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-28T19:08:06.359062] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-28T19:08:06.358916] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:06.359405] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-28T19:08:06.359463] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-28T19:08:06.390683] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-28T19:08:06.715307] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:06.737570] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T19:08:06.977813] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T19:08:06.988443] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-28T19:08:06.988574] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-28T19:08:07.185448] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-28T19:08:07.377392] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-28T19:08:07.377461] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-28T19:08:07.378457] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-28T19:08:07.378520] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-28T19:08:07.379929] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53510 (keeping 200 days of data) [2025-10-28T19:08:07.680744] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:08:07.756467] [DEBUG] [LOCAL ] GSK: Primary data saved (53510 records). [2025-10-28T19:08:07.756588] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-28T19:08:07.756687] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GSK took 25.4s. Estimated remaining: 3h 2m 24s. Rate: 7.6 symbols/min [2025-10-28T19:08:07.924108] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:07.964206] [DEBUG] [LOCAL ] GTN: Loaded 44461 existing records from primary storage. [2025-10-28T19:08:07.964473] [INFO ] [MAIN ] GTN: Loaded 44461 existing records. [2025-10-28T19:08:07.985355] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-28T19:08:08.140369] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:08.140558] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-28T19:08:08.140604] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-28T19:08:08.140964] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-28T19:08:08.141017] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-28T19:08:08.495291] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:08.528356] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T19:08:08.780253] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-28T19:08:09.346310] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T19:08:09.580223] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-28T19:08:09.772412] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T19:08:10.380254] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-28T19:08:10.701029] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:08:11.180250] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-28T19:08:11.270561] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:08:11.980268] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-28T19:08:12.249579] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T19:08:12.780276] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-28T19:08:13.063873] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T19:08:13.580303] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-28T19:08:13.711094] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:08:14.380247] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-28T19:08:14.800626] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:08:15.180249] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-28T19:08:15.831154] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T19:08:15.837878] [INFO ] [REMOTE ] GSL: Full fetch complete (48201 records). [2025-10-28T19:08:15.837988] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-28T19:08:15.985710] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-28T19:08:16.224668] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-28T19:08:16.224776] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-28T19:08:16.225752] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-28T19:08:16.225815] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-28T19:08:16.227031] [DEBUG] [LOCAL ] GSL: Trimmed 48201 records to 32477 (keeping 200 days of data) [2025-10-28T19:08:16.430425] [DEBUG] [LOCAL ] GSL: Primary data saved (32477 records). [2025-10-28T19:08:16.430639] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-28T19:08:16.430793] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GSL took 32.1s. Estimated remaining: 3h 2m 18s. Rate: 7.6 symbols/min [2025-10-28T19:08:16.579920] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:08:16.662428] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:16.692925] [DEBUG] [LOCAL ] GTY: Loaded 29754 existing records from primary storage. [2025-10-28T19:08:16.693189] [INFO ] [MAIN ] GTY: Loaded 29754 existing records. [2025-10-28T19:08:16.785362] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-28T19:08:16.880094] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:16.880588] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-28T19:08:16.880636] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-28T19:08:16.880964] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-28T19:08:16.881005] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-28T19:08:17.232723] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:17.417719] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T19:08:17.580250] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-28T19:08:18.221901] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:08:18.380257] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-28T19:08:18.934382] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T19:08:19.180213] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-28T19:08:19.248905] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:08:19.980287] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-28T19:08:20.427725] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:08:20.780287] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-28T19:08:21.122888] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:08:21.580313] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-28T19:08:21.917793] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:08:22.380270] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-28T19:08:22.905553] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T19:08:23.089593] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T19:08:23.180219] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-28T19:08:23.980258] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-28T19:08:24.123041] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:08:24.780375] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-28T19:08:25.232933] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:08:25.580251] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-28T19:08:25.964954] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:08:26.380251] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-28T19:08:26.611986] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:08:27.180256] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-28T19:08:27.735727] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T19:08:27.980259] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-28T19:08:28.266008] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T19:08:28.780263] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-28T19:08:29.257184] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:08:29.580265] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-28T19:08:29.868850] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:08:30.380231] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-28T19:08:30.565887] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:08:31.180314] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-28T19:08:31.571684] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T19:08:31.980250] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-28T19:08:32.241531] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:08:32.780268] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-28T19:08:33.295877] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:08:33.580984] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:08:33.580337] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-28T19:08:34.380310] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-28T19:08:34.843778] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:08:35.180272] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-28T19:08:35.690743] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:08:35.980318] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-28T19:08:36.516470] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T19:08:36.525365] [INFO ] [REMOTE ] GTN: Full fetch complete (65503 records). [2025-10-28T19:08:36.525539] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-28T19:08:36.788199] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-28T19:08:36.927931] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-28T19:08:36.928018] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-28T19:08:36.929195] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-28T19:08:36.929284] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-28T19:08:36.931024] [DEBUG] [LOCAL ] GTN: Trimmed 65503 records to 44374 (keeping 200 days of data) [2025-10-28T19:08:37.188324] [DEBUG] [LOCAL ] GTN: Primary data saved (44374 records). [2025-10-28T19:08:37.188488] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-28T19:08:37.188633] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTN took 29.4s. Estimated remaining: 3h 2m 28s. Rate: 7.6 symbols/min [2025-10-28T19:08:37.309503] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:08:37.344417] [INFO ] [REMOTE ] GTLS: Full fetch complete (61440 records). [2025-10-28T19:08:37.367272] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-28T19:08:37.449147] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:37.579366] [DEBUG] [LOCAL ] GUG: Loaded 11956 existing records from primary storage. [2025-10-28T19:08:37.604560] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-28T19:08:37.610252] [INFO ] [MAIN ] GUG: Loaded 11956 existing records. [2025-10-28T19:08:37.959893] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-28T19:08:37.982956] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-28T19:08:37.994102] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-28T19:08:37.994228] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-28T19:08:38.024360] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:38.038175] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-28T19:08:38.040423] [DEBUG] [LOCAL ] GTLS: Trimmed 61440 records to 42859 (keeping 200 days of data) [2025-10-28T19:08:38.040971] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-28T19:08:38.041861] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-28T19:08:38.043253] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:08:38.091492] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-28T19:08:38.393672] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-28T19:08:38.676557] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:38.681108] [DEBUG] [LOCAL ] GTLS: Primary data saved (42859 records). [2025-10-28T19:08:38.681468] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-28T19:08:38.681564] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTLS took 33.3s. Estimated remaining: 3h 2m 11s. Rate: 7.6 symbols/min [2025-10-28T19:08:38.846670] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:38.862232] [DEBUG] [LOCAL ] GUT: Loaded 15426 existing records from primary storage. [2025-10-28T19:08:38.862498] [INFO ] [MAIN ] GUT: Loaded 15426 existing records. [2025-10-28T19:08:39.048045] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:39.048384] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-28T19:08:39.048495] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-28T19:08:39.048759] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-28T19:08:39.048929] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-28T19:08:39.189926] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-28T19:08:39.332874] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T19:08:39.486214] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:39.625382] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T19:08:39.632006] [INFO ] [REMOTE ] GTY: Full fetch complete (43819 records). [2025-10-28T19:08:39.632117] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-28T19:08:39.985383] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-28T19:08:40.026559] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-28T19:08:40.026665] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-28T19:08:40.027553] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-28T19:08:40.027753] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-28T19:08:40.040824] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T19:08:40.042607] [DEBUG] [LOCAL ] GTY: Trimmed 43819 records to 29639 (keeping 200 days of data) [2025-10-28T19:08:40.222128] [DEBUG] [LOCAL ] GTY: Primary data saved (29639 records). [2025-10-28T19:08:40.222282] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-28T19:08:40.222369] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GTY took 23.8s. Estimated remaining: 3h 1m 54s. Rate: 7.6 symbols/min [2025-10-28T19:08:40.391577] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:40.422791] [DEBUG] [LOCAL ] GVA: Loaded 32201 existing records from primary storage. [2025-10-28T19:08:40.423070] [INFO ] [MAIN ] GVA: Loaded 32201 existing records. [2025-10-28T19:08:40.603708] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:40.603977] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-28T19:08:40.604076] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-28T19:08:40.604515] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-28T19:08:40.604595] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-28T19:08:40.791570] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-28T19:08:40.989944] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:41.423630] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:08:41.580219] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-28T19:08:41.639472] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T19:08:42.380284] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-28T19:08:42.603503] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T19:08:42.910794] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:08:43.180332] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-28T19:08:43.980266] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-28T19:08:44.488780] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:08:44.508357] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:08:44.780271] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-28T19:08:45.580308] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-28T19:08:45.826265] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T19:08:46.199049] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T19:08:46.380238] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-28T19:08:47.180330] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-28T19:08:47.547730] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T19:08:47.736213] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T19:08:47.980259] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-28T19:08:48.780291] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-28T19:08:49.382153] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T19:08:49.400949] [INFO ] [REMOTE ] GTES: Full fetch complete (73840 records). [2025-10-28T19:08:49.401957] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-28T19:08:49.401842] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T19:08:49.596844] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-28T19:08:49.792858] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-28T19:08:49.792935] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-28T19:08:49.793856] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-28T19:08:49.793919] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-28T19:08:49.795368] [DEBUG] [LOCAL ] GTES: Trimmed 73840 records to 50234 (keeping 200 days of data) [2025-10-28T19:08:50.073613] [DEBUG] [LOCAL ] GTES: Primary data saved (50234 records). [2025-10-28T19:08:50.073763] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-28T19:08:50.074465] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GTES took 45.0s. Estimated remaining: 3h 1m 49s. Rate: 7.6 symbols/min [2025-10-28T19:08:50.243557] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:50.265866] [DEBUG] [LOCAL ] GWH: Loaded 20891 existing records from primary storage. [2025-10-28T19:08:50.266112] [INFO ] [MAIN ] GWH: Loaded 20891 existing records. [2025-10-28T19:08:50.385310] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-28T19:08:50.452165] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:50.464466] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T19:08:50.464058] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-28T19:08:50.469301] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-28T19:08:50.469611] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-28T19:08:50.469708] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-28T19:08:50.849138] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:50.977195] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T19:08:51.180271] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-28T19:08:51.775578] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T19:08:51.980313] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-28T19:08:52.629389] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:08:52.780302] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-28T19:08:53.351004] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T19:08:53.580288] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-28T19:08:54.380255] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-28T19:08:54.670071] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T19:08:54.807872] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T19:08:55.180315] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-28T19:08:55.869042] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:08:55.980273] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-28T19:08:56.518457] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:08:56.780343] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-28T19:08:57.302558] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T19:08:57.580227] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-28T19:08:58.117464] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:08:58.380286] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-28T19:08:58.932897] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T19:08:59.180241] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-28T19:08:59.980219] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-28T19:09:00.182000] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T19:09:00.780223] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-28T19:09:00.900230] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:09:01.580253] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-28T19:09:01.903367] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T19:09:01.906225] [INFO ] [REMOTE ] GUG: Full fetch complete (18747 records). [2025-10-28T19:09:01.906314] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-28T19:09:02.268400] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-28T19:09:02.268498] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-28T19:09:02.268922] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-28T19:09:02.268981] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-28T19:09:02.269492] [DEBUG] [LOCAL ] GUG: Trimmed 18747 records to 12023 (keeping 200 days of data) [2025-10-28T19:09:02.341898] [DEBUG] [LOCAL ] GUG: Primary data saved (12023 records). [2025-10-28T19:09:02.342017] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-28T19:09:02.342097] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GUG took 25.2s. Estimated remaining: 3h 1m 48s. Rate: 7.6 symbols/min [2025-10-28T19:09:02.384716] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-28T19:09:02.500552] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T19:09:02.526622] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:02.566407] [DEBUG] [LOCAL ] GWRE: Loaded 39239 existing records from primary storage. [2025-10-28T19:09:02.566705] [INFO ] [MAIN ] GWRE: Loaded 39239 existing records. [2025-10-28T19:09:02.743606] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:02.743830] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-28T19:09:02.743878] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-28T19:09:02.744191] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-28T19:09:02.744252] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-28T19:09:03.018018] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:09:03.127725] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:03.180205] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-28T19:09:03.980282] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-28T19:09:04.308294] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:09:04.780260] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-28T19:09:04.995844] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:09:05.580295] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-28T19:09:05.874759] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:09:06.380246] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-28T19:09:06.543258] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T19:09:07.128729] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T19:09:07.180235] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-28T19:09:07.790736] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T19:09:07.980240] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-28T19:09:08.780293] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-28T19:09:09.334624] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:09:09.580284] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-28T19:09:09.597313] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:09:10.380275] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-28T19:09:10.676621] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T19:09:11.180275] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-28T19:09:11.233301] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T19:09:11.939368] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T19:09:11.943114] [INFO ] [REMOTE ] GUT: Full fetch complete (22463 records). [2025-10-28T19:09:11.943188] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-28T19:09:11.985363] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-28T19:09:12.301757] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-28T19:09:12.301852] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-28T19:09:12.302345] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-28T19:09:12.302387] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-28T19:09:12.303177] [DEBUG] [LOCAL ] GUT: Trimmed 22463 records to 15398 (keeping 200 days of data) [2025-10-28T19:09:12.389464] [DEBUG] [LOCAL ] GUT: Primary data saved (15398 records). [2025-10-28T19:09:12.389588] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-28T19:09:12.389685] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GUT took 33.7s. Estimated remaining: 3h 1m 43s. Rate: 7.6 symbols/min [2025-10-28T19:09:12.561729] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:12.581558] [DEBUG] [LOCAL ] GWW: Loaded 18953 existing records from primary storage. [2025-10-28T19:09:12.581849] [INFO ] [MAIN ] GWW: Loaded 18953 existing records. [2025-10-28T19:09:12.759782] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:12.770897] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-28T19:09:12.771032] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-28T19:09:12.772226] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T19:09:12.772300] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-28T19:09:12.772552] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-28T19:09:12.787962] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-28T19:09:13.124996] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:13.580246] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-28T19:09:14.019567] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:09:14.380266] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-28T19:09:14.475142] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:09:15.075865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T19:09:15.180273] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-28T19:09:15.980247] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-28T19:09:16.747403] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:09:16.780219] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-28T19:09:17.059159] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-28T19:09:17.067924] [INFO ] [REMOTE ] GWH: Full fetch complete (25662 records). [2025-10-28T19:09:17.068028] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-28T19:09:17.435421] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-28T19:09:17.435496] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-28T19:09:17.436087] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-28T19:09:17.436148] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-28T19:09:17.436845] [DEBUG] [LOCAL ] GWH: Trimmed 25662 records to 21187 (keeping 200 days of data) [2025-10-28T19:09:17.552810] [DEBUG] [LOCAL ] GWH: Primary data saved (21187 records). [2025-10-28T19:09:17.552937] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-28T19:09:17.553011] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GWH took 27.5s. Estimated remaining: 3h 1m 31s. Rate: 7.6 symbols/min [2025-10-28T19:09:17.585337] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-28T19:09:17.727598] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:17.768053] [DEBUG] [LOCAL ] GXO: Loaded 46145 existing records from primary storage. [2025-10-28T19:09:17.768467] [INFO ] [MAIN ] GXO: Loaded 46145 existing records. [2025-10-28T19:09:17.947054] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:17.947439] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-28T19:09:17.954959] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-28T19:09:17.969357] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-28T19:09:17.969302] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:09:17.977101] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-28T19:09:18.328423] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:18.380223] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-28T19:09:18.546867] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T19:09:19.180322] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-28T19:09:19.431792] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:09:19.980224] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-28T19:09:20.140133] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T19:09:20.780290] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-28T19:09:21.246449] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:09:21.485350] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T19:09:21.580220] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-28T19:09:22.253784] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:09:22.380245] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-28T19:09:23.180251] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-28T19:09:23.599166] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:09:23.980261] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-28T19:09:24.459516] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:09:24.780228] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-28T19:09:25.125408] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:09:25.132300] [INFO ] [REMOTE ] GVA: Full fetch complete (48464 records). [2025-10-28T19:09:25.132401] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-28T19:09:25.510172] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-28T19:09:25.510248] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-28T19:09:25.510987] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-28T19:09:25.511048] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-28T19:09:25.512013] [DEBUG] [LOCAL ] GVA: Trimmed 48464 records to 32061 (keeping 200 days of data) [2025-10-28T19:09:25.599227] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-28T19:09:25.713447] [DEBUG] [LOCAL ] GVA: Primary data saved (32061 records). [2025-10-28T19:09:25.714063] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-28T19:09:25.714182] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GVA took 45.5s. Estimated remaining: 3h 1m 24s. Rate: 7.6 symbols/min [2025-10-28T19:09:25.884986] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:25.888435] [DEBUG] [LOCAL ] GYLD: Loaded 1514 existing records from primary storage. [2025-10-28T19:09:25.888598] [INFO ] [MAIN ] GYLD: Loaded 1514 existing records. [2025-10-28T19:09:26.099377] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:26.101887] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:09:26.102098] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-28T19:09:26.112787] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-28T19:09:26.113766] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-28T19:09:26.113833] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-28T19:09:26.384223] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-28T19:09:26.468240] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:26.596090] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:09:27.080508] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:09:27.180272] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-28T19:09:27.980242] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-28T19:09:28.006564] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:09:28.213689] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-28T19:09:28.780252] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-28T19:09:29.580261] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-28T19:09:29.838406] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-28T19:09:29.873189] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T19:09:30.380265] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-28T19:09:31.180263] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-28T19:09:31.425967] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T19:09:31.481061] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T19:09:31.980285] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-28T19:09:32.696279] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T19:09:32.780307] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-28T19:09:33.083637] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T19:09:33.580282] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-28T19:09:34.380404] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-28T19:09:34.649264] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T19:09:35.159940] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T19:09:35.180238] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-28T19:09:35.980260] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-28T19:09:36.145718] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:09:36.149964] [INFO ] [REMOTE ] GWW: Full fetch complete (28975 records). [2025-10-28T19:09:36.150071] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-28T19:09:36.314948] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T19:09:36.534520] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-28T19:09:36.534617] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-28T19:09:36.535238] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-28T19:09:36.535298] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-28T19:09:36.535981] [DEBUG] [LOCAL ] GWW: Trimmed 28975 records to 18883 (keeping 200 days of data) [2025-10-28T19:09:36.652055] [DEBUG] [LOCAL ] GWW: Primary data saved (18883 records). [2025-10-28T19:09:36.652183] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-28T19:09:36.652256] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GWW took 24.3s. Estimated remaining: 3h 1m 20s. Rate: 7.6 symbols/min [2025-10-28T19:09:36.790414] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-28T19:09:36.822191] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:36.863618] [DEBUG] [LOCAL ] H: Loaded 44189 existing records from primary storage. [2025-10-28T19:09:36.863906] [INFO ] [MAIN ] H: Loaded 44189 existing records. [2025-10-28T19:09:37.037899] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:37.038085] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-28T19:09:37.038131] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-28T19:09:37.038868] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-28T19:09:37.038925] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-28T19:09:37.143430] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T19:09:37.397475] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:37.580273] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-28T19:09:38.380265] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-28T19:09:38.836313] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:09:39.180235] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-28T19:09:39.416833] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:09:39.484547] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:09:39.980335] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-28T19:09:40.266080] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T19:09:40.780293] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-28T19:09:41.580260] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-28T19:09:41.831780] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:09:42.380281] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-28T19:09:42.641340] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:09:43.180239] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-28T19:09:43.515190] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:09:43.980313] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-28T19:09:44.552765] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T19:09:44.561486] [INFO ] [REMOTE ] GXO: Full fetch complete (69124 records). [2025-10-28T19:09:44.561620] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-28T19:09:44.786700] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-28T19:09:44.947578] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-28T19:09:44.947681] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-28T19:09:44.948566] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-28T19:09:44.948606] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-28T19:09:44.949965] [DEBUG] [LOCAL ] GXO: Trimmed 69124 records to 46093 (keeping 200 days of data) [2025-10-28T19:09:45.157710] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:09:45.241163] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T19:09:45.259202] [DEBUG] [LOCAL ] GXO: Primary data saved (46093 records). [2025-10-28T19:09:45.259699] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-28T19:09:45.260482] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 27.7s. Estimated remaining: 3h 1m 13s. Rate: 7.6 symbols/min [2025-10-28T19:09:45.424701] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:45.464965] [DEBUG] [LOCAL ] HAE: Loaded 38963 existing records from primary storage. [2025-10-28T19:09:45.465247] [INFO ] [MAIN ] HAE: Loaded 38963 existing records. [2025-10-28T19:09:45.585329] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-28T19:09:45.662987] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:45.663188] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-28T19:09:45.663233] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-28T19:09:45.663618] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-28T19:09:45.663711] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-28T19:09:46.009073] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:46.380308] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-28T19:09:46.777251] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T19:09:46.778216] [INFO ] [REMOTE ] GYLD: Full fetch complete (2113 records). [2025-10-28T19:09:46.778285] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-28T19:09:46.970149] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:09:47.176539] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-28T19:09:47.176616] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-28T19:09:47.176734] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-28T19:09:47.176788] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-28T19:09:47.177113] [DEBUG] [LOCAL ] GYLD: Trimmed 2113 records to 1514 (keeping 200 days of data) [2025-10-28T19:09:47.182206] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-28T19:09:47.186910] [DEBUG] [LOCAL ] GYLD: Primary data saved (1514 records). [2025-10-28T19:09:47.187831] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-28T19:09:47.187920] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. GYLD took 21.5s. Estimated remaining: 3h 0m 57s. Rate: 7.6 symbols/min [2025-10-28T19:09:47.359827] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:47.398308] [DEBUG] [LOCAL ] HAFN: Loaded 42433 existing records from primary storage. [2025-10-28T19:09:47.398597] [INFO ] [MAIN ] HAFN: Loaded 42433 existing records. [2025-10-28T19:09:47.572095] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:47.572352] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-28T19:09:47.572407] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-28T19:09:47.573165] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-28T19:09:47.573222] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-28T19:09:47.918526] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:47.980230] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-28T19:09:48.381441] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T19:09:48.391883] [INFO ] [REMOTE ] GWRE: Full fetch complete (59830 records). [2025-10-28T19:09:48.392005] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-28T19:09:48.771468] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-28T19:09:48.771544] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-28T19:09:48.772368] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-28T19:09:48.772428] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-28T19:09:48.773561] [DEBUG] [LOCAL ] GWRE: Trimmed 59830 records to 39159 (keeping 200 days of data) [2025-10-28T19:09:48.822866] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-28T19:09:49.012089] [DEBUG] [LOCAL ] GWRE: Primary data saved (39159 records). [2025-10-28T19:09:49.012228] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-28T19:09:49.012308] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. GWRE took 46.7s. Estimated remaining: 3h 0m 41s. Rate: 7.6 symbols/min [2025-10-28T19:09:49.180110] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:49.229178] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-28T19:09:49.229467] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-28T19:09:49.415562] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:49.415898] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-28T19:09:49.416002] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-28T19:09:49.416880] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-28T19:09:49.416975] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-28T19:09:49.586753] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T19:09:49.584832] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-28T19:09:49.809941] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:50.099005] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:09:50.380316] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-28T19:09:50.768219] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:09:51.180250] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-28T19:09:51.594841] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T19:09:51.980290] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-28T19:09:52.780228] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-28T19:09:52.873976] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T19:09:53.580304] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-28T19:09:53.897824] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T19:09:54.380259] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-28T19:09:54.691850] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T19:09:55.099456] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T19:09:55.180306] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-28T19:09:55.586336] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T19:09:55.980323] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-28T19:09:56.524176] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:09:56.780232] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-28T19:09:57.108554] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T19:09:57.580342] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-28T19:09:58.094317] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:09:58.380282] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-28T19:09:58.596556] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:09:59.180295] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-28T19:09:59.666436] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T19:09:59.980326] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-28T19:10:00.780321] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-28T19:10:00.972447] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T19:10:01.127123] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:10:01.580314] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-28T19:10:01.864102] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:10:02.380262] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-28T19:10:03.180251] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-28T19:10:03.470867] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T19:10:03.570123] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:10:03.980246] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-28T19:10:04.388785] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T19:10:04.780262] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-28T19:10:05.101152] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:10:05.580318] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-28T19:10:06.098594] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:10:06.380299] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-28T19:10:06.547546] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T19:10:07.180264] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-28T19:10:07.980229] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-28T19:10:08.037409] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T19:10:08.310590] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:10:08.780255] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-28T19:10:09.243725] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:10:09.580230] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-28T19:10:10.242922] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:10:10.380246] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-28T19:10:10.613059] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T19:10:11.180251] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-28T19:10:11.462033] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:10:11.980244] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-28T19:10:12.608845] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T19:10:12.618547] [INFO ] [REMOTE ] H: Full fetch complete (63613 records). [2025-10-28T19:10:12.618779] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-28T19:10:12.785077] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-28T19:10:13.031819] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-28T19:10:13.031938] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-28T19:10:13.033378] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-28T19:10:13.033450] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-28T19:10:13.035252] [DEBUG] [LOCAL ] H: Trimmed 63613 records to 44158 (keeping 200 days of data) [2025-10-28T19:10:13.365460] [DEBUG] [LOCAL ] H: Primary data saved (44158 records). [2025-10-28T19:10:13.366214] [INFO ] [MAIN ] H: Full history saved. [2025-10-28T19:10:13.367026] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:10:13.367250] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 36.7s. Estimated remaining: 3h 0m 56s. Rate: 7.6 symbols/min [2025-10-28T19:10:13.444891] [INFO ] [REMOTE ] HAFN: Full fetch complete (64472 records). [2025-10-28T19:10:13.455943] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-28T19:10:13.607219] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-28T19:10:13.659738] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:13.989489] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-28T19:10:13.990784] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-28T19:10:13.990675] [DEBUG] [LOCAL ] HASI: Loaded 47503 existing records from primary storage. [2025-10-28T19:10:13.991947] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-28T19:10:13.992037] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-28T19:10:13.992455] [INFO ] [MAIN ] HASI: Loaded 47503 existing records. [2025-10-28T19:10:14.100965] [DEBUG] [LOCAL ] HAFN: Trimmed 64472 records to 42374 (keeping 200 days of data) [2025-10-28T19:10:14.274959] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:14.277921] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-28T19:10:14.278251] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-28T19:10:14.279671] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-28T19:10:14.280512] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-28T19:10:14.796839] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:14.805301] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-28T19:10:14.839331] [DEBUG] [LOCAL ] HAFN: Primary data saved (42374 records). [2025-10-28T19:10:14.839768] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-28T19:10:14.840316] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAFN took 27.7s. Estimated remaining: 3h 0m 39s. Rate: 7.6 symbols/min [2025-10-28T19:10:15.088189] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T19:10:15.091205] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:15.094259] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-28T19:10:15.114039] [INFO ] [REMOTE ] HAE: Full fetch complete (59310 records). [2025-10-28T19:10:15.114535] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-28T19:10:15.184503] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-28T19:10:15.445955] [DEBUG] [LOCAL ] HAYW: Loaded 48740 existing records from primary storage. [2025-10-28T19:10:15.452146] [INFO ] [MAIN ] HAYW: Loaded 48740 existing records. [2025-10-28T19:10:15.658228] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-28T19:10:15.663471] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-28T19:10:15.683912] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-28T19:10:15.689166] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-28T19:10:15.726867] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:15.727197] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-28T19:10:15.727422] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-28T19:10:15.727318] [DEBUG] [LOCAL ] HAE: Trimmed 59310 records to 38836 (keeping 200 days of data) [2025-10-28T19:10:15.727878] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-28T19:10:15.727947] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-28T19:10:16.264384] [DEBUG] [LOCAL ] HAE: Primary data saved (38836 records). [2025-10-28T19:10:16.298869] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-28T19:10:16.334907] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HAE took 31.1s. Estimated remaining: 3h 0m 22s. Rate: 7.6 symbols/min [2025-10-28T19:10:16.333800] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:16.346803] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-28T19:10:16.553171] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:16.558153] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T19:10:16.578344] [DEBUG] [LOCAL ] HBB: Loaded 6050 existing records from primary storage. [2025-10-28T19:10:16.578591] [INFO ] [MAIN ] HBB: Loaded 6050 existing records. [2025-10-28T19:10:16.756153] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:16.756449] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-28T19:10:16.756506] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-28T19:10:16.756685] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-28T19:10:16.756743] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-28T19:10:16.787403] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-28T19:10:17.140200] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:17.185738] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-28T19:10:17.580272] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-28T19:10:17.655180] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:10:18.061607] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T19:10:18.099753] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T19:10:18.380339] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-28T19:10:19.180244] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-28T19:10:19.605223] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:10:19.792259] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T19:10:19.980271] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-28T19:10:20.502958] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T19:10:20.780299] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-28T19:10:21.580324] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-28T19:10:21.911326] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T19:10:22.380318] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-28T19:10:22.797822] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T19:10:23.180302] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-28T19:10:23.905309] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T19:10:23.980229] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-28T19:10:24.484521] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:10:24.607732] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:10:24.780228] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-28T19:10:25.275963] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:10:25.580307] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-28T19:10:26.380333] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-28T19:10:26.737763] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T19:10:26.808237] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:10:27.180332] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-28T19:10:27.980311] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-28T19:10:28.424882] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:10:28.780273] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-28T19:10:29.222721] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T19:10:29.580249] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-28T19:10:30.005481] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T19:10:30.156633] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T19:10:30.380269] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-28T19:10:30.906823] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T19:10:31.180288] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-28T19:10:31.980318] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-28T19:10:32.383417] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T19:10:32.413947] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:10:32.780261] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-28T19:10:33.580250] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-28T19:10:34.046404] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:10:34.163268] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:10:34.174082] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-28T19:10:34.174237] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-28T19:10:34.385449] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-28T19:10:34.569228] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-28T19:10:34.569347] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-28T19:10:34.570680] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-28T19:10:34.570759] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-28T19:10:34.572574] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-28T19:10:34.898694] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-28T19:10:34.898834] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-28T19:10:34.898910] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HAL took 45.9s. Estimated remaining: 3h 0m 29s. Rate: 7.6 symbols/min [2025-10-28T19:10:35.064597] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:35.112772] [DEBUG] [LOCAL ] HBI: Loaded 52899 existing records from primary storage. [2025-10-28T19:10:35.113092] [INFO ] [MAIN ] HBI: Loaded 52899 existing records. [2025-10-28T19:10:35.187451] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-28T19:10:35.291916] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:35.292130] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-28T19:10:35.292197] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-28T19:10:35.292484] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-28T19:10:35.292541] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-28T19:10:35.644614] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:35.727461] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T19:10:35.783876] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T19:10:35.785313] [INFO ] [REMOTE ] HBB: Full fetch complete (9140 records). [2025-10-28T19:10:35.785384] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-28T19:10:35.990291] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-28T19:10:36.144547] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-28T19:10:36.144614] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-28T19:10:36.144846] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-28T19:10:36.144901] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-28T19:10:36.145304] [DEBUG] [LOCAL ] HBB: Trimmed 9140 records to 5976 (keeping 200 days of data) [2025-10-28T19:10:36.181096] [DEBUG] [LOCAL ] HBB: Primary data saved (5976 records). [2025-10-28T19:10:36.181191] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-28T19:10:36.181262] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HBB took 19.8s. Estimated remaining: 3h 0m 12s. Rate: 7.6 symbols/min [2025-10-28T19:10:36.345527] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:36.395285] [DEBUG] [LOCAL ] HBM: Loaded 52979 existing records from primary storage. [2025-10-28T19:10:36.395591] [INFO ] [MAIN ] HBM: Loaded 52979 existing records. [2025-10-28T19:10:36.590142] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:36.590322] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-28T19:10:36.590367] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-28T19:10:36.590714] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-28T19:10:36.590789] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-28T19:10:36.786591] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-28T19:10:36.943083] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:37.426272] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:10:37.580308] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-28T19:10:38.020886] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:10:38.380250] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-28T19:10:38.818609] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:10:39.180235] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-28T19:10:39.630803] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T19:10:39.980317] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-28T19:10:40.413766] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T19:10:40.780288] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-28T19:10:41.215023] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T19:10:41.580329] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-28T19:10:42.143757] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T19:10:42.153875] [INFO ] [REMOTE ] HAYW: Full fetch complete (70930 records). [2025-10-28T19:10:42.154035] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-28T19:10:42.385546] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-28T19:10:42.579340] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-28T19:10:42.579436] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-28T19:10:42.580577] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-28T19:10:42.580679] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-28T19:10:42.582572] [DEBUG] [LOCAL ] HAYW: Trimmed 70930 records to 48731 (keeping 200 days of data) [2025-10-28T19:10:42.909719] [DEBUG] [LOCAL ] HAYW: Primary data saved (48731 records). [2025-10-28T19:10:42.910069] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-28T19:10:42.910189] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HAYW took 28.1s. Estimated remaining: 3h 0m 3s. Rate: 7.6 symbols/min [2025-10-28T19:10:43.111775] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:10:43.131564] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:43.188162] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-28T19:10:43.192854] [DEBUG] [LOCAL ] HCA: Loaded 46869 existing records from primary storage. [2025-10-28T19:10:43.193406] [INFO ] [MAIN ] HCA: Loaded 46869 existing records. [2025-10-28T19:10:43.406557] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:43.407081] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-28T19:10:43.407160] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-28T19:10:43.407890] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-28T19:10:43.407960] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-28T19:10:43.845024] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:43.876181] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T19:10:43.980256] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-28T19:10:44.383961] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:10:44.780303] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-28T19:10:45.206868] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T19:10:45.580255] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-28T19:10:46.254128] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T19:10:46.380258] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-28T19:10:47.072071] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T19:10:47.180287] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-28T19:10:47.474611] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T19:10:47.980307] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-28T19:10:48.576448] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T19:10:48.585854] [INFO ] [REMOTE ] HASI: Full fetch complete (68208 records). [2025-10-28T19:10:48.585995] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-28T19:10:48.785470] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-28T19:10:48.977330] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-28T19:10:48.977405] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-28T19:10:48.978312] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-28T19:10:48.978375] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-28T19:10:48.979581] [DEBUG] [LOCAL ] HASI: Trimmed 68208 records to 47390 (keeping 200 days of data) [2025-10-28T19:10:49.258336] [DEBUG] [LOCAL ] HASI: Primary data saved (47390 records). [2025-10-28T19:10:49.258583] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-28T19:10:49.258697] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HASI took 35.9s. Estimated remaining: 2h 59m 53s. Rate: 7.6 symbols/min [2025-10-28T19:10:49.428488] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:49.461563] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T19:10:49.504629] [DEBUG] [LOCAL ] HCC: Loaded 44733 existing records from primary storage. [2025-10-28T19:10:49.504996] [INFO ] [MAIN ] HCC: Loaded 44733 existing records. [2025-10-28T19:10:49.585388] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-28T19:10:49.683962] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:49.684242] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-28T19:10:49.684296] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-28T19:10:49.684550] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-28T19:10:49.684606] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-28T19:10:50.029432] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:50.380229] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-28T19:10:50.493482] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T19:10:50.874752] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:10:51.180230] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-28T19:10:51.513958] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:10:51.980230] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-28T19:10:52.696937] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T19:10:52.780231] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-28T19:10:52.964414] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:10:53.580268] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-28T19:10:53.962249] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:10:54.380317] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-28T19:10:54.901765] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:10:55.180299] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-28T19:10:55.719251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:10:55.980362] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-28T19:10:56.299340] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:10:56.780250] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-28T19:10:57.257868] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:10:57.580285] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-28T19:10:57.946588] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T19:10:58.380310] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-28T19:10:58.648050] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:10:59.180261] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-28T19:10:59.542574] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:10:59.980266] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-28T19:11:00.780295] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-28T19:11:01.310895] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:11:01.449543] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-28T19:11:01.580269] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-28T19:11:02.139020] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:11:02.380256] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-28T19:11:02.572301] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:11:03.180261] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-28T19:11:03.843155] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:11:03.854183] [INFO ] [REMOTE ] HBI: Full fetch complete (76949 records). [2025-10-28T19:11:03.854357] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-28T19:11:03.985369] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-28T19:11:04.272191] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-28T19:11:04.272265] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-28T19:11:04.273322] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-28T19:11:04.273398] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-28T19:11:04.274870] [DEBUG] [LOCAL ] HBI: Trimmed 76949 records to 52883 (keeping 200 days of data) [2025-10-28T19:11:04.589155] [DEBUG] [LOCAL ] HBI: Primary data saved (52883 records). [2025-10-28T19:11:04.600409] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-28T19:11:04.600521] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HBI took 29.7s. Estimated remaining: 2h 59m 55s. Rate: 7.6 symbols/min [2025-10-28T19:11:04.602359] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:11:04.780320] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-28T19:11:05.392890] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T19:11:05.580270] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-28T19:11:05.925853] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T19:11:06.380269] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-28T19:11:07.116455] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T19:11:07.180269] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-28T19:11:07.436543] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:11:07.980293] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-28T19:11:08.780303] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-28T19:11:09.122894] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:11:09.175937] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T19:11:09.187109] [INFO ] [REMOTE ] HBM: Full fetch complete (76773 records). [2025-10-28T19:11:09.187259] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-28T19:11:09.585678] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-28T19:11:09.586683] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-28T19:11:09.587983] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-28T19:11:09.589074] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-28T19:11:09.589181] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-28T19:11:09.590835] [DEBUG] [LOCAL ] HBM: Trimmed 76773 records to 52979 (keeping 200 days of data) [2025-10-28T19:11:09.914611] [DEBUG] [LOCAL ] HBM: Primary data saved (52979 records). [2025-10-28T19:11:09.914820] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-28T19:11:09.915624] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HBM took 33.7s. Estimated remaining: 2h 59m 44s. Rate: 7.6 symbols/min [2025-10-28T19:11:10.310006] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:11:10.380214] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-28T19:11:10.767178] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:11:11.180251] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-28T19:11:11.729849] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:11:11.980279] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-28T19:11:12.687834] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T19:11:12.696325] [INFO ] [REMOTE ] HCC: Full fetch complete (64713 records). [2025-10-28T19:11:12.696468] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-28T19:11:13.074207] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-28T19:11:13.074320] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-28T19:11:13.075236] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-28T19:11:13.075738] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-28T19:11:13.077056] [DEBUG] [LOCAL ] HCC: Trimmed 64713 records to 44630 (keeping 200 days of data) [2025-10-28T19:11:13.359741] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T19:11:13.377059] [DEBUG] [LOCAL ] HCC: Primary data saved (44630 records). [2025-10-28T19:11:13.377441] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-28T19:11:13.377537] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-28T19:11:13.377824] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HCC took 24.1s. Estimated remaining: 2h 59m 30s. Rate: 7.6 symbols/min [2025-10-28T19:11:14.862045] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T19:11:14.871464] [INFO ] [REMOTE ] HCA: Full fetch complete (68889 records). [2025-10-28T19:11:14.871618] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-28T19:11:15.271393] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-28T19:11:15.271485] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-28T19:11:15.272442] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-28T19:11:15.272503] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-28T19:11:15.273884] [DEBUG] [LOCAL ] HCA: Trimmed 68889 records to 46820 (keeping 200 days of data) [2025-10-28T19:11:15.564487] [DEBUG] [LOCAL ] HCA: Primary data saved (46820 records). [2025-10-28T19:11:15.564624] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-28T19:11:15.565401] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCA took 32.7s. Estimated remaining: 2h 59m 14s. Rate: 7.6 symbols/min [2025-10-28T19:11:16.132005] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.221579] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.251211] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.311870] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.312305] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-28T19:11:16.312713] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-28T19:11:16.312873] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-28T19:11:16.313049] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-28T19:11:16.313203] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-28T19:11:16.313255] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-28T19:11:16.471143] [DEBUG] [LOCAL ] HCI: Loaded 13895 existing records from primary storage. [2025-10-28T19:11:16.521544] [INFO ] [MAIN ] HCI: Loaded 13895 existing records. [2025-10-28T19:11:16.727238] [DEBUG] [LOCAL ] HD: Loaded 53453 existing records from primary storage. [2025-10-28T19:11:16.762665] [INFO ] [MAIN ] HD: Loaded 53453 existing records. [2025-10-28T19:11:16.768902] [DEBUG] [LOCAL ] HDB: Loaded 51901 existing records from primary storage. [2025-10-28T19:11:16.895698] [INFO ] [MAIN ] HDB: Loaded 51901 existing records. [2025-10-28T19:11:17.097507] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:17.170785] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-28T19:11:17.187470] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:17.235365] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-28T19:11:17.234757] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-28T19:11:17.262195] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-28T19:11:17.295768] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:17.329992] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-28T19:11:17.310257] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-28T19:11:17.330178] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-28T19:11:17.388324] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-28T19:11:17.389162] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-28T19:11:17.378006] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:17.405680] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-28T19:11:17.492048] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-28T19:11:17.533966] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-28T19:11:17.581519] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-28T19:11:17.581804] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T19:11:17.677043] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-28T19:11:18.151072] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T19:11:18.257582] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-28T19:11:18.427143] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:18.495215] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-28T19:11:18.551871] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T19:11:18.603114] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:18.609933] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-28T19:11:18.620955] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-28T19:11:18.713206] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:18.713552] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-28T19:11:18.956465] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T19:11:19.180340] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-28T19:11:19.214939] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T19:11:19.686609] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:11:19.980285] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-28T19:11:20.098320] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:11:20.145184] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T19:11:20.430526] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T19:11:20.780265] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-28T19:11:21.580288] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-28T19:11:22.060262] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T19:11:22.380272] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-28T19:11:22.923074] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:11:23.106878] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T19:11:23.180277] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-28T19:11:23.980282] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-28T19:11:24.633378] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:11:24.635210] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T19:11:24.780301] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-28T19:11:25.514715] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T19:11:25.580252] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-28T19:11:26.283044] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:11:26.380301] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-28T19:11:27.180265] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-28T19:11:27.399293] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-28T19:11:27.716268] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:11:27.980296] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-28T19:11:28.780286] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-28T19:11:28.992315] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-28T19:11:29.240000] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:11:29.580317] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-28T19:11:30.191451] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:11:30.380275] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-28T19:11:31.180252] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-28T19:11:31.856767] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T19:11:31.980884] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-28T19:11:31.987016] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T19:11:32.200587] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T19:11:32.780303] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-28T19:11:33.580283] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-28T19:11:33.840307] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-28T19:11:34.380265] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-28T19:11:34.665154] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T19:11:34.690136] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T19:11:34.690795] [INFO ] [REMOTE ] HCXY: Full fetch complete (517 records). [2025-10-28T19:11:34.690864] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-28T19:11:34.872623] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-28T19:11:34.872804] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:11:34.872871] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:11:34.872941] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-28T19:11:34.873020] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-28T19:11:34.873056] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-28T19:11:34.873095] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-28T19:11:34.873148] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HCXY took 19.3s. Estimated remaining: 2h 59m 22s. Rate: 7.6 symbols/min [2025-10-28T19:11:35.045382] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:35.092070] [DEBUG] [LOCAL ] HE: Loaded 48626 existing records from primary storage. [2025-10-28T19:11:35.092357] [INFO ] [MAIN ] HE: Loaded 48626 existing records. [2025-10-28T19:11:35.185454] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-28T19:11:35.275750] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:35.275961] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-28T19:11:35.276008] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-28T19:11:35.276625] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-28T19:11:35.276715] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-28T19:11:35.624179] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:35.933240] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:11:35.980237] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-28T19:11:36.780280] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-28T19:11:37.239216] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T19:11:37.545992] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:11:37.551162] [INFO ] [REMOTE ] HCI: Full fetch complete (19494 records). [2025-10-28T19:11:37.551289] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-28T19:11:37.585387] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-28T19:11:37.934062] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-28T19:11:37.934138] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-28T19:11:37.934542] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-28T19:11:37.934581] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-28T19:11:37.935131] [DEBUG] [LOCAL ] HCI: Trimmed 19494 records to 13859 (keeping 200 days of data) [2025-10-28T19:11:38.024416] [DEBUG] [LOCAL ] HCI: Primary data saved (13859 records). [2025-10-28T19:11:38.024839] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-28T19:11:38.024929] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HCI took 22.5s. Estimated remaining: 2h 59m 7s. Rate: 7.6 symbols/min [2025-10-28T19:11:38.188797] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:38.219018] [DEBUG] [LOCAL ] HEI: Loaded 30061 existing records from primary storage. [2025-10-28T19:11:38.219286] [INFO ] [MAIN ] HEI: Loaded 30061 existing records. [2025-10-28T19:11:38.387754] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-28T19:11:38.392365] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:38.393468] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-28T19:11:38.393519] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-28T19:11:38.394134] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-28T19:11:38.394197] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-28T19:11:38.736778] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:38.986522] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T19:11:39.180282] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-28T19:11:39.877349] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T19:11:39.980247] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-28T19:11:40.310518] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:11:40.780234] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-28T19:11:41.180242] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:11:41.580308] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-28T19:11:42.311124] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T19:11:42.380204] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-28T19:11:42.642488] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:11:43.180298] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-28T19:11:43.936553] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T19:11:43.980287] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-28T19:11:44.364968] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T19:11:44.780355] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-28T19:11:45.580235] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-28T19:11:45.671623] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T19:11:45.858872] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:11:46.380247] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-28T19:11:46.691112] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:11:47.180326] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-28T19:11:47.836026] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T19:11:47.980271] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-28T19:11:48.597162] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:11:48.780229] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-28T19:11:49.229763] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:11:49.580272] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-28T19:11:50.021498] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:11:50.380306] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-28T19:11:50.650081] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:11:51.180283] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-28T19:11:51.931179] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:11:51.980213] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-28T19:11:52.212775] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T19:11:52.780308] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-28T19:11:53.580235] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-28T19:11:53.702805] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T19:11:53.716112] [INFO ] [REMOTE ] HD: Full fetch complete (77530 records). [2025-10-28T19:11:53.716408] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-28T19:11:54.092693] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:11:54.199538] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-28T19:11:54.199636] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-28T19:11:54.200787] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-28T19:11:54.200858] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-28T19:11:54.202411] [DEBUG] [LOCAL ] HD: Trimmed 77530 records to 53446 (keeping 200 days of data) [2025-10-28T19:11:54.381303] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-28T19:11:54.546885] [DEBUG] [LOCAL ] HD: Primary data saved (53446 records). [2025-10-28T19:11:54.547054] [INFO ] [MAIN ] HD: Full history saved. [2025-10-28T19:11:54.547157] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HD took 39.0s. Estimated remaining: 2h 59m 11s. Rate: 7.6 symbols/min [2025-10-28T19:11:54.723772] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:54.732458] [DEBUG] [LOCAL ] HEQ: Loaded 6624 existing records from primary storage. [2025-10-28T19:11:54.732704] [INFO ] [MAIN ] HEQ: Loaded 6624 existing records. [2025-10-28T19:11:54.922835] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:54.923311] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-28T19:11:54.923387] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-28T19:11:54.923826] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-28T19:11:54.923954] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-28T19:11:55.192481] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-28T19:11:55.340005] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-28T19:11:55.371245] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:55.713835] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T19:11:55.980249] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-28T19:11:56.246990] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:11:56.780252] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-28T19:11:57.281059] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T19:11:57.443030] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:11:57.453765] [INFO ] [REMOTE ] HDB: Full fetch complete (75665 records). [2025-10-28T19:11:57.453885] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-28T19:11:57.585474] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-28T19:11:57.857785] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-28T19:11:57.857861] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-28T19:11:57.858811] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-28T19:11:57.858872] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-28T19:11:57.860243] [DEBUG] [LOCAL ] HDB: Trimmed 75665 records to 51896 (keeping 200 days of data) [2025-10-28T19:11:58.169851] [DEBUG] [LOCAL ] HDB: Primary data saved (51896 records). [2025-10-28T19:11:58.169979] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-28T19:11:58.171094] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HDB took 42.6s. Estimated remaining: 2h 58m 58s. Rate: 7.6 symbols/min [2025-10-28T19:11:58.337257] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:58.380253] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-28T19:11:58.382739] [DEBUG] [LOCAL ] HESM: Loaded 48557 existing records from primary storage. [2025-10-28T19:11:58.383066] [INFO ] [MAIN ] HESM: Loaded 48557 existing records. [2025-10-28T19:11:58.563794] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:58.563981] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-28T19:11:58.564028] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-28T19:11:58.564212] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-28T19:11:58.564253] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-28T19:11:58.932292] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:58.950355] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T19:11:59.180289] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-28T19:11:59.590455] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:11:59.780814] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:11:59.980266] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-28T19:12:00.780264] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-28T19:12:01.337917] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T19:12:01.580255] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-28T19:12:01.925100] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T19:12:02.154999] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:12:02.380257] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-28T19:12:03.180245] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-28T19:12:03.321061] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:12:03.980261] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-28T19:12:04.680619] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T19:12:04.690204] [INFO ] [REMOTE ] HE: Full fetch complete (71863 records). [2025-10-28T19:12:04.690318] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-28T19:12:04.786823] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-28T19:12:05.084392] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-28T19:12:05.084470] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-28T19:12:05.085409] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-28T19:12:05.085471] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-28T19:12:05.086827] [DEBUG] [LOCAL ] HE: Trimmed 71863 records to 48563 (keeping 200 days of data) [2025-10-28T19:12:05.361182] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T19:12:05.390836] [DEBUG] [LOCAL ] HE: Primary data saved (48563 records). [2025-10-28T19:12:05.391130] [INFO ] [MAIN ] HE: Full history saved. [2025-10-28T19:12:05.391923] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HE took 30.5s. Estimated remaining: 2h 58m 49s. Rate: 7.6 symbols/min [2025-10-28T19:12:05.563467] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T19:12:05.581144] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-28T19:12:05.605084] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:05.606596] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-28T19:12:05.606794] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-28T19:12:05.606967] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-28T19:12:05.607017] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-28T19:12:05.607060] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-28T19:12:05.607096] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-28T19:12:05.973462] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:06.097127] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T19:12:06.380307] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-28T19:12:06.892830] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T19:12:07.180252] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-28T19:12:07.980235] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-28T19:12:08.076223] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:12:08.081272] [INFO ] [REMOTE ] HEI: Full fetch complete (46697 records). [2025-10-28T19:12:08.081364] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-28T19:12:08.471589] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-28T19:12:08.471695] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-28T19:12:08.472422] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-28T19:12:08.472463] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-28T19:12:08.473483] [DEBUG] [LOCAL ] HEI: Trimmed 46697 records to 29971 (keeping 200 days of data) [2025-10-28T19:12:08.653924] [DEBUG] [LOCAL ] HEI: Primary data saved (29971 records). [2025-10-28T19:12:08.654046] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-28T19:12:08.654121] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HEI took 30.6s. Estimated remaining: 2h 58m 35s. Rate: 7.6 symbols/min [2025-10-28T19:12:08.785420] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-28T19:12:08.837319] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:08.837510] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-28T19:12:08.837562] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-28T19:12:08.837691] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-28T19:12:08.837748] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-28T19:12:08.837793] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-28T19:12:08.837833] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-28T19:12:09.122786] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:12:09.215700] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:09.289660] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:12:09.580225] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-28T19:12:09.826428] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-28T19:12:10.380293] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-28T19:12:10.669456] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:12:11.180354] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-28T19:12:11.652454] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:12:11.980250] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-28T19:12:12.180356] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-10-28T19:12:12.780250] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-28T19:12:13.175274] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:12:13.580302] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-28T19:12:13.851420] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T19:12:14.380309] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-28T19:12:14.619698] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T19:12:15.180278] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-28T19:12:15.980322] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-28T19:12:16.181249] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-28T19:12:16.392222] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:12:16.780312] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-28T19:12:17.243343] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T19:12:17.580249] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-28T19:12:17.814329] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T19:12:18.380251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-28T19:12:18.584805] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-28T19:12:19.180274] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-28T19:12:19.980338] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-28T19:12:20.191954] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-28T19:12:20.275908] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:12:20.780251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-28T19:12:20.951996] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.17 seconds). [2025-10-28T19:12:21.580255] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-28T19:12:21.792435] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-28T19:12:22.380249] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-28T19:12:22.557824] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-28T19:12:23.180264] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-28T19:12:23.394428] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-28T19:12:23.980252] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-28T19:12:24.780248] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-28T19:12:25.059241] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T19:12:25.247331] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:12:25.580259] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-28T19:12:26.195876] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T19:12:26.198259] [INFO ] [REMOTE ] HEQ: Full fetch complete (9684 records). [2025-10-28T19:12:26.198330] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-28T19:12:26.385686] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-28T19:12:26.553207] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-28T19:12:26.553284] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-28T19:12:26.553535] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-28T19:12:26.553635] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-28T19:12:26.554133] [DEBUG] [LOCAL ] HEQ: Trimmed 9684 records to 6561 (keeping 200 days of data) [2025-10-28T19:12:26.591419] [DEBUG] [LOCAL ] HEQ: Primary data saved (6561 records). [2025-10-28T19:12:26.591499] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-28T19:12:26.591580] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HEQ took 32.0s. Estimated remaining: 2h 58m 40s. Rate: 7.6 symbols/min [2025-10-28T19:12:26.706444] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T19:12:26.782635] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:26.798770] [DEBUG] [LOCAL ] HFRO: Loaded 15780 existing records from primary storage. [2025-10-28T19:12:26.799003] [INFO ] [MAIN ] HFRO: Loaded 15780 existing records. [2025-10-28T19:12:26.988863] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:26.989096] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-28T19:12:26.989160] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-28T19:12:26.989359] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-28T19:12:26.989404] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-28T19:12:27.187318] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-28T19:12:27.344243] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:27.565201] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T19:12:27.565840] [INFO ] [REMOTE ] HF: Full fetch complete (420 records). [2025-10-28T19:12:27.565908] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-28T19:12:27.758022] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-10-28T19:12:27.758166] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:12:27.758261] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:12:27.758345] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-28T19:12:27.758424] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-28T19:12:27.758475] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-28T19:12:27.758771] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-28T19:12:27.758853] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HF took 22.4s. Estimated remaining: 2h 58m 23s. Rate: 7.6 symbols/min [2025-10-28T19:12:27.980254] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-28T19:12:27.980126] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:28.000779] [DEBUG] [LOCAL ] HGER: Loaded 15806 existing records from primary storage. [2025-10-28T19:12:28.001061] [INFO ] [MAIN ] HGER: Loaded 15806 existing records. [2025-10-28T19:12:28.256505] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:28.256789] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-28T19:12:28.256848] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-28T19:12:28.257045] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-28T19:12:28.257121] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-28T19:12:28.342538] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:12:28.773304] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:28.780257] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-28T19:12:29.225331] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:12:29.580305] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-28T19:12:29.897862] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T19:12:30.380255] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-28T19:12:30.762524] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T19:12:31.180250] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-28T19:12:31.660964] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:12:31.980250] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-28T19:12:32.507555] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T19:12:32.780252] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-28T19:12:33.319607] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T19:12:33.580310] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-28T19:12:33.993769] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T19:12:33.994633] [INFO ] [REMOTE ] HFND: Full fetch complete (1786 records). [2025-10-28T19:12:33.994730] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-28T19:12:34.178717] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T19:12:34.178900] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:12:34.178969] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:12:34.179041] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-28T19:12:34.179105] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-28T19:12:34.179142] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-28T19:12:34.179182] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-28T19:12:34.179237] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HFND took 25.5s. Estimated remaining: 2h 58m 14s. Rate: 7.6 symbols/min [2025-10-28T19:12:34.370937] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:34.381745] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-28T19:12:34.382191] [DEBUG] [LOCAL ] HGLB: Loaded 9325 existing records from primary storage. [2025-10-28T19:12:34.382399] [INFO ] [MAIN ] HGLB: Loaded 9325 existing records. [2025-10-28T19:12:34.562468] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:34.562686] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-28T19:12:34.562745] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-28T19:12:34.562944] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-28T19:12:34.563003] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-28T19:12:34.911169] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:35.180224] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-28T19:12:35.292803] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:12:35.717095] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T19:12:35.980297] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-28T19:12:36.647275] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:12:36.780310] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-28T19:12:37.235249] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:12:37.580266] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-28T19:12:38.180578] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T19:12:38.380268] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-28T19:12:38.921230] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:12:39.180253] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-28T19:12:39.749016] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T19:12:39.980234] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-28T19:12:40.429733] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:12:40.780246] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-28T19:12:41.574198] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:12:41.580245] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-28T19:12:42.380253] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-28T19:12:42.950724] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T19:12:43.143005] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:12:43.180211] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-28T19:12:43.853760] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T19:12:43.980253] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-28T19:12:44.542290] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T19:12:44.780271] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-28T19:12:45.346100] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T19:12:45.580270] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-28T19:12:46.043313] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T19:12:46.380295] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-28T19:12:46.864075] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T19:12:47.180242] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-28T19:12:47.761461] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T19:12:47.980250] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-28T19:12:48.608212] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:12:48.610924] [INFO ] [REMOTE ] HGLB: Full fetch complete (14400 records). [2025-10-28T19:12:48.611020] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-28T19:12:48.783326] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-28T19:12:48.978627] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-28T19:12:48.978728] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-28T19:12:48.979062] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-28T19:12:48.979100] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-28T19:12:48.979563] [DEBUG] [LOCAL ] HGLB: Trimmed 14400 records to 9253 (keeping 200 days of data) [2025-10-28T19:12:49.032507] [DEBUG] [LOCAL ] HGLB: Primary data saved (9253 records). [2025-10-28T19:12:49.032626] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-28T19:12:49.032735] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HGLB took 14.9s. Estimated remaining: 2h 58m 15s. Rate: 7.6 symbols/min [2025-10-28T19:12:49.195446] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:49.209887] [DEBUG] [LOCAL ] HGTY: Loaded 13404 existing records from primary storage. [2025-10-28T19:12:49.210096] [INFO ] [MAIN ] HGTY: Loaded 13404 existing records. [2025-10-28T19:12:49.382852] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:49.383073] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-28T19:12:49.383138] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-28T19:12:49.383316] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-28T19:12:49.383372] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-28T19:12:49.589439] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-28T19:12:49.739114] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:50.114463] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:12:50.281348] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:12:50.380221] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-28T19:12:50.818947] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T19:12:51.180256] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-28T19:12:51.980277] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-28T19:12:52.386027] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:12:52.628486] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T19:12:52.780288] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-28T19:12:53.198869] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:12:53.580255] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-28T19:12:54.237167] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:12:54.380290] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-28T19:12:55.066677] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T19:12:55.180259] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-28T19:12:55.881133] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T19:12:55.980266] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-28T19:12:56.780271] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-28T19:12:57.328349] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:12:57.338638] [INFO ] [REMOTE ] HESM: Full fetch complete (70062 records). [2025-10-28T19:12:57.338785] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-28T19:12:57.492117] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T19:12:57.585372] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-28T19:12:57.753525] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-28T19:12:57.753607] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-28T19:12:57.754633] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-28T19:12:57.754727] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-28T19:12:57.756102] [DEBUG] [LOCAL ] HESM: Trimmed 70062 records to 48536 (keeping 200 days of data) [2025-10-28T19:12:58.042607] [DEBUG] [LOCAL ] HESM: Primary data saved (48536 records). [2025-10-28T19:12:58.042758] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-28T19:12:58.042856] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HESM took 59.9s. Estimated remaining: 2h 58m 9s. Rate: 7.6 symbols/min [2025-10-28T19:12:58.212361] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:58.221243] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T19:12:58.260760] [DEBUG] [LOCAL ] HGV: Loaded 45936 existing records from primary storage. [2025-10-28T19:12:58.261098] [INFO ] [MAIN ] HGV: Loaded 45936 existing records. [2025-10-28T19:12:58.385398] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-28T19:12:58.435474] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:58.435676] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-28T19:12:58.435732] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-28T19:12:58.436051] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-28T19:12:58.436108] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-28T19:12:58.784732] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:58.950527] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T19:12:59.180256] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-28T19:12:59.628721] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:12:59.980255] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-28T19:13:00.557920] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T19:13:00.780259] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-28T19:13:01.552551] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:13:01.580210] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-28T19:13:02.324794] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T19:13:02.380265] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-28T19:13:03.180279] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-28T19:13:03.541818] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:13:03.814370] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:13:03.817503] [INFO ] [REMOTE ] HFRO: Full fetch complete (26142 records). [2025-10-28T19:13:03.817629] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-28T19:13:03.991163] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-28T19:13:04.194268] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-28T19:13:04.194343] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-28T19:13:04.194955] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-28T19:13:04.195018] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-28T19:13:04.195625] [DEBUG] [LOCAL ] HFRO: Trimmed 26142 records to 15711 (keeping 200 days of data) [2025-10-28T19:13:04.286575] [DEBUG] [LOCAL ] HFRO: Primary data saved (15711 records). [2025-10-28T19:13:04.286731] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-28T19:13:04.286817] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HFRO took 37.7s. Estimated remaining: 2h 57m 59s. Rate: 7.6 symbols/min [2025-10-28T19:13:04.475629] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:04.508184] [DEBUG] [LOCAL ] HHH: Loaded 32806 existing records from primary storage. [2025-10-28T19:13:04.508447] [INFO ] [MAIN ] HHH: Loaded 32806 existing records. [2025-10-28T19:13:04.708767] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:04.709109] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-28T19:13:04.709169] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-28T19:13:04.709367] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-28T19:13:04.709424] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-28T19:13:04.785385] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-28T19:13:04.900247] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T19:13:05.139569] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:05.580253] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-28T19:13:05.908941] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T19:13:06.365017] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T19:13:06.368075] [INFO ] [REMOTE ] HGTY: Full fetch complete (17628 records). [2025-10-28T19:13:06.368150] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-28T19:13:06.388393] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-28T19:13:06.750155] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-28T19:13:06.750232] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-28T19:13:06.750609] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-28T19:13:06.750676] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-28T19:13:06.751210] [DEBUG] [LOCAL ] HGTY: Trimmed 17628 records to 13398 (keeping 200 days of data) [2025-10-28T19:13:06.826030] [DEBUG] [LOCAL ] HGTY: Primary data saved (13398 records). [2025-10-28T19:13:06.826155] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-28T19:13:06.826230] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HGTY took 17.8s. Estimated remaining: 2h 57m 43s. Rate: 7.6 symbols/min [2025-10-28T19:13:06.997609] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:07.032762] [DEBUG] [LOCAL ] HI: Loaded 36099 existing records from primary storage. [2025-10-28T19:13:07.033042] [INFO ] [MAIN ] HI: Loaded 36099 existing records. [2025-10-28T19:13:07.188556] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-28T19:13:07.221025] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:07.221823] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-28T19:13:07.221874] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-28T19:13:07.222075] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-28T19:13:07.222118] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-28T19:13:07.523949] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T19:13:07.546393] [INFO ] [REMOTE ] HGER: Full fetch complete (19546 records). [2025-10-28T19:13:07.556834] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-28T19:13:07.696485] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:07.982022] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-28T19:13:07.981773] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-28T19:13:07.982205] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-28T19:13:07.982711] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-28T19:13:07.982976] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-28T19:13:07.984458] [DEBUG] [LOCAL ] HGER: Trimmed 19546 records to 15888 (keeping 200 days of data) [2025-10-28T19:13:08.078518] [DEBUG] [LOCAL ] HGER: Primary data saved (15888 records). [2025-10-28T19:13:08.078673] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-28T19:13:08.078770] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HGER took 40.3s. Estimated remaining: 2h 57m 27s. Rate: 7.6 symbols/min [2025-10-28T19:13:08.248277] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:08.265226] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:13:08.316949] [DEBUG] [LOCAL ] HIG: Loaded 51028 existing records from primary storage. [2025-10-28T19:13:08.317246] [INFO ] [MAIN ] HIG: Loaded 51028 existing records. [2025-10-28T19:13:08.488444] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:08.488631] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-28T19:13:08.488713] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-28T19:13:08.488967] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-28T19:13:08.489008] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-28T19:13:08.785360] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-28T19:13:08.839159] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:09.118885] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T19:13:09.580316] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-28T19:13:10.129674] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:13:10.380303] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-28T19:13:10.801097] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:13:11.180294] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-28T19:13:11.406531] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T19:13:11.980268] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-28T19:13:12.532191] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T19:13:12.780263] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-28T19:13:13.375533] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:13:13.580262] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-28T19:13:13.715437] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:13:14.380264] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-28T19:13:14.696030] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T19:13:15.180323] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-28T19:13:15.945798] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T19:13:15.980322] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-28T19:13:16.502188] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:13:16.780303] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-28T19:13:17.113876] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T19:13:17.580238] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-28T19:13:17.634576] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:13:18.380249] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-28T19:13:18.961186] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T19:13:19.180220] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-28T19:13:19.202899] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:13:19.980247] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-28T19:13:20.660703] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T19:13:20.780296] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-28T19:13:21.059889] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T19:13:21.580271] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-28T19:13:22.225099] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:13:22.380216] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-28T19:13:22.403582] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:13:23.180354] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-28T19:13:23.708449] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:13:23.980301] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-28T19:13:24.222280] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T19:13:24.780306] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-28T19:13:25.257574] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:13:25.580245] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-28T19:13:25.726623] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T19:13:26.380246] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-28T19:13:26.875269] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T19:13:27.180248] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-28T19:13:27.712887] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:13:27.980310] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-28T19:13:28.464341] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:13:28.780298] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-28T19:13:29.111232] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:13:29.580250] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-28T19:13:29.845993] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:13:30.380244] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-28T19:13:31.034972] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T19:13:31.180237] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-28T19:13:31.382987] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:13:31.980245] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-28T19:13:32.283792] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:13:32.780257] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-28T19:13:32.964484] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:13:33.580239] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-28T19:13:33.999051] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:13:34.007563] [INFO ] [REMOTE ] HGV: Full fetch complete (65872 records). [2025-10-28T19:13:34.007739] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-28T19:13:34.387944] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-28T19:13:34.391537] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-28T19:13:34.392443] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-28T19:13:34.393380] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-28T19:13:34.393551] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-28T19:13:34.394828] [DEBUG] [LOCAL ] HGV: Trimmed 65872 records to 45892 (keeping 200 days of data) [2025-10-28T19:13:34.656122] [DEBUG] [LOCAL ] HGV: Primary data saved (45892 records). [2025-10-28T19:13:34.656381] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-28T19:13:34.656607] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HGV took 36.6s. Estimated remaining: 2h 57m 44s. Rate: 7.6 symbols/min [2025-10-28T19:13:34.801165] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:13:34.859041] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:34.891613] [DEBUG] [LOCAL ] HII: Loaded 33058 existing records from primary storage. [2025-10-28T19:13:34.891907] [INFO ] [MAIN ] HII: Loaded 33058 existing records. [2025-10-28T19:13:35.070117] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:35.070344] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-28T19:13:35.070389] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-28T19:13:35.070565] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-28T19:13:35.070602] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-28T19:13:35.185484] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-28T19:13:35.434257] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:35.639330] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T19:13:35.648182] [INFO ] [REMOTE ] HI: Full fetch complete (51730 records). [2025-10-28T19:13:35.648275] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-28T19:13:35.985317] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-28T19:13:36.029912] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-28T19:13:36.029995] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-28T19:13:36.030938] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-28T19:13:36.031005] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-28T19:13:36.032381] [DEBUG] [LOCAL ] HI: Trimmed 51730 records to 36061 (keeping 200 days of data) [2025-10-28T19:13:36.243385] [DEBUG] [LOCAL ] HI: Primary data saved (36061 records). [2025-10-28T19:13:36.243515] [INFO ] [MAIN ] HI: Full history saved. [2025-10-28T19:13:36.243592] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HI took 29.4s. Estimated remaining: 2h 57m 28s. Rate: 7.6 symbols/min [2025-10-28T19:13:36.412635] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:36.459713] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-28T19:13:36.460083] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-28T19:13:36.648913] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:36.649285] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-28T19:13:36.649398] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-28T19:13:36.650381] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-28T19:13:36.650441] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-28T19:13:36.783803] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-28T19:13:36.969514] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T19:13:37.030445] [INFO ] [REMOTE ] HIG: Full fetch complete (73705 records). [2025-10-28T19:13:37.051006] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-28T19:13:37.070967] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:37.324203] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T19:13:37.543840] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-28T19:13:37.543958] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-28T19:13:37.545249] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-28T19:13:37.545324] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-28T19:13:37.547479] [DEBUG] [LOCAL ] HIG: Trimmed 73705 records to 51022 (keeping 200 days of data) [2025-10-28T19:13:37.605242] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-28T19:13:37.903709] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T19:13:37.934590] [DEBUG] [LOCAL ] HIG: Primary data saved (51022 records). [2025-10-28T19:13:37.934990] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-28T19:13:37.936494] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HIG took 29.9s. Estimated remaining: 2h 57m 11s. Rate: 7.6 symbols/min [2025-10-28T19:13:38.117514] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:38.145757] [DEBUG] [LOCAL ] HIO: Loaded 23581 existing records from primary storage. [2025-10-28T19:13:38.146137] [INFO ] [MAIN ] HIO: Loaded 23581 existing records. [2025-10-28T19:13:38.331921] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:38.332223] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-28T19:13:38.332272] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-28T19:13:38.332538] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-28T19:13:38.332580] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-28T19:13:38.390449] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-28T19:13:38.724421] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:38.800465] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:13:39.180292] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-28T19:13:39.408799] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T19:13:39.414485] [INFO ] [REMOTE ] HHH: Full fetch complete (46183 records). [2025-10-28T19:13:39.414569] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-28T19:13:39.786120] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-28T19:13:39.786204] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-28T19:13:39.786977] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-28T19:13:39.787041] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-28T19:13:39.787990] [DEBUG] [LOCAL ] HHH: Trimmed 46183 records to 32707 (keeping 200 days of data) [2025-10-28T19:13:39.977032] [DEBUG] [LOCAL ] HHH: Primary data saved (32707 records). [2025-10-28T19:13:39.977149] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-28T19:13:39.977224] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HHH took 35.7s. Estimated remaining: 2h 56m 56s. Rate: 7.6 symbols/min [2025-10-28T19:13:39.988345] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-28T19:13:40.151805] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:40.168419] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T19:13:40.192455] [DEBUG] [LOCAL ] HIPO: Loaded 21121 existing records from primary storage. [2025-10-28T19:13:40.192704] [INFO ] [MAIN ] HIPO: Loaded 21121 existing records. [2025-10-28T19:13:40.375144] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:40.375341] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-28T19:13:40.375388] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-28T19:13:40.375543] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-28T19:13:40.375580] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-28T19:13:40.719871] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:40.780237] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-28T19:13:41.313030] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:13:41.452344] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:13:41.580218] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-28T19:13:42.260783] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T19:13:42.380271] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-28T19:13:43.115130] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:13:43.180234] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-28T19:13:43.926740] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T19:13:43.980222] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-28T19:13:44.785169] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-28T19:13:44.788863] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T19:13:45.580254] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-28T19:13:46.380227] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-28T19:13:46.562181] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T19:13:46.818196] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-28T19:13:47.180247] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-28T19:13:47.696061] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:13:47.980246] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-28T19:13:48.029696] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:13:48.780272] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-28T19:13:49.580277] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-28T19:13:49.696812] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T19:13:49.832678] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T19:13:50.240871] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T19:13:50.380222] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-28T19:13:51.180295] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-28T19:13:51.200270] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T19:13:51.899939] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:13:51.980234] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-28T19:13:52.718492] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T19:13:52.780212] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-28T19:13:53.572115] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T19:13:53.580219] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-28T19:13:54.380264] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-28T19:13:54.574498] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:13:55.180291] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-28T19:13:55.333754] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:13:55.980229] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-28T19:13:56.033070] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:13:56.780222] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-28T19:13:56.962628] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T19:13:56.969439] [INFO ] [REMOTE ] HIO: Full fetch complete (38262 records). [2025-10-28T19:13:56.969532] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-28T19:13:57.345498] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-28T19:13:57.345581] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-28T19:13:57.346370] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-28T19:13:57.346438] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-28T19:13:57.347303] [DEBUG] [LOCAL ] HIO: Trimmed 38262 records to 23411 (keeping 200 days of data) [2025-10-28T19:13:57.479638] [DEBUG] [LOCAL ] HIO: Primary data saved (23411 records). [2025-10-28T19:13:57.479783] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-28T19:13:57.479860] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HIO took 19.5s. Estimated remaining: 2h 57m 1s. Rate: 7.6 symbols/min [2025-10-28T19:13:57.583350] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-28T19:13:57.657502] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:57.695208] [DEBUG] [LOCAL ] HIW: Loaded 44271 existing records from primary storage. [2025-10-28T19:13:57.695488] [INFO ] [MAIN ] HIW: Loaded 44271 existing records. [2025-10-28T19:13:57.893334] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:57.893745] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-28T19:13:57.893846] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-28T19:13:57.901185] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-28T19:13:57.912162] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-28T19:13:57.918788] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T19:13:58.298203] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:58.380225] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-28T19:13:59.180233] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-28T19:13:59.279201] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T19:13:59.799214] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-28T19:13:59.980258] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-28T19:14:00.495994] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:14:00.780263] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-28T19:14:01.028748] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:14:01.580253] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-28T19:14:02.181711] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:14:02.380259] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-28T19:14:03.180256] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-28T19:14:03.676368] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:14:03.861213] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-28T19:14:03.980250] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-28T19:14:04.420615] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:14:04.427807] [INFO ] [REMOTE ] HII: Full fetch complete (52184 records). [2025-10-28T19:14:04.427977] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-28T19:14:04.783440] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-28T19:14:04.826278] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-28T19:14:04.826454] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-28T19:14:04.827411] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-28T19:14:04.827477] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-28T19:14:04.828790] [DEBUG] [LOCAL ] HII: Trimmed 52184 records to 32873 (keeping 200 days of data) [2025-10-28T19:14:05.031584] [DEBUG] [LOCAL ] HII: Primary data saved (32873 records). [2025-10-28T19:14:05.031737] [INFO ] [MAIN ] HII: Full history saved. [2025-10-28T19:14:05.032851] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HII took 30.4s. Estimated remaining: 2h 56m 52s. Rate: 7.6 symbols/min [2025-10-28T19:14:05.197351] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:05.216111] [DEBUG] [LOCAL ] HIX: Loaded 20160 existing records from primary storage. [2025-10-28T19:14:05.216365] [INFO ] [MAIN ] HIX: Loaded 20160 existing records. [2025-10-28T19:14:05.393756] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:05.393989] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-28T19:14:05.394036] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-28T19:14:05.394502] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-28T19:14:05.394559] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-28T19:14:05.589815] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-28T19:14:05.772514] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:05.768926] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T19:14:06.278134] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-28T19:14:06.380239] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-28T19:14:06.878793] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T19:14:07.180250] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-28T19:14:07.980269] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-28T19:14:08.050549] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:14:08.609314] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-28T19:14:08.780237] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-28T19:14:09.223232] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T19:14:09.580276] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-28T19:14:10.380323] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-28T19:14:10.674080] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T19:14:11.005392] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T19:14:11.102787] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-28T19:14:11.180233] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-28T19:14:11.912316] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:14:11.980249] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-28T19:14:12.770472] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T19:14:12.780208] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-28T19:14:13.525167] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T19:14:13.580254] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-28T19:14:14.380316] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-28T19:14:14.708173] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:14:15.180316] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-28T19:14:15.980271] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-28T19:14:16.407203] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-28T19:14:16.445228] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:14:16.700729] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:14:16.780253] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-28T19:14:17.580307] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-28T19:14:18.305179] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T19:14:18.380279] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-28T19:14:18.920491] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-28T19:14:19.180303] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-28T19:14:19.567684] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:14:19.980290] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-28T19:14:20.646868] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T19:14:20.780217] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-28T19:14:21.536758] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-28T19:14:21.555889] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:14:21.562271] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-28T19:14:21.563097] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-28T19:14:21.586395] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-28T19:14:21.973827] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-28T19:14:21.973912] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-28T19:14:21.974923] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-28T19:14:21.974986] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-28T19:14:21.976514] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-28T19:14:22.286880] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-28T19:14:22.287012] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-28T19:14:22.287096] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIMS took 46.0s. Estimated remaining: 2h 56m 57s. Rate: 7.6 symbols/min [2025-10-28T19:14:22.385388] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-28T19:14:22.470189] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:22.481637] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:14:22.485634] [INFO ] [REMOTE ] HIPO: Full fetch complete (30844 records). [2025-10-28T19:14:22.485815] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-28T19:14:22.618989] [DEBUG] [LOCAL ] HKD: Loaded 18741 existing records from primary storage. [2025-10-28T19:14:22.634786] [INFO ] [MAIN ] HKD: Loaded 18741 existing records. [2025-10-28T19:14:23.006552] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:23.012631] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-28T19:14:23.018013] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-28T19:14:23.046393] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-28T19:14:23.056346] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-28T19:14:23.151984] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-28T19:14:23.183492] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-28T19:14:23.189504] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-28T19:14:23.189848] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-28T19:14:23.190120] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-28T19:14:23.268805] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T19:14:23.276970] [DEBUG] [LOCAL ] HIPO: Trimmed 30844 records to 21001 (keeping 200 days of data) [2025-10-28T19:14:23.560732] [DEBUG] [LOCAL ] HIPO: Primary data saved (21001 records). [2025-10-28T19:14:23.571117] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-28T19:14:23.576374] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIPO took 43.6s. Estimated remaining: 2h 56m 40s. Rate: 7.6 symbols/min [2025-10-28T19:14:23.762879] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:23.834342] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:23.885108] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-28T19:14:23.885497] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-28T19:14:23.985359] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-28T19:14:24.105054] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:24.105244] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-28T19:14:24.105292] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-28T19:14:24.105513] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-28T19:14:24.105572] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-28T19:14:24.472055] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:24.499412] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T19:14:24.508821] [INFO ] [REMOTE ] HIW: Full fetch complete (64940 records). [2025-10-28T19:14:24.508932] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-28T19:14:24.780750] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-28T19:14:24.942116] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:14:24.964634] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-28T19:14:24.964754] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-28T19:14:24.965899] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-28T19:14:24.965961] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-28T19:14:24.967328] [DEBUG] [LOCAL ] HIW: Trimmed 64940 records to 44259 (keeping 200 days of data) [2025-10-28T19:14:25.249503] [DEBUG] [LOCAL ] HIW: Primary data saved (44259 records). [2025-10-28T19:14:25.249628] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-28T19:14:25.249742] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HIW took 27.8s. Estimated remaining: 2h 56m 24s. Rate: 7.6 symbols/min [2025-10-28T19:14:25.448887] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:25.492988] [DEBUG] [LOCAL ] HLF: Loaded 48241 existing records from primary storage. [2025-10-28T19:14:25.493283] [INFO ] [MAIN ] HLF: Loaded 48241 existing records. [2025-10-28T19:14:25.582451] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-28T19:14:25.658757] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T19:14:25.703314] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:25.703515] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-28T19:14:25.703561] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-28T19:14:25.703885] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-28T19:14:25.703942] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-28T19:14:26.053479] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:26.380490] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-28T19:14:27.088225] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T19:14:27.180261] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-28T19:14:27.615937] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:14:27.980292] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-28T19:14:28.615793] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:14:28.780252] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-28T19:14:29.175272] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:14:29.580318] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-28T19:14:30.085627] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:14:30.380223] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-28T19:14:30.416268] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T19:14:31.180282] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-28T19:14:31.266731] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:14:31.271072] [INFO ] [REMOTE ] HIX: Full fetch complete (30059 records). [2025-10-28T19:14:31.271157] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-28T19:14:31.680843] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-28T19:14:31.680917] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-28T19:14:31.681517] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-28T19:14:31.681576] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-28T19:14:31.682311] [DEBUG] [LOCAL ] HIX: Trimmed 30059 records to 20042 (keeping 200 days of data) [2025-10-28T19:14:31.796185] [DEBUG] [LOCAL ] HIX: Primary data saved (20042 records). [2025-10-28T19:14:31.796325] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-28T19:14:31.796608] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HIX took 26.8s. Estimated remaining: 2h 56m 15s. Rate: 7.6 symbols/min [2025-10-28T19:14:31.938793] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:14:31.985298] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:31.984482] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-28T19:14:32.016681] [DEBUG] [LOCAL ] HLI: Loaded 30327 existing records from primary storage. [2025-10-28T19:14:32.016927] [INFO ] [MAIN ] HLI: Loaded 30327 existing records. [2025-10-28T19:14:32.191368] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:32.191563] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-28T19:14:32.191611] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-28T19:14:32.191997] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-28T19:14:32.192055] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-28T19:14:32.539676] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:32.780262] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-28T19:14:33.247073] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:14:33.580286] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-28T19:14:34.316517] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T19:14:34.380265] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-28T19:14:34.907858] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:14:35.113285] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T19:14:35.180298] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-28T19:14:35.980243] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-28T19:14:36.532808] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:14:36.780253] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-28T19:14:37.020168] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T19:14:37.580304] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-28T19:14:38.168013] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T19:14:38.380278] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-28T19:14:39.104317] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T19:14:39.180222] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-28T19:14:39.647683] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T19:14:39.980309] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-28T19:14:40.780228] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-28T19:14:40.828079] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T19:14:41.101941] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:14:41.280590] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:14:41.580311] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-28T19:14:42.380250] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-28T19:14:43.141006] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T19:14:43.180215] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-28T19:14:43.255402] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:14:43.980250] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-28T19:14:44.780282] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-28T19:14:44.908803] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T19:14:44.937523] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:14:45.580252] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-28T19:14:45.833843] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:14:46.385325] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-28T19:14:46.393748] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T19:14:47.180247] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-28T19:14:47.711023] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:14:47.720345] [INFO ] [REMOTE ] HLF: Full fetch complete (70654 records). [2025-10-28T19:14:47.720463] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-28T19:14:47.911755] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T19:14:47.985364] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-28T19:14:48.125270] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-28T19:14:48.125344] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-28T19:14:48.126339] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-28T19:14:48.126408] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-28T19:14:48.127845] [DEBUG] [LOCAL ] HLF: Trimmed 70654 records to 48171 (keeping 200 days of data) [2025-10-28T19:14:48.389346] [DEBUG] [LOCAL ] HLF: Primary data saved (48171 records). [2025-10-28T19:14:48.389462] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-28T19:14:48.390208] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HLF took 23.1s. Estimated remaining: 2h 56m 18s. Rate: 7.6 symbols/min [2025-10-28T19:14:48.554525] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:48.584320] [DEBUG] [LOCAL ] HLIO: Loaded 27820 existing records from primary storage. [2025-10-28T19:14:48.584559] [INFO ] [MAIN ] HLIO: Loaded 27820 existing records. [2025-10-28T19:14:48.776714] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:48.776915] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-28T19:14:48.776959] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-28T19:14:48.777136] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-28T19:14:48.777173] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-28T19:14:48.788236] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-28T19:14:49.125793] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:49.580272] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-28T19:14:49.831534] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:14:49.970588] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-28T19:14:50.265947] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:14:50.380265] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-28T19:14:51.041848] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T19:14:51.180247] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-28T19:14:51.938119] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:14:51.980211] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-28T19:14:52.780220] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-28T19:14:52.831887] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:14:53.580219] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-28T19:14:53.765233] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T19:14:54.380247] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-28T19:14:54.454790] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T19:14:55.180315] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-28T19:14:55.312861] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:14:55.980226] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-28T19:14:56.030393] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:14:56.780224] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-28T19:14:56.851615] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T19:14:57.417969] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:14:57.580263] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-28T19:14:58.380263] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-28T19:14:59.180268] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-28T19:14:59.632043] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:14:59.678993] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T19:14:59.689806] [INFO ] [REMOTE ] HL: Full fetch complete (77827 records). [2025-10-28T19:14:59.689939] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-28T19:14:59.985449] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-28T19:15:00.091282] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-28T19:15:00.091415] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-28T19:15:00.092472] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-28T19:15:00.092586] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-28T19:15:00.094330] [DEBUG] [LOCAL ] HL: Trimmed 77827 records to 53676 (keeping 200 days of data) [2025-10-28T19:15:00.226195] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:15:00.428772] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-28T19:15:00.428893] [INFO ] [MAIN ] HL: Full history saved. [2025-10-28T19:15:00.428970] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HL took 36.8s. Estimated remaining: 2h 56m 16s. Rate: 7.6 symbols/min [2025-10-28T19:15:00.596302] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:00.626576] [DEBUG] [LOCAL ] HLLY: Loaded 33098 existing records from primary storage. [2025-10-28T19:15:00.626862] [INFO ] [MAIN ] HLLY: Loaded 33098 existing records. [2025-10-28T19:15:00.791376] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-28T19:15:00.804400] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:00.805310] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-28T19:15:00.805363] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-28T19:15:00.805715] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-28T19:15:00.805772] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-28T19:15:01.167666] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:15:01.203509] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:01.203729] [INFO ] [REMOTE ] HKD: Full fetch complete (27718 records). [2025-10-28T19:15:01.204260] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-28T19:15:01.570302] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-28T19:15:01.570386] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-28T19:15:01.570998] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-28T19:15:01.571059] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-28T19:15:01.571940] [DEBUG] [LOCAL ] HKD: Trimmed 27718 records to 18680 (keeping 200 days of data) [2025-10-28T19:15:01.613057] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-28T19:15:01.681252] [DEBUG] [LOCAL ] HKD: Primary data saved (18680 records). [2025-10-28T19:15:01.681388] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-28T19:15:01.681468] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HKD took 39.4s. Estimated remaining: 2h 55m 59s. Rate: 7.6 symbols/min [2025-10-28T19:15:01.859362] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:01.909850] [DEBUG] [LOCAL ] HLN: Loaded 53110 existing records from primary storage. [2025-10-28T19:15:01.910218] [INFO ] [MAIN ] HLN: Loaded 53110 existing records. [2025-10-28T19:15:02.119400] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:02.119750] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-28T19:15:02.119883] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-28T19:15:02.120157] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-28T19:15:02.120213] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-28T19:15:02.380878] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-28T19:15:02.555174] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:02.570825] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T19:15:02.607282] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T19:15:03.180221] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-28T19:15:03.287996] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:15:03.980259] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-28T19:15:04.337078] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:15:04.780241] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-28T19:15:04.834598] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T19:15:05.580241] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-28T19:15:06.083721] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T19:15:06.380208] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-28T19:15:06.586109] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T19:15:07.180271] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-28T19:15:07.792346] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T19:15:07.980263] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-28T19:15:08.243060] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:15:08.249760] [INFO ] [REMOTE ] HLI: Full fetch complete (45425 records). [2025-10-28T19:15:08.249894] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-28T19:15:08.704970] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-28T19:15:08.705096] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-28T19:15:08.706070] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-28T19:15:08.706147] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-28T19:15:08.707350] [DEBUG] [LOCAL ] HLI: Trimmed 45425 records to 30307 (keeping 200 days of data) [2025-10-28T19:15:08.803357] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-28T19:15:08.905290] [DEBUG] [LOCAL ] HLI: Primary data saved (30307 records). [2025-10-28T19:15:08.905412] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-28T19:15:08.905484] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLI took 37.1s. Estimated remaining: 2h 55m 50s. Rate: 7.6 symbols/min [2025-10-28T19:15:09.082709] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:09.128724] [DEBUG] [LOCAL ] HLT: Loaded 50413 existing records from primary storage. [2025-10-28T19:15:09.129070] [INFO ] [MAIN ] HLT: Loaded 50413 existing records. [2025-10-28T19:15:09.324169] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:09.324432] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-28T19:15:09.324550] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-28T19:15:09.325373] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-28T19:15:09.325478] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-28T19:15:09.548220] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T19:15:09.587987] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-28T19:15:09.769373] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T19:15:09.768730] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:10.380221] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-28T19:15:10.547466] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T19:15:11.180252] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-28T19:15:11.671212] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:15:11.980321] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-28T19:15:12.533707] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:15:12.780265] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-28T19:15:12.928243] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T19:15:12.933758] [INFO ] [REMOTE ] HLIO: Full fetch complete (37276 records). [2025-10-28T19:15:12.933877] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-28T19:15:13.300143] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-28T19:15:13.300218] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-28T19:15:13.300905] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-28T19:15:13.300965] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-28T19:15:13.301873] [DEBUG] [LOCAL ] HLIO: Trimmed 37276 records to 27808 (keeping 200 days of data) [2025-10-28T19:15:13.469382] [DEBUG] [LOCAL ] HLIO: Primary data saved (27808 records). [2025-10-28T19:15:13.469549] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-28T19:15:13.469665] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLIO took 25.1s. Estimated remaining: 2h 55m 38s. Rate: 7.6 symbols/min [2025-10-28T19:15:13.585343] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-28T19:15:13.638414] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:13.680398] [DEBUG] [LOCAL ] HLX: Loaded 47244 existing records from primary storage. [2025-10-28T19:15:13.680776] [INFO ] [MAIN ] HLX: Loaded 47244 existing records. [2025-10-28T19:15:13.855884] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:13.856208] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-28T19:15:13.856370] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-28T19:15:13.856935] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-28T19:15:13.857011] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-28T19:15:14.221522] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T19:15:14.254232] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:14.380257] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-28T19:15:14.657041] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:15:15.180256] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-28T19:15:15.686521] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:15:15.980256] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-28T19:15:16.688495] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T19:15:16.780248] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-28T19:15:17.152053] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:15:17.580267] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-28T19:15:18.323152] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T19:15:18.389075] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-28T19:15:18.394574] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T19:15:19.180294] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-28T19:15:19.710888] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:15:19.980253] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-28T19:15:20.533764] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T19:15:20.780249] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-28T19:15:21.496799] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T19:15:21.580266] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-28T19:15:22.098522] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:15:22.380252] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-28T19:15:23.130425] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T19:15:23.180297] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-28T19:15:23.647429] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T19:15:23.980271] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-28T19:15:24.532731] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:15:24.780295] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-28T19:15:25.024400] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T19:15:25.510836] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T19:15:25.580267] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-28T19:15:26.380332] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-28T19:15:26.752244] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:15:27.159274] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:15:27.180230] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-28T19:15:27.980266] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-28T19:15:28.521490] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T19:15:28.780263] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-28T19:15:28.955470] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T19:15:29.580263] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-28T19:15:30.108394] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:15:30.380244] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-28T19:15:30.944921] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T19:15:31.180269] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-28T19:15:31.650427] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:15:31.980230] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-28T19:15:32.167756] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T19:15:32.780363] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-28T19:15:33.396237] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:15:33.406899] [INFO ] [REMOTE ] HLN: Full fetch complete (77021 records). [2025-10-28T19:15:33.407031] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-28T19:15:33.580832] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-28T19:15:33.804750] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-28T19:15:33.804843] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-28T19:15:33.806043] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-28T19:15:33.806117] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-28T19:15:33.807695] [DEBUG] [LOCAL ] HLN: Trimmed 77021 records to 53097 (keeping 200 days of data) [2025-10-28T19:15:34.135878] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T19:15:34.164934] [DEBUG] [LOCAL ] HLN: Primary data saved (53097 records). [2025-10-28T19:15:34.165055] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-28T19:15:34.165145] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLN took 32.5s. Estimated remaining: 2h 55m 47s. Rate: 7.6 symbols/min [2025-10-28T19:15:34.334922] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:34.374966] [DEBUG] [LOCAL ] HMC: Loaded 46041 existing records from primary storage. [2025-10-28T19:15:34.375273] [INFO ] [MAIN ] HMC: Loaded 46041 existing records. [2025-10-28T19:15:34.386220] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-28T19:15:34.554312] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:34.554530] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-28T19:15:34.554603] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-28T19:15:34.554994] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-28T19:15:34.555051] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-28T19:15:34.921419] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:34.970096] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:15:35.180310] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-28T19:15:35.759356] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:15:35.980239] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-28T19:15:36.176641] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T19:15:36.183323] [INFO ] [REMOTE ] HLLY: Full fetch complete (46052 records). [2025-10-28T19:15:36.183425] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-28T19:15:36.575093] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-28T19:15:36.575180] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-28T19:15:36.575952] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-28T19:15:36.576014] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-28T19:15:36.577100] [DEBUG] [LOCAL ] HLLY: Trimmed 46052 records to 33119 (keeping 200 days of data) [2025-10-28T19:15:36.755822] [DEBUG] [LOCAL ] HLLY: Primary data saved (33119 records). [2025-10-28T19:15:36.755946] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-28T19:15:36.756065] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLLY took 36.3s. Estimated remaining: 2h 55m 32s. Rate: 7.6 symbols/min [2025-10-28T19:15:36.789175] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-28T19:15:36.938754] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:36.960896] [DEBUG] [LOCAL ] HMN: Loaded 22910 existing records from primary storage. [2025-10-28T19:15:36.961154] [INFO ] [MAIN ] HMN: Loaded 22910 existing records. [2025-10-28T19:15:37.144797] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:37.144987] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-28T19:15:37.145034] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-28T19:15:37.145349] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-28T19:15:37.145406] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-28T19:15:37.539422] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:37.568126] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:15:37.578689] [INFO ] [REMOTE ] HLT: Full fetch complete (73643 records). [2025-10-28T19:15:37.578837] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-28T19:15:37.591262] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-28T19:15:37.982102] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-28T19:15:37.982181] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-28T19:15:37.983195] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-28T19:15:37.983255] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-28T19:15:37.984638] [DEBUG] [LOCAL ] HLT: Trimmed 73643 records to 50372 (keeping 200 days of data) [2025-10-28T19:15:38.327044] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:15:38.330676] [DEBUG] [LOCAL ] HLT: Primary data saved (50372 records). [2025-10-28T19:15:38.339967] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-28T19:15:38.340995] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HLT took 29.4s. Estimated remaining: 2h 55m 16s. Rate: 7.6 symbols/min [2025-10-28T19:15:38.352619] [INFO ] [REMOTE ] HLX: Full fetch complete (69004 records). [2025-10-28T19:15:38.384877] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-28T19:15:38.384633] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-28T19:15:38.650529] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:38.975940] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-28T19:15:38.976381] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-28T19:15:38.996727] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-28T19:15:38.998408] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-28T19:15:38.998806] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-28T19:15:38.999161] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-28T19:15:39.075843] [DEBUG] [LOCAL ] HLX: Trimmed 69004 records to 47235 (keeping 200 days of data) [2025-10-28T19:15:39.425732] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:39.506503] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-28T19:15:39.512231] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-28T19:15:39.556680] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-28T19:15:39.545499] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T19:15:39.559837] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-28T19:15:39.581067] [DEBUG] [LOCAL ] HLX: Primary data saved (47235 records). [2025-10-28T19:15:39.581681] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-28T19:15:39.559753] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:15:39.602505] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-28T19:15:39.636447] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HLX took 26.2s. Estimated remaining: 2h 54m 60s. Rate: 7.6 symbols/min [2025-10-28T19:15:39.947254] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:39.981099] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-28T19:15:40.013020] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-28T19:15:40.019794] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-28T19:15:40.043400] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-28T19:15:40.055190] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-28T19:15:40.055328] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-28T19:15:40.055379] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-28T19:15:40.246217] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:40.529348] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:40.775906] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:15:40.780156] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-28T19:15:41.110216] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T19:15:41.553022] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T19:15:41.580212] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-28T19:15:42.342078] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:15:42.380208] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-28T19:15:43.180229] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-28T19:15:43.255928] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T19:15:43.319958] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:15:43.320229] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-28T19:15:43.320316] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:15:43.320362] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-28T19:15:43.320395] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:15:43.320429] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-28T19:15:43.320490] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-28T19:15:43.320528] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-28T19:15:43.320567] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-28T19:15:43.320610] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HNGE took 3.7s. Estimated remaining: 2h 54m 46s. Rate: 7.6 symbols/min [2025-10-28T19:15:43.490285] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:43.521618] [DEBUG] [LOCAL ] HNI: Loaded 29700 existing records from primary storage. [2025-10-28T19:15:43.521920] [INFO ] [MAIN ] HNI: Loaded 29700 existing records. [2025-10-28T19:15:43.700273] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:43.700494] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-28T19:15:43.700593] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-28T19:15:43.701017] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-28T19:15:43.701105] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-28T19:15:43.985418] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-28T19:15:44.057134] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:44.780309] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-28T19:15:44.807802] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:15:45.580244] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-28T19:15:46.092571] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:15:46.380233] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-28T19:15:46.980329] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T19:15:47.180253] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-28T19:15:47.747610] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:15:47.944732] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T19:15:47.980234] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-28T19:15:48.780268] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-28T19:15:49.163675] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:15:49.521542] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T19:15:49.580289] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-28T19:15:50.380282] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-28T19:15:50.461289] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:15:51.131413] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T19:15:51.180256] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-28T19:15:51.980266] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-28T19:15:52.780215] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-28T19:15:52.816388] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T19:15:52.844762] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T19:15:53.488344] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T19:15:53.580400] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-28T19:15:54.269818] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:15:54.380247] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-28T19:15:55.135912] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T19:15:55.180249] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-28T19:15:55.876429] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:15:55.980257] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-28T19:15:56.742568] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T19:15:56.780211] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-28T19:15:57.580230] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-28T19:15:58.071700] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T19:15:58.380248] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-28T19:15:59.049820] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T19:15:59.180261] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-28T19:15:59.279203] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:15:59.283241] [INFO ] [REMOTE ] HMN: Full fetch complete (31724 records). [2025-10-28T19:15:59.283335] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-28T19:15:59.669327] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-28T19:15:59.669409] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-28T19:15:59.670126] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-28T19:15:59.670188] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-28T19:15:59.671082] [DEBUG] [LOCAL ] HMN: Trimmed 31724 records to 22876 (keeping 200 days of data) [2025-10-28T19:15:59.811139] [DEBUG] [LOCAL ] HMN: Primary data saved (22876 records). [2025-10-28T19:15:59.811264] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-28T19:15:59.811371] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HMN took 23.1s. Estimated remaining: 2h 54m 50s. Rate: 7.6 symbols/min [2025-10-28T19:15:59.981456] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:59.981696] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-28T19:16:00.030722] [DEBUG] [LOCAL ] HOG: Loaded 50529 existing records from primary storage. [2025-10-28T19:16:00.031059] [INFO ] [MAIN ] HOG: Loaded 50529 existing records. [2025-10-28T19:16:00.221151] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:00.221425] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-28T19:16:00.221502] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-28T19:16:00.222056] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-28T19:16:00.222145] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-28T19:16:00.403258] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T19:16:00.626127] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:00.780246] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-28T19:16:01.580219] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-28T19:16:01.837314] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-28T19:16:02.041602] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T19:16:02.380226] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-28T19:16:02.711611] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:16:02.718719] [INFO ] [REMOTE ] HNI: Full fetch complete (42342 records). [2025-10-28T19:16:02.718882] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-28T19:16:03.131189] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-28T19:16:03.131316] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-28T19:16:03.132510] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-28T19:16:03.132597] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-28T19:16:03.134057] [DEBUG] [LOCAL ] HNI: Trimmed 42342 records to 29761 (keeping 200 days of data) [2025-10-28T19:16:03.213413] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-28T19:16:03.432330] [DEBUG] [LOCAL ] HNI: Primary data saved (29761 records). [2025-10-28T19:16:03.432519] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-28T19:16:03.432670] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HNI took 20.1s. Estimated remaining: 2h 54m 36s. Rate: 7.6 symbols/min [2025-10-28T19:16:03.675232] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:03.721141] [DEBUG] [LOCAL ] HOMB: Loaded 43589 existing records from primary storage. [2025-10-28T19:16:03.721556] [INFO ] [MAIN ] HOMB: Loaded 43589 existing records. [2025-10-28T19:16:03.955166] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:03.955544] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-28T19:16:03.955737] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-28T19:16:03.956011] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-28T19:16:03.956090] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-28T19:16:03.984040] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-28T19:16:04.192959] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T19:16:04.398818] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:04.424739] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T19:16:04.780267] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-28T19:16:05.360470] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T19:16:05.580298] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-28T19:16:05.937093] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:16:06.380243] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-28T19:16:06.841110] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:16:07.180199] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-28T19:16:07.936888] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T19:16:07.980206] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-28T19:16:08.201148] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:16:08.780272] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-28T19:16:09.560980] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T19:16:09.580215] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-28T19:16:10.002527] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T19:16:10.380282] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-28T19:16:11.118562] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:16:11.180236] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-28T19:16:11.315598] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:16:11.980254] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-28T19:16:12.780244] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-28T19:16:12.883726] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-28T19:16:13.254481] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T19:16:13.580258] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-28T19:16:14.153558] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:16:14.380307] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-28T19:16:14.806021] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T19:16:15.180225] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-28T19:16:15.365997] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T19:16:15.980256] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-28T19:16:16.458315] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:16:16.780257] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-28T19:16:17.580252] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-28T19:16:17.747917] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T19:16:17.778839] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:16:17.787227] [INFO ] [REMOTE ] HMY: Full fetch complete (77158 records). [2025-10-28T19:16:17.787440] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-28T19:16:18.170208] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-28T19:16:18.170287] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-28T19:16:18.171268] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-28T19:16:18.171335] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-28T19:16:18.172804] [DEBUG] [LOCAL ] HMY: Trimmed 77158 records to 53165 (keeping 200 days of data) [2025-10-28T19:16:18.388778] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-28T19:16:18.523043] [DEBUG] [LOCAL ] HMY: Primary data saved (53165 records). [2025-10-28T19:16:18.523199] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-28T19:16:18.523327] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HMY took 40.2s. Estimated remaining: 2h 54m 38s. Rate: 7.6 symbols/min [2025-10-28T19:16:18.908734] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:16:19.180274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-28T19:16:19.450797] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:16:19.980288] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-28T19:16:20.416372] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:16:20.780318] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-28T19:16:21.369593] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:16:21.378890] [INFO ] [REMOTE ] HMC: Full fetch complete (68399 records). [2025-10-28T19:16:21.379056] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-28T19:16:21.607208] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-28T19:16:21.788196] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-28T19:16:21.788284] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-28T19:16:21.789212] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-28T19:16:21.789275] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-28T19:16:21.790761] [DEBUG] [LOCAL ] HMC: Trimmed 68399 records to 46011 (keeping 200 days of data) [2025-10-28T19:16:22.031482] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:16:22.102150] [DEBUG] [LOCAL ] HMC: Primary data saved (46011 records). [2025-10-28T19:16:22.102285] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-28T19:16:22.102365] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HMC took 47.9s. Estimated remaining: 2h 54m 24s. Rate: 7.6 symbols/min [2025-10-28T19:16:22.380302] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-28T19:16:23.018856] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:16:23.180299] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-28T19:16:23.454487] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:16:23.980319] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-28T19:16:24.372680] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T19:16:24.780241] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-28T19:16:25.130337] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:16:25.139579] [INFO ] [REMOTE ] HOMB: Full fetch complete (64448 records). [2025-10-28T19:16:25.139719] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-28T19:16:25.524571] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-28T19:16:25.524709] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-28T19:16:25.525747] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-28T19:16:25.525812] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-28T19:16:25.527324] [DEBUG] [LOCAL ] HOMB: Trimmed 64448 records to 43531 (keeping 200 days of data) [2025-10-28T19:16:25.780359] [DEBUG] [LOCAL ] HOMB: Primary data saved (43531 records). [2025-10-28T19:16:25.780478] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-28T19:16:25.780552] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOMB took 22.3s. Estimated remaining: 2h 54m 11s. Rate: 7.6 symbols/min [2025-10-28T19:16:26.058375] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:16:26.069197] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-28T19:16:27.600578] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T19:16:27.610400] [INFO ] [REMOTE ] HOG: Full fetch complete (74209 records). [2025-10-28T19:16:27.610544] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-28T19:16:28.001409] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-28T19:16:28.001493] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-28T19:16:28.002521] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-28T19:16:28.002584] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-28T19:16:28.003935] [DEBUG] [LOCAL ] HOG: Trimmed 74209 records to 50482 (keeping 200 days of data) [2025-10-28T19:16:28.302281] [DEBUG] [LOCAL ] HOG: Primary data saved (50482 records). [2025-10-28T19:16:28.302422] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-28T19:16:28.302501] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HOG took 28.5s. Estimated remaining: 2h 53m 56s. Rate: 7.6 symbols/min [2025-10-28T19:16:28.952702] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:28.981297] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:28.990691] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:29.019680] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:29.035746] [DEBUG] [LOCAL ] HOV: Loaded 13651 existing records from primary storage. [2025-10-28T19:16:29.036278] [INFO ] [MAIN ] HOV: Loaded 13651 existing records. [2025-10-28T19:16:29.253748] [DEBUG] [LOCAL ] HOUS: Loaded 45802 existing records from primary storage. [2025-10-28T19:16:29.272297] [INFO ] [MAIN ] HOUS: Loaded 45802 existing records. [2025-10-28T19:16:29.276053] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:29.290268] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-28T19:16:29.302967] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-28T19:16:29.325243] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-28T19:16:29.325363] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-28T19:16:29.325182] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-28T19:16:29.380044] [DEBUG] [LOCAL ] HP: Loaded 51297 existing records from primary storage. [2025-10-28T19:16:29.413273] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-28T19:16:29.418609] [INFO ] [MAIN ] HP: Loaded 51297 existing records. [2025-10-28T19:16:29.847199] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:29.893386] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-28T19:16:29.906292] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-28T19:16:29.993679] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-28T19:16:30.096725] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-28T19:16:30.099779] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:30.147805] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:30.162628] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-28T19:16:30.167925] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-28T19:16:30.183740] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-28T19:16:30.178476] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-28T19:16:30.201102] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-28T19:16:30.230535] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-28T19:16:30.230742] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-28T19:16:30.201212] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-28T19:16:30.565012] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:30.655915] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-28T19:16:31.265897] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:31.318433] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-28T19:16:31.408437] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:31.412610] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:31.413123] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-28T19:16:31.413821] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-28T19:16:31.424495] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:16:31.427374] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-28T19:16:31.975860] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:16:31.978738] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-28T19:16:32.405704] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:16:32.414319] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-28T19:16:32.561526] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:16:32.571116] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-28T19:16:32.580063] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:16:32.780267] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-28T19:16:33.111568] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T19:16:33.359038] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T19:16:33.411390] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:16:33.580288] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-28T19:16:33.767441] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:16:34.102634] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T19:16:34.380293] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-28T19:16:35.180299] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-28T19:16:35.577778] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:16:35.810028] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T19:16:35.980263] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-28T19:16:36.780325] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-28T19:16:37.419574] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:16:37.580250] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-28T19:16:37.806360] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T19:16:38.380265] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-28T19:16:38.969392] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:16:39.180236] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-28T19:16:39.414211] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:16:39.980299] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-28T19:16:40.642884] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T19:16:40.676470] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T19:16:40.780273] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-28T19:16:41.364452] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:16:41.580284] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-28T19:16:42.178399] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:16:42.380244] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-28T19:16:43.180300] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-28T19:16:43.791527] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T19:16:43.794104] [INFO ] [REMOTE ] HOV: Full fetch complete (18851 records). [2025-10-28T19:16:43.794173] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-28T19:16:43.980528] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-28T19:16:44.020623] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T19:16:44.219257] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-28T19:16:44.219333] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-28T19:16:44.219747] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-28T19:16:44.219807] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-28T19:16:44.220372] [DEBUG] [LOCAL ] HOV: Trimmed 18851 records to 13612 (keeping 200 days of data) [2025-10-28T19:16:44.301303] [DEBUG] [LOCAL ] HOV: Primary data saved (13612 records). [2025-10-28T19:16:44.301433] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-28T19:16:44.301513] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HOV took 16.0s. Estimated remaining: 2h 53m 59s. Rate: 7.6 symbols/min [2025-10-28T19:16:44.481004] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:44.489371] [DEBUG] [LOCAL ] HPF: Loaded 7315 existing records from primary storage. [2025-10-28T19:16:44.489576] [INFO ] [MAIN ] HPF: Loaded 7315 existing records. [2025-10-28T19:16:44.679488] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:44.679711] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-28T19:16:44.679767] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-28T19:16:44.679998] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-28T19:16:44.680039] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-28T19:16:44.785402] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-28T19:16:45.037910] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:45.585394] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-28T19:16:45.603492] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T19:16:45.956752] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:16:46.380275] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-28T19:16:46.907253] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:16:47.180273] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-28T19:16:47.644545] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T19:16:47.761089] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T19:16:47.980248] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-28T19:16:48.780258] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-28T19:16:49.256825] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:16:49.580263] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-28T19:16:49.975190] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T19:16:50.189935] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T19:16:50.380287] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-28T19:16:51.180327] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-28T19:16:51.554510] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:16:51.620359] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T19:16:51.980248] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-28T19:16:52.780266] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-28T19:16:53.254215] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:16:53.580262] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-28T19:16:53.783005] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:16:54.018176] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T19:16:54.380254] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-28T19:16:55.180302] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-28T19:16:55.640578] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T19:16:55.857243] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T19:16:55.980219] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-28T19:16:56.780230] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-28T19:16:57.261839] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:16:57.451420] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T19:16:57.580241] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-28T19:16:58.380240] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-28T19:16:58.573176] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T19:16:59.180251] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-28T19:16:59.657165] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:16:59.846547] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T19:16:59.980243] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-28T19:17:00.780260] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-28T19:17:01.265323] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:17:01.580248] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-28T19:17:01.682356] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T19:17:01.693117] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-28T19:17:01.693283] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-28T19:17:02.083683] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-28T19:17:02.083780] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-28T19:17:02.084781] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-28T19:17:02.084844] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-28T19:17:02.086325] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-28T19:17:02.384318] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-28T19:17:02.411816] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-28T19:17:02.411941] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-28T19:17:02.412018] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPE took 34.1s. Estimated remaining: 2h 54m 4s. Rate: 7.6 symbols/min [2025-10-28T19:17:02.586620] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:02.599129] [DEBUG] [LOCAL ] HPI: Loaded 10526 existing records from primary storage. [2025-10-28T19:17:02.599352] [INFO ] [MAIN ] HPI: Loaded 10526 existing records. [2025-10-28T19:17:02.785956] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:02.786202] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-28T19:17:02.786299] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-28T19:17:02.786547] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-28T19:17:02.786606] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-28T19:17:03.014777] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T19:17:03.198873] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-28T19:17:03.175833] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T19:17:03.214363] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:03.730862] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T19:17:03.732601] [INFO ] [REMOTE ] HPF: Full fetch complete (10406 records). [2025-10-28T19:17:03.732701] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-28T19:17:03.985365] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-28T19:17:04.097128] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-28T19:17:04.097211] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-28T19:17:04.097481] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-28T19:17:04.097523] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-28T19:17:04.098037] [DEBUG] [LOCAL ] HPF: Trimmed 10406 records to 7291 (keeping 200 days of data) [2025-10-28T19:17:04.143599] [DEBUG] [LOCAL ] HPF: Primary data saved (7291 records). [2025-10-28T19:17:04.143769] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-28T19:17:04.143897] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HPF took 19.8s. Estimated remaining: 2h 53m 48s. Rate: 7.6 symbols/min [2025-10-28T19:17:04.318958] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:04.367638] [DEBUG] [LOCAL ] HPP: Loaded 51188 existing records from primary storage. [2025-10-28T19:17:04.368053] [INFO ] [MAIN ] HPP: Loaded 51188 existing records. [2025-10-28T19:17:04.545157] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:04.545360] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-28T19:17:04.545407] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-28T19:17:04.545830] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-28T19:17:04.545888] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-28T19:17:04.664379] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:17:04.785546] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-28T19:17:04.907638] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:05.580326] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-28T19:17:05.991801] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:17:06.103915] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T19:17:06.114463] [INFO ] [REMOTE ] HOUS: Full fetch complete (64832 records). [2025-10-28T19:17:06.114630] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-28T19:17:06.385512] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-28T19:17:06.498694] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-28T19:17:06.498788] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-28T19:17:06.499693] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-28T19:17:06.499754] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-28T19:17:06.501170] [DEBUG] [LOCAL ] HOUS: Trimmed 64832 records to 45809 (keeping 200 days of data) [2025-10-28T19:17:06.753128] [DEBUG] [LOCAL ] HOUS: Primary data saved (45809 records). [2025-10-28T19:17:06.753261] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-28T19:17:06.754398] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HOUS took 38.5s. Estimated remaining: 2h 53m 34s. Rate: 7.6 symbols/min [2025-10-28T19:17:06.922039] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:06.970770] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-28T19:17:06.971056] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-28T19:17:07.146075] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:07.146339] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-28T19:17:07.146390] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-28T19:17:07.146586] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-28T19:17:07.146625] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-28T19:17:07.188069] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-28T19:17:07.500308] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:07.714563] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:17:07.716469] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:17:07.980303] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-28T19:17:08.780262] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-28T19:17:09.199916] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:17:09.580251] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-28T19:17:09.930084] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:17:10.380314] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-28T19:17:10.606287] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T19:17:11.180252] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-28T19:17:11.642187] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T19:17:11.980261] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-28T19:17:12.330699] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T19:17:12.501415] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:17:12.780261] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-28T19:17:13.580258] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-28T19:17:14.077874] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:17:14.305961] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T19:17:14.380272] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-28T19:17:14.832836] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:17:15.180253] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-28T19:17:15.980259] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-28T19:17:16.635543] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:17:16.645885] [INFO ] [REMOTE ] HP: Full fetch complete (74145 records). [2025-10-28T19:17:16.646044] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-28T19:17:16.785414] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-28T19:17:17.071583] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-28T19:17:17.071768] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-28T19:17:17.072888] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-28T19:17:17.072966] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-28T19:17:17.074576] [DEBUG] [LOCAL ] HP: Trimmed 74145 records to 51229 (keeping 200 days of data) [2025-10-28T19:17:17.198242] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T19:17:17.424853] [DEBUG] [LOCAL ] HP: Primary data saved (51229 records). [2025-10-28T19:17:17.424987] [INFO ] [MAIN ] HP: Full history saved. [2025-10-28T19:17:17.425064] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HP took 49.1s. Estimated remaining: 2h 53m 29s. Rate: 7.6 symbols/min [2025-10-28T19:17:17.597049] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:17.585877] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-28T19:17:17.610518] [DEBUG] [LOCAL ] HPS: Loaded 10175 existing records from primary storage. [2025-10-28T19:17:17.610769] [INFO ] [MAIN ] HPS: Loaded 10175 existing records. [2025-10-28T19:17:17.792251] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:17.792484] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-28T19:17:17.792538] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-28T19:17:17.792760] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-28T19:17:17.792818] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-28T19:17:18.158866] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:18.222980] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:17:18.380268] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-28T19:17:18.791408] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T19:17:18.808081] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T19:17:19.180295] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-28T19:17:19.980302] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-28T19:17:20.530619] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T19:17:20.565438] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:17:20.780270] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-28T19:17:21.325470] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T19:17:21.580323] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-28T19:17:22.107321] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:17:22.380249] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-28T19:17:22.867049] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T19:17:23.180245] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-28T19:17:23.980246] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-28T19:17:24.303262] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:17:24.780272] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-28T19:17:25.213578] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:17:25.279464] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:17:25.580314] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-28T19:17:26.380318] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-28T19:17:26.957795] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T19:17:26.958263] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T19:17:27.180304] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-28T19:17:27.865489] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:17:27.980325] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-28T19:17:28.500748] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T19:17:28.780296] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-28T19:17:29.580317] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-28T19:17:30.173872] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T19:17:30.239005] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:17:30.380223] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-28T19:17:31.180248] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-28T19:17:31.680268] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:17:31.812511] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:17:31.814946] [INFO ] [REMOTE ] HPI: Full fetch complete (13814 records). [2025-10-28T19:17:31.815023] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-28T19:17:31.987594] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-28T19:17:32.173784] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-28T19:17:32.173856] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-28T19:17:32.174164] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-28T19:17:32.174200] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-28T19:17:32.174680] [DEBUG] [LOCAL ] HPI: Trimmed 13814 records to 10492 (keeping 200 days of data) [2025-10-28T19:17:32.235617] [DEBUG] [LOCAL ] HPI: Primary data saved (10492 records). [2025-10-28T19:17:32.235749] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-28T19:17:32.235829] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPI took 29.8s. Estimated remaining: 2h 53m 30s. Rate: 7.6 symbols/min [2025-10-28T19:17:32.402988] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:32.429436] [DEBUG] [LOCAL ] HQH: Loaded 25547 existing records from primary storage. [2025-10-28T19:17:32.429681] [INFO ] [MAIN ] HQH: Loaded 25547 existing records. [2025-10-28T19:17:32.613901] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T19:17:32.618182] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:32.620859] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-28T19:17:32.621169] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-28T19:17:32.621471] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-28T19:17:32.621529] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-28T19:17:32.790016] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-28T19:17:32.981892] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:33.514871] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:17:33.525609] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-28T19:17:33.525811] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-28T19:17:33.588702] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-28T19:17:33.925609] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-28T19:17:33.925723] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-28T19:17:33.926814] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-28T19:17:33.926881] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-28T19:17:33.928408] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-28T19:17:34.111537] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T19:17:34.263754] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-28T19:17:34.263886] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-28T19:17:34.263960] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPQ took 27.5s. Estimated remaining: 2h 53m 15s. Rate: 7.6 symbols/min [2025-10-28T19:17:34.385402] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-28T19:17:34.433185] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:34.450956] [DEBUG] [LOCAL ] HQL: Loaded 17143 existing records from primary storage. [2025-10-28T19:17:34.451180] [INFO ] [MAIN ] HQL: Loaded 17143 existing records. [2025-10-28T19:17:34.631719] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:34.631947] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-28T19:17:34.632008] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-28T19:17:34.632236] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-28T19:17:34.632283] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-28T19:17:34.982978] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:35.039881] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T19:17:35.042292] [INFO ] [REMOTE ] HPS: Full fetch complete (14949 records). [2025-10-28T19:17:35.042364] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-28T19:17:35.185358] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-28T19:17:35.433455] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-28T19:17:35.433529] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-28T19:17:35.433877] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-28T19:17:35.433936] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-28T19:17:35.434428] [DEBUG] [LOCAL ] HPS: Trimmed 14949 records to 10110 (keeping 200 days of data) [2025-10-28T19:17:35.492543] [DEBUG] [LOCAL ] HPS: Primary data saved (10110 records). [2025-10-28T19:17:35.492679] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-28T19:17:35.492783] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HPS took 18.1s. Estimated remaining: 2h 52m 59s. Rate: 7.6 symbols/min [2025-10-28T19:17:35.657442] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:35.705149] [DEBUG] [LOCAL ] HR: Loaded 52096 existing records from primary storage. [2025-10-28T19:17:35.705432] [INFO ] [MAIN ] HR: Loaded 52096 existing records. [2025-10-28T19:17:35.879455] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:35.879702] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-28T19:17:35.879767] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-28T19:17:35.880178] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-28T19:17:35.880233] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-28T19:17:35.980259] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-28T19:17:36.235360] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:17:36.256676] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:36.780245] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-28T19:17:36.827343] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T19:17:37.580310] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-28T19:17:37.954031] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:17:38.380296] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-28T19:17:38.901889] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T19:17:39.180294] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-28T19:17:39.511044] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:17:39.980251] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-28T19:17:40.315400] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:17:40.624271] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:17:40.780265] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-28T19:17:41.563680] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:17:41.580248] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-28T19:17:42.380299] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-28T19:17:42.948517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:17:43.180362] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-28T19:17:43.691919] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:17:43.980330] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-28T19:17:44.478036] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T19:17:44.488600] [INFO ] [REMOTE ] HPP: Full fetch complete (73362 records). [2025-10-28T19:17:44.488827] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-28T19:17:44.785384] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-28T19:17:44.902009] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-28T19:17:44.902085] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-28T19:17:44.903104] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-28T19:17:44.903168] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-28T19:17:44.904615] [DEBUG] [LOCAL ] HPP: Trimmed 73362 records to 51198 (keeping 200 days of data) [2025-10-28T19:17:45.227590] [DEBUG] [LOCAL ] HPP: Primary data saved (51198 records). [2025-10-28T19:17:45.227760] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-28T19:17:45.227875] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HPP took 41.1s. Estimated remaining: 2h 52m 53s. Rate: 7.6 symbols/min [2025-10-28T19:17:45.405045] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:17:45.477173] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:45.518839] [DEBUG] [LOCAL ] HRB: Loaded 48064 existing records from primary storage. [2025-10-28T19:17:45.519127] [INFO ] [MAIN ] HRB: Loaded 48064 existing records. [2025-10-28T19:17:45.582234] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-28T19:17:45.666513] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:17:45.725084] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:45.725327] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-28T19:17:45.725374] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-28T19:17:45.725752] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-28T19:17:45.725810] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-28T19:17:46.071087] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:46.380243] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-28T19:17:46.833455] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:17:47.069220] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:17:47.180325] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-28T19:17:47.980301] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-28T19:17:48.444896] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T19:17:48.780287] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-28T19:17:48.848019] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T19:17:49.580252] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-28T19:17:49.924259] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T19:17:50.281252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:17:50.380250] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-28T19:17:51.180259] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-28T19:17:51.808004] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T19:17:51.814783] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T19:17:51.980233] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-28T19:17:52.780245] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-28T19:17:53.242630] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:17:53.379068] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T19:17:53.580279] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-28T19:17:54.211059] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:17:54.380268] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-28T19:17:55.180253] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-28T19:17:55.651864] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T19:17:55.875071] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T19:17:55.980213] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-28T19:17:56.779761] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:17:56.785229] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-28T19:17:57.580250] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-28T19:17:57.986902] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:17:58.195356] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T19:17:58.380264] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-28T19:17:59.036088] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T19:17:59.180240] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-28T19:17:59.906133] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T19:17:59.980205] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-28T19:18:00.780252] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-28T19:18:01.024979] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T19:18:01.030531] [INFO ] [REMOTE ] HQH: Full fetch complete (36838 records). [2025-10-28T19:18:01.030613] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-28T19:18:01.443510] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-28T19:18:01.443578] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-28T19:18:01.444395] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-28T19:18:01.444460] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-28T19:18:01.445409] [DEBUG] [LOCAL ] HQH: Trimmed 36838 records to 25506 (keeping 200 days of data) [2025-10-28T19:18:01.585680] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-28T19:18:01.607635] [DEBUG] [LOCAL ] HQH: Primary data saved (25506 records). [2025-10-28T19:18:01.607780] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-28T19:18:01.607859] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HQH took 29.4s. Estimated remaining: 2h 52m 56s. Rate: 7.6 symbols/min [2025-10-28T19:18:01.760395] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T19:18:01.796024] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:01.829480] [DEBUG] [LOCAL ] HRI: Loaded 31983 existing records from primary storage. [2025-10-28T19:18:01.829759] [INFO ] [MAIN ] HRI: Loaded 31983 existing records. [2025-10-28T19:18:02.016461] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:02.016690] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-28T19:18:02.016752] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-28T19:18:02.017027] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-28T19:18:02.017087] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-28T19:18:02.386123] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-28T19:18:02.420256] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:02.800570] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:18:03.035105] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T19:18:03.180238] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-28T19:18:03.980318] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-28T19:18:04.073936] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:18:04.780340] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-28T19:18:05.138130] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:18:05.571458] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:18:05.580203] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-28T19:18:06.380299] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-28T19:18:06.646804] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T19:18:07.180254] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-28T19:18:07.573418] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:18:07.980256] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-28T19:18:08.251081] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:18:08.780265] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-28T19:18:09.203778] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:18:09.580300] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-28T19:18:10.050620] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T19:18:10.061170] [INFO ] [REMOTE ] HR: Full fetch complete (75080 records). [2025-10-28T19:18:10.061286] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-28T19:18:10.404170] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-28T19:18:10.453037] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-28T19:18:10.454096] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-28T19:18:10.455225] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-28T19:18:10.455462] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-28T19:18:10.457481] [DEBUG] [LOCAL ] HR: Trimmed 75080 records to 52094 (keeping 200 days of data) [2025-10-28T19:18:10.689798] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:18:10.805796] [DEBUG] [LOCAL ] HR: Primary data saved (52094 records). [2025-10-28T19:18:10.805959] [INFO ] [MAIN ] HR: Full history saved. [2025-10-28T19:18:10.806721] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HR took 35.3s. Estimated remaining: 2h 52m 50s. Rate: 7.6 symbols/min [2025-10-28T19:18:10.972710] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:11.024445] [DEBUG] [LOCAL ] HRL: Loaded 53115 existing records from primary storage. [2025-10-28T19:18:11.024780] [INFO ] [MAIN ] HRL: Loaded 53115 existing records. [2025-10-28T19:18:11.193816] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-28T19:18:11.198463] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:11.199602] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-28T19:18:11.199680] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-28T19:18:11.200158] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-28T19:18:11.200294] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-28T19:18:11.559600] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:11.684314] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:18:11.980258] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-28T19:18:12.093528] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:18:12.099067] [INFO ] [REMOTE ] HQL: Full fetch complete (25496 records). [2025-10-28T19:18:12.099163] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-28T19:18:12.472024] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-28T19:18:12.472101] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-28T19:18:12.472629] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-28T19:18:12.472705] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-28T19:18:12.473334] [DEBUG] [LOCAL ] HQL: Trimmed 25496 records to 17242 (keeping 200 days of data) [2025-10-28T19:18:12.572736] [DEBUG] [LOCAL ] HQL: Primary data saved (17242 records). [2025-10-28T19:18:12.572865] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-28T19:18:12.572942] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HQL took 38.3s. Estimated remaining: 2h 52m 34s. Rate: 7.6 symbols/min [2025-10-28T19:18:12.747960] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:12.779684] [DEBUG] [LOCAL ] HRTG: Loaded 34356 existing records from primary storage. [2025-10-28T19:18:12.779948] [INFO ] [MAIN ] HRTG: Loaded 34356 existing records. [2025-10-28T19:18:12.790864] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-28T19:18:12.962484] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:12.962776] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-28T19:18:12.962840] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-28T19:18:12.963229] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-28T19:18:12.963290] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-28T19:18:13.330021] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:13.435618] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T19:18:13.580234] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-28T19:18:14.110791] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:18:14.231881] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:18:14.380287] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-28T19:18:15.180270] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-28T19:18:15.230407] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:18:15.980292] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-28T19:18:16.388247] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:18:16.780276] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-28T19:18:17.203370] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T19:18:17.283063] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T19:18:17.580280] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-28T19:18:18.380253] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-28T19:18:18.912134] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:18:18.921621] [INFO ] [REMOTE ] HRB: Full fetch complete (69814 records). [2025-10-28T19:18:18.921820] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-28T19:18:19.188549] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-28T19:18:19.309233] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-28T19:18:19.309317] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-28T19:18:19.310248] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-28T19:18:19.310312] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-28T19:18:19.311795] [DEBUG] [LOCAL ] HRB: Trimmed 69814 records to 47981 (keeping 200 days of data) [2025-10-28T19:18:19.603702] [DEBUG] [LOCAL ] HRB: Primary data saved (47981 records). [2025-10-28T19:18:19.618407] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-28T19:18:19.631575] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRB took 34.4s. Estimated remaining: 2h 52m 25s. Rate: 7.6 symbols/min [2025-10-28T19:18:19.669743] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T19:18:19.818753] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:19.863989] [DEBUG] [LOCAL ] HSBC: Loaded 50955 existing records from primary storage. [2025-10-28T19:18:19.864270] [INFO ] [MAIN ] HSBC: Loaded 50955 existing records. [2025-10-28T19:18:19.985362] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-28T19:18:20.040404] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:20.040666] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-28T19:18:20.040727] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-28T19:18:20.041088] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-28T19:18:20.041144] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-28T19:18:20.401160] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:20.425193] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:18:20.780271] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-28T19:18:21.506711] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T19:18:21.580244] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-28T19:18:22.172459] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T19:18:22.380260] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-28T19:18:23.178872] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T19:18:23.188903] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-28T19:18:23.986873] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-28T19:18:24.013590] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T19:18:24.075791] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T19:18:24.780336] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-28T19:18:25.224472] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:18:25.580219] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-28T19:18:26.389834] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-28T19:18:26.415488] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T19:18:26.865803] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T19:18:27.180270] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-28T19:18:27.469555] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:18:27.980335] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-28T19:18:28.642220] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:18:28.780230] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-28T19:18:29.269085] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T19:18:29.580298] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-28T19:18:30.337198] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T19:18:30.380336] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-28T19:18:31.180365] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-28T19:18:31.432495] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T19:18:31.531092] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:18:31.537332] [INFO ] [REMOTE ] HRI: Full fetch complete (46912 records). [2025-10-28T19:18:31.537422] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-28T19:18:31.921531] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-28T19:18:31.921612] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-28T19:18:31.922333] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-28T19:18:31.922390] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-28T19:18:31.923297] [DEBUG] [LOCAL ] HRI: Trimmed 46912 records to 32021 (keeping 200 days of data) [2025-10-28T19:18:31.986532] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-28T19:18:32.123474] [DEBUG] [LOCAL ] HRI: Primary data saved (32021 records). [2025-10-28T19:18:32.123591] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-28T19:18:32.123684] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HRI took 30.5s. Estimated remaining: 2h 52m 23s. Rate: 7.6 symbols/min [2025-10-28T19:18:32.292464] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:32.306947] [DEBUG] [LOCAL ] HSHP: Loaded 14105 existing records from primary storage. [2025-10-28T19:18:32.307226] [INFO ] [MAIN ] HSHP: Loaded 14105 existing records. [2025-10-28T19:18:32.486485] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:32.486761] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-28T19:18:32.486944] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-28T19:18:32.487235] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-28T19:18:32.487297] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-28T19:18:32.799371] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T19:18:32.797560] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-28T19:18:32.898000] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:33.581085] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-28T19:18:33.580957] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:18:33.612771] [INFO ] [REMOTE ] HRL: Full fetch complete (77029 records). [2025-10-28T19:18:33.614102] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T19:18:33.621549] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-28T19:18:34.009143] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-28T19:18:34.009221] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-28T19:18:34.010197] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-28T19:18:34.010258] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-28T19:18:34.011697] [DEBUG] [LOCAL ] HRL: Trimmed 77029 records to 53113 (keeping 200 days of data) [2025-10-28T19:18:34.230042] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:18:34.345302] [DEBUG] [LOCAL ] HRL: Primary data saved (53113 records). [2025-10-28T19:18:34.345435] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-28T19:18:34.346235] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HRL took 23.5s. Estimated remaining: 2h 52m 8s. Rate: 7.6 symbols/min [2025-10-28T19:18:34.385349] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-28T19:18:34.515800] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:34.564424] [DEBUG] [LOCAL ] HSY: Loaded 50292 existing records from primary storage. [2025-10-28T19:18:34.564726] [INFO ] [MAIN ] HSY: Loaded 50292 existing records. [2025-10-28T19:18:34.739598] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:34.739815] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-28T19:18:34.739872] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-28T19:18:34.740384] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-28T19:18:34.740424] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-28T19:18:35.098764] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:35.109460] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T19:18:35.180227] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-28T19:18:35.943393] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:18:35.980242] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-28T19:18:36.667978] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:18:36.780286] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-28T19:18:37.580277] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-28T19:18:37.700042] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:18:38.189408] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T19:18:38.380263] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-28T19:18:39.180288] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-28T19:18:39.400373] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T19:18:39.980280] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-28T19:18:40.454441] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T19:18:40.619112] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:18:40.780287] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-28T19:18:41.580272] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-28T19:18:42.065893] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:18:42.380230] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-28T19:18:42.559993] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:18:43.180246] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-28T19:18:43.657255] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:18:43.980249] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-28T19:18:44.644813] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T19:18:44.677189] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T19:18:44.780233] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-28T19:18:45.580253] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-28T19:18:46.055181] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:18:46.073103] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:18:46.380306] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-28T19:18:47.180252] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-28T19:18:47.873243] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T19:18:47.937349] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T19:18:47.980225] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-28T19:18:48.728049] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T19:18:48.730936] [INFO ] [REMOTE ] HSHP: Full fetch complete (22858 records). [2025-10-28T19:18:48.731036] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-28T19:18:48.785448] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-28T19:18:49.095498] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-28T19:18:49.095576] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-28T19:18:49.096068] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-28T19:18:49.096128] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-28T19:18:49.096833] [DEBUG] [LOCAL ] HSHP: Trimmed 22858 records to 13903 (keeping 200 days of data) [2025-10-28T19:18:49.174761] [DEBUG] [LOCAL ] HSHP: Primary data saved (13903 records). [2025-10-28T19:18:49.174902] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-28T19:18:49.174979] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HSHP took 17.1s. Estimated remaining: 2h 52m 9s. Rate: 7.6 symbols/min [2025-10-28T19:18:49.348612] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:49.348812] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-28T19:18:49.348855] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-28T19:18:49.348965] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-28T19:18:49.349006] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-28T19:18:49.349048] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-28T19:18:49.349080] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-28T19:18:49.589231] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-28T19:18:49.714497] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:50.364182] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T19:18:50.380227] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-28T19:18:50.553788] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T19:18:51.180320] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-28T19:18:51.597703] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:18:51.980260] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-28T19:18:52.206390] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T19:18:52.780225] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-28T19:18:53.443354] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T19:18:53.580259] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-28T19:18:53.733993] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:18:54.380259] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-28T19:18:55.073078] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:18:55.083791] [INFO ] [REMOTE ] HSBC: Full fetch complete (74281 records). [2025-10-28T19:18:55.083961] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-28T19:18:55.185380] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-28T19:18:55.472984] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-28T19:18:55.473081] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-28T19:18:55.474062] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-28T19:18:55.474122] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-28T19:18:55.475476] [DEBUG] [LOCAL ] HSBC: Trimmed 74281 records to 50952 (keeping 200 days of data) [2025-10-28T19:18:55.810921] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T19:18:55.830697] [DEBUG] [LOCAL ] HSBC: Primary data saved (50952 records). [2025-10-28T19:18:55.831159] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-28T19:18:55.831400] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSBC took 36.2s. Estimated remaining: 2h 51m 59s. Rate: 7.6 symbols/min [2025-10-28T19:18:55.998679] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-28T19:18:56.007935] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:56.024091] [DEBUG] [LOCAL ] HTD: Loaded 14025 existing records from primary storage. [2025-10-28T19:18:56.024326] [INFO ] [MAIN ] HTD: Loaded 14025 existing records. [2025-10-28T19:18:56.205168] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:56.205371] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-28T19:18:56.205420] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-28T19:18:56.205611] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-28T19:18:56.205697] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-28T19:18:56.270819] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:18:56.294263] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-28T19:18:56.307845] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:18:56.308035] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-28T19:18:56.311587] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:18:56.312077] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-28T19:18:56.317543] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-28T19:18:56.328073] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-28T19:18:56.328279] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-28T19:18:56.357609] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTB took 7.2s. Estimated remaining: 2h 51m 42s. Rate: 7.6 symbols/min [2025-10-28T19:18:56.691600] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:56.718767] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-28T19:18:56.788490] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-28T19:18:56.772831] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:18:56.792622] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-28T19:18:56.792447] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:56.801043] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-28T19:18:56.801317] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-28T19:18:56.801733] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-28T19:18:56.801971] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-28T19:18:56.814042] [INFO ] [REMOTE ] HRTG: Full fetch complete (44479 records). [2025-10-28T19:18:56.835626] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-28T19:18:57.473036] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:57.559997] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-28T19:18:57.560072] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-28T19:18:57.560865] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-28T19:18:57.560975] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-28T19:18:57.561991] [DEBUG] [LOCAL ] HRTG: Trimmed 44479 records to 34248 (keeping 200 days of data) [2025-10-28T19:18:57.608871] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-28T19:18:57.759575] [DEBUG] [LOCAL ] HRTG: Primary data saved (34248 records). [2025-10-28T19:18:57.759728] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-28T19:18:57.759813] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HRTG took 45.2s. Estimated remaining: 2h 51m 27s. Rate: 7.6 symbols/min [2025-10-28T19:18:57.939794] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:57.982748] [DEBUG] [LOCAL ] HTGC: Loaded 47529 existing records from primary storage. [2025-10-28T19:18:57.983099] [INFO ] [MAIN ] HTGC: Loaded 47529 existing records. [2025-10-28T19:18:58.168004] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:58.168333] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-28T19:18:58.168466] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-28T19:18:58.177699] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-28T19:18:58.177530] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:18:58.180718] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-28T19:18:58.385376] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-28T19:18:58.551849] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:58.593964] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T19:18:58.931144] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:18:59.180243] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-28T19:18:59.766287] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T19:18:59.980283] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-28T19:19:00.631301] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:19:00.780315] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-28T19:19:01.034838] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-28T19:19:01.580305] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-28T19:19:02.380295] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-28T19:19:02.623802] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:19:02.896550] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:19:03.180290] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-28T19:19:03.980322] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-28T19:19:04.461525] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:19:04.780313] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-28T19:19:05.157909] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T19:19:05.518268] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T19:19:05.528475] [INFO ] [REMOTE ] HSY: Full fetch complete (73542 records). [2025-10-28T19:19:05.528633] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-28T19:19:05.585476] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-28T19:19:05.925248] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-28T19:19:05.925329] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-28T19:19:05.926416] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-28T19:19:05.926478] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-28T19:19:05.927831] [DEBUG] [LOCAL ] HSY: Trimmed 73542 records to 50287 (keeping 200 days of data) [2025-10-28T19:19:06.240697] [DEBUG] [LOCAL ] HSY: Primary data saved (50287 records). [2025-10-28T19:19:06.240933] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-28T19:19:06.241827] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HSY took 31.9s. Estimated remaining: 2h 51m 20s. Rate: 7.6 symbols/min [2025-10-28T19:19:06.365220] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T19:19:06.383800] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-28T19:19:06.452748] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:06.484838] [DEBUG] [LOCAL ] HTH: Loaded 32247 existing records from primary storage. [2025-10-28T19:19:06.485123] [INFO ] [MAIN ] HTH: Loaded 32247 existing records. [2025-10-28T19:19:06.662762] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:06.662968] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-28T19:19:06.663017] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-28T19:19:06.663257] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-28T19:19:06.663299] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-28T19:19:06.730089] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T19:19:07.024028] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:07.180300] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-28T19:19:07.438777] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-28T19:19:07.980253] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-28T19:19:08.672911] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:19:08.780296] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-28T19:19:09.008665] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T19:19:09.580247] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-28T19:19:10.100244] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T19:19:10.380236] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-28T19:19:10.634421] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-28T19:19:11.180295] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-28T19:19:11.980223] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-28T19:19:12.150555] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T19:19:12.160699] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-10-28T19:19:12.780232] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-28T19:19:13.580256] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-28T19:19:13.998407] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:19:14.366507] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T19:19:14.380204] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-28T19:19:15.180224] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-28T19:19:15.249991] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T19:19:15.365116] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-28T19:19:15.980308] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-28T19:19:16.204469] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-28T19:19:16.780308] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-28T19:19:17.580263] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-28T19:19:18.062062] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:19:18.280713] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T19:19:18.380287] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-28T19:19:18.956456] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:19:19.180301] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-28T19:19:19.980222] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-28T19:19:20.660703] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T19:19:20.780251] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-28T19:19:20.988546] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:19:21.210262] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T19:19:21.210922] [INFO ] [REMOTE ] HTFC: Full fetch complete (832 records). [2025-10-28T19:19:21.210987] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-28T19:19:21.383525] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-28T19:19:21.383724] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:19:21.383789] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:19:21.383856] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-28T19:19:21.383921] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-28T19:19:21.383956] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-28T19:19:21.383994] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-28T19:19:21.384047] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HTFC took 25.0s. Estimated remaining: 2h 51m 21s. Rate: 7.6 symbols/min [2025-10-28T19:19:21.545875] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:21.579438] [DEBUG] [LOCAL ] HUBB: Loaded 35660 existing records from primary storage. [2025-10-28T19:19:21.579741] [INFO ] [MAIN ] HUBB: Loaded 35660 existing records. [2025-10-28T19:19:21.590418] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-28T19:19:21.763798] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:21.764033] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-28T19:19:21.764083] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-28T19:19:21.764436] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-28T19:19:21.764496] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-28T19:19:22.119324] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:22.380271] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-28T19:19:22.815330] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:19:23.180305] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-28T19:19:23.474702] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:19:23.980229] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-28T19:19:24.114823] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T19:19:24.780287] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-28T19:19:25.147268] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:19:25.402385] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T19:19:25.580271] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-28T19:19:26.320890] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T19:19:26.324787] [INFO ] [REMOTE ] HTD: Full fetch complete (19526 records). [2025-10-28T19:19:26.324914] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-28T19:19:26.387884] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-28T19:19:26.700521] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-28T19:19:26.700598] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-28T19:19:26.701022] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-28T19:19:26.701083] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-28T19:19:26.701696] [DEBUG] [LOCAL ] HTD: Trimmed 19526 records to 14039 (keeping 200 days of data) [2025-10-28T19:19:26.785486] [DEBUG] [LOCAL ] HTD: Primary data saved (14039 records). [2025-10-28T19:19:26.785626] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-28T19:19:26.785744] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HTD took 31.0s. Estimated remaining: 2h 51m 10s. Rate: 7.6 symbols/min [2025-10-28T19:19:26.955190] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:26.991822] [DEBUG] [LOCAL ] HUBS: Loaded 39652 existing records from primary storage. [2025-10-28T19:19:26.992112] [INFO ] [MAIN ] HUBS: Loaded 39652 existing records. [2025-10-28T19:19:27.170150] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:27.170360] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-28T19:19:27.170410] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-28T19:19:27.170670] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-28T19:19:27.170746] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-28T19:19:27.185364] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-28T19:19:27.546705] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:27.642683] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:19:27.980248] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-28T19:19:28.202987] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:19:28.780282] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-28T19:19:29.309208] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T19:19:29.580273] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-28T19:19:29.944271] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T19:19:30.380315] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-28T19:19:30.830022] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:19:31.180313] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-28T19:19:31.617077] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:19:31.980326] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-28T19:19:32.183534] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:19:32.780334] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-28T19:19:33.362930] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:19:33.372747] [INFO ] [REMOTE ] HTGC: Full fetch complete (68857 records). [2025-10-28T19:19:33.372865] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-28T19:19:33.585770] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-28T19:19:33.762736] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-28T19:19:33.762971] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-28T19:19:33.764041] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-28T19:19:33.764119] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-28T19:19:33.765693] [DEBUG] [LOCAL ] HTGC: Trimmed 68857 records to 47495 (keeping 200 days of data) [2025-10-28T19:19:34.011739] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:19:34.080179] [DEBUG] [LOCAL ] HTGC: Primary data saved (47495 records). [2025-10-28T19:19:34.080303] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-28T19:19:34.080399] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HTGC took 36.3s. Estimated remaining: 2h 51m 1s. Rate: 7.6 symbols/min [2025-10-28T19:19:34.244921] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:34.286819] [DEBUG] [LOCAL ] HUM: Loaded 49027 existing records from primary storage. [2025-10-28T19:19:34.287132] [INFO ] [MAIN ] HUM: Loaded 49027 existing records. [2025-10-28T19:19:34.384480] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-28T19:19:34.462384] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:34.462580] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-28T19:19:34.462627] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-28T19:19:34.463000] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-28T19:19:34.463057] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-28T19:19:34.811146] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:34.869509] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T19:19:35.180268] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-28T19:19:35.355676] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T19:19:35.980320] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-28T19:19:36.423075] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:19:36.780289] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-28T19:19:37.038749] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:19:37.580255] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-28T19:19:37.994435] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T19:19:38.380323] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-28T19:19:38.754535] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T19:19:39.180334] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-28T19:19:39.321977] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T19:19:39.968633] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T19:19:39.980263] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-28T19:19:40.780266] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-28T19:19:40.911309] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:19:41.580224] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-28T19:19:41.649609] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:19:41.655598] [INFO ] [REMOTE ] HTH: Full fetch complete (46863 records). [2025-10-28T19:19:41.655731] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-28T19:19:42.052246] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-28T19:19:42.052341] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-28T19:19:42.053194] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-28T19:19:42.053258] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-28T19:19:42.054228] [DEBUG] [LOCAL ] HTH: Trimmed 46863 records to 32136 (keeping 200 days of data) [2025-10-28T19:19:42.243064] [DEBUG] [LOCAL ] HTH: Primary data saved (32136 records). [2025-10-28T19:19:42.243203] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-28T19:19:42.243283] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HTH took 36.0s. Estimated remaining: 2h 50m 54s. Rate: 7.6 symbols/min [2025-10-28T19:19:42.386459] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-28T19:19:42.418371] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:42.478155] [DEBUG] [LOCAL ] HUN: Loaded 53210 existing records from primary storage. [2025-10-28T19:19:42.478994] [INFO ] [MAIN ] HUN: Loaded 53210 existing records. [2025-10-28T19:19:42.665299] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:42.665793] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-28T19:19:42.665869] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-28T19:19:42.667163] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-28T19:19:42.667231] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-28T19:19:42.791511] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T19:19:42.817289] [INFO ] [REMOTE ] HUBB: Full fetch complete (54303 records). [2025-10-28T19:19:42.827715] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-28T19:19:43.200117] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-28T19:19:43.312804] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:43.474390] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-28T19:19:43.474477] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-28T19:19:43.475361] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-28T19:19:43.475425] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-28T19:19:43.476598] [DEBUG] [LOCAL ] HUBB: Trimmed 54303 records to 35648 (keeping 200 days of data) [2025-10-28T19:19:43.702808] [DEBUG] [LOCAL ] HUBB: Primary data saved (35648 records). [2025-10-28T19:19:43.702979] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-28T19:19:43.703135] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUBB took 22.3s. Estimated remaining: 2h 50m 38s. Rate: 7.6 symbols/min [2025-10-28T19:19:43.836966] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T19:19:43.915285] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:43.953066] [DEBUG] [LOCAL ] HUYA: Loaded 43516 existing records from primary storage. [2025-10-28T19:19:43.953411] [INFO ] [MAIN ] HUYA: Loaded 43516 existing records. [2025-10-28T19:19:43.985344] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-28T19:19:44.138449] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:44.138678] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-28T19:19:44.138737] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-28T19:19:44.138929] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-28T19:19:44.138970] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-28T19:19:44.504484] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:44.569107] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:19:44.780249] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-28T19:19:45.195842] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T19:19:45.580261] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-28T19:19:46.137356] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T19:19:46.380270] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-28T19:19:46.929490] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:19:47.180223] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-28T19:19:47.754357] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:19:47.980296] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-28T19:19:48.385520] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T19:19:48.780285] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-28T19:19:49.203292] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:19:49.580298] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-28T19:19:50.380224] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-28T19:19:50.573152] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:19:50.614864] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-28T19:19:51.180246] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-28T19:19:51.787997] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T19:19:51.980228] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-28T19:19:52.239792] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:19:52.780261] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-28T19:19:53.274817] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T19:19:53.580242] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-28T19:19:53.964393] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T19:19:54.380299] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-28T19:19:54.998379] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:19:55.180241] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-28T19:19:55.480539] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T19:19:55.980295] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-28T19:19:56.481570] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T19:19:56.780270] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-28T19:19:57.210911] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:19:57.580243] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-28T19:19:58.168028] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:19:58.380289] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-28T19:19:58.865039] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:19:59.180295] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-28T19:19:59.474367] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:19:59.980290] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-28T19:20:00.717941] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:20:00.727794] [INFO ] [REMOTE ] HUM: Full fetch complete (71063 records). [2025-10-28T19:20:00.727931] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-28T19:20:00.790205] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-28T19:20:01.132422] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-28T19:20:01.132623] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-28T19:20:01.133750] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-28T19:20:01.133829] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-28T19:20:01.135722] [DEBUG] [LOCAL ] HUM: Trimmed 71063 records to 48986 (keeping 200 days of data) [2025-10-28T19:20:01.379639] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:20:01.480459] [DEBUG] [LOCAL ] HUM: Primary data saved (48986 records). [2025-10-28T19:20:01.480600] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-28T19:20:01.481799] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUM took 27.4s. Estimated remaining: 2h 50m 42s. Rate: 7.6 symbols/min [2025-10-28T19:20:01.585392] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-28T19:20:01.656541] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:01.672963] [DEBUG] [LOCAL ] HVT: Loaded 14524 existing records from primary storage. [2025-10-28T19:20:01.673184] [INFO ] [MAIN ] HVT: Loaded 14524 existing records. [2025-10-28T19:20:01.853937] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:01.854152] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-28T19:20:01.854198] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-28T19:20:01.854365] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-28T19:20:01.854403] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-28T19:20:02.279270] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:02.282102] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T19:20:02.380306] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-28T19:20:02.788027] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T19:20:03.180307] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-28T19:20:03.373026] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:20:03.980224] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-28T19:20:04.305581] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T19:20:04.780302] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-28T19:20:05.254866] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T19:20:05.472492] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:20:05.580249] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-28T19:20:06.380269] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-28T19:20:07.180224] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-28T19:20:07.388200] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T19:20:07.396760] [INFO ] [REMOTE ] HUBS: Full fetch complete (57117 records). [2025-10-28T19:20:07.396893] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-28T19:20:07.792241] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-28T19:20:07.792457] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-28T19:20:07.793615] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-28T19:20:07.793732] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-28T19:20:07.795333] [DEBUG] [LOCAL ] HUBS: Trimmed 57117 records to 39593 (keeping 200 days of data) [2025-10-28T19:20:07.917957] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T19:20:08.022918] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T19:20:08.023004] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-28T19:20:08.098960] [DEBUG] [LOCAL ] HUBS: Primary data saved (39593 records). [2025-10-28T19:20:08.099097] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-28T19:20:08.099176] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUBS took 41.3s. Estimated remaining: 2h 50m 33s. Rate: 7.6 symbols/min [2025-10-28T19:20:08.275311] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:08.324888] [DEBUG] [LOCAL ] HWM: Loaded 52655 existing records from primary storage. [2025-10-28T19:20:08.325204] [INFO ] [MAIN ] HWM: Loaded 52655 existing records. [2025-10-28T19:20:08.510602] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:08.510846] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-28T19:20:08.510927] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-28T19:20:08.511853] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-28T19:20:08.511913] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-28T19:20:08.785523] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-28T19:20:08.885853] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:09.526521] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T19:20:09.580258] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-28T19:20:09.981440] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:20:10.380307] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-28T19:20:11.180226] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-28T19:20:11.501822] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T19:20:11.716169] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:20:11.885540] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:20:11.980226] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-28T19:20:12.780263] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-28T19:20:13.580226] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-28T19:20:13.638733] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T19:20:13.650006] [INFO ] [REMOTE ] HUN: Full fetch complete (77037 records). [2025-10-28T19:20:13.650151] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-28T19:20:14.070090] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-28T19:20:14.070326] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-28T19:20:14.071715] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-28T19:20:14.072998] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T19:20:14.073088] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-28T19:20:14.083519] [DEBUG] [LOCAL ] HUN: Trimmed 77037 records to 53207 (keeping 200 days of data) [2025-10-28T19:20:14.380517] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-28T19:20:14.401614] [DEBUG] [LOCAL ] HUN: Primary data saved (53207 records). [2025-10-28T19:20:14.402087] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-28T19:20:14.413836] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HUN took 32.2s. Estimated remaining: 2h 50m 23s. Rate: 7.6 symbols/min [2025-10-28T19:20:14.480963] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T19:20:14.597567] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:14.641887] [DEBUG] [LOCAL ] HXL: Loaded 45823 existing records from primary storage. [2025-10-28T19:20:14.642199] [INFO ] [MAIN ] HXL: Loaded 45823 existing records. [2025-10-28T19:20:14.847183] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:14.847416] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-28T19:20:14.847498] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-28T19:20:14.847713] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-28T19:20:14.847769] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-28T19:20:15.182358] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-28T19:20:15.206036] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:15.716328] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T19:20:15.726406] [INFO ] [REMOTE ] HUYA: Full fetch complete (64076 records). [2025-10-28T19:20:15.736573] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-28T19:20:15.737490] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:20:15.985538] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-28T19:20:16.152525] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-28T19:20:16.152605] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-28T19:20:16.153500] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-28T19:20:16.153562] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-28T19:20:16.154775] [DEBUG] [LOCAL ] HUYA: Trimmed 64076 records to 43540 (keeping 200 days of data) [2025-10-28T19:20:16.394627] [DEBUG] [LOCAL ] HUYA: Primary data saved (43540 records). [2025-10-28T19:20:16.394771] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-28T19:20:16.394849] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HUYA took 32.7s. Estimated remaining: 2h 50m 8s. Rate: 7.6 symbols/min [2025-10-28T19:20:16.561532] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:16.571121] [DEBUG] [LOCAL ] HY: Loaded 9594 existing records from primary storage. [2025-10-28T19:20:16.571315] [INFO ] [MAIN ] HY: Loaded 9594 existing records. [2025-10-28T19:20:16.750942] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:16.751149] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-28T19:20:16.751197] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-28T19:20:16.751453] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-28T19:20:16.751493] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-28T19:20:16.785559] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-28T19:20:17.124113] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:17.423339] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:20:17.580263] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-28T19:20:17.905302] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:20:18.260875] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T19:20:18.380240] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-28T19:20:19.180287] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-28T19:20:19.757396] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:20:19.758337] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T19:20:19.980333] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-28T19:20:20.780309] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-28T19:20:21.436633] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:20:21.515258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T19:20:21.580214] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-28T19:20:22.141579] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T19:20:22.380264] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-28T19:20:22.977338] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T19:20:23.180307] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-28T19:20:23.980259] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-28T19:20:24.285152] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:20:24.780268] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-28T19:20:25.395069] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T19:20:25.418411] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T19:20:25.580310] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-28T19:20:26.162978] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T19:20:26.380258] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-28T19:20:27.180259] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-28T19:20:27.520515] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:20:27.765859] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T19:20:27.980286] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-28T19:20:28.494056] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:20:28.780259] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-28T19:20:29.580243] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-28T19:20:29.616921] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:20:29.620053] [INFO ] [REMOTE ] HVT: Full fetch complete (22896 records). [2025-10-28T19:20:29.620154] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-28T19:20:29.986796] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-28T19:20:29.986887] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-28T19:20:29.987394] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-28T19:20:29.987454] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-28T19:20:29.988231] [DEBUG] [LOCAL ] HVT: Trimmed 22896 records to 14478 (keeping 200 days of data) [2025-10-28T19:20:30.074192] [DEBUG] [LOCAL ] HVT: Primary data saved (14478 records). [2025-10-28T19:20:30.074328] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-28T19:20:30.074404] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HVT took 28.6s. Estimated remaining: 2h 50m 7s. Rate: 7.6 symbols/min [2025-10-28T19:20:30.242532] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:30.242740] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-28T19:20:30.242785] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-28T19:20:30.242896] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-28T19:20:30.242936] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-28T19:20:30.242989] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-28T19:20:30.243053] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-28T19:20:30.389021] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-28T19:20:30.616549] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:30.782248] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:20:30.918832] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T19:20:31.180226] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-28T19:20:31.396262] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-28T19:20:31.980292] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-28T19:20:32.780280] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-28T19:20:33.164800] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:20:33.580249] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-28T19:20:34.047932] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:20:34.065344] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T19:20:34.380256] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-28T19:20:35.180246] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-28T19:20:35.698013] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T19:20:35.985434] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-28T19:20:36.002533] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T19:20:36.780253] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-28T19:20:37.215060] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:20:37.580256] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-28T19:20:38.222366] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:20:38.380252] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-28T19:20:38.724496] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T19:20:39.180321] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-28T19:20:39.816899] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T19:20:39.980233] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-28T19:20:40.257684] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:20:40.504756] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T19:20:40.780251] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-28T19:20:41.018616] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:20:41.580228] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-28T19:20:42.380245] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-28T19:20:42.647085] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:20:43.180247] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-28T19:20:43.354578] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-10-28T19:20:43.980221] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-28T19:20:44.049192] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T19:20:44.059612] [INFO ] [REMOTE ] HWM: Full fetch complete (76600 records). [2025-10-28T19:20:44.059800] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-28T19:20:44.443456] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-28T19:20:44.443543] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-28T19:20:44.444606] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-28T19:20:44.444695] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-28T19:20:44.446165] [DEBUG] [LOCAL ] HWM: Trimmed 76600 records to 52640 (keeping 200 days of data) [2025-10-28T19:20:44.679219] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:20:44.683529] [INFO ] [REMOTE ] HY: Full fetch complete (14740 records). [2025-10-28T19:20:44.684111] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-28T19:20:44.785324] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-28T19:20:45.163227] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-28T19:20:45.167670] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-28T19:20:45.168018] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-28T19:20:45.168089] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-28T19:20:45.174416] [DEBUG] [LOCAL ] HWM: Primary data saved (52640 records). [2025-10-28T19:20:45.174743] [DEBUG] [LOCAL ] HY: Trimmed 14740 records to 9548 (keeping 200 days of data) [2025-10-28T19:20:45.174831] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-28T19:20:45.175161] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HWM took 37.1s. Estimated remaining: 2h 50m 8s. Rate: 7.6 symbols/min [2025-10-28T19:20:45.361806] [DEBUG] [LOCAL ] HY: Primary data saved (9548 records). [2025-10-28T19:20:45.375600] [INFO ] [MAIN ] HY: Full history saved. [2025-10-28T19:20:45.382956] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HY took 29.0s. Estimated remaining: 2h 49m 51s. Rate: 7.6 symbols/min [2025-10-28T19:20:45.481829] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:45.497582] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-28T19:20:45.505681] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-28T19:20:45.508041] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-28T19:20:45.508134] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-28T19:20:45.508201] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-28T19:20:45.508505] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-28T19:20:45.585699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-28T19:20:45.648144] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:45.761507] [DEBUG] [LOCAL ] HYI: Loaded 9485 existing records from primary storage. [2025-10-28T19:20:45.779769] [INFO ] [MAIN ] HYI: Loaded 9485 existing records. [2025-10-28T19:20:45.930834] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T19:20:46.154757] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:46.178248] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:46.178702] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-28T19:20:46.178849] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-28T19:20:46.179705] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-28T19:20:46.179838] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-28T19:20:46.387631] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-28T19:20:46.465737] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T19:20:46.513764] [INFO ] [REMOTE ] HXL: Full fetch complete (66764 records). [2025-10-28T19:20:46.524231] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-28T19:20:46.668443] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:46.719210] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T19:20:46.977910] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-28T19:20:46.977996] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-28T19:20:46.978931] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-28T19:20:46.978994] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-28T19:20:46.980372] [DEBUG] [LOCAL ] HXL: Trimmed 66764 records to 45798 (keeping 200 days of data) [2025-10-28T19:20:47.184349] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-28T19:20:47.250805] [DEBUG] [LOCAL ] HXL: Primary data saved (45798 records). [2025-10-28T19:20:47.251032] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-28T19:20:47.251119] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HXL took 32.8s. Estimated remaining: 2h 49m 36s. Rate: 7.6 symbols/min [2025-10-28T19:20:47.419292] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:47.447966] [DEBUG] [LOCAL ] HYT: Loaded 33156 existing records from primary storage. [2025-10-28T19:20:47.448225] [INFO ] [MAIN ] HYT: Loaded 33156 existing records. [2025-10-28T19:20:47.626246] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:47.626599] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-28T19:20:47.626690] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-28T19:20:47.627342] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-28T19:20:47.627399] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-28T19:20:47.737811] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T19:20:47.985612] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-28T19:20:47.990393] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:48.255931] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-28T19:20:48.780247] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-28T19:20:48.945850] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.17 seconds). [2025-10-28T19:20:49.580293] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-28T19:20:49.806673] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T19:20:50.380337] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-28T19:20:50.643881] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-28T19:20:51.180277] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-28T19:20:51.980235] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-28T19:20:52.067844] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:20:52.281092] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:20:52.780250] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-28T19:20:52.956975] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-28T19:20:53.580260] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-28T19:20:53.745795] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-10-28T19:20:54.380266] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-28T19:20:55.180301] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-28T19:20:55.268637] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:20:55.671706] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T19:20:55.672515] [INFO ] [REMOTE ] HYAC: Full fetch complete (907 records). [2025-10-28T19:20:55.672581] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-28T19:20:55.869321] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-28T19:20:55.869534] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:20:55.869619] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:20:55.869733] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-28T19:20:55.869809] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-28T19:20:55.869846] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-28T19:20:55.869886] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-28T19:20:55.869945] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYAC took 25.8s. Estimated remaining: 2h 49m 29s. Rate: 7.6 symbols/min [2025-10-28T19:20:55.983672] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-28T19:20:56.054855] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:56.059442] [DEBUG] [LOCAL ] HYTR: Loaded 3094 existing records from primary storage. [2025-10-28T19:20:56.059607] [INFO ] [MAIN ] HYTR: Loaded 3094 existing records. [2025-10-28T19:20:56.249156] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:56.252232] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-28T19:20:56.252089] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T19:20:56.253437] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-28T19:20:56.253687] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-28T19:20:56.253745] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-28T19:20:56.609402] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:56.780207] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-28T19:20:57.041195] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T19:20:57.580324] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-28T19:20:57.897106] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T19:20:58.380221] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-28T19:20:59.180279] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-28T19:20:59.459211] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:20:59.505143] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T19:20:59.980275] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-28T19:21:00.464681] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:21:00.780257] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-28T19:21:01.580264] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-28T19:21:01.796637] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:21:02.059973] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:21:02.380258] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-28T19:21:02.740967] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T19:21:03.180270] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-28T19:21:03.980253] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-28T19:21:04.046317] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T19:21:04.194573] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-28T19:21:04.780282] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-28T19:21:05.301295] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:21:05.580287] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-28T19:21:05.946140] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:21:06.380268] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-28T19:21:06.635048] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T19:21:07.180250] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-28T19:21:07.512406] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T19:21:07.980261] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-28T19:21:08.780257] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-28T19:21:08.970960] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:21:09.100922] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-28T19:21:09.580239] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-28T19:21:10.380232] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-28T19:21:10.533565] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T19:21:10.714077] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-28T19:21:11.180344] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-28T19:21:11.980355] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-28T19:21:12.267550] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T19:21:12.443883] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T19:21:12.780281] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-28T19:21:13.222868] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T19:21:13.580238] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-28T19:21:13.802829] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T19:21:14.380323] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-28T19:21:14.858611] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:21:15.180247] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-28T19:21:15.384533] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-10-28T19:21:15.980298] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-28T19:21:16.780293] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-28T19:21:16.938017] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T19:21:17.107404] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T19:21:17.580246] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-28T19:21:17.893896] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T19:21:18.380296] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-28T19:21:18.738913] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T19:21:18.739634] [INFO ] [REMOTE ] HYBX: Full fetch complete (702 records). [2025-10-28T19:21:18.739738] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-28T19:21:18.994473] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-28T19:21:18.994682] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:21:18.994753] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:21:18.994846] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-28T19:21:18.994932] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-28T19:21:18.994970] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-28T19:21:18.995010] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-28T19:21:18.995104] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYBX took 33.8s. Estimated remaining: 2h 49m 39s. Rate: 7.6 symbols/min [2025-10-28T19:21:19.189436] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-28T19:21:19.192747] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:19.220540] [DEBUG] [LOCAL ] HZO: Loaded 28097 existing records from primary storage. [2025-10-28T19:21:19.220820] [INFO ] [MAIN ] HZO: Loaded 28097 existing records. [2025-10-28T19:21:19.398001] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:19.398206] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-28T19:21:19.398273] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-28T19:21:19.398922] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-28T19:21:19.398979] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-28T19:21:19.758470] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:19.980264] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-28T19:21:20.378339] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:21:20.386539] [INFO ] [REMOTE ] HYT: Full fetch complete (47863 records). [2025-10-28T19:21:20.386794] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-28T19:21:20.770059] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T19:21:20.780703] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-28T19:21:20.789962] [INFO ] [REMOTE ] HYTR: Full fetch complete (4702 records). [2025-10-28T19:21:20.809807] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-28T19:21:20.875720] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-28T19:21:20.904860] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-28T19:21:20.938111] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-28T19:21:20.941323] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-28T19:21:21.041497] [DEBUG] [LOCAL ] HYT: Trimmed 47863 records to 33000 (keeping 200 days of data) [2025-10-28T19:21:21.328020] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-28T19:21:21.328889] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-28T19:21:21.340186] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-28T19:21:21.342283] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:21:21.342373] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-28T19:21:21.366025] [DEBUG] [LOCAL ] HYTR: Trimmed 4702 records to 3090 (keeping 200 days of data) [2025-10-28T19:21:21.459564] [DEBUG] [LOCAL ] HYTR: Primary data saved (3090 records). [2025-10-28T19:21:21.463056] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-28T19:21:21.464735] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HYTR took 25.6s. Estimated remaining: 2h 49m 25s. Rate: 7.6 symbols/min [2025-10-28T19:21:21.554673] [DEBUG] [LOCAL ] HYT: Primary data saved (33000 records). [2025-10-28T19:21:21.566687] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-28T19:21:21.571933] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. HYT took 34.3s. Estimated remaining: 2h 49m 8s. Rate: 7.6 symbols/min [2025-10-28T19:21:21.585079] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-28T19:21:21.674302] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:21.681916] [DEBUG] [LOCAL ] IAE: Loaded 6415 existing records from primary storage. [2025-10-28T19:21:21.682085] [INFO ] [MAIN ] IAE: Loaded 6415 existing records. [2025-10-28T19:21:21.869207] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:21.869425] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-28T19:21:21.869475] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-28T19:21:21.869732] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-28T19:21:21.869791] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-28T19:21:22.242421] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:22.386553] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-28T19:21:22.388546] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:21:22.780152] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T19:21:23.180301] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-28T19:21:23.953747] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:21:23.956582] [INFO ] [REMOTE ] HYI: Full fetch complete (14057 records). [2025-10-28T19:21:23.956688] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-28T19:21:23.986718] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-28T19:21:24.315184] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-28T19:21:24.315278] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-28T19:21:24.315619] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-28T19:21:24.315699] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-28T19:21:24.316195] [DEBUG] [LOCAL ] HYI: Trimmed 14057 records to 9430 (keeping 200 days of data) [2025-10-28T19:21:24.373183] [DEBUG] [LOCAL ] HYI: Primary data saved (9430 records). [2025-10-28T19:21:24.373310] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-28T19:21:24.373387] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HYI took 39.0s. Estimated remaining: 2h 48m 54s. Rate: 7.6 symbols/min [2025-10-28T19:21:24.787406] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-28T19:21:24.789414] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:21:25.228270] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T19:21:25.580242] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-28T19:21:25.984896] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T19:21:26.380259] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-28T19:21:26.778036] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T19:21:27.180250] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-28T19:21:27.980228] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-28T19:21:28.058143] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:21:28.348309] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:21:28.780312] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-28T19:21:29.166055] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T19:21:29.580283] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-28T19:21:29.990686] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T19:21:30.380284] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-28T19:21:31.180370] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-28T19:21:31.256789] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T19:21:31.644073] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T19:21:31.980317] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-28T19:21:32.780228] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-28T19:21:32.873102] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:21:33.178212] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:21:33.580245] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-28T19:21:34.042926] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T19:21:34.380294] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-28T19:21:35.055797] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T19:21:35.058104] [INFO ] [REMOTE ] IAE: Full fetch complete (9183 records). [2025-10-28T19:21:35.058174] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-28T19:21:35.185444] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-28T19:21:35.416948] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-28T19:21:35.417023] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-28T19:21:35.417233] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-28T19:21:35.417270] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-28T19:21:35.417679] [DEBUG] [LOCAL ] IAE: Trimmed 9183 records to 6432 (keeping 200 days of data) [2025-10-28T19:21:35.452864] [DEBUG] [LOCAL ] IAE: Primary data saved (6432 records). [2025-10-28T19:21:35.452948] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-28T19:21:35.453020] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAE took 14.0s. Estimated remaining: 2h 48m 50s. Rate: 7.6 symbols/min [2025-10-28T19:21:36.177742] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:21:36.183734] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-28T19:21:36.949008] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:21:36.955611] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-28T19:21:37.731394] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T19:21:37.740176] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-28T19:21:38.565464] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T19:21:38.571526] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-28T19:21:39.437840] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:21:39.443298] [INFO ] [REMOTE ] HZO: Full fetch complete (41331 records). [2025-10-28T19:21:39.443458] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-28T19:21:39.835472] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-28T19:21:39.835563] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-28T19:21:39.836408] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-28T19:21:39.836472] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-28T19:21:39.837526] [DEBUG] [LOCAL ] HZO: Trimmed 41331 records to 28055 (keeping 200 days of data) [2025-10-28T19:21:39.995723] [DEBUG] [LOCAL ] HZO: Primary data saved (28055 records). [2025-10-28T19:21:39.995856] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-28T19:21:39.995932] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. HZO took 21.0s. Estimated remaining: 2h 48m 38s. Rate: 7.6 symbols/min [2025-10-28T19:21:40.641401] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.707806] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.701451] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.704554] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.783615] [DEBUG] [LOCAL ] IBP: Loaded 28251 existing records from primary storage. [2025-10-28T19:21:40.797279] [INFO ] [MAIN ] IBP: Loaded 28251 existing records. [2025-10-28T19:21:40.799855] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-28T19:21:40.844723] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-28T19:21:40.856745] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-28T19:21:40.896146] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-28T19:21:41.017851] [DEBUG] [LOCAL ] IBN: Loaded 52799 existing records from primary storage. [2025-10-28T19:21:41.104940] [INFO ] [MAIN ] IBN: Loaded 52799 existing records. [2025-10-28T19:21:41.364855] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.530219] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.542316] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-28T19:21:41.533814] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.618625] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.622014] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-28T19:21:41.621883] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.625140] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-28T19:21:41.625102] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-28T19:21:41.624979] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.625562] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.625633] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-28T19:21:41.625748] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-28T19:21:41.642568] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-28T19:21:41.626098] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.747489] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-28T19:21:41.723839] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-28T19:21:41.784133] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-28T19:21:41.832744] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-28T19:21:41.951226] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-28T19:21:42.941492] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:42.994744] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-28T19:21:43.019254] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:43.085992] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-28T19:21:43.140429] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:43.140899] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-28T19:21:43.136793] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:43.141963] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-28T19:21:43.839211] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T19:21:43.844232] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-28T19:21:44.285663] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T19:21:44.296076] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-28T19:21:44.465154] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:21:44.475704] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-28T19:21:44.586840] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:21:44.625633] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:21:44.780241] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-28T19:21:45.543057] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:21:45.580233] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-28T19:21:45.636556] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:21:46.170792] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:21:46.380242] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-28T19:21:46.819859] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:21:47.180301] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-28T19:21:47.828002] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T19:21:47.980240] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-28T19:21:48.482748] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:21:48.780231] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-28T19:21:49.580207] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-28T19:21:49.652743] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T19:21:50.208170] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T19:21:50.380248] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-28T19:21:50.867346] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T19:21:51.180325] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-28T19:21:51.285626] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:21:51.980325] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-28T19:21:52.640003] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:21:52.780260] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-28T19:21:53.265998] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T19:21:53.580263] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-28T19:21:54.122540] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T19:21:54.380305] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-28T19:21:54.818770] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:21:55.105414] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T19:21:55.180245] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-28T19:21:55.980249] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-28T19:21:56.021568] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:21:56.780327] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-28T19:21:57.304585] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:21:57.580319] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-28T19:21:58.335622] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T19:21:58.380248] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-28T19:21:58.900870] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T19:21:59.180317] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-28T19:21:59.900929] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T19:21:59.980247] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-28T19:22:00.458832] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:22:00.779586] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T19:22:00.785321] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-28T19:22:01.580315] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-28T19:22:02.380241] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-28T19:22:02.521226] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T19:22:02.939741] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:22:03.180233] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-28T19:22:03.310921] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T19:22:03.980261] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-28T19:22:04.780222] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-28T19:22:04.922917] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T19:22:04.934618] [INFO ] [REMOTE ] IAG: Full fetch complete (77529 records). [2025-10-28T19:22:04.934816] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-28T19:22:05.252070] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:22:05.456777] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-28T19:22:05.456875] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-28T19:22:05.457984] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-28T19:22:05.458051] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-28T19:22:05.459734] [DEBUG] [LOCAL ] IAG: Trimmed 77529 records to 53492 (keeping 200 days of data) [2025-10-28T19:22:05.582266] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-28T19:22:05.890275] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-28T19:22:05.890458] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-28T19:22:05.891668] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. IAG took 25.9s. Estimated remaining: 2h 48m 51s. Rate: 7.6 symbols/min [2025-10-28T19:22:06.077482] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:06.116309] [DEBUG] [LOCAL ] IBTA: Loaded 35583 existing records from primary storage. [2025-10-28T19:22:06.116733] [INFO ] [MAIN ] IBTA: Loaded 35583 existing records. [2025-10-28T19:22:06.306122] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:06.306354] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-28T19:22:06.306402] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-28T19:22:06.306803] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-28T19:22:06.306862] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-28T19:22:06.385360] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-28T19:22:06.675144] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:06.710039] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-28T19:22:06.852713] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:22:07.180297] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-28T19:22:07.308749] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:22:07.980254] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-28T19:22:08.562012] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T19:22:08.780256] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-28T19:22:09.022510] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T19:22:09.028825] [INFO ] [REMOTE ] IBP: Full fetch complete (41122 records). [2025-10-28T19:22:09.029018] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-28T19:22:09.427140] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-28T19:22:09.427245] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-28T19:22:09.428536] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-28T19:22:09.428602] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-28T19:22:09.430040] [DEBUG] [LOCAL ] IBP: Trimmed 41122 records to 28152 (keeping 200 days of data) [2025-10-28T19:22:09.584290] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-28T19:22:09.619775] [DEBUG] [LOCAL ] IBP: Primary data saved (28152 records). [2025-10-28T19:22:09.620362] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-28T19:22:09.620496] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBP took 29.6s. Estimated remaining: 2h 48m 38s. Rate: 7.6 symbols/min [2025-10-28T19:22:09.829681] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:09.887665] [DEBUG] [LOCAL ] ICE: Loaded 53009 existing records from primary storage. [2025-10-28T19:22:09.888112] [INFO ] [MAIN ] ICE: Loaded 53009 existing records. [2025-10-28T19:22:10.071894] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:10.072205] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-28T19:22:10.072257] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-28T19:22:10.072682] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-28T19:22:10.072744] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-28T19:22:10.385817] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-28T19:22:10.459969] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:10.608737] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-28T19:22:11.161242] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T19:22:11.172120] [INFO ] [REMOTE ] IBN: Full fetch complete (76656 records). [2025-10-28T19:22:11.172247] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-28T19:22:11.186234] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-28T19:22:11.486424] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:22:11.663896] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-28T19:22:11.664006] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-28T19:22:11.665185] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-28T19:22:11.665251] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-28T19:22:11.667228] [DEBUG] [LOCAL ] IBN: Trimmed 76656 records to 52793 (keeping 200 days of data) [2025-10-28T19:22:11.994704] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-28T19:22:12.020130] [DEBUG] [LOCAL ] IBN: Primary data saved (52793 records). [2025-10-28T19:22:12.020274] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-28T19:22:12.020357] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IBN took 32.0s. Estimated remaining: 2h 48m 24s. Rate: 7.6 symbols/min [2025-10-28T19:22:12.223094] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:12.260601] [DEBUG] [LOCAL ] ICL: Loaded 37737 existing records from primary storage. [2025-10-28T19:22:12.260962] [INFO ] [MAIN ] ICL: Loaded 37737 existing records. [2025-10-28T19:22:12.472928] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:12.473370] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-28T19:22:12.473495] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-28T19:22:12.473988] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-28T19:22:12.474137] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-28T19:22:12.782770] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-28T19:22:12.830432] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T19:22:12.924908] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:13.580310] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-28T19:22:13.659910] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:22:14.040445] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-28T19:22:14.051483] [INFO ] [REMOTE ] IBM: Full fetch complete (77744 records). [2025-10-28T19:22:14.051683] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-28T19:22:14.390087] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-28T19:22:14.452563] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-28T19:22:14.452700] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-28T19:22:14.453890] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-28T19:22:14.453969] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-28T19:22:14.455440] [DEBUG] [LOCAL ] IBM: Trimmed 77744 records to 53628 (keeping 200 days of data) [2025-10-28T19:22:14.692552] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:22:14.819376] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-28T19:22:14.819515] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-28T19:22:14.819878] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBM took 34.8s. Estimated remaining: 2h 48m 10s. Rate: 7.6 symbols/min [2025-10-28T19:22:14.986874] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:15.023051] [DEBUG] [LOCAL ] IDA: Loaded 32500 existing records from primary storage. [2025-10-28T19:22:15.023307] [INFO ] [MAIN ] IDA: Loaded 32500 existing records. [2025-10-28T19:22:15.195155] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-28T19:22:15.199786] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:15.200611] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-28T19:22:15.200689] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-28T19:22:15.200964] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-28T19:22:15.201021] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-28T19:22:15.555478] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:15.616520] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T19:22:15.980322] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-28T19:22:16.150902] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:22:16.780292] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-28T19:22:17.222957] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T19:22:17.580309] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-28T19:22:17.965577] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:22:18.380423] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-28T19:22:18.922415] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:22:19.180286] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-28T19:22:19.465271] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:22:19.980254] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-28T19:22:20.336528] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:22:20.780279] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-28T19:22:21.399352] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:22:21.580246] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-28T19:22:21.727507] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T19:22:22.380287] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-28T19:22:22.806875] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:22:23.180239] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-28T19:22:23.335877] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T19:22:23.985424] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-28T19:22:24.000793] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T19:22:24.780226] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-28T19:22:24.853816] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T19:22:25.580314] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-28T19:22:25.977958] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T19:22:26.380248] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-28T19:22:26.382618] [DEBUG] [REMOTE ] IDA: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T19:22:26.382723] [WARN ] [REMOTE ] IDA: No data returned for month 2025-03 [2025-10-28T19:22:26.382808] [FATAL] [REMOTE ] IDA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:22:26.382875] [FATAL] [MAIN ] IDA: Failed to fetch primary data. [2025-10-28T19:22:26.382946] [WARN ] [MAIN ] IDA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:22:26.383028] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-28T19:22:26.383106] [DEBUG] [LOCAL ] IDA: No primary data file found to delete. [2025-10-28T19:22:26.383154] [INFO ] [LOCAL ] IDA: Starting deletion of derivative data. [2025-10-28T19:22:26.384297] [DEBUG] [LOCAL ] IDA: Deleted derivative data file. [2025-10-28T19:22:26.384375] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. IDA took 11.6s. Estimated remaining: 2h 48m 7s. Rate: 7.6 symbols/min [2025-10-28T19:22:26.563680] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:26.575227] [DEBUG] [LOCAL ] IDE: Loaded 9081 existing records from primary storage. [2025-10-28T19:22:26.575446] [INFO ] [MAIN ] IDE: Loaded 9081 existing records. [2025-10-28T19:22:26.753174] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:26.753382] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-28T19:22:26.753460] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-28T19:22:26.753593] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-28T19:22:26.753631] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-28T19:22:27.127591] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:27.180267] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-28T19:22:27.488966] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:22:27.636492] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T19:22:27.980305] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-28T19:22:28.424330] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T19:22:28.780319] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-28T19:22:29.549556] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T19:22:29.580252] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-28T19:22:30.380260] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-28T19:22:30.927578] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:22:31.180245] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-28T19:22:31.307287] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T19:22:31.980243] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-28T19:22:32.517246] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:22:32.780234] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-28T19:22:32.894968] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:22:33.580268] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-28T19:22:34.088969] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:22:34.380243] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-28T19:22:34.441692] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T19:22:34.758220] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T19:22:35.180237] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-28T19:22:35.980266] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-28T19:22:36.380466] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:22:36.499151] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:22:36.780273] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-28T19:22:37.580289] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-28T19:22:37.859126] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:22:38.070157] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T19:22:38.380332] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-28T19:22:38.892735] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T19:22:39.180289] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-28T19:22:39.716112] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T19:22:39.980244] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-28T19:22:40.490731] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T19:22:40.780252] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-28T19:22:41.580250] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-28T19:22:41.934952] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:22:41.946095] [INFO ] [REMOTE ] IBTA: Full fetch complete (51094 records). [2025-10-28T19:22:41.946322] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-28T19:22:42.359435] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-28T19:22:42.359531] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-28T19:22:42.360327] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-28T19:22:42.360392] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-28T19:22:42.361544] [DEBUG] [LOCAL ] IBTA: Trimmed 51094 records to 35416 (keeping 200 days of data) [2025-10-28T19:22:42.411346] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-28T19:22:42.575550] [DEBUG] [LOCAL ] IBTA: Primary data saved (35416 records). [2025-10-28T19:22:42.575715] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-28T19:22:42.575806] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. IBTA took 36.7s. Estimated remaining: 2h 48m 9s. Rate: 7.6 symbols/min [2025-10-28T19:22:42.756240] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:42.775609] [DEBUG] [LOCAL ] IDT: Loaded 18504 existing records from primary storage. [2025-10-28T19:22:42.775888] [INFO ] [MAIN ] IDT: Loaded 18504 existing records. [2025-10-28T19:22:43.035449] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:43.035982] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-28T19:22:43.036185] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-28T19:22:43.036445] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-28T19:22:43.036604] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-28T19:22:43.185229] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-28T19:22:43.381426] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T19:22:43.458166] [INFO ] [REMOTE ] ICE: Full fetch complete (77024 records). [2025-10-28T19:22:43.457589] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:43.458892] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-28T19:22:43.561172] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T19:22:43.819013] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T19:22:43.911316] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-28T19:22:43.911410] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-28T19:22:43.912816] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-28T19:22:43.912897] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-28T19:22:43.915143] [DEBUG] [LOCAL ] ICE: Trimmed 77024 records to 53007 (keeping 200 days of data) [2025-10-28T19:22:44.004000] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-28T19:22:44.241890] [DEBUG] [LOCAL ] ICE: Primary data saved (53007 records). [2025-10-28T19:22:44.242019] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-28T19:22:44.242412] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. ICE took 34.6s. Estimated remaining: 2h 47m 53s. Rate: 7.6 symbols/min [2025-10-28T19:22:44.412568] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:44.453382] [DEBUG] [LOCAL ] IEX: Loaded 37995 existing records from primary storage. [2025-10-28T19:22:44.453667] [INFO ] [MAIN ] IEX: Loaded 37995 existing records. [2025-10-28T19:22:44.654997] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:22:44.654688] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:44.657954] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-28T19:22:44.658016] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-28T19:22:44.658480] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-28T19:22:44.658540] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-28T19:22:44.785386] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-28T19:22:45.036451] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:45.580263] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-28T19:22:46.037767] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T19:22:46.047168] [INFO ] [REMOTE ] ICL: Full fetch complete (55601 records). [2025-10-28T19:22:46.047344] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-28T19:22:46.356210] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T19:22:46.375263] [INFO ] [REMOTE ] IDE: Full fetch complete (12797 records). [2025-10-28T19:22:46.404402] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-28T19:22:46.385693] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-28T19:22:46.529543] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-28T19:22:46.546022] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-28T19:22:46.565202] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-28T19:22:46.567446] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-28T19:22:46.618793] [DEBUG] [LOCAL ] ICL: Trimmed 55601 records to 37606 (keeping 200 days of data) [2025-10-28T19:22:46.947773] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-28T19:22:46.950024] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-28T19:22:46.958556] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-28T19:22:46.958787] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-28T19:22:47.003440] [DEBUG] [LOCAL ] IDE: Trimmed 12797 records to 9108 (keeping 200 days of data) [2025-10-28T19:22:47.043446] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T19:22:47.120708] [DEBUG] [LOCAL ] ICL: Primary data saved (37606 records). [2025-10-28T19:22:47.126438] [DEBUG] [LOCAL ] IDE: Primary data saved (9108 records). [2025-10-28T19:22:47.126638] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-28T19:22:47.126768] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-28T19:22:47.126890] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. ICL took 35.1s. Estimated remaining: 2h 47m 40s. Rate: 7.6 symbols/min [2025-10-28T19:22:47.138265] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IDE took 20.8s. Estimated remaining: 2h 47m 23s. Rate: 7.6 symbols/min [2025-10-28T19:22:47.200994] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-28T19:22:47.432908] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:47.487385] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:47.506201] [DEBUG] [LOCAL ] IFN: Loaded 18180 existing records from primary storage. [2025-10-28T19:22:47.506454] [INFO ] [MAIN ] IFN: Loaded 18180 existing records. [2025-10-28T19:22:47.714892] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:47.730265] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-28T19:22:47.730361] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-28T19:22:47.731781] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-28T19:22:47.731867] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-28T19:22:47.731995] [DEBUG] [LOCAL ] IFF: Loaded 51193 existing records from primary storage. [2025-10-28T19:22:47.801824] [INFO ] [MAIN ] IFF: Loaded 51193 existing records. [2025-10-28T19:22:47.994449] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-28T19:22:48.184137] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:48.208157] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-28T19:22:48.232793] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-28T19:22:48.241424] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-28T19:22:48.247262] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-28T19:22:48.285438] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:22:48.367581] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:48.693042] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:48.780220] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-28T19:22:49.112104] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:22:49.326668] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T19:22:49.580259] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-28T19:22:50.354826] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:22:50.380211] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-28T19:22:51.050132] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:22:51.180238] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-28T19:22:51.832422] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:22:51.980253] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-28T19:22:52.780219] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-28T19:22:52.839994] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T19:22:53.580248] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-28T19:22:54.189213] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T19:22:54.225408] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T19:22:54.380265] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-28T19:22:55.180244] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-28T19:22:55.492633] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:22:55.856069] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:22:55.980270] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-28T19:22:56.780266] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-28T19:22:57.175361] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:22:57.524108] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T19:22:57.580283] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-28T19:22:58.380281] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-28T19:22:58.720398] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T19:22:59.180268] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-28T19:22:59.980325] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-28T19:23:00.780360] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-28T19:23:04.256080] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (5.88 seconds). [2025-10-28T19:23:04.260980] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-28T19:23:04.760416] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (5.58 seconds). [2025-10-28T19:23:04.765024] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-28T19:23:05.539999] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (4.76 seconds). [2025-10-28T19:23:05.548227] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-28T19:23:05.729110] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (5.75 seconds). [2025-10-28T19:23:05.739802] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-28T19:23:06.012421] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T19:23:06.017584] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-28T19:23:06.345577] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T19:23:06.349684] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-28T19:23:06.744743] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:23:06.749879] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-28T19:23:07.097033] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:23:07.181812] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-28T19:23:07.184882] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T19:23:07.387344] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T19:23:07.488211] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-28T19:23:07.980231] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-28T19:23:08.012107] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T19:23:08.016804] [INFO ] [REMOTE ] IDT: Full fetch complete (24243 records). [2025-10-28T19:23:08.016884] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-28T19:23:08.396258] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-28T19:23:08.396347] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-28T19:23:08.396947] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-28T19:23:08.397010] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-28T19:23:08.397750] [DEBUG] [LOCAL ] IDT: Trimmed 24243 records to 18480 (keeping 200 days of data) [2025-10-28T19:23:08.519014] [DEBUG] [LOCAL ] IDT: Primary data saved (18480 records). [2025-10-28T19:23:08.519165] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-28T19:23:08.519254] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IDT took 25.9s. Estimated remaining: 2h 47m 31s. Rate: 7.6 symbols/min [2025-10-28T19:23:08.693958] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:08.706053] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T19:23:08.731514] [DEBUG] [LOCAL ] IFS: Loaded 21676 existing records from primary storage. [2025-10-28T19:23:08.731873] [INFO ] [MAIN ] IFS: Loaded 21676 existing records. [2025-10-28T19:23:08.786473] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-28T19:23:08.914293] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:08.914518] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-28T19:23:08.914563] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-28T19:23:08.914819] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-28T19:23:08.914876] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-28T19:23:09.260034] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:09.580258] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-28T19:23:10.060205] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T19:23:10.380258] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-28T19:23:10.641013] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:23:11.180242] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-28T19:23:11.701346] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:23:11.856394] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:23:11.980276] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-28T19:23:12.754355] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:23:12.780232] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-28T19:23:13.580318] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-28T19:23:13.692835] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:23:14.380333] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-28T19:23:14.946741] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T19:23:15.180252] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-28T19:23:15.237126] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T19:23:15.241375] [INFO ] [REMOTE ] IFN: Full fetch complete (28013 records). [2025-10-28T19:23:15.241505] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-28T19:23:15.625598] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-28T19:23:15.625703] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-28T19:23:15.626362] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-28T19:23:15.626425] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-28T19:23:15.627254] [DEBUG] [LOCAL ] IFN: Trimmed 28013 records to 18129 (keeping 200 days of data) [2025-10-28T19:23:15.735906] [DEBUG] [LOCAL ] IFN: Primary data saved (18129 records). [2025-10-28T19:23:15.736047] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-28T19:23:15.736149] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IFN took 28.5s. Estimated remaining: 2h 47m 22s. Rate: 7.6 symbols/min [2025-10-28T19:23:15.901790] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:15.913138] [DEBUG] [LOCAL ] IGA: Loaded 9709 existing records from primary storage. [2025-10-28T19:23:15.913333] [INFO ] [MAIN ] IGA: Loaded 9709 existing records. [2025-10-28T19:23:15.980682] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-28T19:23:16.097699] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:16.097917] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-28T19:23:16.097968] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-28T19:23:16.098116] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-28T19:23:16.098157] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-28T19:23:16.487771] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:16.785880] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-28T19:23:16.808547] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T19:23:16.875351] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T19:23:17.580326] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-28T19:23:17.908458] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:23:18.380219] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-28T19:23:18.503517] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T19:23:19.180239] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-28T19:23:19.404227] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:23:19.985164] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-28T19:23:19.987323] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T19:23:20.780268] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-28T19:23:21.268347] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T19:23:21.275888] [INFO ] [REMOTE ] IEX: Full fetch complete (53903 records). [2025-10-28T19:23:21.275987] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-28T19:23:21.393751] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T19:23:21.585470] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-28T19:23:21.712150] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-28T19:23:21.712221] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-28T19:23:21.713032] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-28T19:23:21.713094] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-28T19:23:21.714207] [DEBUG] [LOCAL ] IEX: Trimmed 53903 records to 37974 (keeping 200 days of data) [2025-10-28T19:23:21.955072] [DEBUG] [LOCAL ] IEX: Primary data saved (37974 records). [2025-10-28T19:23:21.955247] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-28T19:23:21.955785] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IEX took 37.7s. Estimated remaining: 2h 47m 12s. Rate: 7.6 symbols/min [2025-10-28T19:23:22.143594] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:22.150324] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T19:23:22.169257] [DEBUG] [LOCAL ] IGD: Loaded 19075 existing records from primary storage. [2025-10-28T19:23:22.169499] [INFO ] [MAIN ] IGD: Loaded 19075 existing records. [2025-10-28T19:23:22.340390] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:22.340600] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-28T19:23:22.340669] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-28T19:23:22.340890] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-28T19:23:22.340931] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-28T19:23:22.385526] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-28T19:23:22.693582] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:23.122754] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T19:23:23.180215] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-28T19:23:23.953319] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T19:23:23.980208] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-28T19:23:24.722298] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T19:23:24.780249] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-28T19:23:25.580259] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-28T19:23:26.062423] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:23:26.230617] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T19:23:26.380219] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-28T19:23:27.180264] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-28T19:23:27.854514] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T19:23:27.865778] [INFO ] [REMOTE ] IFF: Full fetch complete (73809 records). [2025-10-28T19:23:27.865925] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-28T19:23:27.981892] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-28T19:23:28.146928] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:23:28.178518] [INFO ] [REMOTE ] IFS: Full fetch complete (32302 records). [2025-10-28T19:23:28.188924] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-28T19:23:28.447535] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-28T19:23:28.448251] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-28T19:23:28.513497] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-28T19:23:28.538051] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-28T19:23:28.588473] [DEBUG] [LOCAL ] IFF: Trimmed 73809 records to 51191 (keeping 200 days of data) [2025-10-28T19:23:28.776809] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-28T19:23:28.779530] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-28T19:23:28.779966] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-28T19:23:28.780067] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-28T19:23:28.784290] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-28T19:23:28.796276] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T19:23:28.797873] [DEBUG] [LOCAL ] IFS: Trimmed 32302 records to 21632 (keeping 200 days of data) [2025-10-28T19:23:29.054236] [DEBUG] [LOCAL ] IFS: Primary data saved (21632 records). [2025-10-28T19:23:29.062689] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-28T19:23:29.063268] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IFS took 20.5s. Estimated remaining: 2h 47m 3s. Rate: 7.6 symbols/min [2025-10-28T19:23:29.258191] [DEBUG] [LOCAL ] IFF: Primary data saved (51191 records). [2025-10-28T19:23:29.276153] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-28T19:23:29.289286] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IFF took 42.2s. Estimated remaining: 2h 46m 47s. Rate: 7.6 symbols/min [2025-10-28T19:23:29.322982] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:29.420984] [DEBUG] [LOCAL ] IGI: Loaded 4108 existing records from primary storage. [2025-10-28T19:23:29.436733] [INFO ] [MAIN ] IGI: Loaded 4108 existing records. [2025-10-28T19:23:29.561855] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:29.593434] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-28T19:23:29.680819] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:29.681341] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-28T19:23:29.681432] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-28T19:23:29.681756] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-28T19:23:29.682022] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-28T19:23:29.835431] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:23:29.836614] [DEBUG] [LOCAL ] IGR: Loaded 30163 existing records from primary storage. [2025-10-28T19:23:29.880273] [INFO ] [MAIN ] IGR: Loaded 30163 existing records. [2025-10-28T19:23:30.254607] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T19:23:30.254022] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:30.297749] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-28T19:23:30.308323] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-28T19:23:30.317177] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-28T19:23:30.317367] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-28T19:23:30.385505] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-28T19:23:30.406796] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:30.703247] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:31.180276] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-28T19:23:31.214451] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T19:23:31.572219] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:23:31.980258] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-28T19:23:32.780230] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-28T19:23:32.921129] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:23:33.183186] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T19:23:33.580250] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-28T19:23:34.030668] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:23:34.380298] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-28T19:23:35.180242] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-28T19:23:35.468798] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:23:35.980223] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-28T19:23:36.727092] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:23:36.780239] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-28T19:23:36.859141] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T19:23:37.228227] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T19:23:37.580264] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-28T19:23:38.212726] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:23:38.380279] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-28T19:23:39.180239] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-28T19:23:39.221577] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T19:23:39.661232] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T19:23:39.980367] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-28T19:23:40.508318] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:23:40.780260] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-28T19:23:41.580239] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-28T19:23:41.782591] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T19:23:42.380249] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-28T19:23:42.449797] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T19:23:42.684885] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T19:23:43.180250] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-28T19:23:43.505172] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T19:23:43.980246] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-28T19:23:44.413719] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T19:23:44.780256] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-28T19:23:45.580288] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-28T19:23:45.753139] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T19:23:46.269574] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T19:23:46.272386] [INFO ] [REMOTE ] IGA: Full fetch complete (14247 records). [2025-10-28T19:23:46.272478] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-28T19:23:46.385370] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-28T19:23:46.630331] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-28T19:23:46.630407] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-28T19:23:46.630761] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-28T19:23:46.630822] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-28T19:23:46.631322] [DEBUG] [LOCAL ] IGA: Trimmed 14247 records to 9667 (keeping 200 days of data) [2025-10-28T19:23:46.688050] [DEBUG] [LOCAL ] IGA: Primary data saved (9667 records). [2025-10-28T19:23:46.688193] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-28T19:23:46.688320] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IGA took 31.0s. Estimated remaining: 2h 46m 50s. Rate: 7.6 symbols/min [2025-10-28T19:23:46.862115] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:46.867253] [DEBUG] [LOCAL ] IH: Loaded 2674 existing records from primary storage. [2025-10-28T19:23:46.867410] [INFO ] [MAIN ] IH: Loaded 2674 existing records. [2025-10-28T19:23:47.042945] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:47.043187] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-28T19:23:47.043238] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-28T19:23:47.043397] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-28T19:23:47.043454] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-28T19:23:47.185378] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-28T19:23:47.410625] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:47.499024] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T19:23:47.980320] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-28T19:23:48.351282] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:23:48.780249] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-28T19:23:49.159520] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T19:23:49.287668] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-28T19:23:49.580242] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-28T19:23:49.988304] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T19:23:50.380317] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-28T19:23:51.180314] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-28T19:23:51.222629] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:23:51.783016] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:23:51.980258] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-28T19:23:52.780275] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-28T19:23:52.819334] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:23:52.824464] [INFO ] [REMOTE ] IGD: Full fetch complete (30081 records). [2025-10-28T19:23:52.824571] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-28T19:23:53.217701] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-28T19:23:53.217875] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-28T19:23:53.218961] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-28T19:23:53.219031] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-28T19:23:53.220396] [DEBUG] [LOCAL ] IGD: Trimmed 30081 records to 19113 (keeping 200 days of data) [2025-10-28T19:23:53.309358] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:23:53.349123] [DEBUG] [LOCAL ] IGD: Primary data saved (19113 records). [2025-10-28T19:23:53.349336] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-28T19:23:53.349441] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGD took 31.4s. Estimated remaining: 2h 46m 41s. Rate: 7.6 symbols/min [2025-10-28T19:23:53.537056] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:53.547714] [DEBUG] [LOCAL ] IHD: Loaded 7348 existing records from primary storage. [2025-10-28T19:23:53.548061] [INFO ] [MAIN ] IHD: Loaded 7348 existing records. [2025-10-28T19:23:53.585472] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-28T19:23:53.740081] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:53.740285] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-28T19:23:53.740330] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-28T19:23:53.740512] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-28T19:23:53.740569] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-28T19:23:54.087763] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:54.380256] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-28T19:23:54.443305] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T19:23:54.777190] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T19:23:55.180268] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-28T19:23:55.552088] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:23:55.980285] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-28T19:23:56.534587] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T19:23:56.780252] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-28T19:23:57.309385] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:23:57.580247] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-28T19:23:58.062025] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:23:58.380308] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-28T19:23:58.751986] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:23:59.180249] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-28T19:23:59.464508] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-28T19:23:59.980260] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-28T19:24:00.780343] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-28T19:24:01.525553] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:24:01.580306] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-28T19:24:01.780207] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T19:24:02.212841] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:24:02.380278] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-28T19:24:03.180234] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-28T19:24:03.273408] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:24:03.275178] [INFO ] [REMOTE ] IGI: Full fetch complete (5570 records). [2025-10-28T19:24:03.275248] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-28T19:24:03.539069] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T19:24:03.650179] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-28T19:24:03.650263] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-28T19:24:03.650426] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-28T19:24:03.650464] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-28T19:24:03.650875] [DEBUG] [LOCAL ] IGI: Trimmed 5570 records to 4082 (keeping 200 days of data) [2025-10-28T19:24:03.677907] [DEBUG] [LOCAL ] IGI: Primary data saved (4082 records). [2025-10-28T19:24:03.678060] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-28T19:24:03.678155] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IGI took 34.6s. Estimated remaining: 2h 46m 35s. Rate: 7.6 symbols/min [2025-10-28T19:24:03.856173] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:03.881732] [DEBUG] [LOCAL ] IHG: Loaded 23569 existing records from primary storage. [2025-10-28T19:24:03.882008] [INFO ] [MAIN ] IHG: Loaded 23569 existing records. [2025-10-28T19:24:03.985529] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-28T19:24:04.093904] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:04.094210] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-28T19:24:04.094264] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-28T19:24:04.094721] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-28T19:24:04.094783] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-28T19:24:04.437154] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:04.567212] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:24:04.780262] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-28T19:24:05.580266] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-28T19:24:06.380284] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-28T19:24:06.403911] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:24:06.427220] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T19:24:06.771585] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T19:24:07.180238] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-28T19:24:07.797593] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:24:07.980285] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-28T19:24:08.734513] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T19:24:08.780291] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-28T19:24:09.357496] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:24:09.580296] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-28T19:24:09.964871] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T19:24:10.380300] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-28T19:24:11.022520] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:24:11.180255] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-28T19:24:11.527414] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T19:24:11.980259] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-28T19:24:12.477981] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T19:24:12.479123] [INFO ] [REMOTE ] IH: Full fetch complete (5061 records). [2025-10-28T19:24:12.479190] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-28T19:24:12.785497] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-28T19:24:12.854038] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-28T19:24:12.854116] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-28T19:24:12.854291] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-28T19:24:12.854350] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-28T19:24:12.854740] [DEBUG] [LOCAL ] IH: Trimmed 5061 records to 2664 (keeping 200 days of data) [2025-10-28T19:24:12.870134] [DEBUG] [LOCAL ] IH: Primary data saved (2664 records). [2025-10-28T19:24:12.870199] [INFO ] [MAIN ] IH: Full history saved. [2025-10-28T19:24:12.870268] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IH took 26.2s. Estimated remaining: 2h 46m 29s. Rate: 7.6 symbols/min [2025-10-28T19:24:13.043965] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:13.077955] [DEBUG] [LOCAL ] IHS: Loaded 36888 existing records from primary storage. [2025-10-28T19:24:13.078220] [INFO ] [MAIN ] IHS: Loaded 36888 existing records. [2025-10-28T19:24:13.252337] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:13.252526] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-28T19:24:13.252570] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-28T19:24:13.252883] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-28T19:24:13.252938] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-28T19:24:13.581537] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-28T19:24:13.610288] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:13.710705] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T19:24:14.380279] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-28T19:24:14.589281] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T19:24:15.180315] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-28T19:24:15.456368] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:24:15.840137] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T19:24:15.842573] [INFO ] [REMOTE ] IHD: Full fetch complete (11687 records). [2025-10-28T19:24:15.842682] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-28T19:24:15.985453] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-28T19:24:16.206363] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-28T19:24:16.206439] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-28T19:24:16.206781] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-28T19:24:16.206854] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-28T19:24:16.207277] [DEBUG] [LOCAL ] IHD: Trimmed 11687 records to 7342 (keeping 200 days of data) [2025-10-28T19:24:16.249751] [DEBUG] [LOCAL ] IHD: Primary data saved (7342 records). [2025-10-28T19:24:16.249883] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-28T19:24:16.249963] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IHD took 22.9s. Estimated remaining: 2h 46m 16s. Rate: 7.6 symbols/min [2025-10-28T19:24:16.419316] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:16.426487] [DEBUG] [LOCAL ] IIF: Loaded 5028 existing records from primary storage. [2025-10-28T19:24:16.426735] [INFO ] [MAIN ] IIF: Loaded 5028 existing records. [2025-10-28T19:24:16.599885] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:16.600085] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-28T19:24:16.600131] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-28T19:24:16.600281] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-28T19:24:16.600336] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-28T19:24:16.789325] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-28T19:24:16.970833] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:17.127162] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T19:24:17.133962] [INFO ] [REMOTE ] IGR: Full fetch complete (44470 records). [2025-10-28T19:24:17.134091] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-28T19:24:17.568549] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-28T19:24:17.569369] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-28T19:24:17.570273] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-28T19:24:17.570352] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-28T19:24:17.571446] [DEBUG] [LOCAL ] IGR: Trimmed 44470 records to 30039 (keeping 200 days of data) [2025-10-28T19:24:17.623856] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-28T19:24:17.763729] [DEBUG] [LOCAL ] IGR: Primary data saved (30039 records). [2025-10-28T19:24:17.778066] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-28T19:24:17.778891] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IGR took 48.5s. Estimated remaining: 2h 46m 1s. Rate: 7.6 symbols/min [2025-10-28T19:24:17.779472] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T19:24:17.978516] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:17.994861] [DEBUG] [LOCAL ] IIIN: Loaded 16087 existing records from primary storage. [2025-10-28T19:24:17.995111] [INFO ] [MAIN ] IIIN: Loaded 16087 existing records. [2025-10-28T19:24:18.168172] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:18.168372] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-28T19:24:18.168419] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-28T19:24:18.168602] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-28T19:24:18.168673] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-28T19:24:18.384379] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-28T19:24:18.544061] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:18.560680] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:24:19.180228] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-28T19:24:19.329167] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T19:24:19.800139] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:24:19.980259] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-28T19:24:20.780298] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-28T19:24:21.087260] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:24:21.354725] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:24:21.580303] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-28T19:24:22.380233] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-28T19:24:22.520892] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T19:24:22.823029] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T19:24:23.180304] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-28T19:24:23.567787] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T19:24:23.980351] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-28T19:24:24.780320] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-28T19:24:25.284520] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:24:25.580243] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-28T19:24:25.616856] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T19:24:26.262875] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T19:24:26.380309] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-28T19:24:27.114672] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T19:24:27.180249] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-28T19:24:27.980277] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-28T19:24:28.013934] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:24:28.785189] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-28T19:24:28.791549] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T19:24:29.201602] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T19:24:29.580309] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-28T19:24:29.924375] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T19:24:30.380349] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-28T19:24:31.180243] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-28T19:24:31.530168] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T19:24:31.939722] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T19:24:31.980321] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-28T19:24:32.543337] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T19:24:32.780324] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-28T19:24:33.580293] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-28T19:24:33.787058] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T19:24:34.037434] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T19:24:34.380248] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-28T19:24:35.180238] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-28T19:24:35.420518] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:24:35.980285] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-28T19:24:36.522110] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:24:36.780236] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-28T19:24:36.979515] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:24:37.585003] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-28T19:24:37.589071] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T19:24:37.965400] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T19:24:38.380260] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-28T19:24:38.801057] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T19:24:38.802220] [INFO ] [REMOTE ] IIF: Full fetch complete (8728 records). [2025-10-28T19:24:38.802287] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-28T19:24:39.171537] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-28T19:24:39.171620] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-28T19:24:39.171912] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-28T19:24:39.171973] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-28T19:24:39.172420] [DEBUG] [LOCAL ] IIF: Trimmed 8728 records to 4964 (keeping 200 days of data) [2025-10-28T19:24:39.184277] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-28T19:24:39.202467] [DEBUG] [LOCAL ] IIF: Primary data saved (4964 records). [2025-10-28T19:24:39.202541] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-28T19:24:39.202613] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IIF took 23.0s. Estimated remaining: 2h 46m 9s. Rate: 7.6 symbols/min [2025-10-28T19:24:39.371419] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:39.387978] [DEBUG] [LOCAL ] IIM: Loaded 15363 existing records from primary storage. [2025-10-28T19:24:39.388196] [INFO ] [MAIN ] IIM: Loaded 15363 existing records. [2025-10-28T19:24:39.563784] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:39.564006] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-28T19:24:39.564054] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-28T19:24:39.564326] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-28T19:24:39.564394] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-28T19:24:39.921982] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:39.980224] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-28T19:24:40.033118] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:24:40.780252] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-28T19:24:41.029988] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:24:41.035008] [INFO ] [REMOTE ] IHG: Full fetch complete (34605 records). [2025-10-28T19:24:41.035122] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-28T19:24:41.407910] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-28T19:24:41.408047] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-28T19:24:41.408875] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-28T19:24:41.408944] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-28T19:24:41.410072] [DEBUG] [LOCAL ] IHG: Trimmed 34605 records to 23472 (keeping 200 days of data) [2025-10-28T19:24:41.520302] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T19:24:41.572993] [DEBUG] [LOCAL ] IHG: Primary data saved (23472 records). [2025-10-28T19:24:41.573113] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-28T19:24:41.573189] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IHG took 37.9s. Estimated remaining: 2h 45m 54s. Rate: 7.6 symbols/min [2025-10-28T19:24:41.585377] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-28T19:24:41.748017] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:41.777238] [DEBUG] [LOCAL ] IIPR: Loaded 28414 existing records from primary storage. [2025-10-28T19:24:41.777480] [INFO ] [MAIN ] IIPR: Loaded 28414 existing records. [2025-10-28T19:24:41.961603] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:41.961782] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-28T19:24:41.961827] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-28T19:24:41.962218] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-28T19:24:41.962276] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-28T19:24:42.313124] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:42.380217] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-28T19:24:42.643411] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:24:43.180274] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-28T19:24:43.419465] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T19:24:43.425783] [INFO ] [REMOTE ] IHS: Full fetch complete (51473 records). [2025-10-28T19:24:43.425923] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-28T19:24:43.796259] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-28T19:24:43.796335] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-28T19:24:43.797119] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-28T19:24:43.797179] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-28T19:24:43.798302] [DEBUG] [LOCAL ] IHS: Trimmed 51473 records to 36825 (keeping 200 days of data) [2025-10-28T19:24:43.896938] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:24:43.983553] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-28T19:24:44.011947] [DEBUG] [LOCAL ] IHS: Primary data saved (36825 records). [2025-10-28T19:24:44.012065] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-28T19:24:44.012140] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IHS took 31.1s. Estimated remaining: 2h 45m 40s. Rate: 7.6 symbols/min [2025-10-28T19:24:44.181831] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:44.220492] [DEBUG] [LOCAL ] IMAX: Loaded 43361 existing records from primary storage. [2025-10-28T19:24:44.220816] [INFO ] [MAIN ] IMAX: Loaded 43361 existing records. [2025-10-28T19:24:44.399048] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:44.399240] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-28T19:24:44.399289] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-28T19:24:44.399731] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-28T19:24:44.399789] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-28T19:24:44.764498] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:24:44.763991] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:44.780204] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-28T19:24:45.580220] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-28T19:24:45.693286] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:24:46.312877] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:24:46.380204] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-28T19:24:47.150002] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T19:24:47.180247] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-28T19:24:47.735477] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:24:47.980232] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-28T19:24:48.639676] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T19:24:48.780256] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-28T19:24:49.310909] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T19:24:49.580228] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-28T19:24:50.380307] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-28T19:24:50.688673] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:24:51.050094] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:24:51.180261] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-28T19:24:51.931586] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:24:51.980221] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-28T19:24:52.754355] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:24:52.757869] [INFO ] [REMOTE ] IIM: Full fetch complete (24597 records). [2025-10-28T19:24:52.757945] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-28T19:24:52.790445] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-28T19:24:53.168738] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-28T19:24:53.168837] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-28T19:24:53.169581] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-28T19:24:53.169669] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-28T19:24:53.170631] [DEBUG] [LOCAL ] IIM: Trimmed 24597 records to 15240 (keeping 200 days of data) [2025-10-28T19:24:53.309263] [DEBUG] [LOCAL ] IIM: Primary data saved (15240 records). [2025-10-28T19:24:53.309445] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-28T19:24:53.309588] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IIM took 14.1s. Estimated remaining: 2h 45m 34s. Rate: 7.6 symbols/min [2025-10-28T19:24:53.555890] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:53.588240] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-28T19:24:53.616860] [DEBUG] [LOCAL ] INFA: Loaded 48355 existing records from primary storage. [2025-10-28T19:24:53.617253] [INFO ] [MAIN ] INFA: Loaded 48355 existing records. [2025-10-28T19:24:53.866564] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:53.866978] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-28T19:24:53.867069] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-28T19:24:53.867688] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-28T19:24:53.867862] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-28T19:24:54.018593] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T19:24:54.294757] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:54.337918] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T19:24:54.380256] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-28T19:24:55.180252] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-28T19:24:55.886911] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T19:24:55.980217] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-28T19:24:56.197387] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:24:56.780267] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-28T19:24:57.166746] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:24:57.294480] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T19:24:57.580257] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-28T19:24:58.380247] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-28T19:24:59.020903] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:24:59.180272] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-28T19:24:59.443608] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T19:24:59.980313] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-28T19:25:00.665503] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T19:25:00.780273] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-28T19:25:00.999063] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T19:25:01.004447] [INFO ] [REMOTE ] IIIN: Full fetch complete (24950 records). [2025-10-28T19:25:01.004555] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-28T19:25:01.374890] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-28T19:25:01.374975] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-28T19:25:01.375495] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-28T19:25:01.375534] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-28T19:25:01.376427] [DEBUG] [LOCAL ] IIIN: Trimmed 24950 records to 15939 (keeping 200 days of data) [2025-10-28T19:25:01.484035] [DEBUG] [LOCAL ] IIIN: Primary data saved (15939 records). [2025-10-28T19:25:01.484184] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-28T19:25:01.484264] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. IIIN took 43.7s. Estimated remaining: 2h 45m 27s. Rate: 7.6 symbols/min [2025-10-28T19:25:01.585496] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-28T19:25:01.700279] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:01.760571] [DEBUG] [LOCAL ] INFY: Loaded 53595 existing records from primary storage. [2025-10-28T19:25:01.760984] [INFO ] [MAIN ] INFY: Loaded 53595 existing records. [2025-10-28T19:25:01.953441] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:01.953717] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-28T19:25:01.953796] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-28T19:25:01.954558] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-28T19:25:01.954627] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-28T19:25:02.365872] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:02.380242] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-28T19:25:02.820175] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-28T19:25:03.180213] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-28T19:25:03.240223] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T19:25:03.819358] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T19:25:03.980248] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-28T19:25:04.364357] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:25:04.780336] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-28T19:25:05.401836] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T19:25:05.580244] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-28T19:25:05.919538] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T19:25:06.380318] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-28T19:25:06.928124] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:25:07.180266] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-28T19:25:07.490781] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:25:07.980276] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-28T19:25:08.582715] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T19:25:08.780337] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-28T19:25:09.580257] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-28T19:25:09.617322] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T19:25:10.184529] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T19:25:10.380274] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-28T19:25:10.659138] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T19:25:11.180249] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-28T19:25:11.652601] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:25:11.980276] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-28T19:25:12.171897] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:25:12.780286] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-28T19:25:13.110488] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T19:25:13.580281] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-28T19:25:13.934605] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:25:14.380267] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-28T19:25:15.180299] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-28T19:25:15.226520] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:25:15.326919] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T19:25:15.980298] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-28T19:25:16.550244] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T19:25:16.780230] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-28T19:25:16.882511] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:25:17.580270] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-28T19:25:17.925148] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T19:25:18.380256] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-28T19:25:18.921036] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:25:19.180273] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-28T19:25:19.950622] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T19:25:19.959272] [INFO ] [REMOTE ] INFA: Full fetch complete (70633 records). [2025-10-28T19:25:19.959449] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-28T19:25:19.991948] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-28T19:25:20.373544] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-28T19:25:20.373695] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-28T19:25:20.374823] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-28T19:25:20.374988] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-28T19:25:20.376818] [DEBUG] [LOCAL ] INFA: Trimmed 70633 records to 48282 (keeping 200 days of data) [2025-10-28T19:25:20.517121] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:25:20.735769] [DEBUG] [LOCAL ] INFA: Primary data saved (48282 records). [2025-10-28T19:25:20.735945] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-28T19:25:20.736066] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. INFA took 27.4s. Estimated remaining: 2h 45m 32s. Rate: 7.6 symbols/min [2025-10-28T19:25:20.789237] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-28T19:25:20.931607] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:20.978364] [DEBUG] [LOCAL ] ING: Loaded 50616 existing records from primary storage. [2025-10-28T19:25:20.978685] [INFO ] [MAIN ] ING: Loaded 50616 existing records. [2025-10-28T19:25:21.154632] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:21.154882] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-28T19:25:21.154929] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-28T19:25:21.155188] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-28T19:25:21.155233] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-28T19:25:21.526056] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:21.540470] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:25:21.580210] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-28T19:25:21.780505] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T19:25:22.380307] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-28T19:25:23.180254] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-28T19:25:23.220676] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T19:25:23.232085] [INFO ] [REMOTE ] INFY: Full fetch complete (77750 records). [2025-10-28T19:25:23.232256] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-28T19:25:23.653540] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-28T19:25:23.653719] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-28T19:25:23.654937] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-28T19:25:23.655041] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-28T19:25:23.674457] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T19:25:23.681256] [DEBUG] [LOCAL ] INFY: Trimmed 77750 records to 53594 (keeping 200 days of data) [2025-10-28T19:25:23.983254] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-28T19:25:24.010473] [DEBUG] [LOCAL ] INFY: Primary data saved (53594 records). [2025-10-28T19:25:24.010618] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-28T19:25:24.010765] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. INFY took 22.5s. Estimated remaining: 2h 45m 18s. Rate: 7.6 symbols/min [2025-10-28T19:25:24.187372] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:24.213497] [DEBUG] [LOCAL ] INGM: Loaded 27728 existing records from primary storage. [2025-10-28T19:25:24.213758] [INFO ] [MAIN ] INGM: Loaded 27728 existing records. [2025-10-28T19:25:24.346705] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T19:25:24.427125] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:24.427304] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-28T19:25:24.427361] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-28T19:25:24.427531] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-28T19:25:24.427567] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-28T19:25:24.768852] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:24.780207] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-28T19:25:25.206806] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:25:25.580217] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-28T19:25:26.156227] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:25:26.380297] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-28T19:25:26.742467] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:25:27.180283] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-28T19:25:27.269492] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:25:27.980262] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-28T19:25:28.403189] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:25:28.412560] [INFO ] [REMOTE ] IMAX: Full fetch complete (61392 records). [2025-10-28T19:25:28.412703] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-28T19:25:28.790027] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-28T19:25:28.793463] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-28T19:25:28.794754] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-28T19:25:28.795751] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-28T19:25:28.795929] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-28T19:25:28.797193] [DEBUG] [LOCAL ] IMAX: Trimmed 61392 records to 43353 (keeping 200 days of data) [2025-10-28T19:25:29.044132] [DEBUG] [LOCAL ] IMAX: Primary data saved (43353 records). [2025-10-28T19:25:29.044280] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-28T19:25:29.044394] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. IMAX took 45.0s. Estimated remaining: 2h 45m 7s. Rate: 7.6 symbols/min [2025-10-28T19:25:29.214528] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:29.246931] [DEBUG] [LOCAL ] INGR: Loaded 33584 existing records from primary storage. [2025-10-28T19:25:29.247216] [INFO ] [MAIN ] INGR: Loaded 33584 existing records. [2025-10-28T19:25:29.422343] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:29.422562] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-28T19:25:29.422620] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-28T19:25:29.422909] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-28T19:25:29.422966] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-28T19:25:29.588772] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-28T19:25:29.631053] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T19:25:29.807081] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:30.161003] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T19:25:30.380292] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-28T19:25:31.162188] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T19:25:31.169520] [INFO ] [REMOTE ] IIPR: Full fetch complete (43416 records). [2025-10-28T19:25:31.169767] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-28T19:25:31.185684] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-28T19:25:31.604822] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-28T19:25:31.615782] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-28T19:25:31.620801] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-28T19:25:31.621637] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-28T19:25:31.623988] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:25:31.633422] [DEBUG] [LOCAL ] IIPR: Trimmed 43416 records to 28323 (keeping 200 days of data) [2025-10-28T19:25:31.833387] [DEBUG] [LOCAL ] IIPR: Primary data saved (28323 records). [2025-10-28T19:25:31.833584] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-28T19:25:31.833734] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. IIPR took 50.3s. Estimated remaining: 2h 44m 54s. Rate: 7.6 symbols/min [2025-10-28T19:25:31.989351] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-28T19:25:32.024158] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:32.068456] [DEBUG] [LOCAL ] INN: Loaded 41159 existing records from primary storage. [2025-10-28T19:25:32.068887] [INFO ] [MAIN ] INN: Loaded 41159 existing records. [2025-10-28T19:25:32.271140] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:32.271817] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-28T19:25:32.271957] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-28T19:25:32.272614] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-28T19:25:32.272746] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-28T19:25:32.458832] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T19:25:32.692017] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:32.780245] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-28T19:25:32.880705] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:25:33.580345] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-28T19:25:33.691145] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:25:34.380222] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-28T19:25:34.585928] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:25:35.115608] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T19:25:35.180268] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-28T19:25:35.980308] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-28T19:25:36.508566] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:25:36.780267] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-28T19:25:36.848693] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T19:25:37.580256] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-28T19:25:38.162396] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T19:25:38.380237] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-28T19:25:38.447390] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:25:39.180310] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-28T19:25:39.846352] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T19:25:39.980243] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-28T19:25:40.785629] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-28T19:25:40.805071] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T19:25:41.294704] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-28T19:25:41.580307] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-28T19:25:41.825974] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:25:42.380254] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-28T19:25:43.180217] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-28T19:25:43.498947] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:25:43.713939] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-28T19:25:43.980229] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-28T19:25:44.039477] [DEBUG] [REMOTE ] ING: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-28T19:25:44.039828] [WARN ] [REMOTE ] ING: No data returned for month 2025-07 [2025-10-28T19:25:44.039915] [FATAL] [REMOTE ] ING: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:25:44.039996] [FATAL] [MAIN ] ING: Failed to fetch primary data. [2025-10-28T19:25:44.040056] [WARN ] [MAIN ] ING: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:25:44.040144] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-28T19:25:44.040206] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-28T19:25:44.040241] [INFO ] [LOCAL ] ING: Starting deletion of derivative data. [2025-10-28T19:25:44.040417] [DEBUG] [LOCAL ] ING: Deleted derivative data file. [2025-10-28T19:25:44.040499] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. ING took 23.3s. Estimated remaining: 2h 44m 51s. Rate: 7.6 symbols/min [2025-10-28T19:25:44.223694] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:44.223933] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-28T19:25:44.224032] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-28T19:25:44.224198] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-28T19:25:44.224366] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-28T19:25:44.224563] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-28T19:25:44.224680] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-28T19:25:44.310143] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:25:44.349242] [INFO ] [REMOTE ] INGM: Full fetch complete (41656 records). [2025-10-28T19:25:44.360238] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-28T19:25:44.789510] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-28T19:25:44.909934] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:44.996742] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-28T19:25:44.996838] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-28T19:25:44.997546] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-28T19:25:44.997585] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-28T19:25:44.998608] [DEBUG] [LOCAL ] INGM: Trimmed 41656 records to 27588 (keeping 200 days of data) [2025-10-28T19:25:45.161559] [DEBUG] [LOCAL ] INGM: Primary data saved (27588 records). [2025-10-28T19:25:45.161711] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-28T19:25:45.161800] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INGM took 21.2s. Estimated remaining: 2h 44m 35s. Rate: 7.6 symbols/min [2025-10-28T19:25:45.329530] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:45.365057] [DEBUG] [LOCAL ] INSP: Loaded 38599 existing records from primary storage. [2025-10-28T19:25:45.365361] [INFO ] [MAIN ] INSP: Loaded 38599 existing records. [2025-10-28T19:25:45.560481] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:45.560735] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-28T19:25:45.560794] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-28T19:25:45.561064] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-28T19:25:45.561123] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-28T19:25:45.592457] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-28T19:25:45.938889] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:45.941512] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T19:25:45.967633] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:25:46.380288] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-28T19:25:47.180285] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-28T19:25:47.980267] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-28T19:25:48.117505] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T19:25:48.780275] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-28T19:25:48.939316] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:25:49.239284] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-10-28T19:25:49.580276] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-28T19:25:49.709069] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T19:25:50.380272] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-28T19:25:50.622618] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T19:25:51.180229] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-28T19:25:51.290742] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:25:51.980288] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-28T19:25:52.099275] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:25:52.780240] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-28T19:25:52.992267] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T19:25:53.580249] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-28T19:25:53.792789] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T19:25:54.324895] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T19:25:54.380219] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-28T19:25:55.020041] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T19:25:55.180452] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-28T19:25:55.980246] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-28T19:25:56.152308] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T19:25:56.780310] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-28T19:25:57.437345] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:25:57.580258] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-28T19:25:57.704966] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T19:25:58.380280] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-28T19:25:58.452673] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T19:25:59.180266] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-28T19:25:59.985158] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-28T19:25:59.987401] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T19:26:00.780332] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-28T19:26:00.860307] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-28T19:26:00.880469] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:26:01.580291] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-28T19:26:01.718993] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:26:02.380258] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-28T19:26:03.180254] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-28T19:26:03.385111] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T19:26:03.950337] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-28T19:26:03.980226] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-28T19:26:04.780235] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-28T19:26:05.025382] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:26:05.071801] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-28T19:26:05.580320] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-28T19:26:06.019371] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:26:06.028854] [INFO ] [REMOTE ] INN: Full fetch complete (57602 records). [2025-10-28T19:26:06.029086] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-28T19:26:06.388093] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-28T19:26:06.463805] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-28T19:26:06.466439] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-28T19:26:06.467971] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-28T19:26:06.468768] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-28T19:26:06.468688] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T19:26:06.477305] [DEBUG] [LOCAL ] INN: Trimmed 57602 records to 41032 (keeping 200 days of data) [2025-10-28T19:26:06.707158] [DEBUG] [LOCAL ] INN: Primary data saved (41032 records). [2025-10-28T19:26:06.707285] [INFO ] [MAIN ] INN: Full history saved. [2025-10-28T19:26:06.708007] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INN took 34.9s. Estimated remaining: 2h 44m 43s. Rate: 7.6 symbols/min [2025-10-28T19:26:06.885723] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:06.923799] [DEBUG] [LOCAL ] INSW: Loaded 38828 existing records from primary storage. [2025-10-28T19:26:06.924078] [INFO ] [MAIN ] INSW: Loaded 38828 existing records. [2025-10-28T19:26:07.108806] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:07.109001] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-28T19:26:07.109047] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-28T19:26:07.109301] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-28T19:26:07.109405] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-28T19:26:07.185714] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-28T19:26:07.483640] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:07.594432] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:26:07.980296] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-28T19:26:08.346962] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:26:08.353425] [INFO ] [REMOTE ] INR: Full fetch complete (38052 records). [2025-10-28T19:26:08.353574] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-28T19:26:08.567371] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-28T19:26:08.568074] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:26:08.568156] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:26:08.568236] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-28T19:26:08.568320] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-28T19:26:08.568359] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-28T19:26:08.568399] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-28T19:26:08.568511] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INR took 24.5s. Estimated remaining: 2h 44m 28s. Rate: 7.6 symbols/min [2025-10-28T19:26:08.774905] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:08.780282] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-28T19:26:08.842425] [DEBUG] [LOCAL ] INVH: Loaded 53185 existing records from primary storage. [2025-10-28T19:26:08.842939] [INFO ] [MAIN ] INVH: Loaded 53185 existing records. [2025-10-28T19:26:09.043557] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:09.044709] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-28T19:26:09.044775] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-28T19:26:09.045133] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-28T19:26:09.045196] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-28T19:26:09.397492] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:26:09.446002] [INFO ] [REMOTE ] INGR: Full fetch complete (50814 records). [2025-10-28T19:26:09.463192] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-28T19:26:09.469253] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:09.585423] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-28T19:26:09.886784] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-28T19:26:09.886879] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-28T19:26:09.887867] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-28T19:26:09.887931] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-28T19:26:09.889108] [DEBUG] [LOCAL ] INGR: Trimmed 50814 records to 33548 (keeping 200 days of data) [2025-10-28T19:26:10.107638] [DEBUG] [LOCAL ] INGR: Primary data saved (33548 records). [2025-10-28T19:26:10.107816] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-28T19:26:10.107901] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INGR took 41.1s. Estimated remaining: 2h 44m 13s. Rate: 7.6 symbols/min [2025-10-28T19:26:10.279573] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:10.310463] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:26:10.341002] [DEBUG] [LOCAL ] INVX: Loaded 28642 existing records from primary storage. [2025-10-28T19:26:10.341259] [INFO ] [MAIN ] INVX: Loaded 28642 existing records. [2025-10-28T19:26:10.385492] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-28T19:26:10.516990] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:10.517224] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-28T19:26:10.517271] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-28T19:26:10.517452] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-28T19:26:10.517492] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-28T19:26:10.866847] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:10.899624] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:26:11.180303] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-28T19:26:11.652307] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T19:26:11.972538] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T19:26:11.980171] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-28T19:26:12.780241] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-28T19:26:12.806333] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T19:26:13.580271] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-28T19:26:13.908931] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:26:14.380240] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-28T19:26:14.651413] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:26:15.180258] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-28T19:26:15.484334] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:26:15.980217] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-28T19:26:16.011133] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T19:26:16.780262] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-28T19:26:17.264452] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:26:17.580244] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-28T19:26:17.707950] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T19:26:18.380277] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-28T19:26:19.180268] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-28T19:26:19.400226] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:26:19.980264] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-28T19:26:20.554713] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T19:26:20.564096] [INFO ] [REMOTE ] INSP: Full fetch complete (53958 records). [2025-10-28T19:26:20.564237] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-28T19:26:20.793895] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-28T19:26:21.014681] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-28T19:26:21.021604] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-28T19:26:21.033100] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-28T19:26:21.033219] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-28T19:26:21.035441] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:26:21.043237] [DEBUG] [LOCAL ] INSP: Trimmed 53958 records to 38628 (keeping 200 days of data) [2025-10-28T19:26:21.284252] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (3.70 seconds). [2025-10-28T19:26:21.311050] [DEBUG] [LOCAL ] INSP: Primary data saved (38628 records). [2025-10-28T19:26:21.311198] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-28T19:26:21.311283] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INSP took 36.1s. Estimated remaining: 2h 44m 9s. Rate: 7.6 symbols/min [2025-10-28T19:26:21.496313] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:21.548903] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-28T19:26:21.549269] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-28T19:26:21.585439] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-28T19:26:21.744123] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:21.744355] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-28T19:26:21.744426] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-28T19:26:21.745316] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-28T19:26:21.745375] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-28T19:26:22.105202] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:22.137293] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:26:22.380255] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-28T19:26:22.463001] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T19:26:23.180261] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-28T19:26:23.980231] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-28T19:26:24.367399] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:26:24.780244] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-28T19:26:25.580253] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-28T19:26:26.090816] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (3.71 seconds). [2025-10-28T19:26:26.136171] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-28T19:26:26.380213] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-28T19:26:26.581497] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:26:27.180265] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-28T19:26:27.954836] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (3.17 seconds). [2025-10-28T19:26:27.980211] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-28T19:26:28.780227] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-28T19:26:29.255719] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:26:29.580268] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-28T19:26:30.866981] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (3.69 seconds). [2025-10-28T19:26:30.875285] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-28T19:26:30.966794] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:26:31.180233] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-28T19:26:31.842694] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T19:26:31.980259] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-28T19:26:32.526568] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T19:26:32.780314] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-28T19:26:33.078155] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T19:26:33.195255] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (6.82 seconds). [2025-10-28T19:26:33.580260] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-28T19:26:34.380263] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-28T19:26:34.693499] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (5.91 seconds). [2025-10-28T19:26:35.180285] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-28T19:26:35.995162] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T19:26:36.001194] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-28T19:26:36.135637] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (3.36 seconds). [2025-10-28T19:26:36.146626] [INFO ] [REMOTE ] INVH: Full fetch complete (76987 records). [2025-10-28T19:26:36.146803] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-28T19:26:36.535267] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-28T19:26:36.535352] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-28T19:26:36.536435] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-28T19:26:36.536496] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-28T19:26:36.537889] [DEBUG] [LOCAL ] INVH: Trimmed 76987 records to 53180 (keeping 200 days of data) [2025-10-28T19:26:36.868533] [DEBUG] [LOCAL ] INVH: Primary data saved (53180 records). [2025-10-28T19:26:36.868766] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-28T19:26:36.868859] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INVH took 28.3s. Estimated remaining: 2h 44m 10s. Rate: 7.6 symbols/min [2025-10-28T19:26:37.056976] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:37.058408] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:26:37.064850] [INFO ] [REMOTE ] INVX: Full fetch complete (42464 records). [2025-10-28T19:26:37.065026] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-28T19:26:37.439128] [DEBUG] [LOCAL ] IOT: Loaded 53443 existing records from primary storage. [2025-10-28T19:26:37.458195] [INFO ] [MAIN ] IOT: Loaded 53443 existing records. [2025-10-28T19:26:37.558871] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-28T19:26:37.569935] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-28T19:26:37.571086] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-28T19:26:37.582060] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-28T19:26:37.623279] [DEBUG] [LOCAL ] INVX: Trimmed 42464 records to 28510 (keeping 200 days of data) [2025-10-28T19:26:37.740903] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:37.750606] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-28T19:26:37.776999] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-28T19:26:37.803252] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-28T19:26:37.806895] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-28T19:26:37.974223] [DEBUG] [LOCAL ] INVX: Primary data saved (28510 records). [2025-10-28T19:26:37.988707] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-28T19:26:37.988953] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. INVX took 27.9s. Estimated remaining: 2h 43m 54s. Rate: 7.6 symbols/min [2025-10-28T19:26:38.221159] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (3.84 seconds). [2025-10-28T19:26:38.257007] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-28T19:26:38.326228] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:38.326783] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-28T19:26:39.395009] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T19:26:39.402752] [INFO ] [REMOTE ] INSW: Full fetch complete (59008 records). [2025-10-28T19:26:39.402876] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-28T19:26:39.810303] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-28T19:26:39.810415] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-28T19:26:39.811476] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-28T19:26:39.811560] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-28T19:26:39.844296] [DEBUG] [LOCAL ] INSW: Trimmed 59008 records to 38711 (keeping 200 days of data) [2025-10-28T19:26:39.847241] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T19:26:39.908913] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-28T19:26:40.092242] [DEBUG] [LOCAL ] INSW: Primary data saved (38711 records). [2025-10-28T19:26:40.092452] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-28T19:26:40.093099] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. INSW took 33.4s. Estimated remaining: 2h 43m 40s. Rate: 7.6 symbols/min [2025-10-28T19:26:41.296728] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:26:41.307566] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-28T19:26:42.458056] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (8.88 seconds). [2025-10-28T19:26:42.469226] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-28T19:26:42.653248] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:26:42.664343] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-28T19:26:44.155004] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T19:26:44.166176] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-28T19:26:45.491712] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:26:45.504828] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-28T19:26:46.931046] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T19:26:46.942208] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-28T19:26:47.179006] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (4.71 seconds). [2025-10-28T19:26:47.191049] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-28T19:26:48.395429] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T19:26:48.415091] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-28T19:26:49.268716] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-28T19:26:49.287046] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-28T19:26:49.868349] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T19:26:49.882586] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-28T19:26:51.189571] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-28T19:26:51.201575] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-28T19:26:51.295748] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T19:26:51.307577] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-28T19:26:53.014053] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T19:26:53.025071] [INFO ] [REMOTE ] IOT: Full fetch complete (77517 records). [2025-10-28T19:26:53.025234] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-28T19:26:53.425621] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-28T19:26:53.425740] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-28T19:26:53.426821] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-28T19:26:53.426886] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-28T19:26:53.428287] [DEBUG] [LOCAL ] IOT: Trimmed 77517 records to 53440 (keeping 200 days of data) [2025-10-28T19:26:53.735923] [DEBUG] [LOCAL ] IOT: Primary data saved (53440 records). [2025-10-28T19:26:53.736045] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-28T19:26:53.736155] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IOT took 16.9s. Estimated remaining: 2h 43m 39s. Rate: 7.6 symbols/min [2025-10-28T19:26:55.953586] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (4.75 seconds). [2025-10-28T19:26:55.965314] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-28T19:26:58.250062] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-28T19:26:58.261408] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-28T19:27:00.302406] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-28T19:27:00.313933] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-28T19:27:02.584112] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-28T19:27:02.595228] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-28T19:27:02.595388] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-28T19:27:03.003476] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-28T19:27:03.003564] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-28T19:27:03.004609] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-28T19:27:03.004704] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-28T19:27:03.006352] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-28T19:27:03.320733] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-28T19:27:03.320857] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-28T19:27:03.320933] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IONQ took 42.0s. Estimated remaining: 2h 43m 33s. Rate: 7.6 symbols/min [2025-10-28T19:27:03.882554] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:03.956285] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:04.027281] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:04.045749] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:04.058617] [DEBUG] [LOCAL ] IQI: Loaded 17496 existing records from primary storage. [2025-10-28T19:27:04.058951] [INFO ] [MAIN ] IQI: Loaded 17496 existing records. [2025-10-28T19:27:04.222088] [DEBUG] [LOCAL ] IPI: Loaded 21303 existing records from primary storage. [2025-10-28T19:27:04.266679] [INFO ] [MAIN ] IPI: Loaded 21303 existing records. [2025-10-28T19:27:04.286192] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:04.347489] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-28T19:27:04.377085] [DEBUG] [LOCAL ] IP: Loaded 53297 existing records from primary storage. [2025-10-28T19:27:04.424603] [DEBUG] [LOCAL ] IPG: Loaded 53328 existing records from primary storage. [2025-10-28T19:27:04.393694] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-28T19:27:04.455574] [INFO ] [MAIN ] IPG: Loaded 53328 existing records. [2025-10-28T19:27:04.430244] [INFO ] [MAIN ] IP: Loaded 53297 existing records. [2025-10-28T19:27:04.526542] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-28T19:27:04.676749] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-28T19:27:04.732273] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:04.758917] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-28T19:27:04.759546] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-28T19:27:04.816690] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-28T19:27:04.847028] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-28T19:27:05.019750] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:05.067731] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:05.082302] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-28T19:27:05.086826] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-28T19:27:05.128333] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-28T19:27:05.123143] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-28T19:27:05.201561] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-28T19:27:05.173521] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-28T19:27:05.216400] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-28T19:27:05.215955] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-28T19:27:05.985514] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.030782] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-28T19:27:06.311062] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.355724] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-28T19:27:06.442357] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.454949] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-28T19:27:06.480203] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.480606] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-28T19:27:07.120039] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T19:27:07.123850] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-28T19:27:07.400144] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:27:07.404319] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-28T19:27:07.815115] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:27:07.825745] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-28T19:27:08.171560] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:27:08.177000] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-28T19:27:08.517050] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:27:08.521715] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-28T19:27:08.855499] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:27:08.859444] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-28T19:27:09.618942] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:27:09.624198] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-28T19:27:09.994945] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (3.54 seconds). [2025-10-28T19:27:10.005361] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-28T19:27:10.216164] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T19:27:10.220400] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-28T19:27:10.822464] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T19:27:10.826506] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-28T19:27:11.130817] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (3.31 seconds). [2025-10-28T19:27:11.140835] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-28T19:27:11.225693] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-28T19:27:11.231363] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-28T19:27:11.259086] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:27:11.269452] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-28T19:27:11.559419] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:27:11.563782] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-28T19:27:11.991447] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:27:11.996918] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-28T19:27:12.343362] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T19:27:12.348747] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-28T19:27:12.518743] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:27:12.530514] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-28T19:27:12.571907] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:27:12.584679] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-28T19:27:13.736860] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:27:13.741469] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-28T19:27:13.792318] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:27:13.804782] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-28T19:27:13.888700] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:27:13.901178] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-28T19:27:14.356919] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-28T19:27:14.363050] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-28T19:27:14.462346] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:27:14.465774] [INFO ] [REMOTE ] IQI: Full fetch complete (26042 records). [2025-10-28T19:27:14.465858] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-28T19:27:14.850299] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-28T19:27:14.850377] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-28T19:27:14.850927] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-28T19:27:14.850987] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-28T19:27:14.851606] [DEBUG] [LOCAL ] IQI: Trimmed 26042 records to 17371 (keeping 200 days of data) [2025-10-28T19:27:14.954920] [DEBUG] [LOCAL ] IQI: Primary data saved (17371 records). [2025-10-28T19:27:14.955164] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-28T19:27:14.955340] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 11.6s. Estimated remaining: 2h 43m 29s. Rate: 7.6 symbols/min [2025-10-28T19:27:15.129055] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:15.142599] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T19:27:15.174813] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-28T19:27:15.178717] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:27:15.191139] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-28T19:27:15.225196] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:27:15.248639] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-28T19:27:15.270201] [DEBUG] [LOCAL ] IQV: Loaded 49937 existing records from primary storage. [2025-10-28T19:27:15.270482] [INFO ] [MAIN ] IQV: Loaded 49937 existing records. [2025-10-28T19:27:15.443423] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:15.443624] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-28T19:27:15.443700] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-28T19:27:15.444061] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-28T19:27:15.444102] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-28T19:27:15.792698] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:15.792996] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-28T19:27:15.945503] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:27:15.949985] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-28T19:27:16.297140] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:27:16.308195] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-28T19:27:17.640729] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T19:27:17.652487] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-28T19:27:17.703008] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T19:27:17.707543] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-28T19:27:18.470513] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T19:27:18.475543] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-28T19:27:18.668433] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-10-28T19:27:18.874361] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:19.180245] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-28T19:27:19.327717] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:27:19.333076] [INFO ] [REMOTE ] IPI: Full fetch complete (30440 records). [2025-10-28T19:27:19.333218] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-28T19:27:19.725318] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-28T19:27:19.725433] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-28T19:27:19.726512] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-28T19:27:19.726582] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-28T19:27:19.727859] [DEBUG] [LOCAL ] IPI: Trimmed 30440 records to 21264 (keeping 200 days of data) [2025-10-28T19:27:19.862261] [DEBUG] [LOCAL ] IPI: Primary data saved (21264 records). [2025-10-28T19:27:19.862430] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-28T19:27:19.862529] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 16.5s. Estimated remaining: 2h 43m 18s. Rate: 7.6 symbols/min [2025-10-28T19:27:19.985399] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-28T19:27:20.049855] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:20.102502] [DEBUG] [LOCAL ] IR: Loaded 52720 existing records from primary storage. [2025-10-28T19:27:20.102997] [INFO ] [MAIN ] IR: Loaded 52720 existing records. [2025-10-28T19:27:20.293752] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:20.294108] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-28T19:27:20.294160] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-28T19:27:20.294559] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-28T19:27:20.294629] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-28T19:27:20.675525] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:20.780367] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-28T19:27:21.203972] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (5.41 seconds). [2025-10-28T19:27:21.369033] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T19:27:21.580330] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-28T19:27:21.938061] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:27:22.380277] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-28T19:27:22.574817] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:27:23.190800] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-28T19:27:23.197748] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (4.02 seconds). [2025-10-28T19:27:23.381600] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T19:27:23.980279] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-28T19:27:24.377864] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:27:24.780295] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-28T19:27:25.195959] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:25.580281] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-28T19:27:26.035670] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:27:26.380287] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-28T19:27:27.032451] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T19:27:27.044619] [INFO ] [REMOTE ] IPG: Full fetch complete (77442 records). [2025-10-28T19:27:27.044850] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-28T19:27:27.193411] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-28T19:27:27.467909] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-28T19:27:27.468013] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-28T19:27:27.469191] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-28T19:27:27.469256] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-28T19:27:27.470955] [DEBUG] [LOCAL ] IPG: Trimmed 77442 records to 53327 (keeping 200 days of data) [2025-10-28T19:27:27.835017] [DEBUG] [LOCAL ] IPG: Primary data saved (53327 records). [2025-10-28T19:27:27.838344] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-28T19:27:27.838475] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IPG took 24.5s. Estimated remaining: 2h 43m 10s. Rate: 7.6 symbols/min [2025-10-28T19:27:27.883883] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T19:27:27.985442] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-28T19:27:28.050101] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:28.101722] [DEBUG] [LOCAL ] IRM: Loaded 48673 existing records from primary storage. [2025-10-28T19:27:28.102047] [INFO ] [MAIN ] IRM: Loaded 48673 existing records. [2025-10-28T19:27:28.300495] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:28.300857] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-28T19:27:28.300919] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-28T19:27:28.301377] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-28T19:27:28.301450] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-28T19:27:28.659157] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:28.691875] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T19:27:28.780268] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-28T19:27:29.581686] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-28T19:27:29.584426] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T19:27:29.595807] [INFO ] [REMOTE ] IP: Full fetch complete (77423 records). [2025-10-28T19:27:29.595914] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-28T19:27:29.991410] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-28T19:27:29.991528] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-28T19:27:29.992773] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-28T19:27:29.992912] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-28T19:27:29.994951] [DEBUG] [LOCAL ] IP: Trimmed 77423 records to 53297 (keeping 200 days of data) [2025-10-28T19:27:30.259768] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T19:27:30.358797] [DEBUG] [LOCAL ] IP: Primary data saved (53297 records). [2025-10-28T19:27:30.358965] [INFO ] [MAIN ] IP: Full history saved. [2025-10-28T19:27:30.359311] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IP took 27.0s. Estimated remaining: 2h 42m 56s. Rate: 7.6 symbols/min [2025-10-28T19:27:30.388220] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-28T19:27:30.527248] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:30.550805] [DEBUG] [LOCAL ] IRS: Loaded 23461 existing records from primary storage. [2025-10-28T19:27:30.551049] [INFO ] [MAIN ] IRS: Loaded 23461 existing records. [2025-10-28T19:27:30.727889] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:30.728334] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-28T19:27:30.728520] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-28T19:27:30.728955] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-28T19:27:30.729061] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-28T19:27:31.164419] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:31.173412] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T19:27:31.187207] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-28T19:27:31.980215] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-28T19:27:32.364171] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:27:32.780241] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-28T19:27:33.186381] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:27:33.570448] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T19:27:33.580196] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-28T19:27:34.219331] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:27:34.380311] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-28T19:27:34.654778] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (4.27 seconds). [2025-10-28T19:27:35.099551] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T19:27:35.180250] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-28T19:27:35.980297] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-28T19:27:36.507128] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T19:27:36.760081] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:27:36.780289] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-28T19:27:37.504714] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T19:27:37.580276] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-28T19:27:38.253077] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:27:38.380262] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-28T19:27:39.180304] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-28T19:27:39.980263] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-28T19:27:40.780286] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-28T19:27:41.198809] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:41.580286] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-28T19:27:42.313159] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:27:42.380214] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-28T19:27:42.759275] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:27:42.906240] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (4.53 seconds). [2025-10-28T19:27:43.177087] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:27:43.181866] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-28T19:27:43.763271] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:27:43.774590] [INFO ] [REMOTE ] IQV: Full fetch complete (72677 records). [2025-10-28T19:27:43.774850] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-28T19:27:43.985859] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-28T19:27:44.196515] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-28T19:27:44.196632] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-28T19:27:44.198276] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-28T19:27:44.198353] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-28T19:27:44.200497] [DEBUG] [LOCAL ] IQV: Trimmed 72677 records to 49919 (keeping 200 days of data) [2025-10-28T19:27:44.535019] [DEBUG] [LOCAL ] IQV: Primary data saved (49919 records). [2025-10-28T19:27:44.535288] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-28T19:27:44.535461] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IQV took 29.6s. Estimated remaining: 2h 42m 55s. Rate: 7.6 symbols/min [2025-10-28T19:27:44.742021] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:44.791167] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-28T19:27:44.795108] [DEBUG] [LOCAL ] IRT: Loaded 50309 existing records from primary storage. [2025-10-28T19:27:44.795637] [INFO ] [MAIN ] IRT: Loaded 50309 existing records. [2025-10-28T19:27:44.991307] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:44.991604] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-28T19:27:44.991694] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-28T19:27:44.992303] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-28T19:27:44.992382] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-28T19:27:45.382734] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:45.440195] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T19:27:45.580237] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-28T19:27:45.754599] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T19:27:46.380248] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-28T19:27:46.778736] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T19:27:47.001746] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (7.82 seconds). [2025-10-28T19:27:47.180247] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-28T19:27:47.531783] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:27:47.538736] [INFO ] [REMOTE ] IRS: Full fetch complete (32766 records). [2025-10-28T19:27:47.538975] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-28T19:27:47.922625] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-28T19:27:47.922748] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-28T19:27:47.923409] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-28T19:27:47.923450] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-28T19:27:47.924217] [DEBUG] [LOCAL ] IRS: Trimmed 32766 records to 23690 (keeping 200 days of data) [2025-10-28T19:27:48.005727] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-28T19:27:48.061772] [DEBUG] [LOCAL ] IRS: Primary data saved (23690 records). [2025-10-28T19:27:48.061967] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-28T19:27:48.062066] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IRS took 17.7s. Estimated remaining: 2h 42m 43s. Rate: 7.6 symbols/min [2025-10-28T19:27:48.232968] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:48.249545] [DEBUG] [LOCAL ] ISD: Loaded 15420 existing records from primary storage. [2025-10-28T19:27:48.249945] [INFO ] [MAIN ] ISD: Loaded 15420 existing records. [2025-10-28T19:27:48.427970] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:48.428340] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-28T19:27:48.428401] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-28T19:27:48.428796] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-28T19:27:48.428930] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-28T19:27:48.638238] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T19:27:48.791455] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-28T19:27:48.831821] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:49.580316] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-28T19:27:50.207332] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:27:50.380272] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-28T19:27:50.764411] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:27:51.180279] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-28T19:27:51.485383] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T19:27:51.980241] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-28T19:27:52.482881] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (4.48 seconds). [2025-10-28T19:27:52.780293] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-28T19:27:53.054830] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:27:53.580244] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-28T19:27:53.980688] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T19:27:54.169130] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-10-28T19:27:54.380306] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-28T19:27:55.180314] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-28T19:27:55.554525] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:27:55.980270] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-28T19:27:56.404671] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:56.780247] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-28T19:27:57.041092] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (3.46 seconds). [2025-10-28T19:27:57.332956] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T19:27:57.580256] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-28T19:27:57.978285] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T19:27:58.380306] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-28T19:27:58.963791] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:27:58.974566] [INFO ] [REMOTE ] IR: Full fetch complete (76479 records). [2025-10-28T19:27:58.974746] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-28T19:27:59.113604] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:27:59.180676] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-28T19:27:59.402296] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-28T19:27:59.402389] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-28T19:27:59.403422] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-28T19:27:59.403488] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-28T19:27:59.404972] [DEBUG] [LOCAL ] IR: Trimmed 76479 records to 52717 (keeping 200 days of data) [2025-10-28T19:27:59.725439] [DEBUG] [LOCAL ] IR: Primary data saved (52717 records). [2025-10-28T19:27:59.725599] [INFO ] [MAIN ] IR: Full history saved. [2025-10-28T19:27:59.725736] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. IR took 39.9s. Estimated remaining: 2h 42m 39s. Rate: 7.6 symbols/min [2025-10-28T19:27:59.904674] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:59.949341] [DEBUG] [LOCAL ] IT: Loaded 42087 existing records from primary storage. [2025-10-28T19:27:59.956197] [INFO ] [MAIN ] IT: Loaded 42087 existing records. [2025-10-28T19:27:59.956064] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:27:59.985325] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-28T19:28:00.154581] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:00.154847] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-28T19:28:00.154896] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-28T19:28:00.155210] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-28T19:28:00.155270] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-28T19:28:00.521421] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:00.780265] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-28T19:28:01.294901] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:28:01.580256] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-28T19:28:01.744847] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:28:02.380288] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-28T19:28:02.718232] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:28:03.180256] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-28T19:28:03.328283] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T19:28:03.980261] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-28T19:28:04.607825] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:28:04.780275] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-28T19:28:05.391813] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T19:28:05.580278] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-28T19:28:06.380303] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-28T19:28:06.632455] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:28:07.180322] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-28T19:28:07.980338] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-28T19:28:08.260842] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (5.08 seconds). [2025-10-28T19:28:08.271509] [INFO ] [REMOTE ] IRM: Full fetch complete (71845 records). [2025-10-28T19:28:08.271699] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-28T19:28:08.661705] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T19:28:08.793793] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-28T19:28:08.818637] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-28T19:28:08.818817] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-28T19:28:08.820345] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-28T19:28:08.820550] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-28T19:28:08.822826] [DEBUG] [LOCAL ] IRM: Trimmed 71845 records to 48597 (keeping 200 days of data) [2025-10-28T19:28:09.136865] [DEBUG] [LOCAL ] IRM: Primary data saved (48597 records). [2025-10-28T19:28:09.137015] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-28T19:28:09.137716] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRM took 41.3s. Estimated remaining: 2h 42m 33s. Rate: 7.6 symbols/min [2025-10-28T19:28:09.311549] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:09.338083] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T19:28:09.384801] [DEBUG] [LOCAL ] ITGR: Loaded 31163 existing records from primary storage. [2025-10-28T19:28:09.385187] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-28T19:28:09.388723] [INFO ] [MAIN ] ITGR: Loaded 31163 existing records. [2025-10-28T19:28:09.563680] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:09.563879] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-28T19:28:09.563926] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-28T19:28:09.564346] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-28T19:28:09.564407] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-28T19:28:09.585492] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-28T19:28:09.910485] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:10.141096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:28:10.380322] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-28T19:28:11.180233] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-28T19:28:11.647360] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:28:11.881021] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:28:11.980213] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-28T19:28:12.780263] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-28T19:28:13.413696] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T19:28:13.580242] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-28T19:28:14.380338] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-28T19:28:14.410279] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (4.82 seconds). [2025-10-28T19:28:14.439116] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-28T19:28:14.743118] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:28:15.180328] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-28T19:28:15.971677] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T19:28:15.980203] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-28T19:28:16.124866] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:28:16.638271] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T19:28:16.642183] [INFO ] [REMOTE ] ISD: Full fetch complete (23958 records). [2025-10-28T19:28:16.642254] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-28T19:28:16.785359] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-28T19:28:17.012610] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-28T19:28:17.012726] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-28T19:28:17.013281] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-28T19:28:17.013363] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-28T19:28:17.014029] [DEBUG] [LOCAL ] ISD: Trimmed 23958 records to 15340 (keeping 200 days of data) [2025-10-28T19:28:17.106007] [DEBUG] [LOCAL ] ISD: Primary data saved (15340 records). [2025-10-28T19:28:17.106174] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-28T19:28:17.106260] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. ISD took 29.0s. Estimated remaining: 2h 42m 25s. Rate: 7.6 symbols/min [2025-10-28T19:28:17.300314] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:17.333015] [DEBUG] [LOCAL ] ITT: Loaded 31974 existing records from primary storage. [2025-10-28T19:28:17.333292] [INFO ] [MAIN ] ITT: Loaded 31974 existing records. [2025-10-28T19:28:17.509277] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:17.509556] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-28T19:28:17.509605] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-28T19:28:17.509845] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-28T19:28:17.509902] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-28T19:28:17.585506] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-28T19:28:17.863783] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:17.890676] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:28:18.380289] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-28T19:28:19.180240] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-28T19:28:19.528306] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:28:19.980255] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-28T19:28:20.257845] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:28:20.780316] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-28T19:28:21.238775] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:28:21.580314] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-28T19:28:21.792558] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:28:22.380292] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-28T19:28:22.880561] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:28:23.180251] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-28T19:28:23.980260] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-28T19:28:24.761447] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T19:28:24.770810] [INFO ] [REMOTE ] IT: Full fetch complete (58196 records). [2025-10-28T19:28:24.770924] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-28T19:28:25.022589] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (7.44 seconds). [2025-10-28T19:28:25.093039] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:28:25.131038] [INFO ] [REMOTE ] IRT: Full fetch complete (72816 records). [2025-10-28T19:28:25.140105] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-28T19:28:25.140885] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-28T19:28:25.357130] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-28T19:28:25.362367] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-28T19:28:25.368409] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-28T19:28:25.380818] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-28T19:28:25.435687] [DEBUG] [LOCAL ] IT: Trimmed 58196 records to 42098 (keeping 200 days of data) [2025-10-28T19:28:25.823878] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-28T19:28:25.824268] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-28T19:28:25.825324] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-28T19:28:25.825491] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-28T19:28:25.876474] [DEBUG] [LOCAL ] IRT: Trimmed 72816 records to 50290 (keeping 200 days of data) [2025-10-28T19:28:25.970509] [DEBUG] [LOCAL ] IT: Primary data saved (42098 records). [2025-10-28T19:28:25.971105] [INFO ] [MAIN ] IT: Full history saved. [2025-10-28T19:28:25.971249] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. IT took 26.2s. Estimated remaining: 2h 42m 18s. Rate: 7.6 symbols/min [2025-10-28T19:28:26.201775] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:26.328186] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:28:26.343602] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-28T19:28:26.455225] [DEBUG] [LOCAL ] ITUB: Loaded 53305 existing records from primary storage. [2025-10-28T19:28:26.463532] [INFO ] [MAIN ] ITUB: Loaded 53305 existing records. [2025-10-28T19:28:26.573104] [DEBUG] [LOCAL ] IRT: Primary data saved (50290 records). [2025-10-28T19:28:26.573506] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-28T19:28:26.573618] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. IRT took 42.0s. Estimated remaining: 2h 42m 2s. Rate: 7.6 symbols/min [2025-10-28T19:28:26.752520] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:26.768543] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-28T19:28:26.773771] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-28T19:28:26.821590] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:26.818470] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-28T19:28:26.822330] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-28T19:28:27.206544] [DEBUG] [LOCAL ] ITW: Loaded 45560 existing records from primary storage. [2025-10-28T19:28:27.264805] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:27.265227] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-28T19:28:27.258773] [INFO ] [MAIN ] ITW: Loaded 45560 existing records. [2025-10-28T19:28:27.384792] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:28:27.404127] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-28T19:28:27.488257] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:27.488587] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-28T19:28:27.488639] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-28T19:28:27.489310] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-28T19:28:27.489374] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-28T19:28:27.884271] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:27.980321] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-28T19:28:28.321083] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:28:28.494938] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T19:28:28.780313] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-28T19:28:29.159382] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:28:29.580303] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-28T19:28:30.165597] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:28:30.287543] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (7.91 seconds). [2025-10-28T19:28:30.380276] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-28T19:28:30.731678] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:28:30.740506] [INFO ] [REMOTE ] ITGR: Full fetch complete (44226 records). [2025-10-28T19:28:30.740750] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-28T19:28:31.155259] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-28T19:28:31.155344] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-28T19:28:31.156266] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-28T19:28:31.156328] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-28T19:28:31.157414] [DEBUG] [LOCAL ] ITGR: Trimmed 44226 records to 31198 (keeping 200 days of data) [2025-10-28T19:28:31.210619] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-28T19:28:31.348345] [DEBUG] [LOCAL ] ITGR: Primary data saved (31198 records). [2025-10-28T19:28:31.348470] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-28T19:28:31.348555] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITGR took 22.2s. Estimated remaining: 2h 41m 51s. Rate: 7.6 symbols/min [2025-10-28T19:28:31.518277] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:31.560700] [DEBUG] [LOCAL ] IVR: Loaded 47696 existing records from primary storage. [2025-10-28T19:28:31.561059] [INFO ] [MAIN ] IVR: Loaded 47696 existing records. [2025-10-28T19:28:31.741791] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:31.742065] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-28T19:28:31.742143] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-28T19:28:31.742608] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-28T19:28:31.742709] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-28T19:28:31.983270] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-28T19:28:32.035961] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T19:28:32.168747] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:32.229987] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:28:32.780257] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-28T19:28:33.356459] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T19:28:33.580246] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-28T19:28:34.130624] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:28:34.380273] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-28T19:28:34.686496] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:28:35.180247] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-28T19:28:35.751987] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:28:35.980251] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-28T19:28:36.645369] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T19:28:36.780252] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-28T19:28:37.580256] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-28T19:28:38.380264] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-28T19:28:38.631169] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:28:39.180302] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-28T19:28:41.352488] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (5.37 seconds). [2025-10-28T19:28:41.361513] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-28T19:28:42.820898] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T19:28:42.831085] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-28T19:28:43.993465] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (4.81 seconds). [2025-10-28T19:28:44.004841] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-28T19:28:44.172543] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:28:44.183099] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-28T19:28:44.744096] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (6.36 seconds). [2025-10-28T19:28:44.755297] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-28T19:28:44.977796] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T19:28:44.989357] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-28T19:28:45.399963] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T19:28:45.410234] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-28T19:28:45.586482] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (8.81 seconds). [2025-10-28T19:28:45.596443] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-28T19:28:45.993595] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:28:46.060485] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:28:46.380267] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-28T19:28:46.701498] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:28:47.180249] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-28T19:28:47.690624] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:28:47.980269] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-28T19:28:48.366012] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:28:48.780274] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-28T19:28:49.580266] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-28T19:28:50.089289] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T19:28:50.183806] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (4.77 seconds). [2025-10-28T19:28:50.380273] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-28T19:28:50.877485] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-28T19:28:51.180265] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-28T19:28:51.914720] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:28:51.980221] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-28T19:28:52.458415] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:28:52.780223] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-28T19:28:53.127746] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T19:28:53.580262] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-28T19:28:53.616449] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T19:28:54.380216] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-28T19:28:54.893697] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:28:55.180231] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-28T19:28:55.277674] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T19:28:55.980238] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-28T19:28:56.399048] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (6.82 seconds). [2025-10-28T19:28:56.655471] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T19:28:56.665378] [INFO ] [REMOTE ] IVR: Full fetch complete (68999 records). [2025-10-28T19:28:56.665528] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-28T19:28:56.785439] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-28T19:28:57.047947] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-28T19:28:57.048046] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-28T19:28:57.049008] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-28T19:28:57.049209] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-28T19:28:57.050538] [DEBUG] [LOCAL ] IVR: Trimmed 68999 records to 47650 (keeping 200 days of data) [2025-10-28T19:28:57.273421] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:28:57.297280] [INFO ] [REMOTE ] ITT: Full fetch complete (47659 records). [2025-10-28T19:28:57.301099] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-28T19:28:57.534869] [DEBUG] [LOCAL ] IVR: Primary data saved (47650 records). [2025-10-28T19:28:57.548197] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-28T19:28:57.554109] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. IVR took 26.2s. Estimated remaining: 2h 42m 3s. Rate: 7.6 symbols/min [2025-10-28T19:28:57.594245] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-28T19:28:57.896371] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:57.911630] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-28T19:28:57.911718] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-28T19:28:57.912488] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-28T19:28:57.912526] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-28T19:28:57.913610] [DEBUG] [LOCAL ] ITT: Trimmed 47659 records to 31933 (keeping 200 days of data) [2025-10-28T19:28:58.091581] [DEBUG] [LOCAL ] IVT: Loaded 31135 existing records from primary storage. [2025-10-28T19:28:58.107743] [INFO ] [MAIN ] IVT: Loaded 31135 existing records. [2025-10-28T19:28:58.172782] [DEBUG] [LOCAL ] ITT: Primary data saved (31933 records). [2025-10-28T19:28:58.184375] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-28T19:28:58.198178] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. ITT took 41.1s. Estimated remaining: 2h 41m 47s. Rate: 7.6 symbols/min [2025-10-28T19:28:58.415490] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:58.431170] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-28T19:28:58.436568] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-28T19:28:58.482568] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-28T19:28:58.482526] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:58.482802] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-28T19:28:58.807245] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T19:28:58.888396] [INFO ] [REMOTE ] ITUB: Full fetch complete (77303 records). [2025-10-28T19:28:58.925610] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:58.926079] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-28T19:28:58.922484] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-28T19:28:58.928210] [DEBUG] [LOCAL ] IVZ: Loaded 53128 existing records from primary storage. [2025-10-28T19:28:58.940006] [INFO ] [MAIN ] IVZ: Loaded 53128 existing records. [2025-10-28T19:28:59.312413] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T19:28:59.324519] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:59.345808] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-28T19:28:59.354293] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-28T19:28:59.368049] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-28T19:28:59.388103] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-28T19:28:59.400403] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-28T19:28:59.763987] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-28T19:28:59.774183] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-28T19:28:59.829049] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-28T19:28:59.834517] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-28T19:28:59.924432] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:59.925797] [DEBUG] [LOCAL ] ITUB: Trimmed 77303 records to 53301 (keeping 200 days of data) [2025-10-28T19:28:59.989962] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-28T19:29:00.001477] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:29:00.267630] [DEBUG] [LOCAL ] ITUB: Primary data saved (53301 records). [2025-10-28T19:29:00.267801] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-28T19:29:00.267883] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. ITUB took 34.3s. Estimated remaining: 2h 41m 33s. Rate: 7.6 symbols/min [2025-10-28T19:29:00.437875] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:00.459490] [DEBUG] [LOCAL ] IX: Loaded 21695 existing records from primary storage. [2025-10-28T19:29:00.459823] [INFO ] [MAIN ] IX: Loaded 21695 existing records. [2025-10-28T19:29:00.638995] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:00.639260] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-28T19:29:00.639309] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-28T19:29:00.639575] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-28T19:29:00.639617] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-28T19:29:00.784408] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-28T19:29:01.024267] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:01.050539] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T19:29:01.059928] [INFO ] [REMOTE ] ITW: Full fetch complete (66952 records). [2025-10-28T19:29:01.060053] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-28T19:29:01.434321] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-28T19:29:01.434395] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-28T19:29:01.435282] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-28T19:29:01.435344] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-28T19:29:01.436602] [DEBUG] [LOCAL ] ITW: Trimmed 66952 records to 45547 (keeping 200 days of data) [2025-10-28T19:29:01.612615] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-28T19:29:01.736141] [DEBUG] [LOCAL ] ITW: Primary data saved (45547 records). [2025-10-28T19:29:01.736463] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-28T19:29:01.736586] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. ITW took 35.2s. Estimated remaining: 2h 41m 18s. Rate: 7.6 symbols/min [2025-10-28T19:29:01.952889] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:01.978998] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-28T19:29:02.026558] [DEBUG] [LOCAL ] J: Loaded 40512 existing records from primary storage. [2025-10-28T19:29:02.026929] [INFO ] [MAIN ] J: Loaded 40512 existing records. [2025-10-28T19:29:02.201452] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:02.201684] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-28T19:29:02.201742] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-28T19:29:02.202040] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-28T19:29:02.202098] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-28T19:29:02.314764] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:29:02.387922] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-28T19:29:02.590971] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:02.934198] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:29:03.180238] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-28T19:29:03.636884] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-28T19:29:03.980253] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-28T19:29:04.786719] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-28T19:29:04.804337] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T19:29:05.431739] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-28T19:29:05.580276] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-28T19:29:06.380281] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-28T19:29:06.545207] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T19:29:07.180279] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-28T19:29:07.207224] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T19:29:07.980225] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-28T19:29:08.155844] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T19:29:08.780249] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-28T19:29:08.976323] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (4.19 seconds). [2025-10-28T19:29:09.112050] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:29:09.427928] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T19:29:09.580292] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-28T19:29:10.380282] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-28T19:29:10.499927] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:29:11.180301] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-28T19:29:11.641401] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:29:11.980240] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-28T19:29:12.065927] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T19:29:12.780317] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-28T19:29:13.580243] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-28T19:29:14.380232] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-28T19:29:14.469106] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T19:29:15.180312] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-28T19:29:16.373502] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:29:16.382242] [INFO ] [REMOTE ] IVT: Full fetch complete (45577 records). [2025-10-28T19:29:16.382411] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-28T19:29:16.750017] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (4.77 seconds). [2025-10-28T19:29:16.822180] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-28T19:29:16.856846] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-28T19:29:16.856939] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-28T19:29:16.857707] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-28T19:29:16.857768] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-28T19:29:16.858717] [DEBUG] [LOCAL ] IVT: Trimmed 45577 records to 31153 (keeping 200 days of data) [2025-10-28T19:29:17.046725] [DEBUG] [LOCAL ] IVT: Primary data saved (31153 records). [2025-10-28T19:29:17.046857] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-28T19:29:17.046936] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IVT took 19.5s. Estimated remaining: 2h 41m 19s. Rate: 7.6 symbols/min [2025-10-28T19:29:17.216971] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:17.256282] [DEBUG] [LOCAL ] JBGS: Loaded 41297 existing records from primary storage. [2025-10-28T19:29:17.256580] [INFO ] [MAIN ] JBGS: Loaded 41297 existing records. [2025-10-28T19:29:17.439769] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:17.439979] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-28T19:29:17.440025] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-28T19:29:17.440235] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-28T19:29:17.440277] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-28T19:29:17.784592] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:17.784906] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-28T19:29:18.667621] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (4.29 seconds). [2025-10-28T19:29:18.677243] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-28T19:29:18.677974] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (5.90 seconds). [2025-10-28T19:29:18.685497] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-28T19:29:18.719848] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T19:29:19.180312] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-28T19:29:19.378988] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:29:19.782613] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:29:19.980262] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-28T19:29:20.025248] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T19:29:20.788121] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-28T19:29:20.790775] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T19:29:21.580264] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-28T19:29:21.816061] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (4.99 seconds). [2025-10-28T19:29:22.090374] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:29:22.380209] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-28T19:29:22.563734] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T19:29:23.180258] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-28T19:29:23.595552] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:29:23.980302] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-28T19:29:24.318978] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:29:24.717213] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T19:29:24.780237] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-28T19:29:25.461605] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T19:29:25.580244] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-28T19:29:26.380273] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-28T19:29:27.180250] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-28T19:29:27.980265] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-28T19:29:28.702106] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:29:28.706520] [INFO ] [REMOTE ] IX: Full fetch complete (29055 records). [2025-10-28T19:29:28.706610] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-28T19:29:29.095289] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-28T19:29:29.095373] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-28T19:29:29.096097] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-28T19:29:29.096161] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-28T19:29:29.097015] [DEBUG] [LOCAL ] IX: Trimmed 29055 records to 21585 (keeping 200 days of data) [2025-10-28T19:29:29.222595] [DEBUG] [LOCAL ] IX: Primary data saved (21585 records). [2025-10-28T19:29:29.222742] [INFO ] [MAIN ] IX: Full history saved. [2025-10-28T19:29:29.222826] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. IX took 29.0s. Estimated remaining: 2h 41m 15s. Rate: 7.6 symbols/min [2025-10-28T19:29:29.394569] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:29.431719] [DEBUG] [LOCAL ] JBI: Loaded 42114 existing records from primary storage. [2025-10-28T19:29:29.431999] [INFO ] [MAIN ] JBI: Loaded 42114 existing records. [2025-10-28T19:29:29.608775] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:29.609076] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-28T19:29:29.609148] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-28T19:29:29.609488] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-28T19:29:29.609552] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-28T19:29:29.961718] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:29.962089] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-28T19:29:32.156084] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (6.58 seconds). [2025-10-28T19:29:32.167511] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-28T19:29:32.470665] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (6.09 seconds). [2025-10-28T19:29:32.480331] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-28T19:29:33.763030] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T19:29:33.774476] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-28T19:29:34.073632] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T19:29:34.083975] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-28T19:29:34.864320] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (7.68 seconds). [2025-10-28T19:29:34.872777] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-28T19:29:36.111600] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:29:36.120216] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-28T19:29:36.843283] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (6.88 seconds). [2025-10-28T19:29:36.852558] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-28T19:29:37.318286] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:29:37.327245] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-28T19:29:37.969522] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T19:29:37.978663] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-28T19:29:38.509286] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:29:38.518276] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-28T19:29:38.662255] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (4.58 seconds). [2025-10-28T19:29:38.671604] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-28T19:29:38.901870] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:29:38.912208] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-28T19:29:39.815292] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T19:29:39.825815] [INFO ] [REMOTE ] J: Full fetch complete (60017 records). [2025-10-28T19:29:39.826110] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-28T19:29:39.897403] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:29:40.001377] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-28T19:29:40.297166] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-28T19:29:40.297266] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-28T19:29:40.298399] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-28T19:29:40.298479] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-28T19:29:40.324182] [DEBUG] [LOCAL ] J: Trimmed 60017 records to 40501 (keeping 200 days of data) [2025-10-28T19:29:40.326064] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:29:40.340143] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-28T19:29:40.585177] [DEBUG] [LOCAL ] J: Primary data saved (40501 records). [2025-10-28T19:29:40.585311] [INFO ] [MAIN ] J: Full history saved. [2025-10-28T19:29:40.586501] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. J took 38.8s. Estimated remaining: 2h 41m 11s. Rate: 7.6 symbols/min [2025-10-28T19:29:40.758371] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:40.789859] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (7.02 seconds). [2025-10-28T19:29:40.802062] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-28T19:29:40.841767] [DEBUG] [LOCAL ] JBL: Loaded 48193 existing records from primary storage. [2025-10-28T19:29:40.842052] [INFO ] [MAIN ] JBL: Loaded 48193 existing records. [2025-10-28T19:29:41.020404] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:41.020736] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-28T19:29:41.020806] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-28T19:29:41.021055] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-28T19:29:41.021178] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-28T19:29:41.218298] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:29:41.423125] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:41.449437] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:29:41.580238] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-28T19:29:42.327065] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:29:42.337694] [INFO ] [REMOTE ] IVZ: Full fetch complete (77073 records). [2025-10-28T19:29:42.337803] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-28T19:29:42.385428] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-28T19:29:42.742971] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-28T19:29:42.743150] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-28T19:29:42.744199] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-28T19:29:42.744370] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-28T19:29:42.745992] [DEBUG] [LOCAL ] IVZ: Trimmed 77073 records to 53126 (keeping 200 days of data) [2025-10-28T19:29:42.898070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T19:29:43.100912] [DEBUG] [LOCAL ] IVZ: Primary data saved (53126 records). [2025-10-28T19:29:43.101037] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-28T19:29:43.101114] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. IVZ took 44.9s. Estimated remaining: 2h 40m 58s. Rate: 7.6 symbols/min [2025-10-28T19:29:43.185598] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-28T19:29:43.274437] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:43.301947] [DEBUG] [LOCAL ] JBND: Loaded 27459 existing records from primary storage. [2025-10-28T19:29:43.302214] [INFO ] [MAIN ] JBND: Loaded 27459 existing records. [2025-10-28T19:29:43.486081] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:43.486399] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-28T19:29:43.486510] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-28T19:29:43.486908] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-28T19:29:43.487075] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-28T19:29:43.614762] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:29:43.878374] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:43.980253] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-28T19:29:44.245362] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:29:44.252964] [INFO ] [REMOTE ] JBGS: Full fetch complete (59085 records). [2025-10-28T19:29:44.253118] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-28T19:29:44.639417] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-28T19:29:44.639613] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-28T19:29:44.640534] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-28T19:29:44.640613] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-28T19:29:44.651911] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:29:44.656555] [DEBUG] [LOCAL ] JBGS: Trimmed 59085 records to 41208 (keeping 200 days of data) [2025-10-28T19:29:44.780278] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-28T19:29:44.901719] [DEBUG] [LOCAL ] JBGS: Primary data saved (41208 records). [2025-10-28T19:29:44.901846] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-28T19:29:44.902592] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBGS took 27.9s. Estimated remaining: 2h 40m 43s. Rate: 7.6 symbols/min [2025-10-28T19:29:45.070394] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:45.070571] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-28T19:29:45.070607] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-28T19:29:45.070755] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-28T19:29:45.070798] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-28T19:29:45.070846] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-28T19:29:45.070879] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-28T19:29:45.419468] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:45.580285] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-28T19:29:45.914910] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:29:46.200193] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T19:29:46.380311] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-28T19:29:47.180218] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-28T19:29:47.323698] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:29:47.324014] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-28T19:29:47.324102] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:29:47.324148] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-28T19:29:47.324181] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:29:47.324218] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-28T19:29:47.324272] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-28T19:29:47.324308] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-28T19:29:47.324346] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-28T19:29:47.324394] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBS took 2.4s. Estimated remaining: 2h 40m 29s. Rate: 7.6 symbols/min [2025-10-28T19:29:47.491804] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:47.527400] [DEBUG] [LOCAL ] JBTM: Loaded 33232 existing records from primary storage. [2025-10-28T19:29:47.527689] [INFO ] [MAIN ] JBTM: Loaded 33232 existing records. [2025-10-28T19:29:47.707928] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:47.708159] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-28T19:29:47.708206] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-28T19:29:47.708754] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-28T19:29:47.708813] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-28T19:29:47.982878] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-28T19:29:48.088249] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:48.780282] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-28T19:29:49.174153] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-28T19:29:49.375006] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T19:29:49.580240] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-28T19:29:49.825920] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:29:50.380298] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-28T19:29:50.872764] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:29:51.180235] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-28T19:29:51.227554] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:29:51.980234] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-28T19:29:52.780244] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-28T19:29:53.421709] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:29:53.580248] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-28T19:29:53.603712] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T19:29:54.092583] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-10-28T19:29:54.380219] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-28T19:29:54.457484] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T19:29:55.180225] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-28T19:29:55.980249] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-28T19:29:56.296410] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T19:29:56.304510] [INFO ] [REMOTE ] JBI: Full fetch complete (63167 records). [2025-10-28T19:29:56.304639] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-28T19:29:56.688736] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-28T19:29:56.688821] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-28T19:29:56.689817] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-28T19:29:56.689879] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-28T19:29:56.691204] [DEBUG] [LOCAL ] JBI: Trimmed 63167 records to 42038 (keeping 200 days of data) [2025-10-28T19:29:56.787937] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-28T19:29:56.928633] [DEBUG] [LOCAL ] JBI: Primary data saved (42038 records). [2025-10-28T19:29:56.928787] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-28T19:29:56.928866] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBI took 27.7s. Estimated remaining: 2h 40m 23s. Rate: 7.6 symbols/min [2025-10-28T19:29:57.097599] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:57.105563] [DEBUG] [LOCAL ] JCE: Loaded 7116 existing records from primary storage. [2025-10-28T19:29:57.105774] [INFO ] [MAIN ] JCE: Loaded 7116 existing records. [2025-10-28T19:29:57.235557] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-28T19:29:57.316922] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:57.317232] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-28T19:29:57.317410] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-28T19:29:57.317781] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-28T19:29:57.317841] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-28T19:29:57.591520] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-28T19:29:57.681903] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:57.709037] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T19:29:58.380257] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-28T19:29:58.485369] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T19:29:58.801227] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T19:29:59.180253] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-28T19:29:59.553636] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-28T19:29:59.980315] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-28T19:30:00.025531] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:30:00.780255] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-28T19:30:01.541094] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T19:30:01.580204] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-28T19:30:01.946372] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T19:30:02.380333] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-28T19:30:02.805829] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:30:03.180242] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-28T19:30:03.976630] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (4.00 seconds). [2025-10-28T19:30:03.985626] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-28T19:30:04.112432] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:30:04.543555] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T19:30:04.780271] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-28T19:30:05.580282] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-28T19:30:05.683774] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T19:30:06.380255] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-28T19:30:06.534672] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T19:30:07.180272] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-28T19:30:07.376692] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:30:07.566584] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T19:30:07.980287] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-28T19:30:08.780288] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-28T19:30:09.009013] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:30:09.580238] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-28T19:30:09.667513] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T19:30:10.380386] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-28T19:30:10.690486] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T19:30:10.697697] [INFO ] [REMOTE ] JBND: Full fetch complete (36697 records). [2025-10-28T19:30:10.697777] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-28T19:30:11.070530] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-28T19:30:11.070605] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-28T19:30:11.071288] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-28T19:30:11.071347] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-28T19:30:11.072138] [DEBUG] [LOCAL ] JBND: Trimmed 36697 records to 27536 (keeping 200 days of data) [2025-10-28T19:30:11.183698] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-28T19:30:11.236854] [DEBUG] [LOCAL ] JBND: Primary data saved (27536 records). [2025-10-28T19:30:11.237004] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-28T19:30:11.237243] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBND took 28.1s. Estimated remaining: 2h 40m 22s. Rate: 7.6 symbols/min [2025-10-28T19:30:11.410149] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T19:30:11.434764] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:11.488119] [DEBUG] [LOCAL ] JCI: Loaded 53513 existing records from primary storage. [2025-10-28T19:30:11.488473] [INFO ] [MAIN ] JCI: Loaded 53513 existing records. [2025-10-28T19:30:11.660900] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:11.661113] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-28T19:30:11.661159] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-28T19:30:11.661792] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-28T19:30:11.661849] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-28T19:30:11.982525] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-28T19:30:12.012046] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:12.248998] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T19:30:12.780299] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-28T19:30:13.580325] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-28T19:30:13.956278] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:30:14.380233] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-28T19:30:14.432394] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-28T19:30:15.180333] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-28T19:30:15.634699] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T19:30:15.796193] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:30:15.980291] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-28T19:30:16.758350] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-10-28T19:30:16.780228] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-28T19:30:17.580346] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-28T19:30:17.965042] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T19:30:18.380266] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-28T19:30:18.861564] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:30:19.180276] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-28T19:30:19.466193] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (3.49 seconds). [2025-10-28T19:30:19.474747] [INFO ] [REMOTE ] JBTM: Full fetch complete (46913 records). [2025-10-28T19:30:19.474967] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-28T19:30:19.813545] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T19:30:19.913155] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-28T19:30:19.913407] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-28T19:30:19.914920] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-28T19:30:19.915001] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-28T19:30:19.946912] [DEBUG] [LOCAL ] JBTM: Trimmed 46913 records to 33118 (keeping 200 days of data) [2025-10-28T19:30:19.948341] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T19:30:20.016577] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-28T19:30:20.191324] [DEBUG] [LOCAL ] JBTM: Primary data saved (33118 records). [2025-10-28T19:30:20.191509] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-28T19:30:20.191607] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JBTM took 32.9s. Estimated remaining: 2h 40m 16s. Rate: 7.6 symbols/min [2025-10-28T19:30:20.368547] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:20.419193] [DEBUG] [LOCAL ] JEF: Loaded 50159 existing records from primary storage. [2025-10-28T19:30:20.419595] [INFO ] [MAIN ] JEF: Loaded 50159 existing records. [2025-10-28T19:30:20.596369] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:20.596683] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-28T19:30:20.596749] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-28T19:30:20.597426] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-28T19:30:20.597488] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-28T19:30:20.787540] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-28T19:30:20.966392] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:21.588933] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-28T19:30:21.594425] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T19:30:22.123694] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:30:22.270118] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T19:30:22.272629] [INFO ] [REMOTE ] JCE: Full fetch complete (9591 records). [2025-10-28T19:30:22.272731] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-28T19:30:22.385421] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-28T19:30:22.658909] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-28T19:30:22.658997] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-28T19:30:22.659252] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-28T19:30:22.659295] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-28T19:30:22.659889] [DEBUG] [LOCAL ] JCE: Trimmed 9591 records to 7103 (keeping 200 days of data) [2025-10-28T19:30:22.707125] [DEBUG] [LOCAL ] JCE: Primary data saved (7103 records). [2025-10-28T19:30:22.707244] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-28T19:30:22.707319] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCE took 25.8s. Estimated remaining: 2h 40m 2s. Rate: 7.6 symbols/min [2025-10-28T19:30:22.871133] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:22.908700] [DEBUG] [LOCAL ] JELD: Loaded 45579 existing records from primary storage. [2025-10-28T19:30:22.908974] [INFO ] [MAIN ] JELD: Loaded 45579 existing records. [2025-10-28T19:30:23.083547] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:23.083765] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-28T19:30:23.083812] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-28T19:30:23.084535] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-28T19:30:23.084591] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-28T19:30:23.183068] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-28T19:30:23.431138] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:23.742555] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T19:30:23.980235] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-28T19:30:24.780261] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-28T19:30:25.592349] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-28T19:30:25.821762] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T19:30:26.380303] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-28T19:30:27.324250] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T19:30:27.333364] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-28T19:30:28.479370] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T19:30:28.490044] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-28T19:30:29.649934] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:30:29.660421] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-28T19:30:29.729553] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (6.55 seconds). [2025-10-28T19:30:29.740486] [INFO ] [REMOTE ] JBL: Full fetch complete (70535 records). [2025-10-28T19:30:29.740698] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-28T19:30:30.155552] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-28T19:30:30.155627] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-28T19:30:30.156740] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-28T19:30:30.156816] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-28T19:30:30.158169] [DEBUG] [LOCAL ] JBL: Trimmed 70535 records to 48163 (keeping 200 days of data) [2025-10-28T19:30:30.449717] [DEBUG] [LOCAL ] JBL: Primary data saved (48163 records). [2025-10-28T19:30:30.449824] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-28T19:30:30.450537] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JBL took 49.9s. Estimated remaining: 2h 39m 54s. Rate: 7.6 symbols/min [2025-10-28T19:30:30.620731] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:30.650965] [DEBUG] [LOCAL ] JFR: Loaded 30827 existing records from primary storage. [2025-10-28T19:30:30.651216] [INFO ] [MAIN ] JFR: Loaded 30827 existing records. [2025-10-28T19:30:30.839229] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:30.839835] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-28T19:30:30.839991] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-28T19:30:30.840631] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-28T19:30:30.840761] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-28T19:30:31.054233] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:30:31.148945] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-28T19:30:31.247510] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:31.247884] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-28T19:30:32.212493] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:30:32.251944] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:30:32.249960] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-28T19:30:32.260798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-28T19:30:33.401019] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:30:33.411019] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-28T19:30:34.626666] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:30:34.636709] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-28T19:30:35.686753] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:30:35.696593] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-28T19:30:35.978139] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (12.00 seconds). [2025-10-28T19:30:35.988444] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-28T19:30:36.927434] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T19:30:36.936553] [INFO ] [REMOTE ] JELD: Full fetch complete (64533 records). [2025-10-28T19:30:36.936761] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-28T19:30:37.337931] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-28T19:30:37.338037] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-28T19:30:37.339144] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-28T19:30:37.339253] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-28T19:30:37.340902] [DEBUG] [LOCAL ] JELD: Trimmed 64533 records to 45524 (keeping 200 days of data) [2025-10-28T19:30:37.524369] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T19:30:37.575724] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-28T19:30:37.635878] [DEBUG] [LOCAL ] JELD: Primary data saved (45524 records). [2025-10-28T19:30:37.636030] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-28T19:30:37.636130] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JELD took 14.9s. Estimated remaining: 2h 39m 46s. Rate: 7.6 symbols/min [2025-10-28T19:30:37.808768] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:37.821056] [DEBUG] [LOCAL ] JGH: Loaded 12378 existing records from primary storage. [2025-10-28T19:30:37.821309] [INFO ] [MAIN ] JGH: Loaded 12378 existing records. [2025-10-28T19:30:38.003404] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:38.003629] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-28T19:30:38.003723] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-28T19:30:38.004086] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-28T19:30:38.004147] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-28T19:30:38.368995] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:38.369273] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-28T19:30:38.911377] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:30:38.913437] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:30:38.916302] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-28T19:30:38.928172] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-28T19:30:39.350714] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T19:30:39.352333] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (13.76 seconds). [2025-10-28T19:30:39.355057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-28T19:30:39.907899] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T19:30:39.980203] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-28T19:30:40.143193] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T19:30:40.500313] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:30:40.780254] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-28T19:30:41.580238] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-28T19:30:42.116753] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T19:30:42.380229] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-28T19:30:42.447405] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (10.19 seconds). [2025-10-28T19:30:43.180289] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-28T19:30:43.307229] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:30:43.980261] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-28T19:30:44.780224] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-28T19:30:45.061736] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:30:45.260618] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:30:45.580274] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-28T19:30:45.894958] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (4.31 seconds). [2025-10-28T19:30:46.380369] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-28T19:30:47.180327] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-28T19:30:47.725145] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T19:30:47.756756] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:30:47.980271] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-28T19:30:48.780275] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-28T19:30:49.206638] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:30:49.351406] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:30:49.580260] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-28T19:30:49.809719] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (6.63 seconds). [2025-10-28T19:30:50.380298] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-28T19:30:50.927061] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T19:30:50.959066] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T19:30:51.180209] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-28T19:30:51.980272] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-28T19:30:52.068540] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:30:52.073123] [INFO ] [REMOTE ] JGH: Full fetch complete (16464 records). [2025-10-28T19:30:52.073199] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-28T19:30:52.444095] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-28T19:30:52.444166] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-28T19:30:52.444519] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-28T19:30:52.444557] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-28T19:30:52.445073] [DEBUG] [LOCAL ] JGH: Trimmed 16464 records to 12300 (keeping 200 days of data) [2025-10-28T19:30:52.517183] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (6.94 seconds). [2025-10-28T19:30:52.544438] [DEBUG] [LOCAL ] JGH: Primary data saved (12300 records). [2025-10-28T19:30:52.544544] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-28T19:30:52.544619] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JGH took 14.9s. Estimated remaining: 2h 39m 45s. Rate: 7.6 symbols/min [2025-10-28T19:30:52.718973] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:52.758037] [DEBUG] [LOCAL ] JHG: Loaded 47426 existing records from primary storage. [2025-10-28T19:30:52.758310] [INFO ] [MAIN ] JHG: Loaded 47426 existing records. [2025-10-28T19:30:52.788684] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-28T19:30:52.936992] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:52.937198] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-28T19:30:52.937242] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-28T19:30:52.938061] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-28T19:30:52.938118] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-28T19:30:53.299079] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:53.328974] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T19:30:53.580250] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-28T19:30:54.122348] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:30:54.380279] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-28T19:30:54.615518] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T19:30:55.180249] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-28T19:30:55.242988] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T19:30:55.980302] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-28T19:30:56.313252] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:30:56.780312] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-28T19:30:57.426211] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T19:30:57.438456] [INFO ] [REMOTE ] JCI: Full fetch complete (77650 records). [2025-10-28T19:30:57.438759] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-28T19:30:57.588382] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-28T19:30:57.842528] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-28T19:30:57.842752] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-28T19:30:57.843954] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-28T19:30:57.844021] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-28T19:30:57.845491] [DEBUG] [LOCAL ] JCI: Trimmed 77650 records to 53505 (keeping 200 days of data) [2025-10-28T19:30:58.094408] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:30:58.219985] [DEBUG] [LOCAL ] JCI: Primary data saved (53505 records). [2025-10-28T19:30:58.220124] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-28T19:30:58.220202] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JCI took 47.0s. Estimated remaining: 2h 39m 35s. Rate: 7.6 symbols/min [2025-10-28T19:30:58.387222] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:58.385446] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-28T19:30:58.393770] [DEBUG] [LOCAL ] JHI: Loaded 4048 existing records from primary storage. [2025-10-28T19:30:58.393938] [INFO ] [MAIN ] JHI: Loaded 4048 existing records. [2025-10-28T19:30:58.568244] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:58.568485] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-28T19:30:58.568534] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-28T19:30:58.568740] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-28T19:30:58.568799] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-28T19:30:58.915983] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:59.028338] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:30:59.038971] [INFO ] [REMOTE ] JEF: Full fetch complete (73295 records). [2025-10-28T19:30:59.039109] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-28T19:30:59.185515] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-28T19:30:59.455278] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-28T19:30:59.455360] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-28T19:30:59.456377] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-28T19:30:59.456447] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-28T19:30:59.457834] [DEBUG] [LOCAL ] JEF: Trimmed 73295 records to 50140 (keeping 200 days of data) [2025-10-28T19:30:59.672827] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T19:30:59.790583] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:30:59.813223] [DEBUG] [LOCAL ] JEF: Primary data saved (50140 records). [2025-10-28T19:30:59.813350] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-28T19:30:59.814132] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JEF took 39.6s. Estimated remaining: 2h 39m 20s. Rate: 7.6 symbols/min [2025-10-28T19:30:59.980750] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-28T19:30:59.980673] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:59.989477] [DEBUG] [LOCAL ] JHS: Loaded 2985 existing records from primary storage. [2025-10-28T19:30:59.989736] [INFO ] [MAIN ] JHS: Loaded 2985 existing records. [2025-10-28T19:31:00.165817] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:00.166111] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-28T19:31:00.166163] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-28T19:31:00.166327] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-28T19:31:00.166366] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-28T19:31:00.510638] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:00.780278] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-28T19:31:01.154543] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:31:01.403749] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:31:01.580253] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-28T19:31:02.380243] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-28T19:31:02.583799] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:31:02.721824] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T19:31:03.180257] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-28T19:31:03.980222] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-28T19:31:04.128746] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T19:31:04.569568] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T19:31:04.780299] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-28T19:31:05.169749] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T19:31:05.580290] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-28T19:31:06.380316] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-28T19:31:06.526922] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T19:31:06.827160] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T19:31:07.180300] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-28T19:31:07.980252] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-28T19:31:08.247712] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:31:08.780243] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-28T19:31:09.580253] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-28T19:31:09.990242] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T19:31:10.380313] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-28T19:31:10.650831] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-28T19:31:10.779709] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:31:11.180269] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-28T19:31:11.549889] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:31:11.579167] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:31:11.980257] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-28T19:31:12.780340] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-28T19:31:13.083156] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T19:31:13.580237] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-28T19:31:14.380319] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-28T19:31:14.503190] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:31:14.759127] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:31:15.180245] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-28T19:31:15.980266] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-28T19:31:16.469010] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:31:16.476547] [INFO ] [REMOTE ] JFR: Full fetch complete (48539 records). [2025-10-28T19:31:16.476722] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-28T19:31:16.785381] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-28T19:31:16.867724] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-28T19:31:16.867802] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-28T19:31:16.868581] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-28T19:31:16.868620] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-28T19:31:16.869545] [DEBUG] [LOCAL ] JFR: Trimmed 48539 records to 30734 (keeping 200 days of data) [2025-10-28T19:31:17.044068] [DEBUG] [LOCAL ] JFR: Primary data saved (30734 records). [2025-10-28T19:31:17.044190] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-28T19:31:17.044269] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JFR took 46.6s. Estimated remaining: 2h 39m 22s. Rate: 7.6 symbols/min [2025-10-28T19:31:17.220140] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:17.220723] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T19:31:17.269608] [DEBUG] [LOCAL ] JHX: Loaded 53186 existing records from primary storage. [2025-10-28T19:31:17.269921] [INFO ] [MAIN ] JHX: Loaded 53186 existing records. [2025-10-28T19:31:17.449085] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:17.449309] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-28T19:31:17.449366] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-28T19:31:17.449910] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-28T19:31:17.449968] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-28T19:31:17.595060] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-28T19:31:17.824819] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:18.021718] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T19:31:18.274054] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (6.29 seconds). [2025-10-28T19:31:18.380239] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-28T19:31:18.669027] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-28T19:31:19.180274] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-28T19:31:19.517799] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T19:31:19.980263] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-28T19:31:20.342549] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T19:31:20.780298] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-28T19:31:21.481541] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:31:21.483637] [INFO ] [REMOTE ] JHI: Full fetch complete (5807 records). [2025-10-28T19:31:21.483748] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-28T19:31:21.585348] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-28T19:31:21.869681] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-28T19:31:21.869771] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-28T19:31:21.869960] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-28T19:31:21.870049] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-28T19:31:21.870424] [DEBUG] [LOCAL ] JHI: Trimmed 5807 records to 4056 (keeping 200 days of data) [2025-10-28T19:31:21.894426] [DEBUG] [LOCAL ] JHI: Primary data saved (4056 records). [2025-10-28T19:31:21.894523] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-28T19:31:21.894600] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JHI took 23.7s. Estimated remaining: 2h 39m 11s. Rate: 7.6 symbols/min [2025-10-28T19:31:22.064909] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:22.081481] [DEBUG] [LOCAL ] JILL: Loaded 15011 existing records from primary storage. [2025-10-28T19:31:22.081775] [INFO ] [MAIN ] JILL: Loaded 15011 existing records. [2025-10-28T19:31:22.263975] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:22.264160] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-28T19:31:22.264206] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-28T19:31:22.264386] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-28T19:31:22.264427] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-28T19:31:22.385407] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-28T19:31:22.631696] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:22.909315] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:31:23.055401] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:31:23.180250] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-28T19:31:23.524107] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (5.14 seconds). [2025-10-28T19:31:23.533931] [INFO ] [REMOTE ] JHG: Full fetch complete (68828 records). [2025-10-28T19:31:23.534094] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-28T19:31:23.852154] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:31:23.950726] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-28T19:31:23.950802] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-28T19:31:23.951744] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-28T19:31:23.951803] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-28T19:31:23.953053] [DEBUG] [LOCAL ] JHG: Trimmed 68828 records to 47435 (keeping 200 days of data) [2025-10-28T19:31:24.004557] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-28T19:31:24.234533] [DEBUG] [LOCAL ] JHG: Primary data saved (47435 records). [2025-10-28T19:31:24.234679] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-28T19:31:24.234787] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHG took 31.7s. Estimated remaining: 2h 38m 58s. Rate: 7.6 symbols/min [2025-10-28T19:31:24.407661] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:24.443887] [DEBUG] [LOCAL ] JKS: Loaded 38863 existing records from primary storage. [2025-10-28T19:31:24.444173] [INFO ] [MAIN ] JKS: Loaded 38863 existing records. [2025-10-28T19:31:24.627769] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:24.628060] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-28T19:31:24.628133] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-28T19:31:24.634927] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-28T19:31:24.635021] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-28T19:31:24.640930] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:31:24.789049] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-28T19:31:24.993470] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:25.580280] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-28T19:31:25.593055] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T19:31:26.380263] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-28T19:31:26.688850] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:31:26.932195] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T19:31:27.180304] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-28T19:31:27.827887] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:31:27.980300] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-28T19:31:28.318014] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T19:31:28.319237] [INFO ] [REMOTE ] JHS: Full fetch complete (4581 records). [2025-10-28T19:31:28.319304] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-28T19:31:28.674742] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-28T19:31:28.674830] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-28T19:31:28.675007] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-28T19:31:28.675068] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-28T19:31:28.675414] [DEBUG] [LOCAL ] JHS: Trimmed 4581 records to 2960 (keeping 200 days of data) [2025-10-28T19:31:28.692772] [DEBUG] [LOCAL ] JHS: Primary data saved (2960 records). [2025-10-28T19:31:28.692841] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-28T19:31:28.692907] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JHS took 28.9s. Estimated remaining: 2h 38m 46s. Rate: 7.6 symbols/min [2025-10-28T19:31:28.788028] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-28T19:31:28.861334] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:28.893316] [DEBUG] [LOCAL ] JLL: Loaded 31094 existing records from primary storage. [2025-10-28T19:31:28.893560] [INFO ] [MAIN ] JLL: Loaded 31094 existing records. [2025-10-28T19:31:29.067449] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:29.067724] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-28T19:31:29.067785] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-28T19:31:29.068153] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-28T19:31:29.068211] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-28T19:31:29.415900] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:29.580221] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-28T19:31:30.133124] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:31:30.380236] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-28T19:31:31.180215] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-28T19:31:31.980215] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-28T19:31:32.020679] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T19:31:32.716406] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (3.93 seconds). [2025-10-28T19:31:32.780228] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-28T19:31:32.821721] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T19:31:33.580258] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-28T19:31:33.867802] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T19:31:33.918489] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (3.54 seconds). [2025-10-28T19:31:34.380218] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-28T19:31:34.564725] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:31:35.075879] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:31:35.180211] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-28T19:31:35.848853] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:31:35.980239] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-28T19:31:36.577811] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T19:31:36.780248] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-28T19:31:37.419376] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:31:37.580239] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-28T19:31:38.351101] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:31:38.354029] [INFO ] [REMOTE ] JILL: Full fetch complete (22259 records). [2025-10-28T19:31:38.354104] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-28T19:31:38.385292] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-28T19:31:38.715730] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-28T19:31:38.716386] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-28T19:31:38.716905] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-28T19:31:38.716965] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-28T19:31:38.717565] [DEBUG] [LOCAL ] JILL: Trimmed 22259 records to 14956 (keeping 200 days of data) [2025-10-28T19:31:38.805940] [DEBUG] [LOCAL ] JILL: Primary data saved (14956 records). [2025-10-28T19:31:38.806107] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-28T19:31:38.806190] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JILL took 16.9s. Estimated remaining: 2h 38m 41s. Rate: 7.6 symbols/min [2025-10-28T19:31:38.973803] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:38.980411] [DEBUG] [LOCAL ] JLS: Loaded 3941 existing records from primary storage. [2025-10-28T19:31:38.980564] [INFO ] [MAIN ] JLS: Loaded 3941 existing records. [2025-10-28T19:31:39.152236] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:39.152462] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-28T19:31:39.152510] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-28T19:31:39.152905] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-28T19:31:39.152962] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-28T19:31:39.185394] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-28T19:31:39.515055] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:39.628445] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:31:39.980269] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-28T19:31:40.522582] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:31:40.748706] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T19:31:40.780307] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-28T19:31:41.169533] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:31:41.580278] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-28T19:31:42.380242] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-28T19:31:42.775134] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:31:43.180252] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-28T19:31:43.438417] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:31:43.980309] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-28T19:31:44.235451] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:31:44.356541] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T19:31:44.780315] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-28T19:31:45.418016] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T19:31:45.580280] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-28T19:31:46.380316] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-28T19:31:46.788183] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T19:31:46.934143] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:31:47.180316] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-28T19:31:47.238709] [DEBUG] [REMOTE ] JLS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-28T19:31:47.239068] [WARN ] [REMOTE ] JLS: No data returned for month 2025-05 [2025-10-28T19:31:47.239158] [FATAL] [REMOTE ] JLS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:31:47.239230] [FATAL] [MAIN ] JLS: Failed to fetch primary data. [2025-10-28T19:31:47.239292] [WARN ] [MAIN ] JLS: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:31:47.239366] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-28T19:31:47.239428] [DEBUG] [LOCAL ] JLS: No primary data file found to delete. [2025-10-28T19:31:47.239464] [INFO ] [LOCAL ] JLS: Starting deletion of derivative data. [2025-10-28T19:31:47.239618] [DEBUG] [LOCAL ] JLS: Deleted derivative data file. [2025-10-28T19:31:47.239732] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JLS took 8.4s. Estimated remaining: 2h 38m 33s. Rate: 7.6 symbols/min [2025-10-28T19:31:47.980223] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-28T19:31:48.780318] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-28T19:31:49.580255] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-28T19:31:50.591409] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:31:50.598382] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-28T19:31:56.163139] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (8.18 seconds). [2025-10-28T19:31:56.173879] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-28T19:31:57.587000] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:31:57.599515] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-28T19:31:58.717626] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (9.94 seconds). [2025-10-28T19:31:58.726595] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-28T19:31:59.094967] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T19:31:59.108044] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-28T19:31:59.931801] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T19:31:59.941187] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-28T19:32:00.500059] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:32:00.511355] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-28T19:32:01.189099] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (10.59 seconds). [2025-10-28T19:32:01.196447] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-28T19:32:02.275188] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:32:02.284815] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-28T19:32:03.224344] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:32:03.234624] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-28T19:32:04.503893] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (4.56 seconds). [2025-10-28T19:32:04.512697] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-28T19:32:05.591590] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:32:05.602415] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-28T19:32:06.269266] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-28T19:32:06.274765] [INFO ] [REMOTE ] JLL: Full fetch complete (44936 records). [2025-10-28T19:32:06.274880] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-28T19:32:06.657918] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-28T19:32:06.658017] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-28T19:32:06.658962] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-28T19:32:06.659050] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-28T19:32:06.660247] [DEBUG] [LOCAL ] JLL: Trimmed 44936 records to 30962 (keeping 200 days of data) [2025-10-28T19:32:06.859850] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T19:32:06.870880] [INFO ] [REMOTE ] JKS: Full fetch complete (58426 records). [2025-10-28T19:32:06.881938] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-28T19:32:06.881839] [DEBUG] [LOCAL ] JLL: Primary data saved (30962 records). [2025-10-28T19:32:06.882242] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-28T19:32:06.882429] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JLL took 38.2s. Estimated remaining: 2h 38m 38s. Rate: 7.6 symbols/min [2025-10-28T19:32:07.290943] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-28T19:32:07.291023] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-28T19:32:07.291919] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-28T19:32:07.291985] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-28T19:32:07.293204] [DEBUG] [LOCAL ] JKS: Trimmed 58426 records to 38705 (keeping 200 days of data) [2025-10-28T19:32:07.522422] [DEBUG] [LOCAL ] JKS: Primary data saved (38705 records). [2025-10-28T19:32:07.522564] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-28T19:32:07.522665] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JKS took 43.3s. Estimated remaining: 2h 38m 22s. Rate: 7.6 symbols/min [2025-10-28T19:32:10.385486] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (9.87 seconds). [2025-10-28T19:32:10.396928] [INFO ] [REMOTE ] JHX: Full fetch complete (63700 records). [2025-10-28T19:32:10.397108] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-28T19:32:10.849331] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-28T19:32:10.849444] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-28T19:32:10.850593] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-28T19:32:10.850681] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-28T19:32:10.852172] [DEBUG] [LOCAL ] JHX: Trimmed 63700 records to 53186 (keeping 200 days of data) [2025-10-28T19:32:11.188465] [DEBUG] [LOCAL ] JHX: Primary data saved (53186 records). [2025-10-28T19:32:11.188595] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-28T19:32:11.188695] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JHX took 54.1s. Estimated remaining: 2h 38m 10s. Rate: 7.6 symbols/min [2025-10-28T19:32:11.800594] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.981516] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.979840] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.984013] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.984693] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-28T19:32:11.984845] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-28T19:32:11.985057] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-28T19:32:11.985106] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-28T19:32:11.985148] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-28T19:32:11.985179] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-28T19:32:12.331828] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-28T19:32:12.345302] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-28T19:32:12.406362] [DEBUG] [LOCAL ] JMIA: Loaded 51192 existing records from primary storage. [2025-10-28T19:32:12.448679] [INFO ] [MAIN ] JMIA: Loaded 51192 existing records. [2025-10-28T19:32:12.589438] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-28T19:32:12.543751] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:12.651985] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-28T19:32:12.652139] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-28T19:32:12.817318] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:12.919116] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:12.916041] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-28T19:32:12.941773] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-28T19:32:12.941873] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-28T19:32:12.947033] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-28T19:32:12.968709] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-28T19:32:12.958409] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-28T19:32:12.974053] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-28T19:32:12.973990] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-28T19:32:13.207711] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T19:32:13.299689] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:13.311532] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-28T19:32:13.311850] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-28T19:32:13.322704] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-28T19:32:13.475600] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-28T19:32:13.480923] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-28T19:32:13.779497] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T19:32:13.805114] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-28T19:32:13.957349] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:13.971182] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:13.992508] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-28T19:32:13.993059] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-28T19:32:14.230199] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:14.233957] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-28T19:32:14.234159] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:32:14.236384] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-28T19:32:14.559558] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-28T19:32:14.560665] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-28T19:32:14.850244] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T19:32:14.851572] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-28T19:32:15.138846] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T19:32:15.140133] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-28T19:32:15.367502] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:32:15.377313] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-28T19:32:15.710125] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T19:32:15.711381] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-28T19:32:16.081596] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T19:32:16.082993] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-28T19:32:16.084285] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T19:32:16.096260] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-28T19:32:16.299800] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-28T19:32:16.310051] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-28T19:32:16.381833] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T19:32:16.382850] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-28T19:32:16.541011] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:32:16.550566] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-28T19:32:16.792087] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T19:32:16.792913] [INFO ] [REMOTE ] JMM: Full fetch complete (2325 records). [2025-10-28T19:32:16.792979] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-28T19:32:16.966387] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T19:32:16.966566] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:32:16.966611] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:32:16.966675] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-28T19:32:16.966748] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-28T19:32:16.966784] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-28T19:32:16.966823] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-28T19:32:16.966875] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JMM took 5.8s. Estimated remaining: 2h 38m 0s. Rate: 7.6 symbols/min [2025-10-28T19:32:17.130801] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:17.152321] [DEBUG] [LOCAL ] JOE: Loaded 23241 existing records from primary storage. [2025-10-28T19:32:17.152549] [INFO ] [MAIN ] JOE: Loaded 23241 existing records. [2025-10-28T19:32:17.325798] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:17.326040] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-28T19:32:17.326096] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-28T19:32:17.326348] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-28T19:32:17.326407] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-28T19:32:17.682804] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:17.683264] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-28T19:32:17.714220] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T19:32:17.724371] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-28T19:32:17.869141] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:32:17.879840] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-28T19:32:18.340718] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-28T19:32:18.350939] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-28T19:32:18.384299] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:32:18.390460] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-28T19:32:19.109966] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:32:19.120813] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-28T19:32:19.418960] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T19:32:19.431821] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-28T19:32:20.650474] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T19:32:20.661566] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-28T19:32:21.183950] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T19:32:21.196200] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-28T19:32:21.955779] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (3.57 seconds). [2025-10-28T19:32:21.960674] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-28T19:32:22.014694] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T19:32:22.025065] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-28T19:32:23.090978] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T19:32:23.102416] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-28T19:32:23.425356] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T19:32:23.436350] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-28T19:32:24.895148] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:32:24.907359] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-28T19:32:27.613635] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (5.65 seconds). [2025-10-28T19:32:27.621704] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-28T19:32:28.642916] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:32:28.649039] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-28T19:32:29.487113] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:32:29.493482] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-28T19:32:31.666805] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (13.32 seconds). [2025-10-28T19:32:31.677954] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-28T19:32:37.394391] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (14.29 seconds). [2025-10-28T19:32:37.405162] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-28T19:32:39.169454] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T19:32:39.181290] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-28T19:32:42.206727] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (17.30 seconds). [2025-10-28T19:32:42.217849] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-28T19:32:44.224994] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (14.73 seconds). [2025-10-28T19:32:44.231124] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-28T19:32:45.067545] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T19:32:45.073723] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-28T19:32:53.367194] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (11.15 seconds). [2025-10-28T19:32:53.377977] [INFO ] [REMOTE ] JMIA: Full fetch complete (73495 records). [2025-10-28T19:32:53.378130] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-28T19:32:53.765695] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-28T19:32:53.765782] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-28T19:32:53.766882] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-28T19:32:53.766947] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-28T19:32:53.768310] [DEBUG] [LOCAL ] JMIA: Trimmed 73495 records to 51198 (keeping 200 days of data) [2025-10-28T19:32:54.084191] [DEBUG] [LOCAL ] JMIA: Primary data saved (51198 records). [2025-10-28T19:32:54.084371] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-28T19:32:54.084476] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JMIA took 42.9s. Estimated remaining: 2h 38m 23s. Rate: 7.6 symbols/min [2025-10-28T19:32:54.263589] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:54.272553] [DEBUG] [LOCAL ] JOF: Loaded 6868 existing records from primary storage. [2025-10-28T19:32:54.272806] [INFO ] [MAIN ] JOF: Loaded 6868 existing records. [2025-10-28T19:32:54.448605] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:54.448877] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-28T19:32:54.448925] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-28T19:32:54.449116] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-28T19:32:54.449157] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-28T19:32:54.806765] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:54.807106] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-28T19:32:55.113498] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (23.44 seconds). [2025-10-28T19:32:55.125486] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-28T19:32:55.211754] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T19:32:55.213298] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-28T19:32:55.579159] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T19:32:55.580918] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-28T19:32:56.173428] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T19:32:56.176713] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-28T19:32:56.648129] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T19:32:56.652038] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-28T19:32:57.047114] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T19:32:57.050393] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-28T19:32:57.332635] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-28T19:32:57.343953] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-28T19:32:57.497145] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:32:57.499221] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-28T19:32:57.913887] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T19:32:57.916003] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-28T19:32:58.427832] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T19:32:58.430797] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-28T19:32:59.399634] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-28T19:32:59.410433] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-28T19:33:00.826504] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-28T19:33:00.829340] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-28T19:33:01.430588] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T19:33:01.434266] [INFO ] [REMOTE ] JOF: Full fetch complete (9582 records). [2025-10-28T19:33:01.434430] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-28T19:33:01.835785] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-28T19:33:01.836220] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-28T19:33:01.836578] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-28T19:33:01.836791] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-28T19:33:01.837787] [DEBUG] [LOCAL ] JOF: Trimmed 9582 records to 6891 (keeping 200 days of data) [2025-10-28T19:33:01.878810] [DEBUG] [LOCAL ] JOF: Primary data saved (6891 records). [2025-10-28T19:33:01.879036] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-28T19:33:01.879256] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JOF took 7.8s. Estimated remaining: 2h 38m 15s. Rate: 7.6 symbols/min [2025-10-28T19:33:01.982867] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-28T19:33:02.025861] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-28T19:33:02.090525] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:02.124263] [DEBUG] [LOCAL ] JPC: Loaded 36745 existing records from primary storage. [2025-10-28T19:33:02.124539] [INFO ] [MAIN ] JPC: Loaded 36745 existing records. [2025-10-28T19:33:02.296823] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:02.297017] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-28T19:33:02.297064] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-28T19:33:02.297464] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-28T19:33:02.297520] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-28T19:33:02.662974] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:02.663298] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-28T19:33:03.774595] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:33:03.783201] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-28T19:33:04.116410] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T19:33:04.127993] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-28T19:33:06.166640] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-28T19:33:06.178250] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-28T19:33:06.993597] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (27.81 seconds). [2025-10-28T19:33:07.005201] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-28T19:33:08.799067] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T19:33:08.810774] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-28T19:33:09.084820] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (24.01 seconds). [2025-10-28T19:33:09.089987] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-28T19:33:09.787836] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T19:33:09.793561] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-28T19:33:10.960249] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-28T19:33:10.971143] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-28T19:33:10.971301] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-28T19:33:11.372207] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-28T19:33:11.372274] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-28T19:33:11.373288] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-28T19:33:11.373349] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-28T19:33:11.374723] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-28T19:33:11.707432] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-28T19:33:11.707578] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-28T19:33:11.707957] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JNJ took 1m 1s. Estimated remaining: 2h 38m 9s. Rate: 7.6 symbols/min [2025-10-28T19:33:11.875721] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:11.927140] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-28T19:33:11.927463] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-28T19:33:12.100996] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:12.101203] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-28T19:33:12.101248] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-28T19:33:12.101872] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-28T19:33:12.101928] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-28T19:33:12.453599] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:12.454012] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-28T19:33:12.964359] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-28T19:33:12.968841] [INFO ] [REMOTE ] JOE: Full fetch complete (35227 records). [2025-10-28T19:33:12.968920] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-28T19:33:13.345838] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-28T19:33:13.345912] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-28T19:33:13.346707] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-28T19:33:13.346768] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-28T19:33:13.347557] [DEBUG] [LOCAL ] JOE: Trimmed 35227 records to 23070 (keeping 200 days of data) [2025-10-28T19:33:13.484371] [DEBUG] [LOCAL ] JOE: Primary data saved (23070 records). [2025-10-28T19:33:13.484487] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-28T19:33:13.484568] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOE took 56.5s. Estimated remaining: 2h 37m 54s. Rate: 7.6 symbols/min [2025-10-28T19:33:13.661405] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:13.695861] [DEBUG] [LOCAL ] JQC: Loaded 33597 existing records from primary storage. [2025-10-28T19:33:13.696220] [INFO ] [MAIN ] JQC: Loaded 33597 existing records. [2025-10-28T19:33:13.884823] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:13.885070] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-28T19:33:13.885138] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-28T19:33:13.885563] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-28T19:33:13.885622] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-28T19:33:14.253973] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:14.254432] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-28T19:33:14.286155] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-28T19:33:14.298589] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-28T19:33:15.264266] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T19:33:15.272026] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-28T19:33:15.645495] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (9.47 seconds). [2025-10-28T19:33:15.660520] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-28T19:33:15.660749] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-28T19:33:16.038047] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (12.25 seconds). [2025-10-28T19:33:16.097249] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-28T19:33:16.120342] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-28T19:33:16.120561] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-28T19:33:16.121666] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-28T19:33:16.121959] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-28T19:33:16.140564] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-28T19:33:16.142160] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:33:16.149562] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-28T19:33:16.287065] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-28T19:33:16.304397] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-28T19:33:16.515260] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-28T19:33:16.515402] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-28T19:33:16.515486] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JOBY took 1m 5s. Estimated remaining: 2h 37m 42s. Rate: 7.6 symbols/min [2025-10-28T19:33:16.689947] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:16.706384] [DEBUG] [LOCAL ] JRI: Loaded 15041 existing records from primary storage. [2025-10-28T19:33:16.706740] [INFO ] [MAIN ] JRI: Loaded 15041 existing records. [2025-10-28T19:33:16.880765] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:16.880976] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-28T19:33:16.881023] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-28T19:33:16.881307] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-28T19:33:16.881366] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-28T19:33:17.251584] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:17.252364] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-28T19:33:17.285185] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:33:17.345111] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-28T19:33:17.348131] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T19:33:17.357062] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-28T19:33:18.048135] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:33:18.053169] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-28T19:33:18.151557] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-28T19:33:18.163069] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-28T19:33:18.200215] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T19:33:18.209446] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-28T19:33:18.382804] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T19:33:18.390885] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-28T19:33:19.188355] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T19:33:19.196317] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-28T19:33:19.255522] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T19:33:19.262607] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-28T19:33:19.921691] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T19:33:19.933923] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-28T19:33:20.127274] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T19:33:20.134713] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-28T19:33:21.116167] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:33:21.124465] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-28T19:33:21.324457] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (3.27 seconds). [2025-10-28T19:33:21.328443] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-28T19:33:21.925489] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:33:21.929463] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-28T19:33:21.985890] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T19:33:21.994883] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-28T19:33:22.612118] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T19:33:22.616694] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-28T19:33:22.934892] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:33:22.943099] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-28T19:33:23.265847] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:33:23.269376] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-28T19:33:23.839514] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T19:33:23.842962] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-28T19:33:24.472036] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:33:24.476636] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-28T19:33:25.000908] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (5.74 seconds). [2025-10-28T19:33:25.006825] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-28T19:33:25.019368] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T19:33:25.022594] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-28T19:33:25.659131] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:33:25.665471] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-28T19:33:26.037151] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:33:26.045777] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-28T19:33:26.518267] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:33:26.521910] [INFO ] [REMOTE ] JRI: Full fetch complete (22692 records). [2025-10-28T19:33:26.521994] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-28T19:33:26.895588] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-28T19:33:26.895723] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-28T19:33:26.896299] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-28T19:33:26.896383] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-28T19:33:26.897327] [DEBUG] [LOCAL ] JRI: Trimmed 22692 records to 15017 (keeping 200 days of data) [2025-10-28T19:33:26.998149] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T19:33:27.012603] [DEBUG] [LOCAL ] JRI: Primary data saved (15017 records). [2025-10-28T19:33:27.012870] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-28T19:33:27.020393] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JRI took 10.5s. Estimated remaining: 2h 37m 36s. Rate: 7.6 symbols/min [2025-10-28T19:33:27.064629] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-28T19:33:27.193166] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:27.205716] [DEBUG] [LOCAL ] JRS: Loaded 11423 existing records from primary storage. [2025-10-28T19:33:27.205947] [INFO ] [MAIN ] JRS: Loaded 11423 existing records. [2025-10-28T19:33:27.383978] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:27.384206] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-28T19:33:27.384272] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-28T19:33:27.384480] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-28T19:33:27.384521] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-28T19:33:27.734489] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:27.734817] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-28T19:33:28.068380] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:33:28.075791] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-28T19:33:28.101539] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:33:28.104315] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-28T19:33:28.604743] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T19:33:28.607431] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-28T19:33:29.089665] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T19:33:29.096957] [INFO ] [REMOTE ] JQC: Full fetch complete (50080 records). [2025-10-28T19:33:29.097049] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-28T19:33:29.205681] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:33:29.234454] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-28T19:33:29.487321] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-28T19:33:29.487402] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-28T19:33:29.488247] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-28T19:33:29.488309] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-28T19:33:29.489363] [DEBUG] [LOCAL ] JQC: Trimmed 50080 records to 33418 (keeping 200 days of data) [2025-10-28T19:33:29.681472] [DEBUG] [LOCAL ] JQC: Primary data saved (33418 records). [2025-10-28T19:33:29.681602] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-28T19:33:29.681700] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JQC took 16.2s. Estimated remaining: 2h 37m 23s. Rate: 7.6 symbols/min [2025-10-28T19:33:29.860925] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:33:29.864087] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:29.867159] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-28T19:33:29.907763] [DEBUG] [LOCAL ] JXN: Loaded 43924 existing records from primary storage. [2025-10-28T19:33:29.908049] [INFO ] [MAIN ] JXN: Loaded 43924 existing records. [2025-10-28T19:33:30.085548] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:30.085778] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-28T19:33:30.085830] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-28T19:33:30.086325] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-28T19:33:30.086384] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-28T19:33:30.436342] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:30.436707] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-28T19:33:33.169686] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (10.23 seconds). [2025-10-28T19:33:33.177583] [INFO ] [REMOTE ] JPC: Full fetch complete (54865 records). [2025-10-28T19:33:33.177745] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-28T19:33:33.594558] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-28T19:33:33.594669] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-28T19:33:33.595533] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-28T19:33:33.595686] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-28T19:33:33.596872] [DEBUG] [LOCAL ] JPC: Trimmed 54865 records to 36664 (keeping 200 days of data) [2025-10-28T19:33:33.781572] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (13.85 seconds). [2025-10-28T19:33:33.823401] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-28T19:33:33.854096] [DEBUG] [LOCAL ] JPC: Primary data saved (36664 records). [2025-10-28T19:33:33.854217] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-28T19:33:33.854296] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JPC took 32.0s. Estimated remaining: 2h 37m 11s. Rate: 7.6 symbols/min [2025-10-28T19:33:34.020899] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:34.067246] [DEBUG] [LOCAL ] K: Loaded 50265 existing records from primary storage. [2025-10-28T19:33:34.067590] [INFO ] [MAIN ] K: Loaded 50265 existing records. [2025-10-28T19:33:34.245690] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:34.245903] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-28T19:33:34.245950] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-28T19:33:34.246317] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-28T19:33:34.246359] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-28T19:33:34.604948] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:34.605310] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-28T19:33:35.246291] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (5.38 seconds). [2025-10-28T19:33:35.251037] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-28T19:33:35.472628] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T19:33:35.484195] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-28T19:33:35.756356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:33:35.766187] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-28T19:33:35.823203] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T19:33:35.827210] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-28T19:33:36.375405] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T19:33:36.379331] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-28T19:33:36.874832] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T19:33:36.884853] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-28T19:33:36.901826] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T19:33:36.905175] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-28T19:33:37.444313] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T19:33:37.456804] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-28T19:33:38.100534] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:33:38.110392] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-28T19:33:39.264963] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T19:33:39.276611] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-28T19:33:39.325088] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (8.89 seconds). [2025-10-28T19:33:39.333565] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-28T19:33:39.419902] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:33:39.430628] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-28T19:33:40.795553] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T19:33:40.806330] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-28T19:33:42.078258] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (5.17 seconds). [2025-10-28T19:33:42.081991] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-28T19:33:42.151391] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T19:33:42.163044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-28T19:33:42.756850] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:33:42.759802] [INFO ] [REMOTE ] JRS: Full fetch complete (16064 records). [2025-10-28T19:33:42.760001] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-28T19:33:43.138039] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-28T19:33:43.138148] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-28T19:33:43.138737] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-28T19:33:43.138802] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-28T19:33:43.139621] [DEBUG] [LOCAL ] JRS: Trimmed 16064 records to 11407 (keeping 200 days of data) [2025-10-28T19:33:43.214216] [DEBUG] [LOCAL ] JRS: Primary data saved (11407 records). [2025-10-28T19:33:43.214603] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-28T19:33:43.214821] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JRS took 16.2s. Estimated remaining: 2h 37m 5s. Rate: 7.6 symbols/min [2025-10-28T19:33:43.398178] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:43.432148] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T19:33:43.448410] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-28T19:33:43.456744] [DEBUG] [LOCAL ] KAI: Loaded 13227 existing records from primary storage. [2025-10-28T19:33:43.457099] [INFO ] [MAIN ] KAI: Loaded 13227 existing records. [2025-10-28T19:33:43.643598] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:43.643973] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-28T19:33:43.644036] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-28T19:33:43.644323] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-28T19:33:43.644384] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-28T19:33:44.024743] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:44.025123] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-28T19:33:44.601394] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T19:33:44.611990] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-28T19:33:44.706098] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:33:44.708406] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-28T19:33:45.510334] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:33:45.514337] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-28T19:33:47.884611] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-28T19:33:47.888141] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-28T19:33:48.582972] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:33:48.587280] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-28T19:33:48.982215] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (9.65 seconds). [2025-10-28T19:33:48.990845] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-28T19:33:49.255630] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:33:49.259609] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-28T19:33:50.369094] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:33:50.379766] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-28T19:33:51.510974] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T19:33:51.520984] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-28T19:33:52.699367] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:33:52.709340] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-28T19:33:57.639627] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (18.36 seconds). [2025-10-28T19:33:57.651551] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-28T19:33:59.754311] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T19:33:59.766000] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-28T19:33:59.766219] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-28T19:34:00.251582] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-28T19:34:00.252008] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-28T19:34:00.254347] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-28T19:34:00.254467] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-28T19:34:00.256792] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-28T19:34:00.738152] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-28T19:34:00.738305] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-28T19:34:00.739000] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. JPM took 49.0s. Estimated remaining: 2h 37m 7s. Rate: 7.6 symbols/min [2025-10-28T19:34:00.940962] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:00.984529] [DEBUG] [LOCAL ] KAR: Loaded 39580 existing records from primary storage. [2025-10-28T19:34:00.984866] [INFO ] [MAIN ] KAR: Loaded 39580 existing records. [2025-10-28T19:34:01.177003] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:01.177247] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-28T19:34:01.177335] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-28T19:34:01.178193] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-28T19:34:01.178253] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-28T19:34:01.556368] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:01.556744] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-28T19:34:02.756208] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T19:34:02.763185] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-28T19:34:03.718268] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:34:03.726350] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-28T19:34:04.734495] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T19:34:04.743173] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-28T19:34:05.821137] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:34:05.830057] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-28T19:34:06.855042] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T19:34:06.863306] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-28T19:34:09.333471] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (20.07 seconds). [2025-10-28T19:34:09.338167] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-28T19:34:09.969024] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:34:09.973055] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-28T19:34:10.522703] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T19:34:10.526383] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-28T19:34:12.901513] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (28.29 seconds). [2025-10-28T19:34:12.916774] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-28T19:34:15.139990] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (8.28 seconds). [2025-10-28T19:34:15.148931] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-28T19:34:16.243544] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:34:16.253508] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-28T19:34:17.297053] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:34:17.309024] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-28T19:34:18.329525] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:34:18.338687] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-28T19:34:18.434186] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (7.91 seconds). [2025-10-28T19:34:18.437318] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-28T19:34:19.203762] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (26.49 seconds). [2025-10-28T19:34:19.213685] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-28T19:34:19.502008] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:34:19.510093] [INFO ] [REMOTE ] KAR: Full fetch complete (57068 records). [2025-10-28T19:34:19.510224] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-28T19:34:19.891600] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-28T19:34:19.891704] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-28T19:34:19.892591] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-28T19:34:19.892675] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-28T19:34:19.893863] [DEBUG] [LOCAL ] KAR: Trimmed 57068 records to 39565 (keeping 200 days of data) [2025-10-28T19:34:20.114301] [DEBUG] [LOCAL ] KAR: Primary data saved (39565 records). [2025-10-28T19:34:20.114422] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-28T19:34:20.114499] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. KAR took 19.4s. Estimated remaining: 2h 37m 11s. Rate: 7.6 symbols/min [2025-10-28T19:34:20.287967] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:20.316306] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:34:20.326022] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-28T19:34:20.347815] [DEBUG] [LOCAL ] KB: Loaded 22731 existing records from primary storage. [2025-10-28T19:34:20.348065] [INFO ] [MAIN ] KB: Loaded 22731 existing records. [2025-10-28T19:34:20.579916] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:20.580143] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-28T19:34:20.580189] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-28T19:34:20.580671] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-28T19:34:20.580735] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-28T19:34:21.008793] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:21.009082] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-28T19:34:21.245324] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-28T19:34:21.248512] [INFO ] [REMOTE ] KAI: Full fetch complete (19426 records). [2025-10-28T19:34:21.248585] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-28T19:34:21.626539] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-28T19:34:21.626776] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-28T19:34:21.627245] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-28T19:34:21.627314] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-28T19:34:21.627996] [DEBUG] [LOCAL ] KAI: Trimmed 19426 records to 13188 (keeping 200 days of data) [2025-10-28T19:34:21.730940] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:34:21.747570] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-28T19:34:21.747212] [DEBUG] [LOCAL ] KAI: Primary data saved (13188 records). [2025-10-28T19:34:21.747743] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-28T19:34:21.747997] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KAI took 38.5s. Estimated remaining: 2h 36m 57s. Rate: 7.6 symbols/min [2025-10-28T19:34:21.914310] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:21.934774] [DEBUG] [LOCAL ] KBDC: Loaded 22512 existing records from primary storage. [2025-10-28T19:34:21.935013] [INFO ] [MAIN ] KBDC: Loaded 22512 existing records. [2025-10-28T19:34:22.106665] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:22.106858] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-28T19:34:22.106907] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-28T19:34:22.107351] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-28T19:34:22.107433] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-28T19:34:22.454617] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:22.454960] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-28T19:34:22.889424] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T19:34:22.898933] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-28T19:34:23.166423] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T19:34:23.170390] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-28T19:34:23.996386] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T19:34:24.004071] [INFO ] [REMOTE ] JXN: Full fetch complete (65158 records). [2025-10-28T19:34:24.004176] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-28T19:34:24.376393] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-28T19:34:24.376472] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-28T19:34:24.377339] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-28T19:34:24.377402] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-28T19:34:24.378614] [DEBUG] [LOCAL ] JXN: Trimmed 65158 records to 43769 (keeping 200 days of data) [2025-10-28T19:34:24.638244] [DEBUG] [LOCAL ] JXN: Primary data saved (43769 records). [2025-10-28T19:34:24.638363] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-28T19:34:24.638976] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. JXN took 55.0s. Estimated remaining: 2h 36m 44s. Rate: 7.6 symbols/min [2025-10-28T19:34:24.806853] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:24.854006] [DEBUG] [LOCAL ] KBH: Loaded 48545 existing records from primary storage. [2025-10-28T19:34:24.854335] [INFO ] [MAIN ] KBH: Loaded 48545 existing records. [2025-10-28T19:34:25.056232] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:25.056706] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-28T19:34:25.058255] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (12.14 seconds). [2025-10-28T19:34:25.057006] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-28T19:34:25.061714] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-28T19:34:25.067764] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-28T19:34:25.141897] [INFO ] [REMOTE ] K: Full fetch complete (72253 records). [2025-10-28T19:34:25.165128] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-28T19:34:25.688239] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:25.709076] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-28T19:34:25.829967] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-28T19:34:25.830042] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-28T19:34:25.831048] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-28T19:34:25.831110] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-28T19:34:25.832445] [DEBUG] [LOCAL ] K: Trimmed 72253 records to 50245 (keeping 200 days of data) [2025-10-28T19:34:26.142086] [DEBUG] [LOCAL ] K: Primary data saved (50245 records). [2025-10-28T19:34:26.142211] [INFO ] [MAIN ] K: Full history saved. [2025-10-28T19:34:26.142290] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. K took 52.3s. Estimated remaining: 2h 36m 29s. Rate: 7.6 symbols/min [2025-10-28T19:34:26.306701] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:26.349803] [DEBUG] [LOCAL ] KBR: Loaded 47929 existing records from primary storage. [2025-10-28T19:34:26.350088] [INFO ] [MAIN ] KBR: Loaded 47929 existing records. [2025-10-28T19:34:26.522889] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:26.523085] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-28T19:34:26.523131] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-28T19:34:26.523707] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-28T19:34:26.523763] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-28T19:34:26.872883] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:26.873270] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-28T19:34:26.913508] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (5.90 seconds). [2025-10-28T19:34:26.917688] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-28T19:34:27.147463] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T19:34:27.157159] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-28T19:34:27.686343] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:34:27.691234] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-28T19:34:28.243887] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:34:28.253294] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-28T19:34:28.354565] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:34:28.363854] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-28T19:34:29.599689] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:34:29.610012] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-28T19:34:30.839072] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:34:30.849618] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-28T19:34:31.438068] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (8.27 seconds). [2025-10-28T19:34:31.442000] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-28T19:34:32.019788] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:34:32.030048] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-28T19:34:32.170007] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:34:32.174979] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-28T19:34:32.927374] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:34:32.933012] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-28T19:34:33.220289] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:34:33.230307] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-28T19:34:33.592253] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T19:34:33.597268] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-28T19:34:34.213084] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T19:34:34.217279] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-28T19:34:34.494385] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:34:34.505517] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-28T19:34:35.627228] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:34:35.637568] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-28T19:34:35.837447] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (8.15 seconds). [2025-10-28T19:34:35.843708] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-28T19:34:36.639079] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T19:34:36.657921] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-28T19:34:36.660942] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (8.41 seconds). [2025-10-28T19:34:36.670783] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-28T19:34:36.765710] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:34:36.777901] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-28T19:34:37.585770] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:34:37.591718] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-28T19:34:37.841605] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T19:34:37.852049] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-28T19:34:37.906165] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:34:37.916034] [INFO ] [REMOTE ] KBH: Full fetch complete (70989 records). [2025-10-28T19:34:37.916197] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-28T19:34:38.315929] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-28T19:34:38.316126] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-28T19:34:38.317325] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-28T19:34:38.317462] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-28T19:34:38.319045] [DEBUG] [LOCAL ] KBH: Trimmed 70989 records to 48535 (keeping 200 days of data) [2025-10-28T19:34:38.586637] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:34:38.590402] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (4.37 seconds). [2025-10-28T19:34:38.601534] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-28T19:34:38.602166] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-28T19:34:38.656956] [DEBUG] [LOCAL ] KBH: Primary data saved (48535 records). [2025-10-28T19:34:38.657084] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-28T19:34:38.657708] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KBH took 14.0s. Estimated remaining: 2h 36m 26s. Rate: 7.6 symbols/min [2025-10-28T19:34:38.826740] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:38.878233] [DEBUG] [LOCAL ] KD: Loaded 52295 existing records from primary storage. [2025-10-28T19:34:38.878525] [INFO ] [MAIN ] KD: Loaded 52295 existing records. [2025-10-28T19:34:39.058603] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:39.058996] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-28T19:34:39.059227] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-28T19:34:39.059713] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-28T19:34:39.059771] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-28T19:34:39.397093] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T19:34:39.398008] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:34:39.466030] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-28T19:34:39.459827] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-28T19:34:39.499666] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:39.502033] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-28T19:34:39.521514] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:34:39.528790] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-28T19:34:40.313292] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T19:34:40.318561] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-28T19:34:40.369476] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T19:34:40.376156] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-28T19:34:40.744312] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:34:40.754854] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-28T19:34:40.847932] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T19:34:40.858209] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-28T19:34:41.113705] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T19:34:41.120168] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-28T19:34:41.247207] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:34:41.253826] [INFO ] [REMOTE ] KBDC: Full fetch complete (31293 records). [2025-10-28T19:34:41.253947] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-28T19:34:41.624668] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-28T19:34:41.624752] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-28T19:34:41.625458] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-28T19:34:41.625520] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-28T19:34:41.626288] [DEBUG] [LOCAL ] KBDC: Trimmed 31293 records to 22598 (keeping 200 days of data) [2025-10-28T19:34:41.758447] [DEBUG] [LOCAL ] KBDC: Primary data saved (22598 records). [2025-10-28T19:34:41.758566] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-28T19:34:41.758673] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBDC took 20.0s. Estimated remaining: 2h 36m 13s. Rate: 7.6 symbols/min [2025-10-28T19:34:41.929880] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:41.936710] [DEBUG] [LOCAL ] KEN: Loaded 4395 existing records from primary storage. [2025-10-28T19:34:41.936951] [INFO ] [MAIN ] KEN: Loaded 4395 existing records. [2025-10-28T19:34:42.071026] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T19:34:42.102969] [INFO ] [REMOTE ] KB: Full fetch complete (33246 records). [2025-10-28T19:34:42.129279] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-28T19:34:42.132100] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:42.132762] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-28T19:34:42.132969] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-28T19:34:42.144124] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-28T19:34:42.144445] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-28T19:34:42.636314] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T19:34:42.715603] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-28T19:34:42.886719] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-28T19:34:42.887372] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-28T19:34:42.888789] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-28T19:34:42.888868] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-28T19:34:42.909130] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:42.909562] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-28T19:34:42.910514] [DEBUG] [LOCAL ] KB: Trimmed 33246 records to 22618 (keeping 200 days of data) [2025-10-28T19:34:43.043350] [DEBUG] [LOCAL ] KB: Primary data saved (22618 records). [2025-10-28T19:34:43.043476] [INFO ] [MAIN ] KB: Full history saved. [2025-10-28T19:34:43.043553] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KB took 22.9s. Estimated remaining: 2h 35m 59s. Rate: 7.6 symbols/min [2025-10-28T19:34:43.209512] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:43.240742] [DEBUG] [LOCAL ] KEP: Loaded 32538 existing records from primary storage. [2025-10-28T19:34:43.241017] [INFO ] [MAIN ] KEP: Loaded 32538 existing records. [2025-10-28T19:34:43.414272] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:43.414425] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-28T19:34:43.414469] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-28T19:34:43.414886] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-28T19:34:43.414943] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-28T19:34:43.560596] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:34:43.606349] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-28T19:34:43.779898] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:43.780172] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-28T19:34:43.961729] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T19:34:43.962871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-28T19:34:44.051385] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:34:44.062357] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-28T19:34:44.586159] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T19:34:44.588082] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-28T19:34:44.919867] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T19:34:44.925480] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-28T19:34:45.063882] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T19:34:45.066256] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-28T19:34:45.702204] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:34:45.706885] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-28T19:34:46.461603] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T19:34:46.466419] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-28T19:34:48.006456] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (7.25 seconds). [2025-10-28T19:34:48.026130] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-28T19:34:50.114236] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T19:34:50.124954] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-28T19:34:51.505592] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (7.44 seconds). [2025-10-28T19:34:51.517122] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-28T19:34:51.544990] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T19:34:51.556604] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-28T19:34:51.883943] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (6.82 seconds). [2025-10-28T19:34:51.885493] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-28T19:34:52.295524] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T19:34:52.297294] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-28T19:34:52.744141] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:34:52.754170] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-28T19:34:52.762665] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:34:52.764356] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-28T19:34:53.116923] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T19:34:53.118409] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-28T19:34:53.216388] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T19:34:53.227721] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-28T19:34:54.063524] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (7.60 seconds). [2025-10-28T19:34:54.069661] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-28T19:34:54.525563] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T19:34:54.536723] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-28T19:34:54.770260] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T19:34:54.771685] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-28T19:34:54.962911] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:34:54.969635] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-28T19:34:55.089263] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T19:34:55.090500] [INFO ] [REMOTE ] KEN: Full fetch complete (5827 records). [2025-10-28T19:34:55.090570] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-28T19:34:55.444465] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-28T19:34:55.444543] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-28T19:34:55.444723] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-28T19:34:55.444784] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-28T19:34:55.445167] [DEBUG] [LOCAL ] KEN: Trimmed 5827 records to 4287 (keeping 200 days of data) [2025-10-28T19:34:55.470991] [DEBUG] [LOCAL ] KEN: Primary data saved (4287 records). [2025-10-28T19:34:55.471115] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-28T19:34:55.471237] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEN took 13.7s. Estimated remaining: 2h 35m 56s. Rate: 7.6 symbols/min [2025-10-28T19:34:55.649531] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:55.685744] [DEBUG] [LOCAL ] KEX: Loaded 38625 existing records from primary storage. [2025-10-28T19:34:55.686132] [INFO ] [MAIN ] KEX: Loaded 38625 existing records. [2025-10-28T19:34:55.881831] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:55.882465] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-28T19:34:55.882564] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-28T19:34:55.883303] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-28T19:34:55.883395] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-28T19:34:56.042550] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T19:34:56.175867] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-28T19:34:56.204440] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:34:56.235401] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-28T19:34:56.325404] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:56.325749] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-28T19:34:57.354056] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:34:57.362287] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-28T19:34:57.604859] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T19:34:57.613183] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-28T19:34:58.340633] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T19:34:58.348858] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-28T19:34:58.369856] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T19:34:58.377434] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-28T19:34:59.349572] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:34:59.356870] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-28T19:34:59.394461] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T19:34:59.402583] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-28T19:35:00.506454] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T19:35:00.515819] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-28T19:35:00.535280] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:35:00.542249] [INFO ] [REMOTE ] KEP: Full fetch complete (42651 records). [2025-10-28T19:35:00.542350] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-28T19:35:00.919770] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-28T19:35:00.919857] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-28T19:35:00.920680] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-28T19:35:00.920741] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-28T19:35:00.921681] [DEBUG] [LOCAL ] KEP: Trimmed 42651 records to 32541 (keeping 200 days of data) [2025-10-28T19:35:01.106960] [DEBUG] [LOCAL ] KEP: Primary data saved (32541 records). [2025-10-28T19:35:01.107091] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-28T19:35:01.107169] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KEP took 18.1s. Estimated remaining: 2h 35m 45s. Rate: 7.6 symbols/min [2025-10-28T19:35:01.273900] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:01.274065] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-28T19:35:01.274125] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-28T19:35:01.274238] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-28T19:35:01.274280] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-28T19:35:01.274326] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-28T19:35:01.274360] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-28T19:35:01.662312] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:01.662690] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-28T19:35:02.476094] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (9.72 seconds). [2025-10-28T19:35:02.489178] [INFO ] [REMOTE ] KBR: Full fetch complete (70091 records). [2025-10-28T19:35:02.489389] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-28T19:35:02.891446] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-28T19:35:02.891534] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-28T19:35:02.892519] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-28T19:35:02.892582] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-28T19:35:02.893912] [DEBUG] [LOCAL ] KBR: Trimmed 70091 records to 47937 (keeping 200 days of data) [2025-10-28T19:35:03.178876] [DEBUG] [LOCAL ] KBR: Primary data saved (47937 records). [2025-10-28T19:35:03.179014] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-28T19:35:03.179096] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KBR took 37.0s. Estimated remaining: 2h 35m 32s. Rate: 7.6 symbols/min [2025-10-28T19:35:03.357691] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:03.391975] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T19:35:03.402990] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-28T19:35:03.434628] [DEBUG] [LOCAL ] KEYS: Loaded 42921 existing records from primary storage. [2025-10-28T19:35:03.434922] [INFO ] [MAIN ] KEYS: Loaded 42921 existing records. [2025-10-28T19:35:03.629917] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:03.630137] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-28T19:35:03.630184] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-28T19:35:03.630544] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-28T19:35:03.630583] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-28T19:35:03.975978] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:03.976291] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-28T19:35:05.518210] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-28T19:35:05.528368] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-28T19:35:05.567791] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T19:35:05.576102] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-28T19:35:06.212823] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (10.04 seconds). [2025-10-28T19:35:06.224251] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-28T19:35:07.819588] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T19:35:07.831170] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-28T19:35:09.415874] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T19:35:09.426526] [INFO ] [REMOTE ] KD: Full fetch complete (76065 records). [2025-10-28T19:35:09.426696] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-28T19:35:09.811434] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-28T19:35:09.811509] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-28T19:35:09.812502] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-28T19:35:09.812562] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-28T19:35:09.813937] [DEBUG] [LOCAL ] KD: Trimmed 76065 records to 52294 (keeping 200 days of data) [2025-10-28T19:35:10.108310] [DEBUG] [LOCAL ] KD: Primary data saved (52294 records). [2025-10-28T19:35:10.108428] [INFO ] [MAIN ] KD: Full history saved. [2025-10-28T19:35:10.109190] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KD took 31.5s. Estimated remaining: 2h 35m 23s. Rate: 7.6 symbols/min [2025-10-28T19:35:10.274115] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:10.279446] [DEBUG] [LOCAL ] KF: Loaded 2320 existing records from primary storage. [2025-10-28T19:35:10.279623] [INFO ] [MAIN ] KF: Loaded 2320 existing records. [2025-10-28T19:35:10.453349] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:10.453593] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-28T19:35:10.453667] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-28T19:35:10.453849] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-28T19:35:10.453904] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-28T19:35:10.809908] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:10.810265] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-28T19:35:11.583086] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:35:11.584316] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-28T19:35:11.889721] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T19:35:11.890920] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-28T19:35:11.927536] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (11.41 seconds). [2025-10-28T19:35:11.935823] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-28T19:35:12.401370] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T19:35:12.402789] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-28T19:35:12.818382] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T19:35:12.825439] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-28T19:35:15.649869] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (10.12 seconds). [2025-10-28T19:35:15.660925] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-28T19:35:18.048407] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (12.47 seconds). [2025-10-28T19:35:18.057045] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-28T19:35:18.423751] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (6.02 seconds). [2025-10-28T19:35:18.425087] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-28T19:35:18.682768] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (5.86 seconds). [2025-10-28T19:35:18.690878] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-28T19:35:18.764190] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T19:35:18.765591] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-28T19:35:19.137738] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T19:35:19.139213] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-28T19:35:19.261309] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:35:19.270876] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-28T19:35:19.451151] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T19:35:19.452211] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-28T19:35:19.596135] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:35:19.604706] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-28T19:35:19.676208] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T19:35:19.677451] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-28T19:35:19.967802] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T19:35:19.968903] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-28T19:35:20.411357] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T19:35:20.412395] [INFO ] [REMOTE ] KF: Full fetch complete (3428 records). [2025-10-28T19:35:20.412463] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-28T19:35:20.801774] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-28T19:35:20.801881] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-28T19:35:20.802070] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-28T19:35:20.802685] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-28T19:35:20.804145] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T19:35:20.813871] [DEBUG] [LOCAL ] KF: Trimmed 3428 records to 2314 (keeping 200 days of data) [2025-10-28T19:35:20.815037] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-28T19:35:20.829485] [DEBUG] [LOCAL ] KF: Primary data saved (2314 records). [2025-10-28T19:35:20.829719] [INFO ] [MAIN ] KF: Full history saved. [2025-10-28T19:35:20.829815] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KF took 10.7s. Estimated remaining: 2h 35m 18s. Rate: 7.6 symbols/min [2025-10-28T19:35:20.997896] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:21.022485] [DEBUG] [LOCAL ] KFRC: Loaded 20906 existing records from primary storage. [2025-10-28T19:35:21.022751] [INFO ] [MAIN ] KFRC: Loaded 20906 existing records. [2025-10-28T19:35:21.203578] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:21.203850] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-28T19:35:21.203914] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-28T19:35:21.204238] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-28T19:35:21.204298] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-28T19:35:21.554884] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:21.555306] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-28T19:35:21.954720] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:35:21.964035] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-28T19:35:22.360169] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:35:22.362897] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-28T19:35:22.928187] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T19:35:22.933329] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-28T19:35:22.969968] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:35:22.978505] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-28T19:35:24.103621] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:35:24.112898] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-28T19:35:26.707922] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (11.05 seconds). [2025-10-28T19:35:26.719490] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-28T19:35:28.046688] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:35:28.058124] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-28T19:35:29.308734] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:35:29.319788] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-28T19:35:30.757869] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T19:35:30.771541] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-28T19:35:32.119257] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:35:32.130448] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-28T19:35:33.343542] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:35:33.354537] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-28T19:35:34.097782] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T19:35:34.108416] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-28T19:35:34.108528] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-28T19:35:34.301797] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T19:35:34.302552] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:35:34.302626] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:35:34.302741] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-28T19:35:34.302814] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-28T19:35:34.302854] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-28T19:35:34.302896] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-28T19:35:34.302957] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KEY took 33.2s. Estimated remaining: 2h 35m 16s. Rate: 7.6 symbols/min [2025-10-28T19:35:34.470367] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:34.480696] [DEBUG] [LOCAL ] KFS: Loaded 8681 existing records from primary storage. [2025-10-28T19:35:34.480893] [INFO ] [MAIN ] KFS: Loaded 8681 existing records. [2025-10-28T19:35:34.659028] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:34.679900] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-28T19:35:34.682493] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-28T19:35:34.682959] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-28T19:35:34.684215] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (15.08 seconds). [2025-10-28T19:35:34.683393] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-28T19:35:34.737791] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-28T19:35:35.060625] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:35.060956] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-28T19:35:35.739930] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:35:35.741777] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-28T19:35:35.972931] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:35:35.981722] [INFO ] [REMOTE ] KEX: Full fetch complete (56210 records). [2025-10-28T19:35:35.981867] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-28T19:35:36.094913] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T19:35:36.106864] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-28T19:35:36.370864] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-28T19:35:36.370991] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-28T19:35:36.371945] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-28T19:35:36.372007] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-28T19:35:36.373136] [DEBUG] [LOCAL ] KEX: Trimmed 56210 records to 38656 (keeping 200 days of data) [2025-10-28T19:35:36.599827] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T19:35:36.603822] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-28T19:35:36.609921] [DEBUG] [LOCAL ] KEX: Primary data saved (38656 records). [2025-10-28T19:35:36.610075] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-28T19:35:36.610174] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KEX took 41.1s. Estimated remaining: 2h 35m 2s. Rate: 7.6 symbols/min [2025-10-28T19:35:36.780012] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:36.780190] [DEBUG] [LOCAL ] KFY: No existing data file found in primary storage. [2025-10-28T19:35:36.780272] [WARN ] [MAIN ] KFY: No existing data found, performing full refresh instead. [2025-10-28T19:35:36.780404] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-28T19:35:36.780451] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-28T19:35:36.780500] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-28T19:35:36.780538] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-28T19:35:37.154053] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T19:35:37.153776] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:37.156662] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-28T19:35:37.157680] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-28T19:35:37.168462] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (14.24 seconds). [2025-10-28T19:35:37.172392] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-28T19:35:37.647811] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T19:35:37.650128] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-28T19:35:37.951347] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:35:37.955896] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-28T19:35:38.153904] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T19:35:38.156463] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-28T19:35:38.188468] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T19:35:38.194101] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-28T19:35:38.657210] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T19:35:38.661961] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-28T19:35:39.156484] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:35:39.163378] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-28T19:35:40.213518] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:35:40.225803] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-28T19:35:40.432988] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-28T19:35:40.435805] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-28T19:35:40.987017] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T19:35:40.989599] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-28T19:35:41.349114] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:35:41.363786] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:35:41.580238] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-28T19:35:42.102031] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:35:42.104316] [INFO ] [REMOTE ] KFS: Full fetch complete (11347 records). [2025-10-28T19:35:42.104382] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-28T19:35:42.382746] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-28T19:35:42.463017] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-28T19:35:42.463092] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-28T19:35:42.463382] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-28T19:35:42.463421] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-28T19:35:42.463904] [DEBUG] [LOCAL ] KFS: Trimmed 11347 records to 8698 (keeping 200 days of data) [2025-10-28T19:35:42.512379] [DEBUG] [LOCAL ] KFS: Primary data saved (8698 records). [2025-10-28T19:35:42.512498] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-28T19:35:42.512587] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KFS took 8.2s. Estimated remaining: 2h 34m 52s. Rate: 7.6 symbols/min [2025-10-28T19:35:42.677751] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:42.727389] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-28T19:35:42.727697] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-28T19:35:42.905292] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:42.905722] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-28T19:35:42.905778] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-28T19:35:42.906474] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-28T19:35:42.906531] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-28T19:35:43.260300] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:43.260727] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-28T19:35:43.276750] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:35:43.985339] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-28T19:35:44.003712] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (19.89 seconds). [2025-10-28T19:35:44.780236] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-28T19:35:44.843999] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T19:35:44.923139] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T19:35:45.580347] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-28T19:35:45.966143] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:35:46.017854] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (7.36 seconds). [2025-10-28T19:35:46.380312] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-28T19:35:47.180270] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-28T19:35:47.980270] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-28T19:35:48.066062] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T19:35:48.780302] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-28T19:35:49.360411] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:35:49.369496] [INFO ] [REMOTE ] KEYS: Full fetch complete (63158 records). [2025-10-28T19:35:49.369700] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-28T19:35:49.773405] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-28T19:35:49.773602] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-28T19:35:49.774561] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-28T19:35:49.774662] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-28T19:35:49.790418] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:35:49.796067] [DEBUG] [LOCAL ] KEYS: Trimmed 63158 records to 42890 (keeping 200 days of data) [2025-10-28T19:35:49.797134] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-28T19:35:50.059330] [DEBUG] [LOCAL ] KEYS: Primary data saved (42890 records). [2025-10-28T19:35:50.059481] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-28T19:35:50.059566] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KEYS took 46.9s. Estimated remaining: 2h 34m 44s. Rate: 7.6 symbols/min [2025-10-28T19:35:50.233829] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:50.276425] [DEBUG] [LOCAL ] KGS: Loaded 45875 existing records from primary storage. [2025-10-28T19:35:50.276767] [INFO ] [MAIN ] KGS: Loaded 45875 existing records. [2025-10-28T19:35:50.460313] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:50.460536] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-28T19:35:50.460589] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-28T19:35:50.461136] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-28T19:35:50.461193] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-28T19:35:50.833908] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:50.834319] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-28T19:35:50.853546] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:35:51.180285] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-28T19:35:52.178360] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T19:35:52.184138] [INFO ] [REMOTE ] KFY: Full fetch complete (43235 records). [2025-10-28T19:35:52.184220] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-28T19:35:52.552389] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-28T19:35:52.552461] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-28T19:35:52.553198] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-28T19:35:52.553258] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-28T19:35:52.554143] [DEBUG] [LOCAL ] KFY: Trimmed 43235 records to 28988 (keeping 200 days of data) [2025-10-28T19:35:52.731018] [DEBUG] [LOCAL ] KFY: Primary data saved (28988 records). [2025-10-28T19:35:52.731173] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-28T19:35:52.731250] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KFY took 16.1s. Estimated remaining: 2h 34m 31s. Rate: 7.6 symbols/min [2025-10-28T19:35:52.899395] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:52.947921] [DEBUG] [LOCAL ] KIM: Loaded 52988 existing records from primary storage. [2025-10-28T19:35:52.948231] [INFO ] [MAIN ] KIM: Loaded 52988 existing records. [2025-10-28T19:35:53.050592] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (6.67 seconds). [2025-10-28T19:35:53.081994] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-28T19:35:53.143575] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:53.143759] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-28T19:35:53.143807] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-28T19:35:53.144563] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-28T19:35:53.144621] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-28T19:35:53.505716] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:53.506043] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-28T19:35:53.905982] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T19:35:53.912010] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-28T19:35:54.732785] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T19:35:54.761833] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-28T19:35:54.776863] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (9.20 seconds). [2025-10-28T19:35:55.180290] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-28T19:35:55.927182] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:35:55.980211] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-28T19:35:56.501952] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:35:56.780362] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-28T19:35:57.201423] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:35:57.580277] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-28T19:35:58.329171] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (7.49 seconds). [2025-10-28T19:35:58.380232] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-28T19:35:58.574397] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (4.66 seconds). [2025-10-28T19:35:58.834680] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:35:59.180309] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-28T19:35:59.436527] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:35:59.980348] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-28T19:36:00.241161] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:36:00.247149] [INFO ] [REMOTE ] KFRC: Full fetch complete (27420 records). [2025-10-28T19:36:00.247237] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-28T19:36:00.660294] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-28T19:36:00.660374] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-28T19:36:00.660973] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-28T19:36:00.661038] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-28T19:36:00.661742] [DEBUG] [LOCAL ] KFRC: Trimmed 27420 records to 20978 (keeping 200 days of data) [2025-10-28T19:36:00.781879] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-28T19:36:00.784851] [DEBUG] [LOCAL ] KFRC: Primary data saved (20978 records). [2025-10-28T19:36:00.784939] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-28T19:36:00.785769] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KFRC took 40.0s. Estimated remaining: 2h 34m 23s. Rate: 7.6 symbols/min [2025-10-28T19:36:00.952723] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:00.973967] [DEBUG] [LOCAL ] KIO: Loaded 21584 existing records from primary storage. [2025-10-28T19:36:00.974233] [INFO ] [MAIN ] KIO: Loaded 21584 existing records. [2025-10-28T19:36:01.151877] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:01.152232] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-28T19:36:01.152289] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-28T19:36:01.152544] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-28T19:36:01.152584] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-28T19:36:01.537233] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:01.532208] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T19:36:01.580475] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-28T19:36:02.155366] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:36:02.380313] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-28T19:36:02.857826] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:36:03.180258] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-28T19:36:03.980254] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-28T19:36:04.377046] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T19:36:04.780257] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-28T19:36:05.074853] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T19:36:05.580253] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-28T19:36:05.802565] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:36:06.380298] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-28T19:36:06.689716] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (4.31 seconds). [2025-10-28T19:36:07.073896] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T19:36:07.180227] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-28T19:36:07.510072] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:36:07.980300] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-28T19:36:08.269877] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (11.49 seconds). [2025-10-28T19:36:08.676058] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T19:36:08.763635] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:36:08.780238] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-28T19:36:09.580270] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-28T19:36:09.641431] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T19:36:10.380300] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-28T19:36:10.716491] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T19:36:11.180307] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-28T19:36:11.655924] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:36:11.980291] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-28T19:36:12.598558] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:36:12.610582] [INFO ] [REMOTE ] KIM: Full fetch complete (76971 records). [2025-10-28T19:36:12.610869] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-28T19:36:12.781049] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-28T19:36:13.037136] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-28T19:36:13.037352] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-28T19:36:13.038867] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-28T19:36:13.038949] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-28T19:36:13.041016] [DEBUG] [LOCAL ] KIM: Trimmed 76971 records to 52988 (keeping 200 days of data) [2025-10-28T19:36:13.309681] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:36:13.447305] [DEBUG] [LOCAL ] KIM: Primary data saved (52988 records). [2025-10-28T19:36:13.447512] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-28T19:36:13.447617] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KIM took 20.7s. Estimated remaining: 2h 34m 20s. Rate: 7.6 symbols/min [2025-10-28T19:36:13.585432] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-28T19:36:13.635340] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:13.698202] [DEBUG] [LOCAL ] KKR: Loaded 53494 existing records from primary storage. [2025-10-28T19:36:13.698816] [INFO ] [MAIN ] KKR: Loaded 53494 existing records. [2025-10-28T19:36:13.888154] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:13.888474] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-28T19:36:13.888525] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-28T19:36:13.889301] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-28T19:36:13.889360] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-28T19:36:14.270203] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:14.370005] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:36:14.380200] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-28T19:36:15.180256] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-28T19:36:15.980320] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-28T19:36:16.654507] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T19:36:16.663900] [INFO ] [REMOTE ] KGS: Full fetch complete (66579 records). [2025-10-28T19:36:16.664049] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-28T19:36:17.072595] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-28T19:36:17.072700] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-28T19:36:17.073625] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-28T19:36:17.073698] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-28T19:36:17.074985] [DEBUG] [LOCAL ] KGS: Trimmed 66579 records to 45848 (keeping 200 days of data) [2025-10-28T19:36:17.344760] [DEBUG] [LOCAL ] KGS: Primary data saved (45848 records). [2025-10-28T19:36:17.344887] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-28T19:36:17.344989] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KGS took 27.3s. Estimated remaining: 2h 34m 8s. Rate: 7.6 symbols/min [2025-10-28T19:36:17.519047] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:17.527090] [DEBUG] [LOCAL ] KKRS: Loaded 5455 existing records from primary storage. [2025-10-28T19:36:17.527303] [INFO ] [MAIN ] KKRS: Loaded 5455 existing records. [2025-10-28T19:36:17.709244] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:17.709464] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-28T19:36:17.709512] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-28T19:36:17.709736] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-28T19:36:17.709796] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-28T19:36:18.085019] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:18.085363] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-28T19:36:21.952123] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (9.17 seconds). [2025-10-28T19:36:21.964932] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-28T19:36:23.509759] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (9.13 seconds). [2025-10-28T19:36:23.515067] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-28T19:36:23.564570] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-28T19:36:23.575607] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-28T19:36:24.218305] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:36:24.222870] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-28T19:36:25.050990] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:36:25.056622] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-28T19:36:25.270120] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T19:36:25.282182] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-28T19:36:25.862681] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T19:36:25.868186] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-28T19:36:26.674096] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:36:26.698156] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-28T19:36:26.700443] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T19:36:26.708371] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-28T19:36:26.978317] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (11.00 seconds). [2025-10-28T19:36:26.991319] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-28T19:36:27.481044] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (9.40 seconds). [2025-10-28T19:36:27.483265] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-28T19:36:27.680187] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:36:27.686347] [INFO ] [REMOTE ] KIO: Full fetch complete (32570 records). [2025-10-28T19:36:27.686471] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-28T19:36:28.098448] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-28T19:36:28.098548] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-28T19:36:28.099296] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-28T19:36:28.099371] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-28T19:36:28.100488] [DEBUG] [LOCAL ] KIO: Trimmed 32570 records to 21659 (keeping 200 days of data) [2025-10-28T19:36:28.271078] [DEBUG] [LOCAL ] KIO: Primary data saved (21659 records). [2025-10-28T19:36:28.271284] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-28T19:36:28.271603] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KIO took 27.5s. Estimated remaining: 2h 34m 4s. Rate: 7.6 symbols/min [2025-10-28T19:36:28.305294] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T19:36:28.368004] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-28T19:36:28.460688] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:28.460865] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-28T19:36:28.460902] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-28T19:36:28.461011] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-28T19:36:28.461050] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-28T19:36:28.461089] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-28T19:36:28.461120] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-28T19:36:28.676919] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:36:28.724531] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-28T19:36:28.831563] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:28.831904] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-28T19:36:28.971864] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:36:28.972196] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-28T19:36:28.972286] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:36:28.972331] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-28T19:36:28.972387] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:36:28.972457] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-28T19:36:28.972519] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-28T19:36:28.972554] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-28T19:36:28.972591] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-28T19:36:28.972636] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KKRT took 0.7s. Estimated remaining: 2h 33m 49s. Rate: 7.6 symbols/min [2025-10-28T19:36:29.144713] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:29.144979] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-28T19:36:29.145054] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-28T19:36:29.145214] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-28T19:36:29.150119] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-28T19:36:29.150993] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-28T19:36:29.151051] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-28T19:36:29.151432] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:36:29.197284] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-28T19:36:29.538476] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:29.580247] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-28T19:36:29.716242] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:36:29.736569] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:36:29.736911] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-28T19:36:29.736997] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:36:29.737075] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-28T19:36:29.737138] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:36:29.737209] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-28T19:36:29.737270] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-28T19:36:29.737304] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-28T19:36:29.737343] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-28T19:36:29.737390] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 33m 34s. Rate: 7.6 symbols/min [2025-10-28T19:36:29.901371] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:29.937347] [DEBUG] [LOCAL ] KLC: Loaded 35861 existing records from primary storage. [2025-10-28T19:36:29.937633] [INFO ] [MAIN ] KLC: Loaded 35861 existing records. [2025-10-28T19:36:30.110041] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:30.110330] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-28T19:36:30.110387] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-28T19:36:30.110709] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-28T19:36:30.110767] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-28T19:36:30.385516] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-28T19:36:30.468104] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:30.496487] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T19:36:30.507336] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-28T19:36:30.507455] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-28T19:36:30.906931] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T19:36:30.907148] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-28T19:36:30.909452] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-28T19:36:30.910478] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-28T19:36:30.910540] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-28T19:36:30.911956] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 53699 (keeping 200 days of data) [2025-10-28T19:36:31.186524] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-28T19:36:31.234547] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-28T19:36:31.234681] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-28T19:36:31.234787] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KGC took 48.7s. Estimated remaining: 2h 33m 20s. Rate: 7.6 symbols/min [2025-10-28T19:36:31.410376] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:31.466044] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-28T19:36:31.466337] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-28T19:36:31.640953] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:31.641173] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-28T19:36:31.641219] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-28T19:36:31.641587] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-28T19:36:31.641677] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-28T19:36:31.987923] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-28T19:36:31.992296] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:32.780220] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-28T19:36:32.989233] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:36:33.580252] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-28T19:36:34.328345] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T19:36:34.380282] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-28T19:36:34.471698] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:36:34.706112] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (7.71 seconds). [2025-10-28T19:36:35.180235] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-28T19:36:35.233625] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (4.05 seconds). [2025-10-28T19:36:35.752322] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T19:36:35.980258] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-28T19:36:36.780286] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-28T19:36:37.327374] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:36:37.580324] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-28T19:36:38.199207] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T19:36:38.380258] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-28T19:36:39.180244] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-28T19:36:39.955475] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T19:36:39.980230] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-28T19:36:41.305901] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (6.13 seconds). [2025-10-28T19:36:41.313513] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-28T19:36:42.150761] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-10-28T19:36:42.152513] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-28T19:36:42.379224] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:36:42.388080] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-28T19:36:42.591358] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T19:36:43.180291] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-28T19:36:43.584770] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T19:36:43.585980] [INFO ] [REMOTE ] KKRS: Full fetch complete (7498 records). [2025-10-28T19:36:43.586052] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-28T19:36:43.953759] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-28T19:36:43.953892] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-28T19:36:43.954313] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-28T19:36:43.954446] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-28T19:36:43.955629] [DEBUG] [LOCAL ] KKRS: Trimmed 7498 records to 5436 (keeping 200 days of data) [2025-10-28T19:36:44.000744] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T19:36:44.018393] [DEBUG] [LOCAL ] KKRS: Primary data saved (5436 records). [2025-10-28T19:36:44.018485] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-28T19:36:44.018589] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KKRS took 26.7s. Estimated remaining: 2h 33m 17s. Rate: 7.6 symbols/min [2025-10-28T19:36:44.018957] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-28T19:36:44.187981] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:44.193596] [DEBUG] [LOCAL ] KMPB: Loaded 3417 existing records from primary storage. [2025-10-28T19:36:44.193782] [INFO ] [MAIN ] KMPB: Loaded 3417 existing records. [2025-10-28T19:36:44.368269] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:44.368446] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-28T19:36:44.368490] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-28T19:36:44.368612] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-28T19:36:44.368684] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-28T19:36:44.713415] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:44.780209] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-28T19:36:45.063270] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T19:36:45.192818] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T19:36:45.580290] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-28T19:36:46.380230] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-28T19:36:47.461776] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:36:47.469316] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-28T19:36:47.645785] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (10.07 seconds). [2025-10-28T19:36:47.980280] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-28T19:36:48.122701] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-28T19:36:48.480390] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:36:48.729468] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (8.75 seconds). [2025-10-28T19:36:48.780238] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-28T19:36:49.535376] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T19:36:49.580210] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-28T19:36:49.793537] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T19:36:50.380233] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-28T19:36:51.048292] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T19:36:51.180326] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-28T19:36:51.522749] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T19:36:51.980363] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-28T19:36:52.449268] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:36:52.780262] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-28T19:36:53.070232] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T19:36:53.077818] [INFO ] [REMOTE ] KLC: Full fetch complete (50687 records). [2025-10-28T19:36:53.077920] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-28T19:36:53.466227] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-28T19:36:53.466303] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-28T19:36:53.467172] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-28T19:36:53.467232] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-28T19:36:53.468300] [DEBUG] [LOCAL ] KLC: Trimmed 50687 records to 35763 (keeping 200 days of data) [2025-10-28T19:36:53.581675] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-28T19:36:53.667726] [DEBUG] [LOCAL ] KLC: Primary data saved (35763 records). [2025-10-28T19:36:53.667856] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-28T19:36:53.668835] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KLC took 23.9s. Estimated remaining: 2h 33m 11s. Rate: 7.6 symbols/min [2025-10-28T19:36:54.380253] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-28T19:36:54.427378] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T19:36:54.741796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T19:36:55.094382] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T19:36:55.180287] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-28T19:36:55.980257] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-28T19:36:56.448821] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:36:56.780276] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-28T19:36:57.309682] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:36:57.580351] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-28T19:36:57.887566] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T19:36:58.170161] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:36:58.380262] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-28T19:36:59.180262] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-28T19:36:59.408353] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T19:36:59.851919] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T19:36:59.980281] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-28T19:37:00.780334] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-28T19:37:01.580296] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-28T19:37:01.588091] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T19:37:01.874412] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T19:37:01.886554] [INFO ] [REMOTE ] KKR: Full fetch complete (77655 records). [2025-10-28T19:37:01.886811] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-28T19:37:02.304633] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-28T19:37:02.304807] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-28T19:37:02.306583] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-28T19:37:02.306683] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-28T19:37:02.308933] [DEBUG] [LOCAL ] KKR: Trimmed 77655 records to 53492 (keeping 200 days of data) [2025-10-28T19:37:02.404708] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-28T19:37:02.675851] [DEBUG] [LOCAL ] KKR: Primary data saved (53492 records). [2025-10-28T19:37:02.676079] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-28T19:37:02.676221] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KKR took 49.2s. Estimated remaining: 2h 33m 4s. Rate: 7.6 symbols/min [2025-10-28T19:37:02.753898] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T19:37:03.180316] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-28T19:37:03.539294] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:37:03.980287] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-28T19:37:04.352089] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:37:04.780297] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-28T19:37:05.204382] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T19:37:05.205738] [INFO ] [REMOTE ] KMPB: Full fetch complete (4914 records). [2025-10-28T19:37:05.205823] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-28T19:37:05.570426] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-28T19:37:05.570512] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-28T19:37:05.570721] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-28T19:37:05.570782] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-28T19:37:05.571149] [DEBUG] [LOCAL ] KMPB: Trimmed 4914 records to 3417 (keeping 200 days of data) [2025-10-28T19:37:05.592072] [DEBUG] [LOCAL ] KMPB: Primary data saved (3417 records). [2025-10-28T19:37:05.592217] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-28T19:37:05.592302] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KMPB took 21.6s. Estimated remaining: 2h 32m 51s. Rate: 7.6 symbols/min [2025-10-28T19:37:08.381443] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (6.80 seconds). [2025-10-28T19:37:08.392194] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-28T19:37:08.392347] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-28T19:37:08.797864] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-28T19:37:08.797944] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-28T19:37:08.799224] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-28T19:37:08.799313] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-28T19:37:08.800757] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-28T19:37:09.115638] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-28T19:37:09.115796] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-28T19:37:09.115872] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMI took 37.9s. Estimated remaining: 2h 32m 39s. Rate: 7.6 symbols/min [2025-10-28T19:37:09.755541] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.815056] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.832331] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.851913] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.941761] [DEBUG] [LOCAL ] KN: Loaded 38260 existing records from primary storage. [2025-10-28T19:37:09.941226] [DEBUG] [LOCAL ] KMT: Loaded 42540 existing records from primary storage. [2025-10-28T19:37:09.970284] [INFO ] [MAIN ] KN: Loaded 38260 existing records. [2025-10-28T19:37:09.991943] [DEBUG] [LOCAL ] KMPR: Loaded 40466 existing records from primary storage. [2025-10-28T19:37:09.981595] [INFO ] [MAIN ] KMT: Loaded 42540 existing records. [2025-10-28T19:37:10.007725] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-28T19:37:10.051607] [INFO ] [MAIN ] KMX: Loaded 53284 existing records. [2025-10-28T19:37:10.051785] [INFO ] [MAIN ] KMPR: Loaded 40466 existing records. [2025-10-28T19:37:10.593354] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.603979] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.627502] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.632361] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-28T19:37:10.627432] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.658139] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-28T19:37:10.682797] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-28T19:37:10.682942] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-28T19:37:10.687399] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.716829] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.735138] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-28T19:37:10.751014] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-28T19:37:10.751095] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-28T19:37:10.777018] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.813502] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-28T19:37:10.813864] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-28T19:37:10.813772] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.875200] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-28T19:37:11.019486] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-28T19:37:11.059184] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-28T19:37:12.027596] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.050454] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-28T19:37:12.069876] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.116944] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.078588] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-28T19:37:12.117722] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-28T19:37:12.227968] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.228235] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-28T19:37:13.287632] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:37:13.293307] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-28T19:37:13.383234] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:37:13.391062] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-28T19:37:13.500552] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:37:13.508520] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-28T19:37:14.516952] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:37:14.529164] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-28T19:37:14.531106] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-28T19:37:14.542977] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-28T19:37:15.610133] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:37:15.619909] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-28T19:37:15.785134] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T19:37:15.794601] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-28T19:37:16.703659] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:37:16.713872] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-28T19:37:17.307705] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T19:37:17.319356] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-28T19:37:17.831826] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:37:17.841028] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-28T19:37:18.857264] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T19:37:18.869045] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-28T19:37:19.138306] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (5.84 seconds). [2025-10-28T19:37:19.144079] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-28T19:37:19.994390] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:37:20.002513] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-28T19:37:20.189433] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T19:37:20.200876] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-28T19:37:21.423095] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:37:21.434014] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-28T19:37:23.031621] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T19:37:23.043850] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-28T19:37:24.434029] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (6.59 seconds). [2025-10-28T19:37:24.441973] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-28T19:37:24.473052] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T19:37:24.484593] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-28T19:37:27.633604] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (14.13 seconds). [2025-10-28T19:37:27.646555] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-28T19:37:28.839796] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:37:28.848603] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-28T19:37:30.151262] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:37:30.161081] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-28T19:37:31.322031] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (6.88 seconds). [2025-10-28T19:37:31.330493] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-28T19:37:31.472168] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:37:31.481312] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-28T19:37:32.335427] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T19:37:32.344042] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-28T19:37:32.555946] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:37:32.564886] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-28T19:37:33.387903] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T19:37:33.397829] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-28T19:37:33.625859] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:37:33.635983] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-28T19:37:34.100474] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (14.10 seconds). [2025-10-28T19:37:34.108760] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-28T19:37:34.639152] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:37:34.648356] [INFO ] [REMOTE ] KN: Full fetch complete (56813 records). [2025-10-28T19:37:34.648518] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-28T19:37:35.135340] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-28T19:37:35.135760] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-28T19:37:35.172383] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:37:35.168820] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-28T19:37:35.183775] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-28T19:37:35.184424] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-28T19:37:35.193600] [DEBUG] [LOCAL ] KN: Trimmed 56813 records to 38185 (keeping 200 days of data) [2025-10-28T19:37:35.212171] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:37:35.306862] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-28T19:37:35.548220] [DEBUG] [LOCAL ] KN: Primary data saved (38185 records). [2025-10-28T19:37:35.548479] [INFO ] [MAIN ] KN: Full history saved. [2025-10-28T19:37:35.549014] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KN took 26.4s. Estimated remaining: 2h 32m 49s. Rate: 7.6 symbols/min [2025-10-28T19:37:35.826067] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:35.873769] [DEBUG] [LOCAL ] KNF: Loaded 36587 existing records from primary storage. [2025-10-28T19:37:35.874229] [INFO ] [MAIN ] KNF: Loaded 36587 existing records. [2025-10-28T19:37:36.099338] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:36.099567] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-28T19:37:36.099621] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-28T19:37:36.099996] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-28T19:37:36.100047] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-28T19:37:36.489133] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:36.489751] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-28T19:37:36.517332] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:37:36.528383] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-28T19:37:36.817345] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T19:37:36.824905] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-28T19:37:37.380324] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:37:37.388707] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-28T19:37:37.691633] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:37:37.699389] [INFO ] [REMOTE ] KMT: Full fetch complete (61695 records). [2025-10-28T19:37:37.699535] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-28T19:37:38.090403] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-28T19:37:38.090496] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-28T19:37:38.091418] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-28T19:37:38.091495] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-28T19:37:38.093040] [DEBUG] [LOCAL ] KMT: Trimmed 61695 records to 42364 (keeping 200 days of data) [2025-10-28T19:37:38.178084] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:37:38.224317] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-28T19:37:38.370971] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:37:38.379593] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-28T19:37:38.400832] [DEBUG] [LOCAL ] KMT: Primary data saved (42364 records). [2025-10-28T19:37:38.400932] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-28T19:37:38.401007] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KMT took 29.3s. Estimated remaining: 2h 32m 36s. Rate: 7.6 symbols/min [2025-10-28T19:37:38.578697] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:38.578878] [DEBUG] [LOCAL ] KNOP: No existing data file found in primary storage. [2025-10-28T19:37:38.578915] [WARN ] [MAIN ] KNOP: No existing data found, performing full refresh instead. [2025-10-28T19:37:38.579017] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-28T19:37:38.579057] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-28T19:37:38.579096] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-28T19:37:38.579131] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-28T19:37:38.925055] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:38.925372] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-28T19:37:39.288062] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:37:39.295856] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-28T19:37:39.343124] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:37:39.353434] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-28T19:37:39.496209] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:37:39.980259] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-28T19:37:40.113926] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:37:40.455452] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:37:40.780274] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-28T19:37:41.580248] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-28T19:37:41.808023] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T19:37:42.380286] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-28T19:37:42.523619] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-28T19:37:42.862426] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T19:37:42.871360] [INFO ] [REMOTE ] KMPR: Full fetch complete (53993 records). [2025-10-28T19:37:42.871461] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-28T19:37:43.180538] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-28T19:37:43.273264] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-28T19:37:43.273411] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-28T19:37:43.274320] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-28T19:37:43.274398] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-28T19:37:43.275717] [DEBUG] [LOCAL ] KMPR: Trimmed 53993 records to 40506 (keeping 200 days of data) [2025-10-28T19:37:43.356973] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:37:43.538897] [DEBUG] [LOCAL ] KMPR: Primary data saved (40506 records). [2025-10-28T19:37:43.539016] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-28T19:37:43.539613] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KMPR took 34.4s. Estimated remaining: 2h 32m 26s. Rate: 7.6 symbols/min [2025-10-28T19:37:43.705046] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:43.725173] [DEBUG] [LOCAL ] KNSL: Loaded 18472 existing records from primary storage. [2025-10-28T19:37:43.725399] [INFO ] [MAIN ] KNSL: Loaded 18472 existing records. [2025-10-28T19:37:43.912035] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:37:43.915791] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:43.919308] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-28T19:37:43.919368] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-28T19:37:43.919711] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-28T19:37:43.919779] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-28T19:37:43.985514] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-28T19:37:44.265857] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:44.780255] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-28T19:37:45.155488] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T19:37:45.557176] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T19:37:45.580221] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-28T19:37:46.190095] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (21.71 seconds). [2025-10-28T19:37:46.368013] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:37:46.380196] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-28T19:37:47.180325] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-28T19:37:47.980309] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-28T19:37:48.560446] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T19:37:48.780300] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-28T19:37:49.580306] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-28T19:37:50.549431] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T19:37:50.560228] [INFO ] [REMOTE ] KMX: Full fetch complete (76441 records). [2025-10-28T19:37:50.560366] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-28T19:37:50.973829] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-28T19:37:50.973918] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-28T19:37:50.974962] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-28T19:37:50.975025] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-28T19:37:50.976475] [DEBUG] [LOCAL ] KMX: Trimmed 76441 records to 53284 (keeping 200 days of data) [2025-10-28T19:37:51.283006] [DEBUG] [LOCAL ] KMX: Primary data saved (53284 records). [2025-10-28T19:37:51.283183] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-28T19:37:51.283287] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMX took 42.2s. Estimated remaining: 2h 32m 18s. Rate: 7.6 symbols/min [2025-10-28T19:37:51.448682] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:51.490045] [DEBUG] [LOCAL ] KNTK: Loaded 47192 existing records from primary storage. [2025-10-28T19:37:51.490350] [INFO ] [MAIN ] KNTK: Loaded 47192 existing records. [2025-10-28T19:37:51.664619] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:51.664878] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-28T19:37:51.664926] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-28T19:37:51.665120] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-28T19:37:51.665176] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-28T19:37:52.017618] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:52.018104] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-28T19:37:52.545728] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (6.17 seconds). [2025-10-28T19:37:52.549770] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-28T19:37:53.052183] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T19:37:53.060251] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-28T19:37:53.349755] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T19:37:53.354765] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-28T19:37:54.024298] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:37:54.032521] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-28T19:37:54.046738] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T19:37:54.380370] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-28T19:37:55.173186] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T19:37:55.180220] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-28T19:37:55.225619] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:37:55.980374] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-28T19:37:57.605578] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (8.03 seconds). [2025-10-28T19:37:57.608195] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-28T19:37:58.089400] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:37:58.092070] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-28T19:37:58.324400] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (11.14 seconds). [2025-10-28T19:37:58.380268] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-28T19:37:59.476809] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:37:59.485291] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-28T19:38:04.706952] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (6.61 seconds). [2025-10-28T19:38:04.710004] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-28T19:38:04.989484] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (9.81 seconds). [2025-10-28T19:38:04.997942] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-28T19:38:05.198818] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:38:05.202089] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-28T19:38:05.665319] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:38:05.670181] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-28T19:38:05.791491] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T19:38:05.794898] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-28T19:38:06.527661] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T19:38:06.530561] [INFO ] [REMOTE ] KNOP: Full fetch complete (14639 records). [2025-10-28T19:38:06.530632] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-28T19:38:06.898546] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-28T19:38:06.898624] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-28T19:38:06.899008] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-28T19:38:06.899059] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-28T19:38:06.899569] [DEBUG] [LOCAL ] KNOP: Trimmed 14639 records to 9773 (keeping 200 days of data) [2025-10-28T19:38:06.957114] [DEBUG] [LOCAL ] KNOP: Primary data saved (9773 records). [2025-10-28T19:38:06.957231] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-28T19:38:06.957299] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNOP took 28.6s. Estimated remaining: 2h 32m 18s. Rate: 7.6 symbols/min [2025-10-28T19:38:07.130585] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:07.177869] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-28T19:38:07.178178] [INFO ] [MAIN ] KNX: Loaded 52645 existing records. [2025-10-28T19:38:07.351965] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:07.352163] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-28T19:38:07.352217] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-28T19:38:07.352456] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-28T19:38:07.352513] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-28T19:38:07.702700] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:07.703015] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-28T19:38:14.559577] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (15.07 seconds). [2025-10-28T19:38:14.568604] [INFO ] [REMOTE ] KNF: Full fetch complete (51517 records). [2025-10-28T19:38:14.568804] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-28T19:38:14.965832] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-28T19:38:14.965914] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-28T19:38:14.966780] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-28T19:38:14.966841] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-28T19:38:14.968066] [DEBUG] [LOCAL ] KNF: Trimmed 51517 records to 36657 (keeping 200 days of data) [2025-10-28T19:38:15.190796] [DEBUG] [LOCAL ] KNF: Primary data saved (36657 records). [2025-10-28T19:38:15.190910] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-28T19:38:15.190987] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNF took 39.6s. Estimated remaining: 2h 32m 10s. Rate: 7.6 symbols/min [2025-10-28T19:38:15.356707] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:15.356861] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-28T19:38:15.356897] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-28T19:38:15.357024] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-28T19:38:15.357065] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-28T19:38:15.357107] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-28T19:38:15.357138] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-28T19:38:15.716775] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:15.717103] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-28T19:38:15.910243] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (19.93 seconds). [2025-10-28T19:38:15.919478] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-28T19:38:17.179834] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:38:17.190363] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-28T19:38:17.637945] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T19:38:17.649385] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-28T19:38:19.069514] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (13.40 seconds). [2025-10-28T19:38:19.074101] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-28T19:38:19.586965] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T19:38:19.604548] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-28T19:38:19.922403] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:38:19.927561] [INFO ] [REMOTE ] KNSL: Full fetch complete (27226 records). [2025-10-28T19:38:19.927676] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-28T19:38:20.311804] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-28T19:38:20.311905] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-28T19:38:20.312802] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-28T19:38:20.312864] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-28T19:38:20.313750] [DEBUG] [LOCAL ] KNSL: Trimmed 27226 records to 18536 (keeping 200 days of data) [2025-10-28T19:38:20.436771] [DEBUG] [LOCAL ] KNSL: Primary data saved (18536 records). [2025-10-28T19:38:20.436967] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-28T19:38:20.437066] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNSL took 36.9s. Estimated remaining: 2h 31m 60s. Rate: 7.6 symbols/min [2025-10-28T19:38:20.612399] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:20.659988] [DEBUG] [LOCAL ] KODK: Loaded 43487 existing records from primary storage. [2025-10-28T19:38:20.660460] [INFO ] [MAIN ] KODK: Loaded 43487 existing records. [2025-10-28T19:38:20.845294] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:20.845606] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-28T19:38:20.845686] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-28T19:38:20.846576] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-28T19:38:20.846667] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-28T19:38:21.220622] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:21.221061] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-28T19:38:21.504413] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-28T19:38:21.516805] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-28T19:38:22.381973] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:38:22.396817] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-28T19:38:23.423761] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T19:38:23.451389] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-28T19:38:23.463708] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:38:23.473547] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-28T19:38:24.630521] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:38:24.640701] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-28T19:38:25.307191] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-28T19:38:25.318482] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-28T19:38:26.055195] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:38:26.066362] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-28T19:38:27.251026] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:38:27.261985] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-28T19:38:27.314389] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-28T19:38:27.325576] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-28T19:38:28.270417] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:38:28.279256] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-28T19:38:29.368325] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-28T19:38:29.380157] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-28T19:38:29.522586] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:38:29.532494] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-28T19:38:29.897880] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (22.19 seconds). [2025-10-28T19:38:29.907971] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-28T19:38:31.075613] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:38:31.085870] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-28T19:38:31.291587] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-28T19:38:31.303635] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-28T19:38:32.142577] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (14.95 seconds). [2025-10-28T19:38:32.154060] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-28T19:38:32.289891] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:38:32.301056] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-28T19:38:33.285824] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:38:33.297293] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-28T19:38:33.407880] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-28T19:38:33.419104] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-28T19:38:33.904482] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T19:38:33.915899] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-28T19:38:34.423033] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:38:34.432751] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-28T19:38:35.061969] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:38:35.072941] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-28T19:38:35.549384] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T19:38:35.560326] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-28T19:38:35.560490] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-28T19:38:35.756595] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T19:38:35.757309] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:38:35.757378] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:38:35.757448] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-28T19:38:35.757514] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-28T19:38:35.757550] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-28T19:38:35.757589] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-28T19:38:35.757667] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KO took 20.6s. Estimated remaining: 2h 31m 59s. Rate: 7.6 symbols/min [2025-10-28T19:38:35.924780] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:35.950013] [DEBUG] [LOCAL ] KOF: Loaded 26160 existing records from primary storage. [2025-10-28T19:38:35.950254] [INFO ] [MAIN ] KOF: Loaded 26160 existing records. [2025-10-28T19:38:36.130333] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:36.130701] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-28T19:38:36.130776] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-28T19:38:36.131021] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-28T19:38:36.131151] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-28T19:38:36.482291] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T19:38:36.538870] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-28T19:38:36.578715] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:36.580197] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-28T19:38:37.652042] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T19:38:37.658457] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-28T19:38:37.910770] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T19:38:37.922591] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-28T19:38:38.481205] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T19:38:38.487693] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-28T19:38:38.975082] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:38:38.986472] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-28T19:38:39.245963] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:38:39.250961] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-28T19:38:40.146804] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T19:38:40.153312] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-28T19:38:40.255344] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:38:40.266826] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-28T19:38:40.992208] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:38:40.998245] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-28T19:38:41.690880] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:38:41.701697] [INFO ] [REMOTE ] KNX: Full fetch complete (76346 records). [2025-10-28T19:38:41.701846] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-28T19:38:42.103899] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-28T19:38:42.103975] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-28T19:38:42.105010] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-28T19:38:42.105071] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-28T19:38:42.106538] [DEBUG] [LOCAL ] KNX: Trimmed 76346 records to 52642 (keeping 200 days of data) [2025-10-28T19:38:42.426357] [DEBUG] [LOCAL ] KNX: Primary data saved (52642 records). [2025-10-28T19:38:42.426491] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-28T19:38:42.426586] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KNX took 35.5s. Estimated remaining: 2h 31m 50s. Rate: 7.6 symbols/min [2025-10-28T19:38:42.600542] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:42.618299] [DEBUG] [LOCAL ] KOP: Loaded 17144 existing records from primary storage. [2025-10-28T19:38:42.618527] [INFO ] [MAIN ] KOP: Loaded 17144 existing records. [2025-10-28T19:38:42.822086] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:42.822343] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-28T19:38:42.822398] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-28T19:38:42.822592] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-28T19:38:42.822633] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-28T19:38:43.187219] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:43.187600] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-28T19:38:43.787523] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (14.26 seconds). [2025-10-28T19:38:43.797728] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-28T19:38:44.020052] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T19:38:44.023940] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-28T19:38:44.669833] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:38:44.673782] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-28T19:38:44.813774] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:38:44.822924] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-28T19:38:45.431253] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:38:45.438386] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-28T19:38:45.969467] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:38:45.979773] [INFO ] [REMOTE ] KODK: Full fetch complete (63218 records). [2025-10-28T19:38:45.979972] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-28T19:38:46.381155] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-28T19:38:46.388108] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-28T19:38:46.401152] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T19:38:46.402488] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-28T19:38:46.409263] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-28T19:38:46.409595] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-28T19:38:46.411636] [DEBUG] [LOCAL ] KODK: Trimmed 63218 records to 43385 (keeping 200 days of data) [2025-10-28T19:38:46.654468] [DEBUG] [LOCAL ] KODK: Primary data saved (43385 records). [2025-10-28T19:38:46.654608] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-28T19:38:46.655364] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KODK took 26.2s. Estimated remaining: 2h 31m 39s. Rate: 7.6 symbols/min [2025-10-28T19:38:46.827314] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:46.827478] [DEBUG] [LOCAL ] KORE: No existing data file found in primary storage. [2025-10-28T19:38:46.827515] [WARN ] [MAIN ] KORE: No existing data found, performing full refresh instead. [2025-10-28T19:38:46.827622] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-28T19:38:46.827695] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-28T19:38:46.827749] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-28T19:38:46.827782] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-28T19:38:47.206688] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:47.212375] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-28T19:38:47.219829] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T19:38:47.224610] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-28T19:38:47.899988] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:38:47.902606] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-28T19:38:48.241036] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T19:38:48.242493] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-28T19:38:48.471565] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (14.04 seconds). [2025-10-28T19:38:48.481987] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-28T19:38:49.769056] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:38:49.781320] [INFO ] [REMOTE ] KNTK: Full fetch complete (66189 records). [2025-10-28T19:38:49.781471] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-28T19:38:50.160669] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-28T19:38:50.160759] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-28T19:38:50.161696] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-28T19:38:50.161758] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-28T19:38:50.163116] [DEBUG] [LOCAL ] KNTK: Trimmed 66189 records to 47159 (keeping 200 days of data) [2025-10-28T19:38:50.449982] [DEBUG] [LOCAL ] KNTK: Primary data saved (47159 records). [2025-10-28T19:38:50.450142] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-28T19:38:50.450262] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KNTK took 59.2s. Estimated remaining: 2h 31m 27s. Rate: 7.6 symbols/min [2025-10-28T19:38:50.623442] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:50.675391] [DEBUG] [LOCAL ] KOS: Loaded 53087 existing records from primary storage. [2025-10-28T19:38:50.675741] [INFO ] [MAIN ] KOS: Loaded 53087 existing records. [2025-10-28T19:38:50.872893] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:50.873105] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-28T19:38:50.873152] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-28T19:38:50.873961] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-28T19:38:50.874032] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-28T19:38:51.268723] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:51.269030] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-28T19:38:51.573128] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (10.57 seconds). [2025-10-28T19:38:51.579339] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-28T19:38:52.143615] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (3.90 seconds). [2025-10-28T19:38:52.145235] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-28T19:38:52.440924] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T19:38:52.442563] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-28T19:38:52.596559] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:38:52.607070] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-28T19:38:52.758808] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T19:38:52.760425] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-28T19:38:53.039185] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-28T19:38:53.040867] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-28T19:38:54.004780] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:38:54.014922] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-28T19:38:55.878268] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (8.65 seconds). [2025-10-28T19:38:55.881808] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-28T19:38:56.574341] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T19:38:56.578349] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-28T19:38:56.757750] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (3.72 seconds). [2025-10-28T19:38:56.759077] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-28T19:38:57.062579] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T19:38:57.063745] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-28T19:38:57.375198] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T19:38:57.376407] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-28T19:38:57.811993] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T19:38:57.813246] [INFO ] [REMOTE ] KORE: Full fetch complete (3770 records). [2025-10-28T19:38:57.813315] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-28T19:38:58.161398] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-28T19:38:58.161475] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-28T19:38:58.161619] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-28T19:38:58.161684] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-28T19:38:58.162042] [DEBUG] [LOCAL ] KORE: Trimmed 3770 records to 2278 (keeping 200 days of data) [2025-10-28T19:38:58.174684] [DEBUG] [LOCAL ] KORE: Primary data saved (2278 records). [2025-10-28T19:38:58.174752] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-28T19:38:58.174812] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KORE took 11.5s. Estimated remaining: 2h 31m 19s. Rate: 7.6 symbols/min [2025-10-28T19:38:58.340104] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:58.391689] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-28T19:38:58.391999] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-28T19:38:58.568981] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:58.569203] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-28T19:38:58.569254] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-28T19:38:58.570095] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-28T19:38:58.570151] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-28T19:38:58.918606] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:58.918898] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-28T19:39:00.125502] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (8.55 seconds). [2025-10-28T19:39:00.131684] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-28T19:39:00.280340] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T19:39:00.291313] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-28T19:39:00.991285] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T19:39:01.000508] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-28T19:39:01.709552] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T19:39:01.721066] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-28T19:39:01.823211] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T19:39:01.830294] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-28T19:39:02.936896] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T19:39:02.942402] [INFO ] [REMOTE ] KOF: Full fetch complete (37790 records). [2025-10-28T19:39:02.942492] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-28T19:39:03.323266] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-28T19:39:03.323393] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-28T19:39:03.324435] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-28T19:39:03.324524] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-28T19:39:03.325577] [DEBUG] [LOCAL ] KOF: Trimmed 37790 records to 25986 (keeping 200 days of data) [2025-10-28T19:39:03.483778] [DEBUG] [LOCAL ] KOF: Primary data saved (25986 records). [2025-10-28T19:39:03.484071] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-28T19:39:03.484156] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KOF took 27.7s. Estimated remaining: 2h 31m 9s. Rate: 7.6 symbols/min [2025-10-28T19:39:03.612589] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T19:39:03.642333] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-28T19:39:03.697360] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:03.736152] [DEBUG] [LOCAL ] KRC: Loaded 47927 existing records from primary storage. [2025-10-28T19:39:03.736445] [INFO ] [MAIN ] KRC: Loaded 47927 existing records. [2025-10-28T19:39:03.908392] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:03.908569] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-28T19:39:03.908613] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-28T19:39:03.909384] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-28T19:39:03.909441] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-28T19:39:04.256504] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:04.256837] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-28T19:39:05.160488] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T19:39:05.172611] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-28T19:39:15.593779] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (21.58 seconds). [2025-10-28T19:39:15.611128] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-28T19:39:17.004975] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T19:39:17.016275] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-28T19:39:18.322874] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:39:18.334209] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-28T19:39:19.198614] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (14.94 seconds). [2025-10-28T19:39:19.207920] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-28T19:39:19.592081] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T19:39:19.602820] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-28T19:39:21.432080] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (24.85 seconds). [2025-10-28T19:39:21.436758] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-28T19:39:22.099543] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:39:22.106894] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-28T19:39:22.829190] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:39:22.833148] [INFO ] [REMOTE ] KOP: Full fetch complete (25330 records). [2025-10-28T19:39:22.833225] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-28T19:39:23.206727] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-28T19:39:23.206831] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-28T19:39:23.207456] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-28T19:39:23.207521] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-28T19:39:23.208318] [DEBUG] [LOCAL ] KOP: Trimmed 25330 records to 17107 (keeping 200 days of data) [2025-10-28T19:39:23.313017] [DEBUG] [LOCAL ] KOP: Primary data saved (17107 records). [2025-10-28T19:39:23.313161] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-28T19:39:23.313237] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KOP took 40.9s. Estimated remaining: 2h 31m 12s. Rate: 7.6 symbols/min [2025-10-28T19:39:23.488632] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:23.522014] [DEBUG] [LOCAL ] KREF: Loaded 37851 existing records from primary storage. [2025-10-28T19:39:23.522302] [INFO ] [MAIN ] KREF: Loaded 37851 existing records. [2025-10-28T19:39:23.708110] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:23.708415] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-28T19:39:23.708494] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-28T19:39:23.709246] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-28T19:39:23.709308] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-28T19:39:24.076698] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:24.077021] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-28T19:39:24.896042] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T19:39:24.902518] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-28T19:39:25.861916] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:39:25.868108] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-28T19:39:26.785026] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:39:26.792805] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-28T19:39:27.843452] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T19:39:27.852249] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-28T19:39:28.853051] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T19:39:28.862111] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-28T19:39:29.832974] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T19:39:29.841547] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-28T19:39:30.868567] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:39:30.877503] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-28T19:39:31.743457] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T19:39:31.751302] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-28T19:39:32.808243] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:39:32.817877] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-28T19:39:34.086773] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T19:39:34.095025] [INFO ] [REMOTE ] KREF: Full fetch complete (53070 records). [2025-10-28T19:39:34.095188] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-28T19:39:34.502667] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-28T19:39:34.502762] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-28T19:39:34.503609] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-28T19:39:34.503693] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-28T19:39:34.504876] [DEBUG] [LOCAL ] KREF: Trimmed 53070 records to 37791 (keeping 200 days of data) [2025-10-28T19:39:34.732057] [DEBUG] [LOCAL ] KREF: Primary data saved (37791 records). [2025-10-28T19:39:34.732206] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-28T19:39:34.732288] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KREF took 11.4s. Estimated remaining: 2h 31m 8s. Rate: 7.6 symbols/min [2025-10-28T19:39:34.925362] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:34.971154] [DEBUG] [LOCAL ] KRG: Loaded 49194 existing records from primary storage. [2025-10-28T19:39:34.971514] [INFO ] [MAIN ] KRG: Loaded 49194 existing records. [2025-10-28T19:39:35.158188] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:35.158408] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-28T19:39:35.158455] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-28T19:39:35.159000] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-28T19:39:35.159063] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-28T19:39:35.511252] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:35.511560] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-28T19:39:36.698982] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T19:39:36.708905] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-28T19:39:37.849667] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T19:39:37.859334] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-28T19:39:38.412425] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (18.81 seconds). [2025-10-28T19:39:38.423963] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-28T19:39:38.592884] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (33.42 seconds). [2025-10-28T19:39:38.604220] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-28T19:39:39.017590] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:39:39.027857] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-28T19:39:39.753471] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:39:39.768897] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-28T19:39:39.931614] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T19:39:39.945426] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-28T19:39:40.158605] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T19:39:40.169506] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-28T19:39:41.334976] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:39:41.345576] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-28T19:39:42.456128] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:39:42.466754] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-28T19:39:43.618772] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:39:43.630722] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-28T19:39:52.162094] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (32.95 seconds). [2025-10-28T19:39:52.171632] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-28T19:39:53.517821] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:39:53.528219] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-28T19:39:54.725317] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:39:54.735842] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-28T19:39:55.211607] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (15.44 seconds). [2025-10-28T19:39:55.223107] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-28T19:39:55.983857] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:39:55.994431] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-28T19:39:56.718262] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T19:39:56.729459] [INFO ] [REMOTE ] KOS: Full fetch complete (77032 records). [2025-10-28T19:39:56.729634] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-28T19:39:57.134980] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-28T19:39:57.135176] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-28T19:39:57.136429] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-28T19:39:57.136593] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-28T19:39:57.138326] [DEBUG] [LOCAL ] KOS: Trimmed 77032 records to 53090 (keeping 200 days of data) [2025-10-28T19:39:57.353958] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T19:39:57.395693] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-28T19:39:57.471025] [DEBUG] [LOCAL ] KOS: Primary data saved (53090 records). [2025-10-28T19:39:57.471182] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-28T19:39:57.471293] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KOS took 1m 7s. Estimated remaining: 2h 31m 14s. Rate: 7.6 symbols/min [2025-10-28T19:39:57.652265] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:57.652767] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-28T19:39:57.652891] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-28T19:39:57.653016] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-28T19:39:57.653060] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-28T19:39:57.653105] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-28T19:39:57.653142] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-28T19:39:57.827274] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (17.88 seconds). [2025-10-28T19:39:57.875495] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-28T19:39:58.117794] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:58.118220] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-28T19:39:58.254109] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:39:58.254452] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-28T19:39:58.254555] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:39:58.254626] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-28T19:39:58.254712] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:39:58.254784] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-28T19:39:58.254850] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-28T19:39:58.254888] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-28T19:39:58.254927] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-28T19:39:58.254975] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KRMN took 0.8s. Estimated remaining: 2h 30m 59s. Rate: 7.6 symbols/min [2025-10-28T19:39:58.431693] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:58.460864] [DEBUG] [LOCAL ] KRO: Loaded 26446 existing records from primary storage. [2025-10-28T19:39:58.461242] [INFO ] [MAIN ] KRO: Loaded 26446 existing records. [2025-10-28T19:39:58.659026] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:58.659383] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-28T19:39:58.659462] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-28T19:39:58.660057] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-28T19:39:58.660197] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-28T19:39:58.865464] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:39:58.945161] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-28T19:39:59.107153] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:59.107582] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-28T19:39:59.267395] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:39:59.278727] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-28T19:39:59.832102] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:39:59.836194] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-28T19:40:00.037881] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T19:40:00.048336] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-28T19:40:00.529689] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T19:40:00.533263] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-28T19:40:00.859074] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T19:40:00.870925] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-28T19:40:01.322900] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:40:01.333396] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-28T19:40:01.399459] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T19:40:01.407243] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-28T19:40:02.343801] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T19:40:02.355819] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-28T19:40:02.600787] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T19:40:02.617967] [INFO ] [REMOTE ] KR: Full fetch complete (77844 records). [2025-10-28T19:40:02.618218] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-28T19:40:03.174878] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-28T19:40:03.176208] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-28T19:40:03.183220] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-28T19:40:03.181741] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T19:40:03.183874] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-28T19:40:03.196420] [INFO ] [REMOTE ] KRC: Full fetch complete (70041 records). [2025-10-28T19:40:03.196781] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-28T19:40:03.197526] [DEBUG] [LOCAL ] KR: Trimmed 77844 records to 53681 (keeping 200 days of data) [2025-10-28T19:40:03.550519] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:40:03.584850] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-28T19:40:03.871850] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-28T19:40:03.872928] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-28T19:40:03.875257] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-28T19:40:03.877343] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-28T19:40:03.898894] [DEBUG] [LOCAL ] KRC: Trimmed 70041 records to 47934 (keeping 200 days of data) [2025-10-28T19:40:04.069249] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-28T19:40:04.074693] [INFO ] [MAIN ] KR: Full history saved. [2025-10-28T19:40:04.089346] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KR took 1m 6s. Estimated remaining: 2h 30m 49s. Rate: 7.6 symbols/min [2025-10-28T19:40:04.388354] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:04.446840] [DEBUG] [LOCAL ] KRC: Primary data saved (47934 records). [2025-10-28T19:40:04.447039] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-28T19:40:04.447298] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRC took 1m 1s. Estimated remaining: 2h 30m 34s. Rate: 7.6 symbols/min [2025-10-28T19:40:04.639465] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:04.640631] [DEBUG] [LOCAL ] KRP: Loaded 35495 existing records from primary storage. [2025-10-28T19:40:04.640868] [INFO ] [MAIN ] KRP: Loaded 35495 existing records. [2025-10-28T19:40:04.843208] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:04.843491] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-28T19:40:04.843545] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-28T19:40:04.844000] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-28T19:40:04.844058] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-28T19:40:05.050695] [DEBUG] [LOCAL ] KSS: Loaded 53574 existing records from primary storage. [2025-10-28T19:40:05.077271] [INFO ] [MAIN ] KSS: Loaded 53574 existing records. [2025-10-28T19:40:05.436341] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:05.440120] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:05.440493] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-28T19:40:05.441365] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-28T19:40:05.441438] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-28T19:40:05.441628] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-28T19:40:05.441719] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-28T19:40:05.799972] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:05.800265] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-28T19:40:06.886747] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:40:06.895108] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-28T19:40:07.103325] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (23.47 seconds). [2025-10-28T19:40:07.114287] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-28T19:40:07.200775] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T19:40:07.211531] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-28T19:40:07.875608] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:40:07.883484] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-28T19:40:08.521081] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T19:40:08.531916] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-28T19:40:08.585073] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T19:40:08.595604] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-28T19:40:09.098364] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (5.51 seconds). [2025-10-28T19:40:09.104123] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-28T19:40:09.331597] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T19:40:09.342075] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-28T19:40:09.971778] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:40:09.981829] [INFO ] [REMOTE ] KRG: Full fetch complete (71438 records). [2025-10-28T19:40:09.981956] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-28T19:40:10.404851] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-28T19:40:10.405490] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-28T19:40:10.407197] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-28T19:40:10.407283] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-28T19:40:10.409052] [DEBUG] [LOCAL ] KRG: Trimmed 71438 records to 49201 (keeping 200 days of data) [2025-10-28T19:40:10.631822] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T19:40:10.697014] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-28T19:40:10.784042] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:40:10.796028] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-28T19:40:10.810510] [DEBUG] [LOCAL ] KRG: Primary data saved (49201 records). [2025-10-28T19:40:10.810599] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-28T19:40:10.810696] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRG took 36.1s. Estimated remaining: 2h 30m 25s. Rate: 7.6 symbols/min [2025-10-28T19:40:10.981384] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:11.021057] [DEBUG] [LOCAL ] KT: Loaded 45188 existing records from primary storage. [2025-10-28T19:40:11.021367] [INFO ] [MAIN ] KT: Loaded 45188 existing records. [2025-10-28T19:40:11.199329] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:11.199555] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-28T19:40:11.199601] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-28T19:40:11.200465] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-28T19:40:11.200522] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-28T19:40:11.549235] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:11.549519] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-28T19:40:11.809267] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:40:11.818540] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-28T19:40:12.460286] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T19:40:12.474856] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-28T19:40:12.758683] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T19:40:12.768086] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-28T19:40:12.800784] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:40:12.809129] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-28T19:40:13.808275] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:40:13.816875] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-28T19:40:13.856224] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:40:13.865674] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-28T19:40:14.102497] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T19:40:14.113889] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-28T19:40:14.936292] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:40:14.945349] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-28T19:40:15.004336] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:40:15.015706] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-28T19:40:15.422456] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:40:15.433459] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-28T19:40:15.934891] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T19:40:15.942845] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-28T19:40:16.043938] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:40:16.058229] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-28T19:40:16.942706] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (7.84 seconds). [2025-10-28T19:40:16.949452] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-28T19:40:17.015542] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T19:40:17.027854] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-28T19:40:17.130513] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T19:40:17.141393] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-28T19:40:17.769676] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T19:40:17.777279] [INFO ] [REMOTE ] KRP: Full fetch complete (54683 records). [2025-10-28T19:40:17.777462] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-28T19:40:17.904226] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T19:40:17.932739] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-28T19:40:18.222028] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-28T19:40:18.222284] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-28T19:40:18.223389] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-28T19:40:18.223476] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-28T19:40:18.253992] [DEBUG] [LOCAL ] KRP: Trimmed 54683 records to 35449 (keeping 200 days of data) [2025-10-28T19:40:18.256605] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:40:18.268171] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-28T19:40:18.491446] [DEBUG] [LOCAL ] KRP: Primary data saved (35449 records). [2025-10-28T19:40:18.491674] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-28T19:40:18.491890] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KRP took 14.4s. Estimated remaining: 2h 30m 17s. Rate: 7.6 symbols/min [2025-10-28T19:40:18.707190] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:18.712772] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T19:40:18.726499] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-28T19:40:18.761239] [DEBUG] [LOCAL ] KTB: Loaded 39895 existing records from primary storage. [2025-10-28T19:40:18.761550] [INFO ] [MAIN ] KTB: Loaded 39895 existing records. [2025-10-28T19:40:18.949990] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:18.950343] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-28T19:40:18.950419] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-28T19:40:18.957816] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-28T19:40:18.969418] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-28T19:40:19.036157] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:40:19.080304] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-28T19:40:19.335488] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:19.335861] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-28T19:40:20.164942] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T19:40:20.191392] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-28T19:40:20.192910] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T19:40:20.199730] [INFO ] [REMOTE ] KRO: Full fetch complete (35412 records). [2025-10-28T19:40:20.199816] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-28T19:40:20.592683] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-28T19:40:20.592859] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-28T19:40:20.593683] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-28T19:40:20.593767] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-28T19:40:20.595025] [DEBUG] [LOCAL ] KRO: Trimmed 35412 records to 26457 (keeping 200 days of data) [2025-10-28T19:40:20.614616] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T19:40:20.675320] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-28T19:40:20.770367] [DEBUG] [LOCAL ] KRO: Primary data saved (26457 records). [2025-10-28T19:40:20.770485] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-28T19:40:20.770560] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KRO took 22.5s. Estimated remaining: 2h 30m 4s. Rate: 7.6 symbols/min [2025-10-28T19:40:20.941991] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:20.953115] [DEBUG] [LOCAL ] KTF: Loaded 11395 existing records from primary storage. [2025-10-28T19:40:20.953342] [INFO ] [MAIN ] KTF: Loaded 11395 existing records. [2025-10-28T19:40:21.137839] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:21.138064] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-28T19:40:21.138110] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-28T19:40:21.138429] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-28T19:40:21.138484] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-28T19:40:21.489284] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:21.489557] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-28T19:40:22.499936] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-28T19:40:22.510950] [INFO ] [REMOTE ] KSS: Full fetch complete (77737 records). [2025-10-28T19:40:22.511098] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-28T19:40:22.914684] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-28T19:40:22.914782] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-28T19:40:22.915878] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-28T19:40:22.915960] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-28T19:40:22.917496] [DEBUG] [LOCAL ] KSS: Trimmed 77737 records to 53573 (keeping 200 days of data) [2025-10-28T19:40:23.166296] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T19:40:23.178980] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-28T19:40:23.261618] [DEBUG] [LOCAL ] KSS: Primary data saved (53573 records). [2025-10-28T19:40:23.261886] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-28T19:40:23.261980] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KSS took 18.8s. Estimated remaining: 2h 29m 51s. Rate: 7.6 symbols/min [2025-10-28T19:40:23.445550] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:23.499741] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-28T19:40:23.500088] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-28T19:40:23.689727] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:23.690118] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-28T19:40:23.690278] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-28T19:40:23.691155] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-28T19:40:23.691214] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-28T19:40:23.805724] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T19:40:23.829254] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-28T19:40:24.067958] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:24.068313] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-28T19:40:25.365777] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:40:25.376878] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-28T19:40:26.868497] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T19:40:26.878832] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-28T19:40:28.509079] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T19:40:28.521232] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-28T19:40:29.928917] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:40:29.940393] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-28T19:40:30.420293] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (12.15 seconds). [2025-10-28T19:40:30.429585] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-28T19:40:31.228846] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T19:40:31.240161] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-28T19:40:31.558926] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:40:31.568425] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-28T19:40:32.318200] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (11.64 seconds). [2025-10-28T19:40:32.326472] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-28T19:40:32.558460] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:40:32.574726] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-28T19:40:32.780610] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:40:32.791046] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-28T19:40:33.398097] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T19:40:33.407004] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-28T19:40:34.139194] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:40:34.150906] [INFO ] [REMOTE ] KT: Full fetch complete (66553 records). [2025-10-28T19:40:34.151037] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-28T19:40:34.540670] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-28T19:40:34.540836] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-28T19:40:34.541939] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-28T19:40:34.542083] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-28T19:40:34.543612] [DEBUG] [LOCAL ] KT: Trimmed 66553 records to 45095 (keeping 200 days of data) [2025-10-28T19:40:34.657267] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:40:34.678834] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-28T19:40:34.845715] [DEBUG] [LOCAL ] KT: Primary data saved (45095 records). [2025-10-28T19:40:34.845833] [INFO ] [MAIN ] KT: Full history saved. [2025-10-28T19:40:34.845959] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KT took 24.0s. Estimated remaining: 2h 29m 47s. Rate: 7.6 symbols/min [2025-10-28T19:40:35.039119] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (11.21 seconds). [2025-10-28T19:40:35.061026] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:35.061595] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-28T19:40:35.106908] [DEBUG] [LOCAL ] KVYO: Loaded 50902 existing records from primary storage. [2025-10-28T19:40:35.107203] [INFO ] [MAIN ] KVYO: Loaded 50902 existing records. [2025-10-28T19:40:35.280061] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:35.280278] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-28T19:40:35.280323] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-28T19:40:35.280505] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-28T19:40:35.280542] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-28T19:40:35.634837] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:35.635253] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-28T19:40:35.763628] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T19:40:35.768090] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-28T19:40:35.792333] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:40:35.801458] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-28T19:40:36.335142] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T19:40:36.337870] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-28T19:40:36.719829] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T19:40:36.727831] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-28T19:40:36.792454] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:40:36.796110] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-28T19:40:36.966946] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:40:36.976001] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-28T19:40:37.311210] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T19:40:37.314541] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-28T19:40:37.705170] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:40:37.714423] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-28T19:40:37.887779] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:40:37.891038] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-28T19:40:38.077012] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:40:38.086128] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-28T19:40:38.389270] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T19:40:38.392343] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-28T19:40:39.017374] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:40:39.020603] [INFO ] [REMOTE ] KTF: Full fetch complete (17544 records). [2025-10-28T19:40:39.020739] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-28T19:40:39.447076] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-28T19:40:39.447220] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-28T19:40:39.447888] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-28T19:40:39.447963] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-28T19:40:39.448889] [DEBUG] [LOCAL ] KTF: Trimmed 17544 records to 11465 (keeping 200 days of data) [2025-10-28T19:40:39.529147] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:40:39.543010] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-28T19:40:39.561018] [DEBUG] [LOCAL ] KTF: Primary data saved (11465 records). [2025-10-28T19:40:39.561119] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-28T19:40:39.561194] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KTF took 18.8s. Estimated remaining: 2h 29m 36s. Rate: 7.6 symbols/min [2025-10-28T19:40:39.751989] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:39.787898] [DEBUG] [LOCAL ] KW: Loaded 40000 existing records from primary storage. [2025-10-28T19:40:39.788175] [INFO ] [MAIN ] KW: Loaded 40000 existing records. [2025-10-28T19:40:39.972456] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:39.972684] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-28T19:40:39.972743] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-28T19:40:39.973024] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-28T19:40:39.973064] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-28T19:40:40.372618] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:40.372988] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-28T19:40:40.958686] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:40:40.969226] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-28T19:40:41.429390] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:40:41.438381] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-28T19:40:42.512226] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:40:42.519637] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-28T19:40:43.605606] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T19:40:43.615693] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-28T19:40:44.744425] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T19:40:44.753848] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-28T19:40:45.791926] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T19:40:45.801148] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-28T19:40:48.609802] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (16.04 seconds). [2025-10-28T19:40:48.621250] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-28T19:40:49.928582] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T19:40:49.941198] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-28T19:40:50.874688] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (13.16 seconds). [2025-10-28T19:40:50.884236] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-28T19:40:51.675375] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T19:40:51.688291] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-28T19:40:51.953507] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:40:51.962823] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-28T19:40:52.361071] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:40:52.372798] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-28T19:40:52.373026] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-28T19:40:52.809869] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-28T19:40:52.809987] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-28T19:40:52.811779] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-28T19:40:52.811872] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-28T19:40:52.814251] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-28T19:40:53.178472] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:40:53.193822] [INFO ] [REMOTE ] KTB: Full fetch complete (58242 records). [2025-10-28T19:40:53.202941] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-28T19:40:53.213502] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-28T19:40:53.213818] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-28T19:40:53.213925] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KVUE took 30.0s. Estimated remaining: 2h 29m 33s. Rate: 7.6 symbols/min [2025-10-28T19:40:53.544855] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:53.719924] [DEBUG] [LOCAL ] KWR: Loaded 15417 existing records from primary storage. [2025-10-28T19:40:53.748311] [INFO ] [MAIN ] KWR: Loaded 15417 existing records. [2025-10-28T19:40:53.875015] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-28T19:40:53.886144] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-28T19:40:53.898323] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-28T19:40:53.904172] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-28T19:40:53.973094] [DEBUG] [LOCAL ] KTB: Trimmed 58242 records to 39775 (keeping 200 days of data) [2025-10-28T19:40:53.977825] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:53.978413] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-28T19:40:53.978714] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-28T19:40:53.979018] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-28T19:40:53.979077] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-28T19:40:54.475420] [DEBUG] [LOCAL ] KTB: Primary data saved (39775 records). [2025-10-28T19:40:54.491581] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-28T19:40:54.500170] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KTB took 36.0s. Estimated remaining: 2h 29m 19s. Rate: 7.6 symbols/min [2025-10-28T19:40:54.691995] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:54.702689] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-28T19:40:54.758339] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:54.788333] [DEBUG] [LOCAL ] KYN: Loaded 29810 existing records from primary storage. [2025-10-28T19:40:54.788573] [INFO ] [MAIN ] KYN: Loaded 29810 existing records. [2025-10-28T19:40:54.962939] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:54.963175] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-28T19:40:54.963229] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-28T19:40:54.963407] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-28T19:40:54.963481] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-28T19:40:55.326518] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:55.327098] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-28T19:40:55.421217] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:40:55.424799] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-28T19:40:56.062868] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (15.09 seconds). [2025-10-28T19:40:56.085487] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-28T19:40:56.087843] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T19:40:56.092827] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-28T19:40:56.215901] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:40:56.223020] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-28T19:40:56.811314] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T19:40:56.815814] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-28T19:40:57.047057] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T19:40:57.053437] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-28T19:40:57.109099] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:40:57.119638] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-28T19:40:57.425082] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T19:40:57.430001] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-28T19:40:57.730122] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:40:57.736487] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-28T19:40:58.216174] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T19:40:58.220250] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-28T19:40:58.257605] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T19:40:58.268145] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-28T19:40:58.692479] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T19:40:58.700304] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-28T19:40:58.856805] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:40:58.860810] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-28T19:40:59.418145] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T19:40:59.425509] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-28T19:40:59.457300] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T19:40:59.470197] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-28T19:40:59.483980] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T19:40:59.488481] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-28T19:41:00.643052] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:41:00.649263] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-28T19:41:01.051971] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T19:41:01.063471] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-28T19:41:01.748330] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:41:01.755861] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-28T19:41:02.492692] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T19:41:02.503791] [INFO ] [REMOTE ] KVYO: Full fetch complete (72436 records). [2025-10-28T19:41:02.504023] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-28T19:41:02.578575] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T19:41:02.634436] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-28T19:41:02.919720] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-28T19:41:02.919797] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-28T19:41:02.920764] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-28T19:41:02.920824] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-28T19:41:02.922094] [DEBUG] [LOCAL ] KVYO: Trimmed 72436 records to 50922 (keeping 200 days of data) [2025-10-28T19:41:03.140403] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (17.34 seconds). [2025-10-28T19:41:03.157844] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-28T19:41:03.241474] [DEBUG] [LOCAL ] KVYO: Primary data saved (50922 records). [2025-10-28T19:41:03.241587] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-28T19:41:03.241682] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KVYO took 28.4s. Estimated remaining: 2h 29m 12s. Rate: 7.6 symbols/min [2025-10-28T19:41:03.407044] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:03.443421] [DEBUG] [LOCAL ] L: Loaded 40785 existing records from primary storage. [2025-10-28T19:41:03.443703] [INFO ] [MAIN ] L: Loaded 40785 existing records. [2025-10-28T19:41:03.619364] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:03.619616] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-28T19:41:03.619698] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-28T19:41:03.620014] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-28T19:41:03.620070] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-28T19:41:03.889966] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:41:03.927582] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-28T19:41:03.998772] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:03.999031] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-28T19:41:04.252174] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:41:04.261068] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-28T19:41:05.083080] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:41:05.089247] [INFO ] [REMOTE ] KYN: Full fetch complete (44365 records). [2025-10-28T19:41:05.089332] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-28T19:41:05.491485] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-28T19:41:05.493304] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T19:41:05.492133] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-28T19:41:05.502072] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-28T19:41:05.502538] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-28T19:41:05.503171] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-28T19:41:05.504554] [DEBUG] [LOCAL ] KYN: Trimmed 44365 records to 29647 (keeping 200 days of data) [2025-10-28T19:41:05.678707] [DEBUG] [LOCAL ] KYN: Primary data saved (29647 records). [2025-10-28T19:41:05.678831] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-28T19:41:05.678907] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KYN took 11.2s. Estimated remaining: 2h 28m 59s. Rate: 7.6 symbols/min [2025-10-28T19:41:05.845676] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:05.898431] [DEBUG] [LOCAL ] LAC: Loaded 52585 existing records from primary storage. [2025-10-28T19:41:05.898742] [INFO ] [MAIN ] LAC: Loaded 52585 existing records. [2025-10-28T19:41:06.071563] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:06.071791] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-28T19:41:06.071847] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-28T19:41:06.072022] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-28T19:41:06.072059] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-28T19:41:06.439090] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:06.439463] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-28T19:41:06.498335] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:41:06.506604] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-28T19:41:08.053803] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T19:41:08.061765] [INFO ] [REMOTE ] KW: Full fetch complete (57178 records). [2025-10-28T19:41:08.061881] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-28T19:41:08.385806] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T19:41:08.398261] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-28T19:41:08.488243] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-28T19:41:08.488317] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-28T19:41:08.489845] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-28T19:41:08.489906] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-28T19:41:08.490985] [DEBUG] [LOCAL ] KW: Trimmed 57178 records to 39949 (keeping 200 days of data) [2025-10-28T19:41:08.721909] [DEBUG] [LOCAL ] KW: Primary data saved (39949 records). [2025-10-28T19:41:08.722048] [INFO ] [MAIN ] KW: Full history saved. [2025-10-28T19:41:08.722128] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KW took 29.2s. Estimated remaining: 2h 28m 47s. Rate: 7.6 symbols/min [2025-10-28T19:41:08.898545] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:08.922317] [DEBUG] [LOCAL ] LAD: Loaded 23328 existing records from primary storage. [2025-10-28T19:41:08.922574] [INFO ] [MAIN ] LAD: Loaded 23328 existing records. [2025-10-28T19:41:09.101233] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:09.101459] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-28T19:41:09.101505] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-28T19:41:09.101768] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-28T19:41:09.101825] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-28T19:41:09.463034] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:09.463440] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-28T19:41:09.883713] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T19:41:09.894360] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-28T19:41:10.376396] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:41:10.388191] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-28T19:41:11.268302] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:41:11.274117] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-28T19:41:12.111609] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (12.62 seconds). [2025-10-28T19:41:12.116395] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-28T19:41:12.136743] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T19:41:12.144687] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-28T19:41:12.621773] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T19:41:12.625206] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-28T19:41:13.337067] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T19:41:13.340700] [INFO ] [REMOTE ] KWR: Full fetch complete (22965 records). [2025-10-28T19:41:13.340864] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-28T19:41:13.768428] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-28T19:41:13.768581] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-28T19:41:13.770014] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-28T19:41:13.770129] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-28T19:41:13.771626] [DEBUG] [LOCAL ] KWR: Trimmed 22965 records to 15320 (keeping 200 days of data) [2025-10-28T19:41:13.881857] [DEBUG] [LOCAL ] KWR: Primary data saved (15320 records). [2025-10-28T19:41:13.882074] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-28T19:41:13.882188] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. KWR took 20.7s. Estimated remaining: 2h 28m 37s. Rate: 7.6 symbols/min [2025-10-28T19:41:14.069240] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:14.116354] [DEBUG] [LOCAL ] LADR: Loaded 39131 existing records from primary storage. [2025-10-28T19:41:14.116846] [INFO ] [MAIN ] LADR: Loaded 39131 existing records. [2025-10-28T19:41:14.303047] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:14.303391] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-28T19:41:14.303469] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-28T19:41:14.303856] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-28T19:41:14.303918] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-28T19:41:14.703476] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:14.704149] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-28T19:41:15.623966] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:41:15.631724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-28T19:41:16.544558] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T19:41:16.551611] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-28T19:41:16.856797] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (12.86 seconds). [2025-10-28T19:41:16.864767] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-28T19:41:17.499879] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T19:41:17.507945] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-28T19:41:18.585744] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:41:18.595197] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-28T19:41:31.724571] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (21.83 seconds). [2025-10-28T19:41:31.735602] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-28T19:41:33.212826] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:41:33.223680] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-28T19:41:34.659113] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T19:41:34.669960] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-28T19:41:35.980958] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:41:35.991844] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-28T19:41:37.539516] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T19:41:37.551923] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-28T19:41:44.630023] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (32.49 seconds). [2025-10-28T19:41:44.636613] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-28T19:41:45.404976] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T19:41:45.410359] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-28T19:41:52.080454] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (14.53 seconds). [2025-10-28T19:41:52.091678] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-28T19:41:53.685583] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T19:41:53.696982] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-28T19:41:55.926048] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-28T19:41:55.937105] [INFO ] [REMOTE ] LAC: Full fetch complete (76157 records). [2025-10-28T19:41:55.937262] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-28T19:41:56.054111] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (10.64 seconds). [2025-10-28T19:41:56.069633] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-28T19:41:56.352285] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-28T19:41:56.352360] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-28T19:41:56.353484] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-28T19:41:56.353547] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-28T19:41:56.354927] [DEBUG] [LOCAL ] LAC: Trimmed 76157 records to 52592 (keeping 200 days of data) [2025-10-28T19:41:56.652309] [DEBUG] [LOCAL ] LAC: Primary data saved (52592 records). [2025-10-28T19:41:56.652446] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-28T19:41:56.653417] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. LAC took 51.0s. Estimated remaining: 2h 29m 1s. Rate: 7.6 symbols/min [2025-10-28T19:41:56.825278] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:56.831294] [DEBUG] [LOCAL ] LANV: Loaded 2761 existing records from primary storage. [2025-10-28T19:41:56.831494] [INFO ] [MAIN ] LANV: Loaded 2761 existing records. [2025-10-28T19:41:57.040693] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:57.041200] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-28T19:41:57.041392] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-28T19:41:57.041601] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-28T19:41:57.041815] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-28T19:41:57.187009] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:41:57.247583] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-28T19:41:57.625725] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:57.627147] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-28T19:41:58.013064] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:41:58.016360] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-28T19:41:58.098041] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T19:41:58.103871] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-28T19:41:58.301313] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T19:41:58.302776] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-28T19:41:58.597396] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T19:41:58.599051] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-28T19:41:58.760581] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:41:58.765799] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-28T19:41:59.685812] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:41:59.691385] [INFO ] [REMOTE ] LAD: Full fetch complete (35775 records). [2025-10-28T19:41:59.691525] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-28T19:42:00.076112] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-28T19:42:00.076202] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-28T19:42:00.076986] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-28T19:42:00.077048] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-28T19:42:00.078041] [DEBUG] [LOCAL ] LAD: Trimmed 35775 records to 23261 (keeping 200 days of data) [2025-10-28T19:42:00.225960] [DEBUG] [LOCAL ] LAD: Primary data saved (23261 records). [2025-10-28T19:42:00.226095] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-28T19:42:00.226176] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LAD took 51.5s. Estimated remaining: 2h 28m 49s. Rate: 7.6 symbols/min [2025-10-28T19:42:00.395085] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:00.395265] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-28T19:42:00.395302] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-28T19:42:00.395407] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-28T19:42:00.395467] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-28T19:42:00.395507] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-28T19:42:00.395538] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-28T19:42:00.757750] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:00.758026] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-28T19:42:00.964048] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (44.10 seconds). [2025-10-28T19:42:00.971847] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-28T19:42:01.297357] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:42:01.300334] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-28T19:42:01.609088] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (43.01 seconds). [2025-10-28T19:42:01.616910] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-28T19:42:02.114321] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:42:02.122939] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-28T19:42:02.513707] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T19:42:02.522611] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-28T19:42:02.556296] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T19:42:02.564405] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-28T19:42:03.470914] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (4.87 seconds). [2025-10-28T19:42:03.472404] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-28T19:42:03.694896] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:42:03.704298] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-28T19:42:03.714436] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T19:42:03.715383] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-28T19:42:03.950220] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-28T19:42:03.951517] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-28T19:42:04.341076] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T19:42:04.342486] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-28T19:42:04.663618] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T19:42:04.675761] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-28T19:42:05.496754] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T19:42:05.498631] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-28T19:42:05.711264] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T19:42:05.720058] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-28T19:42:05.841538] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T19:42:05.843255] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-28T19:42:06.295015] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T19:42:06.296153] [INFO ] [REMOTE ] LANV: Full fetch complete (4204 records). [2025-10-28T19:42:06.296220] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-28T19:42:06.654618] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-28T19:42:06.654719] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-28T19:42:06.654870] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-28T19:42:06.654908] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-28T19:42:06.655241] [DEBUG] [LOCAL ] LANV: Trimmed 4204 records to 2765 (keeping 200 days of data) [2025-10-28T19:42:06.670452] [DEBUG] [LOCAL ] LANV: Primary data saved (2765 records). [2025-10-28T19:42:06.670517] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-28T19:42:06.670586] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LANV took 10.0s. Estimated remaining: 2h 28m 40s. Rate: 7.6 symbols/min [2025-10-28T19:42:06.837952] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:06.854003] [DEBUG] [LOCAL ] LAW: Loaded 15098 existing records from primary storage. [2025-10-28T19:42:06.854221] [INFO ] [MAIN ] LAW: Loaded 15098 existing records. [2025-10-28T19:42:07.040394] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:42:07.040801] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-28T19:42:07.040957] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-28T19:42:07.041233] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-28T19:42:07.041307] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-28T19:42:07.176607] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:42:07.228121] [INFO ] [REMOTE ] LADR: Full fetch complete (55649 records). [2025-10-28T19:42:07.237419] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-28T19:42:07.626098] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:07.688187] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-28T19:42:07.853197] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-28T19:42:07.853270] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-28T19:42:07.854111] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-28T19:42:07.854171] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-28T19:42:07.855285] [DEBUG] [LOCAL ] LADR: Trimmed 55649 records to 39034 (keeping 200 days of data) [2025-10-28T19:42:08.088459] [DEBUG] [LOCAL ] LADR: Primary data saved (39034 records). [2025-10-28T19:42:08.088598] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-28T19:42:08.088731] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LADR took 54.2s. Estimated remaining: 2h 28m 26s. Rate: 7.6 symbols/min [2025-10-28T19:42:08.255898] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:08.294889] [DEBUG] [LOCAL ] LAZ: Loaded 44276 existing records from primary storage. [2025-10-28T19:42:08.295172] [INFO ] [MAIN ] LAZ: Loaded 44276 existing records. [2025-10-28T19:42:08.478304] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:42:08.478472] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-28T19:42:08.478520] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-28T19:42:08.478952] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-28T19:42:08.479021] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-28T19:42:08.837914] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:08.838213] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-28T19:42:09.942224] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:42:09.951841] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-28T19:42:10.957384] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:42:10.966154] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-28T19:42:12.082248] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:42:12.091924] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-28T19:42:13.242083] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T19:42:13.252292] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-28T19:42:14.573621] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (12.45 seconds). [2025-10-28T19:42:14.582286] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-28T19:42:15.640753] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:42:15.649298] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-28T19:42:16.726911] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:42:16.736996] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-28T19:42:17.868801] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:42:17.878079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-28T19:42:19.020578] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:42:19.029355] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-28T19:42:20.107199] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:42:20.116319] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-28T19:42:26.106470] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (23.58 seconds). [2025-10-28T19:42:26.116102] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-28T19:42:27.211710] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T19:42:27.221878] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-28T19:42:28.107885] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (14.86 seconds). [2025-10-28T19:42:28.118874] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-28T19:42:28.794927] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T19:42:28.804445] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-28T19:42:29.230544] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:42:29.239979] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-28T19:42:29.364446] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (21.68 seconds). [2025-10-28T19:42:29.367762] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-28T19:42:29.907530] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T19:42:29.916536] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-28T19:42:30.015851] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:42:30.019514] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-28T19:42:30.322157] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:42:30.332209] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-28T19:42:30.405055] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T19:42:30.408229] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-28T19:42:31.002541] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T19:42:31.005886] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-28T19:42:31.119417] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T19:42:31.130144] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-28T19:42:31.464390] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:42:31.473944] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-28T19:42:31.550144] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T19:42:31.553905] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-28T19:42:32.219400] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:42:32.223570] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-28T19:42:32.380454] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:42:32.390839] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-28T19:42:32.471926] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:42:32.481783] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-28T19:42:32.824671] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T19:42:32.828376] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-28T19:42:33.333034] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T19:42:33.337795] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-28T19:42:33.564684] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T19:42:33.575235] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-28T19:42:33.806791] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T19:42:33.810794] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-28T19:42:34.642815] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T19:42:34.647133] [INFO ] [REMOTE ] LAW: Full fetch complete (21192 records). [2025-10-28T19:42:34.647220] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-28T19:42:35.028432] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-28T19:42:35.028527] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-28T19:42:35.029066] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-28T19:42:35.029128] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-28T19:42:35.029902] [DEBUG] [LOCAL ] LAW: Trimmed 21192 records to 15102 (keeping 200 days of data) [2025-10-28T19:42:35.121012] [DEBUG] [LOCAL ] LAW: Primary data saved (15102 records). [2025-10-28T19:42:35.121169] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-28T19:42:35.121274] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LAW took 28.5s. Estimated remaining: 2h 28m 36s. Rate: 7.6 symbols/min [2025-10-28T19:42:35.298598] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:35.335149] [DEBUG] [LOCAL ] LB: Loaded 36633 existing records from primary storage. [2025-10-28T19:42:35.335427] [INFO ] [MAIN ] LB: Loaded 36633 existing records. [2025-10-28T19:42:35.511741] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:42:35.511961] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-28T19:42:35.512014] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-28T19:42:35.512239] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-28T19:42:35.512294] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-28T19:42:35.866722] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:35.867133] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-28T19:42:37.032467] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:42:37.041546] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-28T19:42:38.377766] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T19:42:38.385530] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-28T19:42:40.520846] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (20.40 seconds). [2025-10-28T19:42:40.529028] [INFO ] [REMOTE ] L: Full fetch complete (59242 records). [2025-10-28T19:42:40.529128] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-28T19:42:40.907077] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-28T19:42:40.907154] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-28T19:42:40.908048] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-28T19:42:40.908111] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-28T19:42:40.909200] [DEBUG] [LOCAL ] L: Trimmed 59242 records to 40788 (keeping 200 days of data) [2025-10-28T19:42:41.154814] [DEBUG] [LOCAL ] L: Primary data saved (40788 records). [2025-10-28T19:42:41.154959] [INFO ] [MAIN ] L: Full history saved. [2025-10-28T19:42:41.155052] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. L took 1m 38s. Estimated remaining: 2h 28m 26s. Rate: 7.6 symbols/min [2025-10-28T19:42:43.812212] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (11.33 seconds). [2025-10-28T19:42:43.820573] [INFO ] [REMOTE ] LAZ: Full fetch complete (65291 records). [2025-10-28T19:42:43.820762] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-28T19:42:44.210899] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-28T19:42:44.210983] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-28T19:42:44.212015] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-28T19:42:44.212078] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-28T19:42:44.213371] [DEBUG] [LOCAL ] LAZ: Trimmed 65291 records to 44224 (keeping 200 days of data) [2025-10-28T19:42:44.475335] [DEBUG] [LOCAL ] LAZ: Primary data saved (44224 records). [2025-10-28T19:42:44.475464] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-28T19:42:44.475557] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAZ took 36.4s. Estimated remaining: 2h 28m 14s. Rate: 7.6 symbols/min [2025-10-28T19:42:48.646868] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (10.26 seconds). [2025-10-28T19:42:48.655342] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-28T19:42:54.942686] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (21.37 seconds). [2025-10-28T19:42:54.953403] [INFO ] [REMOTE ] LAR: Full fetch complete (63995 records). [2025-10-28T19:42:54.953562] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-28T19:42:55.148403] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-28T19:42:55.149102] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:42:55.149176] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:42:55.149233] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-28T19:42:55.149296] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-28T19:42:55.149331] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-28T19:42:55.149369] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-28T19:42:55.149431] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LAR took 54.9s. Estimated remaining: 2h 28m 9s. Rate: 7.6 symbols/min [2025-10-28T19:43:01.465781] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (12.81 seconds). [2025-10-28T19:43:01.477931] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-28T19:43:02.504936] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T19:43:02.514004] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-28T19:43:03.511844] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:43:03.519362] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-28T19:43:04.735734] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T19:43:04.745791] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-28T19:43:05.822533] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:43:05.832462] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-28T19:43:06.814776] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:43:06.822742] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-28T19:43:07.907973] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T19:43:07.915267] [INFO ] [REMOTE ] LB: Full fetch complete (55393 records). [2025-10-28T19:43:07.915381] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-28T19:43:08.292766] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-28T19:43:08.292859] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-28T19:43:08.293744] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-28T19:43:08.293812] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-28T19:43:08.295134] [DEBUG] [LOCAL ] LB: Trimmed 55393 records to 36485 (keeping 200 days of data) [2025-10-28T19:43:08.514601] [DEBUG] [LOCAL ] LB: Primary data saved (36485 records). [2025-10-28T19:43:08.514758] [INFO ] [MAIN ] LB: Full history saved. [2025-10-28T19:43:08.514849] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LB took 33.4s. Estimated remaining: 2h 28m 6s. Rate: 7.6 symbols/min [2025-10-28T19:43:09.053055] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.208115] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.207162] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.242744] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.289456] [DEBUG] [LOCAL ] LCII: Loaded 26354 existing records from primary storage. [2025-10-28T19:43:09.289802] [INFO ] [MAIN ] LCII: Loaded 26354 existing records. [2025-10-28T19:43:09.438125] [DEBUG] [LOCAL ] LC: Loaded 48250 existing records from primary storage. [2025-10-28T19:43:09.445425] [DEBUG] [LOCAL ] LDI: Loaded 45259 existing records from primary storage. [2025-10-28T19:43:09.456183] [INFO ] [MAIN ] LC: Loaded 48250 existing records. [2025-10-28T19:43:09.483576] [INFO ] [MAIN ] LDI: Loaded 45259 existing records. [2025-10-28T19:43:09.586564] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:09.657480] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-28T19:43:09.626150] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-28T19:43:09.714060] [INFO ] [MAIN ] LBRT: Loaded 53003 existing records. [2025-10-28T19:43:09.713404] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-28T19:43:09.853073] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-28T19:43:09.858434] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-28T19:43:09.971321] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:10.076443] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-28T19:43:10.092427] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-28T19:43:10.092321] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:10.127242] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-28T19:43:10.148970] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-28T19:43:10.149166] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-28T19:43:10.149306] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-28T19:43:10.257468] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-28T19:43:10.278678] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-28T19:43:10.422131] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:10.544348] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-28T19:43:10.655284] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-28T19:43:10.767428] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-28T19:43:10.783981] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-28T19:43:11.215322] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.319436] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-28T19:43:11.397479] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.451823] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-28T19:43:11.679382] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.709127] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-28T19:43:11.708812] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.710286] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-28T19:43:12.243493] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:43:12.248519] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-28T19:43:12.814580] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:43:12.821805] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-28T19:43:12.905573] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:43:12.915484] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-28T19:43:12.931132] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T19:43:12.936565] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-28T19:43:13.043674] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:43:13.054526] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-28T19:43:13.618908] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:43:13.626027] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-28T19:43:13.784109] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:43:13.790710] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-28T19:43:14.581192] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T19:43:14.591135] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-28T19:43:14.855202] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T19:43:14.863171] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-28T19:43:15.755629] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:43:15.766584] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-28T19:43:17.093877] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:43:17.106438] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-28T19:43:18.310046] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T19:43:18.321006] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-28T19:43:18.849049] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (5.22 seconds). [2025-10-28T19:43:18.858852] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-28T19:43:18.942123] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (6.03 seconds). [2025-10-28T19:43:18.951811] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-28T19:43:19.606517] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T19:43:19.617366] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-28T19:43:19.931275] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:43:19.941385] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-28T19:43:19.994268] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:43:20.004836] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-28T19:43:21.048867] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:43:21.057039] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-28T19:43:22.086962] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:43:22.095702] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-28T19:43:22.296844] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (7.43 seconds). [2025-10-28T19:43:22.303369] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-28T19:43:23.155145] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:43:23.161400] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-28T19:43:23.263206] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T19:43:23.273364] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-28T19:43:23.891687] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:43:23.898074] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-28T19:43:24.728129] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T19:43:24.734119] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-28T19:43:25.867850] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (5.86 seconds). [2025-10-28T19:43:25.878128] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-28T19:43:26.926006] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (7.31 seconds). [2025-10-28T19:43:26.937779] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-28T19:43:26.973862] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:43:26.984135] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-28T19:43:28.083748] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T19:43:28.093338] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-28T19:43:28.179604] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T19:43:28.190578] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-28T19:43:28.988747] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (5.72 seconds). [2025-10-28T19:43:28.998374] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-28T19:43:29.517260] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:43:29.528496] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-28T19:43:30.962166] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (6.23 seconds). [2025-10-28T19:43:30.967426] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-28T19:43:31.834679] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:43:31.839864] [INFO ] [REMOTE ] LCII: Full fetch complete (38979 records). [2025-10-28T19:43:31.840037] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-28T19:43:32.267266] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-28T19:43:32.267373] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-28T19:43:32.268188] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-28T19:43:32.268282] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-28T19:43:32.269277] [DEBUG] [LOCAL ] LCII: Trimmed 38979 records to 26239 (keeping 200 days of data) [2025-10-28T19:43:32.433013] [DEBUG] [LOCAL ] LCII: Primary data saved (26239 records). [2025-10-28T19:43:32.433157] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-28T19:43:32.433239] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 23.9s. Estimated remaining: 2h 28m 13s. Rate: 7.6 symbols/min [2025-10-28T19:43:32.606211] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:32.646463] [DEBUG] [LOCAL ] LDOS: Loaded 44312 existing records from primary storage. [2025-10-28T19:43:32.646775] [INFO ] [MAIN ] LDOS: Loaded 44312 existing records. [2025-10-28T19:43:32.822089] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:32.822335] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-28T19:43:32.822382] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-28T19:43:32.823208] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-28T19:43:32.823266] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-28T19:43:33.176536] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:33.176878] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-28T19:43:34.175298] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (5.18 seconds). [2025-10-28T19:43:34.186396] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-28T19:43:34.347980] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:43:34.359535] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-28T19:43:35.560010] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:43:35.569584] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-28T19:43:35.710838] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:43:35.721372] [INFO ] [REMOTE ] LDI: Full fetch complete (62536 records). [2025-10-28T19:43:35.721486] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-28T19:43:36.100028] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-28T19:43:36.100106] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-28T19:43:36.101014] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-28T19:43:36.101080] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-28T19:43:36.102537] [DEBUG] [LOCAL ] LDI: Trimmed 62536 records to 45252 (keeping 200 days of data) [2025-10-28T19:43:36.353278] [DEBUG] [LOCAL ] LDI: Primary data saved (45252 records). [2025-10-28T19:43:36.353421] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-28T19:43:36.353504] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LDI took 27.8s. Estimated remaining: 2h 28m 1s. Rate: 7.6 symbols/min [2025-10-28T19:43:36.556113] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:36.557933] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (8.37 seconds). [2025-10-28T19:43:36.569966] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-28T19:43:36.581557] [DEBUG] [LOCAL ] LDP: Loaded 12250 existing records from primary storage. [2025-10-28T19:43:36.581789] [INFO ] [MAIN ] LDP: Loaded 12250 existing records. [2025-10-28T19:43:36.762890] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:36.763133] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-28T19:43:36.763179] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-28T19:43:36.763321] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-28T19:43:36.763358] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-28T19:43:37.213038] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:37.213699] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-28T19:43:37.265587] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T19:43:37.282184] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-28T19:43:38.087979] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:43:38.092397] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-28T19:43:38.543558] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:43:38.568601] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-28T19:43:38.570429] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:43:38.576327] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-28T19:43:38.925365] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (9.40 seconds). [2025-10-28T19:43:38.937616] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-28T19:43:39.209479] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T19:43:39.214291] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-28T19:43:39.742765] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:43:39.753732] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-28T19:43:39.858488] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T19:43:39.862841] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-28T19:43:40.093042] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:43:40.104202] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-28T19:43:40.802368] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T19:43:40.812626] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-28T19:43:41.498748] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:43:41.508919] [INFO ] [REMOTE ] LC: Full fetch complete (70704 records). [2025-10-28T19:43:41.509063] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-28T19:43:41.927501] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-28T19:43:41.927703] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-28T19:43:41.929415] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-28T19:43:41.929532] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-28T19:43:41.931596] [DEBUG] [LOCAL ] LC: Trimmed 70704 records to 48227 (keeping 200 days of data) [2025-10-28T19:43:42.250911] [DEBUG] [LOCAL ] LC: Primary data saved (48227 records). [2025-10-28T19:43:42.251102] [INFO ] [MAIN ] LC: Full history saved. [2025-10-28T19:43:42.251208] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LC took 33.7s. Estimated remaining: 2h 27m 51s. Rate: 7.6 symbols/min [2025-10-28T19:43:42.437119] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:42.482536] [DEBUG] [LOCAL ] LEA: Loaded 40872 existing records from primary storage. [2025-10-28T19:43:42.483014] [INFO ] [MAIN ] LEA: Loaded 40872 existing records. [2025-10-28T19:43:42.684077] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:42.684423] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-28T19:43:42.684476] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-28T19:43:42.684868] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-28T19:43:42.684929] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-28T19:43:42.896970] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (6.33 seconds). [2025-10-28T19:43:43.019418] [INFO ] [REMOTE ] LBRT: Full fetch complete (76932 records). [2025-10-28T19:43:43.031746] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-28T19:43:43.301242] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:43.307869] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-28T19:43:43.609439] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-28T19:43:43.609529] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-28T19:43:43.610555] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-28T19:43:43.610626] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-28T19:43:43.612193] [DEBUG] [LOCAL ] LBRT: Trimmed 76932 records to 53005 (keeping 200 days of data) [2025-10-28T19:43:43.938991] [DEBUG] [LOCAL ] LBRT: Primary data saved (53005 records). [2025-10-28T19:43:43.939124] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-28T19:43:43.939202] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LBRT took 35.4s. Estimated remaining: 2h 27m 38s. Rate: 7.6 symbols/min [2025-10-28T19:43:44.118784] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:44.163910] [DEBUG] [LOCAL ] LEG: Loaded 49847 existing records from primary storage. [2025-10-28T19:43:44.164232] [INFO ] [MAIN ] LEG: Loaded 49847 existing records. [2025-10-28T19:43:44.350876] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:44.351260] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-28T19:43:44.351307] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-28T19:43:44.351803] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-28T19:43:44.351860] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-28T19:43:44.716979] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:44.717287] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-28T19:43:45.123572] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (5.26 seconds). [2025-10-28T19:43:45.127635] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-28T19:43:46.949368] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (3.64 seconds). [2025-10-28T19:43:46.958294] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-28T19:43:48.027876] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:43:48.036094] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-28T19:43:49.328039] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T19:43:49.338258] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-28T19:43:49.782272] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (8.97 seconds). [2025-10-28T19:43:49.791814] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-28T19:43:50.412519] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:43:50.421722] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-28T19:43:50.437849] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (5.31 seconds). [2025-10-28T19:43:50.440707] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-28T19:43:51.114289] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:43:51.118095] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-28T19:43:51.169196] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (6.45 seconds). [2025-10-28T19:43:51.179181] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-28T19:43:51.615485] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:43:51.624717] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-28T19:43:51.693825] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:43:51.697245] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-28T19:43:52.178854] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T19:43:52.181922] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-28T19:43:52.292962] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T19:43:52.304131] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-28T19:43:52.685481] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:43:52.695371] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-28T19:43:53.359490] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:43:53.362182] [INFO ] [REMOTE ] LDP: Full fetch complete (18666 records). [2025-10-28T19:43:53.362262] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-28T19:43:53.764984] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T19:43:53.794925] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-28T19:43:53.814673] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-28T19:43:53.827009] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-28T19:43:53.831028] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-28T19:43:53.831160] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-28T19:43:53.833331] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (4.04 seconds). [2025-10-28T19:43:53.833839] [DEBUG] [LOCAL ] LDP: Trimmed 18666 records to 12139 (keeping 200 days of data) [2025-10-28T19:43:53.843804] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-28T19:43:53.920276] [DEBUG] [LOCAL ] LDP: Primary data saved (12139 records). [2025-10-28T19:43:53.920380] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-28T19:43:53.920456] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 17.6s. Estimated remaining: 2h 27m 32s. Rate: 7.6 symbols/min [2025-10-28T19:43:54.090007] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:54.139192] [DEBUG] [LOCAL ] LEN: Loaded 53194 existing records from primary storage. [2025-10-28T19:43:54.139504] [INFO ] [MAIN ] LEN: Loaded 53194 existing records. [2025-10-28T19:43:54.317808] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:54.318074] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-28T19:43:54.318125] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-28T19:43:54.319079] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-28T19:43:54.319141] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-28T19:43:54.681320] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:54.681720] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-28T19:43:55.022448] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:43:55.031764] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-28T19:43:55.922441] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:43:55.934117] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-28T19:43:56.317612] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:43:56.327006] [INFO ] [REMOTE ] LDOS: Full fetch complete (66578 records). [2025-10-28T19:43:56.327181] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-28T19:43:56.782877] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-28T19:43:56.783003] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-28T19:43:56.784225] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-28T19:43:56.784295] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-28T19:43:56.785829] [DEBUG] [LOCAL ] LDOS: Trimmed 66578 records to 44181 (keeping 200 days of data) [2025-10-28T19:43:57.068441] [DEBUG] [LOCAL ] LDOS: Primary data saved (44181 records). [2025-10-28T19:43:57.068570] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-28T19:43:57.068670] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LDOS took 24.6s. Estimated remaining: 2h 27m 20s. Rate: 7.6 symbols/min [2025-10-28T19:43:57.245195] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:57.281024] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T19:43:57.297402] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-28T19:43:57.297104] [DEBUG] [LOCAL ] LEO: Loaded 16427 existing records from primary storage. [2025-10-28T19:43:57.298391] [INFO ] [MAIN ] LEO: Loaded 16427 existing records. [2025-10-28T19:43:57.460892] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (4.77 seconds). [2025-10-28T19:43:57.516049] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-28T19:43:57.536549] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:57.537422] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-28T19:43:57.537473] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-28T19:43:57.537852] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-28T19:43:57.537912] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-28T19:43:57.899728] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:57.900016] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-28T19:43:58.821957] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T19:43:58.833064] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-28T19:44:00.091042] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-28T19:44:00.096050] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-28T19:44:00.168090] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:44:00.179574] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-28T19:44:01.130730] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T19:44:01.135843] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-28T19:44:01.685015] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T19:44:01.696322] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-28T19:44:01.773863] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (7.95 seconds). [2025-10-28T19:44:01.785540] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-28T19:44:01.988736] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:44:01.993505] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-28T19:44:02.745617] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:44:02.751298] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-28T19:44:03.017323] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:44:03.028523] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-28T19:44:03.093243] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:44:03.104048] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-28T19:44:03.401014] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:44:03.404449] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-28T19:44:04.095156] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:44:04.099773] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-28T19:44:04.172746] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:44:04.182719] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-28T19:44:04.554243] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:44:04.572496] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-28T19:44:04.712578] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:44:04.716580] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-28T19:44:04.804226] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (7.29 seconds). [2025-10-28T19:44:04.813628] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-28T19:44:05.269975] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:44:05.282745] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-28T19:44:05.312182] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T19:44:05.315989] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-28T19:44:05.744907] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:44:05.755600] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-28T19:44:05.814691] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T19:44:05.819147] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-28T19:44:06.263463] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T19:44:06.276795] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-28T19:44:06.489264] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:44:06.492909] [INFO ] [REMOTE ] LEO: Full fetch complete (26398 records). [2025-10-28T19:44:06.493020] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-28T19:44:06.867120] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-28T19:44:06.867191] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-28T19:44:06.867826] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-28T19:44:06.867887] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-28T19:44:06.868536] [DEBUG] [LOCAL ] LEO: Trimmed 26398 records to 16438 (keeping 200 days of data) [2025-10-28T19:44:06.960975] [DEBUG] [LOCAL ] LEO: Primary data saved (16438 records). [2025-10-28T19:44:06.961123] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-28T19:44:06.961260] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEO took 9.9s. Estimated remaining: 2h 27m 14s. Rate: 7.6 symbols/min [2025-10-28T19:44:07.132860] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:07.179126] [DEBUG] [LOCAL ] LEVI: Loaded 51807 existing records from primary storage. [2025-10-28T19:44:07.179427] [INFO ] [MAIN ] LEVI: Loaded 51807 existing records. [2025-10-28T19:44:07.355624] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:07.355867] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-28T19:44:07.355916] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-28T19:44:07.356867] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-28T19:44:07.356925] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-28T19:44:07.716339] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:07.716724] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-28T19:44:07.999560] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T19:44:08.011107] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-28T19:44:09.818409] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T19:44:09.829313] [INFO ] [REMOTE ] LEN: Full fetch complete (77218 records). [2025-10-28T19:44:09.829512] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-28T19:44:10.179116] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (4.90 seconds). [2025-10-28T19:44:10.216350] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-28T19:44:10.287753] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-28T19:44:10.287883] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-28T19:44:10.288982] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-28T19:44:10.289051] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-28T19:44:10.290590] [DEBUG] [LOCAL ] LEN: Trimmed 77218 records to 53188 (keeping 200 days of data) [2025-10-28T19:44:10.549601] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (4.79 seconds). [2025-10-28T19:44:10.562053] [INFO ] [REMOTE ] LEA: Full fetch complete (60321 records). [2025-10-28T19:44:10.569025] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-28T19:44:10.840025] [DEBUG] [LOCAL ] LEN: Primary data saved (53188 records). [2025-10-28T19:44:10.857606] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-28T19:44:10.925490] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LEN took 17.0s. Estimated remaining: 2h 27m 2s. Rate: 7.6 symbols/min [2025-10-28T19:44:11.233807] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-28T19:44:11.234484] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-28T19:44:11.235596] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-28T19:44:11.250239] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-28T19:44:11.253541] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:11.255306] [DEBUG] [LOCAL ] LEA: Trimmed 60321 records to 40774 (keeping 200 days of data) [2025-10-28T19:44:11.389305] [DEBUG] [LOCAL ] LFT: Loaded 18012 existing records from primary storage. [2025-10-28T19:44:11.402443] [INFO ] [MAIN ] LFT: Loaded 18012 existing records. [2025-10-28T19:44:11.727982] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:11.732245] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-28T19:44:11.732333] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-28T19:44:11.732811] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-28T19:44:11.733302] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-28T19:44:11.889381] [DEBUG] [LOCAL ] LEA: Primary data saved (40774 records). [2025-10-28T19:44:11.907833] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-28T19:44:11.922621] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LEA took 29.7s. Estimated remaining: 2h 26m 48s. Rate: 7.6 symbols/min [2025-10-28T19:44:12.304330] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:12.302262] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:12.304686] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-28T19:44:12.315593] [DEBUG] [LOCAL ] LGI: Loaded 9859 existing records from primary storage. [2025-10-28T19:44:12.315851] [INFO ] [MAIN ] LGI: Loaded 9859 existing records. [2025-10-28T19:44:12.497417] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:12.497689] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-28T19:44:12.497750] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-28T19:44:12.498246] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-28T19:44:12.498305] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-28T19:44:12.873937] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:12.874259] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-28T19:44:13.072130] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:44:13.076480] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-28T19:44:13.590316] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T19:44:13.593440] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-28T19:44:13.623323] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T19:44:13.626004] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-28T19:44:14.025675] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T19:44:14.028159] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-28T19:44:14.295360] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T19:44:14.299900] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-28T19:44:14.561765] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:44:14.564618] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-28T19:44:15.123619] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:44:15.128819] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-28T19:44:15.146309] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T19:44:15.149155] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-28T19:44:15.630531] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (7.91 seconds). [2025-10-28T19:44:15.645832] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-28T19:44:15.655369] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:44:15.658899] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-28T19:44:15.768534] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T19:44:15.772817] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-28T19:44:16.118753] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T19:44:16.121228] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-28T19:44:16.636222] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T19:44:16.638612] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-28T19:44:16.672141] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T19:44:16.677588] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-28T19:44:16.848548] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:44:16.858142] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-28T19:44:17.232309] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T19:44:17.235888] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-28T19:44:17.404451] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:44:17.409370] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-28T19:44:17.903209] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:44:17.914141] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-28T19:44:19.124496] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:44:19.135363] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-28T19:44:20.171823] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (9.96 seconds). [2025-10-28T19:44:20.182891] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-28T19:44:20.359286] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T19:44:20.370135] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-28T19:44:21.012688] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (3.78 seconds). [2025-10-28T19:44:21.014889] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-28T19:44:21.556720] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:44:21.576147] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-28T19:44:21.578020] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T19:44:21.582155] [INFO ] [REMOTE ] LGI: Full fetch complete (14457 records). [2025-10-28T19:44:21.582394] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-28T19:44:21.908741] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T19:44:21.961072] [INFO ] [REMOTE ] LEG: Full fetch complete (72802 records). [2025-10-28T19:44:21.975603] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-28T19:44:22.040614] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-28T19:44:22.080935] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-28T19:44:22.086468] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-28T19:44:22.108079] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-28T19:44:22.129746] [DEBUG] [LOCAL ] LGI: Trimmed 14457 records to 9777 (keeping 200 days of data) [2025-10-28T19:44:22.423594] [DEBUG] [LOCAL ] LGI: Primary data saved (9777 records). [2025-10-28T19:44:22.441996] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-28T19:44:22.459534] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LGI took 10.5s. Estimated remaining: 2h 26m 43s. Rate: 7.6 symbols/min [2025-10-28T19:44:22.459675] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-28T19:44:22.460110] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-28T19:44:22.504804] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-28T19:44:22.536953] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-28T19:44:22.603970] [DEBUG] [LOCAL ] LEG: Trimmed 72802 records to 49848 (keeping 200 days of data) [2025-10-28T19:44:22.635824] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:22.838009] [DEBUG] [LOCAL ] LH: Loaded 36776 existing records from primary storage. [2025-10-28T19:44:22.863841] [INFO ] [MAIN ] LH: Loaded 36776 existing records. [2025-10-28T19:44:23.066184] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:23.070585] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-28T19:44:23.074726] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-28T19:44:23.080147] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-28T19:44:23.080282] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-28T19:44:23.478185] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-28T19:44:23.500466] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (6.09 seconds). [2025-10-28T19:44:23.505704] [DEBUG] [LOCAL ] LEG: Primary data saved (49848 records). [2025-10-28T19:44:23.538983] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-28T19:44:23.538725] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-28T19:44:23.550867] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LEG took 39.6s. Estimated remaining: 2h 26m 29s. Rate: 7.6 symbols/min [2025-10-28T19:44:23.591257] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-28T19:44:23.608884] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:23.633231] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-28T19:44:23.779420] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:23.824285] [DEBUG] [LOCAL ] LHX: Loaded 48276 existing records from primary storage. [2025-10-28T19:44:23.824599] [INFO ] [MAIN ] LHX: Loaded 48276 existing records. [2025-10-28T19:44:24.001430] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:24.001623] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-28T19:44:24.001700] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-28T19:44:24.002387] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-28T19:44:24.002428] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-28T19:44:24.348103] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T19:44:24.368875] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:24.373437] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-28T19:44:24.374805] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-28T19:44:24.695905] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:44:24.703315] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-28T19:44:24.812026] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:44:24.824287] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-28T19:44:25.144913] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:44:25.148432] [INFO ] [REMOTE ] LFT: Full fetch complete (23781 records). [2025-10-28T19:44:25.148508] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-28T19:44:25.543024] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-28T19:44:25.543129] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-28T19:44:25.543892] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-28T19:44:25.543994] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-28T19:44:25.544918] [DEBUG] [LOCAL ] LFT: Trimmed 23781 records to 18066 (keeping 200 days of data) [2025-10-28T19:44:25.654487] [DEBUG] [LOCAL ] LFT: Primary data saved (18066 records). [2025-10-28T19:44:25.654770] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-28T19:44:25.654969] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LFT took 14.7s. Estimated remaining: 2h 26m 16s. Rate: 7.6 symbols/min [2025-10-28T19:44:25.793716] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T19:44:25.809865] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-28T19:44:25.878366] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:25.903099] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:44:25.912555] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-28T19:44:25.935629] [DEBUG] [LOCAL ] LII: Loaded 27586 existing records from primary storage. [2025-10-28T19:44:25.935933] [INFO ] [MAIN ] LII: Loaded 27586 existing records. [2025-10-28T19:44:26.112966] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:26.113329] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-28T19:44:26.113498] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-28T19:44:26.113838] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-28T19:44:26.113953] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-28T19:44:26.457908] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T19:44:26.508448] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-28T19:44:26.508179] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:26.509502] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-28T19:44:26.985899] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T19:44:26.994670] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-28T19:44:27.281452] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T19:44:27.293283] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-28T19:44:27.311557] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:44:27.317938] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-28T19:44:28.164067] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T19:44:28.174095] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-28T19:44:28.193069] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:44:28.199132] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-28T19:44:28.560792] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T19:44:28.570862] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-28T19:44:29.320867] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:44:29.328394] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-28T19:44:29.491970] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T19:44:29.500708] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-28T19:44:29.824140] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:44:29.835507] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-28T19:44:30.340827] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T19:44:30.348576] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-28T19:44:30.504259] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:44:30.512485] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-28T19:44:31.266513] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T19:44:31.277279] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-28T19:44:31.767576] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:44:31.776768] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-28T19:44:32.555214] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:44:32.565339] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-28T19:44:32.879854] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T19:44:32.887015] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-28T19:44:32.921460] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (6.41 seconds). [2025-10-28T19:44:32.932062] [INFO ] [REMOTE ] LEVI: Full fetch complete (75009 records). [2025-10-28T19:44:32.932177] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-28T19:44:33.326294] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-28T19:44:33.326368] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-28T19:44:33.327466] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-28T19:44:33.327529] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-28T19:44:33.328985] [DEBUG] [LOCAL ] LEVI: Trimmed 75009 records to 51799 (keeping 200 days of data) [2025-10-28T19:44:33.640505] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-10-28T19:44:33.647927] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-28T19:44:33.668922] [DEBUG] [LOCAL ] LEVI: Primary data saved (51799 records). [2025-10-28T19:44:33.669014] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-28T19:44:33.669088] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LEVI took 26.7s. Estimated remaining: 2h 26m 8s. Rate: 7.6 symbols/min [2025-10-28T19:44:33.849544] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:33.868097] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:44:33.875464] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-28T19:44:33.911896] [DEBUG] [LOCAL ] LION: Loaded 47270 existing records from primary storage. [2025-10-28T19:44:33.912188] [INFO ] [MAIN ] LION: Loaded 47270 existing records. [2025-10-28T19:44:34.088557] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:34.088812] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-28T19:44:34.088867] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-28T19:44:34.089060] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-28T19:44:34.089118] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-28T19:44:34.463121] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:34.463478] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-28T19:44:34.530104] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T19:44:34.536193] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-28T19:44:34.930223] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:44:34.937895] [INFO ] [REMOTE ] LH: Full fetch complete (54868 records). [2025-10-28T19:44:34.938068] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-28T19:44:35.344490] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-28T19:44:35.344596] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-28T19:44:35.345770] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-28T19:44:35.345988] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-28T19:44:35.348139] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T19:44:35.354091] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-28T19:44:35.355496] [DEBUG] [LOCAL ] LH: Trimmed 54868 records to 36806 (keeping 200 days of data) [2025-10-28T19:44:35.499895] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T19:44:35.511771] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-28T19:44:35.614301] [DEBUG] [LOCAL ] LH: Primary data saved (36806 records). [2025-10-28T19:44:35.614426] [INFO ] [MAIN ] LH: Full history saved. [2025-10-28T19:44:35.614831] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 13.2s. Estimated remaining: 2h 25m 55s. Rate: 7.6 symbols/min [2025-10-28T19:44:35.786218] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:35.791943] [DEBUG] [LOCAL ] LITB: Loaded 3695 existing records from primary storage. [2025-10-28T19:44:35.792100] [INFO ] [MAIN ] LITB: Loaded 3695 existing records. [2025-10-28T19:44:35.971072] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:35.971354] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-28T19:44:35.971423] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-28T19:44:35.971675] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-28T19:44:35.971745] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-28T19:44:36.374048] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:36.374401] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-28T19:44:36.711023] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:44:36.712415] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-28T19:44:37.006697] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:44:37.008498] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-28T19:44:37.431311] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T19:44:37.433174] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-28T19:44:37.917515] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T19:44:37.920252] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-28T19:44:38.271277] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T19:44:38.272585] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-28T19:44:38.373152] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (5.81 seconds). [2025-10-28T19:44:38.384045] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-28T19:44:38.519338] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (3.01 seconds). [2025-10-28T19:44:38.524913] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-28T19:44:39.479616] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:44:39.486299] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-28T19:44:39.783553] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:44:39.781407] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (4.43 seconds). [2025-10-28T19:44:39.798543] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-28T19:44:39.799797] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-28T19:44:39.975442] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T19:44:39.976726] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-28T19:44:40.271708] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T19:44:40.272953] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-28T19:44:40.456441] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T19:44:40.461551] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-28T19:44:40.601877] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T19:44:40.603018] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-28T19:44:41.078002] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:44:41.087631] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-28T19:44:41.284233] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:44:41.290858] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-28T19:44:41.447357] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T19:44:41.449231] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-28T19:44:41.943515] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T19:44:41.944926] [INFO ] [REMOTE ] LITB: Full fetch complete (5798 records). [2025-10-28T19:44:41.944992] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-28T19:44:42.297023] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-28T19:44:42.297105] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-28T19:44:42.297269] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-28T19:44:42.297310] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-28T19:44:42.297705] [DEBUG] [LOCAL ] LITB: Trimmed 5798 records to 3682 (keeping 200 days of data) [2025-10-28T19:44:42.318155] [DEBUG] [LOCAL ] LITB: Primary data saved (3682 records). [2025-10-28T19:44:42.318360] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-28T19:44:42.318475] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LITB took 6.7s. Estimated remaining: 2h 25m 46s. Rate: 7.6 symbols/min [2025-10-28T19:44:42.492355] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:42.548832] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:44:42.561091] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-28T19:44:42.572479] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-28T19:44:42.574152] [INFO ] [REMOTE ] LII: Full fetch complete (41889 records). [2025-10-28T19:44:42.574323] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-28T19:44:42.822920] [DEBUG] [LOCAL ] LLY: Loaded 53169 existing records from primary storage. [2025-10-28T19:44:42.888682] [INFO ] [MAIN ] LLY: Loaded 53169 existing records. [2025-10-28T19:44:43.172219] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-28T19:44:43.202434] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-28T19:44:43.202360] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:43.202737] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-28T19:44:43.203736] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-28T19:44:43.203682] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-28T19:44:43.203909] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-28T19:44:43.204104] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-28T19:44:43.204164] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-28T19:44:43.308823] [DEBUG] [LOCAL ] LII: Trimmed 41889 records to 27548 (keeping 200 days of data) [2025-10-28T19:44:43.751990] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:43.756591] [DEBUG] [LOCAL ] LII: Primary data saved (27548 records). [2025-10-28T19:44:43.756889] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-28T19:44:43.757056] [INFO ] [MAIN ] LII: Full history saved. [2025-10-28T19:44:43.757295] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LII took 18.1s. Estimated remaining: 2h 25m 32s. Rate: 7.6 symbols/min [2025-10-28T19:44:43.974225] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:43.970889] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T19:44:43.974431] [DEBUG] [LOCAL ] LMND: No existing data file found in primary storage. [2025-10-28T19:44:43.983562] [WARN ] [MAIN ] LMND: No existing data found, performing full refresh instead. [2025-10-28T19:44:43.983756] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-28T19:44:43.983932] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-28T19:44:43.984017] [DEBUG] [LOCAL ] LMND: No primary data file found to delete. [2025-10-28T19:44:43.984266] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-28T19:44:44.027544] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-28T19:44:44.362379] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:44.362681] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-28T19:44:45.374506] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:44:45.388045] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-28T19:44:45.576349] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (4.49 seconds). [2025-10-28T19:44:45.618172] [INFO ] [REMOTE ] LHX: Full fetch complete (70623 records). [2025-10-28T19:44:45.618399] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-28T19:44:45.752621] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-28T19:44:45.793089] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-28T19:44:46.284829] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T19:44:46.321046] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-28T19:44:46.320851] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-28T19:44:46.321251] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-28T19:44:46.322535] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-28T19:44:46.323253] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-28T19:44:46.324893] [DEBUG] [LOCAL ] LHX: Trimmed 70623 records to 48202 (keeping 200 days of data) [2025-10-28T19:44:46.628353] [DEBUG] [LOCAL ] LHX: Primary data saved (48202 records). [2025-10-28T19:44:46.628550] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-28T19:44:46.628709] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LHX took 23.1s. Estimated remaining: 2h 25m 20s. Rate: 7.6 symbols/min [2025-10-28T19:44:46.804399] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:46.834852] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T19:44:46.846075] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-28T19:44:46.886540] [DEBUG] [LOCAL ] LMT: Loaded 49543 existing records from primary storage. [2025-10-28T19:44:46.886894] [INFO ] [MAIN ] LMT: Loaded 49543 existing records. [2025-10-28T19:44:47.066146] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:47.066370] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-28T19:44:47.066418] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-28T19:44:47.066922] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-28T19:44:47.066980] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-28T19:44:47.434444] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:47.434895] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-28T19:44:47.712865] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T19:44:47.723277] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-28T19:44:48.039515] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:44:48.050678] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-28T19:44:49.089487] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T19:44:49.099257] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-28T19:44:49.339013] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:44:49.349575] [INFO ] [REMOTE ] LION: Full fetch complete (58633 records). [2025-10-28T19:44:49.349785] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-28T19:44:49.769293] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-28T19:44:49.769476] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-28T19:44:49.771338] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-28T19:44:49.771429] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-28T19:44:49.773462] [DEBUG] [LOCAL ] LION: Trimmed 58633 records to 47410 (keeping 200 days of data) [2025-10-28T19:44:49.891220] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-28T19:44:49.917599] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-28T19:44:50.114040] [DEBUG] [LOCAL ] LION: Primary data saved (47410 records). [2025-10-28T19:44:50.114256] [INFO ] [MAIN ] LION: Full history saved. [2025-10-28T19:44:50.114365] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LION took 16.4s. Estimated remaining: 2h 25m 8s. Rate: 7.6 symbols/min [2025-10-28T19:44:50.299610] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:50.357535] [DEBUG] [LOCAL ] LNC: Loaded 51328 existing records from primary storage. [2025-10-28T19:44:50.358226] [INFO ] [MAIN ] LNC: Loaded 51328 existing records. [2025-10-28T19:44:50.557157] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:50.557458] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-28T19:44:50.557511] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-28T19:44:50.557965] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-28T19:44:50.558057] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-28T19:44:50.990054] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:50.990533] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-28T19:44:51.017389] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T19:44:51.027404] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-28T19:44:51.108204] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (4.79 seconds). [2025-10-28T19:44:51.117924] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-28T19:44:51.805797] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T19:44:51.816973] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-28T19:44:52.160981] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:44:52.170860] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-28T19:44:52.468341] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:44:52.780239] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-28T19:44:53.304446] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:44:53.580315] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-28T19:44:54.100701] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-28T19:44:54.161573] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T19:44:54.380253] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-28T19:44:54.810754] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T19:44:55.180232] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-28T19:44:55.980234] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-28T19:44:56.347812] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (5.23 seconds). [2025-10-28T19:44:56.507179] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-28T19:44:56.780230] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-28T19:44:56.846694] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T19:44:57.225788] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:44:57.580314] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-28T19:44:58.059970] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:44:58.380263] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-28T19:44:59.180280] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-28T19:44:59.367771] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T19:44:59.766200] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:44:59.980254] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-28T19:45:00.731019] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T19:45:00.780280] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-28T19:45:01.549414] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T19:45:01.580250] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-28T19:45:02.380237] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-28T19:45:02.573738] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T19:45:02.985837] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:45:03.180249] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-28T19:45:03.980243] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-28T19:45:04.780293] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-28T19:45:04.886325] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T19:45:05.580250] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-28T19:45:05.680400] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-28T19:45:06.012533] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:45:06.380283] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-28T19:45:07.180229] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-28T19:45:07.327507] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T19:45:07.628910] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:45:07.981536] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-28T19:45:07.984443] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (5.60 seconds). [2025-10-28T19:45:08.780271] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-28T19:45:09.580267] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-28T19:45:09.852716] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T19:45:09.863928] [INFO ] [REMOTE ] LMND: Full fetch complete (75487 records). [2025-10-28T19:45:09.864101] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-28T19:45:10.264476] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-28T19:45:10.264557] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-28T19:45:10.265592] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-28T19:45:10.265685] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-28T19:45:10.267091] [DEBUG] [LOCAL ] LMND: Trimmed 75487 records to 52101 (keeping 200 days of data) [2025-10-28T19:45:10.573367] [DEBUG] [LOCAL ] LMND: Primary data saved (52101 records). [2025-10-28T19:45:10.573517] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-28T19:45:10.573603] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LMND took 26.8s. Estimated remaining: 2h 25m 11s. Rate: 7.6 symbols/min [2025-10-28T19:45:10.751180] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:10.775488] [DEBUG] [LOCAL ] LND: Loaded 4869 existing records from primary storage. [2025-10-28T19:45:10.783973] [INFO ] [MAIN ] LND: Loaded 4869 existing records. [2025-10-28T19:45:10.868675] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T19:45:10.942681] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-28T19:45:10.989400] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-28T19:45:11.022212] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:11.033474] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-28T19:45:11.033789] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-28T19:45:11.034313] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-28T19:45:11.034377] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-28T19:45:11.183582] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-28T19:45:11.399717] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:11.703118] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (4.52 seconds). [2025-10-28T19:45:11.826403] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T19:45:11.837128] [INFO ] [REMOTE ] LLY: Full fetch complete (77184 records). [2025-10-28T19:45:11.837281] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-28T19:45:11.987591] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-28T19:45:12.246253] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-28T19:45:12.246380] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-28T19:45:12.247558] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-28T19:45:12.247623] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-28T19:45:12.249095] [DEBUG] [LOCAL ] LLY: Trimmed 77184 records to 53161 (keeping 200 days of data) [2025-10-28T19:45:12.611880] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T19:45:12.637359] [DEBUG] [LOCAL ] LLY: Primary data saved (53161 records). [2025-10-28T19:45:12.637493] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-28T19:45:12.637938] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LLY took 30.3s. Estimated remaining: 2h 24m 58s. Rate: 7.6 symbols/min [2025-10-28T19:45:12.789859] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-28T19:45:12.818240] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:12.873501] [DEBUG] [LOCAL ] LNG: Loaded 50980 existing records from primary storage. [2025-10-28T19:45:12.873911] [INFO ] [MAIN ] LNG: Loaded 50980 existing records. [2025-10-28T19:45:13.058271] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:13.058553] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-28T19:45:13.058607] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-28T19:45:13.060073] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-28T19:45:13.060133] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-28T19:45:13.416905] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:13.580226] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-28T19:45:13.738498] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T19:45:13.748923] [INFO ] [REMOTE ] LMT: Full fetch complete (72531 records). [2025-10-28T19:45:13.749074] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-28T19:45:14.029110] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:45:14.169595] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-28T19:45:14.169749] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-28T19:45:14.170798] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-28T19:45:14.170876] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-28T19:45:14.182599] [DEBUG] [LOCAL ] LMT: Trimmed 72531 records to 49484 (keeping 200 days of data) [2025-10-28T19:45:14.203067] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T19:45:14.389600] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-28T19:45:14.518066] [DEBUG] [LOCAL ] LMT: Primary data saved (49484 records). [2025-10-28T19:45:14.518196] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-28T19:45:14.518273] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LMT took 27.9s. Estimated remaining: 2h 24m 45s. Rate: 7.6 symbols/min [2025-10-28T19:45:14.686547] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:14.700402] [DEBUG] [LOCAL ] LNN: Loaded 11526 existing records from primary storage. [2025-10-28T19:45:14.700630] [INFO ] [MAIN ] LNN: Loaded 11526 existing records. [2025-10-28T19:45:14.877482] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:14.877717] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-28T19:45:14.877795] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-28T19:45:14.877957] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-28T19:45:14.877997] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-28T19:45:15.185434] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-28T19:45:15.242144] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:15.908930] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:45:15.919085] [INFO ] [REMOTE ] LNC: Full fetch complete (74513 records). [2025-10-28T19:45:15.919236] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-28T19:45:15.988708] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-28T19:45:16.340253] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-28T19:45:16.340345] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-28T19:45:16.341508] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-28T19:45:16.341575] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-28T19:45:16.343093] [DEBUG] [LOCAL ] LNC: Trimmed 74513 records to 51302 (keeping 200 days of data) [2025-10-28T19:45:16.584802] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T19:45:16.671047] [DEBUG] [LOCAL ] LNC: Primary data saved (51302 records). [2025-10-28T19:45:16.671196] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-28T19:45:16.671568] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LNC took 26.6s. Estimated remaining: 2h 24m 33s. Rate: 7.6 symbols/min [2025-10-28T19:45:16.785361] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-28T19:45:16.866432] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:16.909681] [DEBUG] [LOCAL ] LOAR: Loaded 41789 existing records from primary storage. [2025-10-28T19:45:16.910044] [INFO ] [MAIN ] LOAR: Loaded 41789 existing records. [2025-10-28T19:45:17.099237] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:17.099430] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-28T19:45:17.099475] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-28T19:45:17.099802] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-28T19:45:17.099860] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-28T19:45:17.476869] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:17.487053] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:45:17.580279] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-28T19:45:18.050794] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T19:45:18.380274] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-28T19:45:19.180298] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-28T19:45:19.613572] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:45:19.980327] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-28T19:45:20.404175] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T19:45:20.780246] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-28T19:45:21.099428] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-28T19:45:21.260757] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (6.08 seconds). [2025-10-28T19:45:21.290811] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T19:45:21.580262] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-28T19:45:21.960067] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T19:45:22.380328] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-28T19:45:22.765083] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:45:23.180257] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-28T19:45:23.980228] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-28T19:45:24.780325] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-28T19:45:24.994405] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-28T19:45:25.418623] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:45:25.580251] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-28T19:45:25.812508] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:45:26.380280] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-28T19:45:27.180314] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-28T19:45:27.500172] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:45:27.579170] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:45:27.980353] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-28T19:45:28.389240] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T19:45:28.651972] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-10-28T19:45:28.780218] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-28T19:45:29.580288] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-28T19:45:29.697679] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:45:30.380309] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-28T19:45:30.389089] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T19:45:30.391681] [INFO ] [REMOTE ] LND: Full fetch complete (7798 records). [2025-10-28T19:45:30.391774] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-28T19:45:30.754767] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-28T19:45:30.754840] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-28T19:45:30.755029] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-28T19:45:30.755066] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-28T19:45:30.755441] [DEBUG] [LOCAL ] LND: Trimmed 7798 records to 4868 (keeping 200 days of data) [2025-10-28T19:45:30.782615] [DEBUG] [LOCAL ] LND: Primary data saved (4868 records). [2025-10-28T19:45:30.782716] [INFO ] [MAIN ] LND: Full history saved. [2025-10-28T19:45:30.782793] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LND took 20.2s. Estimated remaining: 2h 24m 30s. Rate: 7.6 symbols/min [2025-10-28T19:45:30.948779] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:30.974274] [DEBUG] [LOCAL ] LOB: Loaded 26452 existing records from primary storage. [2025-10-28T19:45:30.974526] [INFO ] [MAIN ] LOB: Loaded 26452 existing records. [2025-10-28T19:45:31.150573] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:31.150815] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-28T19:45:31.150862] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-28T19:45:31.151088] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-28T19:45:31.151127] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-28T19:45:31.185471] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-28T19:45:31.520814] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:31.544970] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:45:31.873340] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:45:31.980363] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-28T19:45:32.759037] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T19:45:32.780288] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-28T19:45:33.515199] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T19:45:33.580266] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-28T19:45:34.380244] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-28T19:45:34.481522] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T19:45:35.012867] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:45:35.180314] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-28T19:45:35.980290] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-28T19:45:36.428080] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:45:36.780281] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-28T19:45:37.386793] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:45:37.580245] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-28T19:45:38.380302] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-28T19:45:39.078139] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-28T19:45:39.180303] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-28T19:45:39.675000] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T19:45:39.980286] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-28T19:45:40.780253] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-28T19:45:41.336528] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T19:45:41.580254] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-28T19:45:42.344906] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T19:45:42.348274] [INFO ] [REMOTE ] LNN: Full fetch complete (16366 records). [2025-10-28T19:45:42.348350] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-28T19:45:42.637117] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (5.06 seconds). [2025-10-28T19:45:42.670446] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-28T19:45:42.753513] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-28T19:45:42.753591] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-28T19:45:42.753977] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-28T19:45:42.754037] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-28T19:45:42.754522] [DEBUG] [LOCAL ] LNN: Trimmed 16366 records to 11561 (keeping 200 days of data) [2025-10-28T19:45:42.842003] [DEBUG] [LOCAL ] LNN: Primary data saved (11561 records). [2025-10-28T19:45:42.842745] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-28T19:45:42.842906] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LNN took 28.3s. Estimated remaining: 2h 24m 26s. Rate: 7.6 symbols/min [2025-10-28T19:45:43.044288] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:43.051704] [DEBUG] [LOCAL ] LOCL: Loaded 3246 existing records from primary storage. [2025-10-28T19:45:43.051972] [INFO ] [MAIN ] LOCL: Loaded 3246 existing records. [2025-10-28T19:45:43.247348] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:43.247735] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-28T19:45:43.247804] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-28T19:45:43.247982] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-28T19:45:43.248024] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-28T19:45:43.582387] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T19:45:43.624949] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-28T19:45:43.649294] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:43.980232] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-28T19:45:44.299620] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T19:45:44.487671] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T19:45:44.780276] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-28T19:45:45.019300] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:45:45.283886] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (6.10 seconds). [2025-10-28T19:45:45.580273] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-28T19:45:46.380245] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-28T19:45:46.624113] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T19:45:47.168622] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T19:45:47.180224] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-28T19:45:47.980284] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-28T19:45:48.211925] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (8.23 seconds). [2025-10-28T19:45:48.262508] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T19:45:48.780303] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-28T19:45:49.345229] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-28T19:45:49.580300] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-28T19:45:50.380241] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-28T19:45:50.573726] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T19:45:50.580055] [INFO ] [REMOTE ] LOB: Full fetch complete (38762 records). [2025-10-28T19:45:50.580231] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-28T19:45:50.996203] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T19:45:51.014348] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-28T19:45:51.014425] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-28T19:45:51.015267] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-28T19:45:51.015328] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-28T19:45:51.016254] [DEBUG] [LOCAL ] LOB: Trimmed 38762 records to 26260 (keeping 200 days of data) [2025-10-28T19:45:51.178533] [DEBUG] [LOCAL ] LOB: Primary data saved (26260 records). [2025-10-28T19:45:51.178696] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-28T19:45:51.178787] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LOB took 20.4s. Estimated remaining: 2h 24m 18s. Rate: 7.6 symbols/min [2025-10-28T19:45:51.190197] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-28T19:45:51.361928] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:51.395338] [DEBUG] [LOCAL ] LOMA: Loaded 32945 existing records from primary storage. [2025-10-28T19:45:51.395599] [INFO ] [MAIN ] LOMA: Loaded 32945 existing records. [2025-10-28T19:45:51.579503] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:51.579907] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-28T19:45:51.580261] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-28T19:45:51.580472] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-28T19:45:51.580514] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-28T19:45:51.662098] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T19:45:51.962038] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:51.980220] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-28T19:45:52.129090] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (3.35 seconds). [2025-10-28T19:45:52.780263] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-28T19:45:52.900502] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:45:53.157283] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:45:53.580302] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-28T19:45:54.380402] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-28T19:45:54.647060] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T19:45:55.180257] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-28T19:45:55.679558] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T19:45:55.741662] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T19:45:55.980262] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-28T19:45:56.780312] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-28T19:45:57.395600] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:45:57.580233] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-28T19:45:57.926057] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T19:45:58.380237] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-28T19:45:58.918386] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:45:59.180239] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-28T19:45:59.431751] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:45:59.439136] [INFO ] [REMOTE ] LOAR: Full fetch complete (55981 records). [2025-10-28T19:45:59.439264] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-28T19:45:59.811215] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-28T19:45:59.811293] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-28T19:45:59.812193] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-28T19:45:59.812277] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-28T19:45:59.813445] [DEBUG] [LOCAL ] LOAR: Trimmed 55981 records to 41655 (keeping 200 days of data) [2025-10-28T19:45:59.988132] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-28T19:46:00.058376] [DEBUG] [LOCAL ] LOAR: Primary data saved (41655 records). [2025-10-28T19:46:00.058496] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-28T19:46:00.058884] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LOAR took 43.4s. Estimated remaining: 2h 24m 11s. Rate: 7.6 symbols/min [2025-10-28T19:46:00.221599] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:00.270413] [DEBUG] [LOCAL ] LOW: Loaded 52939 existing records from primary storage. [2025-10-28T19:46:00.270756] [INFO ] [MAIN ] LOW: Loaded 52939 existing records. [2025-10-28T19:46:00.447543] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:00.447856] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-28T19:46:00.448011] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-28T19:46:00.448959] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-28T19:46:00.449019] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-28T19:46:00.757311] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T19:46:00.789638] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-28T19:46:00.888236] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:01.000513] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:46:01.094120] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T19:46:01.580245] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-28T19:46:02.046623] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T19:46:02.380304] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-28T19:46:03.180325] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-28T19:46:03.795031] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T19:46:03.980297] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-28T19:46:04.672060] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:46:04.683019] [INFO ] [REMOTE ] LNG: Full fetch complete (74663 records). [2025-10-28T19:46:04.683198] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-28T19:46:04.788369] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-28T19:46:05.024416] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:46:05.121420] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-28T19:46:05.121491] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-28T19:46:05.122770] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-28T19:46:05.122834] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-28T19:46:05.124318] [DEBUG] [LOCAL ] LNG: Trimmed 74663 records to 50969 (keeping 200 days of data) [2025-10-28T19:46:05.446479] [DEBUG] [LOCAL ] LNG: Primary data saved (50969 records). [2025-10-28T19:46:05.446920] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-28T19:46:05.447682] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LNG took 52.8s. Estimated remaining: 2h 24m 1s. Rate: 7.6 symbols/min [2025-10-28T19:46:05.591190] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-28T19:46:05.623900] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:05.660834] [DEBUG] [LOCAL ] LPG: Loaded 38804 existing records from primary storage. [2025-10-28T19:46:05.661110] [INFO ] [MAIN ] LPG: Loaded 38804 existing records. [2025-10-28T19:46:05.834432] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:05.834692] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-28T19:46:05.834748] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-28T19:46:05.835750] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-28T19:46:05.835808] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-28T19:46:06.114219] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:46:06.148480] [INFO ] [REMOTE ] LOCL: Full fetch complete (4519 records). [2025-10-28T19:46:06.185638] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-28T19:46:06.210006] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:06.385528] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-28T19:46:06.569186] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T19:46:06.608981] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-28T19:46:06.609051] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-28T19:46:06.609194] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-28T19:46:06.609231] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-28T19:46:06.609574] [DEBUG] [LOCAL ] LOCL: Trimmed 4519 records to 3227 (keeping 200 days of data) [2025-10-28T19:46:06.627030] [DEBUG] [LOCAL ] LOCL: Primary data saved (3227 records). [2025-10-28T19:46:06.627089] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-28T19:46:06.627153] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOCL took 23.8s. Estimated remaining: 2h 23m 48s. Rate: 7.6 symbols/min [2025-10-28T19:46:06.792078] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:06.817606] [DEBUG] [LOCAL ] LPL: Loaded 29165 existing records from primary storage. [2025-10-28T19:46:06.817855] [INFO ] [MAIN ] LPL: Loaded 29165 existing records. [2025-10-28T19:46:06.992910] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:06.993071] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-28T19:46:06.993115] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-28T19:46:06.993555] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-28T19:46:06.993611] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-28T19:46:07.191003] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-28T19:46:07.349616] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:07.565202] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:46:07.980266] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-28T19:46:08.738423] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T19:46:08.780214] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-28T19:46:09.580220] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-28T19:46:10.242020] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:46:10.380281] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-28T19:46:10.445401] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-28T19:46:10.691740] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T19:46:11.180280] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-28T19:46:11.711341] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:46:11.980280] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-28T19:46:12.654340] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:46:12.780214] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-28T19:46:13.580242] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-28T19:46:13.765601] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-28T19:46:14.380276] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-28T19:46:14.500378] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T19:46:14.954461] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T19:46:15.180267] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-28T19:46:15.238263] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T19:46:15.980264] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-28T19:46:16.649302] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:46:16.780253] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-28T19:46:16.905126] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:46:17.580286] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-28T19:46:18.149394] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T19:46:18.380283] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-28T19:46:18.464572] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T19:46:19.180307] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-28T19:46:19.801004] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T19:46:19.980266] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-28T19:46:20.222699] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:46:20.761989] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:46:20.780205] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-28T19:46:21.534343] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:46:21.580224] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-28T19:46:22.282988] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T19:46:22.380255] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-28T19:46:23.061521] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T19:46:23.180223] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-28T19:46:23.885043] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:46:23.895480] [INFO ] [REMOTE ] LOW: Full fetch complete (76693 records). [2025-10-28T19:46:23.895607] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-28T19:46:23.985317] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-28T19:46:24.287909] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-28T19:46:24.287989] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-28T19:46:24.289068] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-28T19:46:24.289130] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-28T19:46:24.290536] [DEBUG] [LOCAL ] LOW: Trimmed 76693 records to 52926 (keeping 200 days of data) [2025-10-28T19:46:24.662785] [DEBUG] [LOCAL ] LOW: Primary data saved (52926 records). [2025-10-28T19:46:24.662932] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-28T19:46:24.663271] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LOW took 24.6s. Estimated remaining: 2h 23m 49s. Rate: 7.6 symbols/min [2025-10-28T19:46:24.785544] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-28T19:46:24.925022] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:24.989582] [DEBUG] [LOCAL ] LPX: Loaded 39955 existing records from primary storage. [2025-10-28T19:46:24.990008] [INFO ] [MAIN ] LPX: Loaded 39955 existing records. [2025-10-28T19:46:25.341916] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:25.345835] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:46:25.346202] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-28T19:46:25.346504] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-28T19:46:25.360019] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-28T19:46:25.360144] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-28T19:46:25.591482] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-28T19:46:25.790479] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:25.807584] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:46:26.380254] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-28T19:46:27.180253] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-28T19:46:27.442178] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:46:27.980234] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-28T19:46:28.385693] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:46:28.780266] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-28T19:46:29.040803] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-28T19:46:29.048739] [INFO ] [REMOTE ] LOMA: Full fetch complete (48099 records). [2025-10-28T19:46:29.048894] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-28T19:46:29.446264] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-28T19:46:29.446346] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-28T19:46:29.447479] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-28T19:46:29.447541] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-28T19:46:29.448806] [DEBUG] [LOCAL ] LOMA: Trimmed 48099 records to 33069 (keeping 200 days of data) [2025-10-28T19:46:29.602801] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-28T19:46:29.654373] [DEBUG] [LOCAL ] LOMA: Primary data saved (33069 records). [2025-10-28T19:46:29.654706] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-28T19:46:29.654937] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LOMA took 38.5s. Estimated remaining: 2h 23m 38s. Rate: 7.6 symbols/min [2025-10-28T19:46:29.824535] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:29.865556] [DEBUG] [LOCAL ] LRN: Loaded 39074 existing records from primary storage. [2025-10-28T19:46:29.865869] [INFO ] [MAIN ] LRN: Loaded 39074 existing records. [2025-10-28T19:46:30.046381] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:30.046770] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-28T19:46:30.046849] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-28T19:46:30.047120] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-28T19:46:30.047165] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-28T19:46:30.175240] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:46:30.385458] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-28T19:46:30.440262] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:30.858743] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:46:31.180346] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-28T19:46:31.438765] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-10-28T19:46:31.568265] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:46:31.980256] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-28T19:46:32.780334] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-28T19:46:33.071415] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T19:46:33.580236] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-28T19:46:33.897327] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:46:34.380302] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-28T19:46:34.652742] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T19:46:34.661905] [INFO ] [REMOTE ] LPL: Full fetch complete (38277 records). [2025-10-28T19:46:34.662051] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-28T19:46:35.056331] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-28T19:46:35.056435] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-28T19:46:35.057256] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-28T19:46:35.057351] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-28T19:46:35.058243] [DEBUG] [LOCAL ] LPL: Trimmed 38277 records to 29274 (keeping 200 days of data) [2025-10-28T19:46:35.174413] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (3.99 seconds). [2025-10-28T19:46:35.186680] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-28T19:46:35.254004] [DEBUG] [LOCAL ] LPL: Primary data saved (29274 records). [2025-10-28T19:46:35.254143] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-28T19:46:35.254223] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LPL took 28.6s. Estimated remaining: 2h 23m 29s. Rate: 7.6 symbols/min [2025-10-28T19:46:35.431054] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:35.471386] [DEBUG] [LOCAL ] LSPD: Loaded 42066 existing records from primary storage. [2025-10-28T19:46:35.471709] [INFO ] [MAIN ] LSPD: Loaded 42066 existing records. [2025-10-28T19:46:35.648451] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:35.648691] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-28T19:46:35.648751] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-28T19:46:35.648932] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-28T19:46:35.648970] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-28T19:46:35.982185] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-28T19:46:36.007088] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:36.295829] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T19:46:36.780308] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-28T19:46:37.407026] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:46:37.580230] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-28T19:46:37.825683] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:46:38.380229] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-28T19:46:38.477710] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (4.10 seconds). [2025-10-28T19:46:39.180278] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-28T19:46:39.470732] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:46:39.517927] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-28T19:46:39.980456] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-28T19:46:40.174195] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T19:46:40.780302] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-28T19:46:41.105769] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:46:41.580326] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-28T19:46:42.084913] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:46:42.380295] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-28T19:46:42.793335] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T19:46:43.180314] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-28T19:46:43.349967] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T19:46:43.980302] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-28T19:46:44.273115] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T19:46:44.780359] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-28T19:46:45.170191] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:46:45.580253] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-28T19:46:45.801961] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:46:46.380286] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-28T19:46:46.762211] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:46:46.769687] [INFO ] [REMOTE ] LPG: Full fetch complete (58513 records). [2025-10-28T19:46:46.769820] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-28T19:46:47.145767] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-28T19:46:47.145853] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-28T19:46:47.146853] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-28T19:46:47.146917] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-28T19:46:47.148142] [DEBUG] [LOCAL ] LPG: Trimmed 58513 records to 38700 (keeping 200 days of data) [2025-10-28T19:46:47.199208] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-28T19:46:47.382544] [DEBUG] [LOCAL ] LPG: Primary data saved (38700 records). [2025-10-28T19:46:47.382713] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-28T19:46:47.382825] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPG took 41.9s. Estimated remaining: 2h 23m 24s. Rate: 7.6 symbols/min [2025-10-28T19:46:47.553885] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:47.589597] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T19:46:47.625470] [DEBUG] [LOCAL ] LTC: Loaded 30481 existing records from primary storage. [2025-10-28T19:46:47.625801] [INFO ] [MAIN ] LTC: Loaded 30481 existing records. [2025-10-28T19:46:47.804438] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:47.804699] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-28T19:46:47.804757] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-28T19:46:47.804933] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-28T19:46:47.804971] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-28T19:46:47.983278] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-28T19:46:48.176112] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:48.295753] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:46:48.780262] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-28T19:46:49.580223] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-28T19:46:49.792570] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:46:50.380234] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-28T19:46:50.504419] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:46:50.702974] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-28T19:46:51.180308] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-28T19:46:51.436267] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:46:51.980307] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-28T19:46:52.229067] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:46:52.780257] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-28T19:46:52.855217] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:46:53.580224] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-28T19:46:53.778196] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T19:46:54.292522] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:46:54.380278] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-28T19:46:55.180288] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-28T19:46:55.411557] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:46:55.980248] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-28T19:46:56.419356] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:46:56.780265] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-28T19:46:57.043314] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:46:57.580225] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-28T19:46:57.780726] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T19:46:58.380252] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-28T19:46:59.072959] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:46:59.084192] [INFO ] [REMOTE ] LSPD: Full fetch complete (62466 records). [2025-10-28T19:46:59.084380] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-28T19:46:59.185494] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-28T19:46:59.499316] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:46:59.526598] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-28T19:46:59.527033] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-28T19:46:59.528068] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-28T19:46:59.528127] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-28T19:46:59.529356] [DEBUG] [LOCAL ] LSPD: Trimmed 62466 records to 41999 (keeping 200 days of data) [2025-10-28T19:46:59.766400] [DEBUG] [LOCAL ] LSPD: Primary data saved (41999 records). [2025-10-28T19:46:59.766523] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-28T19:46:59.766598] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LSPD took 24.5s. Estimated remaining: 2h 23m 20s. Rate: 7.6 symbols/min [2025-10-28T19:46:59.937929] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:59.984078] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-28T19:46:59.986033] [DEBUG] [LOCAL ] LTH: Loaded 51546 existing records from primary storage. [2025-10-28T19:46:59.986387] [INFO ] [MAIN ] LTH: Loaded 51546 existing records. [2025-10-28T19:47:00.166803] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:00.167034] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-28T19:47:00.167083] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-28T19:47:00.167288] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-28T19:47:00.167345] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-28T19:47:00.556372] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:00.580795] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T19:47:00.589192] [INFO ] [REMOTE ] LPX: Full fetch complete (58585 records). [2025-10-28T19:47:00.589339] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-28T19:47:00.788663] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-28T19:47:00.988053] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-28T19:47:00.988133] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-28T19:47:00.989050] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-28T19:47:00.989112] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-28T19:47:00.990298] [DEBUG] [LOCAL ] LPX: Trimmed 58585 records to 39916 (keeping 200 days of data) [2025-10-28T19:47:01.229756] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:47:01.270443] [DEBUG] [LOCAL ] LPX: Primary data saved (39916 records). [2025-10-28T19:47:01.270586] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-28T19:47:01.270981] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LPX took 36.6s. Estimated remaining: 2h 23m 7s. Rate: 7.6 symbols/min [2025-10-28T19:47:01.442228] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:01.480263] [DEBUG] [LOCAL ] LTM: Loaded 39414 existing records from primary storage. [2025-10-28T19:47:01.480564] [INFO ] [MAIN ] LTM: Loaded 39414 existing records. [2025-10-28T19:47:01.585446] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-28T19:47:01.658794] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:01.659323] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-28T19:47:01.659379] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-28T19:47:01.659625] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-28T19:47:01.659718] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-28T19:47:02.018372] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:02.171987] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:47:02.380223] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-28T19:47:02.454904] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T19:47:03.180246] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-28T19:47:03.434188] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:47:03.980257] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-28T19:47:04.019981] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T19:47:04.780251] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-28T19:47:05.202274] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:47:05.209582] [INFO ] [REMOTE ] LRN: Full fetch complete (58047 records). [2025-10-28T19:47:05.209740] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-28T19:47:05.604622] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-28T19:47:05.624493] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-28T19:47:05.624638] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-28T19:47:05.625718] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-28T19:47:05.626625] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-28T19:47:05.633487] [DEBUG] [LOCAL ] LRN: Trimmed 58047 records to 39089 (keeping 200 days of data) [2025-10-28T19:47:05.643625] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T19:47:05.880093] [DEBUG] [LOCAL ] LRN: Primary data saved (39089 records). [2025-10-28T19:47:05.880226] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-28T19:47:05.880919] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LRN took 36.2s. Estimated remaining: 2h 22m 56s. Rate: 7.6 symbols/min [2025-10-28T19:47:06.049012] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:06.097167] [DEBUG] [LOCAL ] LU: Loaded 49197 existing records from primary storage. [2025-10-28T19:47:06.097471] [INFO ] [MAIN ] LU: Loaded 49197 existing records. [2025-10-28T19:47:06.273832] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:06.274023] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-28T19:47:06.274068] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-28T19:47:06.274256] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-28T19:47:06.274292] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-28T19:47:06.385415] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-28T19:47:06.640323] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:06.866769] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T19:47:07.180281] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-28T19:47:07.980230] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-28T19:47:08.481132] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:47:08.780273] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-28T19:47:09.200165] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:47:09.580234] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-28T19:47:09.651191] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T19:47:09.978356] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (3.59 seconds). [2025-10-28T19:47:10.380242] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-28T19:47:10.773103] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:47:11.180243] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-28T19:47:11.402363] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T19:47:11.980259] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-28T19:47:12.422878] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T19:47:12.780304] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-28T19:47:12.895411] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:47:13.580285] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-28T19:47:13.713959] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:47:14.380333] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-28T19:47:14.784136] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T19:47:15.180266] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-28T19:47:15.321328] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:47:15.980267] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-28T19:47:16.219897] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T19:47:16.780270] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-28T19:47:17.580309] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-28T19:47:18.164545] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:47:18.380243] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-28T19:47:18.444810] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-28T19:47:19.180254] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-28T19:47:19.578536] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T19:47:19.585274] [INFO ] [REMOTE ] LTC: Full fetch complete (43920 records). [2025-10-28T19:47:19.585364] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-28T19:47:19.959513] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-28T19:47:19.959593] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-28T19:47:19.960409] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-28T19:47:19.960570] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-28T19:47:19.961605] [DEBUG] [LOCAL ] LTC: Trimmed 43920 records to 30479 (keeping 200 days of data) [2025-10-28T19:47:20.013279] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-28T19:47:20.177999] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:47:20.191467] [DEBUG] [LOCAL ] LTC: Primary data saved (30479 records). [2025-10-28T19:47:20.192052] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-28T19:47:20.192163] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LTC took 32.8s. Estimated remaining: 2h 22m 54s. Rate: 7.6 symbols/min [2025-10-28T19:47:20.427414] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:20.430152] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-28T19:47:20.461666] [DEBUG] [LOCAL ] LUCK: Loaded 23228 existing records from primary storage. [2025-10-28T19:47:20.462005] [INFO ] [MAIN ] LUCK: Loaded 23228 existing records. [2025-10-28T19:47:20.639681] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:20.639888] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-28T19:47:20.639935] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-28T19:47:20.640111] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-28T19:47:20.640149] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-28T19:47:20.789551] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-28T19:47:20.999515] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:21.206559] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:47:21.580258] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-28T19:47:22.130983] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:47:22.380258] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-28T19:47:22.578328] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:47:23.180268] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-28T19:47:23.653465] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:47:23.980253] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-28T19:47:24.219227] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:47:24.780368] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-28T19:47:25.580294] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-28T19:47:26.209260] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T19:47:26.219352] [INFO ] [REMOTE ] LTH: Full fetch complete (74735 records). [2025-10-28T19:47:26.219475] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-28T19:47:26.390367] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-28T19:47:26.608057] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-28T19:47:26.608131] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-28T19:47:26.609166] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-28T19:47:26.609226] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-28T19:47:26.610574] [DEBUG] [LOCAL ] LTH: Trimmed 74735 records to 51532 (keeping 200 days of data) [2025-10-28T19:47:26.841617] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:47:26.949513] [DEBUG] [LOCAL ] LTH: Primary data saved (51532 records). [2025-10-28T19:47:26.949679] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-28T19:47:26.949785] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 27.2s. Estimated remaining: 2h 22m 45s. Rate: 7.6 symbols/min [2025-10-28T19:47:27.040190] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (3.06 seconds). [2025-10-28T19:47:27.180238] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-28T19:47:27.644894] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:47:27.980237] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-28T19:47:28.780330] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-28T19:47:29.055775] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:47:29.580295] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-28T19:47:29.808951] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T19:47:30.380342] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-28T19:47:30.807746] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:47:31.180224] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-28T19:47:31.250694] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T19:47:31.435467] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (4.26 seconds). [2025-10-28T19:47:31.445088] [INFO ] [REMOTE ] LTM: Full fetch complete (51916 records). [2025-10-28T19:47:31.445218] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-28T19:47:31.856619] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-28T19:47:31.856874] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-28T19:47:31.857772] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-28T19:47:31.857834] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-28T19:47:31.858940] [DEBUG] [LOCAL ] LTM: Trimmed 51916 records to 39530 (keeping 200 days of data) [2025-10-28T19:47:32.016797] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-28T19:47:32.086301] [DEBUG] [LOCAL ] LTM: Primary data saved (39530 records). [2025-10-28T19:47:32.086431] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-28T19:47:32.086788] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LTM took 30.8s. Estimated remaining: 2h 22m 35s. Rate: 7.6 symbols/min [2025-10-28T19:47:32.946975] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:47:32.956677] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-28T19:47:33.806711] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:47:33.813554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-28T19:47:34.595063] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:47:34.601158] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-28T19:47:35.221931] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T19:47:35.226819] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-28T19:47:35.950387] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T19:47:35.980340] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-28T19:47:36.829460] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:47:36.835041] [INFO ] [REMOTE ] LUCK: Full fetch complete (38651 records). [2025-10-28T19:47:36.835169] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-28T19:47:37.046775] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (5.87 seconds). [2025-10-28T19:47:37.144498] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-28T19:47:37.264381] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-28T19:47:37.264464] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-28T19:47:37.265360] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-28T19:47:37.265422] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-28T19:47:37.266364] [DEBUG] [LOCAL ] LUCK: Trimmed 38651 records to 23109 (keeping 200 days of data) [2025-10-28T19:47:37.402503] [DEBUG] [LOCAL ] LUCK: Primary data saved (23109 records). [2025-10-28T19:47:37.402635] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-28T19:47:37.402758] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LUCK took 17.2s. Estimated remaining: 2h 22m 25s. Rate: 7.6 symbols/min [2025-10-28T19:47:38.470824] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:47:38.481599] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-28T19:47:39.805193] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T19:47:39.815570] [INFO ] [REMOTE ] LU: Full fetch complete (71049 records). [2025-10-28T19:47:39.815734] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-28T19:47:40.230145] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-28T19:47:40.230223] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-28T19:47:40.231316] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-28T19:47:40.231386] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-28T19:47:40.232770] [DEBUG] [LOCAL ] LU: Trimmed 71049 records to 49221 (keeping 200 days of data) [2025-10-28T19:47:40.497734] [DEBUG] [LOCAL ] LU: Primary data saved (49221 records). [2025-10-28T19:47:40.497861] [INFO ] [MAIN ] LU: Full history saved. [2025-10-28T19:47:40.498490] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LU took 34.6s. Estimated remaining: 2h 22m 13s. Rate: 7.6 symbols/min [2025-10-28T19:47:41.085839] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.077453] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.133321] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-28T19:47:41.145894] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-28T19:47:41.211041] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.229887] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-28T19:47:41.229520] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.230185] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-28T19:47:41.230940] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-28T19:47:41.230998] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-28T19:47:41.508092] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-28T19:47:41.534170] [INFO ] [MAIN ] LUMN: Loaded 53646 existing records. [2025-10-28T19:47:41.660702] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-28T19:47:41.644870] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-28T19:47:41.669826] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-28T19:47:41.689422] [INFO ] [MAIN ] LVS: Loaded 53569 existing records. [2025-10-28T19:47:42.050540] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:42.074847] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-28T19:47:42.159000] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:42.248439] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-28T19:47:42.276869] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:42.280756] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-28T19:47:42.280627] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:47:42.280937] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-28T19:47:42.285889] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-28T19:47:42.285587] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:42.286202] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-28T19:47:42.286384] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-28T19:47:42.286274] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-28T19:47:42.285710] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-28T19:47:42.286614] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-28T19:47:42.286354] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-28T19:47:42.286518] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-28T19:47:42.286791] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:47:42.327573] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-28T19:47:42.366112] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:47:42.303354] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-28T19:47:42.421187] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-28T19:47:42.421068] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-28T19:47:42.462599] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-28T19:47:42.508302] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-28T19:47:42.535418] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-28T19:47:42.606367] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.1s. Estimated remaining: 2h 22m 0s. Rate: 7.6 symbols/min [2025-10-28T19:47:43.359529] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:43.513710] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:43.617509] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:43.628828] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-28T19:47:43.628479] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-28T19:47:43.697684] [DEBUG] [LOCAL ] LVWR: Loaded 18668 existing records from primary storage. [2025-10-28T19:47:43.696709] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:43.697990] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-28T19:47:43.698901] [INFO ] [MAIN ] LVWR: Loaded 18668 existing records. [2025-10-28T19:47:43.876980] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:43.877231] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-28T19:47:43.877279] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-28T19:47:43.877508] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-28T19:47:43.877585] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-28T19:47:44.229128] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:44.229425] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-28T19:47:44.634273] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T19:47:44.636127] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-28T19:47:45.036860] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T19:47:45.047611] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-28T19:47:45.178197] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T19:47:45.181305] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-28T19:47:45.184424] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T19:47:45.198556] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-28T19:47:45.557090] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T19:47:45.580209] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-28T19:47:45.987137] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T19:47:46.380220] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-28T19:47:46.447814] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:47:46.590868] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T19:47:47.131836] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T19:47:47.180259] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-28T19:47:47.980253] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-28T19:47:48.668374] [DEBUG] [REMOTE ] LUMN: Error fetching primary data for 2025-01: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-28T19:47:48.668578] [WARN ] [REMOTE ] LUMN: No data returned for month 2025-01 [2025-10-28T19:47:48.668691] [FATAL] [REMOTE ] LUMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:47:48.668738] [FATAL] [MAIN ] LUMN: Failed to fetch primary data. [2025-10-28T19:47:48.668770] [WARN ] [MAIN ] LUMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:47:48.668835] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-28T19:47:48.668902] [DEBUG] [LOCAL ] LUMN: No primary data file found to delete. [2025-10-28T19:47:48.668935] [INFO ] [LOCAL ] LUMN: Starting deletion of derivative data. [2025-10-28T19:47:48.669161] [DEBUG] [LOCAL ] LUMN: Deleted derivative data file. [2025-10-28T19:47:48.669232] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LUMN took 8.2s. Estimated remaining: 2h 21m 51s. Rate: 7.6 symbols/min [2025-10-28T19:47:48.790375] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-28T19:47:48.852133] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:48.886993] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T19:47:48.940787] [DEBUG] [LOCAL ] LW: Loaded 51116 existing records from primary storage. [2025-10-28T19:47:48.941150] [INFO ] [MAIN ] LW: Loaded 51116 existing records. [2025-10-28T19:47:49.117590] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:49.117905] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-28T19:47:49.117952] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-28T19:47:49.118323] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-28T19:47:49.118380] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-28T19:47:49.477693] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:49.580261] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-28T19:47:50.380319] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-28T19:47:51.004204] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:47:51.180318] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-28T19:47:51.687125] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:47:51.980244] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-28T19:47:52.692959] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T19:47:52.780220] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-28T19:47:52.957994] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:47:53.580236] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-28T19:47:54.105570] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T19:47:54.380302] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-28T19:47:54.881546] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:47:55.180226] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-28T19:47:55.846078] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:47:55.980349] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-28T19:47:56.460187] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:47:56.780303] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-28T19:47:57.947762] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:47:57.958858] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-28T19:47:59.034794] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (11.05 seconds). [2025-10-28T19:47:59.046237] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-28T19:47:59.128326] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:47:59.180233] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-28T19:48:00.374383] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:48:00.385724] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-28T19:48:00.885350] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T19:48:00.896853] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-28T19:48:02.108301] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T19:48:02.120947] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-28T19:48:02.170495] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (13.38 seconds). [2025-10-28T19:48:02.387936] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-28T19:48:02.420763] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T19:48:03.187952] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-28T19:48:03.192235] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T19:48:03.980324] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-28T19:48:04.419247] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T19:48:04.548820] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:48:04.780324] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-28T19:48:05.580293] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-28T19:48:06.267545] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:48:06.316309] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:48:06.327814] [INFO ] [REMOTE ] LW: Full fetch complete (74726 records). [2025-10-28T19:48:06.328025] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-28T19:48:06.391792] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-28T19:48:06.750751] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-28T19:48:06.750840] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-28T19:48:06.751922] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-28T19:48:06.751984] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-28T19:48:06.753366] [DEBUG] [LOCAL ] LW: Trimmed 74726 records to 51101 (keeping 200 days of data) [2025-10-28T19:48:07.057915] [DEBUG] [LOCAL ] LW: Primary data saved (51101 records). [2025-10-28T19:48:07.058180] [INFO ] [MAIN ] LW: Full history saved. [2025-10-28T19:48:07.058281] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LW took 18.4s. Estimated remaining: 2h 21m 52s. Rate: 7.6 symbols/min [2025-10-28T19:48:07.179803] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T19:48:07.225352] [INFO ] [REMOTE ] LVWR: Full fetch complete (20844 records). [2025-10-28T19:48:07.241176] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-28T19:48:07.244762] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:07.421864] [DEBUG] [LOCAL ] LXFR: Loaded 16176 existing records from primary storage. [2025-10-28T19:48:07.439537] [INFO ] [MAIN ] LXFR: Loaded 16176 existing records. [2025-10-28T19:48:07.785873] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-28T19:48:07.814594] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-28T19:48:07.825011] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-28T19:48:07.846144] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-28T19:48:07.846071] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:07.846906] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-28T19:48:07.847693] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-28T19:48:07.847908] [DEBUG] [LOCAL ] LVWR: Trimmed 20844 records to 18684 (keeping 200 days of data) [2025-10-28T19:48:07.848227] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-28T19:48:07.848342] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-28T19:48:08.086076] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (12.11 seconds). [2025-10-28T19:48:08.140041] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-28T19:48:08.300094] [DEBUG] [LOCAL ] LVWR: Primary data saved (18684 records). [2025-10-28T19:48:08.300504] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-28T19:48:08.306013] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LVWR took 25.6s. Estimated remaining: 2h 21m 39s. Rate: 7.6 symbols/min [2025-10-28T19:48:08.441124] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:08.453109] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-28T19:48:08.550994] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:08.597539] [DEBUG] [LOCAL ] LXP: Loaded 50671 existing records from primary storage. [2025-10-28T19:48:08.597871] [INFO ] [MAIN ] LXP: Loaded 50671 existing records. [2025-10-28T19:48:08.775439] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:08.775715] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-28T19:48:08.775773] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-28T19:48:08.775988] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-28T19:48:08.776051] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-28T19:48:09.132151] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:09.132672] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-28T19:48:09.169707] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:48:09.580242] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-28T19:48:09.770580] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T19:48:10.235009] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:48:10.380228] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-28T19:48:10.454133] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:48:11.090314] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:48:11.180260] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-28T19:48:11.948148] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T19:48:11.980223] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-28T19:48:12.632553] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:48:12.742368] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (10.62 seconds). [2025-10-28T19:48:12.780246] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-28T19:48:13.580249] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-28T19:48:13.971231] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:48:14.380307] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-28T19:48:14.938596] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T19:48:15.180298] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-28T19:48:15.980563] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-28T19:48:16.236186] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-28T19:48:16.247384] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-28T19:48:16.247572] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-28T19:48:16.525372] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:48:16.701549] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-28T19:48:16.701628] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-28T19:48:16.702771] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-28T19:48:16.702834] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-28T19:48:16.704328] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-28T19:48:16.791668] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-28T19:48:17.034182] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-28T19:48:17.034306] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-28T19:48:17.034382] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LUV took 36.5s. Estimated remaining: 2h 21m 32s. Rate: 7.6 symbols/min [2025-10-28T19:48:17.202704] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:17.231705] [DEBUG] [LOCAL ] LXU: Loaded 31131 existing records from primary storage. [2025-10-28T19:48:17.231964] [INFO ] [MAIN ] LXU: Loaded 31131 existing records. [2025-10-28T19:48:17.416893] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:17.417106] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-28T19:48:17.417224] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-28T19:48:17.417417] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-28T19:48:17.417458] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-28T19:48:17.536848] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T19:48:17.586161] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-28T19:48:17.795926] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:18.380274] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-28T19:48:19.064403] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:48:19.180247] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-28T19:48:19.348462] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T19:48:19.980328] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-28T19:48:20.461218] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:48:20.685695] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T19:48:20.780261] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-28T19:48:21.459841] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T19:48:21.580318] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-28T19:48:22.380250] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-28T19:48:22.818205] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:48:23.066103] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:48:23.180304] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-28T19:48:23.398944] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (7.42 seconds). [2025-10-28T19:48:23.980290] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-28T19:48:24.435234] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:48:24.746424] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:48:24.750183] [INFO ] [REMOTE ] LXFR: Full fetch complete (24641 records). [2025-10-28T19:48:24.750290] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-28T19:48:24.785368] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-28T19:48:25.122921] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-28T19:48:25.123001] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-28T19:48:25.123561] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-28T19:48:25.123601] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-28T19:48:25.124265] [DEBUG] [LOCAL ] LXFR: Trimmed 24641 records to 16103 (keeping 200 days of data) [2025-10-28T19:48:25.219882] [DEBUG] [LOCAL ] LXFR: Primary data saved (16103 records). [2025-10-28T19:48:25.220004] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-28T19:48:25.220079] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 18.2s. Estimated remaining: 2h 21m 24s. Rate: 7.6 symbols/min [2025-10-28T19:48:25.398415] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:25.446871] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-28T19:48:25.447166] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-28T19:48:25.587731] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-28T19:48:25.628676] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:25.629057] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-28T19:48:25.629160] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-28T19:48:25.629958] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-28T19:48:25.630034] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-28T19:48:25.745338] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:48:25.997221] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:26.380219] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-28T19:48:27.180231] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-28T19:48:27.257963] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:48:27.980265] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-28T19:48:28.416974] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:48:28.780261] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-28T19:48:29.194804] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:48:29.580262] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-28T19:48:30.305104] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:48:30.316337] [INFO ] [REMOTE ] LVS: Full fetch complete (77728 records). [2025-10-28T19:48:30.316471] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-28T19:48:30.385675] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-28T19:48:30.715454] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-28T19:48:30.715546] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-28T19:48:30.716633] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-28T19:48:30.716713] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-28T19:48:30.718201] [DEBUG] [LOCAL ] LVS: Trimmed 77728 records to 53569 (keeping 200 days of data) [2025-10-28T19:48:31.058100] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-28T19:48:31.058344] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-28T19:48:31.058527] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LVS took 50.5s. Estimated remaining: 2h 21m 14s. Rate: 7.6 symbols/min [2025-10-28T19:48:31.257713] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:31.286219] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T19:48:31.300563] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-28T19:48:31.342855] [DEBUG] [LOCAL ] LYG: Loaded 52640 existing records from primary storage. [2025-10-28T19:48:31.343156] [INFO ] [MAIN ] LYG: Loaded 52640 existing records. [2025-10-28T19:48:31.535802] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:31.536216] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-28T19:48:31.536379] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-28T19:48:31.542879] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-28T19:48:31.554181] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-28T19:48:31.612691] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:48:31.928123] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:31.980267] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-28T19:48:32.401775] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:48:32.780286] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-28T19:48:33.413095] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T19:48:33.580260] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-28T19:48:34.101967] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:48:34.380300] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-28T19:48:34.518222] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T19:48:34.816584] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (9.23 seconds). [2025-10-28T19:48:35.180306] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-28T19:48:35.730667] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T19:48:35.980284] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-28T19:48:36.780320] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-28T19:48:37.437868] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T19:48:37.580242] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-28T19:48:37.762149] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:48:38.380302] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-28T19:48:38.918509] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:48:39.180267] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-28T19:48:39.287320] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:48:39.980244] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-28T19:48:40.655631] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:48:40.780267] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-28T19:48:41.309034] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:48:41.580245] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-28T19:48:41.781763] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (6.60 seconds). [2025-10-28T19:48:42.119024] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T19:48:42.380247] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-28T19:48:43.144195] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T19:48:43.180229] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-28T19:48:43.739761] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T19:48:43.750547] [INFO ] [REMOTE ] LXP: Full fetch complete (72830 records). [2025-10-28T19:48:43.750771] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-28T19:48:43.986141] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-28T19:48:44.181759] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-28T19:48:44.181848] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-28T19:48:44.183100] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-28T19:48:44.183166] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-28T19:48:44.184707] [DEBUG] [LOCAL ] LXP: Trimmed 72830 records to 50647 (keeping 200 days of data) [2025-10-28T19:48:44.487743] [DEBUG] [LOCAL ] LXP: Primary data saved (50647 records). [2025-10-28T19:48:44.487921] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-28T19:48:44.488026] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXP took 36.2s. Estimated remaining: 2h 21m 11s. Rate: 7.6 symbols/min [2025-10-28T19:48:44.638687] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T19:48:44.715373] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:44.763704] [DEBUG] [LOCAL ] LYV: Loaded 50904 existing records from primary storage. [2025-10-28T19:48:44.764051] [INFO ] [MAIN ] LYV: Loaded 50904 existing records. [2025-10-28T19:48:44.785339] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-28T19:48:44.907499] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:48:45.005723] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:45.006274] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-28T19:48:45.006475] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-28T19:48:45.007335] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-28T19:48:45.007397] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-28T19:48:45.371404] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:45.580264] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-28T19:48:46.311305] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:48:46.380247] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-28T19:48:46.916494] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T19:48:47.180246] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-28T19:48:47.917721] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T19:48:47.980220] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-28T19:48:48.661121] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T19:48:48.780262] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-28T19:48:49.251774] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:48:49.580230] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-28T19:48:49.731769] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T19:48:49.737720] [INFO ] [REMOTE ] LXU: Full fetch complete (45223 records). [2025-10-28T19:48:49.737822] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-28T19:48:50.133084] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-28T19:48:50.133163] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-28T19:48:50.134071] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-28T19:48:50.134141] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-28T19:48:50.135114] [DEBUG] [LOCAL ] LXU: Trimmed 45223 records to 31022 (keeping 200 days of data) [2025-10-28T19:48:50.308320] [DEBUG] [LOCAL ] LXU: Primary data saved (31022 records). [2025-10-28T19:48:50.308458] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-28T19:48:50.308536] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LXU took 33.3s. Estimated remaining: 2h 21m 2s. Rate: 7.6 symbols/min [2025-10-28T19:48:50.388358] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-28T19:48:50.493337] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:50.525276] [DEBUG] [LOCAL ] LZB: Loaded 34783 existing records from primary storage. [2025-10-28T19:48:50.525587] [INFO ] [MAIN ] LZB: Loaded 34783 existing records. [2025-10-28T19:48:50.714602] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:50.714809] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-28T19:48:50.714858] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-28T19:48:50.715460] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-28T19:48:50.715518] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-28T19:48:51.079504] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:51.110258] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:48:51.180249] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-28T19:48:51.769774] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:48:51.980269] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-28T19:48:52.768458] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T19:48:52.780219] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-28T19:48:53.258972] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:48:53.580225] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-28T19:48:54.380213] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-28T19:48:54.547155] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T19:48:54.612249] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T19:48:54.623110] [INFO ] [REMOTE ] LYB: Full fetch complete (77641 records). [2025-10-28T19:48:54.623262] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-28T19:48:55.022256] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-28T19:48:55.022345] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-28T19:48:55.023389] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-28T19:48:55.023452] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-28T19:48:55.024906] [DEBUG] [LOCAL ] LYB: Trimmed 77641 records to 53620 (keeping 200 days of data) [2025-10-28T19:48:55.200264] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-28T19:48:55.354731] [DEBUG] [LOCAL ] LYB: Primary data saved (53620 records). [2025-10-28T19:48:55.354863] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-28T19:48:55.354938] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYB took 30.1s. Estimated remaining: 2h 20m 51s. Rate: 7.6 symbols/min [2025-10-28T19:48:55.535788] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:55.572011] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:48:55.594050] [DEBUG] [LOCAL ] LZM: Loaded 14897 existing records from primary storage. [2025-10-28T19:48:55.594293] [INFO ] [MAIN ] LZM: Loaded 14897 existing records. [2025-10-28T19:48:55.770811] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:55.771014] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-28T19:48:55.771079] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-28T19:48:55.771477] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-28T19:48:55.771537] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-28T19:48:55.990512] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-28T19:48:56.129520] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:56.189228] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:48:56.780274] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-28T19:48:57.543037] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T19:48:57.553627] [INFO ] [REMOTE ] LYG: Full fetch complete (76280 records). [2025-10-28T19:48:57.553783] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-28T19:48:57.586133] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-28T19:48:57.958220] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-28T19:48:57.958324] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-28T19:48:57.959568] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-28T19:48:57.959664] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-28T19:48:57.961373] [DEBUG] [LOCAL ] LYG: Trimmed 76280 records to 52636 (keeping 200 days of data) [2025-10-28T19:48:58.096240] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T19:48:58.220050] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T19:48:58.316136] [DEBUG] [LOCAL ] LYG: Primary data saved (52636 records). [2025-10-28T19:48:58.316264] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-28T19:48:58.317108] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LYG took 27.3s. Estimated remaining: 2h 20m 40s. Rate: 7.6 symbols/min [2025-10-28T19:48:58.385487] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-28T19:48:58.491541] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:58.543298] [DEBUG] [LOCAL ] M: Loaded 53543 existing records from primary storage. [2025-10-28T19:48:58.543672] [INFO ] [MAIN ] M: Loaded 53543 existing records. [2025-10-28T19:48:58.726536] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:58.726876] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-28T19:48:58.726932] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-28T19:48:58.728062] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-28T19:48:58.728122] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-28T19:48:59.076069] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:59.180264] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-28T19:48:59.980264] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-28T19:49:00.084839] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T19:49:00.437131] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T19:49:00.780312] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-28T19:49:01.580296] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-28T19:49:01.777184] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T19:49:02.380247] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-28T19:49:02.956394] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T19:49:03.180258] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-28T19:49:03.980225] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-28T19:49:04.080677] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T19:49:04.723093] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T19:49:04.780222] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-28T19:49:05.116733] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (5.94 seconds). [2025-10-28T19:49:05.580252] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-28T19:49:06.380262] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-28T19:49:06.852134] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:49:06.940414] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:49:07.180254] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-28T19:49:07.561710] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (5.98 seconds). [2025-10-28T19:49:07.980251] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-28T19:49:08.788417] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-28T19:49:08.797716] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T19:49:09.272153] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:49:09.580276] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-28T19:49:09.847694] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-28T19:49:10.082717] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T19:49:10.380260] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-28T19:49:11.180253] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-28T19:49:11.724376] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T19:49:11.980282] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-28T19:49:12.761683] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (7.98 seconds). [2025-10-28T19:49:12.780206] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-28T19:49:13.580243] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-28T19:49:13.816035] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T19:49:13.852470] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-28T19:49:14.380301] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-28T19:49:15.180323] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-28T19:49:15.695627] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:49:15.980220] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-28T19:49:16.519789] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-28T19:49:16.728699] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:49:16.780300] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-28T19:49:17.033301] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:49:17.580230] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-28T19:49:17.595490] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T19:49:17.600465] [INFO ] [REMOTE ] LZM: Full fetch complete (20249 records). [2025-10-28T19:49:17.600547] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-28T19:49:17.808765] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (7.43 seconds). [2025-10-28T19:49:18.027133] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-28T19:49:18.027213] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-28T19:49:18.027637] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-28T19:49:18.027736] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-28T19:49:18.028347] [DEBUG] [LOCAL ] LZM: Trimmed 20249 records to 14881 (keeping 200 days of data) [2025-10-28T19:49:18.112402] [DEBUG] [LOCAL ] LZM: Primary data saved (14881 records). [2025-10-28T19:49:18.112550] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-28T19:49:18.112630] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LZM took 22.8s. Estimated remaining: 2h 20m 42s. Rate: 7.6 symbols/min [2025-10-28T19:49:18.292074] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:18.346756] [DEBUG] [LOCAL ] MA: Loaded 52417 existing records from primary storage. [2025-10-28T19:49:18.347121] [INFO ] [MAIN ] MA: Loaded 52417 existing records. [2025-10-28T19:49:18.385444] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-28T19:49:18.561777] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:18.561968] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-28T19:49:18.562016] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-28T19:49:18.562201] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-28T19:49:18.562241] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-28T19:49:18.986269] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:19.166681] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:49:19.177008] [INFO ] [REMOTE ] LYV: Full fetch complete (74129 records). [2025-10-28T19:49:19.177137] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-28T19:49:19.188892] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-28T19:49:19.561746] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-28T19:49:19.561829] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-28T19:49:19.562868] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-28T19:49:19.562930] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-28T19:49:19.564354] [DEBUG] [LOCAL ] LYV: Trimmed 74129 records to 50878 (keeping 200 days of data) [2025-10-28T19:49:19.876791] [DEBUG] [LOCAL ] LYV: Primary data saved (50878 records). [2025-10-28T19:49:19.876950] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-28T19:49:19.877065] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LYV took 35.4s. Estimated remaining: 2h 20m 29s. Rate: 7.6 symbols/min [2025-10-28T19:49:19.982057] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-28T19:49:20.012574] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T19:49:20.094318] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:20.134295] [DEBUG] [LOCAL ] MAA: Loaded 42844 existing records from primary storage. [2025-10-28T19:49:20.134575] [INFO ] [MAIN ] MAA: Loaded 42844 existing records. [2025-10-28T19:49:20.313278] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:20.313483] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-28T19:49:20.313529] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-28T19:49:20.313881] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-28T19:49:20.313939] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-28T19:49:20.651755] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:49:20.699855] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:20.700021] [INFO ] [REMOTE ] LZB: Full fetch complete (51177 records). [2025-10-28T19:49:20.700336] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-28T19:49:20.788161] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-28T19:49:21.087791] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-28T19:49:21.087862] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-28T19:49:21.088766] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-28T19:49:21.088826] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-28T19:49:21.089894] [DEBUG] [LOCAL ] LZB: Trimmed 51177 records to 34736 (keeping 200 days of data) [2025-10-28T19:49:21.294853] [DEBUG] [LOCAL ] LZB: Primary data saved (34736 records). [2025-10-28T19:49:21.294978] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-28T19:49:21.295314] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. LZB took 31.0s. Estimated remaining: 2h 20m 16s. Rate: 7.6 symbols/min [2025-10-28T19:49:21.467089] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:21.498817] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T19:49:21.548129] [DEBUG] [LOCAL ] MAC: Loaded 49449 existing records from primary storage. [2025-10-28T19:49:21.548435] [INFO ] [MAIN ] MAC: Loaded 49449 existing records. [2025-10-28T19:49:21.589854] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-28T19:49:21.727748] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:21.727957] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-28T19:49:21.728009] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-28T19:49:21.728578] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-28T19:49:21.728635] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-28T19:49:22.097432] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:22.120781] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:49:22.380245] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-28T19:49:23.091134] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T19:49:23.180276] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-28T19:49:23.428174] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:49:23.980324] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-28T19:49:24.265833] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:49:24.780287] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-28T19:49:25.580328] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-28T19:49:25.700311] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T19:49:26.217505] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:49:26.380247] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-28T19:49:26.808821] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T19:49:27.180290] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-28T19:49:27.980290] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-28T19:49:28.364449] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T19:49:28.780222] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-28T19:49:29.580369] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-28T19:49:30.156281] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:49:30.380357] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-28T19:49:31.002268] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T19:49:31.180320] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-28T19:49:32.129102] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T19:49:32.139986] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-28T19:49:32.579754] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T19:49:32.780264] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-28T19:49:34.189916] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T19:49:34.200859] [INFO ] [REMOTE ] M: Full fetch complete (77656 records). [2025-10-28T19:49:34.201045] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-28T19:49:34.632440] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-28T19:49:34.632525] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-28T19:49:34.633635] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-28T19:49:34.633733] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-28T19:49:34.635235] [DEBUG] [LOCAL ] M: Trimmed 77656 records to 53542 (keeping 200 days of data) [2025-10-28T19:49:34.958989] [DEBUG] [LOCAL ] M: Primary data saved (53542 records). [2025-10-28T19:49:34.959143] [INFO ] [MAIN ] M: Full history saved. [2025-10-28T19:49:34.959867] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. M took 36.6s. Estimated remaining: 2h 20m 12s. Rate: 7.6 symbols/min [2025-10-28T19:49:35.141517] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:35.161372] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (8.78 seconds). [2025-10-28T19:49:35.173104] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-28T19:49:35.206402] [DEBUG] [LOCAL ] MAGN: Loaded 35837 existing records from primary storage. [2025-10-28T19:49:35.206676] [INFO ] [MAIN ] MAGN: Loaded 35837 existing records. [2025-10-28T19:49:35.382469] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:35.382728] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-28T19:49:35.382781] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-28T19:49:35.382962] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-28T19:49:35.382999] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-28T19:49:35.771925] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:35.772777] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-28T19:49:35.774826] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (7.79 seconds). [2025-10-28T19:49:35.784446] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-28T19:49:35.798879] [DEBUG] [REMOTE ] MAC: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T19:49:35.798960] [WARN ] [REMOTE ] MAC: No data returned for month 2025-05 [2025-10-28T19:49:35.799034] [FATAL] [REMOTE ] MAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:49:35.799076] [FATAL] [MAIN ] MAC: Failed to fetch primary data. [2025-10-28T19:49:35.799107] [WARN ] [MAIN ] MAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:49:35.799140] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-28T19:49:35.799187] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-28T19:49:35.799220] [INFO ] [LOCAL ] MAC: Starting deletion of derivative data. [2025-10-28T19:49:35.799450] [DEBUG] [LOCAL ] MAC: Deleted derivative data file. [2025-10-28T19:49:35.799519] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAC took 14.5s. Estimated remaining: 2h 19m 59s. Rate: 7.6 symbols/min [2025-10-28T19:49:35.972210] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:36.012029] [DEBUG] [LOCAL ] MAIN: Loaded 41726 existing records from primary storage. [2025-10-28T19:49:36.012303] [INFO ] [MAIN ] MAIN: Loaded 41726 existing records. [2025-10-28T19:49:36.186109] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:36.186341] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-28T19:49:36.186387] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-28T19:49:36.186560] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-28T19:49:36.186598] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-28T19:49:36.535753] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:36.536103] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-28T19:49:36.674549] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T19:49:36.780225] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-28T19:49:37.038026] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:49:37.580280] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-28T19:49:37.747288] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T19:49:38.380265] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-28T19:49:38.855570] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:49:39.180328] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-28T19:49:40.442229] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:49:40.452599] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-28T19:49:41.791860] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:49:41.801051] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-28T19:49:43.099694] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:49:43.113001] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-28T19:49:44.721116] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T19:49:44.732050] [INFO ] [REMOTE ] MAA: Full fetch complete (62039 records). [2025-10-28T19:49:44.732198] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-28T19:49:45.144063] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-28T19:49:45.144152] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-28T19:49:45.145201] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-28T19:49:45.145264] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-28T19:49:45.146711] [DEBUG] [LOCAL ] MAA: Trimmed 62039 records to 42852 (keeping 200 days of data) [2025-10-28T19:49:45.420883] [DEBUG] [LOCAL ] MAA: Primary data saved (42852 records). [2025-10-28T19:49:45.421009] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-28T19:49:45.421089] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MAA took 25.5s. Estimated remaining: 2h 19m 52s. Rate: 7.6 symbols/min [2025-10-28T19:49:45.592918] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:45.635810] [DEBUG] [LOCAL ] MAN: Loaded 44314 existing records from primary storage. [2025-10-28T19:49:45.636146] [INFO ] [MAIN ] MAN: Loaded 44314 existing records. [2025-10-28T19:49:45.812769] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:45.813030] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-28T19:49:45.813087] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-28T19:49:45.813602] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-28T19:49:45.813691] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-28T19:49:45.964038] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (10.79 seconds). [2025-10-28T19:49:46.037678] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-28T19:49:46.243069] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:46.243392] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-28T19:49:47.248205] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:49:47.256532] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-28T19:49:47.531745] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T19:49:47.542586] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-28T19:49:49.075192] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T19:49:49.085523] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-28T19:49:49.618169] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (12.84 seconds). [2025-10-28T19:49:49.626235] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-28T19:49:50.517634] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T19:49:50.524985] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-28T19:49:51.585612] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T19:49:51.593559] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-28T19:49:52.453486] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (14.07 seconds). [2025-10-28T19:49:52.461608] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-28T19:49:53.800507] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:49:53.809170] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-28T19:49:55.096211] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T19:49:55.105104] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-28T19:49:56.539153] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T19:49:56.549589] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-28T19:49:56.572449] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (9.32 seconds). [2025-10-28T19:49:56.584329] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-28T19:49:57.659558] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:49:57.669102] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-28T19:49:57.734840] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:49:57.743398] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-28T19:49:57.825001] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (6.23 seconds). [2025-10-28T19:49:57.833480] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-28T19:49:58.790290] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:49:58.823579] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:49:58.824124] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-28T19:49:58.832824] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-28T19:49:58.922419] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:49:58.932072] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-28T19:49:59.863820] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:49:59.872092] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-28T19:49:59.966494] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:49:59.980375] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-28T19:50:00.141534] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T19:50:00.150438] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-28T19:50:00.912602] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:50:00.922844] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-28T19:50:01.044570] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:50:01.059845] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-28T19:50:01.267156] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T19:50:01.580336] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-28T19:50:01.774228] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T19:50:02.373342] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:50:02.383847] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-28T19:50:03.124325] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:50:03.134021] [INFO ] [REMOTE ] MAIN: Full fetch complete (60310 records). [2025-10-28T19:50:03.134152] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-28T19:50:03.182446] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-28T19:50:03.524323] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-28T19:50:03.524481] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-28T19:50:03.525511] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-28T19:50:03.525575] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-28T19:50:03.526918] [DEBUG] [LOCAL ] MAIN: Trimmed 60310 records to 41648 (keeping 200 days of data) [2025-10-28T19:50:03.771220] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:50:03.814599] [INFO ] [REMOTE ] MAGN: Full fetch complete (51825 records). [2025-10-28T19:50:03.824937] [DEBUG] [LOCAL ] MAIN: Primary data saved (41648 records). [2025-10-28T19:50:03.825206] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-28T19:50:03.825422] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-28T19:50:03.826339] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAIN took 28.0s. Estimated remaining: 2h 19m 53s. Rate: 7.6 symbols/min [2025-10-28T19:50:04.179263] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:04.487447] [DEBUG] [LOCAL ] MANU: Loaded 26885 existing records from primary storage. [2025-10-28T19:50:04.487767] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-28T19:50:04.488024] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-28T19:50:04.488203] [INFO ] [MAIN ] MANU: Loaded 26885 existing records. [2025-10-28T19:50:04.521748] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-28T19:50:04.533533] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-28T19:50:04.599731] [DEBUG] [LOCAL ] MAGN: Trimmed 51825 records to 35786 (keeping 200 days of data) [2025-10-28T19:50:04.740663] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:04.741068] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-28T19:50:04.766843] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-28T19:50:04.784071] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-28T19:50:04.786147] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-28T19:50:05.175713] [DEBUG] [LOCAL ] MAGN: Primary data saved (35786 records). [2025-10-28T19:50:05.192498] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-28T19:50:05.203851] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MAGN took 30.2s. Estimated remaining: 2h 19m 40s. Rate: 7.6 symbols/min [2025-10-28T19:50:05.419146] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:05.461977] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-28T19:50:05.464747] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:05.517165] [DEBUG] [LOCAL ] MAS: Loaded 52162 existing records from primary storage. [2025-10-28T19:50:05.517584] [INFO ] [MAIN ] MAS: Loaded 52162 existing records. [2025-10-28T19:50:05.725214] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:05.725489] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-28T19:50:05.725540] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-28T19:50:05.725789] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-28T19:50:05.725845] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-28T19:50:06.077037] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:06.077356] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-28T19:50:06.232473] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (17.15 seconds). [2025-10-28T19:50:06.244157] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-28T19:50:07.894295] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T19:50:07.906887] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-28T19:50:09.573427] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T19:50:09.584408] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-28T19:50:11.543758] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-28T19:50:11.554885] [INFO ] [REMOTE ] MA: Full fetch complete (76372 records). [2025-10-28T19:50:11.555052] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-28T19:50:11.955940] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-28T19:50:11.956068] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-28T19:50:11.957352] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-28T19:50:11.957415] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-28T19:50:11.958904] [DEBUG] [LOCAL ] MA: Trimmed 76372 records to 52412 (keeping 200 days of data) [2025-10-28T19:50:12.320536] [DEBUG] [LOCAL ] MA: Primary data saved (52412 records). [2025-10-28T19:50:12.320703] [INFO ] [MAIN ] MA: Full history saved. [2025-10-28T19:50:12.320793] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MA took 54.2s. Estimated remaining: 2h 19m 32s. Rate: 7.6 symbols/min [2025-10-28T19:50:12.501534] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:12.534313] [DEBUG] [LOCAL ] MATV: Loaded 34605 existing records from primary storage. [2025-10-28T19:50:12.534604] [INFO ] [MAIN ] MATV: Loaded 34605 existing records. [2025-10-28T19:50:12.716965] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:12.717255] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-28T19:50:12.717309] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-28T19:50:12.717527] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-28T19:50:12.717578] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-28T19:50:13.067751] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:13.068089] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-28T19:50:13.518365] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (10.34 seconds). [2025-10-28T19:50:13.529507] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-28T19:50:14.078277] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T19:50:14.084424] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-28T19:50:14.603221] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:50:14.612667] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-28T19:50:14.966148] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:50:14.973426] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-28T19:50:15.952949] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T19:50:15.962798] [INFO ] [REMOTE ] MAN: Full fetch complete (63070 records). [2025-10-28T19:50:15.962985] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-28T19:50:16.307344] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T19:50:16.361419] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-28T19:50:16.405743] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-28T19:50:16.405873] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-28T19:50:16.406985] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-28T19:50:16.407047] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-28T19:50:16.408489] [DEBUG] [LOCAL ] MAN: Trimmed 63070 records to 44330 (keeping 200 days of data) [2025-10-28T19:50:16.513862] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (11.05 seconds). [2025-10-28T19:50:16.519537] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-28T19:50:16.680263] [DEBUG] [LOCAL ] MAN: Primary data saved (44330 records). [2025-10-28T19:50:16.680383] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-28T19:50:16.680457] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAN took 31.3s. Estimated remaining: 2h 19m 21s. Rate: 7.6 symbols/min [2025-10-28T19:50:16.849161] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:16.881316] [DEBUG] [LOCAL ] MATX: Loaded 31546 existing records from primary storage. [2025-10-28T19:50:16.881592] [INFO ] [MAIN ] MATX: Loaded 31546 existing records. [2025-10-28T19:50:17.062824] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:17.063053] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-28T19:50:17.063101] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-28T19:50:17.063288] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-28T19:50:17.063327] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-28T19:50:17.393442] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:50:17.431994] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-28T19:50:17.459743] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:17.460948] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-28T19:50:17.542539] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T19:50:17.551492] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-28T19:50:18.283516] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T19:50:18.288917] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-28T19:50:18.322735] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T19:50:18.329481] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-28T19:50:19.161065] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T19:50:19.167036] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-28T19:50:19.258551] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T19:50:19.264558] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-28T19:50:20.174258] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:50:20.180278] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-28T19:50:21.333405] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T19:50:21.341564] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-28T19:50:22.562109] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T19:50:22.571353] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-28T19:50:23.487142] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T19:50:23.494690] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-28T19:50:24.573313] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:50:24.580500] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-28T19:50:25.658492] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:50:25.665905] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-28T19:50:26.458683] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T19:50:26.465266] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-28T19:50:27.443031] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T19:50:27.450664] [INFO ] [REMOTE ] MATX: Full fetch complete (44030 records). [2025-10-28T19:50:27.450892] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-28T19:50:27.852845] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-28T19:50:27.852929] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-28T19:50:27.853737] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-28T19:50:27.853798] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-28T19:50:27.854701] [DEBUG] [LOCAL ] MATX: Trimmed 44030 records to 31448 (keeping 200 days of data) [2025-10-28T19:50:28.060323] [DEBUG] [LOCAL ] MATX: Primary data saved (31448 records). [2025-10-28T19:50:28.060447] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-28T19:50:28.060889] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MATX took 11.4s. Estimated remaining: 2h 19m 16s. Rate: 7.6 symbols/min [2025-10-28T19:50:28.231990] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:28.262152] [DEBUG] [LOCAL ] MAX: Loaded 30512 existing records from primary storage. [2025-10-28T19:50:28.262407] [INFO ] [MAIN ] MAX: Loaded 30512 existing records. [2025-10-28T19:50:28.438227] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:28.438437] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-28T19:50:28.438493] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-28T19:50:28.438779] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-28T19:50:28.438835] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-28T19:50:28.815473] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:28.815813] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-28T19:50:29.772166] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:50:29.778407] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-28T19:50:30.842556] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:50:30.849148] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-28T19:50:37.951299] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (31.87 seconds). [2025-10-28T19:50:37.961064] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-28T19:50:39.044126] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T19:50:39.053831] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-28T19:50:45.112109] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (25.95 seconds). [2025-10-28T19:50:45.117444] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-28T19:50:46.117160] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (28.57 seconds). [2025-10-28T19:50:46.144524] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:50:46.143251] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-28T19:50:46.153039] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-28T19:50:47.007991] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T19:50:47.017583] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-28T19:50:47.319030] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:50:47.326898] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-28T19:50:47.765558] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T19:50:47.773151] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-28T19:50:48.513628] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:50:48.526187] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-28T19:50:48.697119] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:50:48.704305] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-28T19:50:49.708984] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T19:50:49.719155] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-28T19:50:49.837010] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:50:49.843157] [INFO ] [REMOTE ] MANU: Full fetch complete (39425 records). [2025-10-28T19:50:49.843281] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-28T19:50:50.259367] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-28T19:50:50.259538] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-28T19:50:50.260344] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-28T19:50:50.260405] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-28T19:50:50.261260] [DEBUG] [LOCAL ] MANU: Trimmed 39425 records to 26793 (keeping 200 days of data) [2025-10-28T19:50:50.414042] [DEBUG] [LOCAL ] MANU: Primary data saved (26793 records). [2025-10-28T19:50:50.414172] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-28T19:50:50.414251] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MANU took 46.6s. Estimated remaining: 2h 19m 20s. Rate: 7.6 symbols/min [2025-10-28T19:50:50.585298] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:50.625520] [DEBUG] [LOCAL ] MBC: Loaded 43734 existing records from primary storage. [2025-10-28T19:50:50.625801] [INFO ] [MAIN ] MBC: Loaded 43734 existing records. [2025-10-28T19:50:50.762238] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (19.91 seconds). [2025-10-28T19:50:50.787537] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-28T19:50:50.890313] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:50.908360] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-28T19:50:50.908696] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-28T19:50:50.910011] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-28T19:50:50.909968] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:50:50.910112] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-28T19:50:50.970851] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-28T19:50:51.268415] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:51.268752] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-28T19:50:51.871921] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:50:51.879196] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-28T19:50:52.329912] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:50:52.338472] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-28T19:50:52.731877] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:50:52.738829] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-28T19:50:53.559039] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:50:53.565574] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-28T19:50:54.428697] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T19:50:54.435837] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-28T19:50:57.449721] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (18.40 seconds). [2025-10-28T19:50:57.460915] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-28T19:50:58.177531] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (5.84 seconds). [2025-10-28T19:50:58.185802] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-28T19:50:58.840897] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T19:50:58.853590] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-28T19:51:00.292803] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T19:51:00.304219] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-28T19:51:00.718585] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (9.75 seconds). [2025-10-28T19:51:00.724738] [INFO ] [REMOTE ] MATV: Full fetch complete (51845 records). [2025-10-28T19:51:00.724888] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-28T19:51:01.112669] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-28T19:51:01.112753] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-28T19:51:01.113591] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-28T19:51:01.113632] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-28T19:51:01.114724] [DEBUG] [LOCAL ] MATV: Trimmed 51845 records to 34396 (keeping 200 days of data) [2025-10-28T19:51:01.313754] [DEBUG] [LOCAL ] MATV: Primary data saved (34396 records). [2025-10-28T19:51:01.313896] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-28T19:51:01.313974] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MATV took 49.0s. Estimated remaining: 2h 19m 15s. Rate: 7.6 symbols/min [2025-10-28T19:51:01.480729] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:01.502893] [DEBUG] [LOCAL ] MBI: Loaded 23562 existing records from primary storage. [2025-10-28T19:51:01.503135] [INFO ] [MAIN ] MBI: Loaded 23562 existing records. [2025-10-28T19:51:01.712183] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:01.712605] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-28T19:51:01.712730] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-28T19:51:01.712931] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-28T19:51:01.712995] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-28T19:51:01.958116] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T19:51:02.047360] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-28T19:51:02.147147] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:02.147798] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-28T19:51:02.943353] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:51:02.949086] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-28T19:51:03.621928] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (9.19 seconds). [2025-10-28T19:51:03.628781] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-28T19:51:03.940178] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:51:03.945593] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-28T19:51:05.009814] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T19:51:05.015916] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-28T19:51:06.001864] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T19:51:06.010045] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-28T19:51:06.779048] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T19:51:06.784559] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-28T19:51:07.583246] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T19:51:07.588332] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-28T19:51:08.261709] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:51:08.266774] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-28T19:51:09.001193] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (10.82 seconds). [2025-10-28T19:51:09.010745] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-28T19:51:09.694254] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T19:51:09.703377] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-28T19:51:10.548122] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T19:51:10.557475] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-28T19:51:11.620932] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:51:11.631712] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-28T19:51:12.595167] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:51:12.604143] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-28T19:51:13.501794] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:51:13.511486] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-28T19:51:14.671932] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T19:51:14.682255] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-28T19:51:14.921539] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (12.87 seconds). [2025-10-28T19:51:14.932984] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-28T19:51:14.958492] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (11.33 seconds). [2025-10-28T19:51:14.966338] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-28T19:51:15.796105] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T19:51:15.806545] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-28T19:51:20.056378] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (10.35 seconds). [2025-10-28T19:51:20.061637] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-28T19:51:20.883616] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T19:51:20.888237] [INFO ] [REMOTE ] MBI: Full fetch complete (35435 records). [2025-10-28T19:51:20.888316] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-28T19:51:21.259786] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-28T19:51:21.259865] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-28T19:51:21.260571] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-28T19:51:21.260612] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-28T19:51:21.261395] [DEBUG] [LOCAL ] MBI: Trimmed 35435 records to 23464 (keeping 200 days of data) [2025-10-28T19:51:21.384754] [DEBUG] [LOCAL ] MBI: Primary data saved (23464 records). [2025-10-28T19:51:21.384878] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-28T19:51:21.384954] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MBI took 20.1s. Estimated remaining: 2h 19m 17s. Rate: 7.6 symbols/min [2025-10-28T19:51:21.554956] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:21.593354] [DEBUG] [LOCAL ] MC: Loaded 43384 existing records from primary storage. [2025-10-28T19:51:21.593630] [INFO ] [MAIN ] MC: Loaded 43384 existing records. [2025-10-28T19:51:21.775847] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:21.776317] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-28T19:51:21.776399] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-28T19:51:21.776710] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-28T19:51:21.776771] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-28T19:51:22.135044] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:22.135376] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-28T19:51:23.065287] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (8.10 seconds). [2025-10-28T19:51:23.072024] [INFO ] [REMOTE ] MAX: Full fetch complete (45011 records). [2025-10-28T19:51:23.072157] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-28T19:51:23.447338] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-28T19:51:23.447427] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-28T19:51:23.448351] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-28T19:51:23.448437] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-28T19:51:23.449518] [DEBUG] [LOCAL ] MAX: Trimmed 45011 records to 30439 (keeping 200 days of data) [2025-10-28T19:51:23.635667] [DEBUG] [LOCAL ] MAX: Primary data saved (30439 records). [2025-10-28T19:51:23.635818] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-28T19:51:23.635904] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MAX took 55.6s. Estimated remaining: 2h 19m 4s. Rate: 7.6 symbols/min [2025-10-28T19:51:23.815107] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:23.827723] [DEBUG] [LOCAL ] MCB: Loaded 11290 existing records from primary storage. [2025-10-28T19:51:23.827937] [INFO ] [MAIN ] MCB: Loaded 11290 existing records. [2025-10-28T19:51:24.007935] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:24.008139] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-28T19:51:24.008186] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-28T19:51:24.008340] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-28T19:51:24.008378] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-28T19:51:24.364732] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:24.365034] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-28T19:51:24.967436] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T19:51:24.970526] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-28T19:51:25.475107] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T19:51:25.477545] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-28T19:51:26.010289] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:51:26.013563] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-28T19:51:26.675238] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T19:51:26.679237] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-28T19:51:27.298578] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T19:51:27.301698] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-28T19:51:27.788140] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T19:51:27.790969] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-28T19:51:28.489542] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T19:51:28.495200] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-28T19:51:28.949602] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T19:51:28.951991] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-28T19:51:29.493484] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T19:51:29.496501] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-28T19:51:30.320304] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T19:51:30.323615] [INFO ] [REMOTE ] MCB: Full fetch complete (16920 records). [2025-10-28T19:51:30.323743] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-28T19:51:30.692610] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-28T19:51:30.692730] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-28T19:51:30.693173] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-28T19:51:30.693239] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-28T19:51:30.694112] [DEBUG] [LOCAL ] MCB: Trimmed 16920 records to 11282 (keeping 200 days of data) [2025-10-28T19:51:30.767341] [DEBUG] [LOCAL ] MCB: Primary data saved (11282 records). [2025-10-28T19:51:30.767475] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-28T19:51:30.767552] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MCB took 7.1s. Estimated remaining: 2h 18m 56s. Rate: 7.6 symbols/min [2025-10-28T19:51:30.936813] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:30.936994] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-28T19:51:30.937031] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-28T19:51:30.937166] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-28T19:51:30.937226] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-28T19:51:30.937275] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-28T19:51:30.937309] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-28T19:51:31.293357] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:31.293692] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-28T19:51:31.967044] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (16.16 seconds). [2025-10-28T19:51:31.976261] [INFO ] [REMOTE ] MBC: Full fetch complete (63031 records). [2025-10-28T19:51:31.976381] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-28T19:51:32.416584] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-28T19:51:32.416741] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-28T19:51:32.417820] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-28T19:51:32.417885] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-28T19:51:32.419169] [DEBUG] [LOCAL ] MBC: Trimmed 63031 records to 43688 (keeping 200 days of data) [2025-10-28T19:51:32.668973] [DEBUG] [LOCAL ] MBC: Primary data saved (43688 records). [2025-10-28T19:51:32.669096] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-28T19:51:32.669405] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MBC took 42.3s. Estimated remaining: 2h 18m 43s. Rate: 7.6 symbols/min [2025-10-28T19:51:32.833930] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:32.842923] [DEBUG] [LOCAL ] MCI: Loaded 6120 existing records from primary storage. [2025-10-28T19:51:32.843195] [INFO ] [MAIN ] MCI: Loaded 6120 existing records. [2025-10-28T19:51:33.015862] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:33.016172] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-28T19:51:33.016221] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-28T19:51:33.016362] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-28T19:51:33.016400] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-28T19:51:33.362135] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:33.362437] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-28T19:51:33.628058] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (18.70 seconds). [2025-10-28T19:51:33.639580] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-28T19:51:33.939938] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T19:51:33.942086] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-28T19:51:34.466957] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T19:51:34.469572] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-28T19:51:35.066725] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T19:51:35.078945] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-28T19:51:37.376032] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-28T19:51:37.378216] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-28T19:51:37.808498] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T19:51:37.810570] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-28T19:51:38.322953] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:51:38.326085] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-28T19:51:38.865074] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T19:51:38.867334] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-28T19:51:40.574191] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (18.44 seconds). [2025-10-28T19:51:40.581846] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-28T19:51:41.545239] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:51:41.553851] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-28T19:51:42.892626] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:51:42.906090] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-28T19:51:44.105861] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:51:44.116205] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-28T19:51:45.103471] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T19:51:45.112984] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-28T19:51:46.549278] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T19:51:46.558746] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-28T19:51:47.867912] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:51:47.877632] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-28T19:51:47.977176] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (12.90 seconds). [2025-10-28T19:51:47.987435] [INFO ] [REMOTE ] MAS: Full fetch complete (75425 records). [2025-10-28T19:51:47.987579] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-28T19:51:48.382568] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-28T19:51:48.382779] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-28T19:51:48.383947] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-28T19:51:48.384014] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-28T19:51:48.385433] [DEBUG] [LOCAL ] MAS: Trimmed 75425 records to 52159 (keeping 200 days of data) [2025-10-28T19:51:48.699893] [DEBUG] [LOCAL ] MAS: Primary data saved (52159 records). [2025-10-28T19:51:48.700087] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-28T19:51:48.700185] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MAS took 1m 43s. Estimated remaining: 2h 18m 42s. Rate: 7.6 symbols/min [2025-10-28T19:51:48.871544] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:48.906358] [DEBUG] [LOCAL ] MCK: Loaded 37561 existing records from primary storage. [2025-10-28T19:51:48.906785] [INFO ] [MAIN ] MCK: Loaded 37561 existing records. [2025-10-28T19:51:49.102753] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:49.115492] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-28T19:51:49.115631] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-28T19:51:49.115937] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-28T19:51:49.116438] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-28T19:51:49.118064] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T19:51:49.229345] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-28T19:51:49.489536] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (10.62 seconds). [2025-10-28T19:51:49.489048] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:49.491935] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-28T19:51:49.493151] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-28T19:51:49.925186] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T19:51:49.930781] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-28T19:51:50.276505] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:51:50.285174] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-28T19:51:50.471125] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T19:51:50.479318] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-28T19:51:51.631992] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:51:51.640812] [INFO ] [REMOTE ] MC: Full fetch complete (63124 records). [2025-10-28T19:51:51.640933] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-28T19:51:51.803172] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (20.51 seconds). [2025-10-28T19:51:51.847012] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-28T19:51:51.982537] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-28T19:51:51.984317] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T19:51:52.011115] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-28T19:51:52.047848] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-28T19:51:52.157746] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-28T19:51:52.157842] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-28T19:51:52.158955] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-28T19:51:52.159019] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-28T19:51:52.160245] [DEBUG] [LOCAL ] MC: Trimmed 63124 records to 43337 (keeping 200 days of data) [2025-10-28T19:51:52.415308] [DEBUG] [LOCAL ] MC: Primary data saved (43337 records). [2025-10-28T19:51:52.415430] [INFO ] [MAIN ] MC: Full history saved. [2025-10-28T19:51:52.415526] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MC took 31.0s. Estimated remaining: 2h 18m 30s. Rate: 7.6 symbols/min [2025-10-28T19:51:52.586038] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:52.595526] [DEBUG] [LOCAL ] MCN: Loaded 7854 existing records from primary storage. [2025-10-28T19:51:52.595819] [INFO ] [MAIN ] MCN: Loaded 7854 existing records. [2025-10-28T19:51:52.702847] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T19:51:52.720426] [INFO ] [REMOTE ] MCI: Full fetch complete (9770 records). [2025-10-28T19:51:52.730782] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-28T19:51:52.867437] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:52.889279] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-28T19:51:52.889423] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-28T19:51:52.889759] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-28T19:51:52.900259] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-28T19:51:53.442180] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-28T19:51:53.488256] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-28T19:51:53.507220] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-28T19:51:53.510439] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:53.510828] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-28T19:51:53.511259] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-28T19:51:53.512597] [DEBUG] [LOCAL ] MCI: Trimmed 9770 records to 6116 (keeping 200 days of data) [2025-10-28T19:51:53.551996] [DEBUG] [LOCAL ] MCI: Primary data saved (6116 records). [2025-10-28T19:51:53.552729] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-28T19:51:53.566040] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCI took 20.9s. Estimated remaining: 2h 18m 17s. Rate: 7.6 symbols/min [2025-10-28T19:51:53.607877] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T19:51:53.688399] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-28T19:51:53.760135] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:53.789068] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T19:51:53.799839] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-28T19:51:53.836919] [DEBUG] [LOCAL ] MCO: Loaded 39288 existing records from primary storage. [2025-10-28T19:51:53.837182] [INFO ] [MAIN ] MCO: Loaded 39288 existing records. [2025-10-28T19:51:53.974315] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T19:51:54.015550] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-28T19:51:54.036867] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:54.037749] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-28T19:51:54.037824] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-28T19:51:54.038018] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-28T19:51:54.038061] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-28T19:51:54.410033] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:54.410391] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-28T19:51:54.546417] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:51:54.548780] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-28T19:51:55.008849] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-28T19:51:55.011183] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-28T19:51:55.347477] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T19:51:55.354704] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-28T19:51:55.518738] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T19:51:55.520302] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T19:51:55.523177] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-28T19:51:55.534903] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-28T19:51:56.036235] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:51:56.039636] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-28T19:51:56.340373] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:51:56.353730] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-28T19:51:57.615076] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:51:57.624805] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-28T19:51:58.890783] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T19:51:58.900591] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-28T19:52:00.021027] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:52:00.029020] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-28T19:52:01.098733] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:52:01.106381] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-28T19:52:05.799368] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (12.11 seconds). [2025-10-28T19:52:05.808940] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-28T19:52:07.038389] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:52:07.047494] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-28T19:52:08.080269] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:52:08.088103] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-28T19:52:08.516947] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (12.48 seconds). [2025-10-28T19:52:08.519448] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-28T19:52:08.997692] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:52:09.000106] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-28T19:52:09.282532] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:52:09.290805] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-28T19:52:09.505459] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T19:52:09.507670] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-28T19:52:10.030699] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T19:52:10.033083] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-28T19:52:10.309481] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T19:52:10.318340] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-28T19:52:10.661153] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:52:10.662992] [INFO ] [REMOTE ] MCN: Full fetch complete (11533 records). [2025-10-28T19:52:10.663057] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-28T19:52:11.022770] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-28T19:52:11.022863] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-28T19:52:11.023174] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-28T19:52:11.023233] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-28T19:52:11.023704] [DEBUG] [LOCAL ] MCN: Trimmed 11533 records to 7839 (keeping 200 days of data) [2025-10-28T19:52:11.067387] [DEBUG] [LOCAL ] MCN: Primary data saved (7839 records). [2025-10-28T19:52:11.067503] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-28T19:52:11.067582] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCN took 18.7s. Estimated remaining: 2h 18m 17s. Rate: 7.6 symbols/min [2025-10-28T19:52:11.235475] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:11.245595] [DEBUG] [LOCAL ] MCR: Loaded 8810 existing records from primary storage. [2025-10-28T19:52:11.245815] [INFO ] [MAIN ] MCR: Loaded 8810 existing records. [2025-10-28T19:52:11.430756] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:11.431054] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-28T19:52:11.431158] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-28T19:52:11.431434] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-28T19:52:11.431509] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-28T19:52:11.624245] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:52:11.727906] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-28T19:52:11.840151] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:11.840926] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-28T19:52:12.500886] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T19:52:12.504948] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-28T19:52:12.954038] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T19:52:12.956304] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-28T19:52:13.491728] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:52:13.494432] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-28T19:52:14.041345] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T19:52:14.044194] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-28T19:52:16.741393] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-28T19:52:16.744048] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-28T19:52:17.186085] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T19:52:17.188469] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-28T19:52:17.661225] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:52:17.663455] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-28T19:52:18.247309] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:52:18.250575] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-28T19:52:18.675124] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T19:52:18.677617] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-28T19:52:19.462134] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T19:52:19.465213] [INFO ] [REMOTE ] MCR: Full fetch complete (13452 records). [2025-10-28T19:52:19.465300] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-28T19:52:19.884031] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-28T19:52:19.884138] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-28T19:52:19.884726] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-28T19:52:19.884791] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-28T19:52:19.885377] [DEBUG] [LOCAL ] MCR: Trimmed 13452 records to 8864 (keeping 200 days of data) [2025-10-28T19:52:19.943602] [DEBUG] [LOCAL ] MCR: Primary data saved (8864 records). [2025-10-28T19:52:19.943822] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-28T19:52:19.943935] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCR took 8.9s. Estimated remaining: 2h 18m 10s. Rate: 7.6 symbols/min [2025-10-28T19:52:20.127799] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:20.151803] [DEBUG] [LOCAL ] MCS: Loaded 21024 existing records from primary storage. [2025-10-28T19:52:20.152155] [INFO ] [MAIN ] MCS: Loaded 21024 existing records. [2025-10-28T19:52:20.343697] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:20.343994] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-28T19:52:20.344047] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-28T19:52:20.344328] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-28T19:52:20.344389] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-28T19:52:20.806467] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:20.806912] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-28T19:52:21.469955] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T19:52:21.474883] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-28T19:52:22.219029] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (26.68 seconds). [2025-10-28T19:52:22.232182] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T19:52:22.238557] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-28T19:52:22.239069] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-28T19:52:23.068450] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T19:52:23.074006] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-28T19:52:23.765739] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T19:52:23.777187] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-28T19:52:25.341266] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T19:52:25.352484] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-28T19:52:27.051454] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T19:52:27.063212] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-28T19:52:28.606397] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:52:28.617832] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-28T19:52:30.094376] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T19:52:30.105381] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-28T19:52:30.668957] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T19:52:30.679877] [INFO ] [REMOTE ] MCD: Full fetch complete (77113 records). [2025-10-28T19:52:30.680018] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-28T19:52:30.870224] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T19:52:30.871146] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:52:30.871228] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:52:30.871319] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-28T19:52:30.871409] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-28T19:52:30.871459] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-28T19:52:30.871502] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-28T19:52:30.871562] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCD took 1m 0s. Estimated remaining: 2h 18m 5s. Rate: 7.6 symbols/min [2025-10-28T19:52:31.038298] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:31.038490] [DEBUG] [LOCAL ] MCY: No existing data file found in primary storage. [2025-10-28T19:52:31.038526] [WARN ] [MAIN ] MCY: No existing data found, performing full refresh instead. [2025-10-28T19:52:31.038633] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-28T19:52:31.038710] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-28T19:52:31.038758] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-10-28T19:52:31.038790] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-28T19:52:31.430273] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:31.430612] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-28T19:52:32.611625] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:52:32.620371] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-28T19:52:33.427680] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (32.32 seconds). [2025-10-28T19:52:33.436376] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-28T19:52:33.636902] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:52:33.644524] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-28T19:52:34.464786] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T19:52:34.472715] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-28T19:52:34.751741] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:52:34.759716] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-28T19:52:35.544130] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:52:35.553141] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-28T19:52:37.085526] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T19:52:37.094606] [INFO ] [REMOTE ] MCO: Full fetch complete (58424 records). [2025-10-28T19:52:37.094761] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-28T19:52:37.481283] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-28T19:52:37.481363] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-28T19:52:37.482342] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-28T19:52:37.482406] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-28T19:52:37.483664] [DEBUG] [LOCAL ] MCO: Trimmed 58424 records to 39204 (keeping 200 days of data) [2025-10-28T19:52:37.730791] [DEBUG] [LOCAL ] MCO: Primary data saved (39204 records). [2025-10-28T19:52:37.730920] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-28T19:52:37.731253] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCO took 44.2s. Estimated remaining: 2h 17m 56s. Rate: 7.6 symbols/min [2025-10-28T19:52:37.901628] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:37.939573] [DEBUG] [LOCAL ] MD: Loaded 38402 existing records from primary storage. [2025-10-28T19:52:37.939868] [INFO ] [MAIN ] MD: Loaded 38402 existing records. [2025-10-28T19:52:38.122576] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:38.139690] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-28T19:52:38.139946] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-28T19:52:38.140495] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-28T19:52:38.141092] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (26.41 seconds). [2025-10-28T19:52:38.141200] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-28T19:52:38.194972] [INFO ] [REMOTE ] MCK: Full fetch complete (56349 records). [2025-10-28T19:52:38.221396] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-28T19:52:38.827554] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:38.838189] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-28T19:52:38.935793] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-28T19:52:38.935907] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-28T19:52:38.937252] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-28T19:52:38.937324] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-28T19:52:38.938820] [DEBUG] [LOCAL ] MCK: Trimmed 56349 records to 37402 (keeping 200 days of data) [2025-10-28T19:52:39.232269] [DEBUG] [LOCAL ] MCK: Primary data saved (37402 records). [2025-10-28T19:52:39.232433] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-28T19:52:39.233432] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCK took 50.5s. Estimated remaining: 2h 17m 43s. Rate: 7.6 symbols/min [2025-10-28T19:52:39.413777] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:39.423119] [DEBUG] [LOCAL ] MDST: Loaded 6157 existing records from primary storage. [2025-10-28T19:52:39.423324] [INFO ] [MAIN ] MDST: Loaded 6157 existing records. [2025-10-28T19:52:39.604387] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:39.604630] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-28T19:52:39.604724] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-28T19:52:39.604897] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-28T19:52:39.604953] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-28T19:52:39.970358] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:39.987242] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-28T19:52:39.991613] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:52:39.999159] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-28T19:52:40.586893] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T19:52:40.589692] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-28T19:52:40.718142] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T19:52:40.725206] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-28T19:52:41.004769] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:52:41.006850] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-28T19:52:41.066191] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (17.99 seconds). [2025-10-28T19:52:41.071586] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-28T19:52:41.670190] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:52:41.680949] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-28T19:52:45.489094] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (10.73 seconds). [2025-10-28T19:52:45.495307] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-28T19:52:46.420794] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:52:46.427027] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-28T19:52:46.661616] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (5.65 seconds). [2025-10-28T19:52:46.663495] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-28T19:52:47.008112] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T19:52:47.009709] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-28T19:52:47.134310] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T19:52:47.139328] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-28T19:52:48.878301] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (7.81 seconds). [2025-10-28T19:52:48.882888] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-28T19:52:49.503537] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T19:52:49.507911] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-28T19:52:50.268277] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T19:52:50.273621] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-28T19:52:51.029801] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T19:52:51.035345] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-28T19:52:51.294152] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (9.61 seconds). [2025-10-28T19:52:51.302005] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-28T19:52:51.504568] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (4.49 seconds). [2025-10-28T19:52:51.506360] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-28T19:52:51.784745] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:52:51.790305] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-28T19:52:52.642902] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T19:52:52.644584] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-28T19:52:52.977805] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:52:52.982783] [INFO ] [REMOTE ] MCS: Full fetch complete (30710 records). [2025-10-28T19:52:52.982898] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-28T19:52:53.252485] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:52:53.277861] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-28T19:52:53.374917] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-28T19:52:53.375000] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-28T19:52:53.375632] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-28T19:52:53.375709] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-28T19:52:53.376504] [DEBUG] [LOCAL ] MCS: Trimmed 30710 records to 21032 (keeping 200 days of data) [2025-10-28T19:52:53.523542] [DEBUG] [LOCAL ] MCS: Primary data saved (21032 records). [2025-10-28T19:52:53.517291] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (6.38 seconds). [2025-10-28T19:52:53.523937] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-28T19:52:53.529711] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MCS took 33.6s. Estimated remaining: 2h 17m 40s. Rate: 7.6 symbols/min [2025-10-28T19:52:53.531174] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-28T19:52:53.841611] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:52:53.843906] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-28T19:52:54.259877] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T19:52:54.262296] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-28T19:52:54.501496] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T19:52:54.506900] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-28T19:52:54.836062] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T19:52:54.840255] [INFO ] [REMOTE ] MDST: Full fetch complete (8964 records). [2025-10-28T19:52:54.840538] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-28T19:52:55.247000] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-28T19:52:55.247126] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-28T19:52:55.247550] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-28T19:52:55.247594] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-28T19:52:55.248219] [DEBUG] [LOCAL ] MDST: Trimmed 8964 records to 6210 (keeping 200 days of data) [2025-10-28T19:52:55.290542] [DEBUG] [LOCAL ] MDST: Primary data saved (6210 records). [2025-10-28T19:52:55.290730] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-28T19:52:55.290844] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 16.1s. Estimated remaining: 2h 17m 27s. Rate: 7.6 symbols/min [2025-10-28T19:52:56.922791] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (5.62 seconds). [2025-10-28T19:52:56.931795] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-28T19:52:57.889615] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:52:57.897305] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-28T19:52:58.201453] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (3.69 seconds). [2025-10-28T19:52:58.208390] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-28T19:52:59.021710] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:52:59.030721] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-28T19:52:59.056083] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:52:59.062381] [INFO ] [REMOTE ] MCY: Full fetch complete (40147 records). [2025-10-28T19:52:59.062534] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-28T19:52:59.438349] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-28T19:52:59.438430] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-28T19:52:59.439223] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-28T19:52:59.439285] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-28T19:52:59.440249] [DEBUG] [LOCAL ] MCY: Trimmed 40147 records to 22925 (keeping 200 days of data) [2025-10-28T19:52:59.577402] [DEBUG] [LOCAL ] MCY: Primary data saved (22925 records). [2025-10-28T19:52:59.577525] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-28T19:52:59.577596] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MCY took 28.7s. Estimated remaining: 2h 17m 17s. Rate: 7.6 symbols/min [2025-10-28T19:53:00.150236] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:53:00.159578] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-28T19:53:01.268924] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T19:53:01.276781] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-28T19:53:04.155196] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-28T19:53:04.163104] [INFO ] [REMOTE ] MD: Full fetch complete (55405 records). [2025-10-28T19:53:04.163224] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-28T19:53:04.557781] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-28T19:53:04.557860] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-28T19:53:04.558861] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-28T19:53:04.558944] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-28T19:53:04.560030] [DEBUG] [LOCAL ] MD: Trimmed 55405 records to 38397 (keeping 200 days of data) [2025-10-28T19:53:04.775470] [DEBUG] [LOCAL ] MD: Primary data saved (38397 records). [2025-10-28T19:53:04.775593] [INFO ] [MAIN ] MD: Full history saved. [2025-10-28T19:53:04.775935] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MD took 27.0s. Estimated remaining: 2h 17m 7s. Rate: 7.6 symbols/min [2025-10-28T19:53:05.309805] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.425262] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.457266] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.506683] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.522418] [DEBUG] [LOCAL ] MDV: Loaded 8221 existing records from primary storage. [2025-10-28T19:53:05.522808] [INFO ] [MAIN ] MDV: Loaded 8221 existing records. [2025-10-28T19:53:05.642787] [DEBUG] [LOCAL ] MEC: Loaded 16889 existing records from primary storage. [2025-10-28T19:53:05.652631] [INFO ] [MAIN ] MEC: Loaded 16889 existing records. [2025-10-28T19:53:05.834289] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:05.863809] [DEBUG] [LOCAL ] MDU: Loaded 47956 existing records from primary storage. [2025-10-28T19:53:05.881993] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-28T19:53:05.882217] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-28T19:53:05.882509] [INFO ] [MAIN ] MDU: Loaded 47956 existing records. [2025-10-28T19:53:05.883278] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-28T19:53:05.894503] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-28T19:53:05.939726] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-28T19:53:05.984341] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-28T19:53:06.213840] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:06.339739] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-28T19:53:06.425764] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-28T19:53:06.421546] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:06.428686] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:06.434508] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-28T19:53:06.434556] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-28T19:53:06.444801] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-28T19:53:06.478149] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-28T19:53:06.468146] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-28T19:53:06.504558] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-28T19:53:06.567417] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-28T19:53:06.567555] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-28T19:53:06.572706] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-28T19:53:06.604495] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-28T19:53:07.192228] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.269191] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-28T19:53:07.619789] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.639677] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-28T19:53:07.787360] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.783585] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.787797] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-28T19:53:07.788193] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-28T19:53:08.318459] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:53:08.321769] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-28T19:53:08.388010] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:53:08.389733] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-28T19:53:08.756801] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T19:53:08.767272] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-28T19:53:08.848163] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:53:08.851295] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-28T19:53:08.868634] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:53:08.870733] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-28T19:53:09.078858] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:53:09.089624] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-28T19:53:09.570684] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T19:53:09.575713] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-28T19:53:09.930459] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:53:09.940371] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-28T19:53:10.034066] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:53:10.036747] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-28T19:53:10.410866] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T19:53:10.421163] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-28T19:53:10.570312] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T19:53:10.572967] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-28T19:53:10.910575] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:53:10.915113] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-28T19:53:11.048177] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T19:53:11.050901] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-28T19:53:11.180794] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:53:11.191450] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-28T19:53:11.532829] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:53:11.536859] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-28T19:53:11.889436] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T19:53:11.900809] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-28T19:53:12.009249] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:53:12.013087] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-28T19:53:12.449451] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:53:12.459627] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-28T19:53:12.869708] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-28T19:53:12.873765] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-28T19:53:13.366300] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T19:53:13.377420] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-28T19:53:13.417169] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:53:13.419666] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-28T19:53:13.569738] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:53:13.573889] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-28T19:53:13.741252] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:53:13.751813] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-28T19:53:13.815872] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T19:53:13.818134] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-28T19:53:14.167247] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T19:53:14.170984] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-28T19:53:14.308088] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T19:53:14.310001] [INFO ] [REMOTE ] MDV: Full fetch complete (11724 records). [2025-10-28T19:53:14.310068] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-28T19:53:14.671559] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-28T19:53:14.671902] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-28T19:53:14.672338] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-28T19:53:14.672411] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-28T19:53:14.673034] [DEBUG] [LOCAL ] MDV: Trimmed 11724 records to 8222 (keeping 200 days of data) [2025-10-28T19:53:14.734182] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:53:14.740475] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-28T19:53:14.743817] [DEBUG] [LOCAL ] MDV: Primary data saved (8222 records). [2025-10-28T19:53:14.744062] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-28T19:53:14.744215] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MDV took 10.0s. Estimated remaining: 2h 17m 1s. Rate: 7.6 symbols/min [2025-10-28T19:53:14.910163] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T19:53:14.969527] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:14.970462] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-28T19:53:14.990292] [DEBUG] [LOCAL ] MED: Loaded 20766 existing records from primary storage. [2025-10-28T19:53:14.990724] [INFO ] [MAIN ] MED: Loaded 20766 existing records. [2025-10-28T19:53:15.196501] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:15.196801] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-28T19:53:15.196867] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-28T19:53:15.197072] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-28T19:53:15.197127] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-28T19:53:15.491459] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:53:15.534351] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-28T19:53:15.574364] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:15.574598] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-28T19:53:16.306544] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T19:53:16.311780] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-28T19:53:16.372230] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:53:16.376461] [INFO ] [REMOTE ] MEC: Full fetch complete (23148 records). [2025-10-28T19:53:16.376552] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-28T19:53:16.734781] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-28T19:53:16.734853] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-28T19:53:16.735330] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-28T19:53:16.735368] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-28T19:53:16.735994] [DEBUG] [LOCAL ] MEC: Trimmed 23148 records to 16939 (keeping 200 days of data) [2025-10-28T19:53:16.831888] [DEBUG] [LOCAL ] MEC: Primary data saved (16939 records). [2025-10-28T19:53:16.832018] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-28T19:53:16.832094] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols completed. MEC took 12.0s. Estimated remaining: 2h 16m 48s. Rate: 7.6 symbols/min [2025-10-28T19:53:17.001665] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:17.031232] [DEBUG] [LOCAL ] MEG: Loaded 31233 existing records from primary storage. [2025-10-28T19:53:17.031472] [INFO ] [MAIN ] MEG: Loaded 31233 existing records. [2025-10-28T19:53:17.209802] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:17.210115] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-28T19:53:17.215345] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-28T19:53:17.223185] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-28T19:53:17.223720] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-28T19:53:17.223635] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T19:53:17.292421] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-28T19:53:17.576021] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:17.576294] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-28T19:53:18.070033] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:53:18.075291] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-28T19:53:18.110200] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (4.36 seconds). [2025-10-28T19:53:18.119909] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-28T19:53:18.571822] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:53:18.579201] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-28T19:53:18.917265] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T19:53:18.923435] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-28T19:53:19.282905] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T19:53:19.293173] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-28T19:53:19.467455] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:53:19.473598] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-28T19:53:19.651569] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T19:53:19.656773] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-28T19:53:20.377136] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:53:20.382666] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-28T19:53:20.413982] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:53:20.426090] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-28T19:53:20.447436] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T19:53:20.455498] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-28T19:53:21.151848] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:53:21.157210] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-28T19:53:21.426838] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T19:53:21.434337] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-28T19:53:21.824334] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:53:21.829088] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-28T19:53:21.921504] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T19:53:21.932089] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-28T19:53:22.342425] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T19:53:22.365333] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-28T19:53:22.367918] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (7.40 seconds). [2025-10-28T19:53:22.378502] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-28T19:53:23.327997] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:53:23.334763] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-28T19:53:23.406392] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T19:53:23.416865] [INFO ] [REMOTE ] MDU: Full fetch complete (70733 records). [2025-10-28T19:53:23.417021] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-28T19:53:23.807446] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-28T19:53:23.807550] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-28T19:53:23.808639] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-28T19:53:23.808923] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-28T19:53:23.810345] [DEBUG] [LOCAL ] MDU: Trimmed 70733 records to 47933 (keeping 200 days of data) [2025-10-28T19:53:23.972269] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T19:53:24.075630] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-28T19:53:24.163880] [DEBUG] [LOCAL ] MDU: Primary data saved (47933 records). [2025-10-28T19:53:24.164016] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-28T19:53:24.164098] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols completed. MDU took 19.4s. Estimated remaining: 2h 16m 40s. Rate: 7.6 symbols/min [2025-10-28T19:53:24.335203] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:53:24.366435] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:24.369482] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-28T19:53:24.369996] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-28T19:53:24.376622] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-28T19:53:24.395085] [DEBUG] [LOCAL ] MEGI: Loaded 19596 existing records from primary storage. [2025-10-28T19:53:24.395321] [INFO ] [MAIN ] MEGI: Loaded 19596 existing records. [2025-10-28T19:53:24.574918] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:24.575155] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-28T19:53:24.575204] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-28T19:53:24.575372] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-28T19:53:24.575409] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-28T19:53:24.918581] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:24.919047] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-28T19:53:25.245458] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T19:53:25.519731] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:53:25.580244] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-28T19:53:25.634165] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:53:26.358897] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T19:53:26.363012] [INFO ] [REMOTE ] MED: Full fetch complete (31712 records). [2025-10-28T19:53:26.363094] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-28T19:53:26.385384] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-28T19:53:26.754040] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-28T19:53:26.754163] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-28T19:53:26.754938] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-28T19:53:26.755016] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-28T19:53:26.786800] [DEBUG] [LOCAL ] MED: Trimmed 31712 records to 20631 (keeping 200 days of data) [2025-10-28T19:53:26.789610] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:53:26.936391] [DEBUG] [LOCAL ] MED: Primary data saved (20631 records). [2025-10-28T19:53:26.936524] [INFO ] [MAIN ] MED: Full history saved. [2025-10-28T19:53:26.936603] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols completed. MED took 12.2s. Estimated remaining: 2h 16m 28s. Rate: 7.6 symbols/min [2025-10-28T19:53:27.105760] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:27.136913] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T19:53:27.153581] [DEBUG] [LOCAL ] MEI: Loaded 31111 existing records from primary storage. [2025-10-28T19:53:27.153911] [INFO ] [MAIN ] MEI: Loaded 31111 existing records. [2025-10-28T19:53:27.185460] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-28T19:53:27.329959] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:27.330167] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-28T19:53:27.330216] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-28T19:53:27.330412] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-28T19:53:27.330480] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-28T19:53:27.689759] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:27.980314] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-28T19:53:28.780295] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-28T19:53:29.043778] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:53:29.051027] [INFO ] [REMOTE ] MEG: Full fetch complete (47089 records). [2025-10-28T19:53:29.051172] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-28T19:53:29.425874] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-28T19:53:29.426133] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-28T19:53:29.427041] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-28T19:53:29.427119] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-28T19:53:29.428774] [DEBUG] [LOCAL ] MEG: Trimmed 47089 records to 31110 (keeping 200 days of data) [2025-10-28T19:53:29.592364] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-28T19:53:29.628480] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:53:29.631457] [DEBUG] [LOCAL ] MEG: Primary data saved (31110 records). [2025-10-28T19:53:29.636461] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-28T19:53:29.637175] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols completed. MEG took 12.8s. Estimated remaining: 2h 16m 16s. Rate: 7.6 symbols/min [2025-10-28T19:53:29.818040] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:29.867750] [DEBUG] [LOCAL ] MET: Loaded 53279 existing records from primary storage. [2025-10-28T19:53:29.868119] [INFO ] [MAIN ] MET: Loaded 53279 existing records. [2025-10-28T19:53:30.060411] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:30.060700] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-28T19:53:30.060761] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-28T19:53:30.061044] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-28T19:53:30.061102] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-28T19:53:30.391252] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-28T19:53:30.422867] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:30.596619] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:53:31.102392] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T19:53:31.180240] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-28T19:53:31.797423] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T19:53:31.980313] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-28T19:53:32.778878] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:53:32.783988] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-28T19:53:32.869289] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (5.68 seconds). [2025-10-28T19:53:33.580274] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-28T19:53:34.080400] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:53:34.380321] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-28T19:53:34.531245] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T19:53:35.180332] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-28T19:53:35.646712] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:53:35.980322] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-28T19:53:36.780377] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-28T19:53:37.501511] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T19:53:37.580232] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-28T19:53:37.810572] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:53:38.380226] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-28T19:53:39.180360] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-28T19:53:39.238144] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T19:53:39.688580] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (4.51 seconds). [2025-10-28T19:53:39.700370] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-28T19:53:39.700516] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-28T19:53:39.883501] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:53:39.987048] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-28T19:53:40.139152] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-28T19:53:40.139239] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-28T19:53:40.140546] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-28T19:53:40.140613] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-28T19:53:40.142212] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-28T19:53:40.497253] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-28T19:53:40.497439] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-28T19:53:40.497542] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols completed. MDT took 35.7s. Estimated remaining: 2h 16m 11s. Rate: 7.6 symbols/min [2025-10-28T19:53:40.674244] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:40.713816] [DEBUG] [LOCAL ] MFA: Loaded 45266 existing records from primary storage. [2025-10-28T19:53:40.714364] [INFO ] [MAIN ] MFA: Loaded 45266 existing records. [2025-10-28T19:53:40.789613] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-28T19:53:40.914036] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:40.931855] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-28T19:53:40.931965] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-28T19:53:40.932448] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-28T19:53:40.932538] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-28T19:53:40.969051] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:53:41.311173] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:41.580235] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-28T19:53:41.628404] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T19:53:42.319718] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T19:53:42.380249] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-28T19:53:43.069108] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:53:43.180250] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-28T19:53:43.606079] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (6.03 seconds). [2025-10-28T19:53:43.980484] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-28T19:53:44.211896] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:53:44.780301] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-28T19:53:45.370305] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:53:45.580365] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-28T19:53:45.696950] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:53:46.380279] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-28T19:53:47.180267] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-28T19:53:47.254541] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T19:53:47.416297] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T19:53:47.420838] [INFO ] [REMOTE ] MEGI: Full fetch complete (28906 records). [2025-10-28T19:53:47.421068] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-28T19:53:47.806805] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-28T19:53:47.806883] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-28T19:53:47.807502] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-28T19:53:47.807546] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-28T19:53:47.808277] [DEBUG] [LOCAL ] MEGI: Trimmed 28906 records to 19566 (keeping 200 days of data) [2025-10-28T19:53:47.927079] [DEBUG] [LOCAL ] MEGI: Primary data saved (19566 records). [2025-10-28T19:53:47.927217] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-28T19:53:47.927294] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols completed. MEGI took 23.8s. Estimated remaining: 2h 16m 2s. Rate: 7.6 symbols/min [2025-10-28T19:53:47.990777] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-28T19:53:48.099742] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:48.106929] [DEBUG] [LOCAL ] MFAN: Loaded 4192 existing records from primary storage. [2025-10-28T19:53:48.107138] [INFO ] [MAIN ] MFAN: Loaded 4192 existing records. [2025-10-28T19:53:48.286076] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:48.286367] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-28T19:53:48.286531] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-28T19:53:48.286718] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-28T19:53:48.286774] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-28T19:53:48.646504] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:48.677920] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T19:53:48.780246] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-28T19:53:49.082171] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:53:49.580287] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-28T19:53:50.250089] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:53:50.380239] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-28T19:53:50.699207] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:53:51.180254] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-28T19:53:51.830027] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T19:53:51.980257] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-28T19:53:52.072789] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:53:52.780260] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-28T19:53:53.292058] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:53:53.580260] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-28T19:53:53.873457] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:53:54.061104] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:53:54.380277] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-28T19:53:54.721040] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T19:53:55.180288] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-28T19:53:55.549452] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:53:55.980296] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-28T19:53:56.780350] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-28T19:53:57.153590] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T19:53:57.158196] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:53:57.580262] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-28T19:53:58.380369] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-28T19:53:58.729288] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T19:53:58.755760] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:53:59.180282] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-28T19:53:59.980329] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-28T19:54:00.428878] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:54:00.780234] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-28T19:54:01.027505] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:54:01.150436] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-28T19:54:01.580294] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-28T19:54:01.999856] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T19:54:02.380299] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-28T19:54:02.915259] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:54:03.180255] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-28T19:54:03.980236] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-28T19:54:04.780223] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-28T19:54:04.953220] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:54:04.959363] [INFO ] [REMOTE ] MEI: Full fetch complete (45303 records). [2025-10-28T19:54:04.959452] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-28T19:54:05.357854] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:54:05.371017] [INFO ] [REMOTE ] MFAN: Full fetch complete (5924 records). [2025-10-28T19:54:05.370940] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-28T19:54:05.371130] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-28T19:54:05.371195] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-28T19:54:05.387461] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-28T19:54:05.404183] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-28T19:54:05.478094] [DEBUG] [LOCAL ] MEI: Trimmed 45303 records to 30990 (keeping 200 days of data) [2025-10-28T19:54:05.581532] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-28T19:54:05.861422] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-28T19:54:05.861508] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-28T19:54:05.861726] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-28T19:54:05.861787] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-28T19:54:05.862374] [DEBUG] [LOCAL ] MFAN: Trimmed 5924 records to 4177 (keeping 200 days of data) [2025-10-28T19:54:05.942754] [DEBUG] [LOCAL ] MEI: Primary data saved (30990 records). [2025-10-28T19:54:05.943804] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-28T19:54:05.944145] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols completed. MEI took 39.0s. Estimated remaining: 2h 16m 2s. Rate: 7.6 symbols/min [2025-10-28T19:54:06.027685] [DEBUG] [LOCAL ] MFAN: Primary data saved (4177 records). [2025-10-28T19:54:06.046458] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-28T19:54:06.046591] [INFO ] [MAIN ] Update Progress: 1329/2366 symbols completed. MFAN took 18.1s. Estimated remaining: 2h 15m 49s. Rate: 7.6 symbols/min [2025-10-28T19:54:06.223607] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:06.298751] [DEBUG] [LOCAL ] MFAO: Loaded 3768 existing records from primary storage. [2025-10-28T19:54:06.300342] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:06.300699] [INFO ] [MAIN ] MFAO: Loaded 3768 existing records. [2025-10-28T19:54:06.544627] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:06.545152] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-28T19:54:06.545243] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-28T19:54:06.545392] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-28T19:54:06.545451] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-28T19:54:06.717495] [DEBUG] [LOCAL ] MFC: Loaded 50900 existing records from primary storage. [2025-10-28T19:54:06.733714] [INFO ] [MAIN ] MFC: Loaded 50900 existing records. [2025-10-28T19:54:07.141319] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:07.165872] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:07.166545] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-28T19:54:07.166678] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-28T19:54:07.166761] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-28T19:54:07.168248] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-28T19:54:07.168319] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-28T19:54:07.556607] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:07.563421] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T19:54:07.563247] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-28T19:54:07.562981] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T19:54:07.577366] [INFO ] [REMOTE ] MET: Full fetch complete (77353 records). [2025-10-28T19:54:07.577474] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-28T19:54:07.962708] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-28T19:54:07.962791] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-28T19:54:07.963882] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-28T19:54:07.963943] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-28T19:54:07.965317] [DEBUG] [LOCAL ] MET: Trimmed 77353 records to 53277 (keeping 200 days of data) [2025-10-28T19:54:08.018627] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-28T19:54:08.287569] [DEBUG] [LOCAL ] MET: Primary data saved (53277 records). [2025-10-28T19:54:08.287746] [INFO ] [MAIN ] MET: Full history saved. [2025-10-28T19:54:08.288199] [INFO ] [MAIN ] Update Progress: 1330/2366 symbols completed. MET took 38.7s. Estimated remaining: 2h 15m 36s. Rate: 7.6 symbols/min [2025-10-28T19:54:08.424491] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (5.24 seconds). [2025-10-28T19:54:08.447101] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T19:54:08.508852] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:08.551757] [DEBUG] [LOCAL ] MFG: Loaded 49410 existing records from primary storage. [2025-10-28T19:54:08.552052] [INFO ] [MAIN ] MFG: Loaded 49410 existing records. [2025-10-28T19:54:08.738405] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:08.738739] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-28T19:54:08.738819] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-28T19:54:08.739632] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-28T19:54:08.739729] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-28T19:54:08.783256] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-28T19:54:09.059983] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T19:54:09.178576] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:09.183829] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T19:54:09.580326] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-28T19:54:10.380303] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-28T19:54:10.742474] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:54:11.180284] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-28T19:54:11.689941] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:54:11.980322] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-28T19:54:12.600931] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T19:54:12.780358] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-28T19:54:13.199194] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T19:54:13.350953] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:54:13.580306] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-28T19:54:14.008721] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T19:54:14.380323] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-28T19:54:15.180271] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-28T19:54:15.497010] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:54:15.562205] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:54:15.980342] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-28T19:54:16.325857] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T19:54:16.780291] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-28T19:54:17.120418] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T19:54:17.580362] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-28T19:54:18.380247] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-28T19:54:19.027802] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T19:54:19.180268] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-28T19:54:19.389503] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:54:19.980299] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-28T19:54:20.430592] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T19:54:20.581774] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T19:54:20.780260] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-28T19:54:21.580246] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-28T19:54:22.186865] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:54:22.380253] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-28T19:54:22.823759] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:54:23.180317] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-28T19:54:23.980290] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-28T19:54:24.556746] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:54:24.565856] [INFO ] [REMOTE ] MFA: Full fetch complete (65036 records). [2025-10-28T19:54:24.566035] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-28T19:54:24.786052] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-28T19:54:24.973363] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-28T19:54:24.973453] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-28T19:54:24.974580] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-28T19:54:24.974664] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-28T19:54:24.976019] [DEBUG] [LOCAL ] MFA: Trimmed 65036 records to 45144 (keeping 200 days of data) [2025-10-28T19:54:25.249041] [DEBUG] [LOCAL ] MFA: Primary data saved (45144 records). [2025-10-28T19:54:25.249180] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-28T19:54:25.249293] [INFO ] [MAIN ] Update Progress: 1331/2366 symbols completed. MFA took 44.8s. Estimated remaining: 2h 15m 36s. Rate: 7.6 symbols/min [2025-10-28T19:54:25.461273] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:54:25.464757] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:25.489725] [DEBUG] [LOCAL ] MFM: Loaded 13557 existing records from primary storage. [2025-10-28T19:54:25.489964] [INFO ] [MAIN ] MFM: Loaded 13557 existing records. [2025-10-28T19:54:25.586283] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-28T19:54:25.649547] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T19:54:25.693819] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:25.694454] [INFO ] [REMOTE ] MFAO: Full fetch complete (5467 records). [2025-10-28T19:54:25.694715] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-28T19:54:25.694559] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-28T19:54:25.694858] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-28T19:54:25.738172] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-28T19:54:25.770039] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-28T19:54:26.382356] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-28T19:54:26.397582] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-28T19:54:26.408636] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-28T19:54:26.415864] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-28T19:54:26.435486] [DEBUG] [LOCAL ] MFAO: Trimmed 5467 records to 3740 (keeping 200 days of data) [2025-10-28T19:54:26.442347] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:26.442923] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-28T19:54:26.466180] [DEBUG] [LOCAL ] MFAO: Primary data saved (3740 records). [2025-10-28T19:54:26.466282] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-28T19:54:26.466365] [INFO ] [MAIN ] Update Progress: 1332/2366 symbols completed. MFAO took 20.5s. Estimated remaining: 2h 15m 23s. Rate: 7.6 symbols/min [2025-10-28T19:54:26.633520] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:26.633662] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-28T19:54:26.633719] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-28T19:54:26.633825] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-28T19:54:26.633867] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-28T19:54:26.633908] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-28T19:54:26.633940] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-28T19:54:26.999591] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:26.970863] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T19:54:27.188815] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-28T19:54:27.194212] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T19:54:27.254200] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (4.87 seconds). [2025-10-28T19:54:27.434030] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-28T19:54:27.980315] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-28T19:54:28.780244] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-28T19:54:29.018412] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:54:29.580306] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-28T19:54:29.864324] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-28T19:54:30.380247] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-28T19:54:30.984638] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:54:31.180301] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-28T19:54:31.980235] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-28T19:54:32.224529] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-28T19:54:32.780269] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-28T19:54:33.580231] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-28T19:54:33.823629] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T19:54:34.380232] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-28T19:54:34.613541] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T19:54:35.180304] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-28T19:54:35.292610] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (5.71 seconds). [2025-10-28T19:54:35.416975] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T19:54:35.980231] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-28T19:54:36.254987] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-28T19:54:36.780254] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-28T19:54:37.580230] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-28T19:54:38.950093] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (7.77 seconds). [2025-10-28T19:54:38.960044] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-28T19:54:39.120977] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:54:39.131836] [INFO ] [REMOTE ] MFC: Full fetch complete (74343 records). [2025-10-28T19:54:39.132017] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-28T19:54:39.531176] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-28T19:54:39.531259] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-28T19:54:39.532314] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-28T19:54:39.532375] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-28T19:54:39.533855] [DEBUG] [LOCAL ] MFC: Trimmed 74343 records to 50873 (keeping 200 days of data) [2025-10-28T19:54:39.831542] [DEBUG] [LOCAL ] MFC: Primary data saved (50873 records). [2025-10-28T19:54:39.831698] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-28T19:54:39.831788] [INFO ] [MAIN ] Update Progress: 1333/2366 symbols completed. MFC took 33.8s. Estimated remaining: 2h 15m 19s. Rate: 7.6 symbols/min [2025-10-28T19:54:40.015358] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:40.022254] [DEBUG] [LOCAL ] MFSG: Loaded 5908 existing records from primary storage. [2025-10-28T19:54:40.022429] [INFO ] [MAIN ] MFSG: Loaded 5908 existing records. [2025-10-28T19:54:40.206920] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:40.207530] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-28T19:54:40.207729] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-28T19:54:40.207991] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-28T19:54:40.208052] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-28T19:54:40.442405] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T19:54:40.562012] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-28T19:54:40.643322] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:40.643958] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-28T19:54:40.902450] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-28T19:54:40.903430] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-28T19:54:40.990300] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (8.21 seconds). [2025-10-28T19:54:41.245318] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T19:54:41.313692] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (4.53 seconds). [2025-10-28T19:54:41.580249] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-28T19:54:41.951058] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:54:42.043370] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T19:54:42.380312] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-28T19:54:42.690058] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T19:54:43.180260] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-28T19:54:43.734913] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T19:54:43.980282] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-28T19:54:44.362150] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T19:54:44.780312] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-28T19:54:45.291833] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T19:54:45.293393] [INFO ] [REMOTE ] MFSB: Full fetch complete (2194 records). [2025-10-28T19:54:45.293475] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-28T19:54:45.470087] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-28T19:54:45.470263] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:54:45.470309] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:54:45.470346] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-28T19:54:45.470400] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-28T19:54:45.470441] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-28T19:54:45.470479] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-28T19:54:45.470530] [INFO ] [MAIN ] Update Progress: 1334/2366 symbols completed. MFSB took 19.0s. Estimated remaining: 2h 15m 9s. Rate: 7.6 symbols/min [2025-10-28T19:54:45.585408] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-28T19:54:45.643452] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:45.656539] [DEBUG] [LOCAL ] MFSI: Loaded 12866 existing records from primary storage. [2025-10-28T19:54:45.656780] [INFO ] [MAIN ] MFSI: Loaded 12866 existing records. [2025-10-28T19:54:45.833629] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:45.833874] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-28T19:54:45.833920] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-28T19:54:45.834212] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-28T19:54:45.834252] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-28T19:54:46.189107] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:46.380255] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-28T19:54:46.600165] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:54:46.978671] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T19:54:47.180290] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-28T19:54:47.980255] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-28T19:54:48.305457] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:54:48.616184] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T19:54:48.780223] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-28T19:54:49.168587] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T19:54:49.580245] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-28T19:54:50.380246] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-28T19:54:50.803893] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:54:51.180243] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-28T19:54:51.262268] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T19:54:51.272179] [INFO ] [REMOTE ] MFG: Full fetch complete (70019 records). [2025-10-28T19:54:51.272295] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-28T19:54:51.658244] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-28T19:54:51.660459] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-28T19:54:51.663529] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-28T19:54:51.664055] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-28T19:54:51.664309] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:54:51.667534] [DEBUG] [LOCAL ] MFG: Trimmed 70019 records to 49381 (keeping 200 days of data) [2025-10-28T19:54:51.935058] [DEBUG] [LOCAL ] MFG: Primary data saved (49381 records). [2025-10-28T19:54:51.935176] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-28T19:54:51.935250] [INFO ] [MAIN ] Update Progress: 1335/2366 symbols completed. MFG took 43.6s. Estimated remaining: 2h 15m 0s. Rate: 7.6 symbols/min [2025-10-28T19:54:51.987143] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-28T19:54:52.102932] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:52.107113] [DEBUG] [LOCAL ] MFSV: Loaded 2986 existing records from primary storage. [2025-10-28T19:54:52.107254] [INFO ] [MAIN ] MFSV: Loaded 2986 existing records. [2025-10-28T19:54:52.287627] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:52.287895] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-28T19:54:52.287962] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-28T19:54:52.288157] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-28T19:54:52.288214] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-28T19:54:52.583588] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T19:54:52.659615] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:52.780239] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-28T19:54:53.008243] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-28T19:54:53.580243] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-28T19:54:53.855843] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T19:54:54.380272] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-28T19:54:55.110012] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:54:55.180218] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-28T19:54:55.667120] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:54:55.980257] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-28T19:54:56.407019] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T19:54:56.780317] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-28T19:54:57.221536] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T19:54:57.580260] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-28T19:54:57.851571] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T19:54:58.380242] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-28T19:54:58.917146] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T19:54:59.180236] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-28T19:54:59.631213] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T19:54:59.980300] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-28T19:55:00.605249] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T19:55:00.607465] [INFO ] [REMOTE ] MFSG: Full fetch complete (6937 records). [2025-10-28T19:55:00.607575] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-28T19:55:00.782523] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-28T19:55:00.967513] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-28T19:55:00.967597] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-28T19:55:00.967822] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-28T19:55:00.967880] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-28T19:55:00.968283] [DEBUG] [LOCAL ] MFSG: Trimmed 6937 records to 5923 (keeping 200 days of data) [2025-10-28T19:55:01.002013] [DEBUG] [LOCAL ] MFSG: Primary data saved (5923 records). [2025-10-28T19:55:01.002120] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-28T19:55:01.002193] [INFO ] [MAIN ] Update Progress: 1336/2366 symbols completed. MFSG took 21.2s. Estimated remaining: 2h 14m 54s. Rate: 7.6 symbols/min [2025-10-28T19:55:01.169725] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:01.183250] [DEBUG] [LOCAL ] MG: Loaded 15016 existing records from primary storage. [2025-10-28T19:55:01.183464] [INFO ] [MAIN ] MG: Loaded 15016 existing records. [2025-10-28T19:55:01.377686] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:01.377868] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-28T19:55:01.377916] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-28T19:55:01.378238] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-28T19:55:01.378295] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-28T19:55:01.585415] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-28T19:55:01.595381] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T19:55:01.639345] [INFO ] [REMOTE ] MFM: Full fetch complete (19449 records). [2025-10-28T19:55:01.650776] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-28T19:55:01.881727] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:02.011174] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T19:55:02.128277] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-28T19:55:02.128342] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-28T19:55:02.128762] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-28T19:55:02.128821] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-28T19:55:02.129326] [DEBUG] [LOCAL ] MFM: Trimmed 19449 records to 13406 (keeping 200 days of data) [2025-10-28T19:55:02.205428] [DEBUG] [LOCAL ] MFM: Primary data saved (13406 records). [2025-10-28T19:55:02.205532] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-28T19:55:02.205606] [INFO ] [MAIN ] Update Progress: 1337/2366 symbols completed. MFM took 37.0s. Estimated remaining: 2h 14m 41s. Rate: 7.6 symbols/min [2025-10-28T19:55:02.373095] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:02.380255] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-28T19:55:02.416541] [DEBUG] [LOCAL ] MGA: Loaded 50302 existing records from primary storage. [2025-10-28T19:55:02.416855] [INFO ] [MAIN ] MGA: Loaded 50302 existing records. [2025-10-28T19:55:02.610741] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:02.610968] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-28T19:55:02.611013] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-28T19:55:02.611814] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-28T19:55:02.611872] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-28T19:55:02.968898] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:02.964743] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T19:55:03.180229] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-28T19:55:03.980266] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-28T19:55:04.261356] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-28T19:55:04.780284] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-28T19:55:04.888431] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-28T19:55:05.434634] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:55:05.580229] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-28T19:55:06.112018] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:55:06.380272] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-28T19:55:07.180253] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-28T19:55:07.799426] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T19:55:07.857501] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T19:55:07.980221] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-28T19:55:08.671102] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T19:55:08.780282] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-28T19:55:09.580293] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-28T19:55:09.976773] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:55:10.189863] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T19:55:10.380288] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-28T19:55:11.180257] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-28T19:55:11.980302] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-28T19:55:12.030386] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:55:12.760875] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-28T19:55:12.766467] [INFO ] [REMOTE ] MFSI: Full fetch complete (15364 records). [2025-10-28T19:55:12.766572] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-28T19:55:12.785504] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-28T19:55:13.167284] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-28T19:55:13.167382] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-28T19:55:13.167798] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-28T19:55:13.167873] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-28T19:55:13.168919] [DEBUG] [LOCAL ] MFSI: Trimmed 15364 records to 12969 (keeping 200 days of data) [2025-10-28T19:55:13.253146] [DEBUG] [LOCAL ] MFSI: Primary data saved (12969 records). [2025-10-28T19:55:13.253293] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-28T19:55:13.253377] [INFO ] [MAIN ] Update Progress: 1338/2366 symbols completed. MFSI took 27.8s. Estimated remaining: 2h 14m 35s. Rate: 7.6 symbols/min [2025-10-28T19:55:13.381772] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:55:13.478264] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:13.484098] [DEBUG] [LOCAL ] MGF: Loaded 4095 existing records from primary storage. [2025-10-28T19:55:13.484294] [INFO ] [MAIN ] MGF: Loaded 4095 existing records. [2025-10-28T19:55:13.585441] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-28T19:55:13.689210] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:13.689547] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-28T19:55:13.700999] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-28T19:55:13.702175] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:55:13.702225] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-28T19:55:13.706624] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-28T19:55:14.012500] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T19:55:14.093939] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:14.380263] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-28T19:55:14.723914] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:55:15.180307] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-28T19:55:15.465477] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T19:55:15.980268] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-28T19:55:16.780290] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-28T19:55:17.580245] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-28T19:55:18.042163] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:55:18.213751] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-28T19:55:18.380443] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:55:18.380220] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-28T19:55:19.180228] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-28T19:55:19.542745] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:55:19.980232] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-28T19:55:20.391101] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T19:55:20.410819] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-28T19:55:20.780293] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-28T19:55:21.403566] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T19:55:21.580280] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-28T19:55:21.943527] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T19:55:22.380279] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-28T19:55:22.980752] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T19:55:23.180323] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-28T19:55:23.818715] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:55:23.980285] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-28T19:55:24.780247] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-28T19:55:24.818727] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:55:24.821779] [INFO ] [REMOTE ] MG: Full fetch complete (23074 records). [2025-10-28T19:55:24.821856] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-28T19:55:25.187527] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-28T19:55:25.187605] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-28T19:55:25.188105] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-28T19:55:25.188158] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-28T19:55:25.188731] [DEBUG] [LOCAL ] MG: Trimmed 23074 records to 14922 (keeping 200 days of data) [2025-10-28T19:55:25.269286] [DEBUG] [LOCAL ] MG: Primary data saved (14922 records). [2025-10-28T19:55:25.269405] [INFO ] [MAIN ] MG: Full history saved. [2025-10-28T19:55:25.269478] [INFO ] [MAIN ] Update Progress: 1339/2366 symbols completed. MG took 24.3s. Estimated remaining: 2h 14m 30s. Rate: 7.6 symbols/min [2025-10-28T19:55:25.435679] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:25.482610] [DEBUG] [LOCAL ] MGM: Loaded 53601 existing records from primary storage. [2025-10-28T19:55:25.482921] [INFO ] [MAIN ] MGM: Loaded 53601 existing records. [2025-10-28T19:55:25.581526] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-28T19:55:25.662885] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:25.663057] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-28T19:55:25.663103] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-28T19:55:25.663327] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-28T19:55:25.663382] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-28T19:55:26.030756] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:26.060896] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:55:26.124764] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T19:55:26.126450] [INFO ] [REMOTE ] MFSV: Full fetch complete (3872 records). [2025-10-28T19:55:26.126517] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-28T19:55:26.385447] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-28T19:55:26.475910] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-28T19:55:26.475999] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-28T19:55:26.476136] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-28T19:55:26.476174] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-28T19:55:26.476502] [DEBUG] [LOCAL ] MFSV: Trimmed 3872 records to 3053 (keeping 200 days of data) [2025-10-28T19:55:26.494240] [DEBUG] [LOCAL ] MFSV: Primary data saved (3053 records). [2025-10-28T19:55:26.494297] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-28T19:55:26.494360] [INFO ] [MAIN ] Update Progress: 1340/2366 symbols completed. MFSV took 34.6s. Estimated remaining: 2h 14m 18s. Rate: 7.6 symbols/min [2025-10-28T19:55:26.658129] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:26.665509] [DEBUG] [LOCAL ] MGR: Loaded 5451 existing records from primary storage. [2025-10-28T19:55:26.665708] [INFO ] [MAIN ] MGR: Loaded 5451 existing records. [2025-10-28T19:55:26.837600] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:26.837791] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-28T19:55:26.837837] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-28T19:55:26.838015] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-28T19:55:26.838094] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-28T19:55:27.181015] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-28T19:55:27.184454] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:27.615086] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:55:27.980305] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-28T19:55:28.417794] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T19:55:28.780282] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-28T19:55:29.580247] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-28T19:55:30.022213] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T19:55:30.092197] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:55:30.380309] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-28T19:55:30.737362] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T19:55:31.180325] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-28T19:55:31.980316] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-28T19:55:32.429438] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:55:32.652468] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (5.47 seconds). [2025-10-28T19:55:32.780261] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-28T19:55:33.291876] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-28T19:55:33.580242] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-28T19:55:34.380267] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-28T19:55:34.815736] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T19:55:35.008085] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T19:55:35.180283] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-28T19:55:35.980222] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-28T19:55:36.177153] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-10-28T19:55:36.573480] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T19:55:36.764833] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T19:55:36.780206] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-28T19:55:37.580275] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-28T19:55:38.308281] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T19:55:38.380254] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-28T19:55:38.935438] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:55:38.935638] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T19:55:39.180250] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-28T19:55:39.980316] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-28T19:55:40.436255] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T19:55:40.514203] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:55:40.780269] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-28T19:55:41.580274] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-28T19:55:41.905168] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:55:41.942151] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T19:55:42.380305] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-28T19:55:42.802933] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T19:55:43.180261] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-28T19:55:43.620978] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T19:55:43.980301] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-28T19:55:44.356902] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T19:55:44.780255] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-28T19:55:45.580253] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-28T19:55:46.313946] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T19:55:46.380249] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-28T19:55:47.121720] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:55:47.131828] [INFO ] [REMOTE ] MGA: Full fetch complete (73629 records). [2025-10-28T19:55:47.131974] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-28T19:55:47.187691] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-28T19:55:47.528823] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-28T19:55:47.528895] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-28T19:55:47.529904] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-28T19:55:47.529963] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-28T19:55:47.531343] [DEBUG] [LOCAL ] MGA: Trimmed 73629 records to 50260 (keeping 200 days of data) [2025-10-28T19:55:47.642595] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T19:55:47.868710] [DEBUG] [LOCAL ] MGA: Primary data saved (50260 records). [2025-10-28T19:55:47.868874] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-28T19:55:47.869053] [INFO ] [MAIN ] Update Progress: 1341/2366 symbols completed. MGA took 45.7s. Estimated remaining: 2h 14m 20s. Rate: 7.6 symbols/min [2025-10-28T19:55:47.917356] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T19:55:47.984399] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-28T19:55:48.055038] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:48.060811] [DEBUG] [LOCAL ] MGRB: Loaded 3906 existing records from primary storage. [2025-10-28T19:55:48.060957] [INFO ] [MAIN ] MGRB: Loaded 3906 existing records. [2025-10-28T19:55:48.239695] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:48.239925] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-28T19:55:48.239972] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-28T19:55:48.240100] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-28T19:55:48.240138] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-28T19:55:48.548481] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T19:55:48.566174] [INFO ] [REMOTE ] MGR: Full fetch complete (7745 records). [2025-10-28T19:55:48.602252] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-28T19:55:48.639461] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:48.786085] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-28T19:55:48.998703] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-28T19:55:48.998795] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-28T19:55:48.998980] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-28T19:55:48.999017] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-28T19:55:48.999388] [DEBUG] [LOCAL ] MGR: Trimmed 7745 records to 5423 (keeping 200 days of data) [2025-10-28T19:55:49.031139] [DEBUG] [LOCAL ] MGR: Primary data saved (5423 records). [2025-10-28T19:55:49.031219] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-28T19:55:49.031302] [INFO ] [MAIN ] Update Progress: 1342/2366 symbols completed. MGR took 22.5s. Estimated remaining: 2h 14m 7s. Rate: 7.6 symbols/min [2025-10-28T19:55:49.200391] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:49.208923] [DEBUG] [LOCAL ] MGRD: Loaded 2159 existing records from primary storage. [2025-10-28T19:55:49.209068] [INFO ] [MAIN ] MGRD: Loaded 2159 existing records. [2025-10-28T19:55:49.385695] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:49.385882] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-28T19:55:49.385927] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-28T19:55:49.386103] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-28T19:55:49.386158] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-28T19:55:49.589196] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-28T19:55:49.746605] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:50.019800] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T19:55:50.261808] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T19:55:50.380243] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-28T19:55:50.723162] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:55:51.180350] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-28T19:55:51.481317] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-28T19:55:51.980320] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-28T19:55:52.272277] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T19:55:52.780277] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-28T19:55:53.580284] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-28T19:55:54.090799] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T19:55:54.092137] [INFO ] [REMOTE ] MGF: Full fetch complete (5729 records). [2025-10-28T19:55:54.092204] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-28T19:55:54.385375] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-28T19:55:54.486521] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-28T19:55:54.486597] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-28T19:55:54.486782] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-28T19:55:54.486844] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-28T19:55:54.487226] [DEBUG] [LOCAL ] MGF: Trimmed 5729 records to 4090 (keeping 200 days of data) [2025-10-28T19:55:54.511065] [DEBUG] [LOCAL ] MGF: Primary data saved (4090 records). [2025-10-28T19:55:54.511206] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-28T19:55:54.511314] [INFO ] [MAIN ] Update Progress: 1343/2366 symbols completed. MGF took 41.2s. Estimated remaining: 2h 13m 57s. Rate: 7.6 symbols/min [2025-10-28T19:55:54.696007] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:55:54.705840] [DEBUG] [LOCAL ] MGRE: Loaded 6310 existing records from primary storage. [2025-10-28T19:55:54.706086] [INFO ] [MAIN ] MGRE: Loaded 6310 existing records. [2025-10-28T19:55:54.823347] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T19:55:54.907043] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:55:54.907282] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-28T19:55:54.907331] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-28T19:55:54.907483] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-28T19:55:54.907523] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-28T19:55:55.184061] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-28T19:55:55.288548] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:55:55.980243] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-28T19:55:56.366853] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:55:56.780300] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-28T19:55:57.129849] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T19:55:57.223166] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (4.44 seconds). [2025-10-28T19:55:57.424252] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-28T19:55:57.580261] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-28T19:55:57.985807] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:55:58.380283] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-28T19:55:58.774789] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T19:55:59.180266] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-28T19:55:59.498830] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T19:55:59.980253] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-28T19:56:00.472582] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T19:56:00.780264] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-28T19:56:01.580266] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-28T19:56:02.007919] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T19:56:02.380231] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-28T19:56:02.595206] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T19:56:02.607365] [INFO ] [REMOTE ] MGM: Full fetch complete (77757 records). [2025-10-28T19:56:02.607515] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-28T19:56:02.982715] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T19:56:03.006690] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-28T19:56:03.006793] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-28T19:56:03.010287] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-28T19:56:03.010373] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-28T19:56:03.011813] [DEBUG] [LOCAL ] MGM: Trimmed 77757 records to 53601 (keeping 200 days of data) [2025-10-28T19:56:03.181921] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-28T19:56:03.319750] [DEBUG] [LOCAL ] MGM: Primary data saved (53601 records). [2025-10-28T19:56:03.319881] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-28T19:56:03.320522] [INFO ] [MAIN ] Update Progress: 1344/2366 symbols completed. MGM took 38.1s. Estimated remaining: 2h 13m 50s. Rate: 7.6 symbols/min [2025-10-28T19:56:03.486070] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:03.535921] [DEBUG] [LOCAL ] MGY: Loaded 52406 existing records from primary storage. [2025-10-28T19:56:03.536249] [INFO ] [MAIN ] MGY: Loaded 52406 existing records. [2025-10-28T19:56:03.639698] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T19:56:03.723441] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:56:03.723750] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-28T19:56:03.723805] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-28T19:56:03.724213] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-28T19:56:03.724270] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-28T19:56:03.985446] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-28T19:56:04.079535] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:04.367006] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T19:56:04.780325] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-28T19:56:05.068035] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T19:56:05.580297] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-28T19:56:05.878493] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:56:06.380314] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-28T19:56:06.849128] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T19:56:06.850169] [INFO ] [REMOTE ] MGRB: Full fetch complete (5443 records). [2025-10-28T19:56:06.850241] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-28T19:56:07.185361] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-28T19:56:07.255111] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-28T19:56:07.255187] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-28T19:56:07.255340] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-28T19:56:07.255378] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-28T19:56:07.255762] [DEBUG] [LOCAL ] MGRB: Trimmed 5443 records to 3854 (keeping 200 days of data) [2025-10-28T19:56:07.281948] [DEBUG] [LOCAL ] MGRB: Primary data saved (3854 records). [2025-10-28T19:56:07.282077] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-28T19:56:07.282161] [INFO ] [MAIN ] Update Progress: 1345/2366 symbols completed. MGRB took 19.4s. Estimated remaining: 2h 13m 39s. Rate: 7.6 symbols/min [2025-10-28T19:56:07.447989] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:07.448177] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-28T19:56:07.448214] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-28T19:56:07.448319] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-28T19:56:07.448364] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-28T19:56:07.448405] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-28T19:56:07.448438] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-28T19:56:07.795834] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:07.980313] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-10-28T19:56:08.119435] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:56:08.119814] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-10-28T19:56:08.119901] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:56:08.119952] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-28T19:56:08.120009] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:56:08.120083] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-28T19:56:08.120149] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-28T19:56:08.120186] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-28T19:56:08.120227] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-28T19:56:08.120274] [INFO ] [MAIN ] Update Progress: 1346/2366 symbols completed. MH took 0.8s. Estimated remaining: 2h 13m 26s. Rate: 7.6 symbols/min [2025-10-28T19:56:08.304874] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:08.317398] [DEBUG] [LOCAL ] MHD: Loaded 11584 existing records from primary storage. [2025-10-28T19:56:08.317578] [INFO ] [MAIN ] MHD: Loaded 11584 existing records. [2025-10-28T19:56:08.498483] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:56:08.498791] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-28T19:56:08.498906] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-28T19:56:08.499196] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-28T19:56:08.499343] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-28T19:56:08.780408] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-28T19:56:08.824077] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T19:56:08.923434] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:09.107755] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T19:56:09.580235] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-28T19:56:09.877688] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T19:56:10.380270] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-28T19:56:10.883348] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T19:56:10.884316] [INFO ] [REMOTE ] MGRD: Full fetch complete (3231 records). [2025-10-28T19:56:10.884383] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-28T19:56:11.185396] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-28T19:56:11.281299] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-28T19:56:11.281604] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-28T19:56:11.281769] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-28T19:56:11.281827] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-28T19:56:11.282160] [DEBUG] [LOCAL ] MGRD: Trimmed 3231 records to 2150 (keeping 200 days of data) [2025-10-28T19:56:11.295764] [DEBUG] [LOCAL ] MGRD: Primary data saved (2150 records). [2025-10-28T19:56:11.295829] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-28T19:56:11.296025] [INFO ] [MAIN ] Update Progress: 1347/2366 symbols completed. MGRD took 22.3s. Estimated remaining: 2h 13m 15s. Rate: 7.6 symbols/min [2025-10-28T19:56:11.476196] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:11.488866] [DEBUG] [LOCAL ] MHF: Loaded 9097 existing records from primary storage. [2025-10-28T19:56:11.489157] [INFO ] [MAIN ] MHF: Loaded 9097 existing records. [2025-10-28T19:56:11.618378] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:56:11.690573] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:56:11.690815] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-28T19:56:11.690869] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-28T19:56:11.691213] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-28T19:56:11.691273] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-28T19:56:11.985467] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-28T19:56:12.064541] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:12.780250] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-28T19:56:13.252335] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T19:56:13.297447] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T19:56:13.580249] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-28T19:56:13.979180] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T19:56:14.380296] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-28T19:56:15.074640] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:56:15.180240] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-28T19:56:15.704010] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T19:56:15.980290] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-28T19:56:16.579120] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T19:56:16.780262] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-28T19:56:17.319196] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:56:17.580289] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-28T19:56:17.970721] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T19:56:18.380272] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-28T19:56:19.180285] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-28T19:56:19.621335] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T19:56:19.781842] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:56:19.980269] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-28T19:56:20.780247] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-28T19:56:21.160980] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T19:56:21.196953] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T19:56:21.580249] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-28T19:56:22.009622] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T19:56:22.380315] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-28T19:56:23.180319] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-28T19:56:23.537821] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T19:56:23.680561] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T19:56:23.682027] [INFO ] [REMOTE ] MGRE: Full fetch complete (9137 records). [2025-10-28T19:56:23.682113] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-28T19:56:23.985472] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-28T19:56:24.047554] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-28T19:56:24.047622] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-28T19:56:24.047877] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-28T19:56:24.047927] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-28T19:56:24.048357] [DEBUG] [LOCAL ] MGRE: Trimmed 9137 records to 6301 (keeping 200 days of data) [2025-10-28T19:56:24.087607] [DEBUG] [LOCAL ] MGRE: Primary data saved (6301 records). [2025-10-28T19:56:24.087740] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-28T19:56:24.087826] [INFO ] [MAIN ] Update Progress: 1348/2366 symbols completed. MGRE took 29.6s. Estimated remaining: 2h 13m 11s. Rate: 7.6 symbols/min [2025-10-28T19:56:24.259794] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:24.299024] [DEBUG] [LOCAL ] MHK: Loaded 42038 existing records from primary storage. [2025-10-28T19:56:24.299293] [INFO ] [MAIN ] MHK: Loaded 42038 existing records. [2025-10-28T19:56:24.480117] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:56:24.480309] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-28T19:56:24.480364] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-28T19:56:24.480545] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-28T19:56:24.480585] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-28T19:56:24.785326] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-28T19:56:24.843564] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:25.539550] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T19:56:25.580233] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-28T19:56:25.816593] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:56:26.380247] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-28T19:56:26.497880] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:56:26.985156] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T19:56:27.180288] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-28T19:56:27.980265] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-28T19:56:28.474046] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:56:28.491620] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T19:56:28.780329] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-28T19:56:29.580293] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-28T19:56:30.380250] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-28T19:56:30.680566] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:56:30.875827] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T19:56:31.180246] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-28T19:56:31.793093] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:56:31.980244] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-28T19:56:32.780290] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-28T19:56:32.841594] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T19:56:33.252525] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T19:56:33.580281] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-28T19:56:34.046841] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (5.27 seconds). [2025-10-28T19:56:34.071100] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T19:56:34.380261] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-28T19:56:35.180236] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-28T19:56:35.304947] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:56:35.980326] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-28T19:56:36.455670] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T19:56:36.493341] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:56:36.780278] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-28T19:56:37.309668] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:56:37.580293] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-28T19:56:38.252096] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:56:38.254596] [INFO ] [REMOTE ] MHF: Full fetch complete (13001 records). [2025-10-28T19:56:38.254699] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-28T19:56:38.395755] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-28T19:56:38.622277] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-28T19:56:38.622351] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-28T19:56:38.622638] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-28T19:56:38.622719] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-28T19:56:38.623215] [DEBUG] [LOCAL ] MHF: Trimmed 13001 records to 9214 (keeping 200 days of data) [2025-10-28T19:56:38.676273] [DEBUG] [LOCAL ] MHF: Primary data saved (9214 records). [2025-10-28T19:56:38.676401] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-28T19:56:38.676481] [INFO ] [MAIN ] Update Progress: 1349/2366 symbols completed. MHF took 27.4s. Estimated remaining: 2h 13m 8s. Rate: 7.6 symbols/min [2025-10-28T19:56:38.848527] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:38.848835] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-28T19:56:38.848888] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-28T19:56:38.848997] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-28T19:56:38.849048] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-28T19:56:38.849100] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-28T19:56:38.849141] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-28T19:56:39.185532] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-28T19:56:39.243432] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:39.842594] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T19:56:39.862003] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T19:56:39.980245] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-28T19:56:40.780264] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-28T19:56:41.219735] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T19:56:41.237171] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:56:41.580257] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-28T19:56:42.380295] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-28T19:56:42.874785] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T19:56:43.180274] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-28T19:56:43.443164] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-28T19:56:43.531486] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T19:56:43.980263] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-28T19:56:44.564858] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:56:44.567602] [INFO ] [REMOTE ] MHD: Full fetch complete (17957 records). [2025-10-28T19:56:44.567711] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-28T19:56:44.786411] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-28T19:56:44.945264] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-28T19:56:44.945331] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-28T19:56:44.945717] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-28T19:56:44.945777] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-28T19:56:44.946335] [DEBUG] [LOCAL ] MHD: Trimmed 17957 records to 11655 (keeping 200 days of data) [2025-10-28T19:56:45.015861] [DEBUG] [LOCAL ] MHD: Primary data saved (11655 records). [2025-10-28T19:56:45.016025] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-28T19:56:45.016116] [INFO ] [MAIN ] Update Progress: 1350/2366 symbols completed. MHD took 36.9s. Estimated remaining: 2h 12m 59s. Rate: 7.6 symbols/min [2025-10-28T19:56:45.191360] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:45.200104] [DEBUG] [LOCAL ] MHN: Loaded 7019 existing records from primary storage. [2025-10-28T19:56:45.200308] [INFO ] [MAIN ] MHN: Loaded 7019 existing records. [2025-10-28T19:56:45.377873] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:56:45.378068] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-28T19:56:45.378114] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-28T19:56:45.378265] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-28T19:56:45.378319] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-28T19:56:45.585426] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-28T19:56:45.729158] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:45.934158] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T19:56:46.229204] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:56:46.239971] [INFO ] [REMOTE ] MGY: Full fetch complete (75967 records). [2025-10-28T19:56:46.240085] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-28T19:56:46.385939] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-28T19:56:46.648815] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-28T19:56:46.648889] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-28T19:56:46.649941] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-28T19:56:46.650001] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-28T19:56:46.651368] [DEBUG] [LOCAL ] MGY: Trimmed 75967 records to 52401 (keeping 200 days of data) [2025-10-28T19:56:46.960110] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:56:46.982917] [DEBUG] [LOCAL ] MGY: Primary data saved (52401 records). [2025-10-28T19:56:46.983039] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-28T19:56:46.983126] [INFO ] [MAIN ] Update Progress: 1351/2366 symbols completed. MGY took 43.7s. Estimated remaining: 2h 12m 47s. Rate: 7.6 symbols/min [2025-10-28T19:56:47.155120] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:56:47.179319] [DEBUG] [LOCAL ] MHO: Loaded 23488 existing records from primary storage. [2025-10-28T19:56:47.179569] [INFO ] [MAIN ] MHO: Loaded 23488 existing records. [2025-10-28T19:56:47.190259] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-28T19:56:47.375307] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:56:47.375528] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-28T19:56:47.375599] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-28T19:56:47.375858] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-28T19:56:47.375926] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-28T19:56:47.742280] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:56:47.751753] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T19:56:47.980227] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-28T19:56:48.238942] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-28T19:56:48.780243] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-28T19:56:49.227682] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T19:56:49.580234] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-28T19:56:50.360026] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T19:56:50.380204] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-28T19:56:51.180280] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-28T19:56:51.359096] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:56:51.439144] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T19:56:51.980269] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-28T19:56:52.217956] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T19:56:52.780269] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-28T19:56:53.580230] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-28T19:56:53.644176] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T19:56:54.380302] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-28T19:56:54.690532] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:56:54.740069] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T19:56:55.180324] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-28T19:56:55.980243] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-28T19:56:56.347146] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:56:56.476793] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:56:56.780251] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-28T19:56:57.580242] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-28T19:56:58.218520] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:56:58.383410] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-28T19:56:58.386775] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T19:56:58.602869] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-28T19:56:59.180326] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-28T19:56:59.427039] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-28T19:56:59.980296] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-28T19:57:00.559010] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:57:00.780257] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-28T19:57:01.580301] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-28T19:57:02.380263] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-28T19:57:02.745720] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-28T19:57:02.797818] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T19:57:02.945918] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:57:03.180326] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-28T19:57:03.980349] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-28T19:57:04.408280] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T19:57:04.409038] [INFO ] [REMOTE ] MHLA: Full fetch complete (1480 records). [2025-10-28T19:57:04.409109] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-28T19:57:04.409434] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T19:57:04.409517] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:57:04.409566] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:57:04.409676] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-28T19:57:04.409764] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-28T19:57:04.409823] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-28T19:57:04.409881] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-28T19:57:04.409955] [INFO ] [MAIN ] Update Progress: 1352/2366 symbols completed. MHLA took 25.7s. Estimated remaining: 2h 12m 46s. Rate: 7.6 symbols/min [2025-10-28T19:57:04.586703] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:04.586998] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-28T19:57:04.587066] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-28T19:57:04.587200] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-28T19:57:04.587324] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-28T19:57:04.587517] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-28T19:57:04.587599] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-28T19:57:04.712452] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:57:04.794991] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-28T19:57:04.977622] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:05.411777] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T19:57:05.580242] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-28T19:57:06.380292] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-28T19:57:06.615194] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T19:57:07.181465] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-28T19:57:07.183253] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T19:57:07.729245] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T19:57:07.730872] [INFO ] [REMOTE ] MHN: Full fetch complete (11064 records). [2025-10-28T19:57:07.730942] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-28T19:57:07.985421] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-10-28T19:57:08.105050] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-28T19:57:08.105121] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-28T19:57:08.105399] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-28T19:57:08.105437] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-28T19:57:08.105900] [DEBUG] [LOCAL ] MHN: Trimmed 11064 records to 6981 (keeping 200 days of data) [2025-10-28T19:57:08.146206] [DEBUG] [LOCAL ] MHN: Primary data saved (6981 records). [2025-10-28T19:57:08.146298] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-28T19:57:08.146370] [INFO ] [MAIN ] Update Progress: 1353/2366 symbols completed. MHN took 23.1s. Estimated remaining: 2h 12m 35s. Rate: 7.6 symbols/min [2025-10-28T19:57:08.221611] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:57:08.245745] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-10-28T19:57:08.248151] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:57:08.253876] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-28T19:57:08.259047] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:57:08.269350] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-28T19:57:08.274597] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-28T19:57:08.300599] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-28T19:57:08.302302] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-28T19:57:08.319956] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:08.320070] [INFO ] [MAIN ] Update Progress: 1354/2366 symbols completed. MIAX took 3.9s. Estimated remaining: 2h 12m 22s. Rate: 7.6 symbols/min [2025-10-28T19:57:08.447321] [DEBUG] [LOCAL ] MIN: Loaded 13805 existing records from primary storage. [2025-10-28T19:57:08.463188] [INFO ] [MAIN ] MIN: Loaded 13805 existing records. [2025-10-28T19:57:08.634166] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:08.718385] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:08.718749] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-28T19:57:08.718825] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-28T19:57:08.719041] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-28T19:57:08.719097] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-28T19:57:08.783866] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-28T19:57:08.968959] [DEBUG] [LOCAL ] MIR: Loaded 51414 existing records from primary storage. [2025-10-28T19:57:09.019541] [INFO ] [MAIN ] MIR: Loaded 51414 existing records. [2025-10-28T19:57:09.244538] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:09.309734] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:09.309972] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-28T19:57:09.310035] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-28T19:57:09.310376] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-28T19:57:09.310438] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-28T19:57:09.585354] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-28T19:57:09.666434] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:10.011220] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T19:57:10.084120] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T19:57:10.092761] [INFO ] [REMOTE ] MHK: Full fetch complete (61448 records). [2025-10-28T19:57:10.092899] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-28T19:57:10.382959] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-28T19:57:10.475720] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-28T19:57:10.475796] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-28T19:57:10.476834] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-28T19:57:10.476902] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-28T19:57:10.478153] [DEBUG] [LOCAL ] MHK: Trimmed 61448 records to 41941 (keeping 200 days of data) [2025-10-28T19:57:10.720131] [DEBUG] [LOCAL ] MHK: Primary data saved (41941 records). [2025-10-28T19:57:10.720245] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-28T19:57:10.720319] [INFO ] [MAIN ] Update Progress: 1355/2366 symbols completed. MHK took 46.6s. Estimated remaining: 2h 12m 10s. Rate: 7.6 symbols/min [2025-10-28T19:57:10.887964] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:10.888143] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-28T19:57:10.888192] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-28T19:57:10.888294] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-28T19:57:10.888334] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-28T19:57:10.888374] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-28T19:57:10.888408] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-28T19:57:10.973015] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T19:57:11.185381] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-28T19:57:11.303262] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:11.980322] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-28T19:57:12.235114] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-28T19:57:12.437318] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:57:12.780265] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-28T19:57:13.580233] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-28T19:57:13.769874] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T19:57:14.380257] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-28T19:57:14.652820] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T19:57:14.951042] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T19:57:15.180267] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-28T19:57:15.980227] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-28T19:57:16.478556] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:57:16.780268] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-28T19:57:17.027435] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-28T19:57:17.288786] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:57:17.580242] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-28T19:57:18.240634] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T19:57:18.380235] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-28T19:57:19.120674] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T19:57:19.180253] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-28T19:57:19.980253] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-28T19:57:20.087079] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T19:57:20.091717] [INFO ] [REMOTE ] MHO: Full fetch complete (36351 records). [2025-10-28T19:57:20.091796] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-28T19:57:20.269836] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:57:20.464777] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-28T19:57:20.464850] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-28T19:57:20.465550] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-28T19:57:20.465588] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-28T19:57:20.466376] [DEBUG] [LOCAL ] MHO: Trimmed 36351 records to 23473 (keeping 200 days of data) [2025-10-28T19:57:20.601206] [DEBUG] [LOCAL ] MHO: Primary data saved (23473 records). [2025-10-28T19:57:20.601324] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-28T19:57:20.601396] [INFO ] [MAIN ] Update Progress: 1356/2366 symbols completed. MHO took 33.6s. Estimated remaining: 2h 12m 3s. Rate: 7.6 symbols/min [2025-10-28T19:57:20.767288] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:20.771346] [DEBUG] [LOCAL ] MITP: Loaded 2087 existing records from primary storage. [2025-10-28T19:57:20.771480] [INFO ] [MAIN ] MITP: Loaded 2087 existing records. [2025-10-28T19:57:20.785445] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-28T19:57:20.958998] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:20.959259] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-28T19:57:20.959307] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-28T19:57:20.959437] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-28T19:57:20.959474] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-28T19:57:21.315698] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:21.580290] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-28T19:57:21.902791] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T19:57:21.949491] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:57:22.380248] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-28T19:57:22.687543] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T19:57:23.180242] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-28T19:57:23.932254] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T19:57:23.980226] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-28T19:57:24.624921] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T19:57:24.780252] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-28T19:57:25.154059] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T19:57:25.580256] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-28T19:57:26.380265] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-28T19:57:26.762681] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T19:57:26.832488] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T19:57:27.180228] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-28T19:57:27.530499] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T19:57:27.980260] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-28T19:57:28.421708] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T19:57:28.780253] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-28T19:57:29.580244] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-28T19:57:29.899697] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:57:30.222079] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T19:57:30.225621] [INFO ] [REMOTE ] MIN: Full fetch complete (17732 records). [2025-10-28T19:57:30.225723] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-28T19:57:30.390046] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-28T19:57:30.656510] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-28T19:57:30.656585] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-28T19:57:30.657028] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-28T19:57:30.657090] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-28T19:57:30.657624] [DEBUG] [LOCAL ] MIN: Trimmed 17732 records to 13560 (keeping 200 days of data) [2025-10-28T19:57:30.741025] [DEBUG] [LOCAL ] MIN: Primary data saved (13560 records). [2025-10-28T19:57:30.741155] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-28T19:57:30.741233] [INFO ] [MAIN ] Update Progress: 1357/2366 symbols completed. MIN took 22.6s. Estimated remaining: 2h 11m 57s. Rate: 7.6 symbols/min [2025-10-28T19:57:30.746207] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T19:57:31.180341] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-28T19:57:31.980273] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-28T19:57:32.334630] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:57:32.388102] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T19:57:32.780281] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-28T19:57:33.267494] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T19:57:33.580310] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-28T19:57:33.815152] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-28T19:57:34.380259] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-28T19:57:34.617994] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-28T19:57:35.180323] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-28T19:57:35.980240] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-28T19:57:36.278977] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T19:57:36.516379] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T19:57:36.780279] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-28T19:57:37.040577] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-28T19:57:37.580268] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-28T19:57:38.380259] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-28T19:57:38.705526] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-28T19:57:38.820017] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:57:39.180250] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-28T19:57:39.461368] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T19:57:39.980252] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-28T19:57:40.780305] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-28T19:57:41.115994] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T19:57:41.116899] [INFO ] [REMOTE ] MITN: Full fetch complete (2329 records). [2025-10-28T19:57:41.116966] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-28T19:57:41.323253] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T19:57:41.323635] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:57:41.323766] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:57:41.323958] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-28T19:57:41.324214] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-28T19:57:41.324358] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-28T19:57:41.324488] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-28T19:57:41.324706] [INFO ] [MAIN ] Update Progress: 1358/2366 symbols completed. MITN took 30.6s. Estimated remaining: 2h 11m 51s. Rate: 7.6 symbols/min [2025-10-28T19:57:41.356294] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T19:57:41.580242] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-28T19:57:41.835391] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-28T19:57:42.380251] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-28T19:57:42.651859] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-28T19:57:43.180300] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-28T19:57:43.502360] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T19:57:43.503205] [INFO ] [REMOTE ] MITP: Full fetch complete (3196 records). [2025-10-28T19:57:43.503273] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-28T19:57:43.898858] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-28T19:57:43.898960] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-28T19:57:43.899115] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-28T19:57:43.899178] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-28T19:57:43.899783] [DEBUG] [LOCAL ] MITP: Trimmed 3196 records to 2084 (keeping 200 days of data) [2025-10-28T19:57:43.920046] [DEBUG] [LOCAL ] MITP: Primary data saved (2084 records). [2025-10-28T19:57:43.920207] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-28T19:57:43.920312] [INFO ] [MAIN ] Update Progress: 1359/2366 symbols completed. MITP took 23.3s. Estimated remaining: 2h 11m 40s. Rate: 7.6 symbols/min [2025-10-28T19:57:43.980291] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-28T19:57:45.454393] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T19:57:45.466549] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-28T19:57:47.012460] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T19:57:47.023320] [INFO ] [REMOTE ] MIR: Full fetch complete (74036 records). [2025-10-28T19:57:47.023452] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-28T19:57:47.409344] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-28T19:57:47.409419] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-28T19:57:47.410458] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-28T19:57:47.410521] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-28T19:57:47.411858] [DEBUG] [LOCAL ] MIR: Trimmed 74036 records to 51420 (keeping 200 days of data) [2025-10-28T19:57:47.708972] [DEBUG] [LOCAL ] MIR: Primary data saved (51420 records). [2025-10-28T19:57:47.709097] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-28T19:57:47.709173] [INFO ] [MAIN ] Update Progress: 1360/2366 symbols completed. MIR took 39.4s. Estimated remaining: 2h 11m 29s. Rate: 7.7 symbols/min [2025-10-28T19:57:48.324639] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:48.418471] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:48.447835] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:48.484919] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:57:48.499890] [DEBUG] [LOCAL ] MIY: Loaded 6145 existing records from primary storage. [2025-10-28T19:57:48.500411] [INFO ] [MAIN ] MIY: Loaded 6145 existing records. [2025-10-28T19:57:48.608981] [DEBUG] [LOCAL ] MITT: Loaded 21643 existing records from primary storage. [2025-10-28T19:57:48.690699] [DEBUG] [LOCAL ] MKL: Loaded 33390 existing records from primary storage. [2025-10-28T19:57:48.690984] [INFO ] [MAIN ] MITT: Loaded 21643 existing records. [2025-10-28T19:57:48.707077] [INFO ] [MAIN ] MKL: Loaded 33390 existing records. [2025-10-28T19:57:48.786134] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:48.872990] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-28T19:57:48.914612] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-28T19:57:48.973134] [DEBUG] [LOCAL ] MKC: Loaded 52496 existing records from primary storage. [2025-10-28T19:57:48.994521] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-28T19:57:49.020592] [INFO ] [MAIN ] MKC: Loaded 52496 existing records. [2025-10-28T19:57:49.031858] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-28T19:57:49.090420] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:49.161277] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-28T19:57:49.208799] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-28T19:57:49.245903] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:49.304119] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-28T19:57:49.304318] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-28T19:57:49.303577] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-28T19:57:49.359739] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-28T19:57:49.566101] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:57:49.552510] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-28T19:57:49.615494] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-28T19:57:49.635714] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-28T19:57:49.640974] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-28T19:57:49.715514] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-28T19:57:49.734257] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-28T19:57:50.538619] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:50.633909] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-28T19:57:50.680802] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:50.722331] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-28T19:57:50.851200] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:50.852346] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-28T19:57:50.931472] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:57:50.931792] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-28T19:57:51.191379] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T19:57:51.193407] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-28T19:57:51.601406] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:57:51.603091] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-28T19:57:51.682972] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:57:51.689081] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-28T19:57:51.955054] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:57:51.965056] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-28T19:57:51.965971] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T19:57:51.980215] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-28T19:57:52.297375] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:57:52.390774] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T19:57:52.555493] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T19:57:52.780258] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-28T19:57:52.884325] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T19:57:53.580287] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-28T19:57:54.099927] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T19:57:54.380223] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-28T19:57:54.579689] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T19:57:54.764707] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T19:57:55.180281] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-28T19:57:55.980258] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-28T19:57:56.204953] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:57:56.780308] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-28T19:57:56.806820] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T19:57:57.295751] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T19:57:57.580248] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-28T19:57:58.380287] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-28T19:57:58.757784] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T19:57:59.180303] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-28T19:57:59.716787] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T19:57:59.967163] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T19:57:59.980211] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-28T19:58:00.780299] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-28T19:58:01.580374] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-28T19:58:02.067092] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-28T19:58:02.380323] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-28T19:58:03.108092] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-28T19:58:03.180250] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-28T19:58:03.585699] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T19:58:03.631824] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:58:03.980264] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-28T19:58:04.192091] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:58:04.780257] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-28T19:58:04.840386] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T19:58:05.580264] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-28T19:58:05.836677] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:58:06.380272] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-28T19:58:06.833522] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T19:58:06.835472] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T19:58:07.180273] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-28T19:58:07.980289] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-28T19:58:08.463664] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:58:08.663738] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T19:58:08.780300] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-28T19:58:09.580277] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-28T19:58:10.101051] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:58:10.380826] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:58:10.380228] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-28T19:58:11.180308] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-28T19:58:11.555769] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T19:58:11.708772] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:58:11.980253] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-28T19:58:12.602372] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T19:58:12.604581] [INFO ] [REMOTE ] MIY: Full fetch complete (8650 records). [2025-10-28T19:58:12.604702] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-28T19:58:12.785381] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-28T19:58:12.965820] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-28T19:58:12.965899] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-28T19:58:12.966150] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-28T19:58:12.966212] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-28T19:58:12.966632] [DEBUG] [LOCAL ] MIY: Trimmed 8650 records to 6134 (keeping 200 days of data) [2025-10-28T19:58:13.002905] [DEBUG] [LOCAL ] MIY: Primary data saved (6134 records). [2025-10-28T19:58:13.003017] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-28T19:58:13.003119] [INFO ] [MAIN ] Update Progress: 1361/2366 symbols completed. MIY took 25.3s. Estimated remaining: 2h 11m 34s. Rate: 7.6 symbols/min [2025-10-28T19:58:13.171043] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:13.210475] [DEBUG] [LOCAL ] MLI: Loaded 43225 existing records from primary storage. [2025-10-28T19:58:13.210795] [INFO ] [MAIN ] MLI: Loaded 43225 existing records. [2025-10-28T19:58:13.388153] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:13.388403] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-28T19:58:13.388452] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-28T19:58:13.388685] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-28T19:58:13.388745] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-28T19:58:13.587617] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-28T19:58:13.735077] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:58:13.767976] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:14.380245] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-28T19:58:14.759905] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T19:58:15.180257] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-28T19:58:15.270932] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:58:15.275162] [INFO ] [REMOTE ] MITT: Full fetch complete (33029 records). [2025-10-28T19:58:15.275250] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-28T19:58:15.646056] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-28T19:58:15.646132] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-28T19:58:15.646797] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-28T19:58:15.646856] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-28T19:58:15.647581] [DEBUG] [LOCAL ] MITT: Trimmed 33029 records to 21509 (keeping 200 days of data) [2025-10-28T19:58:15.766944] [DEBUG] [LOCAL ] MITT: Primary data saved (21509 records). [2025-10-28T19:58:15.767058] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-28T19:58:15.767131] [INFO ] [MAIN ] Update Progress: 1362/2366 symbols completed. MITT took 28.1s. Estimated remaining: 2h 11m 22s. Rate: 7.6 symbols/min [2025-10-28T19:58:15.939281] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:15.970781] [DEBUG] [LOCAL ] MLM: Loaded 28252 existing records from primary storage. [2025-10-28T19:58:15.971320] [INFO ] [MAIN ] MLM: Loaded 28252 existing records. [2025-10-28T19:58:15.985427] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-28T19:58:16.151102] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:16.151453] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-28T19:58:16.151513] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-28T19:58:16.151971] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-28T19:58:16.152033] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-28T19:58:16.518902] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:16.541876] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T19:58:16.780221] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-28T19:58:17.316667] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:58:17.580247] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-28T19:58:17.650085] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:58:18.380256] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-28T19:58:18.670527] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T19:58:18.680104] [INFO ] [REMOTE ] MKL: Full fetch complete (49724 records). [2025-10-28T19:58:18.680284] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-28T19:58:19.088063] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-28T19:58:19.088239] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-28T19:58:19.089229] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-28T19:58:19.089436] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-28T19:58:19.090900] [DEBUG] [LOCAL ] MKL: Trimmed 49724 records to 33336 (keeping 200 days of data) [2025-10-28T19:58:19.180460] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-28T19:58:19.215453] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:58:19.240891] [INFO ] [REMOTE ] MKC: Full fetch complete (76019 records). [2025-10-28T19:58:19.252335] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-28T19:58:19.497523] [DEBUG] [LOCAL ] MKL: Primary data saved (33336 records). [2025-10-28T19:58:19.504164] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-28T19:58:19.519566] [INFO ] [MAIN ] Update Progress: 1363/2366 symbols completed. MKL took 31.8s. Estimated remaining: 2h 11m 11s. Rate: 7.6 symbols/min [2025-10-28T19:58:19.909941] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-28T19:58:19.909806] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:19.910068] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-28T19:58:19.911191] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-28T19:58:19.911498] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-28T19:58:19.912881] [DEBUG] [LOCAL ] MKC: Trimmed 76019 records to 52495 (keeping 200 days of data) [2025-10-28T19:58:20.004757] [DEBUG] [LOCAL ] MLP: Loaded 2938 existing records from primary storage. [2025-10-28T19:58:20.002300] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-28T19:58:20.005290] [INFO ] [MAIN ] MLP: Loaded 2938 existing records. [2025-10-28T19:58:20.224788] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:20.230120] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-28T19:58:20.230202] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-28T19:58:20.230364] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-28T19:58:20.230421] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-28T19:58:20.790983] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:20.808131] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-28T19:58:20.810676] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T19:58:20.841187] [DEBUG] [LOCAL ] MKC: Primary data saved (52495 records). [2025-10-28T19:58:20.841283] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-28T19:58:20.841848] [INFO ] [MAIN ] Update Progress: 1364/2366 symbols completed. MKC took 33.1s. Estimated remaining: 2h 10m 59s. Rate: 7.7 symbols/min [2025-10-28T19:58:21.006552] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:21.020406] [DEBUG] [LOCAL ] MLR: Loaded 11858 existing records from primary storage. [2025-10-28T19:58:21.020701] [INFO ] [MAIN ] MLR: Loaded 11858 existing records. [2025-10-28T19:58:21.206475] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:21.206983] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-28T19:58:21.207262] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-28T19:58:21.207443] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-28T19:58:21.207506] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-28T19:58:21.255861] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:58:21.514207] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T19:58:21.585333] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-28T19:58:21.624766] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:22.380303] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-28T19:58:22.784880] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:58:22.918211] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:58:23.180307] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-28T19:58:23.732776] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:58:23.980266] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-28T19:58:24.738134] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:58:24.780260] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-28T19:58:25.429759] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:58:25.580324] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-28T19:58:26.380238] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-28T19:58:26.720783] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:58:26.791695] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T19:58:27.180315] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-28T19:58:27.980338] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-28T19:58:28.334142] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T19:58:28.780307] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-28T19:58:29.365514] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T19:58:29.580219] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-28T19:58:29.779864] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T19:58:30.380217] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-28T19:58:30.589535] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:58:31.180295] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-28T19:58:31.282563] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T19:58:31.589681] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:58:31.980234] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-28T19:58:32.311121] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T19:58:32.780248] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-28T19:58:33.580241] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-28T19:58:33.927406] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T19:58:34.380226] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-28T19:58:34.480309] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:58:35.180262] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-28T19:58:35.561322] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:58:35.980238] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-28T19:58:36.017563] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T19:58:36.344159] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T19:58:36.780245] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-28T19:58:37.580274] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-28T19:58:37.900037] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:58:37.960502] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T19:58:38.380258] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-28T19:58:38.835685] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T19:58:39.180273] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-28T19:58:39.980263] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-28T19:58:40.227618] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:58:40.361350] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:58:40.780253] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-28T19:58:41.580313] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-28T19:58:42.111571] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:58:42.121414] [INFO ] [REMOTE ] MLI: Full fetch complete (63238 records). [2025-10-28T19:58:42.121554] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-28T19:58:42.385322] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-28T19:58:42.407087] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:58:42.544264] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-28T19:58:42.544355] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-28T19:58:42.545421] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-28T19:58:42.545486] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-28T19:58:42.546859] [DEBUG] [LOCAL ] MLI: Trimmed 63238 records to 43128 (keeping 200 days of data) [2025-10-28T19:58:42.770761] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T19:58:42.812019] [DEBUG] [LOCAL ] MLI: Primary data saved (43128 records). [2025-10-28T19:58:42.812144] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-28T19:58:42.812227] [INFO ] [MAIN ] Update Progress: 1365/2366 symbols completed. MLI took 29.8s. Estimated remaining: 2h 11m 1s. Rate: 7.6 symbols/min [2025-10-28T19:58:42.977700] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:43.025638] [DEBUG] [LOCAL ] MMC: Loaded 51895 existing records from primary storage. [2025-10-28T19:58:43.026014] [INFO ] [MAIN ] MMC: Loaded 51895 existing records. [2025-10-28T19:58:43.194441] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-28T19:58:43.199148] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:43.200252] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-28T19:58:43.200301] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-28T19:58:43.200696] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-28T19:58:43.200755] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-28T19:58:43.550801] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:43.641732] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T19:58:43.980309] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-28T19:58:44.780240] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-28T19:58:44.806086] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T19:58:45.193151] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T19:58:45.580300] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-28T19:58:46.194619] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T19:58:46.380352] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-28T19:58:46.970676] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T19:58:47.180267] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-28T19:58:47.851411] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:58:47.854459] [INFO ] [REMOTE ] MLR: Full fetch complete (18873 records). [2025-10-28T19:58:47.854557] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-28T19:58:47.985454] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-28T19:58:48.240061] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-28T19:58:48.240140] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-28T19:58:48.240534] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-28T19:58:48.240571] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-28T19:58:48.241204] [DEBUG] [LOCAL ] MLR: Trimmed 18873 records to 11797 (keeping 200 days of data) [2025-10-28T19:58:48.313158] [DEBUG] [LOCAL ] MLR: Primary data saved (11797 records). [2025-10-28T19:58:48.313289] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-28T19:58:48.313386] [INFO ] [MAIN ] Update Progress: 1366/2366 symbols completed. MLR took 27.5s. Estimated remaining: 2h 10m 52s. Rate: 7.6 symbols/min [2025-10-28T19:58:48.486266] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:48.501003] [DEBUG] [LOCAL ] MMD: Loaded 10594 existing records from primary storage. [2025-10-28T19:58:48.501223] [INFO ] [MAIN ] MMD: Loaded 10594 existing records. [2025-10-28T19:58:48.680809] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:48.684476] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-28T19:58:48.684317] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:58:48.684603] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-28T19:58:48.685939] [INFO ] [REMOTE ] MLP: Full fetch complete (4218 records). [2025-10-28T19:58:48.686054] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-28T19:58:48.686083] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-28T19:58:48.729165] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-28T19:58:48.790489] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-28T19:58:49.449975] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-28T19:58:49.449714] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:49.450153] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-28T19:58:49.450721] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-28T19:58:49.450790] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-28T19:58:49.451310] [DEBUG] [LOCAL ] MLP: Trimmed 4218 records to 2938 (keeping 200 days of data) [2025-10-28T19:58:49.470585] [DEBUG] [LOCAL ] MLP: Primary data saved (2938 records). [2025-10-28T19:58:49.470686] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-28T19:58:49.470777] [INFO ] [MAIN ] Update Progress: 1367/2366 symbols completed. MLP took 29.9s. Estimated remaining: 2h 10m 39s. Rate: 7.6 symbols/min [2025-10-28T19:58:49.585512] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-28T19:58:49.664749] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:49.681537] [DEBUG] [LOCAL ] MMI: Loaded 15152 existing records from primary storage. [2025-10-28T19:58:49.681820] [INFO ] [MAIN ] MMI: Loaded 15152 existing records. [2025-10-28T19:58:49.882620] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:58:49.883047] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-28T19:58:49.883160] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-28T19:58:49.883346] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-28T19:58:49.883399] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-28T19:58:49.981168] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:58:50.013453] [INFO ] [REMOTE ] MLM: Full fetch complete (44908 records). [2025-10-28T19:58:50.028972] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-28T19:58:50.383028] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-28T19:58:50.550976] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:50.661413] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-28T19:58:50.661478] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-28T19:58:50.662256] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-28T19:58:50.662315] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-28T19:58:50.663192] [DEBUG] [LOCAL ] MLM: Trimmed 44908 records to 28163 (keeping 200 days of data) [2025-10-28T19:58:50.838744] [DEBUG] [LOCAL ] MLM: Primary data saved (28163 records). [2025-10-28T19:58:50.838885] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-28T19:58:50.838996] [INFO ] [MAIN ] Update Progress: 1368/2366 symbols completed. MLM took 35.1s. Estimated remaining: 2h 10m 26s. Rate: 7.7 symbols/min [2025-10-28T19:58:51.036101] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:51.037685] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:58:51.037772] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-28T19:58:51.048047] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-28T19:58:51.048191] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-28T19:58:51.048235] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-28T19:58:51.048276] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-28T19:58:51.048307] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-28T19:58:51.185897] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-28T19:58:51.386816] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:58:51.416902] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:51.765552] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T19:58:51.980249] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-28T19:58:52.780288] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-28T19:58:53.266969] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:58:53.292944] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T19:58:53.580294] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-28T19:58:54.097427] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T19:58:54.380274] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-28T19:58:54.988209] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T19:58:55.180279] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-28T19:58:55.894551] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T19:58:55.980291] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-28T19:58:56.780301] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-28T19:58:57.332061] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:58:57.350016] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T19:58:57.580240] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-10-28T19:58:57.730512] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:58:57.730839] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-10-28T19:58:57.730924] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:58:57.730974] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-28T19:58:57.731037] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:58:57.731108] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-28T19:58:57.731172] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-28T19:58:57.731207] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-28T19:58:57.731246] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-28T19:58:57.731291] [INFO ] [MAIN ] Update Progress: 1369/2366 symbols completed. MMID took 6.9s. Estimated remaining: 2h 10m 18s. Rate: 7.7 symbols/min [2025-10-28T19:58:57.903994] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:58:57.904185] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-28T19:58:57.904225] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-28T19:58:57.904343] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-28T19:58:57.904386] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-28T19:58:57.904448] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-28T19:58:57.904481] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-28T19:58:58.269282] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:58:58.380283] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-28T19:58:58.719731] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:58:59.180287] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-28T19:58:59.461996] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T19:58:59.980280] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-28T19:59:00.780315] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-28T19:59:01.544972] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:59:01.580248] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-28T19:59:01.629749] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T19:59:01.854877] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T19:59:02.380270] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-28T19:59:02.662189] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T19:59:03.180275] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-28T19:59:03.869803] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:59:03.980273] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-28T19:59:04.532619] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T19:59:04.780248] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-28T19:59:05.580240] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-28T19:59:05.852418] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T19:59:06.112935] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:59:06.380269] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-28T19:59:07.108457] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T19:59:07.180314] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-28T19:59:07.515504] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T19:59:07.980282] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-28T19:59:08.243964] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T19:59:08.780297] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-28T19:59:09.580247] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-28T19:59:09.873208] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T19:59:10.173588] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T19:59:10.380283] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-28T19:59:10.602547] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-28T19:59:11.180265] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-28T19:59:11.768529] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T19:59:11.769550] [INFO ] [REMOTE ] MMKT: Full fetch complete (2152 records). [2025-10-28T19:59:11.769626] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-28T19:59:11.965037] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T19:59:11.965267] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:59:11.965336] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:59:11.965406] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-28T19:59:11.965468] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-28T19:59:11.965503] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-28T19:59:11.965542] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-28T19:59:11.965595] [INFO ] [MAIN ] Update Progress: 1370/2366 symbols completed. MMKT took 14.2s. Estimated remaining: 2h 10m 15s. Rate: 7.6 symbols/min [2025-10-28T19:59:11.990742] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-28T19:59:12.143722] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:12.194741] [DEBUG] [LOCAL ] MMM: Loaded 53110 existing records from primary storage. [2025-10-28T19:59:12.195062] [INFO ] [MAIN ] MMM: Loaded 53110 existing records. [2025-10-28T19:59:12.374143] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:59:12.374376] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-28T19:59:12.374433] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-28T19:59:12.374747] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-28T19:59:12.374804] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-28T19:59:12.734122] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:12.780218] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-28T19:59:13.580261] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-28T19:59:14.094047] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T19:59:14.210360] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T19:59:14.380287] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-28T19:59:15.180260] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-28T19:59:15.652111] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (3.66 seconds). [2025-10-28T19:59:15.786385] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:59:15.980230] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-28T19:59:16.590461] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:59:16.718952] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T19:59:16.780247] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-28T19:59:17.580247] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-28T19:59:18.116250] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:59:18.380318] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-28T19:59:18.963090] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:59:19.180255] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-28T19:59:19.231722] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T19:59:19.980259] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-28T19:59:20.780324] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-28T19:59:20.888826] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T19:59:21.429733] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T19:59:21.588057] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-28T19:59:21.590847] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T19:59:22.122815] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:59:22.380251] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-28T19:59:23.033617] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T19:59:23.036145] [INFO ] [REMOTE ] MMD: Full fetch complete (16858 records). [2025-10-28T19:59:23.036215] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-28T19:59:23.185313] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-28T19:59:23.418976] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-28T19:59:23.419059] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-28T19:59:23.419439] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-28T19:59:23.419483] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-28T19:59:23.419991] [DEBUG] [LOCAL ] MMD: Trimmed 16858 records to 10584 (keeping 200 days of data) [2025-10-28T19:59:23.485295] [DEBUG] [LOCAL ] MMD: Primary data saved (10584 records). [2025-10-28T19:59:23.485436] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-28T19:59:23.485528] [INFO ] [MAIN ] Update Progress: 1371/2366 symbols completed. MMD took 35.2s. Estimated remaining: 2h 10m 9s. Rate: 7.6 symbols/min [2025-10-28T19:59:23.660605] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:23.693155] [DEBUG] [LOCAL ] MMS: Loaded 33129 existing records from primary storage. [2025-10-28T19:59:23.693445] [INFO ] [MAIN ] MMS: Loaded 33129 existing records. [2025-10-28T19:59:23.872608] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:59:23.872829] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-28T19:59:23.872875] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-28T19:59:23.873046] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-28T19:59:23.873084] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-28T19:59:23.985334] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-28T19:59:24.234928] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:24.787575] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-28T19:59:24.806768] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T19:59:25.388717] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:59:25.580232] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-28T19:59:25.646936] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T19:59:25.663464] [INFO ] [REMOTE ] MMC: Full fetch complete (75235 records). [2025-10-28T19:59:25.663707] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-28T19:59:26.053883] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-28T19:59:26.053964] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-28T19:59:26.055033] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-28T19:59:26.055094] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-28T19:59:26.056493] [DEBUG] [LOCAL ] MMC: Trimmed 75235 records to 51895 (keeping 200 days of data) [2025-10-28T19:59:26.382001] [DEBUG] [LOCAL ] MMC: Primary data saved (51895 records). [2025-10-28T19:59:26.380308] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-28T19:59:26.382373] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-28T19:59:26.383352] [INFO ] [MAIN ] Update Progress: 1372/2366 symbols completed. MMC took 43.6s. Estimated remaining: 2h 9m 58s. Rate: 7.6 symbols/min [2025-10-28T19:59:26.572263] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:26.584593] [DEBUG] [LOCAL ] MMT: Loaded 9961 existing records from primary storage. [2025-10-28T19:59:26.584903] [INFO ] [MAIN ] MMT: Loaded 9961 existing records. [2025-10-28T19:59:26.770832] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:59:26.771381] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-28T19:59:26.771510] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-28T19:59:26.771886] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-28T19:59:26.771944] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-28T19:59:26.906870] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:59:27.184405] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:27.184556] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-28T19:59:27.987210] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-28T19:59:27.992404] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T19:59:28.132821] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T19:59:28.620443] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T19:59:28.780253] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-28T19:59:29.580265] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-28T19:59:30.365512] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T19:59:30.380206] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-28T19:59:30.418106] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:59:30.421959] [INFO ] [REMOTE ] MMI: Full fetch complete (21941 records). [2025-10-28T19:59:30.422033] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-28T19:59:30.780033] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-28T19:59:30.780107] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-28T19:59:30.780634] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-28T19:59:30.780717] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-28T19:59:30.781287] [DEBUG] [LOCAL ] MMI: Trimmed 21941 records to 15038 (keeping 200 days of data) [2025-10-28T19:59:30.870824] [DEBUG] [LOCAL ] MMI: Primary data saved (15038 records). [2025-10-28T19:59:30.870952] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-28T19:59:30.871027] [INFO ] [MAIN ] Update Progress: 1373/2366 symbols completed. MMI took 41.4s. Estimated remaining: 2h 9m 48s. Rate: 7.7 symbols/min [2025-10-28T19:59:31.036353] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:31.053192] [DEBUG] [LOCAL ] MMU: Loaded 16573 existing records from primary storage. [2025-10-28T19:59:31.053424] [INFO ] [MAIN ] MMU: Loaded 16573 existing records. [2025-10-28T19:59:31.193473] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-28T19:59:31.233157] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:59:31.233360] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-28T19:59:31.233413] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-28T19:59:31.233603] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-28T19:59:31.233715] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-28T19:59:31.577975] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:31.947322] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T19:59:31.980210] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-28T19:59:32.409225] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:59:32.780247] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-28T19:59:33.285927] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T19:59:33.529539] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:59:33.580236] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-28T19:59:34.289215] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:59:34.380214] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-28T19:59:35.180243] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-28T19:59:35.980239] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-28T19:59:36.156895] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T19:59:36.167850] [INFO ] [REMOTE ] MMM: Full fetch complete (77219 records). [2025-10-28T19:59:36.167984] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-28T19:59:36.568110] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-28T19:59:36.568337] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-28T19:59:36.594833] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-28T19:59:36.597958] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T19:59:36.598188] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-28T19:59:36.602137] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:59:36.611891] [DEBUG] [LOCAL ] MMM: Trimmed 77219 records to 53108 (keeping 200 days of data) [2025-10-28T19:59:36.787331] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-28T19:59:36.938065] [DEBUG] [LOCAL ] MMM: Primary data saved (53108 records). [2025-10-28T19:59:36.938208] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-28T19:59:36.939052] [INFO ] [MAIN ] Update Progress: 1374/2366 symbols completed. MMM took 25.0s. Estimated remaining: 2h 9m 39s. Rate: 7.7 symbols/min [2025-10-28T19:59:37.105747] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:37.130260] [DEBUG] [LOCAL ] MNR: Loaded 24744 existing records from primary storage. [2025-10-28T19:59:37.130484] [INFO ] [MAIN ] MNR: Loaded 24744 existing records. [2025-10-28T19:59:37.307359] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:59:37.307570] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-28T19:59:37.307616] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-28T19:59:37.307812] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-28T19:59:37.307861] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-28T19:59:37.585542] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-28T19:59:37.686200] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:37.790541] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T19:59:38.380227] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-28T19:59:38.394373] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T19:59:39.180258] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-28T19:59:39.299702] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:59:39.980245] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-28T19:59:40.263719] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T19:59:40.780247] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-28T19:59:40.967441] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:59:41.343828] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T19:59:41.580244] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-28T19:59:42.287887] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T19:59:42.380272] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-28T19:59:43.180215] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-28T19:59:43.396282] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:59:43.877160] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T19:59:43.980237] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-28T19:59:44.780252] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-28T19:59:45.023458] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T19:59:45.580235] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-28T19:59:45.843761] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T19:59:46.261066] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:59:46.380260] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-28T19:59:47.076925] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T19:59:47.180244] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-28T19:59:47.900738] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T19:59:47.980251] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-28T19:59:48.654853] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:59:48.780233] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-28T19:59:49.424955] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:59:49.580238] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-28T19:59:50.256469] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T19:59:50.380251] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-28T19:59:51.180257] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-28T19:59:51.500299] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T19:59:51.909008] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T19:59:51.980219] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-28T19:59:52.780218] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-28T19:59:52.833952] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:59:53.580245] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-28T19:59:53.901959] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T19:59:53.909175] [INFO ] [REMOTE ] MMS: Full fetch complete (50782 records). [2025-10-28T19:59:53.909342] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-28T19:59:54.381225] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-28T19:59:54.523245] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-28T19:59:54.523475] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-28T19:59:54.525049] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-28T19:59:54.525248] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-28T19:59:54.527218] [DEBUG] [LOCAL ] MMS: Trimmed 50782 records to 32977 (keeping 200 days of data) [2025-10-28T19:59:54.660798] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:59:54.810844] [DEBUG] [LOCAL ] MMS: Primary data saved (32977 records). [2025-10-28T19:59:54.811004] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-28T19:59:54.811091] [INFO ] [MAIN ] Update Progress: 1375/2366 symbols completed. MMS took 31.3s. Estimated remaining: 2h 9m 38s. Rate: 7.6 symbols/min [2025-10-28T19:59:55.006356] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:55.049982] [DEBUG] [LOCAL ] MNSO: Loaded 43635 existing records from primary storage. [2025-10-28T19:59:55.050305] [INFO ] [MAIN ] MNSO: Loaded 43635 existing records. [2025-10-28T19:59:55.198163] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-28T19:59:55.225862] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T19:59:55.254326] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:59:55.259869] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-28T19:59:55.260284] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-28T19:59:55.260503] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-28T19:59:55.260544] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-28T19:59:55.640190] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:55.980227] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-28T19:59:56.142093] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T19:59:56.720025] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T19:59:56.780268] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-28T19:59:57.580274] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-28T19:59:57.638885] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T19:59:57.642516] [INFO ] [REMOTE ] MMU: Full fetch complete (24841 records). [2025-10-28T19:59:57.642586] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-28T19:59:58.018581] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-28T19:59:58.018703] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-28T19:59:58.019350] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-28T19:59:58.019409] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-28T19:59:58.020030] [DEBUG] [LOCAL ] MMU: Trimmed 24841 records to 16459 (keeping 200 days of data) [2025-10-28T19:59:58.107090] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T19:59:58.129986] [DEBUG] [LOCAL ] MMU: Primary data saved (16459 records). [2025-10-28T19:59:58.131109] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-28T19:59:58.131242] [INFO ] [MAIN ] Update Progress: 1376/2366 symbols completed. MMU took 27.3s. Estimated remaining: 2h 9m 27s. Rate: 7.6 symbols/min [2025-10-28T19:59:58.303359] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:58.303540] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-28T19:59:58.303599] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-28T19:59:58.303733] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-28T19:59:58.303776] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-28T19:59:58.303815] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-28T19:59:58.303846] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-28T19:59:58.385530] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-28T19:59:58.656730] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:59.180309] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-10-28T19:59:59.334971] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:59:59.335238] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-10-28T19:59:59.335323] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:59:59.335370] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-28T19:59:59.335429] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:59:59.335498] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-28T19:59:59.335560] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-28T19:59:59.335595] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-28T19:59:59.335633] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-28T19:59:59.335721] [INFO ] [MAIN ] Update Progress: 1377/2366 symbols completed. MNTN took 1.2s. Estimated remaining: 2h 9m 14s. Rate: 7.7 symbols/min [2025-10-28T19:59:59.507298] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:59:59.507477] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-28T19:59:59.507513] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-28T19:59:59.507617] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-28T19:59:59.507684] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-28T19:59:59.507741] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-28T19:59:59.507773] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-28T19:59:59.866940] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:59:59.915619] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T19:59:59.980222] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-28T20:00:00.780273] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-28T20:00:01.580267] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-28T20:00:01.894592] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T20:00:02.074501] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T20:00:02.320338] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T20:00:02.380283] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-28T20:00:03.139208] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:00:03.141666] [INFO ] [REMOTE ] MMT: Full fetch complete (15919 records). [2025-10-28T20:00:03.141787] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-28T20:00:03.185462] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-28T20:00:03.544015] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-28T20:00:03.544103] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-28T20:00:03.544499] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-28T20:00:03.544545] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-28T20:00:03.545265] [DEBUG] [LOCAL ] MMT: Trimmed 15919 records to 9815 (keeping 200 days of data) [2025-10-28T20:00:03.603751] [DEBUG] [LOCAL ] MMT: Primary data saved (9815 records). [2025-10-28T20:00:03.603897] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-28T20:00:03.603981] [INFO ] [MAIN ] Update Progress: 1378/2366 symbols completed. MMT took 37.2s. Estimated remaining: 2h 9m 4s. Rate: 7.7 symbols/min [2025-10-28T20:00:03.787810] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:03.840380] [DEBUG] [LOCAL ] MOD: Loaded 44245 existing records from primary storage. [2025-10-28T20:00:03.840727] [INFO ] [MAIN ] MOD: Loaded 44245 existing records. [2025-10-28T20:00:03.985420] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-28T20:00:04.021676] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:04.022034] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-28T20:00:04.022097] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-28T20:00:04.022274] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-28T20:00:04.022313] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-28T20:00:04.402298] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:04.780251] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-28T20:00:04.938329] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T20:00:05.580222] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-28T20:00:05.653452] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-28T20:00:06.324889] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T20:00:06.380324] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-28T20:00:07.099083] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T20:00:07.180258] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-28T20:00:07.729862] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T20:00:07.980307] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-28T20:00:08.589333] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T20:00:08.780266] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-28T20:00:09.363054] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T20:00:09.580278] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-28T20:00:10.143442] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T20:00:10.380255] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-28T20:00:11.180256] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-28T20:00:11.927712] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T20:00:11.991906] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-28T20:00:11.997901] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-28T20:00:12.780307] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-28T20:00:13.257879] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-28T20:00:13.580302] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-28T20:00:14.380294] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-28T20:00:14.669125] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T20:00:14.734506] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:00:15.049404] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (3.06 seconds). [2025-10-28T20:00:15.180262] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-28T20:00:15.308597] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T20:00:15.314438] [INFO ] [REMOTE ] MNR: Full fetch complete (37201 records). [2025-10-28T20:00:15.314586] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-28T20:00:15.706223] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-28T20:00:15.706330] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-28T20:00:15.707141] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-28T20:00:15.707206] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-28T20:00:15.708186] [DEBUG] [LOCAL ] MNR: Trimmed 37201 records to 24820 (keeping 200 days of data) [2025-10-28T20:00:15.857433] [DEBUG] [LOCAL ] MNR: Primary data saved (24820 records). [2025-10-28T20:00:15.857560] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-28T20:00:15.857660] [INFO ] [MAIN ] Update Progress: 1379/2366 symbols completed. MNR took 38.9s. Estimated remaining: 2h 8m 59s. Rate: 7.7 symbols/min [2025-10-28T20:00:15.994702] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-28T20:00:16.026965] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:16.074283] [DEBUG] [LOCAL ] MODG: Loaded 51468 existing records from primary storage. [2025-10-28T20:00:16.074602] [INFO ] [MAIN ] MODG: Loaded 51468 existing records. [2025-10-28T20:00:16.249732] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:16.249986] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-28T20:00:16.250032] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-28T20:00:16.250301] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-28T20:00:16.250358] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-28T20:00:16.604180] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:16.780286] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-28T20:00:17.111305] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-28T20:00:17.276727] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T20:00:17.580257] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-28T20:00:17.897479] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T20:00:18.380305] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-28T20:00:18.825290] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:00:19.180318] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-28T20:00:19.764388] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:00:19.980253] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-28T20:00:20.463045] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:00:20.780282] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-28T20:00:21.336706] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T20:00:21.580287] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-28T20:00:22.258402] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T20:00:22.267481] [INFO ] [REMOTE ] MNSO: Full fetch complete (64320 records). [2025-10-28T20:00:22.267632] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-28T20:00:22.385380] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-28T20:00:22.674154] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-28T20:00:22.674237] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-28T20:00:22.675215] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-28T20:00:22.675280] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-28T20:00:22.676589] [DEBUG] [LOCAL ] MNSO: Trimmed 64320 records to 43522 (keeping 200 days of data) [2025-10-28T20:00:22.958901] [DEBUG] [LOCAL ] MNSO: Primary data saved (43522 records). [2025-10-28T20:00:22.959052] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-28T20:00:22.959866] [INFO ] [MAIN ] Update Progress: 1380/2366 symbols completed. MNSO took 28.1s. Estimated remaining: 2h 8m 51s. Rate: 7.7 symbols/min [2025-10-28T20:00:22.972505] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T20:00:23.136628] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:23.179492] [DEBUG] [LOCAL ] MOH: Loaded 43173 existing records from primary storage. [2025-10-28T20:00:23.179804] [INFO ] [MAIN ] MOH: Loaded 43173 existing records. [2025-10-28T20:00:23.190819] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-28T20:00:23.357084] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:23.357268] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-28T20:00:23.357313] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-28T20:00:23.357763] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-28T20:00:23.357822] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-28T20:00:23.707913] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:23.980223] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-28T20:00:24.206856] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T20:00:24.529174] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T20:00:24.780299] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-28T20:00:25.096746] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:00:25.580255] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-28T20:00:26.144763] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T20:00:26.380275] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-28T20:00:27.180321] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-28T20:00:27.638462] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-28T20:00:27.945011] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T20:00:27.953726] [INFO ] [REMOTE ] MOD: Full fetch complete (66544 records). [2025-10-28T20:00:27.953895] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-28T20:00:27.985523] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-28T20:00:28.347672] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-28T20:00:28.347759] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-28T20:00:28.348764] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-28T20:00:28.348826] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-28T20:00:28.350706] [DEBUG] [LOCAL ] MOD: Trimmed 66544 records to 44234 (keeping 200 days of data) [2025-10-28T20:00:28.644561] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T20:00:28.658891] [DEBUG] [LOCAL ] MOD: Primary data saved (44234 records). [2025-10-28T20:00:28.658975] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-28T20:00:28.659044] [INFO ] [MAIN ] Update Progress: 1381/2366 symbols completed. MOD took 25.1s. Estimated remaining: 2h 8m 41s. Rate: 7.7 symbols/min [2025-10-28T20:00:28.785317] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-28T20:00:28.832894] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:28.884597] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-28T20:00:28.884919] [INFO ] [MAIN ] MOS: Loaded 53511 existing records. [2025-10-28T20:00:29.063018] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:29.063208] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-28T20:00:29.063254] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-28T20:00:29.063449] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-28T20:00:29.063505] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-28T20:00:29.410962] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:29.580253] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-28T20:00:29.935112] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-28T20:00:30.133781] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T20:00:30.380244] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-28T20:00:30.844776] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T20:00:31.180305] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-28T20:00:31.980247] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-28T20:00:32.091167] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T20:00:32.650306] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:00:32.780260] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-28T20:00:33.126047] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T20:00:33.580248] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-28T20:00:34.167626] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T20:00:34.380271] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-28T20:00:34.965205] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:00:35.180252] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-28T20:00:35.834454] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:00:35.980246] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-28T20:00:36.618463] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:00:36.780236] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-28T20:00:37.026904] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T20:00:37.580234] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-28T20:00:38.175457] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T20:00:38.380265] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-28T20:00:39.180260] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-28T20:00:39.678143] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T20:00:39.689387] [INFO ] [REMOTE ] MO: Full fetch complete (77542 records). [2025-10-28T20:00:39.689515] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-28T20:00:39.934251] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:00:39.932599] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:00:39.944511] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:00:39.945084] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:00:39.945482] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-28T20:00:39.945562] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-28T20:00:39.945603] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-28T20:00:39.945680] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-28T20:00:39.945766] [INFO ] [MAIN ] Update Progress: 1382/2366 symbols completed. MO took 40.6s. Estimated remaining: 2h 8m 36s. Rate: 7.7 symbols/min [2025-10-28T20:00:39.988211] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-28T20:00:40.121399] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:40.145584] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:00:40.169566] [DEBUG] [LOCAL ] MOV: Loaded 20617 existing records from primary storage. [2025-10-28T20:00:40.169832] [INFO ] [MAIN ] MOV: Loaded 20617 existing records. [2025-10-28T20:00:40.351045] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:40.351310] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-28T20:00:40.351415] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-28T20:00:40.351638] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-28T20:00:40.351750] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-28T20:00:40.712768] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:40.780216] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-28T20:00:41.537711] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:00:41.580240] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-28T20:00:41.659809] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T20:00:42.300604] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:00:42.380285] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-28T20:00:43.180307] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-28T20:00:43.836575] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T20:00:43.980263] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-28T20:00:44.512375] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T20:00:44.780247] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-28T20:00:45.571725] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:00:45.582355] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-28T20:00:46.380373] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-28T20:00:46.445923] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T20:00:46.462243] [INFO ] [REMOTE ] MODG: Full fetch complete (74759 records). [2025-10-28T20:00:46.462476] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-28T20:00:47.031367] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-28T20:00:47.031597] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-28T20:00:47.032920] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-28T20:00:47.033007] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-28T20:00:47.034888] [DEBUG] [LOCAL ] MODG: Trimmed 74759 records to 51428 (keeping 200 days of data) [2025-10-28T20:00:47.153824] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T20:00:47.180460] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-28T20:00:47.380414] [DEBUG] [LOCAL ] MODG: Primary data saved (51428 records). [2025-10-28T20:00:47.380540] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-28T20:00:47.380614] [INFO ] [MAIN ] Update Progress: 1383/2366 symbols completed. MODG took 31.5s. Estimated remaining: 2h 8m 28s. Rate: 7.7 symbols/min [2025-10-28T20:00:47.547841] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:47.597550] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-28T20:00:47.597901] [INFO ] [MAIN ] MP: Loaded 53744 existing records. [2025-10-28T20:00:47.781471] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:47.781701] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-28T20:00:47.781757] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-28T20:00:47.782175] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-28T20:00:47.782232] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-28T20:00:47.984756] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-28T20:00:48.081012] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-28T20:00:48.205254] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:48.206726] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T20:00:48.780239] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-28T20:00:49.585393] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-28T20:00:49.612857] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T20:00:50.107078] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T20:00:50.380300] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-28T20:00:50.644350] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T20:00:51.180296] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-28T20:00:51.980277] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-28T20:00:52.069033] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T20:00:52.078522] [INFO ] [REMOTE ] MOH: Full fetch complete (60503 records). [2025-10-28T20:00:52.078711] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-28T20:00:52.458866] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-28T20:00:52.459010] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-28T20:00:52.459998] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-28T20:00:52.460076] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-28T20:00:52.461362] [DEBUG] [LOCAL ] MOH: Trimmed 60503 records to 43224 (keeping 200 days of data) [2025-10-28T20:00:52.729873] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T20:00:52.761033] [DEBUG] [LOCAL ] MOH: Primary data saved (43224 records). [2025-10-28T20:00:52.772739] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-28T20:00:52.773543] [INFO ] [MAIN ] Update Progress: 1384/2366 symbols completed. MOH took 29.8s. Estimated remaining: 2h 8m 18s. Rate: 7.7 symbols/min [2025-10-28T20:00:52.785604] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-28T20:00:52.897683] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T20:00:52.970947] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:00:52.978881] [DEBUG] [LOCAL ] MPA: Loaded 5098 existing records from primary storage. [2025-10-28T20:00:52.979081] [INFO ] [MAIN ] MPA: Loaded 5098 existing records. [2025-10-28T20:00:53.151206] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:00:53.151427] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-28T20:00:53.151473] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-28T20:00:53.151615] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-28T20:00:53.151697] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-28T20:00:53.500213] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:00:53.580323] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-28T20:00:53.950219] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T20:00:54.232297] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:00:54.380274] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-28T20:00:55.180276] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-28T20:00:55.971363] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T20:00:55.980727] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-28T20:00:56.683766] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T20:00:56.762710] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T20:00:56.780221] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-28T20:00:57.542911] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:00:57.580219] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-28T20:00:58.344444] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T20:00:58.380207] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-28T20:00:59.180223] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-28T20:00:59.226723] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T20:00:59.626856] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T20:00:59.980312] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-28T20:01:00.780297] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-28T20:01:01.518152] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T20:01:01.580292] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-28T20:01:01.890715] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T20:01:01.895063] [INFO ] [REMOTE ] MOV: Full fetch complete (30375 records). [2025-10-28T20:01:01.895196] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-28T20:01:02.290554] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-28T20:01:02.290628] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-28T20:01:02.291258] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-28T20:01:02.291307] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-28T20:01:02.292030] [DEBUG] [LOCAL ] MOV: Trimmed 30375 records to 20464 (keeping 200 days of data) [2025-10-28T20:01:02.380280] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-28T20:01:02.416134] [DEBUG] [LOCAL ] MOV: Primary data saved (20464 records). [2025-10-28T20:01:02.416238] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-28T20:01:02.416312] [INFO ] [MAIN ] Update Progress: 1385/2366 symbols completed. MOV took 22.5s. Estimated remaining: 2h 8m 12s. Rate: 7.7 symbols/min [2025-10-28T20:01:02.584381] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:02.633462] [DEBUG] [LOCAL ] MPC: Loaded 51791 existing records from primary storage. [2025-10-28T20:01:02.633781] [INFO ] [MAIN ] MPC: Loaded 51791 existing records. [2025-10-28T20:01:02.802816] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T20:01:02.823638] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:02.824827] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-28T20:01:02.825497] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-28T20:01:02.826993] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-28T20:01:02.827053] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-28T20:01:03.176729] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:03.180210] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-28T20:01:03.402914] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T20:01:03.413811] [INFO ] [REMOTE ] MOS: Full fetch complete (77625 records). [2025-10-28T20:01:03.413949] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-28T20:01:03.837990] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-28T20:01:03.838082] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-28T20:01:03.839234] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-28T20:01:03.839309] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-28T20:01:03.840821] [DEBUG] [LOCAL ] MOS: Trimmed 77625 records to 53505 (keeping 200 days of data) [2025-10-28T20:01:04.012689] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-28T20:01:04.164933] [DEBUG] [LOCAL ] MOS: Primary data saved (53505 records). [2025-10-28T20:01:04.165073] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-28T20:01:04.165152] [INFO ] [MAIN ] Update Progress: 1386/2366 symbols completed. MOS took 35.5s. Estimated remaining: 2h 7m 60s. Rate: 7.7 symbols/min [2025-10-28T20:01:04.333784] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:04.404803] [DEBUG] [LOCAL ] MPLX: Loaded 50731 existing records from primary storage. [2025-10-28T20:01:04.405242] [INFO ] [MAIN ] MPLX: Loaded 50731 existing records. [2025-10-28T20:01:04.607242] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T20:01:04.611092] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:04.614067] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-28T20:01:04.614153] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-28T20:01:04.614528] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-28T20:01:04.614726] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-28T20:01:04.791749] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-28T20:01:04.986741] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T20:01:05.031191] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:05.328687] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T20:01:05.580241] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-28T20:01:06.380253] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-28T20:01:06.978276] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T20:01:07.180265] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-28T20:01:07.770564] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T20:01:07.980262] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-28T20:01:08.553594] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:01:08.780278] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-28T20:01:09.103535] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-28T20:01:09.175682] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T20:01:09.580244] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-28T20:01:10.380261] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-28T20:01:10.797286] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T20:01:10.957216] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T20:01:11.180319] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-28T20:01:11.578159] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T20:01:11.980250] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-28T20:01:12.780301] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-28T20:01:13.580247] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-28T20:01:13.852608] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-28T20:01:14.100386] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T20:01:14.170010] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T20:01:14.380244] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-28T20:01:14.989107] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T20:01:14.990520] [INFO ] [REMOTE ] MPA: Full fetch complete (7086 records). [2025-10-28T20:01:14.990590] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-28T20:01:15.186154] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-28T20:01:15.392888] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-28T20:01:15.392981] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-28T20:01:15.393189] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-28T20:01:15.393230] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-28T20:01:15.393797] [DEBUG] [LOCAL ] MPA: Trimmed 7086 records to 5049 (keeping 200 days of data) [2025-10-28T20:01:15.427968] [DEBUG] [LOCAL ] MPA: Primary data saved (5049 records). [2025-10-28T20:01:15.428104] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-28T20:01:15.428186] [INFO ] [MAIN ] Update Progress: 1387/2366 symbols completed. MPA took 22.7s. Estimated remaining: 2h 7m 54s. Rate: 7.7 symbols/min [2025-10-28T20:01:15.647293] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:15.655480] [DEBUG] [LOCAL ] MPV: Loaded 4296 existing records from primary storage. [2025-10-28T20:01:15.655910] [INFO ] [MAIN ] MPV: Loaded 4296 existing records. [2025-10-28T20:01:15.846068] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:15.846260] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-28T20:01:15.846306] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-28T20:01:15.846449] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-28T20:01:15.846504] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-28T20:01:15.986095] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-28T20:01:16.207215] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:16.780289] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-28T20:01:16.891756] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T20:01:17.411127] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T20:01:17.580296] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-28T20:01:18.032785] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-28T20:01:18.033736] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T20:01:18.380252] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-28T20:01:18.933892] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T20:01:19.180258] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-28T20:01:19.571459] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T20:01:19.980250] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-28T20:01:20.780256] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-28T20:01:21.201495] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T20:01:21.441910] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T20:01:21.580245] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-28T20:01:22.380308] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-28T20:01:22.823073] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:01:23.180240] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-28T20:01:23.414030] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T20:01:23.980263] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-28T20:01:24.597092] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T20:01:24.780273] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-28T20:01:25.528696] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T20:01:25.580205] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-28T20:01:26.020424] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T20:01:26.380298] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-28T20:01:26.768277] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T20:01:27.065948] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T20:01:27.180260] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-28T20:01:27.980356] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-28T20:01:28.614760] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T20:01:28.780253] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-28T20:01:29.580248] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-28T20:01:29.973086] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T20:01:30.049985] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-28T20:01:30.153271] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T20:01:30.380262] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-28T20:01:31.180275] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-28T20:01:31.980242] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-28T20:01:32.633364] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T20:01:32.699208] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-28T20:01:32.780274] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-28T20:01:33.388046] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T20:01:33.580270] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-28T20:01:34.380297] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-28T20:01:34.776191] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T20:01:35.186193] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-28T20:01:35.218461] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T20:01:35.231390] [INFO ] [REMOTE ] MPLX: Full fetch complete (74342 records). [2025-10-28T20:01:35.259779] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-28T20:01:35.261946] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-28T20:01:35.677612] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-28T20:01:35.677741] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-28T20:01:35.678837] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-28T20:01:35.678899] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-28T20:01:35.680492] [DEBUG] [LOCAL ] MPLX: Trimmed 74342 records to 50719 (keeping 200 days of data) [2025-10-28T20:01:35.980278] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-28T20:01:35.988170] [DEBUG] [LOCAL ] MPLX: Primary data saved (50719 records). [2025-10-28T20:01:35.989087] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-28T20:01:35.989186] [INFO ] [MAIN ] Update Progress: 1388/2366 symbols completed. MPLX took 31.8s. Estimated remaining: 2h 7m 55s. Rate: 7.6 symbols/min [2025-10-28T20:01:36.163279] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:36.213844] [DEBUG] [LOCAL ] MPW: Loaded 53481 existing records from primary storage. [2025-10-28T20:01:36.214167] [INFO ] [MAIN ] MPW: Loaded 53481 existing records. [2025-10-28T20:01:36.394079] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:36.394333] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-28T20:01:36.394380] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-28T20:01:36.394588] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-28T20:01:36.394681] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-28T20:01:36.770602] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:36.788102] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-28T20:01:36.818551] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T20:01:37.580281] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-28T20:01:38.135091] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T20:01:38.136488] [INFO ] [REMOTE ] MPV: Full fetch complete (7590 records). [2025-10-28T20:01:38.136560] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-28T20:01:38.381947] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-28T20:01:38.537165] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-28T20:01:38.537483] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-28T20:01:38.538065] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-28T20:01:38.538173] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-28T20:01:38.539163] [DEBUG] [LOCAL ] MPV: Trimmed 7590 records to 4290 (keeping 200 days of data) [2025-10-28T20:01:38.569508] [DEBUG] [LOCAL ] MPV: Primary data saved (4290 records). [2025-10-28T20:01:38.569879] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-28T20:01:38.570252] [INFO ] [MAIN ] Update Progress: 1389/2366 symbols completed. MPV took 23.1s. Estimated remaining: 2h 7m 44s. Rate: 7.6 symbols/min [2025-10-28T20:01:38.679466] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-28T20:01:38.822030] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-28T20:01:38.860456] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:38.867949] [DEBUG] [LOCAL ] MPX: Loaded 3742 existing records from primary storage. [2025-10-28T20:01:38.868174] [INFO ] [MAIN ] MPX: Loaded 3742 existing records. [2025-10-28T20:01:39.055181] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:39.055393] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-28T20:01:39.055439] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-28T20:01:39.055576] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-28T20:01:39.055613] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-28T20:01:39.185452] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-28T20:01:39.421015] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:39.969054] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T20:01:39.979145] [INFO ] [REMOTE ] MPC: Full fetch complete (75578 records). [2025-10-28T20:01:39.979309] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-28T20:01:39.991128] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-28T20:01:40.370545] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-28T20:01:40.370624] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-28T20:01:40.371734] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-28T20:01:40.371795] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-28T20:01:40.373196] [DEBUG] [LOCAL ] MPC: Trimmed 75578 records to 51754 (keeping 200 days of data) [2025-10-28T20:01:40.610238] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T20:01:40.697476] [DEBUG] [LOCAL ] MPC: Primary data saved (51754 records). [2025-10-28T20:01:40.697604] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-28T20:01:40.697906] [INFO ] [MAIN ] Update Progress: 1390/2366 symbols completed. MPC took 38.3s. Estimated remaining: 2h 7m 32s. Rate: 7.7 symbols/min [2025-10-28T20:01:40.785546] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-28T20:01:40.866081] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:40.875256] [DEBUG] [LOCAL ] MQT: Loaded 7883 existing records from primary storage. [2025-10-28T20:01:40.875477] [INFO ] [MAIN ] MQT: Loaded 7883 existing records. [2025-10-28T20:01:41.057125] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:41.057351] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-28T20:01:41.057407] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-28T20:01:41.057623] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-28T20:01:41.057720] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-28T20:01:41.336069] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T20:01:41.412561] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:41.580281] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-28T20:01:42.149993] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T20:01:42.380214] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-28T20:01:42.903422] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T20:01:43.180233] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-28T20:01:43.290243] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (4.10 seconds). [2025-10-28T20:01:43.301232] [INFO ] [REMOTE ] MP: Full fetch complete (77597 records). [2025-10-28T20:01:43.301375] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-28T20:01:43.695892] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-28T20:01:43.695993] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-28T20:01:43.697108] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-28T20:01:43.697170] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-28T20:01:43.698516] [DEBUG] [LOCAL ] MP: Trimmed 77597 records to 53744 (keeping 200 days of data) [2025-10-28T20:01:43.990416] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-28T20:01:44.018868] [DEBUG] [LOCAL ] MP: Primary data saved (53744 records). [2025-10-28T20:01:44.018973] [INFO ] [MAIN ] MP: Full history saved. [2025-10-28T20:01:44.019047] [INFO ] [MAIN ] Update Progress: 1391/2366 symbols completed. MP took 56.6s. Estimated remaining: 2h 7m 21s. Rate: 7.7 symbols/min [2025-10-28T20:01:44.194532] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:01:44.210783] [DEBUG] [LOCAL ] MQY: Loaded 16443 existing records from primary storage. [2025-10-28T20:01:44.211022] [INFO ] [MAIN ] MQY: Loaded 16443 existing records. [2025-10-28T20:01:44.386281] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:01:44.386482] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-28T20:01:44.386529] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-28T20:01:44.386900] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-28T20:01:44.386957] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-28T20:01:44.567600] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T20:01:44.758841] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:01:44.786133] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-28T20:01:44.792904] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T20:01:45.283391] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T20:01:45.580302] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-28T20:01:45.979074] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T20:01:46.380267] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-28T20:01:47.180287] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-28T20:01:47.572218] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T20:01:47.993981] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-28T20:01:48.000725] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T20:01:48.524053] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T20:01:48.780299] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-28T20:01:49.230543] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T20:01:49.580271] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-28T20:01:50.376617] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T20:01:50.381504] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-28T20:01:51.180258] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-28T20:01:51.580823] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T20:01:51.980234] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-28T20:01:52.151578] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-28T20:01:52.705936] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:01:52.780243] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-28T20:01:53.580308] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-28T20:01:54.267854] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T20:01:54.384169] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-28T20:01:54.387987] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T20:01:55.170379] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T20:01:55.180206] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-28T20:01:55.950139] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T20:01:55.980261] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-28T20:01:56.691819] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:01:56.780272] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-28T20:01:57.410720] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:01:57.580252] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-28T20:01:58.283868] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T20:01:58.380239] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-28T20:01:59.180223] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-28T20:01:59.363625] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T20:01:59.554613] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T20:01:59.980265] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-28T20:02:00.780320] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-28T20:02:01.476261] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T20:02:01.535044] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T20:02:01.536368] [INFO ] [REMOTE ] MPX: Full fetch complete (6409 records). [2025-10-28T20:02:01.536459] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-28T20:02:01.585361] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-28T20:02:01.908177] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-28T20:02:01.908253] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-28T20:02:01.908442] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-28T20:02:01.908479] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-28T20:02:01.909074] [DEBUG] [LOCAL ] MPX: Trimmed 6409 records to 3722 (keeping 200 days of data) [2025-10-28T20:02:01.932763] [DEBUG] [LOCAL ] MPX: Primary data saved (3722 records). [2025-10-28T20:02:01.932930] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-28T20:02:01.933018] [INFO ] [MAIN ] Update Progress: 1392/2366 symbols completed. MPX took 23.4s. Estimated remaining: 2h 7m 20s. Rate: 7.6 symbols/min [2025-10-28T20:02:02.111296] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:02.151953] [DEBUG] [LOCAL ] MRC: Loaded 36785 existing records from primary storage. [2025-10-28T20:02:02.152351] [INFO ] [MAIN ] MRC: Loaded 36785 existing records. [2025-10-28T20:02:02.264386] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:02:02.348768] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:02:02.349195] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-28T20:02:02.349252] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-28T20:02:02.349436] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-28T20:02:02.349475] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-28T20:02:02.385331] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-28T20:02:02.732909] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:03.027198] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T20:02:03.180283] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-28T20:02:03.980277] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-28T20:02:04.292194] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T20:02:04.507635] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T20:02:04.780261] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-28T20:02:05.529979] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T20:02:05.580227] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-28T20:02:06.079071] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T20:02:06.380269] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-28T20:02:07.180269] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-28T20:02:07.441636] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T20:02:07.980306] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-28T20:02:08.535444] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T20:02:08.780215] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-28T20:02:08.858325] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T20:02:09.580252] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-28T20:02:09.937488] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T20:02:10.312013] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T20:02:10.314339] [INFO ] [REMOTE ] MQT: Full fetch complete (13091 records). [2025-10-28T20:02:10.314407] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-28T20:02:10.385518] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-28T20:02:10.695158] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-28T20:02:10.695235] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-28T20:02:10.695520] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-28T20:02:10.695558] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-28T20:02:10.696110] [DEBUG] [LOCAL ] MQT: Trimmed 13091 records to 7863 (keeping 200 days of data) [2025-10-28T20:02:10.742737] [DEBUG] [LOCAL ] MQT: Primary data saved (7863 records). [2025-10-28T20:02:10.742873] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-28T20:02:10.742980] [INFO ] [MAIN ] Update Progress: 1393/2366 symbols completed. MQT took 30.0s. Estimated remaining: 2h 7m 13s. Rate: 7.6 symbols/min [2025-10-28T20:02:10.913804] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:10.913983] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-28T20:02:10.914019] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-28T20:02:10.914127] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-28T20:02:10.914167] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-28T20:02:10.914210] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-28T20:02:10.914240] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-28T20:02:11.185997] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-28T20:02:11.278499] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:11.980253] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-28T20:02:12.161420] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T20:02:12.488210] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T20:02:12.492425] [INFO ] [REMOTE ] MQY: Full fetch complete (25454 records). [2025-10-28T20:02:12.492527] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-28T20:02:12.785563] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-28T20:02:12.894631] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-28T20:02:12.894737] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-28T20:02:12.895386] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-28T20:02:12.895448] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-28T20:02:12.896760] [DEBUG] [LOCAL ] MQY: Trimmed 25454 records to 16406 (keeping 200 days of data) [2025-10-28T20:02:13.004010] [DEBUG] [LOCAL ] MQY: Primary data saved (16406 records). [2025-10-28T20:02:13.004377] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-28T20:02:13.004481] [INFO ] [MAIN ] Update Progress: 1394/2366 symbols completed. MQY took 29.0s. Estimated remaining: 2h 7m 1s. Rate: 7.7 symbols/min [2025-10-28T20:02:13.197449] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:13.197779] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-28T20:02:13.197844] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-28T20:02:13.198085] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-28T20:02:13.198139] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-28T20:02:13.198228] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-28T20:02:13.198308] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-28T20:02:13.312279] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T20:02:13.585372] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-28T20:02:13.622247] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:14.371014] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T20:02:14.381731] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-28T20:02:14.746392] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T20:02:15.180326] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-28T20:02:15.980346] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-10-28T20:02:16.125383] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:02:16.125714] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-10-28T20:02:16.125799] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:02:16.125874] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-28T20:02:16.125952] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:02:16.126069] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-28T20:02:16.126149] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-28T20:02:16.126200] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-28T20:02:16.126257] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-28T20:02:16.126317] [INFO ] [MAIN ] Update Progress: 1395/2366 symbols completed. MRP took 3.1s. Estimated remaining: 2h 6m 50s. Rate: 7.7 symbols/min [2025-10-28T20:02:16.347987] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:16.379206] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-28T20:02:16.442475] [DEBUG] [LOCAL ] MS: Loaded 53686 existing records from primary storage. [2025-10-28T20:02:16.442843] [INFO ] [MAIN ] MS: Loaded 53686 existing records. [2025-10-28T20:02:16.624128] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:02:16.624361] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-28T20:02:16.624408] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-28T20:02:16.624759] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-28T20:02:16.624818] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-28T20:02:16.780487] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-28T20:02:16.978604] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:17.152085] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-28T20:02:17.162885] [INFO ] [REMOTE ] MPW: Full fetch complete (77572 records). [2025-10-28T20:02:17.163038] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-28T20:02:17.566550] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-28T20:02:17.566636] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-28T20:02:17.567772] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-28T20:02:17.567838] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-28T20:02:17.569349] [DEBUG] [LOCAL ] MPW: Trimmed 77572 records to 53479 (keeping 200 days of data) [2025-10-28T20:02:17.619984] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-28T20:02:17.839787] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T20:02:17.926975] [DEBUG] [LOCAL ] MPW: Primary data saved (53479 records). [2025-10-28T20:02:17.927117] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-28T20:02:17.927213] [INFO ] [MAIN ] Update Progress: 1396/2366 symbols completed. MPW took 41.9s. Estimated remaining: 2h 6m 38s. Rate: 7.7 symbols/min [2025-10-28T20:02:18.097872] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:18.118303] [DEBUG] [LOCAL ] MSA: Loaded 18569 existing records from primary storage. [2025-10-28T20:02:18.118551] [INFO ] [MAIN ] MSA: Loaded 18569 existing records. [2025-10-28T20:02:18.299824] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:02:18.300070] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-28T20:02:18.300117] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-28T20:02:18.300391] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-28T20:02:18.300448] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-28T20:02:18.389707] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-28T20:02:18.710508] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:19.180250] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-28T20:02:19.246192] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T20:02:19.692453] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T20:02:19.907915] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:02:19.980266] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-28T20:02:20.780296] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-28T20:02:21.053539] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T20:02:21.580287] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-28T20:02:22.380255] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-28T20:02:22.676365] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T20:02:22.767447] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-28T20:02:22.969029] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T20:02:23.180298] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-28T20:02:23.980321] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-28T20:02:24.486874] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:02:24.654553] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T20:02:24.780281] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-28T20:02:25.580258] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-28T20:02:26.380253] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-28T20:02:26.496160] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T20:02:27.180247] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-28T20:02:27.321023] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T20:02:27.729068] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T20:02:27.736625] [INFO ] [REMOTE ] MRC: Full fetch complete (54968 records). [2025-10-28T20:02:27.736789] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-28T20:02:27.985379] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-28T20:02:28.143264] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-28T20:02:28.143340] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-28T20:02:28.144304] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-28T20:02:28.144363] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-28T20:02:28.145424] [DEBUG] [LOCAL ] MRC: Trimmed 54968 records to 36691 (keeping 200 days of data) [2025-10-28T20:02:28.356135] [DEBUG] [LOCAL ] MRC: Primary data saved (36691 records). [2025-10-28T20:02:28.356261] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-28T20:02:28.356402] [INFO ] [MAIN ] Update Progress: 1397/2366 symbols completed. MRC took 26.4s. Estimated remaining: 2h 6m 32s. Rate: 7.7 symbols/min [2025-10-28T20:02:28.780252] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-28T20:02:28.879669] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T20:02:28.984738] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-28T20:02:29.580265] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-28T20:02:30.357298] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T20:02:30.380232] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-28T20:02:30.784811] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-28T20:02:31.139405] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T20:02:31.180207] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-28T20:02:31.937761] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:02:31.980213] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-28T20:02:32.739484] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T20:02:32.780243] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-28T20:02:33.553784] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T20:02:33.580226] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-28T20:02:34.380251] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-28T20:02:35.180248] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-28T20:02:35.198864] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T20:02:35.203360] [INFO ] [REMOTE ] MSA: Full fetch complete (26020 records). [2025-10-28T20:02:35.203521] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-28T20:02:35.619226] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-28T20:02:35.619348] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-28T20:02:35.619968] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-28T20:02:35.620089] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-28T20:02:35.621268] [DEBUG] [LOCAL ] MSA: Trimmed 26020 records to 18566 (keeping 200 days of data) [2025-10-28T20:02:35.772179] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-28T20:02:35.775630] [DEBUG] [LOCAL ] MSA: Primary data saved (18566 records). [2025-10-28T20:02:35.786517] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-28T20:02:35.786941] [INFO ] [MAIN ] Update Progress: 1398/2366 symbols completed. MSA took 17.9s. Estimated remaining: 2h 6m 24s. Rate: 7.7 symbols/min [2025-10-28T20:02:35.980276] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-28T20:02:36.877814] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T20:02:36.889133] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-28T20:02:37.775878] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-28T20:02:37.786845] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-28T20:02:38.220360] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T20:02:38.380254] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-28T20:02:39.861703] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T20:02:39.873731] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-28T20:02:40.037358] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T20:02:40.050602] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-28T20:02:41.631283] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T20:02:41.643256] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-28T20:02:41.817897] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-28T20:02:41.829903] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-28T20:02:43.156816] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T20:02:43.174801] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-28T20:02:43.584190] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T20:02:43.595636] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-28T20:02:45.005493] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T20:02:45.016599] [INFO ] [REMOTE ] MS: Full fetch complete (77857 records). [2025-10-28T20:02:45.016794] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-28T20:02:45.430207] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-28T20:02:45.430307] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-28T20:02:45.431548] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-28T20:02:45.431682] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-28T20:02:45.433298] [DEBUG] [LOCAL ] MS: Trimmed 77857 records to 53686 (keeping 200 days of data) [2025-10-28T20:02:45.563044] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-28T20:02:45.596370] [INFO ] [REMOTE ] MRK: Full fetch complete (77968 records). [2025-10-28T20:02:45.603055] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-28T20:02:46.240029] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-10-28T20:02:46.242854] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-10-28T20:02:46.245178] [DEBUG] [LOCAL ] MS: Primary data saved (53686 records). [2025-10-28T20:02:46.246569] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-10-28T20:02:46.246697] [INFO ] [MAIN ] MS: Full history saved. [2025-10-28T20:02:46.246773] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-10-28T20:02:46.247798] [INFO ] [MAIN ] Update Progress: 1399/2366 symbols completed. MS took 30.1s. Estimated remaining: 2h 6m 18s. Rate: 7.7 symbols/min [2025-10-28T20:02:46.248998] [DEBUG] [LOCAL ] MRK: Trimmed 77968 records to 53790 (keeping 200 days of data) [2025-10-28T20:02:46.570868] [DEBUG] [LOCAL ] MRK: Primary data saved (53790 records). [2025-10-28T20:02:46.571000] [INFO ] [MAIN ] MRK: Full history saved. [2025-10-28T20:02:46.571071] [INFO ] [MAIN ] Update Progress: 1400/2366 symbols completed. MRK took 35.8s. Estimated remaining: 2h 6m 5s. Rate: 7.7 symbols/min [2025-10-28T20:02:47.131379] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:47.181304] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:47.259509] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:47.267038] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-28T20:02:47.269971] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-28T20:02:47.270167] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-28T20:02:47.288947] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-28T20:02:47.288696] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:02:47.289559] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-28T20:02:47.289619] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-28T20:02:47.439726] [DEBUG] [LOCAL ] MSB: Loaded 7959 existing records from primary storage. [2025-10-28T20:02:47.440321] [INFO ] [MAIN ] MSB: Loaded 7959 existing records. [2025-10-28T20:02:47.446601] [DEBUG] [LOCAL ] MSCI: Loaded 33730 existing records from primary storage. [2025-10-28T20:02:47.499941] [INFO ] [MAIN ] MSCI: Loaded 33730 existing records. [2025-10-28T20:02:47.538065] [DEBUG] [LOCAL ] MSD: Loaded 16589 existing records from primary storage. [2025-10-28T20:02:47.622310] [INFO ] [MAIN ] MSD: Loaded 16589 existing records. [2025-10-28T20:02:48.033541] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:02:48.101416] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-28T20:02:48.109080] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-28T20:02:48.221957] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-28T20:02:48.154279] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:02:48.222106] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-28T20:02:48.257462] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-28T20:02:48.262965] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:02:48.273588] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-28T20:02:48.299838] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:48.296963] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-28T20:02:48.323275] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-28T20:02:48.328814] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-28T20:02:48.335418] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-28T20:02:48.358266] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-28T20:02:48.484678] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-28T20:02:48.523868] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-28T20:02:48.831540] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T20:02:48.911023] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-28T20:02:49.194731] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:49.219204] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-28T20:02:49.331287] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:49.343106] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-28T20:02:49.398747] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:02:49.400630] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-28T20:02:49.431062] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:02:49.431325] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-28T20:02:49.683428] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T20:02:49.684468] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-28T20:02:49.921012] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T20:02:49.922051] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-28T20:02:49.966046] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T20:02:50.049450] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T20:02:50.194168] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T20:02:50.380588] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-28T20:02:50.383575] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T20:02:51.180272] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-28T20:02:51.267394] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T20:02:51.948995] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T20:02:51.980292] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-28T20:02:52.597746] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T20:02:52.780253] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-28T20:02:53.580234] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-28T20:02:53.877343] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T20:02:54.181715] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T20:02:54.380295] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-28T20:02:55.050998] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T20:02:55.180245] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-28T20:02:55.747422] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T20:02:55.980318] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-28T20:02:56.780252] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-28T20:02:57.210832] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T20:02:57.462736] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:02:57.580274] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-28T20:02:58.081458] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T20:02:58.380258] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-28T20:02:58.912612] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T20:02:59.180283] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-28T20:02:59.713488] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T20:02:59.980284] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-28T20:03:00.231001] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-28T20:03:00.780294] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-28T20:03:01.160221] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T20:03:01.580254] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-28T20:03:02.380267] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-28T20:03:02.896096] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T20:03:02.911438] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T20:03:03.180261] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-28T20:03:03.980262] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-28T20:03:04.193695] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T20:03:04.712931] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T20:03:04.780244] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-28T20:03:05.058408] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T20:03:05.580270] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-28T20:03:06.380298] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-28T20:03:07.180261] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-28T20:03:07.454919] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-28T20:03:07.712822] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T20:03:07.751995] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T20:03:07.980254] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-28T20:03:08.620562] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:03:08.780258] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-28T20:03:09.580225] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-28T20:03:09.616797] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T20:03:09.621142] [INFO ] [REMOTE ] MSD: Full fetch complete (23132 records). [2025-10-28T20:03:09.621219] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-28T20:03:09.954298] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-28T20:03:09.978943] [INFO ] [REMOTE ] MSC: Full fetch complete (2436 records). [2025-10-28T20:03:09.989280] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-28T20:03:09.989355] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-28T20:03:09.989139] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-28T20:03:09.989945] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-28T20:03:09.990027] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-28T20:03:10.095424] [DEBUG] [LOCAL ] MSD: Trimmed 23132 records to 16600 (keeping 200 days of data) [2025-10-28T20:03:10.265435] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-28T20:03:10.271347] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:03:10.275671] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:03:10.280467] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-28T20:03:10.285766] [DEBUG] [LOCAL ] MSD: Primary data saved (16600 records). [2025-10-28T20:03:10.285860] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-28T20:03:10.285984] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-28T20:03:10.286092] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-28T20:03:10.286235] [INFO ] [MAIN ] Update Progress: 1401/2366 symbols completed. MSD took 23.7s. Estimated remaining: 2h 6m 8s. Rate: 7.7 symbols/min [2025-10-28T20:03:10.345354] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-28T20:03:10.372464] [INFO ] [MAIN ] Update Progress: 1402/2366 symbols completed. MSC took 23.8s. Estimated remaining: 2h 5m 55s. Rate: 7.7 symbols/min [2025-10-28T20:03:10.385390] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-28T20:03:10.599138] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:10.645846] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:10.684946] [DEBUG] [LOCAL ] MSGE: Loaded 26790 existing records from primary storage. [2025-10-28T20:03:10.695560] [INFO ] [MAIN ] MSGE: Loaded 26790 existing records. [2025-10-28T20:03:10.696223] [DEBUG] [LOCAL ] MSDL: Loaded 38515 existing records from primary storage. [2025-10-28T20:03:10.739831] [INFO ] [MAIN ] MSDL: Loaded 38515 existing records. [2025-10-28T20:03:11.060204] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:03:11.087555] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:03:11.092862] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-28T20:03:11.093483] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T20:03:11.092734] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-28T20:03:11.093328] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-28T20:03:11.095817] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-28T20:03:11.095397] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-28T20:03:11.096213] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-28T20:03:11.138094] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-28T20:03:11.169627] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-28T20:03:11.189661] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-28T20:03:11.788192] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:11.806540] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:11.945492] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:03:11.947706] [INFO ] [REMOTE ] MSB: Full fetch complete (13187 records). [2025-10-28T20:03:11.947775] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-28T20:03:11.985321] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-28T20:03:12.305204] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-28T20:03:12.305276] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-28T20:03:12.305542] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-28T20:03:12.305579] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-28T20:03:12.306065] [DEBUG] [LOCAL ] MSB: Trimmed 13187 records to 7927 (keeping 200 days of data) [2025-10-28T20:03:12.351791] [DEBUG] [LOCAL ] MSB: Primary data saved (7927 records). [2025-10-28T20:03:12.351890] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-28T20:03:12.351961] [INFO ] [MAIN ] Update Progress: 1403/2366 symbols completed. MSB took 25.8s. Estimated remaining: 2h 5m 43s. Rate: 7.7 symbols/min [2025-10-28T20:03:12.517316] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:12.534418] [DEBUG] [LOCAL ] MSGS: Loaded 17192 existing records from primary storage. [2025-10-28T20:03:12.534619] [INFO ] [MAIN ] MSGS: Loaded 17192 existing records. [2025-10-28T20:03:12.706874] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:03:12.707093] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-28T20:03:12.707195] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-28T20:03:12.707364] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-28T20:03:12.707403] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-28T20:03:12.785429] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-28T20:03:13.065673] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:13.081837] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:03:13.580288] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-28T20:03:13.726421] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T20:03:14.380258] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-28T20:03:14.769197] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T20:03:14.920700] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T20:03:15.180275] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-28T20:03:15.980253] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-28T20:03:16.780321] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-28T20:03:17.069590] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T20:03:17.279957] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T20:03:17.580251] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-28T20:03:18.380281] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-28T20:03:18.629380] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T20:03:18.985719] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (3.81 seconds). [2025-10-28T20:03:19.180328] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-28T20:03:19.643700] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T20:03:19.852614] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T20:03:19.980249] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-28T20:03:20.656318] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T20:03:20.780241] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-28T20:03:21.514955] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T20:03:21.580260] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-28T20:03:22.266939] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T20:03:22.380291] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-28T20:03:23.180329] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-28T20:03:23.588259] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T20:03:23.594683] [INFO ] [REMOTE ] MSCI: Full fetch complete (50608 records). [2025-10-28T20:03:23.594775] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-28T20:03:23.986850] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-28T20:03:23.987114] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-28T20:03:23.988366] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-28T20:03:23.988837] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T20:03:23.989915] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-28T20:03:23.993573] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-28T20:03:23.995195] [DEBUG] [LOCAL ] MSCI: Trimmed 50608 records to 33812 (keeping 200 days of data) [2025-10-28T20:03:24.205415] [DEBUG] [LOCAL ] MSCI: Primary data saved (33812 records). [2025-10-28T20:03:24.205554] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-28T20:03:24.205670] [INFO ] [MAIN ] Update Progress: 1404/2366 symbols completed. MSCI took 37.6s. Estimated remaining: 2h 5m 38s. Rate: 7.7 symbols/min [2025-10-28T20:03:24.371571] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:24.407030] [DEBUG] [LOCAL ] MSI: Loaded 39347 existing records from primary storage. [2025-10-28T20:03:24.407295] [INFO ] [MAIN ] MSI: Loaded 39347 existing records. [2025-10-28T20:03:24.581026] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:03:24.581232] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-28T20:03:24.581283] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-28T20:03:24.581491] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-28T20:03:24.581530] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-28T20:03:24.785615] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-28T20:03:24.939093] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:24.957281] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T20:03:25.580299] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-28T20:03:25.740180] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T20:03:26.150266] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T20:03:26.380303] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-28T20:03:27.180224] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-28T20:03:27.238373] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:03:27.980221] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-28T20:03:28.035394] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T20:03:28.780246] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-28T20:03:29.105381] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T20:03:29.580269] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-28T20:03:29.679223] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T20:03:29.685594] [INFO ] [REMOTE ] MSGS: Full fetch complete (23834 records). [2025-10-28T20:03:29.685817] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-28T20:03:30.243602] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-28T20:03:30.243733] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-28T20:03:30.244391] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-28T20:03:30.244433] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-28T20:03:30.245306] [DEBUG] [LOCAL ] MSGS: Trimmed 23834 records to 17118 (keeping 200 days of data) [2025-10-28T20:03:30.388722] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-28T20:03:30.401017] [DEBUG] [LOCAL ] MSGS: Primary data saved (17118 records). [2025-10-28T20:03:30.402433] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-28T20:03:30.402560] [INFO ] [MAIN ] Update Progress: 1405/2366 symbols completed. MSGS took 18.1s. Estimated remaining: 2h 5m 29s. Rate: 7.7 symbols/min [2025-10-28T20:03:30.628995] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:30.629325] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-28T20:03:30.629442] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-28T20:03:30.629608] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-28T20:03:30.629804] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-28T20:03:30.629957] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-28T20:03:30.630025] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-28T20:03:30.947547] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T20:03:31.059060] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:31.180258] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-10-28T20:03:31.504039] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T20:03:31.667063] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T20:03:31.980238] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-10-28T20:03:32.560227] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T20:03:32.780250] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-10-28T20:03:33.386919] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T20:03:33.580234] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-28T20:03:34.380316] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-10-28T20:03:34.816668] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T20:03:34.845795] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T20:03:35.180307] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-28T20:03:35.980297] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-28T20:03:36.426219] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T20:03:36.757369] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T20:03:36.780209] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-28T20:03:37.580231] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-28T20:03:37.668624] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T20:03:38.380309] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-10-28T20:03:38.839381] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T20:03:39.180436] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-10-28T20:03:39.768794] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T20:03:39.980258] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-10-28T20:03:40.513372] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T20:03:40.780257] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-28T20:03:41.580241] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-10-28T20:03:41.804331] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T20:03:42.354256] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T20:03:42.380243] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-28T20:03:42.997947] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (5.42 seconds). [2025-10-28T20:03:43.180231] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-28T20:03:43.322887] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T20:03:43.980326] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-10-28T20:03:44.604818] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T20:03:44.780283] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-10. [2025-10-28T20:03:45.580314] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-28T20:03:45.748689] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T20:03:45.754096] [INFO ] [REMOTE ] MSIF: Full fetch complete (19979 records). [2025-10-28T20:03:45.754229] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-10-28T20:03:45.966929] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-28T20:03:45.967239] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:03:45.967307] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:03:45.967377] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-28T20:03:45.967438] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-28T20:03:45.967476] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-28T20:03:45.967515] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-28T20:03:45.967568] [INFO ] [MAIN ] Update Progress: 1406/2366 symbols completed. MSIF took 15.6s. Estimated remaining: 2h 5m 26s. Rate: 7.7 symbols/min [2025-10-28T20:03:46.139828] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:46.174015] [DEBUG] [LOCAL ] MSM: Loaded 35329 existing records from primary storage. [2025-10-28T20:03:46.174279] [INFO ] [MAIN ] MSM: Loaded 35329 existing records. [2025-10-28T20:03:46.355735] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:03:46.355927] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-28T20:03:46.356008] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-28T20:03:46.356237] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-28T20:03:46.356295] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-28T20:03:46.389317] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-28T20:03:46.727979] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:46.745954] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T20:03:47.072330] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (3.89 seconds). [2025-10-28T20:03:47.180212] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-28T20:03:47.449745] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T20:03:47.980272] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-28T20:03:48.248695] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T20:03:48.780293] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-28T20:03:48.943029] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T20:03:49.580312] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-28T20:03:49.807625] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T20:03:50.380244] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-28T20:03:50.549918] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T20:03:51.180287] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-28T20:03:51.648766] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T20:03:51.980298] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-28T20:03:52.543565] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T20:03:52.780263] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-28T20:03:52.885095] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T20:03:53.580277] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-28T20:03:54.046089] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T20:03:54.380339] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-28T20:03:54.479994] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T20:03:54.487681] [INFO ] [REMOTE ] MSGE: Full fetch complete (39591 records). [2025-10-28T20:03:54.487894] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-28T20:03:54.917413] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-28T20:03:54.917562] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-28T20:03:54.919120] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-28T20:03:54.919205] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-28T20:03:54.920837] [DEBUG] [LOCAL ] MSGE: Trimmed 39591 records to 26626 (keeping 200 days of data) [2025-10-28T20:03:55.091880] [DEBUG] [LOCAL ] MSGE: Primary data saved (26626 records). [2025-10-28T20:03:55.092032] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-28T20:03:55.092119] [INFO ] [MAIN ] Update Progress: 1407/2366 symbols completed. MSGE took 44.7s. Estimated remaining: 2h 5m 19s. Rate: 7.7 symbols/min [2025-10-28T20:03:55.187687] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-28T20:03:55.260910] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:03:55.306469] [DEBUG] [LOCAL ] MT: Loaded 50285 existing records from primary storage. [2025-10-28T20:03:55.306795] [INFO ] [MAIN ] MT: Loaded 50285 existing records. [2025-10-28T20:03:55.482942] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:03:55.483250] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-28T20:03:55.483424] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-28T20:03:55.483692] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-28T20:03:55.483747] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-28T20:03:55.817294] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T20:03:55.863118] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:03:55.980204] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-28T20:03:56.496955] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T20:03:56.780322] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-28T20:03:57.470106] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T20:03:57.580225] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-28T20:03:57.911277] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T20:03:58.380253] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-28T20:03:58.998318] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:03:59.180228] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-28T20:03:59.533175] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T20:03:59.980306] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-28T20:04:00.557167] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T20:04:00.566168] [INFO ] [REMOTE ] MSDL: Full fetch complete (56810 records). [2025-10-28T20:04:00.566280] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-28T20:04:00.783198] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-28T20:04:00.949311] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-28T20:04:00.949426] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-28T20:04:00.950582] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-28T20:04:00.950720] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-28T20:04:00.952503] [DEBUG] [LOCAL ] MSDL: Trimmed 56810 records to 38502 (keeping 200 days of data) [2025-10-28T20:04:01.061710] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T20:04:01.215838] [DEBUG] [LOCAL ] MSDL: Primary data saved (38502 records). [2025-10-28T20:04:01.216016] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-28T20:04:01.216383] [INFO ] [MAIN ] Update Progress: 1408/2366 symbols completed. MSDL took 50.9s. Estimated remaining: 2h 5m 10s. Rate: 7.7 symbols/min [2025-10-28T20:04:01.387276] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:01.432233] [DEBUG] [LOCAL ] MTB: Loaded 46518 existing records from primary storage. [2025-10-28T20:04:01.432539] [INFO ] [MAIN ] MTB: Loaded 46518 existing records. [2025-10-28T20:04:01.589123] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-28T20:04:01.611540] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:04:01.612572] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-28T20:04:01.612621] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-28T20:04:01.612832] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-28T20:04:01.612880] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-28T20:04:02.005349] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:02.380226] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-28T20:04:02.451176] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T20:04:02.484154] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T20:04:03.180256] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-28T20:04:03.728536] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T20:04:03.736114] [INFO ] [REMOTE ] MSI: Full fetch complete (57951 records). [2025-10-28T20:04:03.736250] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-28T20:04:03.990870] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-28T20:04:04.122896] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-28T20:04:04.122973] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-28T20:04:04.123909] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-28T20:04:04.123972] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-28T20:04:04.125186] [DEBUG] [LOCAL ] MSI: Trimmed 57951 records to 39253 (keeping 200 days of data) [2025-10-28T20:04:04.364840] [DEBUG] [LOCAL ] MSI: Primary data saved (39253 records). [2025-10-28T20:04:04.364977] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-28T20:04:04.365700] [INFO ] [MAIN ] Update Progress: 1409/2366 symbols completed. MSI took 40.2s. Estimated remaining: 2h 4m 59s. Rate: 7.7 symbols/min [2025-10-28T20:04:04.541706] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:04.559468] [DEBUG] [LOCAL ] MTD: Loaded 14742 existing records from primary storage. [2025-10-28T20:04:04.559742] [INFO ] [MAIN ] MTD: Loaded 14742 existing records. [2025-10-28T20:04:04.739250] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:04:04.739541] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-28T20:04:04.739712] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-28T20:04:04.739921] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-28T20:04:04.739969] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-28T20:04:04.782378] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-28T20:04:04.980145] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-28T20:04:05.135043] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:05.488052] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T20:04:05.580213] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-28T20:04:06.143383] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T20:04:06.380325] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-28T20:04:06.794695] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T20:04:07.132530] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T20:04:07.180278] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-28T20:04:07.849878] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T20:04:07.980210] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-28T20:04:08.780257] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-28T20:04:09.439475] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T20:04:09.580247] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-28T20:04:09.699785] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T20:04:10.380294] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-28T20:04:10.988779] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:04:11.180250] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-28T20:04:11.204229] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T20:04:11.980249] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-28T20:04:12.485200] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T20:04:12.780251] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-28T20:04:12.896589] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T20:04:13.580267] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-28T20:04:13.865876] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T20:04:14.306449] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T20:04:14.380438] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-28T20:04:15.180327] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-28T20:04:15.684456] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T20:04:15.694054] [INFO ] [REMOTE ] MSM: Full fetch complete (51717 records). [2025-10-28T20:04:15.694301] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-28T20:04:15.988445] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-28T20:04:16.003778] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T20:04:16.103251] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-28T20:04:16.103356] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-28T20:04:16.104319] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-28T20:04:16.104381] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-28T20:04:16.105508] [DEBUG] [LOCAL ] MSM: Trimmed 51717 records to 35302 (keeping 200 days of data) [2025-10-28T20:04:16.315027] [DEBUG] [LOCAL ] MSM: Primary data saved (35302 records). [2025-10-28T20:04:16.315164] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-28T20:04:16.315255] [INFO ] [MAIN ] Update Progress: 1410/2366 symbols completed. MSM took 30.3s. Estimated remaining: 2h 4m 54s. Rate: 7.7 symbols/min [2025-10-28T20:04:16.480498] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:16.531228] [DEBUG] [LOCAL ] MTDR: Loaded 51754 existing records from primary storage. [2025-10-28T20:04:16.531554] [INFO ] [MAIN ] MTDR: Loaded 51754 existing records. [2025-10-28T20:04:16.703960] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:04:16.704173] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-28T20:04:16.704219] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-28T20:04:16.704413] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-28T20:04:16.704468] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-28T20:04:16.785398] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-28T20:04:17.053639] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:17.378695] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T20:04:17.523811] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T20:04:17.580213] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-28T20:04:18.127727] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T20:04:18.380266] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-28T20:04:18.988063] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T20:04:19.180249] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-28T20:04:19.980258] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-28T20:04:20.365501] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T20:04:20.780321] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-28T20:04:21.230210] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T20:04:21.580256] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-28T20:04:21.692228] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T20:04:21.695814] [INFO ] [REMOTE ] MTD: Full fetch complete (21502 records). [2025-10-28T20:04:21.695976] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-28T20:04:22.271339] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-28T20:04:22.271719] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-28T20:04:22.272524] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-28T20:04:22.272592] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-28T20:04:22.273717] [DEBUG] [LOCAL ] MTD: Trimmed 21502 records to 14642 (keeping 200 days of data) [2025-10-28T20:04:22.380962] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-28T20:04:22.412017] [DEBUG] [LOCAL ] MTD: Primary data saved (14642 records). [2025-10-28T20:04:22.412175] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-28T20:04:22.412299] [INFO ] [MAIN ] Update Progress: 1411/2366 symbols completed. MTD took 18.0s. Estimated remaining: 2h 4m 45s. Rate: 7.7 symbols/min [2025-10-28T20:04:22.622821] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:22.676307] [DEBUG] [LOCAL ] MTG: Loaded 51005 existing records from primary storage. [2025-10-28T20:04:22.676963] [INFO ] [MAIN ] MTG: Loaded 51005 existing records. [2025-10-28T20:04:22.866513] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:04:22.866795] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-28T20:04:22.866866] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-28T20:04:22.867250] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-28T20:04:22.867350] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-28T20:04:23.182122] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-28T20:04:23.191369] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T20:04:23.273828] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:23.677780] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T20:04:23.980260] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-28T20:04:24.768288] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:04:24.780217] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-28T20:04:25.163848] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T20:04:25.580264] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-28T20:04:26.010811] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T20:04:26.380229] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-28T20:04:26.750453] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T20:04:27.180244] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-28T20:04:27.624428] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T20:04:27.980261] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-28T20:04:28.621174] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T20:04:28.780267] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-28T20:04:29.585898] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-28T20:04:29.598352] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T20:04:29.608961] [INFO ] [REMOTE ] MT: Full fetch complete (73664 records). [2025-10-28T20:04:29.609085] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-28T20:04:29.994258] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-28T20:04:29.994542] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-28T20:04:29.995772] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-28T20:04:29.995857] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-28T20:04:29.997556] [DEBUG] [LOCAL ] MT: Trimmed 73664 records to 50241 (keeping 200 days of data) [2025-10-28T20:04:30.194093] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T20:04:30.331158] [DEBUG] [LOCAL ] MT: Primary data saved (50241 records). [2025-10-28T20:04:30.331299] [INFO ] [MAIN ] MT: Full history saved. [2025-10-28T20:04:30.331385] [INFO ] [MAIN ] Update Progress: 1412/2366 symbols completed. MT took 35.2s. Estimated remaining: 2h 4m 38s. Rate: 7.7 symbols/min [2025-10-28T20:04:30.392809] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-28T20:04:30.498315] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:30.535862] [DEBUG] [LOCAL ] MTH: Loaded 43619 existing records from primary storage. [2025-10-28T20:04:30.536172] [INFO ] [MAIN ] MTH: Loaded 43619 existing records. [2025-10-28T20:04:30.710694] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:04:30.710885] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-28T20:04:30.710930] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-28T20:04:30.711113] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-28T20:04:30.711150] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-28T20:04:31.086909] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:31.124764] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T20:04:31.180302] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-28T20:04:31.869415] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T20:04:31.980299] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-28T20:04:32.491599] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T20:04:32.780253] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-28T20:04:33.393318] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:04:33.580296] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-28T20:04:33.880496] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T20:04:34.380320] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-28T20:04:34.904528] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T20:04:35.180297] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-28T20:04:35.971515] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T20:04:35.980423] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-28T20:04:35.982043] [INFO ] [REMOTE ] MTB: Full fetch complete (68284 records). [2025-10-28T20:04:35.982133] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-28T20:04:36.365601] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-28T20:04:36.365770] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-28T20:04:36.366816] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-28T20:04:36.366876] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-28T20:04:36.368154] [DEBUG] [LOCAL ] MTB: Trimmed 68284 records to 46497 (keeping 200 days of data) [2025-10-28T20:04:36.511872] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T20:04:36.691380] [DEBUG] [LOCAL ] MTB: Primary data saved (46497 records). [2025-10-28T20:04:36.691519] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-28T20:04:36.691875] [INFO ] [MAIN ] Update Progress: 1413/2366 symbols completed. MTB took 35.5s. Estimated remaining: 2h 4m 29s. Rate: 7.7 symbols/min [2025-10-28T20:04:36.785502] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-28T20:04:36.863285] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:36.902785] [DEBUG] [LOCAL ] MTN: Loaded 39043 existing records from primary storage. [2025-10-28T20:04:36.903060] [INFO ] [MAIN ] MTN: Loaded 39043 existing records. [2025-10-28T20:04:37.075954] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:04:37.076180] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-28T20:04:37.076241] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-28T20:04:37.076532] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-28T20:04:37.076596] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-28T20:04:37.430639] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:37.465673] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T20:04:37.580230] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-28T20:04:38.390316] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-28T20:04:38.401726] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T20:04:38.610320] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T20:04:39.180286] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-28T20:04:39.594492] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T20:04:39.980313] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-28T20:04:40.390045] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:04:40.780244] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-28T20:04:41.339611] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T20:04:41.580287] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-28T20:04:42.323586] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T20:04:42.380209] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-28T20:04:42.921471] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T20:04:43.180286] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-28T20:04:43.800071] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T20:04:43.980264] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-28T20:04:44.753880] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T20:04:44.780254] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-28T20:04:45.289945] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T20:04:45.580348] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-28T20:04:46.053267] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T20:04:46.380297] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-28T20:04:46.664102] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T20:04:47.180286] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-28T20:04:47.980320] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-28T20:04:48.126901] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T20:04:48.137409] [INFO ] [REMOTE ] MTDR: Full fetch complete (74435 records). [2025-10-28T20:04:48.137560] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-28T20:04:48.529554] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-28T20:04:48.529670] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-28T20:04:48.530810] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-28T20:04:48.530882] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-28T20:04:48.532515] [DEBUG] [LOCAL ] MTDR: Trimmed 74435 records to 51734 (keeping 200 days of data) [2025-10-28T20:04:48.644789] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T20:04:48.780392] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-28T20:04:48.863062] [DEBUG] [LOCAL ] MTDR: Primary data saved (51734 records). [2025-10-28T20:04:48.863185] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-28T20:04:48.863804] [INFO ] [MAIN ] Update Progress: 1414/2366 symbols completed. MTDR took 32.5s. Estimated remaining: 2h 4m 24s. Rate: 7.7 symbols/min [2025-10-28T20:04:49.027238] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:04:49.027373] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-28T20:04:49.027409] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-28T20:04:49.027512] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-28T20:04:49.027551] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-28T20:04:49.027591] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-28T20:04:49.027627] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-28T20:04:49.374749] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:04:49.487520] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T20:04:49.580216] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-28T20:04:49.899126] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T20:04:49.933485] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T20:04:50.380264] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-28T20:04:51.180257] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-28T20:04:51.580561] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T20:04:51.980284] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-28T20:04:52.217931] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T20:04:52.371771] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T20:04:52.780255] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-28T20:04:53.580234] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-28T20:04:53.833567] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T20:04:54.214900] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T20:04:54.380223] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-28T20:04:55.180251] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-28T20:04:55.507674] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T20:04:55.627369] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T20:04:55.980246] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-28T20:04:56.217796] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T20:04:56.780242] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-28T20:04:57.347158] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T20:04:57.580267] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-28T20:04:58.380286] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-28T20:04:58.943111] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:04:59.180235] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-28T20:04:59.382754] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T20:04:59.980247] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-28T20:05:00.346037] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T20:05:00.780271] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-28T20:05:01.092323] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T20:05:01.272148] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T20:05:01.580272] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-28T20:05:02.380312] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-28T20:05:03.180309] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-28T20:05:03.268387] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T20:05:03.278628] [INFO ] [REMOTE ] MTG: Full fetch complete (74304 records). [2025-10-28T20:05:03.278804] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-28T20:05:03.666819] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-28T20:05:03.666963] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-28T20:05:03.668028] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-28T20:05:03.668089] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-28T20:05:03.669472] [DEBUG] [LOCAL ] MTG: Trimmed 74304 records to 50971 (keeping 200 days of data) [2025-10-28T20:05:03.798356] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T20:05:03.810120] [INFO ] [REMOTE ] MTH: Full fetch complete (64144 records). [2025-10-28T20:05:03.810746] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-28T20:05:03.989991] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-28T20:05:04.391132] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T20:05:04.395470] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-28T20:05:04.402796] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-28T20:05:04.409185] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-28T20:05:04.409378] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-28T20:05:04.411001] [DEBUG] [LOCAL ] MTG: Primary data saved (50971 records). [2025-10-28T20:05:04.411276] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-28T20:05:04.445808] [INFO ] [MAIN ] Update Progress: 1415/2366 symbols completed. MTG took 42.0s. Estimated remaining: 2h 4m 21s. Rate: 7.6 symbols/min [2025-10-28T20:05:04.477612] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T20:05:04.536349] [DEBUG] [LOCAL ] MTH: Trimmed 64144 records to 43638 (keeping 200 days of data) [2025-10-28T20:05:04.743033] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:04.825714] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-28T20:05:04.870969] [DEBUG] [LOCAL ] MTRN: Loaded 17959 existing records from primary storage. [2025-10-28T20:05:04.872067] [INFO ] [MAIN ] MTRN: Loaded 17959 existing records. [2025-10-28T20:05:05.091095] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:05.106231] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-28T20:05:05.108669] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-28T20:05:05.109236] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-28T20:05:05.110065] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-28T20:05:05.177811] [DEBUG] [LOCAL ] MTH: Primary data saved (43638 records). [2025-10-28T20:05:05.193543] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-28T20:05:05.198775] [INFO ] [MAIN ] Update Progress: 1416/2366 symbols completed. MTH took 34.9s. Estimated remaining: 2h 4m 9s. Rate: 7.7 symbols/min [2025-10-28T20:05:05.592437] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:05.585054] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-28T20:05:05.652906] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:05.675585] [DEBUG] [LOCAL ] MTUS: Loaded 27043 existing records from primary storage. [2025-10-28T20:05:05.675857] [INFO ] [MAIN ] MTUS: Loaded 27043 existing records. [2025-10-28T20:05:05.853485] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:05.853877] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-28T20:05:05.853948] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-28T20:05:05.854237] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-28T20:05:05.854293] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-28T20:05:05.918590] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-28T20:05:06.206669] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T20:05:06.244229] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:06.380210] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-28T20:05:07.180264] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-28T20:05:07.298283] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T20:05:07.549718] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-28T20:05:07.550542] [INFO ] [REMOTE ] MTR: Full fetch complete (2410 records). [2025-10-28T20:05:07.550607] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-28T20:05:07.738245] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:05:07.738414] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:05:07.738480] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:05:07.738547] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-28T20:05:07.738608] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-28T20:05:07.738662] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-28T20:05:07.738728] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-28T20:05:07.738785] [INFO ] [MAIN ] Update Progress: 1417/2366 symbols completed. MTR took 18.9s. Estimated remaining: 2h 3m 57s. Rate: 7.7 symbols/min [2025-10-28T20:05:07.904358] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:07.931267] [DEBUG] [LOCAL ] MTW: Loaded 26142 existing records from primary storage. [2025-10-28T20:05:07.931532] [INFO ] [MAIN ] MTW: Loaded 26142 existing records. [2025-10-28T20:05:07.991040] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-28T20:05:08.106021] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:08.106211] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-28T20:05:08.106264] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-28T20:05:08.106473] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-28T20:05:08.106516] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-28T20:05:08.451369] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:08.780302] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-28T20:05:09.435540] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T20:05:09.444993] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T20:05:09.459879] [INFO ] [REMOTE ] MTN: Full fetch complete (56727 records). [2025-10-28T20:05:09.460064] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-28T20:05:09.585550] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-28T20:05:09.944101] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-28T20:05:09.944188] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-28T20:05:09.945223] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-28T20:05:09.945286] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-28T20:05:09.946743] [DEBUG] [LOCAL ] MTN: Trimmed 56727 records to 38993 (keeping 200 days of data) [2025-10-28T20:05:10.203239] [DEBUG] [LOCAL ] MTN: Primary data saved (38993 records). [2025-10-28T20:05:10.203382] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-28T20:05:10.203462] [INFO ] [MAIN ] Update Progress: 1418/2366 symbols completed. MTN took 33.5s. Estimated remaining: 2h 3m 46s. Rate: 7.7 symbols/min [2025-10-28T20:05:10.371822] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:10.388886] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-28T20:05:10.394707] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T20:05:10.419473] [DEBUG] [LOCAL ] MTX: Loaded 22279 existing records from primary storage. [2025-10-28T20:05:10.419779] [INFO ] [MAIN ] MTX: Loaded 22279 existing records. [2025-10-28T20:05:10.592134] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:10.592334] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-28T20:05:10.592383] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-28T20:05:10.592596] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-28T20:05:10.592638] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-28T20:05:10.943858] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:10.988212] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T20:05:11.180258] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-28T20:05:11.980230] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-28T20:05:12.032525] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:05:12.780219] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-28T20:05:12.884891] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T20:05:13.497963] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T20:05:13.580248] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-28T20:05:14.380243] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-28T20:05:14.532153] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T20:05:15.175338] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T20:05:15.180530] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-28T20:05:15.980231] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-28T20:05:16.048288] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T20:05:16.707895] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:05:16.780301] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-28T20:05:17.483565] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T20:05:17.580286] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-28T20:05:18.380263] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-28T20:05:18.501155] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T20:05:19.180234] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-28T20:05:19.284713] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T20:05:19.980247] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-28T20:05:20.064750] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T20:05:20.780218] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-28T20:05:20.828331] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T20:05:21.580226] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-28T20:05:21.740338] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T20:05:22.379308] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T20:05:22.383521] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-28T20:05:23.180236] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-28T20:05:23.245259] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T20:05:23.980252] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-28T20:05:24.051178] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T20:05:24.780223] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-28T20:05:24.886593] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T20:05:25.473079] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T20:05:25.580233] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-28T20:05:26.380240] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-28T20:05:26.515608] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T20:05:27.180260] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-28T20:05:27.253707] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T20:05:27.980240] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-28T20:05:28.051039] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:05:28.617039] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T20:05:28.780242] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-28T20:05:29.580291] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-28T20:05:29.787566] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T20:05:30.330459] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T20:05:30.380253] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-28T20:05:31.071604] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T20:05:31.180259] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-28T20:05:31.980223] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-28T20:05:32.056559] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T20:05:32.782674] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-28T20:05:32.787046] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T20:05:33.580284] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-28T20:05:33.608598] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T20:05:34.287077] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T20:05:34.380281] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-28T20:05:35.180284] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-28T20:05:35.236871] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:05:35.860714] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T20:05:35.980221] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-28T20:05:36.780252] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-28T20:05:36.914719] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T20:05:36.919887] [INFO ] [REMOTE ] MTW: Full fetch complete (38111 records). [2025-10-28T20:05:36.919976] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-28T20:05:37.291739] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-28T20:05:37.291819] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-28T20:05:37.292556] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-28T20:05:37.292595] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-28T20:05:37.293405] [DEBUG] [LOCAL ] MTW: Trimmed 38111 records to 26085 (keeping 200 days of data) [2025-10-28T20:05:37.440289] [DEBUG] [LOCAL ] MTW: Primary data saved (26085 records). [2025-10-28T20:05:37.440417] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-28T20:05:37.440498] [INFO ] [MAIN ] Update Progress: 1419/2366 symbols completed. MTW took 29.7s. Estimated remaining: 2h 3m 51s. Rate: 7.6 symbols/min [2025-10-28T20:05:37.584294] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-28T20:05:37.617418] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:37.629350] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T20:05:37.634286] [INFO ] [REMOTE ] MTX: Full fetch complete (31363 records). [2025-10-28T20:05:37.634382] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-28T20:05:37.961052] [DEBUG] [LOCAL ] MTZ: Loaded 42571 existing records from primary storage. [2025-10-28T20:05:37.972167] [INFO ] [MAIN ] MTZ: Loaded 42571 existing records. [2025-10-28T20:05:38.157483] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-28T20:05:38.162715] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-28T20:05:38.168580] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-28T20:05:38.173809] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-28T20:05:38.212098] [DEBUG] [LOCAL ] MTX: Trimmed 31363 records to 22204 (keeping 200 days of data) [2025-10-28T20:05:38.234139] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:38.235746] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-28T20:05:38.235830] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-28T20:05:38.236075] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-28T20:05:38.236135] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-28T20:05:38.384599] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-28T20:05:38.633541] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T20:05:38.658403] [DEBUG] [LOCAL ] MTX: Primary data saved (22204 records). [2025-10-28T20:05:38.658758] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-28T20:05:38.670509] [INFO ] [MAIN ] Update Progress: 1420/2366 symbols completed. MTX took 28.5s. Estimated remaining: 2h 3m 39s. Rate: 7.7 symbols/min [2025-10-28T20:05:38.901561] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:38.959036] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:38.971071] [DEBUG] [LOCAL ] MUA: Loaded 11426 existing records from primary storage. [2025-10-28T20:05:38.971263] [INFO ] [MAIN ] MUA: Loaded 11426 existing records. [2025-10-28T20:05:39.144966] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:39.145167] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-28T20:05:39.145214] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-28T20:05:39.145374] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-28T20:05:39.145428] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-28T20:05:39.188582] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-28T20:05:39.500948] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:39.707983] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T20:05:39.712847] [INFO ] [REMOTE ] MTUS: Full fetch complete (40846 records). [2025-10-28T20:05:39.712956] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-28T20:05:39.986429] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-28T20:05:40.084037] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-28T20:05:40.084105] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-28T20:05:40.084905] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-28T20:05:40.084965] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-28T20:05:40.085811] [DEBUG] [LOCAL ] MTUS: Trimmed 40846 records to 26927 (keeping 200 days of data) [2025-10-28T20:05:40.238692] [DEBUG] [LOCAL ] MTUS: Primary data saved (26927 records). [2025-10-28T20:05:40.238826] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-28T20:05:40.238908] [INFO ] [MAIN ] Update Progress: 1421/2366 symbols completed. MTUS took 35.0s. Estimated remaining: 2h 3m 27s. Rate: 7.7 symbols/min [2025-10-28T20:05:40.411955] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:40.439965] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T20:05:40.464207] [DEBUG] [LOCAL ] MUC: Loaded 20369 existing records from primary storage. [2025-10-28T20:05:40.464418] [INFO ] [MAIN ] MUC: Loaded 20369 existing records. [2025-10-28T20:05:40.642001] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:40.642226] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-28T20:05:40.642272] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-28T20:05:40.642446] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-28T20:05:40.642485] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-28T20:05:40.789329] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-28T20:05:41.010736] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:41.011891] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T20:05:41.015445] [INFO ] [REMOTE ] MTRN: Full fetch complete (24166 records). [2025-10-28T20:05:41.015533] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-28T20:05:41.390624] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-28T20:05:41.390739] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-28T20:05:41.391375] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-28T20:05:41.391439] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-28T20:05:41.392256] [DEBUG] [LOCAL ] MTRN: Trimmed 24166 records to 17922 (keeping 200 days of data) [2025-10-28T20:05:41.503377] [DEBUG] [LOCAL ] MTRN: Primary data saved (17922 records). [2025-10-28T20:05:41.503520] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-28T20:05:41.503598] [INFO ] [MAIN ] Update Progress: 1422/2366 symbols completed. MTRN took 37.0s. Estimated remaining: 2h 3m 14s. Rate: 7.7 symbols/min [2025-10-28T20:05:41.585472] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-28T20:05:41.687188] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:05:41.700362] [DEBUG] [LOCAL ] MUE: Loaded 11990 existing records from primary storage. [2025-10-28T20:05:41.700571] [INFO ] [MAIN ] MUE: Loaded 11990 existing records. [2025-10-28T20:05:41.884196] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:05:41.884517] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-28T20:05:41.884620] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-28T20:05:41.884925] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-28T20:05:41.884981] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-28T20:05:42.074925] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T20:05:42.292770] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:05:42.376471] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T20:05:42.380150] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-28T20:05:43.071188] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T20:05:43.180245] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-28T20:05:43.980347] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-28T20:05:44.625669] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:05:44.725889] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:05:44.780210] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-28T20:05:45.311104] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T20:05:45.580248] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-28T20:05:46.117502] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T20:05:46.380241] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-28T20:05:46.886488] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T20:05:47.180237] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-28T20:05:47.980292] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-28T20:05:48.391955] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:05:48.780231] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-28T20:05:48.916672] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T20:05:49.580313] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-28T20:05:49.950889] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T20:05:50.148797] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T20:05:50.380267] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-28T20:05:50.968378] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T20:05:51.180311] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-28T20:05:51.980329] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-28T20:05:51.994932] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T20:05:52.780322] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-28T20:05:53.099232] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T20:05:53.496683] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T20:05:53.580293] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-28T20:05:54.123845] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T20:05:54.380252] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-28T20:05:54.942835] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:05:55.180344] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-28T20:05:55.739815] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T20:05:55.980330] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-28T20:05:56.622348] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T20:05:56.780300] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-28T20:05:57.535487] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T20:05:57.580218] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-28T20:05:58.378485] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T20:05:58.382816] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-28T20:05:58.960378] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T20:05:59.180266] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-28T20:05:59.988113] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-28T20:05:59.989724] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T20:06:00.771557] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T20:06:00.774486] [INFO ] [REMOTE ] MUA: Full fetch complete (18204 records). [2025-10-28T20:06:00.774558] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-28T20:06:00.785595] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-28T20:06:01.135138] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-28T20:06:01.135212] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-28T20:06:01.135603] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-28T20:06:01.135662] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-28T20:06:01.136245] [DEBUG] [LOCAL ] MUA: Trimmed 18204 records to 11526 (keeping 200 days of data) [2025-10-28T20:06:01.204458] [DEBUG] [LOCAL ] MUA: Primary data saved (11526 records). [2025-10-28T20:06:01.204590] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-28T20:06:01.204688] [INFO ] [MAIN ] Update Progress: 1423/2366 symbols completed. MUA took 22.5s. Estimated remaining: 2h 3m 14s. Rate: 7.7 symbols/min [2025-10-28T20:06:01.369126] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:01.419405] [DEBUG] [LOCAL ] MUFG: Loaded 52387 existing records from primary storage. [2025-10-28T20:06:01.419752] [INFO ] [MAIN ] MUFG: Loaded 52387 existing records. [2025-10-28T20:06:01.590499] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-28T20:06:01.598110] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:01.606142] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-28T20:06:01.607559] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-28T20:06:01.608534] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-28T20:06:01.608500] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T20:06:01.612428] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-28T20:06:02.022088] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:02.328886] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T20:06:02.380253] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-28T20:06:03.180247] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-28T20:06:03.651735] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:06:03.734165] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T20:06:03.980243] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-28T20:06:04.780260] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-28T20:06:05.313379] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T20:06:05.490043] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T20:06:05.580257] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-28T20:06:06.158242] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T20:06:06.380290] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-28T20:06:07.180267] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-28T20:06:07.733072] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T20:06:07.980262] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-28T20:06:08.644226] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T20:06:08.780240] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-28T20:06:08.899585] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T20:06:09.580305] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-28T20:06:10.367421] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T20:06:10.376385] [INFO ] [REMOTE ] MTZ: Full fetch complete (63474 records). [2025-10-28T20:06:10.376542] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-28T20:06:10.388700] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-28T20:06:10.791583] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-28T20:06:10.791739] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-28T20:06:10.792826] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-28T20:06:10.792930] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-28T20:06:10.794721] [DEBUG] [LOCAL ] MTZ: Trimmed 63474 records to 42486 (keeping 200 days of data) [2025-10-28T20:06:10.942728] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T20:06:11.081262] [DEBUG] [LOCAL ] MTZ: Primary data saved (42486 records). [2025-10-28T20:06:11.081389] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-28T20:06:11.082089] [INFO ] [MAIN ] Update Progress: 1424/2366 symbols completed. MTZ took 33.6s. Estimated remaining: 2h 3m 8s. Rate: 7.7 symbols/min [2025-10-28T20:06:11.181333] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-28T20:06:11.253910] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:11.269131] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:06:11.286207] [DEBUG] [LOCAL ] MUJ: Loaded 13614 existing records from primary storage. [2025-10-28T20:06:11.286433] [INFO ] [MAIN ] MUJ: Loaded 13614 existing records. [2025-10-28T20:06:11.461557] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:11.461802] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-28T20:06:11.461852] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-28T20:06:11.462022] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-28T20:06:11.462060] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-28T20:06:11.814873] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:11.980235] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-28T20:06:12.649792] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T20:06:12.713220] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T20:06:12.780227] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-28T20:06:13.580245] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-28T20:06:14.344362] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T20:06:14.371442] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T20:06:14.380204] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-28T20:06:15.180227] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-28T20:06:15.242547] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T20:06:15.249950] [INFO ] [REMOTE ] MUC: Full fetch complete (29466 records). [2025-10-28T20:06:15.250103] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-28T20:06:15.647361] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-28T20:06:15.647444] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-28T20:06:15.648133] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-28T20:06:15.648194] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-28T20:06:15.648905] [DEBUG] [LOCAL ] MUC: Trimmed 29466 records to 20351 (keeping 200 days of data) [2025-10-28T20:06:15.760959] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T20:06:15.778254] [DEBUG] [LOCAL ] MUC: Primary data saved (20351 records). [2025-10-28T20:06:15.781754] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-28T20:06:15.781846] [INFO ] [MAIN ] Update Progress: 1425/2366 symbols completed. MUC took 35.5s. Estimated remaining: 2h 2m 58s. Rate: 7.7 symbols/min [2025-10-28T20:06:15.950789] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:15.980252] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-28T20:06:16.001011] [DEBUG] [LOCAL ] MUR: Loaded 52812 existing records from primary storage. [2025-10-28T20:06:16.001361] [INFO ] [MAIN ] MUR: Loaded 52812 existing records. [2025-10-28T20:06:16.179061] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:16.179322] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-28T20:06:16.179379] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-28T20:06:16.179585] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-28T20:06:16.179716] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-28T20:06:16.543793] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T20:06:16.547474] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:16.780241] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-28T20:06:17.349681] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T20:06:17.580269] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-28T20:06:18.380243] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-28T20:06:18.961508] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T20:06:19.120951] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T20:06:19.180315] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-28T20:06:19.911701] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T20:06:19.914532] [INFO ] [REMOTE ] MUE: Full fetch complete (15932 records). [2025-10-28T20:06:19.914603] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-28T20:06:19.989707] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-28T20:06:20.295889] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-28T20:06:20.295984] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-28T20:06:20.296380] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-28T20:06:20.296433] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-28T20:06:20.297013] [DEBUG] [LOCAL ] MUE: Trimmed 15932 records to 11984 (keeping 200 days of data) [2025-10-28T20:06:20.366410] [DEBUG] [LOCAL ] MUE: Primary data saved (11984 records). [2025-10-28T20:06:20.366535] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-28T20:06:20.366616] [INFO ] [MAIN ] Update Progress: 1426/2366 symbols completed. MUE took 38.9s. Estimated remaining: 2h 2m 48s. Rate: 7.7 symbols/min [2025-10-28T20:06:20.533770] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:20.556344] [DEBUG] [LOCAL ] MUSA: Loaded 24530 existing records from primary storage. [2025-10-28T20:06:20.556603] [INFO ] [MAIN ] MUSA: Loaded 24530 existing records. [2025-10-28T20:06:20.737227] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:20.737516] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-28T20:06:20.737587] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-28T20:06:20.737824] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-28T20:06:20.737876] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-28T20:06:20.782325] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-28T20:06:20.855876] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:06:21.112776] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:21.580245] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-28T20:06:22.290847] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T20:06:22.380235] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-28T20:06:22.396728] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T20:06:23.180268] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-28T20:06:23.564282] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:06:23.884269] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T20:06:23.980293] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-28T20:06:24.780257] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-28T20:06:25.455549] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T20:06:25.580236] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-28T20:06:25.664893] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T20:06:26.380254] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-28T20:06:27.180260] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-28T20:06:27.211336] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T20:06:27.662398] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T20:06:27.807567] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T20:06:27.980314] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-28T20:06:28.714209] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T20:06:28.780262] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-28T20:06:29.480222] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:06:29.483496] [INFO ] [REMOTE ] MUJ: Full fetch complete (19262 records). [2025-10-28T20:06:29.483573] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-28T20:06:29.582806] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-28T20:06:29.846132] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-28T20:06:29.846210] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-28T20:06:29.846616] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-28T20:06:29.846722] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-28T20:06:29.847252] [DEBUG] [LOCAL ] MUJ: Trimmed 19262 records to 13697 (keeping 200 days of data) [2025-10-28T20:06:29.927602] [DEBUG] [LOCAL ] MUJ: Primary data saved (13697 records). [2025-10-28T20:06:29.927757] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-28T20:06:29.927842] [INFO ] [MAIN ] Update Progress: 1427/2366 symbols completed. MUJ took 18.8s. Estimated remaining: 2h 2m 41s. Rate: 7.7 symbols/min [2025-10-28T20:06:30.092194] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:30.092365] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-28T20:06:30.092402] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-28T20:06:30.092507] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-28T20:06:30.092546] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-28T20:06:30.092586] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-28T20:06:30.092617] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-28T20:06:30.385416] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-28T20:06:30.455759] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:30.977439] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T20:06:31.180314] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-28T20:06:31.980340] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-28T20:06:32.166048] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:06:32.166361] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-28T20:06:32.166497] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:06:32.166592] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-28T20:06:32.166697] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:06:32.166786] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-28T20:06:32.166866] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-28T20:06:32.166906] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-28T20:06:32.166947] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-28T20:06:32.166995] [INFO ] [MAIN ] Update Progress: 1428/2366 symbols completed. MUSE took 2.2s. Estimated remaining: 2h 2m 30s. Rate: 7.7 symbols/min [2025-10-28T20:06:32.340144] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:32.383083] [DEBUG] [LOCAL ] MUX: Loaded 43909 existing records from primary storage. [2025-10-28T20:06:32.383374] [INFO ] [MAIN ] MUX: Loaded 43909 existing records. [2025-10-28T20:06:32.571166] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:32.571549] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-28T20:06:32.571714] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-28T20:06:32.572064] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-28T20:06:32.572195] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-28T20:06:32.778492] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-28T20:06:32.803676] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-28T20:06:32.941957] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T20:06:33.013661] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:33.580254] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-28T20:06:33.610895] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:06:34.380222] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-28T20:06:34.463091] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T20:06:35.180228] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-28T20:06:35.819758] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:06:35.980269] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-28T20:06:36.105173] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T20:06:36.780328] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-28T20:06:37.314552] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T20:06:37.580287] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-28T20:06:38.339416] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T20:06:38.385349] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-28T20:06:38.404534] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T20:06:39.180251] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-28T20:06:39.854571] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T20:06:39.980280] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-28T20:06:40.247957] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T20:06:40.780291] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-28T20:06:41.117348] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T20:06:41.580272] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-28T20:06:42.053540] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T20:06:42.380242] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-28T20:06:42.751056] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T20:06:43.180215] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-28T20:06:43.313786] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T20:06:43.980308] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-28T20:06:44.616318] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T20:06:44.627433] [INFO ] [REMOTE ] MUFG: Full fetch complete (75870 records). [2025-10-28T20:06:44.627639] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-28T20:06:44.781517] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-28T20:06:45.108431] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-28T20:06:45.129350] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-28T20:06:45.133528] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:06:45.132158] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-28T20:06:45.141609] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-28T20:06:45.145535] [DEBUG] [LOCAL ] MUFG: Trimmed 75870 records to 52371 (keeping 200 days of data) [2025-10-28T20:06:45.525601] [DEBUG] [LOCAL ] MUFG: Primary data saved (52371 records). [2025-10-28T20:06:45.525820] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-28T20:06:45.526276] [INFO ] [MAIN ] Update Progress: 1429/2366 symbols completed. MUFG took 44.3s. Estimated remaining: 2h 2m 26s. Rate: 7.7 symbols/min [2025-10-28T20:06:45.585374] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-28T20:06:45.740372] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:45.758604] [DEBUG] [LOCAL ] MVF: Loaded 12539 existing records from primary storage. [2025-10-28T20:06:45.758951] [INFO ] [MAIN ] MVF: Loaded 12539 existing records. [2025-10-28T20:06:45.964032] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:45.964378] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-28T20:06:45.964430] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-28T20:06:45.964728] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-28T20:06:45.964788] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-28T20:06:46.349530] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:46.382971] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-28T20:06:46.396001] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T20:06:46.407390] [INFO ] [REMOTE ] MUR: Full fetch complete (76771 records). [2025-10-28T20:06:46.407578] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-28T20:06:46.828785] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T20:06:46.882704] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-28T20:06:46.883489] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-28T20:06:46.884785] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-28T20:06:46.884850] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-28T20:06:46.886537] [DEBUG] [LOCAL ] MUR: Trimmed 76771 records to 52788 (keeping 200 days of data) [2025-10-28T20:06:47.185720] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-28T20:06:47.203699] [DEBUG] [LOCAL ] MUR: Primary data saved (52788 records). [2025-10-28T20:06:47.203980] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-28T20:06:47.204092] [INFO ] [MAIN ] Update Progress: 1430/2366 symbols completed. MUR took 31.4s. Estimated remaining: 2h 2m 14s. Rate: 7.7 symbols/min [2025-10-28T20:06:47.379772] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:06:47.390707] [DEBUG] [LOCAL ] MVO: Loaded 8935 existing records from primary storage. [2025-10-28T20:06:47.390942] [INFO ] [MAIN ] MVO: Loaded 8935 existing records. [2025-10-28T20:06:47.581744] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:06:47.582135] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-28T20:06:47.582288] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-28T20:06:47.582880] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-28T20:06:47.582958] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-28T20:06:47.720798] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T20:06:47.985458] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-28T20:06:47.991124] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:06:48.066452] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:06:48.780258] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-28T20:06:49.256112] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:06:49.502840] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T20:06:49.580313] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-28T20:06:50.123910] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T20:06:50.380288] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-28T20:06:51.180267] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-28T20:06:51.714624] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T20:06:51.741718] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T20:06:51.980272] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-28T20:06:52.530686] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T20:06:52.780249] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-28T20:06:53.302225] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T20:06:53.580300] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-28T20:06:54.152587] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T20:06:54.380340] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-28T20:06:54.991422] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T20:06:55.180253] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-28T20:06:55.980244] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-28T20:06:56.581222] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T20:06:56.780281] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-28T20:06:57.432234] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T20:06:57.580275] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-28T20:06:58.380236] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-28T20:06:58.856286] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T20:06:59.180300] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-28T20:06:59.264916] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T20:06:59.275221] [INFO ] [REMOTE ] MUX: Full fetch complete (61963 records). [2025-10-28T20:06:59.275333] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-28T20:06:59.696327] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (3.72 seconds). [2025-10-28T20:06:59.720716] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-28T20:06:59.727250] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-28T20:06:59.727157] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:06:59.728566] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-28T20:06:59.728867] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-28T20:06:59.733514] [DEBUG] [LOCAL ] MUX: Trimmed 61963 records to 43942 (keeping 200 days of data) [2025-10-28T20:06:59.979082] [DEBUG] [LOCAL ] MUX: Primary data saved (43942 records). [2025-10-28T20:06:59.979207] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-28T20:06:59.979966] [INFO ] [MAIN ] Update Progress: 1431/2366 symbols completed. MUX took 27.8s. Estimated remaining: 2h 2m 9s. Rate: 7.7 symbols/min [2025-10-28T20:06:59.985683] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-28T20:07:00.154144] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:00.166409] [DEBUG] [LOCAL ] MVT: Loaded 9507 existing records from primary storage. [2025-10-28T20:07:00.166679] [INFO ] [MAIN ] MVT: Loaded 9507 existing records. [2025-10-28T20:07:00.341859] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:00.342064] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-28T20:07:00.342110] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-28T20:07:00.342311] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-28T20:07:00.342369] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-28T20:07:00.707417] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:07:00.780288] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-28T20:07:01.192568] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T20:07:01.197388] [INFO ] [REMOTE ] MUSA: Full fetch complete (35785 records). [2025-10-28T20:07:01.197466] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-28T20:07:01.469130] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T20:07:01.586086] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-28T20:07:01.585341] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-28T20:07:01.586254] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-28T20:07:01.587917] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-28T20:07:01.587979] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-28T20:07:01.588895] [DEBUG] [LOCAL ] MUSA: Trimmed 35785 records to 24532 (keeping 200 days of data) [2025-10-28T20:07:01.737718] [DEBUG] [LOCAL ] MUSA: Primary data saved (24532 records). [2025-10-28T20:07:01.737849] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-28T20:07:01.737925] [INFO ] [MAIN ] Update Progress: 1432/2366 symbols completed. MUSA took 41.4s. Estimated remaining: 2h 1m 57s. Rate: 7.7 symbols/min [2025-10-28T20:07:01.905285] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:01.943018] [DEBUG] [LOCAL ] MWA: Loaded 45519 existing records from primary storage. [2025-10-28T20:07:01.943308] [INFO ] [MAIN ] MWA: Loaded 45519 existing records. [2025-10-28T20:07:02.114592] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:02.114838] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-28T20:07:02.114886] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-28T20:07:02.115806] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-28T20:07:02.115863] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-28T20:07:02.385427] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-28T20:07:02.456375] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T20:07:02.476028] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:07:02.479034] [INFO ] [REMOTE ] MVO: Full fetch complete (14688 records). [2025-10-28T20:07:02.479108] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-28T20:07:02.898041] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-28T20:07:02.898153] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-28T20:07:02.898527] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-28T20:07:02.898590] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-28T20:07:02.899173] [DEBUG] [LOCAL ] MVO: Trimmed 14688 records to 8915 (keeping 200 days of data) [2025-10-28T20:07:02.955117] [DEBUG] [LOCAL ] MVO: Primary data saved (8915 records). [2025-10-28T20:07:02.955249] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-28T20:07:02.955378] [INFO ] [MAIN ] Update Progress: 1433/2366 symbols completed. MVO took 15.8s. Estimated remaining: 2h 1m 45s. Rate: 7.7 symbols/min [2025-10-28T20:07:03.105161] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:07:03.186712] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-28T20:07:03.186626] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:03.208726] [DEBUG] [LOCAL ] MX: Loaded 22033 existing records from primary storage. [2025-10-28T20:07:03.208957] [INFO ] [MAIN ] MX: Loaded 22033 existing records. [2025-10-28T20:07:03.388015] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:03.388242] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-28T20:07:03.388296] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-28T20:07:03.388529] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-28T20:07:03.388586] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-28T20:07:03.675250] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:07:03.753122] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:07:03.980270] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-28T20:07:04.780247] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-28T20:07:04.956796] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T20:07:05.580235] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-28T20:07:05.597969] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T20:07:06.096249] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T20:07:06.380333] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-28T20:07:07.180320] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-28T20:07:07.204600] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T20:07:07.980349] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-28T20:07:08.411792] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T20:07:08.780235] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-28T20:07:08.781539] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T20:07:09.546149] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T20:07:09.580227] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-28T20:07:10.380250] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-28T20:07:10.733757] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T20:07:11.163038] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T20:07:11.180206] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-28T20:07:11.980223] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-28T20:07:12.064062] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T20:07:12.626456] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T20:07:12.780292] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-28T20:07:13.494124] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T20:07:13.580215] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-28T20:07:14.344322] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:07:14.380250] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-28T20:07:15.180250] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-28T20:07:15.813358] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T20:07:15.812063] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T20:07:15.980225] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-28T20:07:16.780260] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-28T20:07:17.399453] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T20:07:17.400535] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T20:07:17.580240] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-28T20:07:18.380262] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-28T20:07:19.007573] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:07:19.180302] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-28T20:07:19.476865] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T20:07:19.731639] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T20:07:19.980303] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-28T20:07:20.780310] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-28T20:07:21.172080] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T20:07:21.570297] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T20:07:21.580209] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-28T20:07:22.380334] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-28T20:07:22.530406] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T20:07:22.534747] [INFO ] [REMOTE ] MX: Full fetch complete (31833 records). [2025-10-28T20:07:22.534829] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-28T20:07:22.900032] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-28T20:07:22.900117] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-28T20:07:22.900830] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-28T20:07:22.900891] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-28T20:07:22.901662] [DEBUG] [LOCAL ] MX: Trimmed 31833 records to 22003 (keeping 200 days of data) [2025-10-28T20:07:23.025029] [DEBUG] [LOCAL ] MX: Primary data saved (22003 records). [2025-10-28T20:07:23.025171] [INFO ] [MAIN ] MX: Full history saved. [2025-10-28T20:07:23.036130] [INFO ] [MAIN ] Update Progress: 1434/2366 symbols completed. MX took 20.1s. Estimated remaining: 2h 1m 45s. Rate: 7.7 symbols/min [2025-10-28T20:07:23.042603] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T20:07:23.185412] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-28T20:07:23.233174] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:23.233360] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-28T20:07:23.233437] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-28T20:07:23.233549] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-28T20:07:23.233590] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-28T20:07:23.233630] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-28T20:07:23.233698] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-28T20:07:23.609569] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:07:23.980241] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-28T20:07:24.000772] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:07:24.558165] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T20:07:24.780332] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-28T20:07:25.232836] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T20:07:25.580265] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-28T20:07:26.380299] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-28T20:07:26.445551] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T20:07:26.448878] [INFO ] [REMOTE ] MVF: Full fetch complete (18630 records). [2025-10-28T20:07:26.448998] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-28T20:07:26.747539] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T20:07:26.825469] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-28T20:07:26.825546] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-28T20:07:26.825979] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-28T20:07:26.826044] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-28T20:07:26.826615] [DEBUG] [LOCAL ] MVF: Trimmed 18630 records to 12493 (keeping 200 days of data) [2025-10-28T20:07:26.898174] [DEBUG] [LOCAL ] MVF: Primary data saved (12493 records). [2025-10-28T20:07:26.898316] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-28T20:07:26.898395] [INFO ] [MAIN ] Update Progress: 1435/2366 symbols completed. MVF took 41.4s. Estimated remaining: 2h 1m 35s. Rate: 7.7 symbols/min [2025-10-28T20:07:27.067121] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:27.074957] [DEBUG] [LOCAL ] MXF: Loaded 5454 existing records from primary storage. [2025-10-28T20:07:27.075176] [INFO ] [MAIN ] MXF: Loaded 5454 existing records. [2025-10-28T20:07:27.185363] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-28T20:07:27.252636] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:27.252832] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-28T20:07:27.252881] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-28T20:07:27.253085] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-28T20:07:27.253142] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-28T20:07:27.567412] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T20:07:27.606295] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:07:27.980285] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-28T20:07:28.227074] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T20:07:28.780247] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-28T20:07:29.298527] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T20:07:29.580265] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-28T20:07:29.939565] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T20:07:30.380307] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-28T20:07:30.911328] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T20:07:31.180264] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-28T20:07:31.882623] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:07:31.884534] [INFO ] [REMOTE ] MVT: Full fetch complete (13553 records). [2025-10-28T20:07:31.884605] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-28T20:07:31.985892] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-28T20:07:32.247227] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-28T20:07:32.247300] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-28T20:07:32.247592] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-28T20:07:32.247629] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-28T20:07:32.248107] [DEBUG] [LOCAL ] MVT: Trimmed 13553 records to 9490 (keeping 200 days of data) [2025-10-28T20:07:32.306748] [DEBUG] [LOCAL ] MVT: Primary data saved (9490 records). [2025-10-28T20:07:32.306876] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-28T20:07:32.306956] [INFO ] [MAIN ] Update Progress: 1436/2366 symbols completed. MVT took 32.3s. Estimated remaining: 2h 1m 25s. Rate: 7.7 symbols/min [2025-10-28T20:07:32.392229] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T20:07:32.489630] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:32.503975] [DEBUG] [LOCAL ] MYD: Loaded 13008 existing records from primary storage. [2025-10-28T20:07:32.504179] [INFO ] [MAIN ] MYD: Loaded 13008 existing records. [2025-10-28T20:07:32.684303] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:32.684517] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-28T20:07:32.684567] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-28T20:07:32.684822] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-28T20:07:32.684879] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-28T20:07:32.785527] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-28T20:07:33.047985] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:07:33.141931] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T20:07:33.580271] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-28T20:07:34.380306] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-28T20:07:34.681554] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:07:34.730718] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T20:07:35.180304] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-28T20:07:35.980262] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-28T20:07:36.311756] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:07:36.339624] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T20:07:36.780256] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-28T20:07:37.141946] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T20:07:37.580240] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-28T20:07:38.131715] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T20:07:38.380301] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-28T20:07:38.861610] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T20:07:38.862744] [INFO ] [REMOTE ] MXE: Full fetch complete (2505 records). [2025-10-28T20:07:38.862843] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-28T20:07:39.063905] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T20:07:39.064126] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:07:39.064193] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:07:39.064241] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-28T20:07:39.064317] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-28T20:07:39.064373] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-28T20:07:39.064415] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-28T20:07:39.064474] [INFO ] [MAIN ] Update Progress: 1437/2366 symbols completed. MXE took 16.0s. Estimated remaining: 2h 1m 17s. Rate: 7.7 symbols/min [2025-10-28T20:07:39.180337] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-28T20:07:39.718999] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T20:07:39.980278] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-28T20:07:40.492404] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:07:40.780256] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-28T20:07:41.580263] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-28T20:07:42.009859] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T20:07:42.380328] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-28T20:07:42.697600] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:07:43.180286] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-28T20:07:43.527270] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T20:07:43.771823] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T20:07:43.980249] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-28T20:07:44.780246] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-28T20:07:45.370609] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T20:07:45.380329] [INFO ] [REMOTE ] MWA: Full fetch complete (68061 records). [2025-10-28T20:07:45.380524] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-28T20:07:45.586286] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-28T20:07:45.651522] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T20:07:45.843556] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-28T20:07:45.843624] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-28T20:07:45.844721] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-28T20:07:45.844786] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-28T20:07:45.846106] [DEBUG] [LOCAL ] MWA: Trimmed 68061 records to 45451 (keeping 200 days of data) [2025-10-28T20:07:46.113878] [DEBUG] [LOCAL ] MWA: Primary data saved (45451 records). [2025-10-28T20:07:46.114056] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-28T20:07:46.114153] [INFO ] [MAIN ] Update Progress: 1438/2366 symbols completed. MWA took 44.4s. Estimated remaining: 2h 1m 9s. Rate: 7.7 symbols/min [2025-10-28T20:07:46.184421] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T20:07:46.380268] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-28T20:07:46.922790] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T20:07:47.180294] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-28T20:07:47.558848] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T20:07:47.980267] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-28T20:07:48.746939] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T20:07:48.780215] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-28T20:07:49.335412] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:07:49.580307] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-28T20:07:50.009963] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T20:07:50.380311] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-28T20:07:50.698662] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T20:07:51.180249] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-28T20:07:51.559336] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T20:07:51.980295] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-28T20:07:52.504206] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T20:07:52.780300] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-28T20:07:53.350021] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T20:07:53.580306] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-28T20:07:54.134302] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T20:07:54.380297] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-28T20:07:54.957909] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T20:07:54.959684] [INFO ] [REMOTE ] MXF: Full fetch complete (9675 records). [2025-10-28T20:07:54.959752] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-28T20:07:55.190338] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-28T20:07:55.341256] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-28T20:07:55.341428] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-28T20:07:55.341845] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-28T20:07:55.341924] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-28T20:07:55.342538] [DEBUG] [LOCAL ] MXF: Trimmed 9675 records to 5436 (keeping 200 days of data) [2025-10-28T20:07:55.376991] [DEBUG] [LOCAL ] MXF: Primary data saved (5436 records). [2025-10-28T20:07:55.377105] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-28T20:07:55.377183] [INFO ] [MAIN ] Update Progress: 1439/2366 symbols completed. MXF took 28.5s. Estimated remaining: 2h 1m 2s. Rate: 7.7 symbols/min [2025-10-28T20:07:56.839190] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T20:07:56.842503] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-28T20:07:57.660288] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T20:07:57.663973] [INFO ] [REMOTE ] MYD: Full fetch complete (20053 records). [2025-10-28T20:07:57.664126] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-28T20:07:58.118843] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-28T20:07:58.118962] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-28T20:07:58.119928] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-28T20:07:58.119999] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-28T20:07:58.120825] [DEBUG] [LOCAL ] MYD: Trimmed 20053 records to 13012 (keeping 200 days of data) [2025-10-28T20:07:58.228153] [DEBUG] [LOCAL ] MYD: Primary data saved (13012 records). [2025-10-28T20:07:58.228328] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-28T20:07:58.228431] [INFO ] [MAIN ] Update Progress: 1440/2366 symbols completed. MYD took 25.9s. Estimated remaining: 2h 0m 51s. Rate: 7.7 symbols/min [2025-10-28T20:07:58.913080] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:59.064335] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:59.107378] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:59.130340] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:07:59.155236] [DEBUG] [LOCAL ] MYN: Loaded 9807 existing records from primary storage. [2025-10-28T20:07:59.155724] [INFO ] [MAIN ] MYN: Loaded 9807 existing records. [2025-10-28T20:07:59.185767] [DEBUG] [LOCAL ] MYI: Loaded 19169 existing records from primary storage. [2025-10-28T20:07:59.244731] [DEBUG] [LOCAL ] NABL: Loaded 38498 existing records from primary storage. [2025-10-28T20:07:59.255338] [INFO ] [MAIN ] MYI: Loaded 19169 existing records. [2025-10-28T20:07:59.266084] [INFO ] [MAIN ] NABL: Loaded 38498 existing records. [2025-10-28T20:07:59.360541] [DEBUG] [LOCAL ] MYE: Loaded 23771 existing records from primary storage. [2025-10-28T20:07:59.429103] [INFO ] [MAIN ] MYE: Loaded 23771 existing records. [2025-10-28T20:07:59.629919] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:59.739097] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-28T20:07:59.743173] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:59.748673] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-28T20:07:59.754442] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-28T20:07:59.770150] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-28T20:07:59.790930] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-28T20:07:59.816856] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-28T20:07:59.816783] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-28T20:07:59.845122] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-28T20:07:59.928937] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:07:59.994478] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-28T20:08:00.128754] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:00.081325] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-28T20:08:00.155055] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-28T20:08:00.149718] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-28T20:08:00.165482] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-28T20:08:00.165532] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-28T20:08:00.225814] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-28T20:08:00.311840] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-28T20:08:01.147601] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:01.216943] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-28T20:08:01.417147] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:01.487853] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:01.488246] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-28T20:08:01.489436] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-28T20:08:01.570989] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:01.571304] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-28T20:08:02.005057] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T20:08:02.008247] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-28T20:08:02.288568] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T20:08:02.293135] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-28T20:08:02.378499] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T20:08:02.383597] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-28T20:08:02.486664] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T20:08:02.495302] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-28T20:08:02.593977] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T20:08:02.974883] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T20:08:03.180278] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-28T20:08:03.230267] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:08:03.497628] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T20:08:03.980713] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-28T20:08:04.160070] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T20:08:04.780248] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-28T20:08:05.261238] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T20:08:05.271349] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T20:08:05.580273] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-28T20:08:06.380231] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-28T20:08:06.451947] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T20:08:07.181275] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-28T20:08:07.182750] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T20:08:07.980232] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-28T20:08:08.053322] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T20:08:08.780250] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-28T20:08:08.924396] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T20:08:09.580304] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-28T20:08:10.380286] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-28T20:08:10.721976] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T20:08:10.967618] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T20:08:11.180249] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-28T20:08:11.274587] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-28T20:08:11.980224] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-28T20:08:12.189028] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T20:08:12.746325] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T20:08:12.780228] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-28T20:08:13.580239] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-28T20:08:13.676687] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T20:08:14.138335] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:08:14.380267] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-28T20:08:14.826052] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T20:08:15.180277] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-28T20:08:15.939933] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:08:15.980220] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-28T20:08:16.710524] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T20:08:16.780242] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-28T20:08:17.580239] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-28T20:08:17.696255] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T20:08:18.380304] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-28T20:08:18.603182] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T20:08:19.180249] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-28T20:08:19.326330] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T20:08:19.331346] [INFO ] [REMOTE ] MYE: Full fetch complete (35968 records). [2025-10-28T20:08:19.331469] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-28T20:08:19.705987] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-28T20:08:19.706084] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-28T20:08:19.706919] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-28T20:08:19.706986] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-28T20:08:19.707955] [DEBUG] [LOCAL ] MYE: Trimmed 35968 records to 23673 (keeping 200 days of data) [2025-10-28T20:08:19.851239] [DEBUG] [LOCAL ] MYE: Primary data saved (23673 records). [2025-10-28T20:08:19.851350] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-28T20:08:19.851433] [INFO ] [MAIN ] Update Progress: 1441/2366 symbols completed. MYE took 21.6s. Estimated remaining: 2h 0m 52s. Rate: 7.7 symbols/min [2025-10-28T20:08:19.995637] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-28T20:08:20.041687] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:08:20.042923] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T20:08:20.071059] [DEBUG] [LOCAL ] NAC: Loaded 24309 existing records from primary storage. [2025-10-28T20:08:20.071326] [INFO ] [MAIN ] NAC: Loaded 24309 existing records. [2025-10-28T20:08:20.250032] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:20.250264] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-28T20:08:20.250313] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-28T20:08:20.250559] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-28T20:08:20.250602] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-28T20:08:20.606127] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:20.780216] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-28T20:08:21.161496] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T20:08:21.580275] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-28T20:08:21.597691] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T20:08:22.381050] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-28T20:08:22.671472] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T20:08:23.065344] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T20:08:23.180272] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-28T20:08:23.746710] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T20:08:23.980287] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-28T20:08:24.648780] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T20:08:24.780243] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-28T20:08:25.329761] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T20:08:25.580238] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-28T20:08:26.145236] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T20:08:26.380253] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-28T20:08:27.043861] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T20:08:27.046444] [INFO ] [REMOTE ] MYN: Full fetch complete (14937 records). [2025-10-28T20:08:27.046540] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-28T20:08:27.187017] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-28T20:08:27.408926] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-28T20:08:27.408999] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-28T20:08:27.409329] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-28T20:08:27.409368] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-28T20:08:27.409865] [DEBUG] [LOCAL ] MYN: Trimmed 14937 records to 9831 (keeping 200 days of data) [2025-10-28T20:08:27.470037] [DEBUG] [LOCAL ] MYN: Primary data saved (9831 records). [2025-10-28T20:08:27.470198] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-28T20:08:27.470310] [INFO ] [MAIN ] Update Progress: 1442/2366 symbols completed. MYN took 29.2s. Estimated remaining: 2h 0m 44s. Rate: 7.7 symbols/min [2025-10-28T20:08:27.634618] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:08:27.667293] [DEBUG] [LOCAL ] NAD: Loaded 33119 existing records from primary storage. [2025-10-28T20:08:27.667577] [INFO ] [MAIN ] NAD: Loaded 33119 existing records. [2025-10-28T20:08:27.842806] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:27.843008] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-28T20:08:27.843057] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-28T20:08:27.843599] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-28T20:08:27.843682] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-28T20:08:27.985740] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-28T20:08:28.111216] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T20:08:28.234662] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:28.780237] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-28T20:08:29.580301] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-28T20:08:30.022303] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T20:08:30.029543] [INFO ] [REMOTE ] NABL: Full fetch complete (56807 records). [2025-10-28T20:08:30.029639] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-28T20:08:30.382363] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-28T20:08:30.416155] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-28T20:08:30.416227] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-28T20:08:30.417158] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-28T20:08:30.417218] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-28T20:08:30.418342] [DEBUG] [LOCAL ] NABL: Trimmed 56807 records to 38426 (keeping 200 days of data) [2025-10-28T20:08:30.640823] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T20:08:30.663947] [DEBUG] [LOCAL ] NABL: Primary data saved (38426 records). [2025-10-28T20:08:30.664084] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-28T20:08:30.664880] [INFO ] [MAIN ] Update Progress: 1443/2366 symbols completed. NABL took 32.4s. Estimated remaining: 2h 0m 33s. Rate: 7.7 symbols/min [2025-10-28T20:08:30.841806] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:08:30.854077] [DEBUG] [LOCAL ] NAN: Loaded 8376 existing records from primary storage. [2025-10-28T20:08:30.854280] [INFO ] [MAIN ] NAN: Loaded 8376 existing records. [2025-10-28T20:08:31.035166] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:31.035373] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-28T20:08:31.035447] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-28T20:08:31.035755] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-28T20:08:31.035844] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-28T20:08:31.188780] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-28T20:08:31.429796] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:31.438136] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T20:08:31.442960] [INFO ] [REMOTE ] MYI: Full fetch complete (29036 records). [2025-10-28T20:08:31.443037] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-28T20:08:31.804511] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-28T20:08:31.804587] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-28T20:08:31.805351] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-28T20:08:31.805412] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-28T20:08:31.806355] [DEBUG] [LOCAL ] MYI: Trimmed 29036 records to 19012 (keeping 200 days of data) [2025-10-28T20:08:31.916971] [DEBUG] [LOCAL ] MYI: Primary data saved (19012 records). [2025-10-28T20:08:31.917076] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-28T20:08:31.917151] [INFO ] [MAIN ] Update Progress: 1444/2366 symbols completed. MYI took 33.7s. Estimated remaining: 2h 0m 21s. Rate: 7.7 symbols/min [2025-10-28T20:08:31.987422] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-28T20:08:32.034467] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (4.05 seconds). [2025-10-28T20:08:32.109826] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:08:32.151618] [DEBUG] [LOCAL ] NAT: Loaded 49154 existing records from primary storage. [2025-10-28T20:08:32.151931] [INFO ] [MAIN ] NAT: Loaded 49154 existing records. [2025-10-28T20:08:32.332063] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:32.332314] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-28T20:08:32.332499] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-28T20:08:32.348496] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T20:08:32.348542] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-28T20:08:32.354302] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-28T20:08:32.642337] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T20:08:32.721842] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:32.780219] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-28T20:08:33.580270] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-28T20:08:33.659382] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T20:08:34.380277] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-28T20:08:34.698610] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T20:08:35.014863] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T20:08:35.180277] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-28T20:08:35.980374] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-28T20:08:36.347404] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T20:08:36.425882] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T20:08:36.780300] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-28T20:08:37.580305] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-28T20:08:38.380246] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-28T20:08:38.522335] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T20:08:38.964246] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T20:08:39.180271] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-28T20:08:39.980245] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-28T20:08:40.153682] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T20:08:40.462930] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T20:08:40.780298] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-28T20:08:41.580274] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-28T20:08:41.820439] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T20:08:42.003742] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T20:08:42.380257] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-28T20:08:43.180251] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-28T20:08:43.346011] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T20:08:43.772033] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T20:08:43.980299] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-28T20:08:44.505090] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T20:08:44.780332] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-28T20:08:45.038027] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (8.26 seconds). [2025-10-28T20:08:45.538980] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T20:08:45.580365] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-28T20:08:46.380268] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-28T20:08:47.180317] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-28T20:08:47.439492] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T20:08:47.980297] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-28T20:08:48.521625] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T20:08:48.780277] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-28T20:08:48.911754] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T20:08:49.163467] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (3.58 seconds). [2025-10-28T20:08:49.360839] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T20:08:49.363075] [INFO ] [REMOTE ] NAN: Full fetch complete (13539 records). [2025-10-28T20:08:49.363146] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-28T20:08:49.585377] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-28T20:08:49.723902] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-28T20:08:49.723974] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-28T20:08:49.724271] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-28T20:08:49.724308] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-28T20:08:49.724770] [DEBUG] [LOCAL ] NAN: Trimmed 13539 records to 8250 (keeping 200 days of data) [2025-10-28T20:08:49.776182] [DEBUG] [LOCAL ] NAN: Primary data saved (8250 records). [2025-10-28T20:08:49.776299] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-28T20:08:49.776374] [INFO ] [MAIN ] Update Progress: 1445/2366 symbols completed. NAN took 19.1s. Estimated remaining: 2h 0m 19s. Rate: 7.7 symbols/min [2025-10-28T20:08:49.942826] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:08:49.975025] [DEBUG] [LOCAL ] NATL: Loaded 31608 existing records from primary storage. [2025-10-28T20:08:49.975320] [INFO ] [MAIN ] NATL: Loaded 31608 existing records. [2025-10-28T20:08:50.151611] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:50.151861] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-28T20:08:50.151908] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-28T20:08:50.152469] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-28T20:08:50.152528] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-28T20:08:50.385418] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-28T20:08:50.502716] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:50.685334] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T20:08:50.691474] [INFO ] [REMOTE ] NAD: Full fetch complete (48174 records). [2025-10-28T20:08:50.691583] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-28T20:08:51.060598] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-28T20:08:51.060694] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-28T20:08:51.061532] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-28T20:08:51.061571] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-28T20:08:51.062528] [DEBUG] [LOCAL ] NAD: Trimmed 48174 records to 32946 (keeping 200 days of data) [2025-10-28T20:08:51.180283] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-28T20:08:51.261065] [DEBUG] [LOCAL ] NAD: Primary data saved (32946 records). [2025-10-28T20:08:51.261173] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-28T20:08:51.261562] [INFO ] [MAIN ] Update Progress: 1446/2366 symbols completed. NAD took 23.8s. Estimated remaining: 2h 0m 7s. Rate: 7.7 symbols/min [2025-10-28T20:08:51.428121] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:08:51.433864] [DEBUG] [LOCAL ] NAZ: Loaded 2646 existing records from primary storage. [2025-10-28T20:08:51.434043] [INFO ] [MAIN ] NAZ: Loaded 2646 existing records. [2025-10-28T20:08:51.606339] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:08:51.606564] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-28T20:08:51.606611] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-28T20:08:51.606800] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-28T20:08:51.606858] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-28T20:08:51.967440] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:08:51.983948] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-28T20:08:51.996781] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T20:08:52.057673] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T20:08:52.399294] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T20:08:52.780301] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-28T20:08:53.130310] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T20:08:53.580248] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-28T20:08:54.385447] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-28T20:08:54.399932] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T20:08:55.180283] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-28T20:08:55.547252] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T20:08:55.722021] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T20:08:55.980261] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-28T20:08:56.335068] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T20:08:56.780271] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-28T20:08:57.454903] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T20:08:57.580248] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-28T20:08:58.344561] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T20:08:58.380219] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-28T20:08:59.180290] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-28T20:08:59.314572] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T20:08:59.980303] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-28T20:09:00.263024] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-28T20:09:00.526045] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T20:09:00.780229] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-28T20:09:01.169368] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T20:09:01.580260] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-28T20:09:02.380250] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-28T20:09:02.500805] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T20:09:03.087159] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T20:09:03.180299] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-28T20:09:03.980266] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-28T20:09:04.088137] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T20:09:04.780287] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-28T20:09:05.143618] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T20:09:05.563450] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T20:09:05.580207] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-28T20:09:06.380313] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-28T20:09:06.740672] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T20:09:06.742824] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T20:09:07.180279] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-28T20:09:07.980319] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-28T20:09:08.458221] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T20:09:08.780235] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-28T20:09:08.849275] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:09:09.580245] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-28T20:09:10.059150] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:09:10.380237] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-28T20:09:10.640993] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T20:09:11.180225] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-28T20:09:11.405547] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T20:09:11.980243] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-28T20:09:12.289409] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T20:09:12.295028] [INFO ] [REMOTE ] NAC: Full fetch complete (35429 records). [2025-10-28T20:09:12.295136] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-28T20:09:12.681838] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-28T20:09:12.681955] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-28T20:09:12.683733] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-28T20:09:12.683797] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-28T20:09:12.684939] [DEBUG] [LOCAL ] NAC: Trimmed 35429 records to 24219 (keeping 200 days of data) [2025-10-28T20:09:12.782718] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-28T20:09:12.852186] [DEBUG] [LOCAL ] NAC: Primary data saved (24219 records). [2025-10-28T20:09:12.852381] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-28T20:09:12.852524] [INFO ] [MAIN ] Update Progress: 1447/2366 symbols completed. NAC took 53.0s. Estimated remaining: 2h 0m 8s. Rate: 7.6 symbols/min [2025-10-28T20:09:13.037742] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:13.068512] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T20:09:13.086738] [DEBUG] [LOCAL ] NBB: Loaded 8889 existing records from primary storage. [2025-10-28T20:09:13.087181] [INFO ] [MAIN ] NBB: Loaded 8889 existing records. [2025-10-28T20:09:13.278826] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:13.279150] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-28T20:09:13.279209] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-28T20:09:13.279460] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-28T20:09:13.279505] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-28T20:09:13.585446] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-28T20:09:13.659480] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:14.369206] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T20:09:14.380242] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-28T20:09:14.380490] [INFO ] [REMOTE ] NAT: Full fetch complete (72157 records). [2025-10-28T20:09:14.380614] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-28T20:09:14.803157] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-28T20:09:14.803440] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-28T20:09:14.805185] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-28T20:09:14.805272] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-28T20:09:14.829885] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T20:09:14.838774] [DEBUG] [LOCAL ] NAT: Trimmed 72157 records to 49164 (keeping 200 days of data) [2025-10-28T20:09:15.027632] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T20:09:15.162126] [DEBUG] [LOCAL ] NAT: Primary data saved (49164 records). [2025-10-28T20:09:15.162323] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-28T20:09:15.162423] [INFO ] [MAIN ] Update Progress: 1448/2366 symbols completed. NAT took 43.2s. Estimated remaining: 1h 59m 57s. Rate: 7.7 symbols/min [2025-10-28T20:09:15.185415] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-28T20:09:15.341019] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:15.367127] [DEBUG] [LOCAL ] NBHC: Loaded 23555 existing records from primary storage. [2025-10-28T20:09:15.367589] [INFO ] [MAIN ] NBHC: Loaded 23555 existing records. [2025-10-28T20:09:15.588525] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:15.588835] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-28T20:09:15.588891] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-28T20:09:15.589346] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-28T20:09:15.589409] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-28T20:09:15.757345] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T20:09:15.980231] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:15.980350] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-28T20:09:16.550246] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T20:09:16.551393] [INFO ] [REMOTE ] NAZ: Full fetch complete (4067 records). [2025-10-28T20:09:16.551463] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-28T20:09:16.785447] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-28T20:09:16.925799] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-28T20:09:16.925891] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-28T20:09:16.926089] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-28T20:09:16.926149] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-28T20:09:16.926527] [DEBUG] [LOCAL ] NAZ: Trimmed 4067 records to 2627 (keeping 200 days of data) [2025-10-28T20:09:16.942753] [DEBUG] [LOCAL ] NAZ: Primary data saved (2627 records). [2025-10-28T20:09:16.942849] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-28T20:09:16.942925] [INFO ] [MAIN ] Update Progress: 1449/2366 symbols completed. NAZ took 25.7s. Estimated remaining: 1h 59m 45s. Rate: 7.7 symbols/min [2025-10-28T20:09:17.115822] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:17.149122] [DEBUG] [LOCAL ] NBR: Loaded 34163 existing records from primary storage. [2025-10-28T20:09:17.149399] [INFO ] [MAIN ] NBR: Loaded 34163 existing records. [2025-10-28T20:09:17.335454] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:17.335721] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-28T20:09:17.335775] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-28T20:09:17.336135] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-28T20:09:17.336193] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-28T20:09:17.585320] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-28T20:09:17.710514] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:17.722455] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T20:09:18.380228] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-28T20:09:18.536428] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T20:09:18.542068] [INFO ] [REMOTE ] NATL: Full fetch complete (44725 records). [2025-10-28T20:09:18.542162] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-28T20:09:18.920674] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-28T20:09:18.920770] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-28T20:09:18.921711] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-28T20:09:18.921773] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-28T20:09:18.923289] [DEBUG] [LOCAL ] NATL: Trimmed 44725 records to 31569 (keeping 200 days of data) [2025-10-28T20:09:19.078520] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T20:09:19.121393] [DEBUG] [LOCAL ] NATL: Primary data saved (31569 records). [2025-10-28T20:09:19.121508] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-28T20:09:19.121582] [INFO ] [MAIN ] Update Progress: 1450/2366 symbols completed. NATL took 29.3s. Estimated remaining: 1h 59m 34s. Rate: 7.7 symbols/min [2025-10-28T20:09:19.185359] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-28T20:09:19.295690] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:19.316272] [DEBUG] [LOCAL ] NBXG: Loaded 21220 existing records from primary storage. [2025-10-28T20:09:19.316494] [INFO ] [MAIN ] NBXG: Loaded 21220 existing records. [2025-10-28T20:09:19.499157] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:19.499386] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-28T20:09:19.499437] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-28T20:09:19.499740] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-28T20:09:19.499797] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-28T20:09:19.781089] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T20:09:19.858680] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:19.980234] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-28T20:09:20.370637] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T20:09:20.780261] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-28T20:09:21.580028] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T20:09:21.585102] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-28T20:09:22.385317] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-28T20:09:22.396720] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T20:09:23.017587] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T20:09:23.180245] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-28T20:09:23.727625] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T20:09:23.980290] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-28T20:09:24.726065] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T20:09:24.780221] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-28T20:09:25.580302] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-28T20:09:25.612268] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T20:09:26.380296] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-28T20:09:26.425270] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T20:09:27.146419] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T20:09:27.180218] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-28T20:09:27.884478] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T20:09:27.980261] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-28T20:09:28.657746] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T20:09:28.780292] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-28T20:09:29.580232] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-28T20:09:29.682465] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T20:09:30.255303] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:09:30.380231] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-28T20:09:31.130309] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T20:09:31.180218] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-28T20:09:31.984417] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-28T20:09:31.985917] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T20:09:32.780233] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-28T20:09:32.839788] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T20:09:33.580250] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-28T20:09:33.658220] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:09:34.335906] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T20:09:34.380241] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-28T20:09:35.180240] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-28T20:09:35.202631] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:09:35.980275] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-28T20:09:36.108420] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T20:09:36.780240] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-28T20:09:36.834792] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T20:09:36.839037] [INFO ] [REMOTE ] NBXG: Full fetch complete (32254 records). [2025-10-28T20:09:36.839117] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-28T20:09:37.210405] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-28T20:09:37.210487] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-28T20:09:37.211160] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-28T20:09:37.211221] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-28T20:09:37.212088] [DEBUG] [LOCAL ] NBXG: Trimmed 32254 records to 21117 (keeping 200 days of data) [2025-10-28T20:09:37.337140] [DEBUG] [LOCAL ] NBXG: Primary data saved (21117 records). [2025-10-28T20:09:37.337262] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-28T20:09:37.337338] [INFO ] [MAIN ] Update Progress: 1451/2366 symbols completed. NBXG took 18.2s. Estimated remaining: 1h 59m 33s. Rate: 7.7 symbols/min [2025-10-28T20:09:37.502804] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:37.507103] [DEBUG] [LOCAL ] NC: Loaded 1839 existing records from primary storage. [2025-10-28T20:09:37.507246] [INFO ] [MAIN ] NC: Loaded 1839 existing records. [2025-10-28T20:09:37.585354] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-28T20:09:37.688758] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:37.689049] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-28T20:09:37.689099] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-28T20:09:37.689312] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-28T20:09:37.689405] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-28T20:09:37.981452] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T20:09:38.074927] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:38.205833] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T20:09:38.380251] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-28T20:09:38.711575] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-28T20:09:39.180264] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-28T20:09:39.681528] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T20:09:39.980273] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-28T20:09:40.317738] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T20:09:40.780248] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-28T20:09:41.580257] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-28T20:09:41.934112] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T20:09:41.939873] [INFO ] [REMOTE ] NBHC: Full fetch complete (33449 records). [2025-10-28T20:09:41.939964] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-28T20:09:42.327974] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-28T20:09:42.328052] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-28T20:09:42.328845] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-28T20:09:42.328904] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-28T20:09:42.329784] [DEBUG] [LOCAL ] NBHC: Trimmed 33449 records to 23470 (keeping 200 days of data) [2025-10-28T20:09:42.388455] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-28T20:09:42.473916] [DEBUG] [LOCAL ] NBHC: Primary data saved (23470 records). [2025-10-28T20:09:42.474123] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-28T20:09:42.474216] [INFO ] [MAIN ] Update Progress: 1452/2366 symbols completed. NBHC took 27.3s. Estimated remaining: 1h 59m 23s. Rate: 7.7 symbols/min [2025-10-28T20:09:42.654286] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:42.678531] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T20:09:42.695794] [DEBUG] [LOCAL ] NCA: Loaded 9447 existing records from primary storage. [2025-10-28T20:09:42.696135] [INFO ] [MAIN ] NCA: Loaded 9447 existing records. [2025-10-28T20:09:42.816235] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T20:09:42.891961] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:42.892180] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-28T20:09:42.892230] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-28T20:09:42.892409] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-28T20:09:42.892451] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-28T20:09:43.188407] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-28T20:09:43.273869] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:43.747635] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:09:43.980320] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-28T20:09:44.390937] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T20:09:44.780248] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-28T20:09:45.167100] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T20:09:45.580250] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-28T20:09:45.877573] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T20:09:46.380261] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-28T20:09:46.667454] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T20:09:47.180294] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-28T20:09:47.429261] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-28T20:09:47.980302] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-28T20:09:48.276573] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T20:09:48.780279] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-28T20:09:49.348120] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T20:09:49.349123] [INFO ] [REMOTE ] NC: Full fetch complete (2726 records). [2025-10-28T20:09:49.349194] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-28T20:09:49.585497] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-28T20:09:49.720399] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-28T20:09:49.720474] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-28T20:09:49.720583] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-28T20:09:49.720621] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-28T20:09:49.720983] [DEBUG] [LOCAL ] NC: Trimmed 2726 records to 1797 (keeping 200 days of data) [2025-10-28T20:09:49.732188] [DEBUG] [LOCAL ] NC: Primary data saved (1797 records). [2025-10-28T20:09:49.732272] [INFO ] [MAIN ] NC: Full history saved. [2025-10-28T20:09:49.732345] [INFO ] [MAIN ] Update Progress: 1453/2366 symbols completed. NC took 12.4s. Estimated remaining: 1h 59m 15s. Rate: 7.7 symbols/min [2025-10-28T20:09:49.921331] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:49.943126] [DEBUG] [LOCAL ] NCDL: Loaded 21391 existing records from primary storage. [2025-10-28T20:09:49.943373] [INFO ] [MAIN ] NCDL: Loaded 21391 existing records. [2025-10-28T20:09:50.125426] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:09:50.125623] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-28T20:09:50.125699] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-28T20:09:50.126089] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-28T20:09:50.126154] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-28T20:09:50.385482] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-28T20:09:50.496564] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:50.765046] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T20:09:50.959290] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T20:09:51.180242] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-28T20:09:51.831699] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T20:09:51.834006] [INFO ] [REMOTE ] NBB: Full fetch complete (12875 records). [2025-10-28T20:09:51.834110] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-28T20:09:51.987288] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-28T20:09:52.195680] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-28T20:09:52.195768] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-28T20:09:52.196112] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-28T20:09:52.196171] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-28T20:09:52.196749] [DEBUG] [LOCAL ] NBB: Trimmed 12875 records to 8885 (keeping 200 days of data) [2025-10-28T20:09:52.250909] [DEBUG] [LOCAL ] NBB: Primary data saved (8885 records). [2025-10-28T20:09:52.251038] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-28T20:09:52.251116] [INFO ] [MAIN ] Update Progress: 1454/2366 symbols completed. NBB took 39.4s. Estimated remaining: 1h 59m 4s. Rate: 7.7 symbols/min [2025-10-28T20:09:52.417576] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:09:52.417758] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-28T20:09:52.417802] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-28T20:09:52.417909] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-28T20:09:52.417950] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-28T20:09:52.417989] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-28T20:09:52.418020] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-28T20:09:52.767427] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:09:52.780207] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-28T20:09:53.313038] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T20:09:53.580292] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-28T20:09:54.380230] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-28T20:09:54.432182] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T20:09:54.458797] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T20:09:55.047862] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T20:09:55.180252] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-28T20:09:55.980212] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-28T20:09:56.183672] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T20:09:56.780374] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-28T20:09:57.511244] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:09:57.580221] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-28T20:09:57.631689] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T20:09:58.356868] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T20:09:58.380215] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-28T20:09:58.875707] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T20:09:59.180245] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-28T20:09:59.980278] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-28T20:10:00.780241] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-28T20:10:00.895155] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T20:10:00.969177] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T20:10:01.140592] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T20:10:01.580259] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-28T20:10:02.139741] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T20:10:02.380293] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-28T20:10:03.180249] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-28T20:10:03.640866] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T20:10:03.965922] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T20:10:03.980218] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-28T20:10:04.724254] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T20:10:04.780218] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-28T20:10:05.281496] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T20:10:05.580310] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-28T20:10:06.380294] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-28T20:10:06.546011] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T20:10:06.936399] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T20:10:07.180284] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-28T20:10:07.980271] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-28T20:10:08.267018] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T20:10:08.780262] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-28T20:10:09.488565] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T20:10:09.580241] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-28T20:10:10.033146] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-28T20:10:10.201674] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T20:10:10.380255] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-28T20:10:11.180264] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-28T20:10:11.980218] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-28T20:10:12.078247] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T20:10:12.271776] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T20:10:12.644374] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T20:10:12.780276] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-28T20:10:13.580271] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-28T20:10:13.911769] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T20:10:13.917239] [INFO ] [REMOTE ] NCDL: Full fetch complete (32988 records). [2025-10-28T20:10:13.917320] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-28T20:10:14.157347] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T20:10:14.299910] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-28T20:10:14.300021] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-28T20:10:14.300703] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-28T20:10:14.300763] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-28T20:10:14.301484] [DEBUG] [LOCAL ] NCDL: Trimmed 32988 records to 21315 (keeping 200 days of data) [2025-10-28T20:10:14.388751] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-28T20:10:14.431572] [DEBUG] [LOCAL ] NCDL: Primary data saved (21315 records). [2025-10-28T20:10:14.431705] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-28T20:10:14.431789] [INFO ] [MAIN ] Update Progress: 1455/2366 symbols completed. NCDL took 24.7s. Estimated remaining: 1h 59m 5s. Rate: 7.7 symbols/min [2025-10-28T20:10:14.595486] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:14.610170] [DEBUG] [LOCAL ] NCV: Loaded 13799 existing records from primary storage. [2025-10-28T20:10:14.610393] [INFO ] [MAIN ] NCV: Loaded 13799 existing records. [2025-10-28T20:10:14.783436] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:14.783994] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-28T20:10:14.784040] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-28T20:10:14.784227] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-28T20:10:14.784266] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-28T20:10:14.972181] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T20:10:15.147366] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:15.180212] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-28T20:10:15.949482] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T20:10:15.980216] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-28T20:10:16.606623] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T20:10:16.780290] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-28T20:10:17.580309] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-28T20:10:17.895748] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T20:10:17.901913] [INFO ] [REMOTE ] NBR: Full fetch complete (49151 records). [2025-10-28T20:10:17.902036] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-28T20:10:18.273634] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-28T20:10:18.273743] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-28T20:10:18.274665] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-28T20:10:18.274725] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-28T20:10:18.275748] [DEBUG] [LOCAL ] NBR: Trimmed 49151 records to 34102 (keeping 200 days of data) [2025-10-28T20:10:18.380293] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-28T20:10:18.474289] [DEBUG] [LOCAL ] NBR: Primary data saved (34102 records). [2025-10-28T20:10:18.474431] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-28T20:10:18.474511] [INFO ] [MAIN ] Update Progress: 1456/2366 symbols completed. NBR took 1m 2s. Estimated remaining: 1h 58m 55s. Rate: 7.7 symbols/min [2025-10-28T20:10:18.643071] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:18.656152] [DEBUG] [LOCAL ] NCZ: Loaded 12075 existing records from primary storage. [2025-10-28T20:10:18.656367] [INFO ] [MAIN ] NCZ: Loaded 12075 existing records. [2025-10-28T20:10:18.827063] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:18.827258] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-28T20:10:18.827306] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-28T20:10:18.827469] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-28T20:10:18.827508] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-28T20:10:19.127568] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:10:19.182584] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-28T20:10:19.222074] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:19.374809] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-28T20:10:19.829502] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T20:10:19.831224] [INFO ] [REMOTE ] NCA: Full fetch complete (14022 records). [2025-10-28T20:10:19.831293] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-28T20:10:19.985617] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-28T20:10:20.199207] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-28T20:10:20.199281] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-28T20:10:20.199587] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-28T20:10:20.199624] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-28T20:10:20.200111] [DEBUG] [LOCAL ] NCA: Trimmed 14022 records to 9429 (keeping 200 days of data) [2025-10-28T20:10:20.253909] [DEBUG] [LOCAL ] NCA: Primary data saved (9429 records). [2025-10-28T20:10:20.254029] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-28T20:10:20.254115] [INFO ] [MAIN ] Update Progress: 1457/2366 symbols completed. NCA took 37.8s. Estimated remaining: 1h 58m 43s. Rate: 7.7 symbols/min [2025-10-28T20:10:20.418853] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:20.435613] [DEBUG] [LOCAL ] NDMO: Loaded 16721 existing records from primary storage. [2025-10-28T20:10:20.435867] [INFO ] [MAIN ] NDMO: Loaded 16721 existing records. [2025-10-28T20:10:20.629577] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:20.629794] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-28T20:10:20.629841] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-28T20:10:20.630093] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-28T20:10:20.630135] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-28T20:10:20.803532] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-28T20:10:20.985348] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T20:10:21.006010] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:21.467810] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T20:10:21.580269] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-28T20:10:22.178235] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T20:10:22.380293] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-28T20:10:23.180251] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-28T20:10:23.779184] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T20:10:23.980217] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-28T20:10:24.177315] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T20:10:24.573985] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T20:10:24.780244] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-28T20:10:25.410432] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T20:10:25.580280] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-28T20:10:26.380253] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-28T20:10:27.022901] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T20:10:27.067585] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T20:10:27.180219] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-28T20:10:27.980256] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-28T20:10:28.559120] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T20:10:28.618452] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T20:10:28.780253] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-28T20:10:29.481936] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T20:10:29.580270] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-28T20:10:30.380252] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-28T20:10:31.041619] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T20:10:31.180235] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-28T20:10:31.872724] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T20:10:31.980229] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-28T20:10:32.692765] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T20:10:32.780273] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-28T20:10:33.399688] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (3.82 seconds). [2025-10-28T20:10:33.580309] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-28T20:10:34.278356] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T20:10:34.380270] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-28T20:10:34.783697] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T20:10:34.794239] [INFO ] [REMOTE ] NCLH: Full fetch complete (77933 records). [2025-10-28T20:10:34.794384] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-28T20:10:35.102532] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T20:10:35.194776] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-28T20:10:35.198932] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-10-28T20:10:35.199007] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-10-28T20:10:35.200868] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-10-28T20:10:35.201029] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-10-28T20:10:35.202695] [DEBUG] [LOCAL ] NCLH: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-28T20:10:35.543137] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-10-28T20:10:35.543312] [INFO ] [MAIN ] NCLH: Full history saved. [2025-10-28T20:10:35.543412] [INFO ] [MAIN ] Update Progress: 1458/2366 symbols completed. NCLH took 43.3s. Estimated remaining: 1h 58m 40s. Rate: 7.7 symbols/min [2025-10-28T20:10:35.710143] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:35.757740] [DEBUG] [LOCAL ] NE: Loaded 52277 existing records from primary storage. [2025-10-28T20:10:35.758029] [INFO ] [MAIN ] NE: Loaded 52277 existing records. [2025-10-28T20:10:35.877038] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T20:10:35.944047] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:35.944248] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-28T20:10:35.944318] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-28T20:10:35.944838] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-28T20:10:35.944899] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-28T20:10:35.985520] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-28T20:10:36.296719] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:36.668780] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:10:36.780272] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-28T20:10:37.580316] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-28T20:10:38.058629] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T20:10:38.380217] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-28T20:10:38.478775] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T20:10:38.484752] [INFO ] [REMOTE ] NCV: Full fetch complete (22448 records). [2025-10-28T20:10:38.484869] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-28T20:10:38.878882] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-28T20:10:38.878973] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-28T20:10:38.879500] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-28T20:10:38.879578] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-28T20:10:38.886242] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T20:10:38.886331] [DEBUG] [LOCAL ] NCV: Trimmed 22448 records to 13788 (keeping 200 days of data) [2025-10-28T20:10:38.969668] [DEBUG] [LOCAL ] NCV: Primary data saved (13788 records). [2025-10-28T20:10:38.969805] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-28T20:10:38.969886] [INFO ] [MAIN ] Update Progress: 1459/2366 symbols completed. NCV took 24.5s. Estimated remaining: 1h 58m 29s. Rate: 7.7 symbols/min [2025-10-28T20:10:39.134259] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:39.169159] [DEBUG] [LOCAL ] NEA: Loaded 34773 existing records from primary storage. [2025-10-28T20:10:39.169436] [INFO ] [MAIN ] NEA: Loaded 34773 existing records. [2025-10-28T20:10:39.189566] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-28T20:10:39.347978] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:39.348178] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-28T20:10:39.348225] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-28T20:10:39.348477] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-28T20:10:39.348517] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-28T20:10:39.766858] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:39.980235] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-28T20:10:40.627512] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T20:10:40.780315] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-28T20:10:41.099631] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:10:41.303614] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T20:10:41.580411] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-28T20:10:42.219982] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T20:10:42.380295] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-28T20:10:43.180220] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-28T20:10:43.217887] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T20:10:43.909414] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T20:10:43.980244] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-28T20:10:44.780248] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-28T20:10:44.875838] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T20:10:45.304692] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T20:10:45.580286] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-28T20:10:46.224057] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:10:46.380250] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-28T20:10:47.180236] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-28T20:10:47.434334] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T20:10:47.965538] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T20:10:47.969019] [INFO ] [REMOTE ] NDMO: Full fetch complete (23361 records). [2025-10-28T20:10:47.969091] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-28T20:10:47.990536] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-28T20:10:48.346594] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-28T20:10:48.346694] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-28T20:10:48.347237] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-28T20:10:48.347278] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-28T20:10:48.347893] [DEBUG] [LOCAL ] NDMO: Trimmed 23361 records to 16778 (keeping 200 days of data) [2025-10-28T20:10:48.445953] [DEBUG] [LOCAL ] NDMO: Primary data saved (16778 records). [2025-10-28T20:10:48.446119] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-28T20:10:48.446201] [INFO ] [MAIN ] Update Progress: 1460/2366 symbols completed. NDMO took 28.2s. Estimated remaining: 1h 58m 22s. Rate: 7.7 symbols/min [2025-10-28T20:10:48.619060] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:48.668909] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-28T20:10:48.669201] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-10-28T20:10:48.785353] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-28T20:10:48.845399] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:48.845583] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-28T20:10:48.845629] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-28T20:10:48.846300] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-10-28T20:10:48.846358] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-28T20:10:49.228116] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:49.231464] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T20:10:49.441124] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T20:10:49.580247] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-28T20:10:50.380215] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-28T20:10:50.504467] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T20:10:51.180309] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-28T20:10:51.665956] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T20:10:51.980248] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-28T20:10:52.323542] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T20:10:52.780249] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-28T20:10:53.588049] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-28T20:10:53.574440] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T20:10:53.596309] [INFO ] [REMOTE ] NCZ: Full fetch complete (20727 records). [2025-10-28T20:10:53.598238] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T20:10:53.596803] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-28T20:10:54.047872] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-28T20:10:54.047951] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-28T20:10:54.048386] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-28T20:10:54.048446] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-28T20:10:54.049088] [DEBUG] [LOCAL ] NCZ: Trimmed 20727 records to 12096 (keeping 200 days of data) [2025-10-28T20:10:54.120698] [DEBUG] [LOCAL ] NCZ: Primary data saved (12096 records). [2025-10-28T20:10:54.120822] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-28T20:10:54.120898] [INFO ] [MAIN ] Update Progress: 1461/2366 symbols completed. NCZ took 35.6s. Estimated remaining: 1h 58m 13s. Rate: 7.7 symbols/min [2025-10-28T20:10:54.285031] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:10:54.332982] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-28T20:10:54.333281] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-10-28T20:10:54.385916] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-28T20:10:54.507705] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:10:54.507889] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-28T20:10:54.507934] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-28T20:10:54.508497] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-10-28T20:10:54.508553] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-28T20:10:54.854739] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:10:55.166135] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T20:10:55.180220] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-28T20:10:55.531905] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T20:10:55.980307] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-28T20:10:56.777993] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T20:10:56.787366] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-28T20:10:56.993836] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T20:10:57.580254] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-28T20:10:58.332617] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T20:10:58.380240] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-28T20:10:59.126349] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T20:10:59.180237] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-28T20:10:59.980238] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-28T20:11:00.701179] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T20:11:00.708888] [INFO ] [REMOTE ] NEA: Full fetch complete (50901 records). [2025-10-28T20:11:00.709000] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-28T20:11:00.786873] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-28T20:11:01.105875] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-28T20:11:01.105998] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-28T20:11:01.107401] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-28T20:11:01.107493] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-28T20:11:01.108762] [DEBUG] [LOCAL ] NEA: Trimmed 50901 records to 34710 (keeping 200 days of data) [2025-10-28T20:11:01.325154] [DEBUG] [LOCAL ] NEA: Primary data saved (34710 records). [2025-10-28T20:11:01.325304] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-28T20:11:01.325400] [INFO ] [MAIN ] Update Progress: 1462/2366 symbols completed. NEA took 22.4s. Estimated remaining: 1h 58m 5s. Rate: 7.7 symbols/min [2025-10-28T20:11:01.510893] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:01.562791] [DEBUG] [LOCAL ] NET: Loaded 52707 existing records from primary storage. [2025-10-28T20:11:01.563120] [INFO ] [MAIN ] NET: Loaded 52707 existing records. [2025-10-28T20:11:01.749999] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:01.750251] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-28T20:11:01.750301] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-28T20:11:01.750972] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-28T20:11:01.751030] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-28T20:11:02.141472] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:02.141867] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-28T20:11:02.174980] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T20:11:02.380242] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-28T20:11:03.654803] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T20:11:03.666127] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-28T20:11:03.701164] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T20:11:03.980282] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-28T20:11:05.276147] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T20:11:05.286733] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-28T20:11:05.323533] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T20:11:05.580242] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-28T20:11:06.928033] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T20:11:06.939319] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-28T20:11:07.026999] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T20:11:07.180241] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-28T20:11:08.384231] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T20:11:08.395567] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-28T20:11:08.833546] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T20:11:08.844520] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-28T20:11:09.617756] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (11.24 seconds). [2025-10-28T20:11:09.627807] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-28T20:11:09.835786] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T20:11:09.846723] [INFO ] [REMOTE ] NE: Full fetch complete (75775 records). [2025-10-28T20:11:09.846959] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-28T20:11:10.264544] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-28T20:11:10.264627] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-28T20:11:10.265752] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-28T20:11:10.265813] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-28T20:11:10.267449] [DEBUG] [LOCAL ] NE: Trimmed 75775 records to 52271 (keeping 200 days of data) [2025-10-28T20:11:10.583132] [DEBUG] [LOCAL ] NE: Primary data saved (52271 records). [2025-10-28T20:11:10.583358] [INFO ] [MAIN ] NE: Full history saved. [2025-10-28T20:11:10.583468] [INFO ] [MAIN ] Update Progress: 1463/2366 symbols completed. NE took 35.0s. Estimated remaining: 1h 57m 58s. Rate: 7.7 symbols/min [2025-10-28T20:11:10.788258] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:10.835147] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-28T20:11:10.835438] [DEBUG] [LOCAL ] NEU: Loaded 8561 existing records from primary storage. [2025-10-28T20:11:10.846880] [INFO ] [MAIN ] NEU: Loaded 8561 existing records. [2025-10-28T20:11:10.909592] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-28T20:11:11.054360] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:11.054703] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-28T20:11:11.054764] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-28T20:11:11.055024] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-28T20:11:11.055103] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-28T20:11:11.427453] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:11.427901] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-28T20:11:11.474141] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-28T20:11:11.979796] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T20:11:11.981617] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-28T20:11:12.440243] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T20:11:12.507436] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-28T20:11:12.780255] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-28T20:11:13.580246] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-28T20:11:14.380217] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-28T20:11:14.455545] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T20:11:14.840007] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-28T20:11:15.182744] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-28T20:11:15.189188] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T20:11:15.782799] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T20:11:15.980245] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-28T20:11:16.780297] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-28T20:11:17.215928] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T20:11:17.580264] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-28T20:11:17.661096] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-28T20:11:18.380258] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-28T20:11:19.032665] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T20:11:19.180230] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-28T20:11:19.980243] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-28T20:11:20.139224] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T20:11:20.662080] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T20:11:20.749966] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T20:11:20.780212] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-28T20:11:21.459518] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (21.48 seconds). [2025-10-28T20:11:21.580207] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-28T20:11:22.370477] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T20:11:22.380270] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-28T20:11:22.381572] [INFO ] [REMOTE ] NET: Full fetch complete (76765 records). [2025-10-28T20:11:22.381681] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-28T20:11:22.783545] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-28T20:11:22.783619] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-28T20:11:22.784760] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-28T20:11:22.784823] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-28T20:11:22.786322] [DEBUG] [LOCAL ] NET: Trimmed 76765 records to 52682 (keeping 200 days of data) [2025-10-28T20:11:23.106091] [DEBUG] [LOCAL ] NET: Primary data saved (52682 records). [2025-10-28T20:11:23.106208] [INFO ] [MAIN ] NET: Full history saved. [2025-10-28T20:11:23.106929] [INFO ] [MAIN ] Update Progress: 1464/2366 symbols completed. NET took 21.8s. Estimated remaining: 1h 57m 53s. Rate: 7.7 symbols/min [2025-10-28T20:11:23.182109] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-28T20:11:23.285789] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:23.311819] [DEBUG] [LOCAL ] NEXA: Loaded 5888 existing records from primary storage. [2025-10-28T20:11:23.321865] [INFO ] [MAIN ] NEXA: Loaded 5888 existing records. [2025-10-28T20:11:23.403424] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-28T20:11:23.511885] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:23.512107] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-28T20:11:23.512154] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-28T20:11:23.512283] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-28T20:11:23.512323] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-28T20:11:23.850061] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T20:11:23.883672] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:23.980207] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-28T20:11:24.447547] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T20:11:24.780217] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-28T20:11:25.580295] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-28T20:11:26.141174] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:11:26.249182] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T20:11:26.380264] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-28T20:11:26.413695] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-28T20:11:27.180221] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-28T20:11:27.589467] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T20:11:27.989977] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-28T20:11:27.995609] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T20:11:28.344783] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T20:11:28.780246] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-28T20:11:29.270920] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T20:11:29.580242] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-28T20:11:30.274615] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:11:30.276557] [INFO ] [REMOTE ] NEU: Full fetch complete (10857 records). [2025-10-28T20:11:30.276625] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-28T20:11:30.385339] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-28T20:11:30.628163] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-28T20:11:30.628268] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-28T20:11:30.628561] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-28T20:11:30.628602] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-28T20:11:30.629075] [DEBUG] [LOCAL ] NEU: Trimmed 10857 records to 8549 (keeping 200 days of data) [2025-10-28T20:11:30.681466] [DEBUG] [LOCAL ] NEU: Primary data saved (8549 records). [2025-10-28T20:11:30.681582] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-28T20:11:30.681724] [INFO ] [MAIN ] Update Progress: 1465/2366 symbols completed. NEU took 20.1s. Estimated remaining: 1h 57m 45s. Rate: 7.7 symbols/min [2025-10-28T20:11:30.846872] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:30.882336] [DEBUG] [LOCAL ] NFG: Loaded 38029 existing records from primary storage. [2025-10-28T20:11:30.882609] [INFO ] [MAIN ] NFG: Loaded 38029 existing records. [2025-10-28T20:11:31.063555] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:31.063830] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-28T20:11:31.063879] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-28T20:11:31.064303] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-28T20:11:31.064362] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-28T20:11:31.185332] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-28T20:11:31.453788] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:31.980235] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-28T20:11:32.318153] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T20:11:32.780307] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-28T20:11:33.140525] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-28T20:11:33.161723] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T20:11:33.580333] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-28T20:11:34.380256] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-28T20:11:35.180260] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-28T20:11:35.536044] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T20:11:35.980228] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-28T20:11:37.190632] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-28T20:11:37.189323] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T20:11:37.209787] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-28T20:11:37.580282] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-28T20:11:40.025804] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-28T20:11:40.041156] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-28T20:11:40.041412] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-28T20:11:40.424431] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-28T20:11:40.424512] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-28T20:11:40.425618] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-28T20:11:40.425703] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-28T20:11:40.427192] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 53708 (keeping 200 days of data) [2025-10-28T20:11:40.752223] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-10-28T20:11:40.752356] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-28T20:11:40.752432] [INFO ] [MAIN ] Update Progress: 1466/2366 symbols completed. NEM took 46.6s. Estimated remaining: 1h 57m 39s. Rate: 7.7 symbols/min [2025-10-28T20:11:40.921899] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:40.941826] [DEBUG] [LOCAL ] NFJ: Loaded 19477 existing records from primary storage. [2025-10-28T20:11:40.942090] [INFO ] [MAIN ] NFJ: Loaded 19477 existing records. [2025-10-28T20:11:41.133731] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:41.133935] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-28T20:11:41.133982] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-28T20:11:41.134152] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-28T20:11:41.134191] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-28T20:11:41.479155] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:41.479485] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-28T20:11:42.334748] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T20:11:42.340016] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-28T20:11:43.091921] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T20:11:43.096273] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-28T20:11:43.827955] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (13.44 seconds). [2025-10-28T20:11:43.839717] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-28T20:11:43.902275] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:11:43.907448] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-28T20:11:44.621218] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (11.04 seconds). [2025-10-28T20:11:44.622992] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-28T20:11:44.696028] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T20:11:44.701409] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-28T20:11:45.017988] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T20:11:45.019908] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-28T20:11:45.324507] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T20:11:45.325753] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-28T20:11:45.395942] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T20:11:45.580228] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-28T20:11:45.763583] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-28T20:11:45.786110] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T20:11:46.326051] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T20:11:46.380214] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-28T20:11:47.180225] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-28T20:11:47.232425] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T20:11:47.980222] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-28T20:11:48.062826] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T20:11:48.066167] [INFO ] [REMOTE ] NEXA: Full fetch complete (7983 records). [2025-10-28T20:11:48.066243] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-28T20:11:48.420097] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-28T20:11:48.420171] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-28T20:11:48.420370] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-28T20:11:48.420459] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-28T20:11:48.420900] [DEBUG] [LOCAL ] NEXA: Trimmed 7983 records to 5916 (keeping 200 days of data) [2025-10-28T20:11:48.460282] [DEBUG] [LOCAL ] NEXA: Primary data saved (5916 records). [2025-10-28T20:11:48.460461] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-28T20:11:48.460583] [INFO ] [MAIN ] Update Progress: 1467/2366 symbols completed. NEXA took 25.4s. Estimated remaining: 1h 57m 31s. Rate: 7.7 symbols/min [2025-10-28T20:11:48.637418] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:48.685308] [DEBUG] [LOCAL ] NGG: Loaded 46547 existing records from primary storage. [2025-10-28T20:11:48.685606] [INFO ] [MAIN ] NGG: Loaded 46547 existing records. [2025-10-28T20:11:48.789038] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-28T20:11:48.872163] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:48.872389] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-28T20:11:48.872443] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-28T20:11:48.872876] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-28T20:11:48.872932] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-28T20:11:49.221241] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:49.542490] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T20:11:49.580239] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-28T20:11:50.223451] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-28T20:11:50.234638] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-28T20:11:50.234828] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-28T20:11:50.385535] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-28T20:11:50.655638] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-28T20:11:50.655738] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-28T20:11:50.656876] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-28T20:11:50.656936] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-28T20:11:50.658374] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 53707 (keeping 200 days of data) [2025-10-28T20:11:50.760978] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T20:11:50.998765] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-10-28T20:11:50.999013] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-28T20:11:50.999100] [INFO ] [MAIN ] Update Progress: 1468/2366 symbols completed. NEE took 1m 3s. Estimated remaining: 1h 57m 20s. Rate: 7.7 symbols/min [2025-10-28T20:11:51.163818] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:51.180317] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-28T20:11:51.192471] [DEBUG] [LOCAL ] NGL: Loaded 29498 existing records from primary storage. [2025-10-28T20:11:51.192740] [INFO ] [MAIN ] NGL: Loaded 29498 existing records. [2025-10-28T20:11:51.368275] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:51.368444] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-28T20:11:51.368491] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-28T20:11:51.368752] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-28T20:11:51.368809] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-28T20:11:51.721750] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:51.757759] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T20:11:51.985932] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-28T20:11:51.989181] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T20:11:51.993562] [INFO ] [REMOTE ] NFJ: Full fetch complete (29385 records). [2025-10-28T20:11:51.993690] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-28T20:11:52.359544] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-28T20:11:52.359617] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-28T20:11:52.360226] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-28T20:11:52.360282] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-28T20:11:52.360962] [DEBUG] [LOCAL ] NFJ: Trimmed 29385 records to 19422 (keeping 200 days of data) [2025-10-28T20:11:52.476352] [DEBUG] [LOCAL ] NFJ: Primary data saved (19422 records). [2025-10-28T20:11:52.476492] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-28T20:11:52.476575] [INFO ] [MAIN ] Update Progress: 1469/2366 symbols completed. NFJ took 11.7s. Estimated remaining: 1h 57m 8s. Rate: 7.7 symbols/min [2025-10-28T20:11:52.646383] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:11:52.657971] [DEBUG] [LOCAL ] NGS: Loaded 10558 existing records from primary storage. [2025-10-28T20:11:52.658172] [INFO ] [MAIN ] NGS: Loaded 10558 existing records. [2025-10-28T20:11:52.783429] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-28T20:11:52.839720] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:11:52.840117] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-28T20:11:52.840231] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-28T20:11:52.840545] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-28T20:11:52.840603] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-28T20:11:52.985060] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T20:11:53.215054] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:11:53.542793] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (16.33 seconds). [2025-10-28T20:11:53.580209] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-28T20:11:54.380224] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-28T20:11:54.794553] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:11:54.856085] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-28T20:11:55.114180] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:11:55.180234] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-28T20:11:55.687865] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T20:11:55.980255] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-28T20:11:56.780264] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-28T20:11:57.079991] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T20:11:57.580216] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-28T20:11:57.612356] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T20:11:58.380254] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-28T20:11:58.682087] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:11:59.062510] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T20:11:59.180247] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-28T20:11:59.928613] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T20:11:59.980223] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-28T20:12:00.780241] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-28T20:12:01.580250] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-28T20:12:02.113365] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T20:12:02.380212] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-28T20:12:02.465010] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T20:12:02.716520] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-28T20:12:03.180274] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-28T20:12:03.507778] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T20:12:03.641329] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T20:12:03.980245] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-28T20:12:04.537617] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T20:12:04.780276] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-28T20:12:05.533404] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T20:12:05.580235] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-28T20:12:06.380263] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-28T20:12:06.825819] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T20:12:07.180269] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-28T20:12:07.218772] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T20:12:07.980256] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-28T20:12:08.452749] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T20:12:08.780249] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-28T20:12:09.137094] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T20:12:09.413818] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T20:12:09.580243] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-28T20:12:10.380251] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-28T20:12:10.890933] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T20:12:10.986847] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T20:12:11.180269] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-28T20:12:11.980284] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-28T20:12:12.655597] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T20:12:12.657749] [INFO ] [REMOTE ] NGS: Full fetch complete (16514 records). [2025-10-28T20:12:12.657822] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-28T20:12:12.794507] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-28T20:12:13.016169] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-28T20:12:13.016244] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-28T20:12:13.016590] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-28T20:12:13.016628] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-28T20:12:13.017140] [DEBUG] [LOCAL ] NGS: Trimmed 16514 records to 10472 (keeping 200 days of data) [2025-10-28T20:12:13.079137] [DEBUG] [LOCAL ] NGS: Primary data saved (10472 records). [2025-10-28T20:12:13.079271] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-28T20:12:13.079348] [INFO ] [MAIN ] Update Progress: 1470/2366 symbols completed. NGS took 20.6s. Estimated remaining: 1h 57m 8s. Rate: 7.6 symbols/min [2025-10-28T20:12:13.246226] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:13.270892] [DEBUG] [LOCAL ] NGVC: Loaded 22651 existing records from primary storage. [2025-10-28T20:12:13.271139] [INFO ] [MAIN ] NGVC: Loaded 22651 existing records. [2025-10-28T20:12:13.442614] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:13.442831] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-28T20:12:13.442879] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-28T20:12:13.443128] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-28T20:12:13.443168] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-28T20:12:13.585493] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-28T20:12:13.806735] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:14.042229] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T20:12:14.380269] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-28T20:12:14.778726] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T20:12:14.892908] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (3.71 seconds). [2025-10-28T20:12:15.045552] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T20:12:15.180266] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-28T20:12:15.909340] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:12:15.980206] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-28T20:12:16.780304] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-28T20:12:16.800771] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T20:12:17.580256] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-28T20:12:17.818686] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T20:12:18.308905] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T20:12:18.380246] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-28T20:12:19.180253] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-28T20:12:19.859575] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T20:12:19.980252] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-28T20:12:20.786139] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-28T20:12:20.806256] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T20:12:21.580236] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-28T20:12:21.682214] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T20:12:21.690804] [INFO ] [REMOTE ] NFG: Full fetch complete (57209 records). [2025-10-28T20:12:21.690951] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-28T20:12:22.128272] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-28T20:12:22.128955] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-28T20:12:22.130949] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-28T20:12:22.129891] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T20:12:22.131116] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-28T20:12:22.140892] [DEBUG] [LOCAL ] NFG: Trimmed 57209 records to 38026 (keeping 200 days of data) [2025-10-28T20:12:22.366029] [DEBUG] [LOCAL ] NFG: Primary data saved (38026 records). [2025-10-28T20:12:22.366154] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-28T20:12:22.366227] [INFO ] [MAIN ] Update Progress: 1471/2366 symbols completed. NFG took 51.7s. Estimated remaining: 1h 57m 1s. Rate: 7.6 symbols/min [2025-10-28T20:12:22.387045] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-28T20:12:22.536215] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:22.558251] [DEBUG] [LOCAL ] NGVT: Loaded 23282 existing records from primary storage. [2025-10-28T20:12:22.558508] [INFO ] [MAIN ] NGVT: Loaded 23282 existing records. [2025-10-28T20:12:22.745700] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:22.745923] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-28T20:12:22.745991] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-28T20:12:22.746325] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-28T20:12:22.746382] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-28T20:12:23.105881] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:23.135378] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T20:12:23.145628] [INFO ] [REMOTE ] NGG: Full fetch complete (66600 records). [2025-10-28T20:12:23.145821] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-28T20:12:23.181441] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-28T20:12:23.584541] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T20:12:23.612386] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-28T20:12:23.612484] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-28T20:12:23.613502] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-28T20:12:23.613583] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-28T20:12:23.615268] [DEBUG] [LOCAL ] NGG: Trimmed 66600 records to 46493 (keeping 200 days of data) [2025-10-28T20:12:23.896634] [DEBUG] [LOCAL ] NGG: Primary data saved (46493 records). [2025-10-28T20:12:23.896783] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-28T20:12:23.897262] [INFO ] [MAIN ] Update Progress: 1472/2366 symbols completed. NGG took 35.4s. Estimated remaining: 1h 56m 49s. Rate: 7.7 symbols/min [2025-10-28T20:12:23.982834] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-28T20:12:24.100086] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:24.115292] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T20:12:24.138372] [DEBUG] [LOCAL ] NHI: Loaded 21545 existing records from primary storage. [2025-10-28T20:12:24.138626] [INFO ] [MAIN ] NHI: Loaded 21545 existing records. [2025-10-28T20:12:24.335568] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:24.335822] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-28T20:12:24.335871] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-28T20:12:24.336264] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-28T20:12:24.336341] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-28T20:12:24.753914] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:24.780221] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-28T20:12:24.838527] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T20:12:25.542968] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:12:25.580276] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-28T20:12:26.380259] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-28T20:12:26.919911] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T20:12:27.180244] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-28T20:12:27.271054] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T20:12:27.980225] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-28T20:12:28.044515] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T20:12:28.780239] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-28T20:12:28.874963] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T20:12:28.879999] [INFO ] [REMOTE ] NGL: Full fetch complete (41594 records). [2025-10-28T20:12:28.880095] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-28T20:12:29.274497] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-28T20:12:29.274572] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-28T20:12:29.275387] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-28T20:12:29.275448] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-28T20:12:29.276386] [DEBUG] [LOCAL ] NGL: Trimmed 41594 records to 29266 (keeping 200 days of data) [2025-10-28T20:12:29.442607] [DEBUG] [LOCAL ] NGL: Primary data saved (29266 records). [2025-10-28T20:12:29.442801] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-28T20:12:29.442929] [INFO ] [MAIN ] Update Progress: 1473/2366 symbols completed. NGL took 38.4s. Estimated remaining: 1h 56m 40s. Rate: 7.7 symbols/min [2025-10-28T20:12:29.587959] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-28T20:12:29.621074] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:29.669302] [DEBUG] [LOCAL ] NI: Loaded 53401 existing records from primary storage. [2025-10-28T20:12:29.669687] [INFO ] [MAIN ] NI: Loaded 53401 existing records. [2025-10-28T20:12:29.851569] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:29.851764] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-28T20:12:29.851816] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-28T20:12:29.852097] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-10-28T20:12:29.852154] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-28T20:12:30.236077] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:30.359132] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T20:12:30.380215] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-28T20:12:31.162674] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-28T20:12:31.180260] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-28T20:12:31.224837] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T20:12:31.992176] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-28T20:12:31.993469] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T20:12:32.757959] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T20:12:32.780256] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-28T20:12:33.526632] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T20:12:33.580214] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-28T20:12:34.342611] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:12:34.380231] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-28T20:12:35.180223] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-28T20:12:35.355021] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T20:12:35.932493] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:12:35.980286] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-28T20:12:36.763676] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T20:12:36.780214] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-28T20:12:37.555633] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T20:12:37.580263] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-28T20:12:38.380325] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-28T20:12:38.977102] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T20:12:39.182323] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-28T20:12:39.184407] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T20:12:39.980262] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-28T20:12:40.442886] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T20:12:40.768787] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T20:12:40.780258] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-28T20:12:41.524864] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T20:12:41.580256] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-28T20:12:42.380311] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-28T20:12:42.384511] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:12:42.388971] [INFO ] [REMOTE ] NGVT: Full fetch complete (34032 records). [2025-10-28T20:12:42.389054] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-28T20:12:42.758614] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-28T20:12:42.758719] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-28T20:12:42.759391] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-28T20:12:42.759431] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-28T20:12:42.760228] [DEBUG] [LOCAL ] NGVT: Trimmed 34032 records to 23101 (keeping 200 days of data) [2025-10-28T20:12:42.892328] [DEBUG] [LOCAL ] NGVT: Primary data saved (23101 records). [2025-10-28T20:12:42.892467] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-28T20:12:42.892564] [INFO ] [MAIN ] Update Progress: 1474/2366 symbols completed. NGVT took 20.5s. Estimated remaining: 1h 56m 36s. Rate: 7.7 symbols/min [2025-10-28T20:12:43.072924] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:43.084227] [DEBUG] [LOCAL ] NIC: Loaded 9015 existing records from primary storage. [2025-10-28T20:12:43.084432] [INFO ] [MAIN ] NIC: Loaded 9015 existing records. [2025-10-28T20:12:43.181886] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-28T20:12:43.260183] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:43.260474] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-28T20:12:43.260532] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-28T20:12:43.260759] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-28T20:12:43.260815] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-28T20:12:43.612574] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:43.691705] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T20:12:43.980223] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-28T20:12:44.023020] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T20:12:44.525205] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T20:12:44.780260] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-28T20:12:45.580234] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-28T20:12:45.773345] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T20:12:46.380228] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-28T20:12:46.395160] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T20:12:46.399845] [INFO ] [REMOTE ] NGVC: Full fetch complete (31202 records). [2025-10-28T20:12:46.399922] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-28T20:12:46.770744] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-28T20:12:46.770849] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-28T20:12:46.771497] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-28T20:12:46.771559] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-28T20:12:46.772419] [DEBUG] [LOCAL ] NGVC: Trimmed 31202 records to 22622 (keeping 200 days of data) [2025-10-28T20:12:46.903444] [DEBUG] [LOCAL ] NGVC: Primary data saved (22622 records). [2025-10-28T20:12:46.903563] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-28T20:12:46.903660] [INFO ] [MAIN ] Update Progress: 1475/2366 symbols completed. NGVC took 33.8s. Estimated remaining: 1h 56m 25s. Rate: 7.7 symbols/min [2025-10-28T20:12:47.072344] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:47.085289] [DEBUG] [LOCAL ] NIE: Loaded 11698 existing records from primary storage. [2025-10-28T20:12:47.085519] [INFO ] [MAIN ] NIE: Loaded 11698 existing records. [2025-10-28T20:12:47.184351] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-28T20:12:47.261576] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T20:12:47.282248] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:47.287011] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-28T20:12:47.287395] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-28T20:12:47.287583] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-28T20:12:47.287638] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-28T20:12:47.640360] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:47.980249] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-28T20:12:48.487952] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T20:12:48.780243] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-28T20:12:48.814804] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T20:12:48.819066] [INFO ] [REMOTE ] NHI: Full fetch complete (30865 records). [2025-10-28T20:12:48.819187] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-28T20:12:49.190261] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-28T20:12:49.190351] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-28T20:12:49.190988] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-28T20:12:49.191047] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-28T20:12:49.192256] [DEBUG] [LOCAL ] NHI: Trimmed 30865 records to 21509 (keeping 200 days of data) [2025-10-28T20:12:49.319848] [DEBUG] [LOCAL ] NHI: Primary data saved (21509 records). [2025-10-28T20:12:49.319972] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-28T20:12:49.320045] [INFO ] [MAIN ] Update Progress: 1476/2366 symbols completed. NHI took 25.4s. Estimated remaining: 1h 56m 14s. Rate: 7.7 symbols/min [2025-10-28T20:12:49.491994] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:12:49.497729] [DEBUG] [LOCAL ] NIM: Loaded 3486 existing records from primary storage. [2025-10-28T20:12:49.497920] [INFO ] [MAIN ] NIM: Loaded 3486 existing records. [2025-10-28T20:12:49.587302] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-28T20:12:49.683412] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:12:49.684624] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-28T20:12:49.684728] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-28T20:12:49.685414] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-28T20:12:49.685475] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-28T20:12:50.036733] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:12:50.220150] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T20:12:50.380219] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-28T20:12:50.774416] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T20:12:51.180251] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-28T20:12:51.701276] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T20:12:51.980298] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-28T20:12:52.443389] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T20:12:52.780248] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-28T20:12:53.285409] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:12:53.580253] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-28T20:12:53.727817] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (4.14 seconds). [2025-10-28T20:12:54.380255] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-28T20:12:54.877599] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T20:12:54.898947] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T20:12:55.180297] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-28T20:12:55.980264] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-28T20:12:56.546213] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T20:12:56.649692] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T20:12:56.780234] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-28T20:12:57.580269] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-28T20:12:58.061083] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T20:12:58.183402] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T20:12:58.380247] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-28T20:12:59.180266] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-28T20:12:59.839479] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T20:12:59.980222] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-28T20:13:00.780276] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-28T20:13:01.294145] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T20:13:01.480764] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-28T20:13:01.580279] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-28T20:13:01.906135] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-28T20:13:01.916999] [INFO ] [REMOTE ] NI: Full fetch complete (77514 records). [2025-10-28T20:13:01.917157] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-28T20:13:02.209314] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T20:13:02.335008] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-28T20:13:02.335103] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-28T20:13:02.336367] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-28T20:13:02.336444] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-28T20:13:02.337987] [DEBUG] [LOCAL ] NI: Trimmed 77514 records to 53401 (keeping 200 days of data) [2025-10-28T20:13:02.393821] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-28T20:13:02.657667] [DEBUG] [LOCAL ] NI: Primary data saved (53401 records). [2025-10-28T20:13:02.657795] [INFO ] [MAIN ] NI: Full history saved. [2025-10-28T20:13:02.657872] [INFO ] [MAIN ] Update Progress: 1477/2366 symbols completed. NI took 33.2s. Estimated remaining: 1h 56m 10s. Rate: 7.7 symbols/min [2025-10-28T20:13:03.022343] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T20:13:03.180230] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-28T20:13:03.666301] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T20:13:03.980233] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-28T20:13:04.319735] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T20:13:04.780250] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-28T20:13:05.224413] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:13:05.580282] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-28T20:13:06.096861] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T20:13:06.380256] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-28T20:13:07.071261] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:13:07.073970] [INFO ] [REMOTE ] NIC: Full fetch complete (12910 records). [2025-10-28T20:13:07.074043] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-28T20:13:07.185350] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-28T20:13:07.427557] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-28T20:13:07.427630] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-28T20:13:07.427946] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-28T20:13:07.427992] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-28T20:13:07.428432] [DEBUG] [LOCAL ] NIC: Trimmed 12910 records to 9020 (keeping 200 days of data) [2025-10-28T20:13:07.485063] [DEBUG] [LOCAL ] NIC: Primary data saved (9020 records). [2025-10-28T20:13:07.485194] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-28T20:13:07.485273] [INFO ] [MAIN ] Update Progress: 1478/2366 symbols completed. NIC took 24.6s. Estimated remaining: 1h 56m 0s. Rate: 7.7 symbols/min [2025-10-28T20:13:07.956485] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T20:13:07.980214] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-28T20:13:08.600745] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:13:08.780285] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-28T20:13:09.224469] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T20:13:09.580263] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-28T20:13:09.904953] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T20:13:10.380246] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-28T20:13:10.884371] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T20:13:11.180244] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-28T20:13:11.799439] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T20:13:11.980354] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-28T20:13:12.319487] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T20:13:12.780263] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-28T20:13:13.178831] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T20:13:13.179972] [INFO ] [REMOTE ] NIM: Full fetch complete (6098 records). [2025-10-28T20:13:13.180042] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-28T20:13:13.540503] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-28T20:13:13.540579] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-28T20:13:13.540788] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-28T20:13:13.540850] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-28T20:13:13.541238] [DEBUG] [LOCAL ] NIM: Trimmed 6098 records to 3496 (keeping 200 days of data) [2025-10-28T20:13:13.561794] [DEBUG] [LOCAL ] NIM: Primary data saved (3496 records). [2025-10-28T20:13:13.561862] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-28T20:13:13.561944] [INFO ] [MAIN ] Update Progress: 1479/2366 symbols completed. NIM took 24.2s. Estimated remaining: 1h 55m 51s. Rate: 7.7 symbols/min [2025-10-28T20:13:13.580281] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-28T20:13:14.265278] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T20:13:14.380250] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-28T20:13:14.948927] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T20:13:15.180231] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-28T20:13:15.722887] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T20:13:15.980235] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-28T20:13:16.846351] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T20:13:16.849818] [INFO ] [REMOTE ] NIE: Full fetch complete (17038 records). [2025-10-28T20:13:16.849895] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-28T20:13:17.221619] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-28T20:13:17.221722] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-28T20:13:17.222084] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-28T20:13:17.222129] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-28T20:13:17.222617] [DEBUG] [LOCAL ] NIE: Trimmed 17038 records to 11725 (keeping 200 days of data) [2025-10-28T20:13:17.291235] [DEBUG] [LOCAL ] NIE: Primary data saved (11725 records). [2025-10-28T20:13:17.291358] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-28T20:13:17.291433] [INFO ] [MAIN ] Update Progress: 1480/2366 symbols completed. NIE took 30.4s. Estimated remaining: 1h 55m 41s. Rate: 7.7 symbols/min [2025-10-28T20:13:17.865775] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:17.910044] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:17.976159] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:17.976432] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-28T20:13:17.979494] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-28T20:13:18.002038] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-28T20:13:18.005057] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:18.005538] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-28T20:13:18.005677] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-28T20:13:18.006047] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-28T20:13:18.282730] [DEBUG] [LOCAL ] NINE: Loaded 28917 existing records from primary storage. [2025-10-28T20:13:18.330461] [DEBUG] [LOCAL ] NJR: Loaded 37537 existing records from primary storage. [2025-10-28T20:13:18.352958] [INFO ] [MAIN ] NJR: Loaded 37537 existing records. [2025-10-28T20:13:18.347434] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-28T20:13:18.346572] [INFO ] [MAIN ] NINE: Loaded 28917 existing records. [2025-10-28T20:13:18.374461] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-28T20:13:18.757629] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:18.832070] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-10-28T20:13:18.999942] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:13:19.024968] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:13:19.051468] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-28T20:13:19.051552] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-28T20:13:19.051776] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-28T20:13:19.051879] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-28T20:13:19.051315] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:13:19.052066] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-28T20:13:19.052118] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-28T20:13:19.052423] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-28T20:13:19.052481] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-28T20:13:19.063331] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-28T20:13:19.063374] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-28T20:13:19.098904] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-28T20:13:19.082708] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-28T20:13:19.088413] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:13:19.130210] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-10-28T20:13:19.159163] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:13:19.217996] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-28T20:13:19.255246] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:13:19.296291] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-28T20:13:19.381727] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-28T20:13:19.434861] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-28T20:13:19.461230] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-28T20:13:19.518988] [INFO ] [MAIN ] Update Progress: 1481/2366 symbols completed. NIQ took 2.2s. Estimated remaining: 1h 55m 30s. Rate: 7.7 symbols/min [2025-10-28T20:13:20.222038] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:20.264234] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:20.261390] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:20.269553] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-28T20:13:20.280300] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-28T20:13:20.274971] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-28T20:13:20.280504] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-28T20:13:20.295027] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-28T20:13:20.311755] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-28T20:13:20.311908] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-28T20:13:20.331295] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-28T20:13:20.344420] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:20.351259] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-28T20:13:20.694235] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:20.694525] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-28T20:13:21.392774] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:13:21.400361] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-28T20:13:21.831576] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T20:13:21.839592] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-28T20:13:22.403128] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T20:13:22.411251] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-28T20:13:22.461219] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-28T20:13:22.737808] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T20:13:22.763561] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T20:13:23.180263] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-28T20:13:23.612862] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T20:13:23.980248] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-28T20:13:24.067523] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T20:13:24.780273] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-28T20:13:25.580298] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-28T20:13:25.945120] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T20:13:26.380222] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-28T20:13:26.505531] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T20:13:26.965383] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.99 seconds). [2025-10-28T20:13:27.180273] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-28T20:13:27.980218] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-28T20:13:28.405745] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-28T20:13:28.780330] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-28T20:13:29.445700] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-28T20:13:29.466935] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T20:13:29.580291] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-28T20:13:29.947368] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T20:13:30.380292] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-28T20:13:31.180251] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-28T20:13:31.448979] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T20:13:31.957986] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-28T20:13:31.980212] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-28T20:13:32.780283] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-28T20:13:33.358297] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-28T20:13:33.580305] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-28T20:13:33.740312] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T20:13:34.222755] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T20:13:34.380298] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-28T20:13:34.652461] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T20:13:35.180262] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-28T20:13:35.579987] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T20:13:35.980256] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-28T20:13:36.382097] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T20:13:36.780262] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-28T20:13:37.580283] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-28T20:13:38.212371] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-28T20:13:38.380210] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-28T20:13:38.497493] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T20:13:38.924674] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-28T20:13:39.180210] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-28T20:13:39.980289] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-28T20:13:40.590548] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-28T20:13:40.780276] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-28T20:13:40.868259] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T20:13:41.394479] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-28T20:13:41.580240] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-28T20:13:42.380226] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-28T20:13:42.817289] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-28T20:13:43.180233] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-28T20:13:43.562218] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T20:13:43.788281] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-28T20:13:43.980246] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-28T20:13:44.780292] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-28T20:13:45.580220] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-28T20:13:45.660923] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-28T20:13:45.713183] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T20:13:46.059570] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T20:13:46.066745] [INFO ] [REMOTE ] NJR: Full fetch complete (54706 records). [2025-10-28T20:13:46.066841] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-28T20:13:46.385434] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-28T20:13:46.460610] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-28T20:13:46.460709] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-28T20:13:46.461634] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-28T20:13:46.461716] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-28T20:13:46.462785] [DEBUG] [LOCAL ] NJR: Trimmed 54706 records to 37471 (keeping 200 days of data) [2025-10-28T20:13:46.685923] [DEBUG] [LOCAL ] NJR: Primary data saved (37471 records). [2025-10-28T20:13:46.691466] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-28T20:13:46.695671] [INFO ] [MAIN ] Update Progress: 1482/2366 symbols completed. NJR took 29.4s. Estimated remaining: 1h 55m 33s. Rate: 7.6 symbols/min [2025-10-28T20:13:46.765820] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T20:13:46.809737] [INFO ] [REMOTE ] NINE: Full fetch complete (43159 records). [2025-10-28T20:13:46.809866] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-28T20:13:46.959689] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:47.162898] [DEBUG] [LOCAL ] NKX: Loaded 13566 existing records from primary storage. [2025-10-28T20:13:47.184924] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-28T20:13:47.200796] [INFO ] [MAIN ] NKX: Loaded 13566 existing records. [2025-10-28T20:13:47.443969] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-28T20:13:47.509222] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:13:47.509354] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-28T20:13:47.513391] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-28T20:13:47.513217] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-28T20:13:47.515194] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T20:13:47.515424] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-28T20:13:47.515360] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-28T20:13:47.526356] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-28T20:13:47.526602] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-28T20:13:47.540592] [INFO ] [REMOTE ] NKE: Full fetch complete (77217 records). [2025-10-28T20:13:47.545854] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-28T20:13:47.553997] [DEBUG] [LOCAL ] NINE: Trimmed 43159 records to 28928 (keeping 200 days of data) [2025-10-28T20:13:48.156563] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T20:13:48.172679] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:13:48.189922] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:13:48.194566] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-28T20:13:48.204462] [DEBUG] [LOCAL ] NINE: Primary data saved (28928 records). [2025-10-28T20:13:48.204570] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-28T20:13:48.216491] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-28T20:13:48.216676] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-28T20:13:48.216601] [INFO ] [MAIN ] Update Progress: 1483/2366 symbols completed. NINE took 30.9s. Estimated remaining: 1h 55m 22s. Rate: 7.7 symbols/min [2025-10-28T20:13:48.266393] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-28T20:13:48.349414] [INFO ] [MAIN ] Update Progress: 1484/2366 symbols completed. NKE took 28.8s. Estimated remaining: 1h 55m 9s. Rate: 7.7 symbols/min [2025-10-28T20:13:48.410865] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:48.446240] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-28T20:13:48.592811] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:48.603226] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-28T20:13:48.615437] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-28T20:13:48.621686] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-28T20:13:48.626876] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-28T20:13:48.627890] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-28T20:13:48.628238] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-28T20:13:48.688048] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:13:48.810018] [DEBUG] [LOCAL ] NLOP: Loaded 11254 existing records from primary storage. [2025-10-28T20:13:48.812356] [INFO ] [MAIN ] NLOP: Loaded 11254 existing records. [2025-10-28T20:13:49.211800] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:49.212145] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-28T20:13:49.207888] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:13:49.205907] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:13:49.216712] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-28T20:13:49.216826] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-28T20:13:49.217067] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-28T20:13:49.217169] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-28T20:13:49.527008] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-28T20:13:49.581158] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-28T20:13:49.616350] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:13:49.680854] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T20:13:50.138056] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T20:13:50.380317] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-28T20:13:50.945550] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T20:13:51.180303] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-28T20:13:51.859672] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T20:13:51.980237] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-28T20:13:52.591270] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T20:13:52.780244] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-28T20:13:53.340306] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T20:13:53.580249] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-28T20:13:54.080489] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T20:13:54.380285] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-28T20:13:55.180261] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-28T20:13:55.917505] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T20:13:55.980327] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-28T20:13:56.783045] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-28T20:13:56.790194] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-28T20:13:56.976163] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T20:13:57.175167] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T20:13:57.580246] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-28T20:13:58.003586] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T20:13:58.380249] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-28T20:13:58.694953] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T20:13:59.180295] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-28T20:13:59.980291] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-28T20:14:00.720637] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T20:14:00.780228] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-28T20:14:01.516903] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T20:14:01.580225] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-28T20:14:01.622186] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-28T20:14:01.632760] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-28T20:14:01.632871] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-28T20:14:02.025678] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-28T20:14:02.025795] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-28T20:14:02.026977] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-28T20:14:02.027041] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-28T20:14:02.028510] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 53802 (keeping 200 days of data) [2025-10-28T20:14:02.326354] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-28T20:14:02.326672] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-28T20:14:02.326768] [INFO ] [MAIN ] Update Progress: 1485/2366 symbols completed. NIO took 45.0s. Estimated remaining: 1h 55m 5s. Rate: 7.7 symbols/min [2025-10-28T20:14:02.388053] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-28T20:14:02.438242] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T20:14:02.493539] [INFO ] [REMOTE ] NKX: Full fetch complete (18923 records). [2025-10-28T20:14:02.511073] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-28T20:14:02.510974] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:02.900531] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-28T20:14:02.900632] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-28T20:14:02.901495] [DEBUG] [LOCAL ] NLY: Loaded 53563 existing records from primary storage. [2025-10-28T20:14:02.902094] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-28T20:14:02.902182] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-28T20:14:02.902716] [INFO ] [MAIN ] NLY: Loaded 53563 existing records. [2025-10-28T20:14:02.971419] [DEBUG] [LOCAL ] NKX: Trimmed 18923 records to 13471 (keeping 200 days of data) [2025-10-28T20:14:03.152088] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:03.156885] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-28T20:14:03.159506] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-28T20:14:03.165375] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-28T20:14:03.165755] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-28T20:14:03.193542] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-28T20:14:03.180314] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T20:14:03.260765] [DEBUG] [LOCAL ] NKX: Primary data saved (13471 records). [2025-10-28T20:14:03.276843] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-28T20:14:03.276977] [INFO ] [MAIN ] Update Progress: 1486/2366 symbols completed. NKX took 16.6s. Estimated remaining: 1h 54m 53s. Rate: 7.7 symbols/min [2025-10-28T20:14:03.657025] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:03.754123] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:03.759607] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T20:14:03.760116] [DEBUG] [LOCAL ] NMAI: Loaded 12392 existing records from primary storage. [2025-10-28T20:14:03.762282] [INFO ] [MAIN ] NMAI: Loaded 12392 existing records. [2025-10-28T20:14:03.946776] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:03.947040] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-28T20:14:03.947088] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-28T20:14:03.947344] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-28T20:14:03.947400] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-28T20:14:03.985876] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-28T20:14:04.301206] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:04.780247] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-28T20:14:05.219826] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:14:05.400774] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T20:14:05.580264] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-28T20:14:06.380271] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-28T20:14:06.786779] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T20:14:06.931609] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T20:14:07.180251] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-28T20:14:07.980303] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-28T20:14:08.640741] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T20:14:08.745508] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T20:14:08.780217] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-28T20:14:09.580252] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-28T20:14:10.267824] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T20:14:10.380239] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-28T20:14:10.480389] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T20:14:10.874600] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:14:11.180253] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-28T20:14:11.861292] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T20:14:11.980257] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-28T20:14:12.553496] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T20:14:12.780254] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-28T20:14:13.312015] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T20:14:13.580253] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-28T20:14:14.380260] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-28T20:14:15.035729] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T20:14:15.180268] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-28T20:14:15.390545] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T20:14:15.598364] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T20:14:15.980267] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-28T20:14:16.780307] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-28T20:14:17.480771] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T20:14:17.580259] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-28T20:14:18.076608] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T20:14:18.193861] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T20:14:18.380257] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-28T20:14:19.180361] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-28T20:14:19.701994] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T20:14:19.770460] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T20:14:19.980272] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-28T20:14:20.622839] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T20:14:20.780241] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-28T20:14:21.379257] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T20:14:21.380670] [INFO ] [REMOTE ] NL: Full fetch complete (6905 records). [2025-10-28T20:14:21.380739] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-28T20:14:21.557750] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:14:21.557974] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:14:21.558064] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:14:21.558157] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-28T20:14:21.558237] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-28T20:14:21.558277] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-28T20:14:21.558316] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-28T20:14:21.558369] [INFO ] [MAIN ] Update Progress: 1487/2366 symbols completed. NL took 33.3s. Estimated remaining: 1h 54m 52s. Rate: 7.7 symbols/min [2025-10-28T20:14:21.587267] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-28T20:14:21.739905] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:21.740110] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-28T20:14:21.740156] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-28T20:14:21.740268] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-28T20:14:21.740309] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-28T20:14:21.740350] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-28T20:14:21.740384] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-28T20:14:22.101636] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:22.186434] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T20:14:22.380227] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-28T20:14:23.071040] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:14:23.073611] [INFO ] [REMOTE ] NLOP: Full fetch complete (17423 records). [2025-10-28T20:14:23.073720] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-28T20:14:23.185399] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-10-28T20:14:23.444676] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-28T20:14:23.444513] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:14:23.445026] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-10-28T20:14:23.444956] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-28T20:14:23.445568] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-28T20:14:23.445186] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:14:23.445711] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-28T20:14:23.445767] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-28T20:14:23.449137] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:14:23.449530] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-28T20:14:23.449859] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-28T20:14:23.450030] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-28T20:14:23.450108] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-28T20:14:23.450198] [INFO ] [MAIN ] Update Progress: 1488/2366 symbols completed. NMAX took 1.9s. Estimated remaining: 1h 54m 40s. Rate: 7.7 symbols/min [2025-10-28T20:14:23.449954] [DEBUG] [LOCAL ] NLOP: Trimmed 17423 records to 11208 (keeping 200 days of data) [2025-10-28T20:14:23.696522] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:23.706921] [DEBUG] [LOCAL ] NLOP: Primary data saved (11208 records). [2025-10-28T20:14:23.707072] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-28T20:14:23.707183] [INFO ] [MAIN ] Update Progress: 1489/2366 symbols completed. NLOP took 35.3s. Estimated remaining: 1h 54m 28s. Rate: 7.7 symbols/min [2025-10-28T20:14:23.842108] [DEBUG] [LOCAL ] NMCO: Loaded 16170 existing records from primary storage. [2025-10-28T20:14:23.848014] [INFO ] [MAIN ] NMCO: Loaded 16170 existing records. [2025-10-28T20:14:24.030288] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:23.985347] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-28T20:14:24.118391] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:24.123095] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-28T20:14:24.123405] [DEBUG] [LOCAL ] NMG: Loaded 12703 existing records from primary storage. [2025-10-28T20:14:24.123493] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-28T20:14:24.123694] [INFO ] [MAIN ] NMG: Loaded 12703 existing records. [2025-10-28T20:14:24.155178] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-28T20:14:24.193121] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-28T20:14:24.435359] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:24.457473] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-28T20:14:24.470158] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-28T20:14:24.486935] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-28T20:14:24.488213] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-28T20:14:24.751346] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T20:14:24.791165] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-28T20:14:24.851716] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:25.037892] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:25.580273] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-28T20:14:26.382072] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-28T20:14:26.396240] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T20:14:26.397400] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T20:14:27.017382] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T20:14:27.180252] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-28T20:14:27.762613] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T20:14:27.980284] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-28T20:14:28.593307] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T20:14:28.780267] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-28T20:14:29.317421] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T20:14:29.580250] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-28T20:14:30.107322] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T20:14:30.380251] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-28T20:14:30.861782] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T20:14:31.180257] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-28T20:14:31.783545] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T20:14:31.980291] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-28T20:14:32.780276] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-28T20:14:32.826872] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T20:14:33.378627] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T20:14:33.580265] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-28T20:14:34.121225] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T20:14:34.380310] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-28T20:14:35.180285] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-28T20:14:35.871724] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:14:35.874753] [INFO ] [REMOTE ] NMAI: Full fetch complete (19292 records). [2025-10-28T20:14:35.874824] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-28T20:14:35.984091] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-28T20:14:36.279205] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-28T20:14:36.279328] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-28T20:14:36.279920] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-28T20:14:36.279999] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-28T20:14:36.291844] [DEBUG] [LOCAL ] NMAI: Trimmed 19292 records to 12383 (keeping 200 days of data) [2025-10-28T20:14:36.312804] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-28T20:14:36.412375] [DEBUG] [LOCAL ] NMAI: Primary data saved (12383 records). [2025-10-28T20:14:36.412498] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-28T20:14:36.412575] [INFO ] [MAIN ] Update Progress: 1490/2366 symbols completed. NMAI took 33.1s. Estimated remaining: 1h 54m 23s. Rate: 7.7 symbols/min [2025-10-28T20:14:36.523593] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T20:14:36.594561] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:36.600711] [DEBUG] [LOCAL ] NMI: Loaded 3954 existing records from primary storage. [2025-10-28T20:14:36.600921] [INFO ] [MAIN ] NMI: Loaded 3954 existing records. [2025-10-28T20:14:36.785238] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-28T20:14:36.789070] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:36.790066] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-28T20:14:36.790152] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-28T20:14:36.790288] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-28T20:14:36.790327] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-28T20:14:37.159054] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:37.580242] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-28T20:14:38.161893] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T20:14:38.380280] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-28T20:14:38.733307] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T20:14:38.744184] [INFO ] [REMOTE ] NLY: Full fetch complete (77697 records). [2025-10-28T20:14:38.744325] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-28T20:14:39.064679] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T20:14:39.193332] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-28T20:14:39.189341] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-28T20:14:39.194208] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-28T20:14:39.195354] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-28T20:14:39.195519] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-28T20:14:39.197078] [DEBUG] [LOCAL ] NLY: Trimmed 77697 records to 53560 (keeping 200 days of data) [2025-10-28T20:14:39.537968] [DEBUG] [LOCAL ] NLY: Primary data saved (53560 records). [2025-10-28T20:14:39.538115] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-28T20:14:39.538224] [INFO ] [MAIN ] Update Progress: 1491/2366 symbols completed. NLY took 37.2s. Estimated remaining: 1h 54m 12s. Rate: 7.7 symbols/min [2025-10-28T20:14:39.707942] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:39.722862] [DEBUG] [LOCAL ] NMM: Loaded 13796 existing records from primary storage. [2025-10-28T20:14:39.723064] [INFO ] [MAIN ] NMM: Loaded 13796 existing records. [2025-10-28T20:14:39.892964] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T20:14:39.913985] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:39.916927] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-28T20:14:39.917232] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-28T20:14:39.917480] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-28T20:14:39.917546] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-28T20:14:39.985306] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-28T20:14:40.272530] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:40.358705] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T20:14:40.780250] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-28T20:14:41.175765] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T20:14:41.580263] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-28T20:14:42.380252] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-28T20:14:42.395827] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T20:14:43.180254] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-28T20:14:43.965160] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T20:14:43.980213] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-28T20:14:44.285692] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-28T20:14:44.293285] [INFO ] [REMOTE ] NMG: Full fetch complete (16540 records). [2025-10-28T20:14:44.293359] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-28T20:14:44.400598] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T20:14:44.671216] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-28T20:14:44.671312] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-28T20:14:44.671769] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-28T20:14:44.671842] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-28T20:14:44.672708] [DEBUG] [LOCAL ] NMG: Trimmed 16540 records to 12859 (keeping 200 days of data) [2025-10-28T20:14:44.754106] [DEBUG] [LOCAL ] NMG: Primary data saved (12859 records). [2025-10-28T20:14:44.754247] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-28T20:14:44.754333] [INFO ] [MAIN ] Update Progress: 1492/2366 symbols completed. NMG took 21.0s. Estimated remaining: 1h 54m 3s. Rate: 7.7 symbols/min [2025-10-28T20:14:44.785446] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-28T20:14:44.928221] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:14:44.964276] [DEBUG] [LOCAL ] NMR: Loaded 35173 existing records from primary storage. [2025-10-28T20:14:44.964563] [INFO ] [MAIN ] NMR: Loaded 35173 existing records. [2025-10-28T20:14:45.142520] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:14:45.142790] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-28T20:14:45.142847] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-28T20:14:45.143091] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-28T20:14:45.143130] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-28T20:14:45.536558] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:14:45.546526] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T20:14:45.580221] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-28T20:14:45.982811] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T20:14:46.380244] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-28T20:14:47.180322] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-28T20:14:47.417624] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T20:14:47.789060] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T20:14:47.980318] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-28T20:14:48.658071] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T20:14:48.780247] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-28T20:14:49.580304] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-28T20:14:49.919820] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T20:14:50.380238] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-28T20:14:50.445676] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T20:14:50.754065] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T20:14:51.180255] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-28T20:14:51.980282] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-28T20:14:52.300683] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T20:14:52.341441] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T20:14:52.780308] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-28T20:14:53.365935] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T20:14:53.580260] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-28T20:14:54.380229] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-28T20:14:54.671929] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T20:14:54.996402] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T20:14:55.180241] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-28T20:14:55.680824] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T20:14:55.980257] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-28T20:14:56.780303] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-28T20:14:57.580249] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-28T20:14:57.865793] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T20:14:58.229724] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T20:14:58.380242] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-28T20:14:58.873159] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T20:14:59.180311] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-28T20:14:59.778205] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T20:14:59.980241] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-28T20:15:00.656964] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T20:15:00.780271] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-28T20:15:01.580274] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-28T20:15:01.915400] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (5.94 seconds). [2025-10-28T20:15:01.983232] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:15:02.247247] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T20:15:02.380253] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-28T20:15:03.180283] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-28T20:15:03.530900] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T20:15:03.732105] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:15:03.980292] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-28T20:15:04.780277] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-28T20:15:05.016228] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T20:15:05.516686] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T20:15:05.519901] [INFO ] [REMOTE ] NMCO: Full fetch complete (22809 records). [2025-10-28T20:15:05.520062] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-28T20:15:05.585505] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-28T20:15:05.886547] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-28T20:15:05.886628] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-28T20:15:05.887136] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-28T20:15:05.887192] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-28T20:15:05.887841] [DEBUG] [LOCAL ] NMCO: Trimmed 22809 records to 16088 (keeping 200 days of data) [2025-10-28T20:15:05.983588] [DEBUG] [LOCAL ] NMCO: Primary data saved (16088 records). [2025-10-28T20:15:05.983745] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-28T20:15:05.983842] [INFO ] [MAIN ] Update Progress: 1493/2366 symbols completed. NMCO took 42.5s. Estimated remaining: 1h 54m 3s. Rate: 7.7 symbols/min [2025-10-28T20:15:06.153179] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:15:06.158340] [DEBUG] [LOCAL ] NMS: Loaded 2909 existing records from primary storage. [2025-10-28T20:15:06.158484] [INFO ] [MAIN ] NMS: Loaded 2909 existing records. [2025-10-28T20:15:06.331569] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:15:06.331773] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-28T20:15:06.331821] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-28T20:15:06.331978] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-28T20:15:06.332033] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-28T20:15:06.393250] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-28T20:15:06.685727] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:15:06.704687] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T20:15:06.994750] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T20:15:07.180230] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-28T20:15:07.565408] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T20:15:07.980274] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-28T20:15:08.780306] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-28T20:15:08.861693] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T20:15:08.866956] [INFO ] [REMOTE ] NMM: Full fetch complete (21397 records). [2025-10-28T20:15:08.867128] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-28T20:15:09.458423] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-28T20:15:09.458539] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-28T20:15:09.459458] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-28T20:15:09.459541] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-28T20:15:09.460610] [DEBUG] [LOCAL ] NMM: Trimmed 21397 records to 13657 (keeping 200 days of data) [2025-10-28T20:15:09.564597] [DEBUG] [LOCAL ] NMM: Primary data saved (13657 records). [2025-10-28T20:15:09.564806] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-28T20:15:09.564916] [INFO ] [MAIN ] Update Progress: 1494/2366 symbols completed. NMM took 30.0s. Estimated remaining: 1h 53m 53s. Rate: 7.7 symbols/min [2025-10-28T20:15:09.585394] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-28T20:15:09.768397] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:15:09.774668] [DEBUG] [LOCAL ] NMT: Loaded 2779 existing records from primary storage. [2025-10-28T20:15:09.774942] [INFO ] [MAIN ] NMT: Loaded 2779 existing records. [2025-10-28T20:15:09.987264] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:15:09.991100] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-28T20:15:09.991277] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T20:15:09.991446] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-28T20:15:09.993045] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-28T20:15:09.993107] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-28T20:15:10.358791] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T20:15:10.383172] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-28T20:15:10.387702] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:15:10.397317] [INFO ] [REMOTE ] NMR: Full fetch complete (51371 records). [2025-10-28T20:15:10.397439] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-28T20:15:10.772145] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-28T20:15:10.772234] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-28T20:15:10.773158] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-28T20:15:10.773219] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-28T20:15:10.774329] [DEBUG] [LOCAL ] NMR: Trimmed 51371 records to 35110 (keeping 200 days of data) [2025-10-28T20:15:10.856427] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T20:15:10.974684] [DEBUG] [LOCAL ] NMR: Primary data saved (35110 records). [2025-10-28T20:15:10.974826] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-28T20:15:10.974921] [INFO ] [MAIN ] Update Progress: 1495/2366 symbols completed. NMR took 26.2s. Estimated remaining: 1h 53m 41s. Rate: 7.7 symbols/min [2025-10-28T20:15:11.140087] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:15:11.159767] [DEBUG] [LOCAL ] NMZ: Loaded 20790 existing records from primary storage. [2025-10-28T20:15:11.160005] [INFO ] [MAIN ] NMZ: Loaded 20790 existing records. [2025-10-28T20:15:11.188294] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-28T20:15:11.335716] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:15:11.335923] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-28T20:15:11.335998] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-28T20:15:11.336330] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-28T20:15:11.336388] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-28T20:15:11.589706] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T20:15:11.685936] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:15:11.980248] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-28T20:15:12.283670] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T20:15:12.780247] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-28T20:15:13.100180] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T20:15:13.580250] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-28T20:15:13.964328] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T20:15:14.380272] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-28T20:15:14.677400] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-28T20:15:15.180304] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-28T20:15:15.572692] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T20:15:15.980247] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-28T20:15:16.422823] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T20:15:16.423874] [INFO ] [REMOTE ] NMI: Full fetch complete (5626 records). [2025-10-28T20:15:16.423942] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-28T20:15:16.791193] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-28T20:15:16.800002] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-28T20:15:16.800087] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-28T20:15:16.800283] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-28T20:15:16.800322] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-28T20:15:16.800828] [DEBUG] [LOCAL ] NMI: Trimmed 5626 records to 3964 (keeping 200 days of data) [2025-10-28T20:15:16.825115] [DEBUG] [LOCAL ] NMI: Primary data saved (3964 records). [2025-10-28T20:15:16.825207] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-28T20:15:16.825280] [INFO ] [MAIN ] Update Progress: 1496/2366 symbols completed. NMI took 40.4s. Estimated remaining: 1h 53m 32s. Rate: 7.7 symbols/min [2025-10-28T20:15:16.989801] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:15:17.002367] [DEBUG] [LOCAL ] NNI: Loaded 10437 existing records from primary storage. [2025-10-28T20:15:17.002579] [INFO ] [MAIN ] NNI: Loaded 10437 existing records. [2025-10-28T20:15:17.176955] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:15:17.181339] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-28T20:15:17.181198] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T20:15:17.181530] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-28T20:15:17.183362] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-28T20:15:17.183421] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-28T20:15:17.526546] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:15:17.580211] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-28T20:15:18.380283] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-28T20:15:19.180214] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-28T20:15:19.309060] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T20:15:19.323460] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T20:15:19.505756] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T20:15:19.980232] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-28T20:15:20.780232] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-28T20:15:21.090409] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T20:15:21.580273] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-28T20:15:21.772960] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T20:15:22.380232] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-28T20:15:22.481319] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T20:15:22.736147] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T20:15:23.180265] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-28T20:15:23.535320] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T20:15:23.980266] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-28T20:15:24.284025] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T20:15:24.780308] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-28T20:15:25.580248] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-28T20:15:25.887562] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T20:15:26.380326] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-28T20:15:26.942130] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-28T20:15:27.047162] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T20:15:27.180270] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-28T20:15:27.542404] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T20:15:27.980262] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-28T20:15:28.780294] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-28T20:15:29.477152] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T20:15:29.580246] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-28T20:15:29.828735] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T20:15:30.380240] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-28T20:15:30.769498] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T20:15:30.770476] [INFO ] [REMOTE ] NMT: Full fetch complete (3865 records). [2025-10-28T20:15:30.770542] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-28T20:15:31.125192] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-28T20:15:31.125261] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-28T20:15:31.125376] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-28T20:15:31.125411] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-28T20:15:31.125798] [DEBUG] [LOCAL ] NMT: Trimmed 3865 records to 2711 (keeping 200 days of data) [2025-10-28T20:15:31.142121] [DEBUG] [LOCAL ] NMT: Primary data saved (2711 records). [2025-10-28T20:15:31.142181] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-28T20:15:31.142257] [INFO ] [MAIN ] Update Progress: 1497/2366 symbols completed. NMT took 21.6s. Estimated remaining: 1h 53m 28s. Rate: 7.7 symbols/min [2025-10-28T20:15:31.185567] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-28T20:15:31.312429] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:15:31.353563] [DEBUG] [LOCAL ] NNN: Loaded 47984 existing records from primary storage. [2025-10-28T20:15:31.353873] [INFO ] [MAIN ] NNN: Loaded 47984 existing records. [2025-10-28T20:15:31.528112] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:15:31.528305] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-28T20:15:31.528352] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-28T20:15:31.528718] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-28T20:15:31.528777] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-28T20:15:31.859909] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T20:15:31.898843] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:15:31.980247] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-28T20:15:32.490826] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T20:15:32.780289] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-28T20:15:33.302587] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T20:15:33.580257] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-28T20:15:34.380252] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-28T20:15:35.180262] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-28T20:15:35.931198] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T20:15:35.980275] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-28T20:15:36.775338] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T20:15:36.780198] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-28T20:15:40.051154] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (10.47 seconds). [2025-10-28T20:15:40.052452] [INFO ] [REMOTE ] NMS: Full fetch complete (4073 records). [2025-10-28T20:15:40.052521] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-28T20:15:40.466034] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-28T20:15:40.466135] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-28T20:15:40.466357] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-28T20:15:40.466431] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-28T20:15:40.467088] [DEBUG] [LOCAL ] NMS: Trimmed 4073 records to 2914 (keeping 200 days of data) [2025-10-28T20:15:40.490769] [DEBUG] [LOCAL ] NMS: Primary data saved (2914 records). [2025-10-28T20:15:40.490898] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-28T20:15:40.490977] [INFO ] [MAIN ] Update Progress: 1498/2366 symbols completed. NMS took 34.5s. Estimated remaining: 1h 53m 21s. Rate: 7.7 symbols/min [2025-10-28T20:15:40.670907] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:15:40.678180] [DEBUG] [LOCAL ] NNY: Loaded 5772 existing records from primary storage. [2025-10-28T20:15:40.678354] [INFO ] [MAIN ] NNY: Loaded 5772 existing records. [2025-10-28T20:15:40.861956] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:15:40.862161] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-28T20:15:40.862207] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-28T20:15:40.862373] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-28T20:15:40.862427] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-28T20:15:41.207323] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:15:41.207620] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-28T20:15:41.666839] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T20:15:41.668563] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-28T20:15:42.127236] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T20:15:42.129162] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-28T20:15:42.560988] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T20:15:42.562714] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-28T20:15:50.370888] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (16.79 seconds). [2025-10-28T20:15:50.380506] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-28T20:15:51.566482] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T20:15:51.576089] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-28T20:15:52.900956] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T20:15:52.911263] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-28T20:15:55.905848] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (21.53 seconds). [2025-10-28T20:15:55.909048] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-28T20:15:56.486093] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T20:15:56.497949] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-28T20:15:57.008714] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T20:15:57.012500] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-28T20:15:58.078435] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (15.52 seconds). [2025-10-28T20:15:58.081021] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-28T20:15:58.450784] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T20:15:58.452429] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-28T20:16:00.124187] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T20:16:00.125925] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-28T20:16:00.716184] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T20:16:00.718339] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-28T20:16:01.343153] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T20:16:01.345927] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-28T20:16:01.835875] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T20:16:01.837934] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-28T20:16:02.351540] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T20:16:02.353417] [INFO ] [REMOTE ] NNY: Full fetch complete (8451 records). [2025-10-28T20:16:02.353486] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-28T20:16:02.712317] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-28T20:16:02.712396] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-28T20:16:02.712606] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-28T20:16:02.712679] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-28T20:16:02.713163] [DEBUG] [LOCAL ] NNY: Trimmed 8451 records to 5762 (keeping 200 days of data) [2025-10-28T20:16:02.745381] [DEBUG] [LOCAL ] NNY: Primary data saved (5762 records). [2025-10-28T20:16:02.745463] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-28T20:16:02.745532] [INFO ] [MAIN ] Update Progress: 1499/2366 symbols completed. NNY took 22.3s. Estimated remaining: 1h 53m 22s. Rate: 7.6 symbols/min [2025-10-28T20:16:02.931753] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:02.947732] [DEBUG] [LOCAL ] NOA: Loaded 15472 existing records from primary storage. [2025-10-28T20:16:02.947937] [INFO ] [MAIN ] NOA: Loaded 15472 existing records. [2025-10-28T20:16:03.121791] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:03.121990] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-28T20:16:03.122035] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-28T20:16:03.122196] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-28T20:16:03.122233] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-28T20:16:03.471861] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:03.472165] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-28T20:16:04.941701] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (28.16 seconds). [2025-10-28T20:16:04.947583] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-28T20:16:05.737594] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-28T20:16:05.740889] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-28T20:16:05.832553] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:16:05.837253] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-28T20:16:06.375590] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T20:16:06.378636] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-28T20:16:06.683605] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T20:16:06.689606] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-28T20:16:07.187035] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:16:07.191607] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-28T20:16:07.595593] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T20:16:07.599828] [INFO ] [REMOTE ] NMZ: Full fetch complete (30813 records). [2025-10-28T20:16:07.599925] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-28T20:16:08.020120] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-28T20:16:08.020307] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-28T20:16:08.021003] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-28T20:16:08.021081] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-28T20:16:08.032922] [DEBUG] [LOCAL ] NMZ: Trimmed 30813 records to 20640 (keeping 200 days of data) [2025-10-28T20:16:08.034206] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T20:16:08.096964] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-28T20:16:08.164745] [DEBUG] [LOCAL ] NMZ: Primary data saved (20640 records). [2025-10-28T20:16:08.164849] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-28T20:16:08.164928] [INFO ] [MAIN ] Update Progress: 1500/2366 symbols completed. NMZ took 57.2s. Estimated remaining: 1h 53m 12s. Rate: 7.6 symbols/min [2025-10-28T20:16:08.332963] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:08.351615] [DEBUG] [LOCAL ] NOAH: Loaded 19278 existing records from primary storage. [2025-10-28T20:16:08.351865] [INFO ] [MAIN ] NOAH: Loaded 19278 existing records. [2025-10-28T20:16:08.527390] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:08.527596] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-28T20:16:08.527689] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-28T20:16:08.527893] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-28T20:16:08.527974] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-28T20:16:08.897876] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:08.889347] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T20:16:08.898266] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-28T20:16:08.902622] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-28T20:16:09.709262] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T20:16:09.712867] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-28T20:16:10.602733] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T20:16:10.606396] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-28T20:16:11.370620] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T20:16:11.374929] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-28T20:16:12.428853] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T20:16:12.435383] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-28T20:16:13.149544] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:16:13.153011] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-28T20:16:13.763028] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (20.85 seconds). [2025-10-28T20:16:13.773774] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-28T20:16:14.039318] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T20:16:14.044946] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-28T20:16:14.074859] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (5.17 seconds). [2025-10-28T20:16:14.078028] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-28T20:16:14.284225] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (17.27 seconds). [2025-10-28T20:16:14.288998] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-28T20:16:14.772831] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T20:16:14.777328] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-28T20:16:14.820137] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T20:16:14.823347] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-28T20:16:14.874050] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T20:16:14.876377] [INFO ] [REMOTE ] NNI: Full fetch complete (13226 records). [2025-10-28T20:16:14.876449] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-28T20:16:15.248836] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-28T20:16:15.249050] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-28T20:16:15.249435] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-28T20:16:15.249515] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-28T20:16:15.250174] [DEBUG] [LOCAL ] NNI: Trimmed 13226 records to 10473 (keeping 200 days of data) [2025-10-28T20:16:15.331040] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T20:16:15.350803] [DEBUG] [LOCAL ] NNI: Primary data saved (10473 records). [2025-10-28T20:16:15.350923] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-28T20:16:15.351047] [INFO ] [MAIN ] Update Progress: 1501/2366 symbols completed. NNI took 58.5s. Estimated remaining: 1h 53m 4s. Rate: 7.7 symbols/min [2025-10-28T20:16:15.351367] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-28T20:16:15.522960] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:15.559950] [DEBUG] [LOCAL ] NOC: Loaded 41335 existing records from primary storage. [2025-10-28T20:16:15.560203] [INFO ] [MAIN ] NOC: Loaded 41335 existing records. [2025-10-28T20:16:15.746587] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:15.746968] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-28T20:16:15.747040] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-28T20:16:15.747372] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-28T20:16:15.747440] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-28T20:16:15.910756] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T20:16:16.004449] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-28T20:16:16.138157] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:16.138442] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-28T20:16:16.883925] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T20:16:16.886803] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T20:16:16.898077] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-28T20:16:16.899523] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-28T20:16:17.345190] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:16:17.353953] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-28T20:16:17.704101] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T20:16:17.707686] [INFO ] [REMOTE ] NOA: Full fetch complete (22622 records). [2025-10-28T20:16:17.707769] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-28T20:16:18.074262] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-28T20:16:18.074451] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-28T20:16:18.074970] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-28T20:16:18.075029] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-28T20:16:18.075640] [DEBUG] [LOCAL ] NOA: Trimmed 22622 records to 15397 (keeping 200 days of data) [2025-10-28T20:16:18.165569] [DEBUG] [LOCAL ] NOA: Primary data saved (15397 records). [2025-10-28T20:16:18.165722] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-28T20:16:18.165822] [INFO ] [MAIN ] Update Progress: 1502/2366 symbols completed. NOA took 15.4s. Estimated remaining: 1h 52m 53s. Rate: 7.7 symbols/min [2025-10-28T20:16:18.335472] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:18.382081] [DEBUG] [LOCAL ] NOG: Loaded 51328 existing records from primary storage. [2025-10-28T20:16:18.399065] [INFO ] [MAIN ] NOG: Loaded 51328 existing records. [2025-10-28T20:16:18.489472] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:16:18.529341] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-28T20:16:18.611985] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:18.612472] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-28T20:16:18.612666] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-28T20:16:18.613186] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-28T20:16:18.613375] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-28T20:16:18.806385] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T20:16:18.911246] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-28T20:16:19.019096] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:19.019398] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-28T20:16:19.934922] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T20:16:19.935788] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (5.16 seconds). [2025-10-28T20:16:19.951843] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-28T20:16:19.952158] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-28T20:16:20.591281] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T20:16:20.601482] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-28T20:16:20.938231] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T20:16:20.943884] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-28T20:16:21.379899] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T20:16:21.390324] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-28T20:16:21.734806] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-28T20:16:21.744537] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-28T20:16:21.757788] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T20:16:21.761432] [INFO ] [REMOTE ] NOAH: Full fetch complete (26948 records). [2025-10-28T20:16:21.761513] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-28T20:16:22.144424] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-28T20:16:22.144637] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-28T20:16:22.145260] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-28T20:16:22.145401] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-28T20:16:22.146465] [DEBUG] [LOCAL ] NOAH: Trimmed 26948 records to 19143 (keeping 200 days of data) [2025-10-28T20:16:22.271592] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T20:16:22.299746] [DEBUG] [LOCAL ] NOAH: Primary data saved (19143 records). [2025-10-28T20:16:22.300686] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-28T20:16:22.300795] [INFO ] [MAIN ] Update Progress: 1503/2366 symbols completed. NOAH took 14.1s. Estimated remaining: 1h 52m 44s. Rate: 7.7 symbols/min [2025-10-28T20:16:22.301210] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-28T20:16:22.493335] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:22.545908] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-28T20:16:22.546284] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-28T20:16:22.738438] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:22.738751] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-28T20:16:22.738833] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-28T20:16:22.739202] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-28T20:16:22.739328] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-28T20:16:22.919784] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T20:16:22.975824] [INFO ] [REMOTE ] NNN: Full fetch complete (70118 records). [2025-10-28T20:16:23.040767] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-28T20:16:23.286253] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:23.297821] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-28T20:16:23.603834] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-28T20:16:23.604004] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-28T20:16:23.605556] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-28T20:16:23.605803] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-28T20:16:23.608171] [DEBUG] [LOCAL ] NNN: Trimmed 70118 records to 47907 (keeping 200 days of data) [2025-10-28T20:16:23.754774] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-28T20:16:23.786871] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-28T20:16:24.027111] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:16:24.029300] [DEBUG] [LOCAL ] NNN: Primary data saved (47907 records). [2025-10-28T20:16:24.040403] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-28T20:16:24.041321] [INFO ] [MAIN ] Update Progress: 1504/2366 symbols completed. NNN took 52.9s. Estimated remaining: 1h 52m 32s. Rate: 7.7 symbols/min [2025-10-28T20:16:24.041183] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-28T20:16:24.247695] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:24.247905] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-28T20:16:24.247947] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-28T20:16:24.248052] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-28T20:16:24.248093] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-28T20:16:24.248132] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-28T20:16:24.248164] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-28T20:16:24.597066] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:24.597426] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-28T20:16:24.757785] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-28T20:16:24.768553] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-28T20:16:24.912876] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T20:16:24.913704] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-28T20:16:25.271867] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T20:16:25.273147] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-28T20:16:25.454619] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T20:16:25.502160] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T20:16:25.580231] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-28T20:16:25.653747] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T20:16:26.373932] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T20:16:26.384176] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-28T20:16:26.773469] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T20:16:27.069821] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T20:16:27.180279] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-28T20:16:27.980302] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-28T20:16:28.628097] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T20:16:28.757409] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T20:16:28.780218] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-28T20:16:29.580323] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-28T20:16:29.902241] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T20:16:30.063003] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T20:16:30.380312] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-28T20:16:30.742474] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T20:16:31.180307] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-28T20:16:31.980321] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-28T20:16:32.406174] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T20:16:32.780243] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-28T20:16:33.580234] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-28T20:16:33.669709] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T20:16:34.380292] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-28T20:16:35.135685] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-28T20:16:35.143447] [INFO ] [REMOTE ] NOC: Full fetch complete (61553 records). [2025-10-28T20:16:35.143584] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-28T20:16:35.144327] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:16:35.144410] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:16:35.144473] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:16:35.144543] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-28T20:16:35.144605] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-28T20:16:35.144662] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-28T20:16:35.145879] [DEBUG] [LOCAL ] NOC: Deleted derivative data file. [2025-10-28T20:16:35.146298] [INFO ] [MAIN ] Update Progress: 1505/2366 symbols completed. NOC took 19.8s. Estimated remaining: 1h 52m 26s. Rate: 7.7 symbols/min [2025-10-28T20:16:35.188990] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-28T20:16:35.321697] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:35.362386] [DEBUG] [LOCAL ] NOMD: Loaded 43215 existing records from primary storage. [2025-10-28T20:16:35.362686] [INFO ] [MAIN ] NOMD: Loaded 43215 existing records. [2025-10-28T20:16:35.519204] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-28T20:16:35.609159] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:35.609387] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-28T20:16:35.609446] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-28T20:16:35.609665] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-28T20:16:35.609722] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-28T20:16:35.687217] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T20:16:35.972281] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:35.980212] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-28T20:16:36.374168] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-28T20:16:36.780234] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-28T20:16:37.233755] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T20:16:37.457757] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:16:37.580227] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-28T20:16:38.206966] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:16:38.380240] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-28T20:16:39.180260] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-28T20:16:39.568733] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T20:16:39.963244] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T20:16:39.980215] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-28T20:16:40.780245] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-28T20:16:41.154587] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T20:16:41.544566] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T20:16:41.580212] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-28T20:16:42.380263] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-28T20:16:43.069082] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T20:16:43.180234] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-28T20:16:43.542139] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T20:16:43.980247] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-28T20:16:44.687010] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T20:16:44.697439] [INFO ] [REMOTE ] NOG: Full fetch complete (74376 records). [2025-10-28T20:16:44.697585] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-28T20:16:44.786764] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-28T20:16:45.084321] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-28T20:16:45.084409] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-28T20:16:45.085471] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-28T20:16:45.085536] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-28T20:16:45.087033] [DEBUG] [LOCAL ] NOG: Trimmed 74376 records to 51317 (keeping 200 days of data) [2025-10-28T20:16:45.411238] [DEBUG] [LOCAL ] NOG: Primary data saved (51317 records). [2025-10-28T20:16:45.411537] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-28T20:16:45.411859] [INFO ] [MAIN ] Update Progress: 1506/2366 symbols completed. NOG took 27.2s. Estimated remaining: 1h 52m 20s. Rate: 7.7 symbols/min [2025-10-28T20:16:45.498209] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T20:16:45.585236] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-28T20:16:45.656110] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:45.692673] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T20:16:45.733043] [DEBUG] [LOCAL ] NOTE: Loaded 39249 existing records from primary storage. [2025-10-28T20:16:45.733316] [INFO ] [MAIN ] NOTE: Loaded 39249 existing records. [2025-10-28T20:16:45.909410] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:45.909630] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-28T20:16:45.909715] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-28T20:16:45.909909] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-28T20:16:45.909951] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-28T20:16:46.257899] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:46.380255] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-28T20:16:47.036816] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T20:16:47.128961] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T20:16:47.180221] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-28T20:16:47.980250] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-28T20:16:48.328630] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T20:16:48.329534] [INFO ] [REMOTE ] NOM: Full fetch complete (1538 records). [2025-10-28T20:16:48.329612] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-28T20:16:48.519828] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-28T20:16:48.520184] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:16:48.520261] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:16:48.520339] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-28T20:16:48.520512] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-28T20:16:48.520557] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-28T20:16:48.520597] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-28T20:16:48.520677] [INFO ] [MAIN ] Update Progress: 1507/2366 symbols completed. NOM took 24.5s. Estimated remaining: 1h 52m 9s. Rate: 7.7 symbols/min [2025-10-28T20:16:48.714027] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:48.746795] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T20:16:48.783200] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-28T20:16:48.805869] [DEBUG] [LOCAL ] NOV: Loaded 53159 existing records from primary storage. [2025-10-28T20:16:48.806201] [INFO ] [MAIN ] NOV: Loaded 53159 existing records. [2025-10-28T20:16:48.981466] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:48.981710] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-28T20:16:48.981768] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-28T20:16:48.982216] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-28T20:16:48.982274] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-28T20:16:49.330364] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:49.580318] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-28T20:16:50.380237] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-28T20:16:51.090438] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T20:16:51.182590] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-28T20:16:51.187704] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-28T20:16:51.872746] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T20:16:51.980221] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-28T20:16:52.450042] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T20:16:52.780258] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-28T20:16:53.398137] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:16:53.580246] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-28T20:16:54.380247] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-28T20:16:55.180313] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-28T20:16:55.388758] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T20:16:55.589010] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T20:16:55.980311] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-28T20:16:56.543668] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T20:16:56.780291] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-28T20:16:57.508419] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T20:16:57.518669] [INFO ] [REMOTE ] NOK: Full fetch complete (77386 records). [2025-10-28T20:16:57.518817] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-28T20:16:57.519502] [FATAL] [VALIDATOR ] NOK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:16:57.519586] [FATAL] [MAIN ] NOK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:16:57.519628] [WARN ] [MAIN ] NOK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:16:57.519713] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-28T20:16:57.519778] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-28T20:16:57.519813] [INFO ] [LOCAL ] NOK: Starting deletion of derivative data. [2025-10-28T20:16:57.520000] [DEBUG] [LOCAL ] NOK: Deleted derivative data file. [2025-10-28T20:16:57.520104] [INFO ] [MAIN ] Update Progress: 1508/2366 symbols completed. NOK took 35.2s. Estimated remaining: 1h 52m 2s. Rate: 7.7 symbols/min [2025-10-28T20:16:57.587845] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-28T20:16:57.688369] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:16:57.731676] [DEBUG] [LOCAL ] NOW: Loaded 47604 existing records from primary storage. [2025-10-28T20:16:57.732027] [INFO ] [MAIN ] NOW: Loaded 47604 existing records. [2025-10-28T20:16:57.908237] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:16:57.908441] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-28T20:16:57.908489] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-28T20:16:57.908831] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-10-28T20:16:57.908890] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-28T20:16:58.285012] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:16:58.308959] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T20:16:58.380254] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-28T20:16:58.967421] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:16:59.180238] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-28T20:16:59.980297] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-28T20:17:00.596445] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T20:17:00.609792] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-28T20:17:00.780221] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-28T20:17:01.580252] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-28T20:17:02.674225] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-28T20:17:02.685199] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-28T20:17:03.703963] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-28T20:17:03.714057] [INFO ] [REMOTE ] NOMD: Full fetch complete (61109 records). [2025-10-28T20:17:03.714198] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-28T20:17:04.089018] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-28T20:17:04.089117] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-28T20:17:04.090073] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-28T20:17:04.090135] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-28T20:17:04.091352] [DEBUG] [LOCAL ] NOMD: Trimmed 61109 records to 43269 (keeping 200 days of data) [2025-10-28T20:17:04.356780] [DEBUG] [LOCAL ] NOMD: Primary data saved (43269 records). [2025-10-28T20:17:04.357011] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-28T20:17:04.357541] [INFO ] [MAIN ] Update Progress: 1509/2366 symbols completed. NOMD took 29.2s. Estimated remaining: 1h 51m 54s. Rate: 7.7 symbols/min [2025-10-28T20:17:04.539251] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:04.539476] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-28T20:17:04.539713] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-28T20:17:04.539992] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-28T20:17:04.540099] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-28T20:17:04.540204] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-28T20:17:04.540360] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-28T20:17:04.831117] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-28T20:17:04.962844] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-28T20:17:05.122755] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:05.123138] [INFO ] [REMOTE ] NP: Fetching primary data for 2025-01. [2025-10-28T20:17:05.361464] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:17:05.361912] [WARN ] [REMOTE ] NP: No data returned for month 2025-01 [2025-10-28T20:17:05.362030] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:17:05.362112] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-28T20:17:05.362190] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:17:05.363563] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-28T20:17:05.363735] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-28T20:17:05.363795] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-28T20:17:05.363896] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-28T20:17:05.364001] [INFO ] [MAIN ] Update Progress: 1510/2366 symbols completed. NP took 1.0s. Estimated remaining: 1h 51m 42s. Rate: 7.7 symbols/min [2025-10-28T20:17:05.584437] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:05.584609] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-28T20:17:05.584673] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-28T20:17:05.584796] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-28T20:17:05.584837] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-28T20:17:05.584879] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-28T20:17:05.584910] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-28T20:17:05.934281] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:05.934571] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-10-28T20:17:06.218918] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:17:06.219243] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-10-28T20:17:06.219335] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:17:06.219404] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-28T20:17:06.219469] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:17:06.219539] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-28T20:17:06.219604] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-28T20:17:06.219639] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-28T20:17:06.219730] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-28T20:17:06.219779] [INFO ] [MAIN ] Update Progress: 1511/2366 symbols completed. NPB took 0.9s. Estimated remaining: 1h 51m 30s. Rate: 7.7 symbols/min [2025-10-28T20:17:06.397752] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:06.416348] [DEBUG] [LOCAL ] NPCT: Loaded 16200 existing records from primary storage. [2025-10-28T20:17:06.416591] [INFO ] [MAIN ] NPCT: Loaded 16200 existing records. [2025-10-28T20:17:06.593056] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:17:06.593273] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-28T20:17:06.593320] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-28T20:17:06.593557] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-28T20:17:06.593614] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-28T20:17:06.944905] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:06.945256] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-28T20:17:07.028248] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-28T20:17:07.039148] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-28T20:17:07.342171] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (14.56 seconds). [2025-10-28T20:17:07.353358] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-28T20:17:08.015150] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T20:17:08.019957] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-28T20:17:08.817920] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-28T20:17:08.828388] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-28T20:17:08.945078] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T20:17:08.964919] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T20:17:09.580252] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-28T20:17:10.380286] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-28T20:17:10.554394] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-28T20:17:11.129081] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T20:17:11.180229] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-28T20:17:11.282549] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T20:17:11.980257] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-28T20:17:12.780279] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-28T20:17:12.872526] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T20:17:12.928050] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T20:17:13.580234] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-28T20:17:14.113906] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T20:17:14.380275] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-28T20:17:14.612119] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T20:17:15.180297] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-28T20:17:15.980238] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-28T20:17:16.097477] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T20:17:16.780282] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-28T20:17:17.044204] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-28T20:17:17.580222] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-28T20:17:17.820896] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T20:17:17.873768] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-28T20:17:18.328776] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (18.35 seconds). [2025-10-28T20:17:18.380220] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-28T20:17:19.180230] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-28T20:17:19.409612] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-28T20:17:19.980224] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-28T20:17:20.119479] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-28T20:17:20.674861] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T20:17:20.720488] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T20:17:20.780288] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-28T20:17:21.395411] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T20:17:21.404737] [INFO ] [REMOTE ] NOW: Full fetch complete (70584 records). [2025-10-28T20:17:21.404897] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-28T20:17:21.583249] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-28T20:17:21.812107] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-28T20:17:21.812190] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-28T20:17:21.813253] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-28T20:17:21.813317] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-28T20:17:21.814637] [DEBUG] [LOCAL ] NOW: Trimmed 70584 records to 47552 (keeping 200 days of data) [2025-10-28T20:17:22.101139] [DEBUG] [LOCAL ] NOW: Primary data saved (47552 records). [2025-10-28T20:17:22.101276] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-28T20:17:22.102030] [INFO ] [MAIN ] Update Progress: 1512/2366 symbols completed. NOW took 24.6s. Estimated remaining: 1h 51m 27s. Rate: 7.7 symbols/min [2025-10-28T20:17:22.268422] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:22.281187] [DEBUG] [LOCAL ] NPFD: Loaded 9868 existing records from primary storage. [2025-10-28T20:17:22.281424] [INFO ] [MAIN ] NPFD: Loaded 9868 existing records. [2025-10-28T20:17:22.385737] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-28T20:17:22.458987] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:17:22.459212] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-28T20:17:22.459283] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-28T20:17:22.459494] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-28T20:17:22.459549] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-28T20:17:22.825044] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:23.177855] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:17:23.181552] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-28T20:17:23.496448] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T20:17:23.980290] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-28T20:17:24.745111] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:17:24.748062] [INFO ] [REMOTE ] NPCT: Full fetch complete (24086 records). [2025-10-28T20:17:24.748134] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-28T20:17:24.785334] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-28T20:17:25.130434] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-28T20:17:25.130532] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-28T20:17:25.131127] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-28T20:17:25.131245] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-28T20:17:25.131970] [DEBUG] [LOCAL ] NPCT: Trimmed 24086 records to 16155 (keeping 200 days of data) [2025-10-28T20:17:25.258185] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-28T20:17:25.258317] [DEBUG] [LOCAL ] NPCT: Primary data saved (16155 records). [2025-10-28T20:17:25.258548] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-28T20:17:25.269179] [INFO ] [MAIN ] Update Progress: 1513/2366 symbols completed. NPCT took 19.0s. Estimated remaining: 1h 51m 16s. Rate: 7.7 symbols/min [2025-10-28T20:17:25.439565] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:25.449933] [DEBUG] [LOCAL ] NPK: Loaded 8398 existing records from primary storage. [2025-10-28T20:17:25.450148] [INFO ] [MAIN ] NPK: Loaded 8398 existing records. [2025-10-28T20:17:25.587416] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-28T20:17:25.626475] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:17:25.626697] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-28T20:17:25.626754] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-28T20:17:25.626902] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-28T20:17:25.626939] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-28T20:17:25.977745] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:26.380269] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-28T20:17:27.181533] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-28T20:17:27.193851] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T20:17:27.204898] [INFO ] [REMOTE ] NOV: Full fetch complete (77202 records). [2025-10-28T20:17:27.205012] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-28T20:17:27.599176] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-28T20:17:27.599260] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-28T20:17:27.600440] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-28T20:17:27.600534] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-28T20:17:27.602057] [DEBUG] [LOCAL ] NOV: Trimmed 77202 records to 53159 (keeping 200 days of data) [2025-10-28T20:17:27.798380] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T20:17:27.805846] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-10-28T20:17:27.957143] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T20:17:27.984555] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-28T20:17:27.989811] [DEBUG] [LOCAL ] NOV: Primary data saved (53159 records). [2025-10-28T20:17:27.989885] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-28T20:17:27.989975] [INFO ] [MAIN ] Update Progress: 1514/2366 symbols completed. NOV took 39.5s. Estimated remaining: 1h 51m 6s. Rate: 7.7 symbols/min [2025-10-28T20:17:28.162614] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:28.200449] [DEBUG] [LOCAL ] NPKI: Loaded 40227 existing records from primary storage. [2025-10-28T20:17:28.200775] [INFO ] [MAIN ] NPKI: Loaded 40227 existing records. [2025-10-28T20:17:28.376216] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:17:28.376410] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-28T20:17:28.376456] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-28T20:17:28.376694] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-10-28T20:17:28.376751] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-28T20:17:28.723845] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:28.780224] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-28T20:17:29.434269] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T20:17:29.472527] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T20:17:29.580212] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-28T20:17:30.303431] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T20:17:30.380274] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-28T20:17:31.050568] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T20:17:31.180262] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-28T20:17:31.980229] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-28T20:17:32.446459] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T20:17:32.780235] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-28T20:17:33.128568] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T20:17:33.134414] [INFO ] [REMOTE ] NOTE: Full fetch complete (60130 records). [2025-10-28T20:17:33.134571] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-28T20:17:33.453275] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T20:17:33.544418] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-28T20:17:33.544492] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-28T20:17:33.545453] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-28T20:17:33.545514] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-28T20:17:33.546714] [DEBUG] [LOCAL ] NOTE: Trimmed 60130 records to 39113 (keeping 200 days of data) [2025-10-28T20:17:33.593501] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-28T20:17:33.764268] [DEBUG] [LOCAL ] NOTE: Primary data saved (39113 records). [2025-10-28T20:17:33.764395] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-28T20:17:33.764477] [INFO ] [MAIN ] Update Progress: 1515/2366 symbols completed. NOTE took 48.3s. Estimated remaining: 1h 50m 57s. Rate: 7.7 symbols/min [2025-10-28T20:17:33.931740] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:33.947947] [DEBUG] [LOCAL ] NPO: Loaded 13385 existing records from primary storage. [2025-10-28T20:17:33.948132] [INFO ] [MAIN ] NPO: Loaded 13385 existing records. [2025-10-28T20:17:34.127701] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:17:34.127898] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-28T20:17:34.127943] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-28T20:17:34.128175] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-28T20:17:34.128230] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-28T20:17:34.307143] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:17:34.381092] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-28T20:17:34.487889] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:35.149006] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T20:17:35.180204] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-28T20:17:35.939265] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:17:35.980239] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-28T20:17:36.532187] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T20:17:36.780257] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-28T20:17:37.337240] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T20:17:37.580270] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-28T20:17:38.178225] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T20:17:38.380265] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-28T20:17:39.180241] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-28T20:17:39.342913] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T20:17:39.950013] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T20:17:39.980241] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-28T20:17:40.726757] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T20:17:40.729582] [INFO ] [REMOTE ] NPFD: Full fetch complete (14705 records). [2025-10-28T20:17:40.729676] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-28T20:17:40.790611] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-28T20:17:41.104366] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-28T20:17:41.104479] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-28T20:17:41.104864] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-28T20:17:41.104925] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-28T20:17:41.105678] [DEBUG] [LOCAL ] NPFD: Trimmed 14705 records to 9872 (keeping 200 days of data) [2025-10-28T20:17:41.164561] [DEBUG] [LOCAL ] NPFD: Primary data saved (9872 records). [2025-10-28T20:17:41.164777] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-28T20:17:41.164890] [INFO ] [MAIN ] Update Progress: 1516/2366 symbols completed. NPFD took 19.1s. Estimated remaining: 1h 50m 49s. Rate: 7.7 symbols/min [2025-10-28T20:17:41.331389] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:17:41.339277] [DEBUG] [LOCAL ] NPV: Loaded 5319 existing records from primary storage. [2025-10-28T20:17:41.339488] [INFO ] [MAIN ] NPV: Loaded 5319 existing records. [2025-10-28T20:17:41.517985] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:17:41.518258] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-28T20:17:41.518314] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-28T20:17:41.518458] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-28T20:17:41.518498] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-28T20:17:41.585300] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-28T20:17:41.652087] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T20:17:41.923940] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:17:42.272037] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T20:17:42.380255] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-28T20:17:43.180262] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-28T20:17:43.558891] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:17:43.923813] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T20:17:43.980232] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-28T20:17:44.736892] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T20:17:44.780251] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-28T20:17:45.255799] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T20:17:45.580305] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-28T20:17:46.263984] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T20:17:46.380300] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-28T20:17:47.164459] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T20:17:47.180213] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-28T20:17:47.792054] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T20:17:47.980249] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-28T20:17:48.418571] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T20:17:48.780245] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-28T20:17:49.580250] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-28T20:17:50.038846] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T20:17:50.328802] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T20:17:50.380212] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-28T20:17:51.001995] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T20:17:51.180327] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-28T20:17:51.691318] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:17:51.980326] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-28T20:17:52.532135] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T20:17:52.780256] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-28T20:17:53.305866] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T20:17:53.580278] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-28T20:17:54.163943] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T20:17:54.380296] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-28T20:17:55.124195] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T20:17:55.126697] [INFO ] [REMOTE ] NPK: Full fetch complete (11214 records). [2025-10-28T20:17:55.126768] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-28T20:17:55.189045] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-28T20:17:55.511166] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-28T20:17:55.511251] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-28T20:17:55.511545] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-28T20:17:55.511585] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-28T20:17:55.512080] [DEBUG] [LOCAL ] NPK: Trimmed 11214 records to 8431 (keeping 200 days of data) [2025-10-28T20:17:55.563424] [DEBUG] [LOCAL ] NPK: Primary data saved (8431 records). [2025-10-28T20:17:55.563571] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-28T20:17:55.563680] [INFO ] [MAIN ] Update Progress: 1517/2366 symbols completed. NPK took 30.3s. Estimated remaining: 1h 50m 45s. Rate: 7.7 symbols/min [2025-10-28T20:17:55.659416] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T20:17:55.980262] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-28T20:17:56.623434] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T20:17:56.780216] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-28T20:17:57.563506] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T20:17:57.580213] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-28T20:17:58.341726] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T20:17:58.380210] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-28T20:17:59.180287] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-28T20:17:59.256262] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T20:17:59.260012] [INFO ] [REMOTE ] NPO: Full fetch complete (19055 records). [2025-10-28T20:17:59.260082] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-28T20:17:59.624243] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-28T20:17:59.624319] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-28T20:17:59.624779] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-28T20:17:59.624842] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-28T20:17:59.625444] [DEBUG] [LOCAL ] NPO: Trimmed 19055 records to 13391 (keeping 200 days of data) [2025-10-28T20:17:59.707684] [DEBUG] [LOCAL ] NPO: Primary data saved (13391 records). [2025-10-28T20:17:59.707807] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-28T20:17:59.707881] [INFO ] [MAIN ] Update Progress: 1518/2366 symbols completed. NPO took 25.9s. Estimated remaining: 1h 50m 35s. Rate: 7.7 symbols/min [2025-10-28T20:17:59.719443] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T20:17:59.980245] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-28T20:18:00.662849] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T20:18:00.780271] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-28T20:18:01.338015] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T20:18:01.580271] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-28T20:18:02.380221] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-28T20:18:03.026370] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T20:18:03.028156] [INFO ] [REMOTE ] NPV: Full fetch complete (7203 records). [2025-10-28T20:18:03.028238] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-28T20:18:03.385543] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-28T20:18:03.385765] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-28T20:18:03.386095] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-28T20:18:03.386203] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-28T20:18:03.386636] [DEBUG] [LOCAL ] NPV: Trimmed 7203 records to 5322 (keeping 200 days of data) [2025-10-28T20:18:03.418052] [DEBUG] [LOCAL ] NPV: Primary data saved (5322 records). [2025-10-28T20:18:03.418200] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-28T20:18:03.418407] [INFO ] [MAIN ] Update Progress: 1519/2366 symbols completed. NPV took 22.3s. Estimated remaining: 1h 50m 25s. Rate: 7.7 symbols/min [2025-10-28T20:18:03.759466] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:18:03.768290] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-28T20:18:05.405039] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T20:18:05.414085] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-28T20:18:06.848103] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T20:18:06.856600] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-28T20:18:08.259351] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T20:18:08.268602] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-28T20:18:09.590729] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T20:18:09.599729] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-28T20:18:11.080824] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T20:18:11.088995] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-28T20:18:12.434937] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T20:18:12.443400] [INFO ] [REMOTE ] NPKI: Full fetch complete (56471 records). [2025-10-28T20:18:12.443565] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-28T20:18:12.894979] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-28T20:18:12.895071] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-28T20:18:12.896084] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-28T20:18:12.896152] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-28T20:18:12.897410] [DEBUG] [LOCAL ] NPKI: Trimmed 56471 records to 40197 (keeping 200 days of data) [2025-10-28T20:18:13.126664] [DEBUG] [LOCAL ] NPKI: Primary data saved (40197 records). [2025-10-28T20:18:13.126838] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-28T20:18:13.126932] [INFO ] [MAIN ] Update Progress: 1520/2366 symbols completed. NPKI took 45.1s. Estimated remaining: 1h 50m 18s. Rate: 7.7 symbols/min [2025-10-28T20:18:13.668629] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:13.851900] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:13.854431] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:13.881790] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:13.889207] [DEBUG] [LOCAL ] NREF: Loaded 7696 existing records from primary storage. [2025-10-28T20:18:13.889574] [INFO ] [MAIN ] NREF: Loaded 7696 existing records. [2025-10-28T20:18:13.947174] [DEBUG] [LOCAL ] NQP: Loaded 8934 existing records from primary storage. [2025-10-28T20:18:13.993097] [INFO ] [MAIN ] NQP: Loaded 8934 existing records. [2025-10-28T20:18:14.197909] [DEBUG] [LOCAL ] NRDY: Loaded 32049 existing records from primary storage. [2025-10-28T20:18:14.245136] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:14.251056] [DEBUG] [LOCAL ] NPWR: Loaded 43554 existing records from primary storage. [2025-10-28T20:18:14.242008] [INFO ] [MAIN ] NRDY: Loaded 32049 existing records. [2025-10-28T20:18:14.303464] [INFO ] [MAIN ] NPWR: Loaded 43554 existing records. [2025-10-28T20:18:14.280957] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-28T20:18:14.386285] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-28T20:18:14.409200] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-28T20:18:14.409367] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-28T20:18:14.459446] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:14.531058] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-28T20:18:14.597948] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-28T20:18:14.664003] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-28T20:18:14.704260] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-28T20:18:14.839462] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:14.911057] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-28T20:18:14.922803] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:14.938488] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-28T20:18:14.973326] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-28T20:18:14.987873] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-28T20:18:15.007963] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-28T20:18:15.007881] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-28T20:18:15.100735] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-28T20:18:15.131622] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-28T20:18:15.728491] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:15.797035] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-28T20:18:16.091158] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:16.100307] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-28T20:18:16.232866] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:16.266874] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-28T20:18:16.301371] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:16.301871] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-28T20:18:16.645955] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T20:18:16.647939] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-28T20:18:16.908618] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T20:18:16.910723] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-28T20:18:17.130988] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T20:18:17.132791] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-28T20:18:17.616376] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T20:18:17.626857] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-28T20:18:17.634058] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:18:17.637224] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-28T20:18:17.687380] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T20:18:17.695591] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-28T20:18:17.725438] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T20:18:17.728953] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-28T20:18:18.244919] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T20:18:18.247332] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-28T20:18:18.421742] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T20:18:18.424081] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-28T20:18:18.646747] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T20:18:18.653285] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-28T20:18:18.708081] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T20:18:18.852722] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T20:18:18.964180] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T20:18:19.180252] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-28T20:18:19.980270] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-28T20:18:20.077123] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T20:18:20.549962] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:18:20.644017] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T20:18:20.780216] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-28T20:18:21.580292] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-28T20:18:22.095681] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T20:18:22.247514] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T20:18:22.380281] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-28T20:18:23.180263] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-28T20:18:23.878582] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T20:18:23.980233] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-28T20:18:24.780234] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-28T20:18:25.139638] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T20:18:25.403669] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T20:18:25.580241] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-28T20:18:26.141138] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:18:26.380305] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-28T20:18:27.180293] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-28T20:18:27.386763] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (5.01 seconds). [2025-10-28T20:18:27.530201] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:18:27.728524] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:18:27.980269] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-28T20:18:28.665480] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T20:18:28.780302] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-28T20:18:29.448688] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T20:18:29.450665] [INFO ] [REMOTE ] NREF: Full fetch complete (10877 records). [2025-10-28T20:18:29.450736] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-28T20:18:29.589968] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-28T20:18:29.807449] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-28T20:18:29.807530] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-28T20:18:29.807811] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-28T20:18:29.807872] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-28T20:18:29.808296] [DEBUG] [LOCAL ] NREF: Trimmed 10877 records to 7656 (keeping 200 days of data) [2025-10-28T20:18:29.853617] [DEBUG] [LOCAL ] NREF: Primary data saved (7656 records). [2025-10-28T20:18:29.853764] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-28T20:18:29.853845] [INFO ] [MAIN ] Update Progress: 1521/2366 symbols completed. NREF took 16.7s. Estimated remaining: 1h 50m 15s. Rate: 7.7 symbols/min [2025-10-28T20:18:30.017432] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:30.017669] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-28T20:18:30.017724] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-28T20:18:30.017835] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-28T20:18:30.017877] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-28T20:18:30.017917] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-28T20:18:30.017949] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-28T20:18:30.350094] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T20:18:30.383847] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-28T20:18:30.383766] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:31.180270] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-28T20:18:31.958022] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T20:18:31.980261] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-28T20:18:32.048007] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T20:18:32.542683] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T20:18:32.544812] [INFO ] [REMOTE ] NQP: Full fetch complete (12794 records). [2025-10-28T20:18:32.544881] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-28T20:18:32.787965] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-28T20:18:32.909847] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-28T20:18:32.909928] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-28T20:18:32.910228] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-28T20:18:32.910267] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-28T20:18:32.910793] [DEBUG] [LOCAL ] NQP: Trimmed 12794 records to 8928 (keeping 200 days of data) [2025-10-28T20:18:32.964134] [DEBUG] [LOCAL ] NQP: Primary data saved (8928 records). [2025-10-28T20:18:32.964260] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-28T20:18:32.964344] [INFO ] [MAIN ] Update Progress: 1522/2366 symbols completed. NQP took 19.8s. Estimated remaining: 1h 50m 4s. Rate: 7.7 symbols/min [2025-10-28T20:18:33.135229] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:33.173450] [DEBUG] [LOCAL ] NRGV: Loaded 44049 existing records from primary storage. [2025-10-28T20:18:33.173746] [INFO ] [MAIN ] NRGV: Loaded 44049 existing records. [2025-10-28T20:18:33.349555] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:33.349819] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-28T20:18:33.349866] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-28T20:18:33.350051] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-28T20:18:33.350108] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-28T20:18:33.585467] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-28T20:18:33.699052] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:33.970494] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T20:18:34.380261] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-28T20:18:34.901275] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T20:18:35.180287] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-28T20:18:35.861321] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T20:18:35.980217] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-28T20:18:36.436569] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:18:36.780305] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-28T20:18:36.905594] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T20:18:37.580291] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-28T20:18:38.143119] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:18:38.380255] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-28T20:18:38.720378] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T20:18:39.180237] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-28T20:18:39.980256] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-28T20:18:40.477191] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T20:18:40.780255] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-28T20:18:41.580259] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-28T20:18:41.634741] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T20:18:41.644787] [INFO ] [REMOTE ] NPWR: Full fetch complete (61060 records). [2025-10-28T20:18:41.644937] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-28T20:18:41.993035] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T20:18:42.066399] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-28T20:18:42.066480] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-28T20:18:42.067439] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-28T20:18:42.067506] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-28T20:18:42.068729] [DEBUG] [LOCAL ] NPWR: Trimmed 61060 records to 43583 (keeping 200 days of data) [2025-10-28T20:18:42.305273] [DEBUG] [LOCAL ] NPWR: Primary data saved (43583 records). [2025-10-28T20:18:42.305402] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-28T20:18:42.305482] [INFO ] [MAIN ] Update Progress: 1523/2366 symbols completed. NPWR took 29.2s. Estimated remaining: 1h 49m 57s. Rate: 7.7 symbols/min [2025-10-28T20:18:42.394488] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-28T20:18:42.473721] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:42.493961] [DEBUG] [LOCAL ] NRK: Loaded 20288 existing records from primary storage. [2025-10-28T20:18:42.494221] [INFO ] [MAIN ] NRK: Loaded 20288 existing records. [2025-10-28T20:18:42.667421] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:42.667662] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-28T20:18:42.667722] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-28T20:18:42.667912] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-28T20:18:42.667953] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-28T20:18:43.040673] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:43.063840] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T20:18:43.180222] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-28T20:18:43.535106] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T20:18:43.541612] [INFO ] [REMOTE ] NRDY: Full fetch complete (49513 records). [2025-10-28T20:18:43.541728] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-28T20:18:43.948381] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-28T20:18:43.948474] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-28T20:18:43.949409] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-28T20:18:43.949472] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-28T20:18:43.950617] [DEBUG] [LOCAL ] NRDY: Trimmed 49513 records to 32019 (keeping 200 days of data) [2025-10-28T20:18:44.009212] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-28T20:18:44.219920] [DEBUG] [LOCAL ] NRDY: Primary data saved (32019 records). [2025-10-28T20:18:44.220105] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-28T20:18:44.220224] [INFO ] [MAIN ] Update Progress: 1524/2366 symbols completed. NRDY took 31.1s. Estimated remaining: 1h 49m 46s. Rate: 7.7 symbols/min [2025-10-28T20:18:44.487469] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:18:44.498115] [DEBUG] [LOCAL ] NRP: Loaded 4026 existing records from primary storage. [2025-10-28T20:18:44.498708] [INFO ] [MAIN ] NRP: Loaded 4026 existing records. [2025-10-28T20:18:44.753773] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:18:44.754285] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-28T20:18:44.754495] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-28T20:18:44.754754] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-28T20:18:44.754878] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-28T20:18:44.903178] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T20:18:44.964488] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-28T20:18:45.164164] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T20:18:45.219375] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:18:45.580279] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-28T20:18:46.319749] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T20:18:46.333811] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T20:18:46.380240] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-28T20:18:46.978962] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (8.60 seconds). [2025-10-28T20:18:47.180293] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-28T20:18:47.552339] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T20:18:47.929099] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:18:47.980271] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-28T20:18:48.780304] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-28T20:18:48.996115] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T20:18:49.580283] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-28T20:18:50.089111] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T20:18:50.214207] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T20:18:50.380302] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-28T20:18:51.170440] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T20:18:51.180213] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-28T20:18:51.947407] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T20:18:51.980204] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-28T20:18:52.780244] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-28T20:18:52.923957] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T20:18:53.213426] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T20:18:53.580282] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-28T20:18:54.380302] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-28T20:18:54.936234] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T20:18:55.185846] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-28T20:18:55.204167] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T20:18:55.980250] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-28T20:18:56.760970] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T20:18:56.780226] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-28T20:18:57.580276] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-28T20:18:57.839862] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-28T20:18:58.380229] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-28T20:18:58.509006] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T20:18:58.811175] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-28T20:18:58.925380] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T20:18:59.180259] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-28T20:18:59.980252] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-28T20:19:00.246445] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T20:19:00.780260] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-28T20:19:01.580227] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-28T20:19:01.681029] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T20:19:01.685446] [INFO ] [REMOTE ] NRK: Full fetch complete (27686 records). [2025-10-28T20:19:01.685523] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-28T20:19:02.116789] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-28T20:19:02.117226] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-28T20:19:02.120368] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-28T20:19:02.117093] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T20:19:02.118547] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-28T20:19:02.131875] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-28T20:19:02.136919] [DEBUG] [LOCAL ] NRK: Trimmed 27686 records to 20343 (keeping 200 days of data) [2025-10-28T20:19:02.266874] [DEBUG] [LOCAL ] NRK: Primary data saved (20343 records). [2025-10-28T20:19:02.267030] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-28T20:19:02.267139] [INFO ] [MAIN ] Update Progress: 1525/2366 symbols completed. NRK took 20.0s. Estimated remaining: 1h 49m 44s. Rate: 7.7 symbols/min [2025-10-28T20:19:02.385456] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-28T20:19:02.458149] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:02.465934] [DEBUG] [LOCAL ] NRT: Loaded 4846 existing records from primary storage. [2025-10-28T20:19:02.466186] [INFO ] [MAIN ] NRT: Loaded 4846 existing records. [2025-10-28T20:19:02.636982] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:19:02.637205] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-28T20:19:02.637253] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-28T20:19:02.637388] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-28T20:19:02.637424] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-28T20:19:02.993512] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:02.994394] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T20:19:03.180257] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-28T20:19:03.980338] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-28T20:19:04.474499] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T20:19:04.780264] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-28T20:19:04.833458] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T20:19:05.304362] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T20:19:05.580258] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-28T20:19:06.380253] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-28T20:19:07.180465] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-28T20:19:07.182799] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T20:19:07.193042] [INFO ] [REMOTE ] NRGV: Full fetch complete (62637 records). [2025-10-28T20:19:07.193136] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-28T20:19:07.568158] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-28T20:19:07.568244] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-28T20:19:07.569403] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-28T20:19:07.569465] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-28T20:19:07.570617] [DEBUG] [LOCAL ] NRGV: Trimmed 62637 records to 44051 (keeping 200 days of data) [2025-10-28T20:19:07.788625] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T20:19:07.829780] [DEBUG] [LOCAL ] NRGV: Primary data saved (44051 records). [2025-10-28T20:19:07.829899] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-28T20:19:07.829975] [INFO ] [MAIN ] Update Progress: 1526/2366 symbols completed. NRGV took 34.9s. Estimated remaining: 1h 49m 35s. Rate: 7.7 symbols/min [2025-10-28T20:19:07.982499] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-28T20:19:08.002938] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:08.034779] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-10-28T20:19:08.036558] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T20:19:08.035444] [INFO ] [MAIN ] NRUC: Loaded 3083 existing records. [2025-10-28T20:19:08.223448] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:19:08.223686] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-28T20:19:08.223743] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-28T20:19:08.223877] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-28T20:19:08.223914] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-28T20:19:08.584705] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:08.589443] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T20:19:08.780231] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-28T20:19:09.308585] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T20:19:09.580272] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-28T20:19:10.131433] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T20:19:10.380269] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-28T20:19:11.180259] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-28T20:19:11.698822] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T20:19:11.980248] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-28T20:19:12.293805] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-28T20:19:12.518412] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T20:19:12.780241] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-28T20:19:13.292484] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T20:19:13.293930] [INFO ] [REMOTE ] NRP: Full fetch complete (6257 records). [2025-10-28T20:19:13.293996] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-28T20:19:13.585370] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-28T20:19:13.724440] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-28T20:19:13.724541] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-28T20:19:13.724769] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-28T20:19:13.724833] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-28T20:19:13.725227] [DEBUG] [LOCAL ] NRP: Trimmed 6257 records to 3986 (keeping 200 days of data) [2025-10-28T20:19:13.752911] [DEBUG] [LOCAL ] NRP: Primary data saved (3986 records). [2025-10-28T20:19:13.753042] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-28T20:19:13.753157] [INFO ] [MAIN ] Update Progress: 1527/2366 symbols completed. NRP took 29.5s. Estimated remaining: 1h 49m 26s. Rate: 7.7 symbols/min [2025-10-28T20:19:13.927246] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:13.927474] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-28T20:19:13.927517] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-28T20:19:13.927684] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-28T20:19:13.927737] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-28T20:19:13.927785] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-28T20:19:13.927816] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-28T20:19:14.285299] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:14.286175] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T20:19:14.380236] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-28T20:19:15.180288] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-28T20:19:15.670448] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T20:19:15.884419] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T20:19:15.980248] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-28T20:19:16.594371] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T20:19:16.780259] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-28T20:19:17.445904] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T20:19:17.580249] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-28T20:19:18.169182] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T20:19:18.380254] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-28T20:19:19.180257] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-28T20:19:19.755054] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T20:19:19.905732] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T20:19:19.980218] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-28T20:19:20.451765] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T20:19:20.780252] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-28T20:19:21.580251] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-28T20:19:22.128432] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T20:19:22.309557] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T20:19:22.380215] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-28T20:19:23.180248] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-28T20:19:23.689170] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T20:19:23.725684] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T20:19:23.980260] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-28T20:19:24.475325] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T20:19:24.780265] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-28T20:19:25.306947] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T20:19:25.308715] [INFO ] [REMOTE ] NRT: Full fetch complete (7581 records). [2025-10-28T20:19:25.308801] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-28T20:19:25.585335] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-28T20:19:25.684858] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-28T20:19:25.684951] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-28T20:19:25.685146] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-28T20:19:25.685182] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-28T20:19:25.685555] [DEBUG] [LOCAL ] NRT: Trimmed 7581 records to 4850 (keeping 200 days of data) [2025-10-28T20:19:25.711977] [DEBUG] [LOCAL ] NRT: Primary data saved (4850 records). [2025-10-28T20:19:25.712066] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-28T20:19:25.712140] [INFO ] [MAIN ] Update Progress: 1528/2366 symbols completed. NRT took 23.4s. Estimated remaining: 1h 49m 21s. Rate: 7.7 symbols/min [2025-10-28T20:19:25.875780] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:25.875926] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-28T20:19:25.875981] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-28T20:19:25.876092] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-28T20:19:25.876132] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-28T20:19:25.876171] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-28T20:19:25.876202] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-28T20:19:26.218159] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:26.380245] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-28T20:19:27.180279] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-28T20:19:27.520253] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-28T20:19:27.531842] [INFO ] [REMOTE ] NRG: Full fetch complete (76764 records). [2025-10-28T20:19:27.532072] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-28T20:19:27.968511] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-10-28T20:19:27.968731] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-10-28T20:19:27.970954] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-10-28T20:19:27.971052] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-10-28T20:19:27.981889] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-28T20:19:28.000044] [DEBUG] [LOCAL ] NRG: Trimmed 76764 records to 52752 (keeping 200 days of data) [2025-10-28T20:19:28.001501] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T20:19:28.374480] [DEBUG] [LOCAL ] NRG: Primary data saved (52752 records). [2025-10-28T20:19:28.374767] [INFO ] [MAIN ] NRG: Full history saved. [2025-10-28T20:19:28.374924] [INFO ] [MAIN ] Update Progress: 1529/2366 symbols completed. NRG took 58.5s. Estimated remaining: 1h 49m 10s. Rate: 7.7 symbols/min [2025-10-28T20:19:28.491204] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T20:19:28.564233] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:28.564435] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-28T20:19:28.564473] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-28T20:19:28.564592] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-28T20:19:28.564673] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-28T20:19:28.564756] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-28T20:19:28.564798] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-28T20:19:28.786169] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-28T20:19:28.925468] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-28T20:19:29.008802] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:29.580297] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-28T20:19:30.234833] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T20:19:30.380306] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-28T20:19:31.180333] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-28T20:19:31.787800] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T20:19:31.980301] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-28T20:19:32.083945] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T20:19:32.780267] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-28T20:19:33.313255] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (3.73 seconds). [2025-10-28T20:19:33.354611] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T20:19:33.580250] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-28T20:19:34.138866] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T20:19:34.380247] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-28T20:19:34.637805] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-28T20:19:35.180312] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-28T20:19:35.935061] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T20:19:35.980248] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-28T20:19:36.552483] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T20:19:36.780298] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-28T20:19:37.297201] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T20:19:37.580295] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-28T20:19:38.031112] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:19:38.043116] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T20:19:38.044754] [INFO ] [REMOTE ] NRUC: Full fetch complete (4891 records). [2025-10-28T20:19:38.044834] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-28T20:19:38.389631] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-28T20:19:38.421274] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-28T20:19:38.421357] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-28T20:19:38.421540] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-28T20:19:38.421579] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-28T20:19:38.422024] [DEBUG] [LOCAL ] NRUC: Trimmed 4891 records to 3083 (keeping 200 days of data) [2025-10-28T20:19:38.440692] [DEBUG] [LOCAL ] NRUC: Primary data saved (3083 records). [2025-10-28T20:19:38.440764] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-28T20:19:38.440839] [INFO ] [MAIN ] Update Progress: 1530/2366 symbols completed. NRUC took 30.6s. Estimated remaining: 1h 49m 3s. Rate: 7.7 symbols/min [2025-10-28T20:19:38.652364] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:38.672611] [DEBUG] [LOCAL ] NTB: Loaded 19938 existing records from primary storage. [2025-10-28T20:19:38.672887] [INFO ] [MAIN ] NTB: Loaded 19938 existing records. [2025-10-28T20:19:38.853623] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:19:38.853849] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-28T20:19:38.853916] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-28T20:19:38.854245] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-28T20:19:38.854304] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-28T20:19:39.181789] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-28T20:19:39.204618] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:39.757919] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T20:19:39.980276] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-28T20:19:40.589441] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T20:19:40.780268] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-28T20:19:41.580239] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-28T20:19:41.869844] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-28T20:19:42.087616] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T20:19:42.380275] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-28T20:19:42.826182] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T20:19:43.180311] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-28T20:19:43.298365] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T20:19:43.980267] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-28T20:19:44.437932] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:19:44.780279] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-28T20:19:44.951320] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T20:19:45.580264] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-28T20:19:46.380229] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-28T20:19:46.454837] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T20:19:47.180306] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-28T20:19:47.949794] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T20:19:47.980247] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-28T20:19:48.567596] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T20:19:48.780235] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-28T20:19:49.351026] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T20:19:49.360378] [INFO ] [REMOTE ] NSC: Full fetch complete (70887 records). [2025-10-28T20:19:49.360515] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-28T20:19:49.585370] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-28T20:19:49.781755] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-10-28T20:19:49.781872] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-10-28T20:19:49.783080] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-10-28T20:19:49.783150] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-10-28T20:19:49.784823] [DEBUG] [LOCAL ] NSC: Trimmed 70887 records to 48473 (keeping 200 days of data) [2025-10-28T20:19:50.088441] [DEBUG] [LOCAL ] NSC: Primary data saved (48473 records). [2025-10-28T20:19:50.088560] [INFO ] [MAIN ] NSC: Full history saved. [2025-10-28T20:19:50.088630] [INFO ] [MAIN ] Update Progress: 1531/2366 symbols completed. NSC took 24.4s. Estimated remaining: 1h 48m 58s. Rate: 7.7 symbols/min [2025-10-28T20:19:50.277635] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T20:19:50.280716] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:50.288498] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-28T20:19:50.288562] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-28T20:19:50.288729] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-28T20:19:50.289045] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-28T20:19:50.289111] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-28T20:19:50.289146] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-28T20:19:50.385721] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-28T20:19:50.654363] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:50.673283] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T20:19:51.154764] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (6.37 seconds). [2025-10-28T20:19:51.180228] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-28T20:19:51.586505] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:19:51.980269] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-28T20:19:52.561811] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T20:19:52.574253] [INFO ] [REMOTE ] NSA: Full fetch complete (62983 records). [2025-10-28T20:19:52.574397] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T20:19:52.574563] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-28T20:19:52.790731] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-28T20:19:52.951204] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-28T20:19:52.951278] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-28T20:19:52.952111] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-28T20:19:52.952171] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-28T20:19:52.953390] [DEBUG] [LOCAL ] NSA: Trimmed 62983 records to 45102 (keeping 200 days of data) [2025-10-28T20:19:53.241963] [DEBUG] [LOCAL ] NSA: Primary data saved (45102 records). [2025-10-28T20:19:53.242102] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-28T20:19:53.242175] [INFO ] [MAIN ] Update Progress: 1532/2366 symbols completed. NSA took 39.5s. Estimated remaining: 1h 48m 47s. Rate: 7.7 symbols/min [2025-10-28T20:19:53.407227] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:19:53.461034] [DEBUG] [LOCAL ] NTR: Loaded 52577 existing records from primary storage. [2025-10-28T20:19:53.461407] [INFO ] [MAIN ] NTR: Loaded 52577 existing records. [2025-10-28T20:19:53.585530] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-28T20:19:53.672265] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:19:53.672484] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-28T20:19:53.672532] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-28T20:19:53.672881] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-28T20:19:53.672959] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-28T20:19:54.115024] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:19:54.133869] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T20:19:54.382024] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-28T20:19:54.385912] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T20:19:55.180250] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-28T20:19:55.720165] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T20:19:55.763378] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T20:19:55.980241] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-28T20:19:56.780224] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-28T20:19:56.853881] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:19:57.580249] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-28T20:19:58.062081] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T20:19:58.152707] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T20:19:58.380274] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-28T20:19:58.844696] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T20:19:59.180264] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-28T20:19:59.980246] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-28T20:20:00.668181] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T20:20:00.780237] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-28T20:20:01.580249] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-28T20:20:02.064722] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-28T20:20:02.380257] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-28T20:20:02.903529] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T20:20:03.180261] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-28T20:20:03.256059] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-28T20:20:03.610425] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-28T20:20:03.917878] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T20:20:03.980223] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-28T20:20:04.630497] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T20:20:04.780250] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-28T20:20:05.580246] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-28T20:20:05.973926] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T20:20:06.380245] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-28T20:20:06.926006] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:20:07.181429] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-28T20:20:07.181343] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T20:20:07.980250] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-28T20:20:08.266484] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T20:20:08.273985] [INFO ] [REMOTE ] NSP: Full fetch complete (50494 records). [2025-10-28T20:20:08.274113] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-28T20:20:08.450728] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T20:20:08.472414] [INFO ] [REMOTE ] NTEST: Full fetch complete (1963 records). [2025-10-28T20:20:08.524696] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-28T20:20:08.539382] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:20:08.557249] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:20:08.578161] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:20:08.581270] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-28T20:20:08.581344] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-28T20:20:08.581684] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-28T20:20:08.592229] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-28T20:20:08.597445] [INFO ] [MAIN ] Update Progress: 1533/2366 symbols completed. NTEST took 18.5s. Estimated remaining: 1h 48m 44s. Rate: 7.7 symbols/min [2025-10-28T20:20:08.772428] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-28T20:20:08.772845] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-28T20:20:08.773758] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-28T20:20:08.779223] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-28T20:20:08.784891] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-28T20:20:08.848927] [DEBUG] [LOCAL ] NSP: Trimmed 50494 records to 35731 (keeping 200 days of data) [2025-10-28T20:20:08.848760] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:09.092580] [DEBUG] [LOCAL ] NTST: Loaded 43955 existing records from primary storage. [2025-10-28T20:20:09.091882] [DEBUG] [LOCAL ] NSP: Primary data saved (35731 records). [2025-10-28T20:20:09.092995] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-28T20:20:09.093104] [INFO ] [MAIN ] Update Progress: 1534/2366 symbols completed. NSP took 40.7s. Estimated remaining: 1h 48m 32s. Rate: 7.7 symbols/min [2025-10-28T20:20:09.104469] [INFO ] [MAIN ] NTST: Loaded 43955 existing records. [2025-10-28T20:20:09.467596] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:09.471037] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:20:09.471267] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-28T20:20:09.471339] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-28T20:20:09.472062] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-28T20:20:09.472119] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-28T20:20:09.584414] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-28T20:20:09.826343] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-28T20:20:09.840410] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-10-28T20:20:09.934778] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:10.036035] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:20:10.036247] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-28T20:20:10.036292] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-28T20:20:10.036824] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-28T20:20:10.036880] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-28T20:20:10.391003] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:10.385287] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-28T20:20:10.583345] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-28T20:20:10.876782] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T20:20:11.180240] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-28T20:20:11.693166] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T20:20:11.980314] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-28T20:20:12.580760] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T20:20:12.780224] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-28T20:20:13.580216] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-28T20:20:13.719882] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T20:20:14.209056] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-28T20:20:14.380283] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-28T20:20:15.062686] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T20:20:15.180236] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-28T20:20:15.393226] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T20:20:15.980320] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-28T20:20:16.780237] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-28T20:20:16.927670] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T20:20:17.031775] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T20:20:17.036205] [INFO ] [REMOTE ] NTB: Full fetch complete (30661 records). [2025-10-28T20:20:17.036296] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-28T20:20:17.403104] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-28T20:20:17.403186] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-28T20:20:17.403869] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-28T20:20:17.403930] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-28T20:20:17.404758] [DEBUG] [LOCAL ] NTB: Trimmed 30661 records to 19841 (keeping 200 days of data) [2025-10-28T20:20:17.524582] [DEBUG] [LOCAL ] NTB: Primary data saved (19841 records). [2025-10-28T20:20:17.524763] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-28T20:20:17.524852] [INFO ] [MAIN ] Update Progress: 1535/2366 symbols completed. NTB took 39.1s. Estimated remaining: 1h 48m 24s. Rate: 7.7 symbols/min [2025-10-28T20:20:17.591202] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-28T20:20:17.714056] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:17.714262] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-28T20:20:17.714311] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-28T20:20:17.714417] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-28T20:20:17.714457] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-28T20:20:17.714498] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-28T20:20:17.714529] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-28T20:20:18.062081] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:18.131471] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T20:20:18.380263] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-28T20:20:19.180229] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-28T20:20:19.227712] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T20:20:19.980254] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-28T20:20:20.108188] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T20:20:20.459099] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T20:20:20.780273] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-28T20:20:21.580302] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-28T20:20:21.931354] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:20:22.380252] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-28T20:20:23.180329] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-28T20:20:23.751006] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-28T20:20:23.980255] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-28T20:20:24.227834] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-28T20:20:24.311633] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T20:20:24.780252] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-28T20:20:25.580273] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-28T20:20:25.854082] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-28T20:20:26.380335] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-28T20:20:27.345011] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (7.36 seconds). [2025-10-28T20:20:27.355407] [INFO ] [REMOTE ] NTR: Full fetch complete (76440 records). [2025-10-28T20:20:27.355605] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-28T20:20:27.748890] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-28T20:20:27.748977] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-28T20:20:27.750132] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-28T20:20:27.750198] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-28T20:20:27.751666] [DEBUG] [LOCAL ] NTR: Trimmed 76440 records to 52544 (keeping 200 days of data) [2025-10-28T20:20:28.076417] [DEBUG] [LOCAL ] NTR: Primary data saved (52544 records). [2025-10-28T20:20:28.076554] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-28T20:20:28.077232] [INFO ] [MAIN ] Update Progress: 1536/2366 symbols completed. NTR took 34.8s. Estimated remaining: 1h 48m 18s. Rate: 7.7 symbols/min [2025-10-28T20:20:28.258669] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:28.259026] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-28T20:20:28.259159] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-28T20:20:28.259296] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-28T20:20:28.259362] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-28T20:20:28.259414] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-28T20:20:28.259447] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-28T20:20:28.628846] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:28.629688] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-28T20:20:28.698027] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (3.92 seconds). [2025-10-28T20:20:28.702147] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-28T20:20:28.726694] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-28T20:20:28.780511] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-28T20:20:29.350383] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (3.77 seconds). [2025-10-28T20:20:29.580252] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-28T20:20:29.925755] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T20:20:30.380274] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-28T20:20:30.663984] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T20:20:30.863325] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-28T20:20:30.923490] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-28T20:20:31.180270] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-28T20:20:31.598873] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T20:20:31.980270] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-28T20:20:32.780242] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-28T20:20:32.919002] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-28T20:20:33.580233] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-28T20:20:33.629188] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T20:20:34.053996] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T20:20:34.380265] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-28T20:20:35.180276] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-28T20:20:35.454757] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-28T20:20:35.596618] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T20:20:35.980319] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-28T20:20:36.475345] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T20:20:36.484972] [INFO ] [REMOTE ] NTST: Full fetch complete (62183 records). [2025-10-28T20:20:36.485123] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-28T20:20:36.788280] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-28T20:20:36.886379] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-28T20:20:36.886460] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-28T20:20:36.887694] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-28T20:20:36.887769] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-28T20:20:36.888980] [DEBUG] [LOCAL ] NTST: Trimmed 62183 records to 43995 (keeping 200 days of data) [2025-10-28T20:20:37.148420] [DEBUG] [LOCAL ] NTST: Primary data saved (43995 records). [2025-10-28T20:20:37.148595] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-28T20:20:37.148731] [INFO ] [MAIN ] Update Progress: 1537/2366 symbols completed. NTST took 28.5s. Estimated remaining: 1h 48m 11s. Rate: 7.7 symbols/min [2025-10-28T20:20:37.332569] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:37.354315] [DEBUG] [LOCAL ] NUV: Loaded 22918 existing records from primary storage. [2025-10-28T20:20:37.354550] [INFO ] [MAIN ] NUV: Loaded 22918 existing records. [2025-10-28T20:20:37.551153] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:20:37.551382] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-28T20:20:37.551429] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-28T20:20:37.551598] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-28T20:20:37.551638] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-28T20:20:37.585527] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-28T20:20:37.929286] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:37.966191] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-28T20:20:38.034738] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T20:20:38.380248] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-28T20:20:39.180328] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-28T20:20:39.530482] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:20:39.599599] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-28T20:20:39.980242] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-28T20:20:40.211559] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T20:20:40.780401] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-28T20:20:40.971374] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T20:20:41.580327] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-28T20:20:42.380257] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-28T20:20:42.561164] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T20:20:43.180262] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-28T20:20:43.203607] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T20:20:43.542025] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T20:20:43.980317] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-28T20:20:44.780245] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-28T20:20:44.838758] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T20:20:45.102720] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T20:20:45.115489] [INFO ] [REMOTE ] NU: Full fetch complete (77926 records). [2025-10-28T20:20:45.115749] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-28T20:20:45.528464] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-28T20:20:45.528593] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-28T20:20:45.529997] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-28T20:20:45.530068] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-28T20:20:45.531883] [DEBUG] [LOCAL ] NU: Trimmed 77926 records to 53746 (keeping 200 days of data) [2025-10-28T20:20:45.598775] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-28T20:20:45.871328] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-10-28T20:20:45.871449] [INFO ] [MAIN ] NU: Full history saved. [2025-10-28T20:20:45.871539] [INFO ] [MAIN ] Update Progress: 1538/2366 symbols completed. NU took 36.8s. Estimated remaining: 1h 48m 3s. Rate: 7.7 symbols/min [2025-10-28T20:20:46.036740] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:46.083105] [DEBUG] [LOCAL ] NUVB: Loaded 51742 existing records from primary storage. [2025-10-28T20:20:46.083398] [INFO ] [MAIN ] NUVB: Loaded 51742 existing records. [2025-10-28T20:20:46.259666] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:20:46.259888] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-28T20:20:46.259934] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-28T20:20:46.260351] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-28T20:20:46.260409] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-28T20:20:46.382260] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-28T20:20:46.628267] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:46.663991] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T20:20:46.757300] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T20:20:47.180310] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-28T20:20:47.613508] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T20:20:47.980272] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-28T20:20:48.613254] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T20:20:48.780267] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-28T20:20:49.272120] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T20:20:49.580253] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-28T20:20:50.380263] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-28T20:20:51.021840] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T20:20:51.028797] [INFO ] [REMOTE ] NUS: Full fetch complete (52838 records). [2025-10-28T20:20:51.028941] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-28T20:20:51.187241] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-28T20:20:51.385180] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T20:20:51.492833] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-28T20:20:51.492927] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-28T20:20:51.494005] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-28T20:20:51.494077] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-28T20:20:51.495337] [DEBUG] [LOCAL ] NUS: Trimmed 52838 records to 35572 (keeping 200 days of data) [2025-10-28T20:20:51.721564] [DEBUG] [LOCAL ] NUS: Primary data saved (35572 records). [2025-10-28T20:20:51.721731] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-28T20:20:51.721832] [INFO ] [MAIN ] Update Progress: 1539/2366 symbols completed. NUS took 23.6s. Estimated remaining: 1h 47m 55s. Rate: 7.7 symbols/min [2025-10-28T20:20:51.916901] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:20:51.926368] [DEBUG] [LOCAL ] NUW: Loaded 6428 existing records from primary storage. [2025-10-28T20:20:51.926692] [INFO ] [MAIN ] NUW: Loaded 6428 existing records. [2025-10-28T20:20:51.980285] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-28T20:20:52.139373] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:20:52.139873] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-28T20:20:52.139976] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-28T20:20:52.140215] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-28T20:20:52.140290] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-28T20:20:52.496143] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (3.72 seconds). [2025-10-28T20:20:52.572475] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:20:52.598024] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T20:20:52.780249] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-28T20:20:53.427238] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T20:20:53.580258] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-28T20:20:54.061554] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T20:20:54.380291] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-28T20:20:55.180294] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-28T20:20:55.353144] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T20:20:55.798988] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T20:20:55.980273] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-28T20:20:56.205356] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-28T20:20:56.585596] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T20:20:56.780281] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-28T20:20:57.382747] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T20:20:57.580241] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-28T20:20:58.380256] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-28T20:20:59.135316] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T20:20:59.180266] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-28T20:20:59.793112] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T20:20:59.980249] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-28T20:21:00.780273] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-28T20:21:01.118607] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-28T20:21:01.436634] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T20:21:01.580313] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-28T20:21:02.380269] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-28T20:21:02.638348] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-28T20:21:03.014716] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:21:03.180284] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-28T20:21:03.901554] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-28T20:21:03.911616] [INFO ] [REMOTE ] NUE: Full fetch complete (74738 records). [2025-10-28T20:21:03.911806] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-28T20:21:03.986121] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-28T20:21:04.107875] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:21:04.108671] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:21:04.108741] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:21:04.108790] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-28T20:21:04.108855] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-28T20:21:04.108891] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-28T20:21:04.108930] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-28T20:21:04.108997] [INFO ] [MAIN ] Update Progress: 1540/2366 symbols completed. NUE took 46.6s. Estimated remaining: 1h 47m 49s. Rate: 7.7 symbols/min [2025-10-28T20:21:04.279387] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:04.305716] [DEBUG] [LOCAL ] NVG: Loaded 26970 existing records from primary storage. [2025-10-28T20:21:04.305998] [INFO ] [MAIN ] NVG: Loaded 26970 existing records. [2025-10-28T20:21:04.495094] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:21:04.495332] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-28T20:21:04.495386] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-28T20:21:04.495799] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-28T20:21:04.495857] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-28T20:21:04.656018] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T20:21:04.786175] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-28T20:21:04.875686] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:04.921981] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-28T20:21:05.580244] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-28T20:21:05.685859] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T20:21:06.380240] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-28T20:21:06.402928] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:21:07.180224] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-28T20:21:07.980233] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-28T20:21:08.023804] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T20:21:08.058013] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T20:21:08.063394] [INFO ] [REMOTE ] NUV: Full fetch complete (33785 records). [2025-10-28T20:21:08.063471] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-28T20:21:08.475810] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-28T20:21:08.475923] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-28T20:21:08.476741] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-28T20:21:08.476973] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-28T20:21:08.477931] [DEBUG] [LOCAL ] NUV: Trimmed 33785 records to 22854 (keeping 200 days of data) [2025-10-28T20:21:08.569622] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T20:21:08.626190] [DEBUG] [LOCAL ] NUV: Primary data saved (22854 records). [2025-10-28T20:21:08.626323] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-28T20:21:08.626402] [INFO ] [MAIN ] Update Progress: 1541/2366 symbols completed. NUV took 31.5s. Estimated remaining: 1h 47m 40s. Rate: 7.7 symbols/min [2025-10-28T20:21:08.792912] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-28T20:21:08.796977] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:08.831334] [DEBUG] [LOCAL ] NVGS: Loaded 29490 existing records from primary storage. [2025-10-28T20:21:08.831592] [INFO ] [MAIN ] NVGS: Loaded 29490 existing records. [2025-10-28T20:21:09.004158] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:21:09.004387] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-28T20:21:09.004433] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-28T20:21:09.005175] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-28T20:21:09.005234] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-28T20:21:09.360071] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:09.580252] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-28T20:21:10.031096] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T20:21:10.032511] [INFO ] [REMOTE ] NUW: Full fetch complete (10553 records). [2025-10-28T20:21:10.032597] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-28T20:21:10.385831] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-28T20:21:10.421327] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-28T20:21:10.421433] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-28T20:21:10.421801] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-28T20:21:10.421884] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-28T20:21:10.422532] [DEBUG] [LOCAL ] NUW: Trimmed 10553 records to 6350 (keeping 200 days of data) [2025-10-28T20:21:10.496622] [DEBUG] [LOCAL ] NUW: Primary data saved (6350 records). [2025-10-28T20:21:10.499333] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T20:21:10.497772] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-28T20:21:10.499546] [INFO ] [MAIN ] Update Progress: 1542/2366 symbols completed. NUW took 18.8s. Estimated remaining: 1h 47m 29s. Rate: 7.7 symbols/min [2025-10-28T20:21:10.685663] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:10.740968] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-28T20:21:10.741279] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-10-28T20:21:10.924424] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:21:10.924664] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-28T20:21:10.924735] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-28T20:21:10.925295] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-28T20:21:10.925351] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-28T20:21:11.189492] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-28T20:21:11.285744] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:11.389167] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T20:21:11.980291] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-28T20:21:12.507267] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T20:21:12.780231] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-28T20:21:13.585316] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-28T20:21:13.606364] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T20:21:14.380308] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-28T20:21:14.858180] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-28T20:21:15.180265] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-28T20:21:15.980235] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-28T20:21:16.049063] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-28T20:21:16.268804] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T20:21:16.286612] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T20:21:16.293592] [INFO ] [REMOTE ] NUVB: Full fetch complete (73571 records). [2025-10-28T20:21:16.294231] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-28T20:21:16.707768] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-28T20:21:16.707847] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-28T20:21:16.709216] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-28T20:21:16.709312] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-28T20:21:16.711402] [DEBUG] [LOCAL ] NUVB: Trimmed 73571 records to 51757 (keeping 200 days of data) [2025-10-28T20:21:16.792924] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-28T20:21:16.940071] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T20:21:17.029452] [DEBUG] [LOCAL ] NUVB: Primary data saved (51757 records). [2025-10-28T20:21:17.029581] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-28T20:21:17.029683] [INFO ] [MAIN ] Update Progress: 1543/2366 symbols completed. NUVB took 31.2s. Estimated remaining: 1h 47m 20s. Rate: 7.7 symbols/min [2025-10-28T20:21:17.200933] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:17.201088] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-28T20:21:17.201126] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-28T20:21:17.201233] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-28T20:21:17.201275] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-28T20:21:17.201317] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-28T20:21:17.201350] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-28T20:21:17.545479] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:17.580205] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-28T20:21:17.881227] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T20:21:18.380234] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-28T20:21:18.455242] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T20:21:19.180289] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-28T20:21:19.831852] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:21:19.980286] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-28T20:21:20.780265] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-28T20:21:21.016936] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T20:21:21.335444] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-28T20:21:21.580255] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-28T20:21:21.694793] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T20:21:22.380246] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-28T20:21:23.180258] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-28T20:21:23.432931] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T20:21:23.862564] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-28T20:21:23.980259] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-28T20:21:24.179052] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T20:21:24.780224] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-28T20:21:25.038901] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T20:21:25.580235] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-28T20:21:26.380278] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-28T20:21:26.510789] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T20:21:27.142029] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-28T20:21:27.180236] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-28T20:21:27.490608] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T20:21:27.980292] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-28T20:21:28.780247] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-28T20:21:29.101417] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T20:21:29.362502] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-28T20:21:29.580278] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-28T20:21:29.986605] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T20:21:30.380274] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-28T20:21:30.525600] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T20:21:31.180296] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-28T20:21:31.980270] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-28T20:21:32.131321] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T20:21:32.780230] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-28T20:21:32.888414] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-28T20:21:33.078172] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T20:21:33.580248] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-28T20:21:33.888221] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T20:21:34.380250] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-28T20:21:34.970502] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T20:21:35.180264] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-28T20:21:35.980229] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-28T20:21:36.017105] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T20:21:36.035703] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T20:21:36.035902] [INFO ] [REMOTE ] NVG: Full fetch complete (39272 records). [2025-10-28T20:21:36.040580] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-28T20:21:36.431103] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-28T20:21:36.431202] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-28T20:21:36.432106] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-28T20:21:36.432168] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-28T20:21:36.433180] [DEBUG] [LOCAL ] NVG: Trimmed 39272 records to 26950 (keeping 200 days of data) [2025-10-28T20:21:36.599007] [DEBUG] [LOCAL ] NVG: Primary data saved (26950 records). [2025-10-28T20:21:36.599131] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-28T20:21:36.599220] [INFO ] [MAIN ] Update Progress: 1544/2366 symbols completed. NVG took 32.5s. Estimated remaining: 1h 47m 18s. Rate: 7.7 symbols/min [2025-10-28T20:21:36.776928] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:36.777116] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-28T20:21:36.777155] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-28T20:21:36.777285] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-28T20:21:36.777336] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-28T20:21:36.777378] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-28T20:21:36.777411] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-28T20:21:36.789405] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-28T20:21:37.157742] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T20:21:37.188273] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:37.188957] [INFO ] [REMOTE ] NVGS: Full fetch complete (41932 records). [2025-10-28T20:21:37.189082] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-28T20:21:37.583579] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-28T20:21:37.584602] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-28T20:21:37.584686] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-28T20:21:37.585554] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-28T20:21:37.585721] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-28T20:21:37.586837] [DEBUG] [LOCAL ] NVGS: Trimmed 41932 records to 29406 (keeping 200 days of data) [2025-10-28T20:21:37.773716] [DEBUG] [LOCAL ] NVGS: Primary data saved (29406 records). [2025-10-28T20:21:37.773855] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-28T20:21:37.773937] [INFO ] [MAIN ] Update Progress: 1545/2366 symbols completed. NVGS took 29.1s. Estimated remaining: 1h 47m 7s. Rate: 7.7 symbols/min [2025-10-28T20:21:37.976792] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T20:21:37.978485] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:38.038329] [DEBUG] [LOCAL ] NVS: Loaded 51268 existing records from primary storage. [2025-10-28T20:21:38.038702] [INFO ] [MAIN ] NVS: Loaded 51268 existing records. [2025-10-28T20:21:38.225266] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:21:38.225501] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-28T20:21:38.225548] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-28T20:21:38.226048] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-28T20:21:38.226106] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-28T20:21:38.382214] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-28T20:21:38.596128] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:39.180287] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-28T20:21:39.601824] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T20:21:39.671381] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T20:21:39.948239] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T20:21:39.980245] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-28T20:21:40.780241] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-28T20:21:41.580253] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-28T20:21:42.380260] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-28T20:21:42.745832] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-28T20:21:43.180382] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-28T20:21:43.329048] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (3.35 seconds). [2025-10-28T20:21:43.980370] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-28T20:21:44.734962] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-28T20:21:44.780223] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-28T20:21:44.810703] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T20:21:45.231954] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-28T20:21:45.580270] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-28T20:21:46.380241] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-28T20:21:46.916440] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T20:21:47.032789] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-28T20:21:47.180297] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-28T20:21:47.330459] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T20:21:47.334954] [INFO ] [REMOTE ] NVR: Full fetch complete (28947 records). [2025-10-28T20:21:47.335039] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-28T20:21:47.716719] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-28T20:21:47.716804] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-28T20:21:47.717460] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-28T20:21:47.717500] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-28T20:21:47.718206] [DEBUG] [LOCAL ] NVR: Trimmed 28947 records to 18111 (keeping 200 days of data) [2025-10-28T20:21:47.829285] [DEBUG] [LOCAL ] NVR: Primary data saved (18111 records). [2025-10-28T20:21:47.829596] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-28T20:21:47.829707] [INFO ] [MAIN ] Update Progress: 1546/2366 symbols completed. NVR took 30.8s. Estimated remaining: 1h 47m 0s. Rate: 7.7 symbols/min [2025-10-28T20:21:47.984110] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-28T20:21:48.002333] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:48.003316] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-28T20:21:48.003363] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-28T20:21:48.003482] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-28T20:21:48.003523] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-28T20:21:48.003565] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-28T20:21:48.003599] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-28T20:21:48.358091] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:48.726815] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T20:21:48.740633] [INFO ] [REMOTE ] NVO: Full fetch complete (77574 records). [2025-10-28T20:21:48.740956] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-28T20:21:48.742561] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:21:48.742725] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:21:48.742823] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:21:48.742877] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-28T20:21:48.742952] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-28T20:21:48.743018] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-28T20:21:48.743337] [DEBUG] [LOCAL ] NVO: Deleted derivative data file. [2025-10-28T20:21:48.743488] [INFO ] [MAIN ] Update Progress: 1547/2366 symbols completed. NVO took 38.2s. Estimated remaining: 1h 46m 49s. Rate: 7.7 symbols/min [2025-10-28T20:21:48.786059] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-28T20:21:48.949106] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:21:48.949433] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-28T20:21:48.949531] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-28T20:21:48.949690] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-28T20:21:48.949746] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-28T20:21:48.949817] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-28T20:21:48.949864] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-28T20:21:49.321726] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:21:49.580292] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-28T20:21:49.999513] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:21:50.380244] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-28T20:21:50.823018] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T20:21:51.180333] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-28T20:21:51.618871] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T20:21:51.979145] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (10.40 seconds). [2025-10-28T20:21:51.982822] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-28T20:21:52.674735] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T20:21:52.780234] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-28T20:21:53.580219] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-28T20:21:54.088820] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-28T20:21:54.325174] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T20:21:54.380331] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-28T20:21:55.180216] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-28T20:21:55.394800] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-28T20:21:55.694437] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T20:21:55.980291] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-28T20:21:56.631385] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T20:21:56.780273] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-28T20:21:57.580290] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-28T20:21:57.684201] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T20:21:58.380251] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-28T20:21:58.655334] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T20:21:59.047613] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:21:59.180251] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-28T20:21:59.385464] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (12.21 seconds). [2025-10-28T20:21:59.980253] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-28T20:22:00.219961] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-28T20:22:00.266487] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T20:22:00.780257] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-28T20:22:01.323968] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T20:22:01.580240] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-28T20:22:02.262893] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T20:22:02.380296] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-28T20:22:03.160905] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T20:22:03.180217] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-28T20:22:03.537814] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T20:22:03.980252] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-28T20:22:04.780230] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-28T20:22:04.881240] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T20:22:05.590893] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-28T20:22:05.600219] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T20:22:06.266214] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T20:22:06.380228] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-28T20:22:06.642632] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T20:22:07.180243] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-28T20:22:07.743582] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:22:07.980253] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-28T20:22:08.780234] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-28T20:22:09.293153] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T20:22:09.580240] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-28T20:22:10.122776] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-28T20:22:10.380236] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-28T20:22:10.415097] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T20:22:10.426729] [INFO ] [REMOTE ] NVT: Full fetch complete (74929 records). [2025-10-28T20:22:10.426906] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-28T20:22:10.834129] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-28T20:22:10.834206] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-28T20:22:10.835304] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-28T20:22:10.835367] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-28T20:22:10.836781] [DEBUG] [LOCAL ] NVT: Trimmed 74929 records to 51371 (keeping 200 days of data) [2025-10-28T20:22:11.147925] [DEBUG] [LOCAL ] NVT: Primary data saved (51371 records). [2025-10-28T20:22:11.148073] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-28T20:22:11.148145] [INFO ] [MAIN ] Update Progress: 1548/2366 symbols completed. NVT took 22.4s. Estimated remaining: 1h 46m 49s. Rate: 7.7 symbols/min [2025-10-28T20:22:11.190328] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-28T20:22:11.348811] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:11.403432] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T20:22:11.431210] [DEBUG] [LOCAL ] NWG: Loaded 51366 existing records from primary storage. [2025-10-28T20:22:11.431592] [INFO ] [MAIN ] NWG: Loaded 51366 existing records. [2025-10-28T20:22:11.652259] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:22:11.652477] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-28T20:22:11.652526] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-28T20:22:11.652762] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-28T20:22:11.652834] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-28T20:22:11.982107] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-28T20:22:12.129140] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:12.131503] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T20:22:12.780230] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-28T20:22:13.168351] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T20:22:13.177221] [INFO ] [REMOTE ] NVRI: Full fetch complete (55780 records). [2025-10-28T20:22:13.177383] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-28T20:22:13.571263] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-28T20:22:13.571341] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-28T20:22:13.572262] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-28T20:22:13.572324] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-28T20:22:13.573432] [DEBUG] [LOCAL ] NVRI: Trimmed 55780 records to 38512 (keeping 200 days of data) [2025-10-28T20:22:13.616747] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-28T20:22:13.788470] [DEBUG] [LOCAL ] NVRI: Primary data saved (38512 records). [2025-10-28T20:22:13.788600] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-28T20:22:13.788694] [INFO ] [MAIN ] Update Progress: 1549/2366 symbols completed. NVRI took 37.2s. Estimated remaining: 1h 46m 38s. Rate: 7.7 symbols/min [2025-10-28T20:22:13.953535] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:13.953715] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-28T20:22:13.953764] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-28T20:22:13.953873] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-28T20:22:13.953914] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-28T20:22:13.953955] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-28T20:22:13.953987] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-28T20:22:14.304534] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:14.335077] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T20:22:14.380216] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-28T20:22:14.874105] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T20:22:15.180256] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-28T20:22:15.871192] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T20:22:15.882917] [INFO ] [REMOTE ] NVS: Full fetch complete (74984 records). [2025-10-28T20:22:15.883216] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-28T20:22:15.986604] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-28T20:22:16.282169] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-28T20:22:16.282300] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-28T20:22:16.283476] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-28T20:22:16.283568] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-28T20:22:16.302526] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:22:16.312574] [DEBUG] [LOCAL ] NVS: Trimmed 74984 records to 51266 (keeping 200 days of data) [2025-10-28T20:22:16.625664] [DEBUG] [LOCAL ] NVS: Primary data saved (51266 records). [2025-10-28T20:22:16.625792] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-28T20:22:16.626132] [INFO ] [MAIN ] Update Progress: 1550/2366 symbols completed. NVS took 38.9s. Estimated remaining: 1h 46m 28s. Rate: 7.7 symbols/min [2025-10-28T20:22:16.794694] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-28T20:22:16.797441] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:16.798046] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-28T20:22:16.798758] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-28T20:22:16.798877] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-28T20:22:16.798920] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-28T20:22:16.798964] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-28T20:22:16.798996] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-28T20:22:17.158185] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:17.359697] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T20:22:17.580251] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-28T20:22:17.978531] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:22:18.380268] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-28T20:22:19.032757] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:22:19.180255] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-28T20:22:19.333256] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T20:22:19.980335] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-28T20:22:20.668865] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T20:22:20.780225] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-28T20:22:20.933687] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T20:22:21.580254] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-28T20:22:21.840686] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (10.65 seconds). [2025-10-28T20:22:22.252398] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:22:22.380298] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-28T20:22:22.460169] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T20:22:23.180293] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-28T20:22:23.607575] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T20:22:23.980315] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-28T20:22:24.782895] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-28T20:22:24.792062] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T20:22:25.046989] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T20:22:25.580280] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-28T20:22:26.380223] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-28T20:22:26.554042] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:22:26.559733] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T20:22:27.180262] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-28T20:22:27.910478] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T20:22:27.980288] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-28T20:22:28.570235] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T20:22:28.583147] [INFO ] [REMOTE ] NVST: Full fetch complete (74454 records). [2025-10-28T20:22:28.583392] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-28T20:22:28.786006] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-28T20:22:29.058870] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-28T20:22:29.058984] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-28T20:22:29.060939] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-28T20:22:29.061024] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-28T20:22:29.063490] [DEBUG] [LOCAL ] NVST: Trimmed 74454 records to 51370 (keeping 200 days of data) [2025-10-28T20:22:29.436987] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T20:22:29.468091] [DEBUG] [LOCAL ] NVST: Primary data saved (51370 records). [2025-10-28T20:22:29.468377] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-28T20:22:29.468534] [INFO ] [MAIN ] Update Progress: 1551/2366 symbols completed. NVST took 41.6s. Estimated remaining: 1h 46m 23s. Rate: 7.7 symbols/min [2025-10-28T20:22:29.582347] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-28T20:22:29.675791] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:29.685908] [DEBUG] [LOCAL ] NXC: Loaded 4001 existing records from primary storage. [2025-10-28T20:22:29.686309] [INFO ] [MAIN ] NXC: Loaded 4001 existing records. [2025-10-28T20:22:29.949042] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:22:29.949364] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-28T20:22:29.949415] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-28T20:22:29.949620] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-28T20:22:29.949707] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-28T20:22:30.389532] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-28T20:22:30.397025] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:30.437899] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T20:22:30.773553] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T20:22:31.180261] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-28T20:22:31.613661] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T20:22:31.636396] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T20:22:31.980256] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-28T20:22:32.572559] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T20:22:32.780250] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-28T20:22:33.580256] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-28T20:22:33.875894] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T20:22:34.380261] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-28T20:22:35.180250] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-28T20:22:35.222354] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T20:22:35.391458] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T20:22:35.980259] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-28T20:22:36.780233] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-28T20:22:36.936918] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T20:22:37.580244] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-28T20:22:38.380242] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-28T20:22:38.516069] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T20:22:38.520684] [INFO ] [REMOTE ] NWN: Full fetch complete (37252 records). [2025-10-28T20:22:38.520783] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-28T20:22:38.915287] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-28T20:22:38.915395] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-28T20:22:38.916296] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-28T20:22:38.916361] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-28T20:22:38.917272] [DEBUG] [LOCAL ] NWN: Trimmed 37252 records to 25982 (keeping 200 days of data) [2025-10-28T20:22:39.008959] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T20:22:39.080771] [DEBUG] [LOCAL ] NWN: Primary data saved (25982 records). [2025-10-28T20:22:39.080895] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-28T20:22:39.080968] [INFO ] [MAIN ] Update Progress: 1552/2366 symbols completed. NWN took 25.3s. Estimated remaining: 1h 46m 16s. Rate: 7.7 symbols/min [2025-10-28T20:22:39.185299] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-28T20:22:39.257587] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:39.257816] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-28T20:22:39.257862] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-28T20:22:39.257973] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-28T20:22:39.258015] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-28T20:22:39.258079] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-28T20:22:39.258141] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-28T20:22:39.628321] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:39.668949] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T20:22:39.980261] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-28T20:22:40.494833] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T20:22:40.780310] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-28T20:22:41.338828] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T20:22:41.580255] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-10-28T20:22:41.638532] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (6.46 seconds). [2025-10-28T20:22:41.796512] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:22:41.796885] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-10-28T20:22:41.796990] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:22:41.797087] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-28T20:22:41.797169] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:22:41.797264] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-28T20:22:41.797346] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-28T20:22:41.797385] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-28T20:22:41.797426] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-28T20:22:41.797508] [INFO ] [MAIN ] Update Progress: 1553/2366 symbols completed. NXDR took 2.7s. Estimated remaining: 1h 46m 5s. Rate: 7.7 symbols/min [2025-10-28T20:22:41.977915] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:41.993070] [DEBUG] [LOCAL ] NXDT: Loaded 14255 existing records from primary storage. [2025-10-28T20:22:41.993284] [INFO ] [MAIN ] NXDT: Loaded 14255 existing records. [2025-10-28T20:22:42.188563] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:22:42.188808] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-28T20:22:42.188882] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-28T20:22:42.189193] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-28T20:22:42.189251] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-28T20:22:42.380858] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-28T20:22:42.571127] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:43.180250] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-28T20:22:43.519212] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T20:22:43.814881] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T20:22:43.980235] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-28T20:22:44.780272] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-28T20:22:44.825841] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:22:45.580228] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-28T20:22:46.030160] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:22:46.389729] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-28T20:22:46.391332] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:22:46.888367] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T20:22:47.180258] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-28T20:22:47.967304] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T20:22:47.980271] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-28T20:22:48.450101] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T20:22:48.780267] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-28T20:22:49.588952] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-28T20:22:49.591068] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T20:22:49.783746] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (13.00 seconds). [2025-10-28T20:22:49.794395] [INFO ] [REMOTE ] NWG: Full fetch complete (74113 records). [2025-10-28T20:22:49.794569] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-28T20:22:50.120451] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T20:22:50.211734] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-28T20:22:50.211817] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-28T20:22:50.213060] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-28T20:22:50.213123] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-28T20:22:50.214574] [DEBUG] [LOCAL ] NWG: Trimmed 74113 records to 51335 (keeping 200 days of data) [2025-10-28T20:22:50.386231] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-28T20:22:50.525860] [DEBUG] [LOCAL ] NWG: Primary data saved (51335 records). [2025-10-28T20:22:50.526080] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-28T20:22:50.526664] [INFO ] [MAIN ] Update Progress: 1554/2366 symbols completed. NWG took 39.4s. Estimated remaining: 1h 45m 58s. Rate: 7.7 symbols/min [2025-10-28T20:22:50.694575] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:50.752286] [DEBUG] [LOCAL ] NXE: Loaded 53066 existing records from primary storage. [2025-10-28T20:22:50.753682] [INFO ] [MAIN ] NXE: Loaded 53066 existing records. [2025-10-28T20:22:50.938595] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:22:50.942793] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-28T20:22:50.942711] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T20:22:50.944463] [INFO ] [REMOTE ] NXC: Full fetch complete (5654 records). [2025-10-28T20:22:50.944375] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-28T20:22:50.944680] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-28T20:22:50.978242] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-28T20:22:51.017467] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-28T20:22:51.197871] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-28T20:22:51.606430] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-28T20:22:51.606868] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-28T20:22:51.612555] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-28T20:22:51.612637] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-28T20:22:51.646990] [DEBUG] [LOCAL ] NXC: Trimmed 5654 records to 3980 (keeping 200 days of data) [2025-10-28T20:22:51.709440] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:51.715737] [DEBUG] [LOCAL ] NXC: Primary data saved (3980 records). [2025-10-28T20:22:51.716182] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-28T20:22:51.716288] [INFO ] [MAIN ] Update Progress: 1555/2366 symbols completed. NXC took 22.2s. Estimated remaining: 1h 45m 47s. Rate: 7.7 symbols/min [2025-10-28T20:22:51.891244] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:51.903294] [DEBUG] [LOCAL ] NXG: Loaded 10298 existing records from primary storage. [2025-10-28T20:22:51.903498] [INFO ] [MAIN ] NXG: Loaded 10298 existing records. [2025-10-28T20:22:51.987731] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-28T20:22:52.103497] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:22:52.103759] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-28T20:22:52.103813] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-28T20:22:52.104056] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-28T20:22:52.104116] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-28T20:22:52.474265] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:52.560950] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:22:52.780307] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-28T20:22:53.580258] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-28T20:22:53.800384] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T20:22:54.148281] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T20:22:54.155561] [INFO ] [REMOTE ] NX: Full fetch complete (48378 records). [2025-10-28T20:22:54.155709] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-28T20:22:54.385424] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-28T20:22:54.498156] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T20:22:54.578411] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-28T20:22:54.578492] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-28T20:22:54.579531] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-28T20:22:54.579594] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-28T20:22:54.580622] [DEBUG] [LOCAL ] NX: Trimmed 48378 records to 32959 (keeping 200 days of data) [2025-10-28T20:22:54.785209] [DEBUG] [LOCAL ] NX: Primary data saved (32959 records). [2025-10-28T20:22:54.785349] [INFO ] [MAIN ] NX: Full history saved. [2025-10-28T20:22:54.785422] [INFO ] [MAIN ] Update Progress: 1556/2366 symbols completed. NX took 38.2s. Estimated remaining: 1h 45m 36s. Rate: 7.7 symbols/min [2025-10-28T20:22:54.963959] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:22:54.984762] [DEBUG] [LOCAL ] NXJ: Loaded 14487 existing records from primary storage. [2025-10-28T20:22:54.985089] [INFO ] [MAIN ] NXJ: Loaded 14487 existing records. [2025-10-28T20:22:55.185461] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-28T20:22:55.193774] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:22:55.194912] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-28T20:22:55.194985] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-28T20:22:55.195262] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-28T20:22:55.195331] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-28T20:22:55.593597] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:22:55.980249] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-28T20:22:56.266900] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T20:22:56.406361] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-28T20:22:56.780285] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-28T20:22:57.257010] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T20:22:57.548259] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T20:22:57.580449] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-28T20:22:58.281476] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T20:22:58.380301] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-28T20:22:59.027020] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T20:22:59.180245] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-28T20:22:59.980264] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-28T20:23:00.780271] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-28T20:23:01.580308] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-28T20:23:05.189105] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (6.01 seconds). [2025-10-28T20:23:05.192055] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-28T20:23:05.523401] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (4.74 seconds). [2025-10-28T20:23:05.527189] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-28T20:23:05.955371] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (5.98 seconds). [2025-10-28T20:23:05.958380] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-28T20:23:06.257634] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (4.68 seconds). [2025-10-28T20:23:06.269497] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-28T20:23:06.423933] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T20:23:06.428742] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-28T20:23:06.641316] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T20:23:06.645356] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-28T20:23:07.354182] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T20:23:07.358635] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-28T20:23:07.875717] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T20:23:07.980245] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-28T20:23:08.155241] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T20:23:08.298540] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T20:23:08.730524] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-28T20:23:08.780261] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-28T20:23:08.807105] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T20:23:09.580266] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-28T20:23:09.639122] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T20:23:09.642687] [INFO ] [REMOTE ] NXDT: Full fetch complete (23630 records). [2025-10-28T20:23:09.642811] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-28T20:23:10.052338] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-28T20:23:10.052414] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-28T20:23:10.053123] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-28T20:23:10.053184] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-28T20:23:10.054005] [DEBUG] [LOCAL ] NXDT: Trimmed 23630 records to 14178 (keeping 200 days of data) [2025-10-28T20:23:10.139973] [DEBUG] [LOCAL ] NXDT: Primary data saved (14178 records). [2025-10-28T20:23:10.140115] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-28T20:23:10.140192] [INFO ] [MAIN ] Update Progress: 1557/2366 symbols completed. NXDT took 28.3s. Estimated remaining: 1h 45m 32s. Rate: 7.7 symbols/min [2025-10-28T20:23:10.380312] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-28T20:23:11.097865] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T20:23:11.180284] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-28T20:23:11.416218] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-28T20:23:11.905914] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T20:23:11.980315] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-28T20:23:12.788985] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-28T20:23:12.794543] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T20:23:13.580276] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-28T20:23:14.233160] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T20:23:14.236308] [INFO ] [REMOTE ] NXG: Full fetch complete (14760 records). [2025-10-28T20:23:14.236391] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-28T20:23:14.385431] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-28T20:23:14.602272] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T20:23:14.674156] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-28T20:23:14.674230] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-28T20:23:14.674581] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-28T20:23:14.674622] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-28T20:23:14.675206] [DEBUG] [LOCAL ] NXG: Trimmed 14760 records to 10307 (keeping 200 days of data) [2025-10-28T20:23:14.739174] [DEBUG] [LOCAL ] NXG: Primary data saved (10307 records). [2025-10-28T20:23:14.739291] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-28T20:23:14.739365] [INFO ] [MAIN ] Update Progress: 1558/2366 symbols completed. NXG took 23.0s. Estimated remaining: 1h 45m 23s. Rate: 7.7 symbols/min [2025-10-28T20:23:15.180281] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-28T20:23:15.411989] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T20:23:15.980307] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-28T20:23:16.874437] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T20:23:16.878873] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-28T20:23:16.926898] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T20:23:17.580266] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-28T20:23:17.743032] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:23:18.380274] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-28T20:23:19.016458] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T20:23:19.039269] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T20:23:19.043992] [INFO ] [REMOTE ] NXJ: Full fetch complete (19909 records). [2025-10-28T20:23:19.044174] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-28T20:23:19.185381] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-28T20:23:19.493763] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-28T20:23:19.493924] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-28T20:23:19.494684] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-28T20:23:19.494751] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-28T20:23:19.495531] [DEBUG] [LOCAL ] NXJ: Trimmed 19909 records to 14451 (keeping 200 days of data) [2025-10-28T20:23:19.597179] [DEBUG] [LOCAL ] NXJ: Primary data saved (14451 records). [2025-10-28T20:23:19.597371] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-28T20:23:19.597540] [INFO ] [MAIN ] Update Progress: 1559/2366 symbols completed. NXJ took 24.8s. Estimated remaining: 1h 45m 13s. Rate: 7.7 symbols/min [2025-10-28T20:23:21.243807] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-28T20:23:21.264623] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-28T20:23:22.068336] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:23:22.080353] [INFO ] [REMOTE ] NXE: Full fetch complete (76581 records). [2025-10-28T20:23:22.080634] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-28T20:23:22.082173] [FATAL] [VALIDATOR ] NXE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:23:22.082294] [FATAL] [MAIN ] NXE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:23:22.082343] [WARN ] [MAIN ] NXE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:23:22.082390] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-28T20:23:22.082488] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-28T20:23:22.082533] [INFO ] [LOCAL ] NXE: Starting deletion of derivative data. [2025-10-28T20:23:22.082816] [DEBUG] [LOCAL ] NXE: Deleted derivative data file. [2025-10-28T20:23:22.083332] [INFO ] [MAIN ] Update Progress: 1560/2366 symbols completed. NXE took 31.6s. Estimated remaining: 1h 45m 3s. Rate: 7.7 symbols/min [2025-10-28T20:23:22.754620] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:22.877090] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:22.906084] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:22.906478] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-28T20:23:22.904182] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:22.907729] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-28T20:23:22.907895] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-28T20:23:22.907989] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-28T20:23:22.908746] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-28T20:23:22.908689] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-28T20:23:22.908947] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-28T20:23:22.908995] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-28T20:23:22.909128] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-28T20:23:22.909187] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-28T20:23:22.911667] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-28T20:23:22.911889] [DEBUG] [LOCAL ] NXN: Loaded 2281 existing records from primary storage. [2025-10-28T20:23:22.911975] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-28T20:23:22.912194] [INFO ] [MAIN ] NXN: Loaded 2281 existing records. [2025-10-28T20:23:23.131822] [DEBUG] [LOCAL ] NXP: Loaded 12044 existing records from primary storage. [2025-10-28T20:23:23.192054] [INFO ] [MAIN ] NXP: Loaded 12044 existing records. [2025-10-28T20:23:23.817949] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:23:23.852045] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-28T20:23:23.900141] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-28T20:23:23.960314] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-28T20:23:23.975832] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-28T20:23:24.263111] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:24.288694] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-28T20:23:24.303468] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:23:24.351139] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:24.356545] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-28T20:23:24.358363] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-28T20:23:24.369746] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-28T20:23:24.374889] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-28T20:23:24.390993] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-28T20:23:24.749943] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T20:23:24.822608] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-28T20:23:24.924904] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:24.935882] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-28T20:23:25.036283] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:25.036548] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-28T20:23:25.156541] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T20:23:25.159602] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-28T20:23:25.324031] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T20:23:25.580273] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-28T20:23:25.664714] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T20:23:25.697702] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:23:25.871204] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T20:23:26.008772] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T20:23:26.380304] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-28T20:23:26.819774] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T20:23:27.180266] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-28T20:23:27.980219] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-28T20:23:28.187059] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T20:23:28.387307] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T20:23:28.780225] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-28T20:23:29.305937] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T20:23:29.580260] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-28T20:23:30.331446] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T20:23:30.380282] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-28T20:23:31.096058] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T20:23:31.180303] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-28T20:23:31.980270] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-28T20:23:32.068996] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T20:23:32.477059] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T20:23:32.780266] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-28T20:23:33.203716] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T20:23:33.580275] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-28T20:23:33.948447] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T20:23:34.380302] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-28T20:23:34.807855] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T20:23:35.180247] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-28T20:23:35.980263] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-28T20:23:36.074300] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T20:23:36.292507] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T20:23:36.780314] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-28T20:23:37.447237] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T20:23:37.580302] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-28T20:23:37.918424] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T20:23:38.380231] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-28T20:23:39.015869] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T20:23:39.180251] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-28T20:23:39.980524] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-28T20:23:39.984073] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T20:23:40.641211] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T20:23:40.780253] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-28T20:23:41.468293] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T20:23:41.580241] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-28T20:23:42.206886] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T20:23:42.380287] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-28T20:23:43.180280] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-28T20:23:43.299888] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T20:23:43.607596] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T20:23:43.980294] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-28T20:23:44.358705] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T20:23:44.780265] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-28T20:23:45.219349] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T20:23:45.580286] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-28T20:23:45.886755] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T20:23:45.887566] [INFO ] [REMOTE ] NYC: Full fetch complete (1842 records). [2025-10-28T20:23:45.887636] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-28T20:23:46.066730] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T20:23:46.066942] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:23:46.067010] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:23:46.067097] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-28T20:23:46.067184] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-28T20:23:46.067226] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-28T20:23:46.067269] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-28T20:23:46.067331] [INFO ] [MAIN ] Update Progress: 1561/2366 symbols completed. NYC took 24.0s. Estimated remaining: 1h 45m 3s. Rate: 7.7 symbols/min [2025-10-28T20:23:46.234096] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:46.234220] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-28T20:23:46.234256] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-28T20:23:46.234388] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-28T20:23:46.234455] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-28T20:23:46.234547] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-28T20:23:46.234595] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-28T20:23:46.390867] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-28T20:23:46.594212] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:47.185514] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-28T20:23:47.191820] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T20:23:47.983430] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-28T20:23:47.987152] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T20:23:48.627939] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:23:48.780294] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-28T20:23:49.580251] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-28T20:23:49.647294] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T20:23:50.380233] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-28T20:23:50.764246] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T20:23:50.765472] [INFO ] [REMOTE ] NXN: Full fetch complete (3443 records). [2025-10-28T20:23:50.765594] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-28T20:23:50.968578] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T20:23:51.183945] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-28T20:23:51.185267] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-28T20:23:51.185354] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-28T20:23:51.185490] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-28T20:23:51.185531] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-28T20:23:51.185928] [DEBUG] [LOCAL ] NXN: Trimmed 3443 records to 2285 (keeping 200 days of data) [2025-10-28T20:23:51.200327] [DEBUG] [LOCAL ] NXN: Primary data saved (2285 records). [2025-10-28T20:23:51.200413] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-28T20:23:51.200491] [INFO ] [MAIN ] Update Progress: 1562/2366 symbols completed. NXN took 29.1s. Estimated remaining: 1h 44m 54s. Rate: 7.7 symbols/min [2025-10-28T20:23:51.369559] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:51.398408] [DEBUG] [LOCAL ] NZF: Loaded 28333 existing records from primary storage. [2025-10-28T20:23:51.398680] [INFO ] [MAIN ] NZF: Loaded 28333 existing records. [2025-10-28T20:23:51.573006] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:23:51.573232] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-28T20:23:51.573279] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-28T20:23:51.573527] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-28T20:23:51.573606] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-28T20:23:51.925090] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:51.980239] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-28T20:23:51.995606] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T20:23:52.780256] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-28T20:23:52.974468] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T20:23:53.580250] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-28T20:23:53.927993] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T20:23:54.376254] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:23:54.380207] [INFO ] [REMOTE ] NXRT: Full fetch complete (26098 records). [2025-10-28T20:23:54.380552] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-28T20:23:54.380347] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-28T20:23:54.749006] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-28T20:23:54.749084] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-28T20:23:54.749726] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-28T20:23:54.749787] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-28T20:23:54.750489] [DEBUG] [LOCAL ] NXRT: Trimmed 26098 records to 18353 (keeping 200 days of data) [2025-10-28T20:23:54.858523] [DEBUG] [LOCAL ] NXRT: Primary data saved (18353 records). [2025-10-28T20:23:54.858684] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-28T20:23:54.858802] [INFO ] [MAIN ] Update Progress: 1563/2366 symbols completed. NXRT took 32.8s. Estimated remaining: 1h 44m 44s. Rate: 7.7 symbols/min [2025-10-28T20:23:55.028135] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:55.028284] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-28T20:23:55.028321] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-28T20:23:55.028425] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-28T20:23:55.028466] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-28T20:23:55.028506] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-28T20:23:55.028537] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-28T20:23:55.185723] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-28T20:23:55.394007] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:55.413597] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T20:23:55.980276] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-28T20:23:56.063023] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T20:23:56.067340] [INFO ] [REMOTE ] NXP: Full fetch complete (17010 records). [2025-10-28T20:23:56.067497] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-28T20:23:56.437661] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-28T20:23:56.437746] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-28T20:23:56.438116] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-28T20:23:56.438156] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-28T20:23:56.438892] [DEBUG] [LOCAL ] NXP: Trimmed 17010 records to 12023 (keeping 200 days of data) [2025-10-28T20:23:56.512283] [DEBUG] [LOCAL ] NXP: Primary data saved (12023 records). [2025-10-28T20:23:56.512414] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-28T20:23:56.512491] [INFO ] [MAIN ] Update Progress: 1564/2366 symbols completed. NXP took 34.4s. Estimated remaining: 1h 44m 33s. Rate: 7.7 symbols/min [2025-10-28T20:23:56.687524] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:23:56.735916] [DEBUG] [LOCAL ] OBDC: Loaded 51713 existing records from primary storage. [2025-10-28T20:23:56.736236] [INFO ] [MAIN ] OBDC: Loaded 51713 existing records. [2025-10-28T20:23:56.790309] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-28T20:23:56.915063] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:23:56.915285] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-28T20:23:56.915333] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-28T20:23:56.915891] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-28T20:23:56.915947] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-28T20:23:57.258875] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:23:57.580299] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-28T20:23:57.903284] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T20:23:58.380284] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-28T20:23:58.473842] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-28T20:23:59.018205] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T20:23:59.180240] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-28T20:23:59.699117] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T20:23:59.980250] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-28T20:24:00.780255] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-28T20:24:01.091278] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-28T20:24:01.589582] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-28T20:24:01.595380] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T20:24:02.240530] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T20:24:02.380249] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-28T20:24:02.810082] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T20:24:03.180247] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-28T20:24:03.914295] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T20:24:03.980211] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-28T20:24:04.780305] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-28T20:24:05.580229] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-28T20:24:05.615664] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T20:24:05.657744] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-28T20:24:06.264734] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T20:24:06.380312] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-28T20:24:06.599703] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T20:24:07.180263] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-28T20:24:07.980251] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-28T20:24:08.110719] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T20:24:08.684485] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-28T20:24:08.780255] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-28T20:24:09.580249] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-28T20:24:09.641056] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T20:24:09.911815] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:24:10.380256] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-28T20:24:11.180255] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-28T20:24:11.481333] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T20:24:11.980259] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-28T20:24:12.138833] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-28T20:24:12.784837] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-28T20:24:12.790960] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T20:24:13.432797] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T20:24:13.580311] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-28T20:24:14.000244] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:24:14.380266] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-28T20:24:15.180249] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-28T20:24:15.385542] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T20:24:15.391538] [INFO ] [REMOTE ] NZF: Full fetch complete (41944 records). [2025-10-28T20:24:15.391700] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-28T20:24:15.774893] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-28T20:24:15.775110] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-28T20:24:15.776071] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-28T20:24:15.776218] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-28T20:24:15.777137] [DEBUG] [LOCAL ] NZF: Trimmed 41944 records to 28206 (keeping 200 days of data) [2025-10-28T20:24:15.986262] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-28T20:24:15.990025] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-28T20:24:15.991590] [DEBUG] [LOCAL ] NZF: Primary data saved (28206 records). [2025-10-28T20:24:16.002276] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-28T20:24:16.002833] [INFO ] [MAIN ] Update Progress: 1565/2366 symbols completed. NZF took 24.8s. Estimated remaining: 1h 44m 31s. Rate: 7.7 symbols/min [2025-10-28T20:24:16.176467] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:16.192383] [DEBUG] [LOCAL ] OBK: Loaded 16241 existing records from primary storage. [2025-10-28T20:24:16.192604] [INFO ] [MAIN ] OBK: Loaded 16241 existing records. [2025-10-28T20:24:16.378068] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:24:16.378342] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-28T20:24:16.378392] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-28T20:24:16.378669] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-28T20:24:16.378731] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-28T20:24:16.739772] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:16.775029] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:24:16.785464] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-28T20:24:17.580213] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-28T20:24:17.754863] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T20:24:17.858291] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T20:24:18.380318] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-28T20:24:19.131067] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T20:24:19.180544] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-28T20:24:19.904055] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T20:24:19.980310] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-28T20:24:20.759822] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T20:24:20.780228] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-28T20:24:21.504414] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T20:24:21.580289] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-28T20:24:22.115981] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T20:24:22.126320] [INFO ] [REMOTE ] NYT: Full fetch complete (72140 records). [2025-10-28T20:24:22.126518] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-28T20:24:22.384762] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-28T20:24:22.597529] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T20:24:22.602259] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-28T20:24:22.606413] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-28T20:24:22.608982] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-28T20:24:22.609086] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-28T20:24:22.611782] [DEBUG] [LOCAL ] NYT: Trimmed 72140 records to 49242 (keeping 200 days of data) [2025-10-28T20:24:22.971380] [DEBUG] [LOCAL ] NYT: Primary data saved (49242 records). [2025-10-28T20:24:22.971667] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-28T20:24:22.971824] [INFO ] [MAIN ] Update Progress: 1566/2366 symbols completed. NYT took 36.9s. Estimated remaining: 1h 44m 23s. Rate: 7.7 symbols/min [2025-10-28T20:24:23.160067] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:23.160325] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-28T20:24:23.160362] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-28T20:24:23.160491] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-28T20:24:23.160533] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-28T20:24:23.160573] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-28T20:24:23.160606] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-28T20:24:23.185437] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-28T20:24:23.576093] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:23.980318] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-28T20:24:24.780315] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-28T20:24:24.810171] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T20:24:24.965258] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-28T20:24:25.017394] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T20:24:25.028998] [INFO ] [REMOTE ] OBDC: Full fetch complete (75423 records). [2025-10-28T20:24:25.029225] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-28T20:24:25.435679] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-28T20:24:25.435812] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-28T20:24:25.437745] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-28T20:24:25.437821] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-28T20:24:25.439969] [DEBUG] [LOCAL ] OBDC: Trimmed 75423 records to 51706 (keeping 200 days of data) [2025-10-28T20:24:25.580306] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-28T20:24:25.804486] [DEBUG] [LOCAL ] OBDC: Primary data saved (51706 records). [2025-10-28T20:24:25.804776] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-28T20:24:25.804893] [INFO ] [MAIN ] Update Progress: 1567/2366 symbols completed. OBDC took 29.3s. Estimated remaining: 1h 44m 13s. Rate: 7.7 symbols/min [2025-10-28T20:24:25.995391] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:26.028434] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T20:24:26.042174] [DEBUG] [LOCAL ] OCFT: Loaded 6857 existing records from primary storage. [2025-10-28T20:24:26.042517] [INFO ] [MAIN ] OCFT: Loaded 6857 existing records. [2025-10-28T20:24:26.238442] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:24:26.238789] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-28T20:24:26.238869] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-28T20:24:26.239085] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-28T20:24:26.239129] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-28T20:24:26.394147] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-28T20:24:26.634498] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:26.652142] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T20:24:27.180274] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-28T20:24:27.669750] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T20:24:27.944517] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:24:27.980235] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-28T20:24:28.780292] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-28T20:24:29.444059] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T20:24:29.580252] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-28T20:24:29.713343] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T20:24:30.362380] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T20:24:30.380219] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-28T20:24:30.980922] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T20:24:31.180282] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-28T20:24:31.774388] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T20:24:31.980304] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-28T20:24:32.634010] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T20:24:32.780257] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-28T20:24:33.580278] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-28T20:24:34.380280] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-28T20:24:35.098867] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T20:24:35.180223] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-28T20:24:35.980255] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-28T20:24:36.595292] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-28T20:24:36.657549] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T20:24:36.715765] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T20:24:36.780213] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-28T20:24:36.946042] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (4.17 seconds). [2025-10-28T20:24:37.580251] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-28T20:24:38.256439] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T20:24:38.281718] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T20:24:38.380217] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-28T20:24:39.180260] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-28T20:24:39.847266] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T20:24:39.980235] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-28T20:24:40.544087] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T20:24:40.780258] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-28T20:24:41.435812] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-28T20:24:41.580233] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-28T20:24:41.631114] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T20:24:42.008282] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T20:24:42.009588] [INFO ] [REMOTE ] OCFT: Full fetch complete (11781 records). [2025-10-28T20:24:42.009681] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-28T20:24:42.383712] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-28T20:24:42.383932] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-28T20:24:42.385086] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-28T20:24:42.385416] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-28T20:24:42.385488] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-28T20:24:42.386318] [DEBUG] [LOCAL ] OCFT: Trimmed 11781 records to 6842 (keeping 200 days of data) [2025-10-28T20:24:42.424394] [DEBUG] [LOCAL ] OCFT: Primary data saved (6842 records). [2025-10-28T20:24:42.424512] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-28T20:24:42.424699] [INFO ] [MAIN ] Update Progress: 1568/2366 symbols completed. OCFT took 16.6s. Estimated remaining: 1h 44m 9s. Rate: 7.7 symbols/min [2025-10-28T20:24:42.594526] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:42.604939] [DEBUG] [LOCAL ] ODC: Loaded 8637 existing records from primary storage. [2025-10-28T20:24:42.605166] [INFO ] [MAIN ] ODC: Loaded 8637 existing records. [2025-10-28T20:24:42.781002] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:24:42.781244] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-28T20:24:42.781291] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-28T20:24:42.781493] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-28T20:24:42.781532] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-28T20:24:43.140683] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:43.164441] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T20:24:43.180201] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-28T20:24:43.827368] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T20:24:43.980268] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-28T20:24:44.780238] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-28T20:24:45.392461] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T20:24:45.580288] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-28T20:24:46.381536] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-28T20:24:46.384751] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-28T20:24:46.396871] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:24:46.401046] [INFO ] [REMOTE ] O: Full fetch complete (77572 records). [2025-10-28T20:24:46.401593] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-28T20:24:46.601411] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:24:46.602182] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:24:46.602254] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:24:46.602304] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-28T20:24:46.602360] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-28T20:24:46.602394] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-28T20:24:46.602432] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-28T20:24:46.602492] [INFO ] [MAIN ] Update Progress: 1569/2366 symbols completed. O took 51.7s. Estimated remaining: 1h 43m 60s. Rate: 7.7 symbols/min [2025-10-28T20:24:46.770938] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:46.798691] [DEBUG] [LOCAL ] ODV: Loaded 30457 existing records from primary storage. [2025-10-28T20:24:46.798978] [INFO ] [MAIN ] ODV: Loaded 30457 existing records. [2025-10-28T20:24:46.976480] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:24:46.976802] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-28T20:24:46.976854] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-28T20:24:46.977194] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-28T20:24:46.977254] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-28T20:24:47.185457] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-28T20:24:47.329698] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:47.686444] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T20:24:47.843008] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T20:24:47.980250] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-28T20:24:48.654383] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T20:24:48.780245] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-28T20:24:49.437335] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T20:24:49.580250] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-28T20:24:50.172766] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T20:24:50.380248] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-28T20:24:51.180266] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-28T20:24:51.865810] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T20:24:51.980286] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-28T20:24:52.780262] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-28T20:24:53.281381] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (2.90 seconds). [2025-10-28T20:24:53.287763] [INFO ] [REMOTE ] OBK: Full fetch complete (24026 records). [2025-10-28T20:24:53.288011] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-28T20:24:53.469751] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T20:24:53.585459] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-28T20:24:53.723000] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T20:24:53.743744] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-28T20:24:53.744239] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-28T20:24:53.745124] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-28T20:24:53.745238] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-28T20:24:53.746391] [DEBUG] [LOCAL ] OBK: Trimmed 24026 records to 16242 (keeping 200 days of data) [2025-10-28T20:24:53.845205] [DEBUG] [LOCAL ] OBK: Primary data saved (16242 records). [2025-10-28T20:24:53.845329] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-28T20:24:53.845407] [INFO ] [MAIN ] Update Progress: 1570/2366 symbols completed. OBK took 37.8s. Estimated remaining: 1h 43m 52s. Rate: 7.7 symbols/min [2025-10-28T20:24:54.012338] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:54.046392] [DEBUG] [LOCAL ] OEC: Loaded 36893 existing records from primary storage. [2025-10-28T20:24:54.046687] [INFO ] [MAIN ] OEC: Loaded 36893 existing records. [2025-10-28T20:24:54.243083] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:24:54.243291] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-28T20:24:54.243338] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-28T20:24:54.243781] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-28T20:24:54.243840] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-28T20:24:54.384101] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-28T20:24:54.551839] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:24:54.620461] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:55.180277] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-28T20:24:55.786121] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T20:24:55.796001] [INFO ] [REMOTE ] OC: Full fetch complete (65022 records). [2025-10-28T20:24:55.796148] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-28T20:24:55.927529] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:24:55.985465] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-28T20:24:56.197254] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-28T20:24:56.197324] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-28T20:24:56.198286] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-28T20:24:56.198347] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-28T20:24:56.199595] [DEBUG] [LOCAL ] OC: Trimmed 65022 records to 44627 (keeping 200 days of data) [2025-10-28T20:24:56.468871] [DEBUG] [LOCAL ] OC: Primary data saved (44627 records). [2025-10-28T20:24:56.468994] [INFO ] [MAIN ] OC: Full history saved. [2025-10-28T20:24:56.469063] [INFO ] [MAIN ] Update Progress: 1571/2366 symbols completed. OC took 33.5s. Estimated remaining: 1h 43m 41s. Rate: 7.7 symbols/min [2025-10-28T20:24:56.634777] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:24:56.634934] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-28T20:24:56.634989] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-28T20:24:56.635116] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-28T20:24:56.635159] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-28T20:24:56.635202] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-28T20:24:56.635234] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-28T20:24:56.788372] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-28T20:24:56.942053] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T20:24:57.010012] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:24:57.580241] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-28T20:24:57.621436] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T20:24:58.380334] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-28T20:24:58.619462] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T20:24:59.180220] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-28T20:24:59.329102] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T20:24:59.980251] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-28T20:25:00.210965] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T20:25:00.780226] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-28T20:25:00.916492] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T20:25:01.580310] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-28T20:25:01.691857] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T20:25:02.380246] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-28T20:25:02.540365] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T20:25:03.180246] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-28T20:25:03.442056] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T20:25:03.803813] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T20:25:03.980254] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-28T20:25:04.780231] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-28T20:25:04.911838] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T20:25:05.580338] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-28T20:25:05.637285] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T20:25:06.380455] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-28T20:25:06.570498] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T20:25:06.933938] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:25:07.180289] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-28T20:25:07.888395] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T20:25:07.891064] [INFO ] [REMOTE ] ODC: Full fetch complete (11537 records). [2025-10-28T20:25:07.891151] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-28T20:25:07.988532] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-28T20:25:08.260513] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-28T20:25:08.260589] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-28T20:25:08.260864] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-28T20:25:08.260926] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-28T20:25:08.261405] [DEBUG] [LOCAL ] ODC: Trimmed 11537 records to 8632 (keeping 200 days of data) [2025-10-28T20:25:08.315042] [DEBUG] [LOCAL ] ODC: Primary data saved (8632 records). [2025-10-28T20:25:08.315191] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-28T20:25:08.315275] [INFO ] [MAIN ] Update Progress: 1572/2366 symbols completed. ODC took 25.9s. Estimated remaining: 1h 43m 35s. Rate: 7.7 symbols/min [2025-10-28T20:25:08.488081] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:08.488246] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-28T20:25:08.488283] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-28T20:25:08.488391] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-28T20:25:08.488431] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-28T20:25:08.488470] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-28T20:25:08.488503] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-28T20:25:08.785381] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-28T20:25:08.853612] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:08.899909] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T20:25:09.580314] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-28T20:25:09.817150] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T20:25:10.380284] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-28T20:25:10.903938] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T20:25:11.180281] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-28T20:25:11.304768] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T20:25:11.980287] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-28T20:25:12.508951] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T20:25:12.780265] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-28T20:25:13.012672] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T20:25:13.580272] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-28T20:25:14.102436] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T20:25:14.380318] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-28T20:25:14.997348] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T20:25:15.007254] [INFO ] [REMOTE ] ODV: Full fetch complete (37132 records). [2025-10-28T20:25:15.007377] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-28T20:25:15.188623] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-28T20:25:15.383059] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-28T20:25:15.383134] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-28T20:25:15.383878] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-28T20:25:15.383937] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-28T20:25:15.384767] [DEBUG] [LOCAL ] ODV: Trimmed 37132 records to 30679 (keeping 200 days of data) [2025-10-28T20:25:15.552156] [DEBUG] [LOCAL ] ODV: Primary data saved (30679 records). [2025-10-28T20:25:15.552291] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-28T20:25:15.552368] [INFO ] [MAIN ] Update Progress: 1573/2366 symbols completed. ODV took 28.9s. Estimated remaining: 1h 43m 27s. Rate: 7.7 symbols/min [2025-10-28T20:25:15.721419] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:15.721802] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-28T20:25:15.721855] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-28T20:25:15.721959] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-28T20:25:15.722000] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-28T20:25:15.722039] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-28T20:25:15.722070] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-28T20:25:15.981880] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-28T20:25:16.093587] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:16.123103] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T20:25:16.186200] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T20:25:16.780266] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-28T20:25:17.375106] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T20:25:17.580273] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-28T20:25:18.149859] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T20:25:18.216515] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T20:25:18.220932] [INFO ] [REMOTE ] OFG: Full fetch complete (33420 records). [2025-10-28T20:25:18.221046] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-28T20:25:18.390782] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-28T20:25:18.591418] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-28T20:25:18.591493] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-28T20:25:18.592168] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-28T20:25:18.592226] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-28T20:25:18.592950] [DEBUG] [LOCAL ] OFG: Trimmed 33420 records to 20280 (keeping 200 days of data) [2025-10-28T20:25:18.712716] [DEBUG] [LOCAL ] OFG: Primary data saved (20280 records). [2025-10-28T20:25:18.712836] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-28T20:25:18.712900] [INFO ] [MAIN ] Update Progress: 1574/2366 symbols completed. OFG took 22.2s. Estimated remaining: 1h 43m 17s. Rate: 7.7 symbols/min [2025-10-28T20:25:18.880945] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:18.881109] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-28T20:25:18.881159] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-28T20:25:18.881281] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-28T20:25:18.881322] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-28T20:25:18.881361] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-28T20:25:18.881392] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-28T20:25:19.185353] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-28T20:25:19.239747] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:19.669381] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T20:25:19.980259] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-28T20:25:20.780274] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-28T20:25:20.843212] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-28T20:25:21.254248] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T20:25:21.580305] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-28T20:25:22.193299] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T20:25:22.380253] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-28T20:25:22.934933] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T20:25:23.180270] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-28T20:25:23.934972] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:25:23.980254] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-28T20:25:24.526921] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T20:25:24.780309] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-28T20:25:24.840856] [DEBUG] [REMOTE ] OEC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-28T20:25:24.841183] [WARN ] [REMOTE ] OEC: No data returned for month 2025-06 [2025-10-28T20:25:24.841270] [FATAL] [REMOTE ] OEC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:25:24.841379] [FATAL] [MAIN ] OEC: Failed to fetch primary data. [2025-10-28T20:25:24.841458] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:25:24.841538] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-28T20:25:24.841616] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-28T20:25:24.841702] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-28T20:25:24.841973] [DEBUG] [LOCAL ] OEC: Deleted derivative data file. [2025-10-28T20:25:24.842073] [INFO ] [MAIN ] Update Progress: 1575/2366 symbols completed. OEC took 31.0s. Estimated remaining: 1h 43m 8s. Rate: 7.7 symbols/min [2025-10-28T20:25:25.023879] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:25.024096] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-28T20:25:25.024193] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-28T20:25:25.024319] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-28T20:25:25.024387] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-28T20:25:25.024493] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-28T20:25:25.024563] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-28T20:25:25.400395] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:25.494512] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T20:25:25.580246] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-28T20:25:26.380300] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-28T20:25:27.180233] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-28T20:25:27.238121] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T20:25:27.814036] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T20:25:27.980280] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-28T20:25:28.701363] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:25:28.780228] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-28T20:25:29.165882] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T20:25:29.580246] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-28T20:25:30.385426] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-28T20:25:30.416395] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T20:25:30.909032] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T20:25:31.180266] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-28T20:25:31.876999] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T20:25:31.980311] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-28T20:25:32.495405] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T20:25:32.780263] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-28T20:25:33.087984] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T20:25:33.580248] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-28T20:25:34.370784] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T20:25:34.381760] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-28T20:25:34.831447] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T20:25:34.840619] [INFO ] [REMOTE ] OGE: Full fetch complete (66862 records). [2025-10-28T20:25:34.840778] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-28T20:25:35.203326] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-28T20:25:35.225158] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-28T20:25:35.225242] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-28T20:25:35.226422] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-28T20:25:35.226486] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-28T20:25:35.227831] [DEBUG] [LOCAL ] OGE: Trimmed 66862 records to 45627 (keeping 200 days of data) [2025-10-28T20:25:35.502980] [DEBUG] [LOCAL ] OGE: Primary data saved (45627 records). [2025-10-28T20:25:35.503122] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-28T20:25:35.503192] [INFO ] [MAIN ] Update Progress: 1576/2366 symbols completed. OGE took 27.2s. Estimated remaining: 1h 43m 2s. Rate: 7.7 symbols/min [2025-10-28T20:25:35.674780] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:35.674939] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-28T20:25:35.674975] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-28T20:25:35.675079] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-28T20:25:35.675119] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-28T20:25:35.675159] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-28T20:25:35.675189] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-28T20:25:35.988700] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-28T20:25:36.028843] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:36.680602] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T20:25:36.780229] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-28T20:25:37.098156] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T20:25:37.580263] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-28T20:25:38.363824] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T20:25:38.380211] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-28T20:25:38.662356] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T20:25:39.180219] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-28T20:25:39.868445] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T20:25:39.980275] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-28T20:25:40.385343] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T20:25:40.780274] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-28T20:25:41.220770] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T20:25:41.532916] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (7.15 seconds). [2025-10-28T20:25:41.580247] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-28T20:25:42.176982] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T20:25:42.380274] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-28T20:25:43.017386] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T20:25:43.180253] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-28T20:25:43.412002] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T20:25:43.980252] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-28T20:25:44.689823] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T20:25:44.780261] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-28T20:25:45.200070] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T20:25:45.580261] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-28T20:25:45.984769] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T20:25:46.380255] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-28T20:25:47.180231] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-28T20:25:47.370990] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T20:25:47.381885] [INFO ] [REMOTE ] OGN: Full fetch complete (76939 records). [2025-10-28T20:25:47.382017] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-28T20:25:47.794860] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-28T20:25:47.795041] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-28T20:25:47.796352] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-28T20:25:47.796503] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-28T20:25:47.798090] [DEBUG] [LOCAL ] OGN: Trimmed 76939 records to 53104 (keeping 200 days of data) [2025-10-28T20:25:47.993289] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-28T20:25:48.054937] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T20:25:48.178192] [DEBUG] [LOCAL ] OGN: Primary data saved (53104 records). [2025-10-28T20:25:48.178316] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-28T20:25:48.178383] [INFO ] [MAIN ] Update Progress: 1577/2366 symbols completed. OGN took 32.6s. Estimated remaining: 1h 42m 57s. Rate: 7.7 symbols/min [2025-10-28T20:25:48.352542] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:48.374418] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T20:25:48.390450] [DEBUG] [LOCAL ] OIA: Loaded 12749 existing records from primary storage. [2025-10-28T20:25:48.390682] [INFO ] [MAIN ] OIA: Loaded 12749 existing records. [2025-10-28T20:25:48.566541] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:25:48.566814] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-28T20:25:48.566873] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-28T20:25:48.567170] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-28T20:25:48.567238] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-28T20:25:48.788219] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-28T20:25:48.926956] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:49.560709] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T20:25:49.580267] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-28T20:25:50.070223] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:25:50.309691] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:25:50.380226] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-28T20:25:51.180264] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-28T20:25:51.218253] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T20:25:51.980253] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-28T20:25:52.785362] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-28T20:25:52.802278] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T20:25:53.356682] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:25:53.580265] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-28T20:25:53.831976] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T20:25:53.837848] [INFO ] [REMOTE ] OGS: Full fetch complete (47935 records). [2025-10-28T20:25:53.837950] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-28T20:25:54.266101] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-28T20:25:54.266181] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-28T20:25:54.267053] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-28T20:25:54.267116] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-28T20:25:54.268188] [DEBUG] [LOCAL ] OGS: Trimmed 47935 records to 33598 (keeping 200 days of data) [2025-10-28T20:25:54.381825] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-28T20:25:54.483951] [DEBUG] [LOCAL ] OGS: Primary data saved (33598 records). [2025-10-28T20:25:54.484138] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-28T20:25:54.484235] [INFO ] [MAIN ] Update Progress: 1578/2366 symbols completed. OGS took 35.8s. Estimated remaining: 1h 42m 48s. Rate: 7.7 symbols/min [2025-10-28T20:25:54.657521] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:54.657823] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-28T20:25:54.658023] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-28T20:25:54.658246] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-28T20:25:54.658316] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-28T20:25:54.658466] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-28T20:25:54.658562] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-28T20:25:54.866095] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T20:25:55.075362] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:55.180245] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-28T20:25:55.980222] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-28T20:25:56.053245] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T20:25:56.063578] [INFO ] [REMOTE ] OHI: Full fetch complete (75253 records). [2025-10-28T20:25:56.063733] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-28T20:25:56.466705] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-28T20:25:56.466868] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-28T20:25:56.468184] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-28T20:25:56.468267] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-28T20:25:56.469866] [DEBUG] [LOCAL ] OHI: Trimmed 75253 records to 51753 (keeping 200 days of data) [2025-10-28T20:25:56.593951] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T20:25:56.633613] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T20:25:56.786209] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-28T20:25:56.828141] [DEBUG] [LOCAL ] OHI: Primary data saved (51753 records). [2025-10-28T20:25:56.828252] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-28T20:25:56.828320] [INFO ] [MAIN ] Update Progress: 1579/2366 symbols completed. OHI took 32.0s. Estimated remaining: 1h 42m 37s. Rate: 7.7 symbols/min [2025-10-28T20:25:56.995093] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:25:57.030997] [DEBUG] [LOCAL ] OIS: Loaded 39608 existing records from primary storage. [2025-10-28T20:25:57.031283] [INFO ] [MAIN ] OIS: Loaded 39608 existing records. [2025-10-28T20:25:57.208724] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:25:57.208956] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-28T20:25:57.209063] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-28T20:25:57.209586] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-28T20:25:57.209689] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-28T20:25:57.584346] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-28T20:25:57.589049] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:25:57.600579] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T20:25:58.380292] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-28T20:25:58.695609] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T20:25:59.180308] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-28T20:25:59.834108] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T20:25:59.968913] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:25:59.980213] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-28T20:26:00.780248] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-28T20:26:01.347969] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T20:26:01.580298] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-28T20:26:02.068695] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T20:26:02.380257] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-28T20:26:02.773635] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T20:26:03.124357] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T20:26:03.180283] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-28T20:26:03.872418] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T20:26:03.980284] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-28T20:26:04.780225] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-28T20:26:04.856785] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:26:05.580315] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-28T20:26:05.683038] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T20:26:06.380226] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-28T20:26:06.849513] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T20:26:07.158627] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T20:26:07.180219] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-28T20:26:07.893299] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T20:26:07.895767] [INFO ] [REMOTE ] OIA: Full fetch complete (19945 records). [2025-10-28T20:26:07.895844] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-28T20:26:07.985430] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-28T20:26:08.280008] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-28T20:26:08.280112] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-28T20:26:08.280528] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-28T20:26:08.280567] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-28T20:26:08.281110] [DEBUG] [LOCAL ] OIA: Trimmed 19945 records to 12659 (keeping 200 days of data) [2025-10-28T20:26:08.353182] [DEBUG] [LOCAL ] OIA: Primary data saved (12659 records). [2025-10-28T20:26:08.353302] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-28T20:26:08.353376] [INFO ] [MAIN ] Update Progress: 1580/2366 symbols completed. OIA took 20.2s. Estimated remaining: 1h 42m 31s. Rate: 7.7 symbols/min [2025-10-28T20:26:08.534409] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:08.534676] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-28T20:26:08.534732] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-28T20:26:08.534849] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-28T20:26:08.534926] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-28T20:26:08.535025] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-28T20:26:08.535108] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-28T20:26:08.789330] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-28T20:26:08.942922] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:09.410498] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T20:26:09.421406] [INFO ] [REMOTE ] OI: Full fetch complete (68183 records). [2025-10-28T20:26:09.421548] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-28T20:26:09.585979] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-28T20:26:09.866738] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-28T20:26:09.866828] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-28T20:26:09.868102] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-28T20:26:09.868175] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-28T20:26:09.869527] [DEBUG] [LOCAL ] OI: Trimmed 68183 records to 46799 (keeping 200 days of data) [2025-10-28T20:26:10.161539] [DEBUG] [LOCAL ] OI: Primary data saved (46799 records). [2025-10-28T20:26:10.161691] [INFO ] [MAIN ] OI: Full history saved. [2025-10-28T20:26:10.161787] [INFO ] [MAIN ] Update Progress: 1581/2366 symbols completed. OI took 34.7s. Estimated remaining: 1h 42m 21s. Rate: 7.7 symbols/min [2025-10-28T20:26:10.351038] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:10.381024] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-28T20:26:10.384310] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T20:26:10.439387] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-10-28T20:26:10.439718] [INFO ] [MAIN ] OKLO: Loaded 53819 existing records. [2025-10-28T20:26:10.609673] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:26:10.609925] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-28T20:26:10.609973] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-28T20:26:10.610503] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-10-28T20:26:10.610561] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-28T20:26:10.950526] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:11.180270] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-28T20:26:11.376304] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T20:26:11.686557] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T20:26:11.980259] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-28T20:26:12.780401] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-28T20:26:13.143453] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-28T20:26:13.329381] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T20:26:13.580299] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-28T20:26:14.380279] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-28T20:26:14.444256] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T20:26:15.180304] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-28T20:26:15.680496] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T20:26:15.747936] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-28T20:26:15.980267] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-28T20:26:16.337050] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T20:26:16.780276] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-28T20:26:17.580288] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-28T20:26:17.984638] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:26:18.108041] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-28T20:26:18.380234] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-28T20:26:19.180237] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-28T20:26:19.677025] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T20:26:19.980234] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-28T20:26:20.780330] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-28T20:26:21.313854] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-28T20:26:21.354507] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T20:26:21.580240] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-28T20:26:22.007349] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T20:26:22.380256] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-28T20:26:23.153998] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (5.57 seconds). [2025-10-28T20:26:23.180244] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-28T20:26:23.710189] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T20:26:23.980266] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-28T20:26:24.239389] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-28T20:26:24.607564] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T20:26:24.780270] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-28T20:26:25.580229] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-28T20:26:25.701290] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T20:26:26.151251] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T20:26:26.159442] [INFO ] [REMOTE ] OII: Full fetch complete (61740 records). [2025-10-28T20:26:26.159545] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-28T20:26:26.385677] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-28T20:26:26.548871] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-28T20:26:26.548952] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-28T20:26:26.550032] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-28T20:26:26.550095] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-28T20:26:26.551344] [DEBUG] [LOCAL ] OII: Trimmed 61740 records to 41572 (keeping 200 days of data) [2025-10-28T20:26:26.816157] [DEBUG] [LOCAL ] OII: Primary data saved (41572 records). [2025-10-28T20:26:26.816315] [INFO ] [MAIN ] OII: Full history saved. [2025-10-28T20:26:26.816432] [INFO ] [MAIN ] Update Progress: 1582/2366 symbols completed. OII took 32.3s. Estimated remaining: 1h 42m 17s. Rate: 7.7 symbols/min [2025-10-28T20:26:26.998330] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:26.998504] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-28T20:26:26.998543] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-28T20:26:26.998684] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-28T20:26:26.998740] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-28T20:26:26.998783] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-28T20:26:26.998816] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-28T20:26:27.202562] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-28T20:26:27.349202] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:27.624875] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-28T20:26:27.980227] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-28T20:26:28.101165] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T20:26:28.550755] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T20:26:28.780289] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-28T20:26:29.509526] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T20:26:29.580252] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-28T20:26:30.380250] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-28T20:26:30.453905] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T20:26:30.978743] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T20:26:31.180296] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-28T20:26:31.980390] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-28T20:26:32.572559] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-28T20:26:32.780229] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-28T20:26:33.021513] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-28T20:26:33.580228] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-28T20:26:33.976176] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T20:26:34.380438] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-28T20:26:35.180296] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-28T20:26:35.462068] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T20:26:35.980285] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-28T20:26:36.291294] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-28T20:26:36.616757] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T20:26:36.780237] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-28T20:26:37.179342] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T20:26:37.187193] [INFO ] [REMOTE ] OIS: Full fetch complete (57451 records). [2025-10-28T20:26:37.187330] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-28T20:26:37.565230] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-28T20:26:37.565308] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-28T20:26:37.566285] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-28T20:26:37.566347] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-28T20:26:37.567467] [DEBUG] [LOCAL ] OIS: Trimmed 57451 records to 39512 (keeping 200 days of data) [2025-10-28T20:26:37.611024] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-28T20:26:37.792203] [DEBUG] [LOCAL ] OIS: Primary data saved (39512 records). [2025-10-28T20:26:37.792370] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-28T20:26:37.792462] [INFO ] [MAIN ] Update Progress: 1583/2366 symbols completed. OIS took 41.0s. Estimated remaining: 1h 42m 11s. Rate: 7.7 symbols/min [2025-10-28T20:26:37.961172] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:37.972388] [DEBUG] [LOCAL ] OLP: Loaded 9975 existing records from primary storage. [2025-10-28T20:26:37.972612] [INFO ] [MAIN ] OLP: Loaded 9975 existing records. [2025-10-28T20:26:38.154424] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:26:38.154945] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-28T20:26:38.155109] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-28T20:26:38.155443] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-28T20:26:38.155524] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-28T20:26:38.557858] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:38.562872] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-28T20:26:38.568560] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T20:26:39.180263] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-28T20:26:39.216989] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T20:26:39.980282] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-28T20:26:40.099837] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (8.12 seconds). [2025-10-28T20:26:40.299409] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-28T20:26:40.698260] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:26:40.754417] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T20:26:40.766463] [INFO ] [REMOTE ] OKE: Full fetch complete (77688 records). [2025-10-28T20:26:40.766818] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-28T20:26:40.785504] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-28T20:26:41.228089] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-28T20:26:41.228199] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-28T20:26:41.229514] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-28T20:26:41.229589] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-28T20:26:41.231215] [DEBUG] [LOCAL ] OKE: Trimmed 77688 records to 53576 (keeping 200 days of data) [2025-10-28T20:26:41.582167] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-28T20:26:41.592238] [DEBUG] [LOCAL ] OKE: Primary data saved (53576 records). [2025-10-28T20:26:41.592370] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-28T20:26:41.592446] [INFO ] [MAIN ] Update Progress: 1584/2366 symbols completed. OKE took 33.2s. Estimated remaining: 1h 42m 1s. Rate: 7.7 symbols/min [2025-10-28T20:26:41.769873] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:41.770050] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-28T20:26:41.770086] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-28T20:26:41.770190] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-28T20:26:41.770230] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-28T20:26:41.770270] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-28T20:26:41.770301] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-28T20:26:42.127223] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:42.282281] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:26:42.292592] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-28T20:26:42.292757] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-28T20:26:42.293450] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:26:42.293533] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:26:42.293575] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:26:42.293660] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-28T20:26:42.293740] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-28T20:26:42.293777] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-28T20:26:42.293983] [DEBUG] [LOCAL ] OKLO: Deleted derivative data file. [2025-10-28T20:26:42.294071] [INFO ] [MAIN ] Update Progress: 1585/2366 symbols completed. OKLO took 32.1s. Estimated remaining: 1h 41m 50s. Rate: 7.7 symbols/min [2025-10-28T20:26:42.384712] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-28T20:26:42.466987] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:42.502028] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T20:26:42.546223] [DEBUG] [LOCAL ] OMF: Loaded 46368 existing records from primary storage. [2025-10-28T20:26:42.546542] [INFO ] [MAIN ] OMF: Loaded 46368 existing records. [2025-10-28T20:26:42.727935] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:26:42.728155] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-28T20:26:42.728202] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-28T20:26:42.728632] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-28T20:26:42.728722] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-28T20:26:43.073156] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:43.110864] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T20:26:43.180259] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-28T20:26:43.980242] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-28T20:26:44.678053] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T20:26:44.736545] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T20:26:44.780246] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-28T20:26:45.580316] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-28T20:26:46.196311] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T20:26:46.274724] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T20:26:46.380239] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-28T20:26:47.048039] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T20:26:47.180267] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-28T20:26:47.874386] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T20:26:47.980273] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-28T20:26:48.780266] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-28T20:26:49.353673] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T20:26:49.580310] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-28T20:26:50.263825] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T20:26:50.394909] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-28T20:26:50.416371] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T20:26:51.180318] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-28T20:26:51.914562] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:26:51.950343] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T20:26:51.980227] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-28T20:26:52.780295] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-28T20:26:53.372057] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T20:26:53.580263] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-28T20:26:54.311936] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T20:26:54.380233] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-28T20:26:54.609210] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T20:26:55.180250] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-28T20:26:55.980271] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-28T20:26:56.589790] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T20:26:56.737781] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:26:56.740852] [INFO ] [REMOTE ] OLP: Full fetch complete (14270 records). [2025-10-28T20:26:56.740943] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-28T20:26:56.785414] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-28T20:26:57.103027] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-28T20:26:57.103107] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-28T20:26:57.103426] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-28T20:26:57.103463] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-28T20:26:57.104049] [DEBUG] [LOCAL ] OLP: Trimmed 14270 records to 9995 (keeping 200 days of data) [2025-10-28T20:26:57.164722] [DEBUG] [LOCAL ] OLP: Primary data saved (9995 records). [2025-10-28T20:26:57.164849] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-28T20:26:57.164925] [INFO ] [MAIN ] Update Progress: 1586/2366 symbols completed. OLP took 19.4s. Estimated remaining: 1h 41m 45s. Rate: 7.7 symbols/min [2025-10-28T20:26:57.350549] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:26:57.350765] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-28T20:26:57.350808] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-28T20:26:57.350915] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-28T20:26:57.350956] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-28T20:26:57.350996] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-28T20:26:57.351027] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-28T20:26:57.591531] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-28T20:26:57.746389] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:26:58.285196] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T20:26:58.380313] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-28T20:26:59.030725] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T20:26:59.180279] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-28T20:26:59.912821] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T20:26:59.980245] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-28T20:27:00.780243] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-28T20:27:00.986320] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-28T20:27:01.262341] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T20:27:01.580322] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-28T20:27:01.792352] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (7.41 seconds). [2025-10-28T20:27:02.025616] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T20:27:02.380311] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-28T20:27:03.104708] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T20:27:03.180259] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-28T20:27:03.574470] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T20:27:03.980264] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-28T20:27:04.676300] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T20:27:04.780258] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-28T20:27:05.250608] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:27:05.580251] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-28T20:27:06.338420] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T20:27:06.380217] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-28T20:27:06.831536] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:27:07.180257] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-28T20:27:07.732479] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T20:27:07.980244] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-28T20:27:08.402926] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:27:08.780264] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-28T20:27:09.419435] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T20:27:09.580254] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-28T20:27:10.304444] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T20:27:10.315036] [INFO ] [REMOTE ] OLN: Full fetch complete (74829 records). [2025-10-28T20:27:10.315184] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-28T20:27:10.389054] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-28T20:27:10.706027] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-28T20:27:10.706125] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-28T20:27:10.707281] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-28T20:27:10.707344] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-28T20:27:10.708802] [DEBUG] [LOCAL ] OLN: Trimmed 74829 records to 51984 (keeping 200 days of data) [2025-10-28T20:27:11.043063] [DEBUG] [LOCAL ] OLN: Primary data saved (51984 records). [2025-10-28T20:27:11.045580] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:27:11.043922] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-28T20:27:11.045728] [INFO ] [MAIN ] Update Progress: 1587/2366 symbols completed. OLN took 44.2s. Estimated remaining: 1h 41m 40s. Rate: 7.7 symbols/min [2025-10-28T20:27:11.185429] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-28T20:27:11.230977] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:11.240516] [DEBUG] [LOCAL ] ONIT: Loaded 7239 existing records from primary storage. [2025-10-28T20:27:11.241029] [INFO ] [MAIN ] ONIT: Loaded 7239 existing records. [2025-10-28T20:27:11.415933] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:27:11.416173] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-28T20:27:11.416228] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-28T20:27:11.416413] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-28T20:27:11.416471] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-28T20:27:11.804668] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:11.836148] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T20:27:11.846453] [INFO ] [REMOTE ] OMF: Full fetch complete (67925 records). [2025-10-28T20:27:11.846621] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-28T20:27:11.996047] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-28T20:27:12.258321] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-28T20:27:12.258410] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-28T20:27:12.259472] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-28T20:27:12.259534] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-28T20:27:12.261077] [DEBUG] [LOCAL ] OMF: Trimmed 67925 records to 46348 (keeping 200 days of data) [2025-10-28T20:27:12.536380] [DEBUG] [LOCAL ] OMF: Primary data saved (46348 records). [2025-10-28T20:27:12.536600] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-28T20:27:12.536804] [INFO ] [MAIN ] Update Progress: 1588/2366 symbols completed. OMF took 30.2s. Estimated remaining: 1h 41m 30s. Rate: 7.7 symbols/min [2025-10-28T20:27:12.728481] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:12.743113] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T20:27:12.759521] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:27:12.785366] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-28T20:27:12.787596] [DEBUG] [LOCAL ] ONL: Loaded 28280 existing records from primary storage. [2025-10-28T20:27:12.787839] [INFO ] [MAIN ] ONL: Loaded 28280 existing records. [2025-10-28T20:27:12.990192] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:27:12.990405] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-28T20:27:12.990452] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-28T20:27:12.990699] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-28T20:27:12.990758] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-28T20:27:13.362253] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:13.580273] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-28T20:27:14.361672] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T20:27:14.380210] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-28T20:27:14.506379] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T20:27:15.180250] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-28T20:27:15.783344] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T20:27:15.980270] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-28T20:27:16.184334] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T20:27:16.194905] [INFO ] [REMOTE ] OMC: Full fetch complete (77295 records). [2025-10-28T20:27:16.195028] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-28T20:27:16.578809] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T20:27:16.605262] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-28T20:27:16.605346] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-28T20:27:16.606585] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-28T20:27:16.606678] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-28T20:27:16.608213] [DEBUG] [LOCAL ] OMC: Trimmed 77295 records to 53290 (keeping 200 days of data) [2025-10-28T20:27:16.786102] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-28T20:27:16.940328] [DEBUG] [LOCAL ] OMC: Primary data saved (53290 records). [2025-10-28T20:27:16.940475] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-28T20:27:16.940552] [INFO ] [MAIN ] Update Progress: 1589/2366 symbols completed. OMC took 35.3s. Estimated remaining: 1h 41m 20s. Rate: 7.7 symbols/min [2025-10-28T20:27:17.110780] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:17.160631] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-28T20:27:17.161002] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-10-28T20:27:17.346842] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:27:17.347130] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-28T20:27:17.347184] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-28T20:27:17.347528] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-28T20:27:17.347604] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-28T20:27:17.585583] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-28T20:27:17.702633] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:18.027063] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T20:27:18.330843] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T20:27:18.380258] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-28T20:27:19.062222] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:27:19.180263] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-28T20:27:19.980330] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-28T20:27:20.700493] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:27:20.780225] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-28T20:27:20.888589] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T20:27:21.580273] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-28T20:27:22.217964] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T20:27:22.380253] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-28T20:27:22.413784] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T20:27:23.180321] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-28T20:27:23.621057] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T20:27:23.980279] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-28T20:27:24.550185] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:27:24.780221] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-28T20:27:25.337744] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T20:27:25.580255] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-28T20:27:25.986231] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:27:26.380255] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-28T20:27:27.148933] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T20:27:27.180214] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-28T20:27:27.536058] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T20:27:27.980236] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-28T20:27:28.575335] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T20:27:28.780237] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-28T20:27:28.888782] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T20:27:29.580258] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-28T20:27:30.027220] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T20:27:30.380317] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-28T20:27:30.805575] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T20:27:31.065420] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T20:27:31.180292] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-28T20:27:31.980248] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-28T20:27:32.662744] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T20:27:32.671964] [INFO ] [REMOTE ] OMI: Full fetch complete (65823 records). [2025-10-28T20:27:32.672095] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-28T20:27:32.785402] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-28T20:27:33.087370] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-28T20:27:33.087474] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-28T20:27:33.088535] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-28T20:27:33.088725] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-28T20:27:33.106828] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:27:33.112925] [DEBUG] [LOCAL ] OMI: Trimmed 65823 records to 45955 (keeping 200 days of data) [2025-10-28T20:27:33.369313] [DEBUG] [LOCAL ] OMI: Primary data saved (45955 records). [2025-10-28T20:27:33.369437] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-28T20:27:33.369506] [INFO ] [MAIN ] Update Progress: 1590/2366 symbols completed. OMI took 36.2s. Estimated remaining: 1h 41m 16s. Rate: 7.7 symbols/min [2025-10-28T20:27:33.538526] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:33.559538] [DEBUG] [LOCAL ] ONTF: Loaded 22513 existing records from primary storage. [2025-10-28T20:27:33.559819] [INFO ] [MAIN ] ONTF: Loaded 22513 existing records. [2025-10-28T20:27:33.591345] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-28T20:27:33.750678] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:27:33.750890] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-28T20:27:33.750939] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-28T20:27:33.751177] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-28T20:27:33.751235] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-28T20:27:34.129167] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:34.334104] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T20:27:34.380201] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-28T20:27:34.498365] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T20:27:34.941131] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T20:27:34.942725] [INFO ] [REMOTE ] ONIT: Full fetch complete (10863 records). [2025-10-28T20:27:34.942795] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-28T20:27:35.185456] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-28T20:27:35.339540] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-28T20:27:35.339635] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-28T20:27:35.339979] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-28T20:27:35.340043] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-28T20:27:35.340510] [DEBUG] [LOCAL ] ONIT: Trimmed 10863 records to 7204 (keeping 200 days of data) [2025-10-28T20:27:35.382528] [DEBUG] [LOCAL ] ONIT: Primary data saved (7204 records). [2025-10-28T20:27:35.382669] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-28T20:27:35.382764] [INFO ] [MAIN ] Update Progress: 1591/2366 symbols completed. ONIT took 24.3s. Estimated remaining: 1h 41m 6s. Rate: 7.7 symbols/min [2025-10-28T20:27:35.564902] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:35.565097] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-28T20:27:35.565145] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-28T20:27:35.565221] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-28T20:27:35.565258] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-28T20:27:35.565298] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-28T20:27:35.565331] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-28T20:27:35.949078] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:35.980215] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-28T20:27:36.199864] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T20:27:36.780248] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-28T20:27:37.402809] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T20:27:37.580236] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-28T20:27:38.380241] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-28T20:27:38.417233] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T20:27:38.440125] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T20:27:39.180304] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-28T20:27:39.695783] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T20:27:39.980246] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-28T20:27:40.747791] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T20:27:40.780214] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-28T20:27:41.554015] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T20:27:41.580215] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-28T20:27:42.348674] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T20:27:42.375006] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T20:27:42.380194] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-28T20:27:43.180278] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-28T20:27:43.324015] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T20:27:43.980302] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-28T20:27:44.779679] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T20:27:44.784378] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-28T20:27:45.580223] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-28T20:27:46.336623] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T20:27:46.337443] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T20:27:46.380208] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-28T20:27:46.533491] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (3.35 seconds). [2025-10-28T20:27:47.180255] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-28T20:27:47.980220] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-28T20:27:48.086785] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T20:27:48.098222] [INFO ] [REMOTE ] ONON: Full fetch complete (77770 records). [2025-10-28T20:27:48.098364] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-28T20:27:48.494791] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-28T20:27:48.494874] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-28T20:27:48.496152] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-28T20:27:48.496230] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-28T20:27:48.497720] [DEBUG] [LOCAL ] ONON: Trimmed 77770 records to 53613 (keeping 200 days of data) [2025-10-28T20:27:48.733711] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T20:27:48.741612] [INFO ] [REMOTE ] ONL: Full fetch complete (42186 records). [2025-10-28T20:27:48.750366] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-28T20:27:48.808170] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-28T20:27:49.049280] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-10-28T20:27:49.075505] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-28T20:27:49.089562] [INFO ] [MAIN ] Update Progress: 1592/2366 symbols completed. ONON took 32.1s. Estimated remaining: 1h 41m 1s. Rate: 7.7 symbols/min [2025-10-28T20:27:49.403967] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-28T20:27:49.425605] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-28T20:27:49.438726] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-28T20:27:49.458834] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:49.460162] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-28T20:27:49.460546] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-28T20:27:49.461837] [DEBUG] [LOCAL ] ONL: Trimmed 42186 records to 28174 (keeping 200 days of data) [2025-10-28T20:27:49.586669] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-28T20:27:49.582674] [DEBUG] [LOCAL ] OOMA: Loaded 18122 existing records from primary storage. [2025-10-28T20:27:49.595867] [INFO ] [MAIN ] OOMA: Loaded 18122 existing records. [2025-10-28T20:27:49.750553] [DEBUG] [LOCAL ] ONL: Primary data saved (28174 records). [2025-10-28T20:27:49.766787] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-28T20:27:49.766944] [INFO ] [MAIN ] Update Progress: 1593/2366 symbols completed. ONL took 37.2s. Estimated remaining: 1h 40m 49s. Rate: 7.7 symbols/min [2025-10-28T20:27:49.910126] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T20:27:49.909237] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:27:49.932307] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-28T20:27:49.933108] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-28T20:27:49.955455] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-28T20:27:49.955544] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-28T20:27:50.146569] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:27:50.392336] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-28T20:27:50.408683] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:50.409725] [DEBUG] [LOCAL ] OPAD: Loaded 27226 existing records from primary storage. [2025-10-28T20:27:50.410154] [INFO ] [MAIN ] OPAD: Loaded 27226 existing records. [2025-10-28T20:27:50.593267] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:27:50.593485] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-28T20:27:50.593588] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-28T20:27:50.593935] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-28T20:27:50.593991] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-28T20:27:50.942176] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:27:51.099764] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T20:27:51.180220] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-28T20:27:51.367292] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:27:51.789855] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T20:27:51.980241] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-28T20:27:52.700801] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T20:27:52.780253] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-28T20:27:53.560979] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T20:27:53.580207] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-28T20:27:54.380275] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-28T20:27:54.617466] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T20:27:55.054204] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T20:27:55.180454] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-28T20:27:55.980230] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-28T20:27:56.013717] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T20:27:56.780248] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-28T20:27:57.347612] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T20:27:57.580250] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-28T20:27:57.664931] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:27:58.084446] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T20:27:58.380262] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-28T20:27:59.180260] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-28T20:27:59.885923] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-28T20:27:59.980277] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-28T20:28:00.126400] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T20:28:00.780293] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-28T20:28:01.582551] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-28T20:28:01.587827] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T20:28:01.861744] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T20:28:01.866625] [INFO ] [REMOTE ] ONTF: Full fetch complete (31495 records). [2025-10-28T20:28:01.866727] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-28T20:28:02.230768] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T20:28:02.245064] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-28T20:28:02.245115] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-28T20:28:02.245821] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-28T20:28:02.245882] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-28T20:28:02.246591] [DEBUG] [LOCAL ] ONTF: Trimmed 31495 records to 22465 (keeping 200 days of data) [2025-10-28T20:28:02.364782] [DEBUG] [LOCAL ] ONTF: Primary data saved (22465 records). [2025-10-28T20:28:02.364904] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-28T20:28:02.364980] [INFO ] [MAIN ] Update Progress: 1594/2366 symbols completed. ONTF took 29.0s. Estimated remaining: 1h 40m 44s. Rate: 7.7 symbols/min [2025-10-28T20:28:02.385339] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-28T20:28:02.535435] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:02.576793] [DEBUG] [LOCAL ] OPFI: Loaded 45789 existing records from primary storage. [2025-10-28T20:28:02.577067] [INFO ] [MAIN ] OPFI: Loaded 45789 existing records. [2025-10-28T20:28:02.751138] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:28:02.751336] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-28T20:28:02.751383] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-28T20:28:02.751731] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-28T20:28:02.751787] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-28T20:28:03.069484] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T20:28:03.171373] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:03.180276] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-28T20:28:03.980233] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-28T20:28:04.780255] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-28T20:28:04.927798] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T20:28:05.252217] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T20:28:05.261555] [INFO ] [REMOTE ] ONTO: Full fetch complete (67339 records). [2025-10-28T20:28:05.261692] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-28T20:28:05.585334] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-28T20:28:05.660929] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-28T20:28:05.666873] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-28T20:28:05.668561] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-28T20:28:05.669137] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-28T20:28:05.669057] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T20:28:05.674750] [DEBUG] [LOCAL ] ONTO: Trimmed 67339 records to 46900 (keeping 200 days of data) [2025-10-28T20:28:05.956538] [DEBUG] [LOCAL ] ONTO: Primary data saved (46900 records). [2025-10-28T20:28:05.956705] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-28T20:28:05.956789] [INFO ] [MAIN ] Update Progress: 1595/2366 symbols completed. ONTO took 30.6s. Estimated remaining: 1h 40m 34s. Rate: 7.7 symbols/min [2025-10-28T20:28:06.128436] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:06.141472] [DEBUG] [LOCAL ] OPP: Loaded 12295 existing records from primary storage. [2025-10-28T20:28:06.141726] [INFO ] [MAIN ] OPP: Loaded 12295 existing records. [2025-10-28T20:28:06.303110] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T20:28:06.324191] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:28:06.324962] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-28T20:28:06.325364] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-28T20:28:06.325610] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-28T20:28:06.325694] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-28T20:28:06.388276] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-28T20:28:06.676274] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:07.180269] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-28T20:28:07.969580] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T20:28:07.980208] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-28T20:28:08.244292] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-28T20:28:08.780309] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-28T20:28:08.877211] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T20:28:09.405467] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T20:28:09.580265] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-28T20:28:10.380304] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-28T20:28:11.030813] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:28:11.180249] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-28T20:28:11.420581] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T20:28:11.874704] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T20:28:11.980313] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-28T20:28:12.714570] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:28:12.780262] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-28T20:28:13.382073] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T20:28:13.580258] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-28T20:28:14.253359] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T20:28:14.380261] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-28T20:28:14.998477] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T20:28:15.180249] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-28T20:28:15.894254] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T20:28:15.980269] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-28T20:28:16.618733] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T20:28:16.780336] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-28T20:28:17.580280] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-28T20:28:18.188253] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:28:18.380242] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-28T20:28:18.502839] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T20:28:19.180299] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-28T20:28:19.980282] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-28T20:28:20.301433] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T20:28:20.788631] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-28T20:28:20.792227] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T20:28:20.817602] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T20:28:20.822193] [INFO ] [REMOTE ] OOMA: Full fetch complete (26028 records). [2025-10-28T20:28:20.822331] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-28T20:28:21.209366] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-28T20:28:21.209482] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-28T20:28:21.210369] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-28T20:28:21.210433] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-28T20:28:21.211323] [DEBUG] [LOCAL ] OOMA: Trimmed 26028 records to 18057 (keeping 200 days of data) [2025-10-28T20:28:21.325781] [DEBUG] [LOCAL ] OOMA: Primary data saved (18057 records). [2025-10-28T20:28:21.326019] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-28T20:28:21.326139] [INFO ] [MAIN ] Update Progress: 1596/2366 symbols completed. OOMA took 32.2s. Estimated remaining: 1h 40m 30s. Rate: 7.7 symbols/min [2025-10-28T20:28:21.502129] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:21.502369] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-28T20:28:21.502444] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-28T20:28:21.502620] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-28T20:28:21.502703] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-28T20:28:21.502760] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-28T20:28:21.502795] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-28T20:28:21.585547] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-28T20:28:21.914386] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:22.238551] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T20:28:22.318698] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T20:28:22.380250] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-28T20:28:23.181463] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-28T20:28:23.185769] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T20:28:23.980271] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-28T20:28:24.498217] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T20:28:24.679198] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T20:28:24.780210] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-28T20:28:25.580255] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-28T20:28:26.322550] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T20:28:26.380214] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-28T20:28:27.149809] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T20:28:27.153737] [INFO ] [REMOTE ] OPP: Full fetch complete (17485 records). [2025-10-28T20:28:27.153830] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-28T20:28:27.185515] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-28T20:28:27.534987] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-28T20:28:27.535082] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-28T20:28:27.535534] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-28T20:28:27.535609] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-28T20:28:27.536414] [DEBUG] [LOCAL ] OPP: Trimmed 17485 records to 12213 (keeping 200 days of data) [2025-10-28T20:28:27.615428] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-28T20:28:27.646971] [DEBUG] [LOCAL ] OPP: Primary data saved (12213 records). [2025-10-28T20:28:27.647272] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-28T20:28:27.647343] [INFO ] [MAIN ] Update Progress: 1597/2366 symbols completed. OPP took 21.7s. Estimated remaining: 1h 40m 21s. Rate: 7.7 symbols/min [2025-10-28T20:28:27.980320] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-28T20:28:28.643120] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T20:28:28.780268] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-28T20:28:29.451025] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T20:28:29.461316] [INFO ] [REMOTE ] OPAD: Full fetch complete (30039 records). [2025-10-28T20:28:29.461447] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-28T20:28:29.585383] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-28T20:28:29.842289] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-28T20:28:29.842381] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-28T20:28:29.843009] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-28T20:28:29.843073] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-28T20:28:29.843902] [DEBUG] [LOCAL ] OPAD: Trimmed 30039 records to 27488 (keeping 200 days of data) [2025-10-28T20:28:29.997532] [DEBUG] [LOCAL ] OPAD: Primary data saved (27488 records). [2025-10-28T20:28:29.997782] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-28T20:28:29.997881] [INFO ] [MAIN ] Update Progress: 1598/2366 symbols completed. OPAD took 40.2s. Estimated remaining: 1h 40m 11s. Rate: 7.7 symbols/min [2025-10-28T20:28:30.201043] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T20:28:30.380299] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-28T20:28:30.699060] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-28T20:28:30.873266] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T20:28:31.180269] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-28T20:28:31.980295] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-28T20:28:32.474782] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T20:28:32.484518] [INFO ] [REMOTE ] OPFI: Full fetch complete (68428 records). [2025-10-28T20:28:32.484714] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-28T20:28:32.603819] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:28:32.786734] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-28T20:28:32.883038] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-28T20:28:32.883131] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-28T20:28:32.884394] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-28T20:28:32.884464] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-28T20:28:32.885880] [DEBUG] [LOCAL ] OPFI: Trimmed 68428 records to 45734 (keeping 200 days of data) [2025-10-28T20:28:33.148379] [DEBUG] [LOCAL ] OPFI: Primary data saved (45734 records). [2025-10-28T20:28:33.148503] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-28T20:28:33.148581] [INFO ] [MAIN ] Update Progress: 1599/2366 symbols completed. OPFI took 30.8s. Estimated remaining: 1h 40m 1s. Rate: 7.7 symbols/min [2025-10-28T20:28:33.497331] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:28:33.580228] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-28T20:28:34.285748] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T20:28:34.380238] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-28T20:28:35.042534] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T20:28:35.180323] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-28T20:28:35.736239] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:28:35.980300] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-28T20:28:36.589068] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T20:28:36.780359] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-28T20:28:37.321944] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T20:28:37.324102] [INFO ] [REMOTE ] OPY: Full fetch complete (10272 records). [2025-10-28T20:28:37.324175] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-28T20:28:37.511797] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:28:37.512115] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:28:37.512212] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:28:37.512294] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-28T20:28:37.512366] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-28T20:28:37.512405] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-28T20:28:37.512444] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-28T20:28:37.512521] [INFO ] [MAIN ] Update Progress: 1600/2366 symbols completed. OPY took 16.2s. Estimated remaining: 1h 39m 51s. Rate: 7.7 symbols/min [2025-10-28T20:28:38.105845] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:38.136530] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:38.231767] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:38.227678] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-28T20:28:38.286403] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:28:38.287113] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-28T20:28:38.287246] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-28T20:28:38.287374] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-28T20:28:38.287416] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-28T20:28:38.287457] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-28T20:28:38.287636] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-28T20:28:38.286603] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-28T20:28:38.293854] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-28T20:28:38.300958] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-28T20:28:38.313631] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-28T20:28:38.339876] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-28T20:28:38.744589] [DEBUG] [LOCAL ] ORC: Loaded 52471 existing records from primary storage. [2025-10-28T20:28:38.814208] [DEBUG] [LOCAL ] OR: Loaded 46888 existing records from primary storage. [2025-10-28T20:28:38.813315] [INFO ] [MAIN ] ORC: Loaded 52471 existing records. [2025-10-28T20:28:38.866592] [INFO ] [MAIN ] OR: Loaded 46888 existing records. [2025-10-28T20:28:39.416581] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:39.471138] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:39.461801] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-28T20:28:39.496894] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-28T20:28:39.595581] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:28:39.625523] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-28T20:28:39.650781] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:28:39.651374] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-28T20:28:39.651311] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-28T20:28:39.651550] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-28T20:28:39.652030] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-28T20:28:39.652093] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-28T20:28:39.657576] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-28T20:28:39.727885] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-28T20:28:40.437601] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:40.468425] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-28T20:28:40.472620] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:28:40.473386] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-28T20:28:40.820547] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T20:28:40.828502] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-28T20:28:41.458216] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T20:28:41.498457] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T20:28:41.580263] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-28T20:28:41.810125] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T20:28:42.301787] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-28T20:28:42.380336] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-28T20:28:42.880515] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T20:28:43.180255] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-28T20:28:43.942453] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T20:28:43.980224] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-28T20:28:44.382565] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T20:28:44.780274] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-28T20:28:45.580235] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-28T20:28:45.667849] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T20:28:45.913591] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T20:28:46.380270] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-28T20:28:47.180311] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-28T20:28:47.535271] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T20:28:47.710985] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-28T20:28:47.980297] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-28T20:28:48.412963] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T20:28:48.780257] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-28T20:28:49.171718] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T20:28:49.580237] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-28T20:28:50.158198] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T20:28:50.380269] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-28T20:28:51.185390] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-28T20:28:51.207923] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T20:28:51.980277] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-28T20:28:52.259670] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T20:28:52.780233] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-28T20:28:53.040858] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-28T20:28:53.547035] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T20:28:53.580255] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-28T20:28:54.197786] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T20:28:54.380293] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-28T20:28:55.180240] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-28T20:28:55.315413] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-28T20:28:55.537417] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T20:28:55.980281] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-28T20:28:56.431462] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:28:56.780254] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-28T20:28:57.371261] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T20:28:57.580348] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-28T20:28:57.983167] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T20:28:58.380253] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-28T20:28:58.816532] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T20:28:59.180254] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-28T20:28:59.440320] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T20:28:59.447843] [INFO ] [REMOTE ] ORA: Full fetch complete (48709 records). [2025-10-28T20:28:59.447951] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-28T20:28:59.816597] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-28T20:28:59.816746] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-28T20:28:59.817604] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-28T20:28:59.817668] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-28T20:28:59.818855] [DEBUG] [LOCAL ] ORA: Trimmed 48709 records to 32705 (keeping 200 days of data) [2025-10-28T20:28:59.996034] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-28T20:29:00.021021] [DEBUG] [LOCAL ] ORA: Primary data saved (32705 records). [2025-10-28T20:29:00.021165] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-28T20:29:00.021237] [INFO ] [MAIN ] Update Progress: 1601/2366 symbols completed. ORA took 22.5s. Estimated remaining: 1h 39m 51s. Rate: 7.7 symbols/min [2025-10-28T20:29:00.196662] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:00.196825] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-28T20:29:00.196885] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-28T20:29:00.196990] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-28T20:29:00.197032] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-28T20:29:00.197073] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-28T20:29:00.197106] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-28T20:29:00.547809] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:00.780278] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-28T20:29:00.837970] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T20:29:01.580252] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-28T20:29:02.170887] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-28T20:29:02.211971] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T20:29:02.380289] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-28T20:29:03.040098] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T20:29:03.050602] [INFO ] [REMOTE ] OR: Full fetch complete (67224 records). [2025-10-28T20:29:03.050767] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-28T20:29:03.194211] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-28T20:29:03.463014] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-28T20:29:03.463140] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-28T20:29:03.465127] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-28T20:29:03.465210] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-28T20:29:03.467213] [DEBUG] [LOCAL ] OR: Trimmed 67224 records to 46874 (keeping 200 days of data) [2025-10-28T20:29:03.799213] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:29:03.821960] [DEBUG] [LOCAL ] OR: Primary data saved (46874 records). [2025-10-28T20:29:03.822159] [INFO ] [MAIN ] OR: Full history saved. [2025-10-28T20:29:03.822271] [INFO ] [MAIN ] Update Progress: 1602/2366 symbols completed. OR took 26.3s. Estimated remaining: 1h 39m 41s. Rate: 7.7 symbols/min [2025-10-28T20:29:03.988167] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-28T20:29:03.992250] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:04.027632] [DEBUG] [LOCAL ] ORN: Loaded 30520 existing records from primary storage. [2025-10-28T20:29:04.027990] [INFO ] [MAIN ] ORN: Loaded 30520 existing records. [2025-10-28T20:29:04.212341] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:29:04.212692] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-28T20:29:04.212763] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-28T20:29:04.213232] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-28T20:29:04.213295] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-28T20:29:04.574631] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:04.780265] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-28T20:29:04.887201] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T20:29:05.580307] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-28T20:29:06.127379] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T20:29:06.209879] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-28T20:29:06.380256] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-28T20:29:07.180266] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-28T20:29:07.260390] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T20:29:07.498699] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:29:07.980276] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-28T20:29:08.564468] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:29:08.780237] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-28T20:29:09.580316] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-28T20:29:09.848578] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-28T20:29:10.298028] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T20:29:10.380260] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-28T20:29:11.180319] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-28T20:29:11.592575] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-28T20:29:11.636345] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T20:29:11.980348] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-28T20:29:12.219088] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T20:29:12.780234] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-28T20:29:13.580248] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-28T20:29:14.006521] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T20:29:14.380229] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-28T20:29:14.583578] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-28T20:29:15.180274] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-28T20:29:15.431786] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T20:29:15.443792] [INFO ] [REMOTE ] ORC: Full fetch complete (75696 records). [2025-10-28T20:29:15.444009] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-28T20:29:15.586726] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:29:15.885870] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-28T20:29:15.886078] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-28T20:29:15.888115] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-28T20:29:15.888189] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-28T20:29:15.890198] [DEBUG] [LOCAL ] ORC: Trimmed 75696 records to 52468 (keeping 200 days of data) [2025-10-28T20:29:15.987239] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-28T20:29:16.222464] [DEBUG] [LOCAL ] ORC: Primary data saved (52468 records). [2025-10-28T20:29:16.222675] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-28T20:29:16.222792] [INFO ] [MAIN ] Update Progress: 1603/2366 symbols completed. ORC took 38.7s. Estimated remaining: 1h 39m 35s. Rate: 7.7 symbols/min [2025-10-28T20:29:16.397586] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:16.453680] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-28T20:29:16.454119] [INFO ] [MAIN ] OSCR: Loaded 53769 existing records. [2025-10-28T20:29:16.638710] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:29:16.639209] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-28T20:29:16.639339] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-28T20:29:16.639933] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-28T20:29:16.639998] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-28T20:29:16.791306] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-28T20:29:17.042437] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-28T20:29:17.143624] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:17.167416] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T20:29:17.580267] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-28T20:29:18.380333] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-28T20:29:18.645767] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T20:29:19.142784] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-28T20:29:19.180327] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-28T20:29:19.980246] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-28T20:29:20.307148] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:29:20.456593] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-28T20:29:20.780312] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-28T20:29:21.580310] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-28T20:29:22.380224] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-28T20:29:22.550843] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-28T20:29:22.589699] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T20:29:22.678561] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T20:29:23.180318] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-28T20:29:23.928980] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:29:23.980218] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-28T20:29:24.384257] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T20:29:24.780266] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-28T20:29:25.437188] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T20:29:25.447399] [INFO ] [REMOTE ] ORCL: Full fetch complete (77213 records). [2025-10-28T20:29:25.447516] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-28T20:29:25.448344] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:29:25.448432] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:29:25.448474] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:29:25.448536] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-28T20:29:25.448596] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-28T20:29:25.448630] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-28T20:29:25.448711] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-28T20:29:25.448775] [INFO ] [MAIN ] Update Progress: 1604/2366 symbols completed. ORCL took 47.9s. Estimated remaining: 1h 39m 28s. Rate: 7.7 symbols/min [2025-10-28T20:29:25.590260] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-28T20:29:25.625125] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:25.625507] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-28T20:29:25.625600] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-28T20:29:25.625765] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-28T20:29:25.625836] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-28T20:29:25.629272] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-28T20:29:25.629396] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-28T20:29:25.819716] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-28T20:29:26.023468] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:26.380325] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-28T20:29:26.638081] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T20:29:26.643844] [INFO ] [REMOTE ] ORN: Full fetch complete (45460 records). [2025-10-28T20:29:26.643949] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-28T20:29:27.048411] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-28T20:29:27.048500] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-28T20:29:27.049453] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-28T20:29:27.049515] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-28T20:29:27.050514] [DEBUG] [LOCAL ] ORN: Trimmed 45460 records to 30441 (keeping 200 days of data) [2025-10-28T20:29:27.185058] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-28T20:29:27.222258] [DEBUG] [LOCAL ] ORN: Primary data saved (30441 records). [2025-10-28T20:29:27.222484] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-28T20:29:27.222575] [INFO ] [MAIN ] Update Progress: 1605/2366 symbols completed. ORN took 23.4s. Estimated remaining: 1h 39m 17s. Rate: 7.7 symbols/min [2025-10-28T20:29:27.397248] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:27.397455] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-28T20:29:27.397491] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-28T20:29:27.397605] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-28T20:29:27.397672] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-28T20:29:27.397738] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-28T20:29:27.397773] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-28T20:29:27.764231] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:27.980304] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-10-28T20:29:28.047388] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T20:29:28.210623] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:29:28.211150] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-10-28T20:29:28.211253] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:29:28.211302] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-28T20:29:28.211364] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:29:28.211440] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-28T20:29:28.211516] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-28T20:29:28.211585] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-28T20:29:28.211627] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-28T20:29:28.211717] [INFO ] [MAIN ] Update Progress: 1606/2366 symbols completed. OTF took 1.0s. Estimated remaining: 1h 39m 6s. Rate: 7.7 symbols/min [2025-10-28T20:29:28.400134] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:28.400588] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-28T20:29:28.400696] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-28T20:29:28.400844] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-28T20:29:28.400986] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-28T20:29:28.401127] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-28T20:29:28.401195] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-28T20:29:28.730216] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T20:29:28.785338] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-28T20:29:28.848707] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:29.580301] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-28T20:29:30.183162] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T20:29:30.195297] [INFO ] [REMOTE ] ORI: Full fetch complete (70548 records). [2025-10-28T20:29:30.195533] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-28T20:29:30.386576] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-28T20:29:30.411789] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:29:30.416722] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:29:30.417043] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:29:30.417131] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-28T20:29:30.417251] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-28T20:29:30.417315] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-28T20:29:30.417363] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-28T20:29:30.417458] [INFO ] [MAIN ] Update Progress: 1607/2366 symbols completed. ORI took 30.4s. Estimated remaining: 1h 38m 56s. Rate: 7.7 symbols/min [2025-10-28T20:29:30.600950] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:30.601222] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-28T20:29:30.601262] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-28T20:29:30.601387] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-28T20:29:30.601429] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-28T20:29:30.601471] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-28T20:29:30.601506] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-28T20:29:31.006723] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:31.045384] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T20:29:31.180301] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-28T20:29:31.980291] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-28T20:29:32.256049] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-28T20:29:32.524212] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T20:29:32.780320] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-28T20:29:33.117577] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:29:33.580303] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-28T20:29:34.381050] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-28T20:29:35.009044] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T20:29:35.180255] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-28T20:29:35.275364] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-28T20:29:35.654233] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T20:29:35.980236] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-28T20:29:36.780286] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-28T20:29:37.067699] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T20:29:37.580253] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-28T20:29:38.056287] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T20:29:38.238089] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-28T20:29:38.380210] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-28T20:29:38.954364] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T20:29:39.180277] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-28T20:29:39.980299] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-28T20:29:40.617150] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T20:29:40.704163] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-28T20:29:40.780255] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-28T20:29:41.290517] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T20:29:41.580287] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-28T20:29:42.223525] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T20:29:42.380254] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-28T20:29:43.180266] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-28T20:29:43.756391] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:29:43.980221] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-28T20:29:44.220565] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-28T20:29:44.442066] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T20:29:44.780300] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-28T20:29:45.580280] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-28T20:29:45.725460] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T20:29:46.111372] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T20:29:46.380320] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-28T20:29:46.930399] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T20:29:47.180258] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-28T20:29:47.626445] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T20:29:47.980260] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-28T20:29:48.780226] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-28T20:29:48.834463] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T20:29:49.580258] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-28T20:29:50.211285] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T20:29:50.380232] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-28T20:29:50.453157] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-28T20:29:50.463905] [INFO ] [REMOTE ] OSCR: Full fetch complete (77768 records). [2025-10-28T20:29:50.464062] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-28T20:29:50.856241] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-28T20:29:50.856315] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-28T20:29:50.857392] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-28T20:29:50.857454] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-28T20:29:50.858857] [DEBUG] [LOCAL ] OSCR: Trimmed 77768 records to 53769 (keeping 200 days of data) [2025-10-28T20:29:51.177369] [DEBUG] [LOCAL ] OSCR: Primary data saved (53769 records). [2025-10-28T20:29:51.177603] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-28T20:29:51.177777] [INFO ] [MAIN ] Update Progress: 1608/2366 symbols completed. OSCR took 35.0s. Estimated remaining: 1h 38m 54s. Rate: 7.7 symbols/min [2025-10-28T20:29:51.189217] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-28T20:29:51.359846] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T20:29:51.384982] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:51.395516] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-28T20:29:51.395588] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-28T20:29:51.395854] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-28T20:29:51.395901] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-28T20:29:51.395942] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-28T20:29:51.396008] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-28T20:29:51.756430] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:51.894430] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-28T20:29:51.980211] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-28T20:29:52.727838] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T20:29:52.780221] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-28T20:29:53.210776] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T20:29:53.580306] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-28T20:29:54.151409] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T20:29:54.380253] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-28T20:29:54.908972] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:29:54.918189] [INFO ] [REMOTE ] OUT: Full fetch complete (69122 records). [2025-10-28T20:29:54.918299] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-28T20:29:55.186790] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-28T20:29:55.317293] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-28T20:29:55.317367] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-28T20:29:55.318393] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-28T20:29:55.318454] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-28T20:29:55.319782] [DEBUG] [LOCAL ] OUT: Trimmed 69122 records to 47551 (keeping 200 days of data) [2025-10-28T20:29:55.596917] [DEBUG] [LOCAL ] OUT: Primary data saved (47551 records). [2025-10-28T20:29:55.597047] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-28T20:29:55.597117] [INFO ] [MAIN ] Update Progress: 1609/2366 symbols completed. OUT took 25.2s. Estimated remaining: 1h 38m 45s. Rate: 7.7 symbols/min [2025-10-28T20:29:55.765916] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:29:55.816771] [DEBUG] [LOCAL ] OWL: Loaded 53560 existing records from primary storage. [2025-10-28T20:29:55.817090] [INFO ] [MAIN ] OWL: Loaded 53560 existing records. [2025-10-28T20:29:55.990205] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-28T20:29:56.018512] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:29:56.018875] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-28T20:29:56.018996] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-28T20:29:56.019560] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-28T20:29:56.019617] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-28T20:29:56.320984] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-28T20:29:56.421043] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:29:56.447637] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:29:56.780351] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-28T20:29:57.588845] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-28T20:29:57.609087] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T20:29:58.000101] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:29:58.380265] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-28T20:29:58.968382] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T20:29:59.180252] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-28T20:29:59.674579] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T20:29:59.683410] [INFO ] [REMOTE ] OSK: Full fetch complete (61319 records). [2025-10-28T20:29:59.683562] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-28T20:29:59.873983] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:29:59.874592] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:29:59.874680] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:29:59.874736] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-28T20:29:59.874799] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-28T20:29:59.874833] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-28T20:29:59.874875] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-28T20:29:59.874930] [INFO ] [MAIN ] Update Progress: 1610/2366 symbols completed. OSK took 34.4s. Estimated remaining: 1h 38m 35s. Rate: 7.7 symbols/min [2025-10-28T20:29:59.981292] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-28T20:30:00.051972] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:00.064102] [DEBUG] [LOCAL ] OWLT: Loaded 10143 existing records from primary storage. [2025-10-28T20:30:00.064412] [INFO ] [MAIN ] OWLT: Loaded 10143 existing records. [2025-10-28T20:30:00.245090] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:30:00.245327] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-28T20:30:00.245374] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-28T20:30:00.245578] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-28T20:30:00.245634] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-28T20:30:00.615020] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:00.780252] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-28T20:30:01.406103] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-28T20:30:01.580366] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-28T20:30:01.795115] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T20:30:02.078841] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T20:30:02.380283] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-28T20:30:02.696282] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T20:30:02.708136] [INFO ] [REMOTE ] OTIS: Full fetch complete (76393 records). [2025-10-28T20:30:02.708359] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-28T20:30:03.117625] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-28T20:30:03.117747] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-28T20:30:03.118905] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-28T20:30:03.118969] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-28T20:30:03.120448] [DEBUG] [LOCAL ] OTIS: Trimmed 76393 records to 52671 (keeping 200 days of data) [2025-10-28T20:30:03.188311] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-28T20:30:03.448748] [DEBUG] [LOCAL ] OTIS: Primary data saved (52671 records). [2025-10-28T20:30:03.448897] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-28T20:30:03.448971] [INFO ] [MAIN ] Update Progress: 1611/2366 symbols completed. OTIS took 35.2s. Estimated remaining: 1h 38m 25s. Rate: 7.7 symbols/min [2025-10-28T20:30:03.617171] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:03.617346] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-28T20:30:03.617386] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-28T20:30:03.617501] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-28T20:30:03.617543] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-28T20:30:03.617586] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-28T20:30:03.617620] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-28T20:30:03.846932] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T20:30:03.989542] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-28T20:30:04.010566] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:04.047122] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T20:30:04.780292] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-28T20:30:05.490054] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T20:30:05.580243] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-28T20:30:05.918738] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T20:30:06.124157] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T20:30:06.380282] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-28T20:30:07.180262] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-28T20:30:07.758575] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T20:30:07.881606] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T20:30:07.980204] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-28T20:30:08.780348] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-28T20:30:09.580228] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-28T20:30:10.018612] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-28T20:30:10.292062] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T20:30:10.293733] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T20:30:10.380207] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-28T20:30:11.034144] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T20:30:11.180241] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-28T20:30:11.980346] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-28T20:30:12.646070] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:30:12.780249] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-28T20:30:13.494533] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T20:30:13.580252] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-28T20:30:14.372317] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T20:30:14.382376] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-28T20:30:15.036536] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T20:30:15.180220] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-28T20:30:15.229995] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T20:30:15.915061] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T20:30:15.980220] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-28T20:30:16.780286] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-28T20:30:16.831501] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T20:30:16.835164] [INFO ] [REMOTE ] OWLT: Full fetch complete (12990 records). [2025-10-28T20:30:16.835235] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-28T20:30:17.206088] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-28T20:30:17.206160] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-28T20:30:17.206445] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-28T20:30:17.206490] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-28T20:30:17.207029] [DEBUG] [LOCAL ] OWLT: Trimmed 12990 records to 10264 (keeping 200 days of data) [2025-10-28T20:30:17.262461] [DEBUG] [LOCAL ] OWLT: Primary data saved (10264 records). [2025-10-28T20:30:17.262582] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-28T20:30:17.262677] [INFO ] [MAIN ] Update Progress: 1612/2366 symbols completed. OWLT took 17.4s. Estimated remaining: 1h 38m 20s. Rate: 7.7 symbols/min [2025-10-28T20:30:17.429629] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:17.429820] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-28T20:30:17.429859] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-28T20:30:17.429984] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-28T20:30:17.430024] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-28T20:30:17.430064] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-28T20:30:17.430103] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-28T20:30:17.583935] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-28T20:30:17.805532] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:18.292600] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T20:30:18.380246] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-28T20:30:18.679782] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T20:30:19.180315] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-28T20:30:19.838542] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T20:30:19.980950] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T20:30:19.980415] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-28T20:30:20.780311] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-28T20:30:21.580336] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-28T20:30:22.021098] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T20:30:22.065243] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T20:30:22.380244] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-28T20:30:23.047360] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T20:30:23.180233] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-28T20:30:23.611968] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T20:30:23.980285] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-28T20:30:24.673180] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T20:30:24.683950] [INFO ] [REMOTE ] OVV: Full fetch complete (77508 records). [2025-10-28T20:30:24.684080] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-28T20:30:24.784577] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-28T20:30:25.073044] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-28T20:30:25.073145] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-28T20:30:25.074269] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-28T20:30:25.074330] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-28T20:30:25.075691] [DEBUG] [LOCAL ] OVV: Trimmed 77508 records to 53477 (keeping 200 days of data) [2025-10-28T20:30:25.385465] [DEBUG] [LOCAL ] OVV: Primary data saved (53477 records). [2025-10-28T20:30:25.385587] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-28T20:30:25.385677] [INFO ] [MAIN ] Update Progress: 1613/2366 symbols completed. OVV took 34.2s. Estimated remaining: 1h 38m 13s. Rate: 7.7 symbols/min [2025-10-28T20:30:25.550391] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:25.580253] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-28T20:30:25.598240] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-28T20:30:25.598524] [INFO ] [MAIN ] PAAS: Loaded 53625 existing records. [2025-10-28T20:30:25.779797] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:30:25.780147] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-28T20:30:25.780303] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-28T20:30:25.780912] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-28T20:30:25.780969] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-28T20:30:25.998832] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T20:30:26.175118] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:26.215279] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-28T20:30:26.380210] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-28T20:30:26.844628] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:30:27.180282] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-28T20:30:27.271897] [DEBUG] [REMOTE ] PAAS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-28T20:30:27.272078] [WARN ] [REMOTE ] PAAS: No data returned for month 2025-01 [2025-10-28T20:30:27.272158] [FATAL] [REMOTE ] PAAS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:30:27.272227] [FATAL] [MAIN ] PAAS: Failed to fetch primary data. [2025-10-28T20:30:27.272290] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:30:27.272357] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-28T20:30:27.272416] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-28T20:30:27.272452] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-28T20:30:27.272594] [DEBUG] [LOCAL ] PAAS: Deleted derivative data file. [2025-10-28T20:30:27.272688] [INFO ] [MAIN ] Update Progress: 1614/2366 symbols completed. PAAS took 1.9s. Estimated remaining: 1h 38m 2s. Rate: 7.7 symbols/min [2025-10-28T20:30:27.438123] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:27.438259] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-28T20:30:27.438295] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-28T20:30:27.438401] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-28T20:30:27.438441] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-28T20:30:27.438482] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-28T20:30:27.438513] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-28T20:30:27.787378] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:27.980250] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-28T20:30:28.609050] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-28T20:30:28.627219] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T20:30:28.780247] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-28T20:30:29.580258] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-28T20:30:30.380306] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-28T20:30:30.867023] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T20:30:31.180267] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-28T20:30:31.264123] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-28T20:30:31.883519] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T20:30:31.980205] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-28T20:30:32.073885] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-28T20:30:32.780262] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-28T20:30:33.580328] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-28T20:30:34.165584] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-28T20:30:34.180012] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T20:30:34.380322] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-28T20:30:35.137060] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T20:30:35.148306] [INFO ] [REMOTE ] OWL: Full fetch complete (77713 records). [2025-10-28T20:30:35.148432] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-28T20:30:35.185441] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-28T20:30:35.562546] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-28T20:30:35.562746] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-28T20:30:35.563961] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-28T20:30:35.564125] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-28T20:30:35.580371] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T20:30:35.587034] [DEBUG] [LOCAL ] OWL: Trimmed 77713 records to 53560 (keeping 200 days of data) [2025-10-28T20:30:35.906763] [DEBUG] [LOCAL ] OWL: Primary data saved (53560 records). [2025-10-28T20:30:35.906933] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-28T20:30:35.907047] [INFO ] [MAIN ] Update Progress: 1615/2366 symbols completed. OWL took 40.3s. Estimated remaining: 1h 37m 54s. Rate: 7.7 symbols/min [2025-10-28T20:30:35.985390] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-28T20:30:36.079478] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:36.107764] [DEBUG] [LOCAL ] PACK: Loaded 31687 existing records from primary storage. [2025-10-28T20:30:36.108019] [INFO ] [MAIN ] PACK: Loaded 31687 existing records. [2025-10-28T20:30:36.283756] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:30:36.283967] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-28T20:30:36.284015] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-28T20:30:36.284340] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-28T20:30:36.284399] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-28T20:30:36.650477] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:36.780247] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-28T20:30:37.199214] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T20:30:37.433259] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-28T20:30:37.580233] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-28T20:30:37.702231] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T20:30:38.380273] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-28T20:30:38.640439] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T20:30:38.647153] [INFO ] [REMOTE ] OXM: Full fetch complete (46441 records). [2025-10-28T20:30:38.647259] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-28T20:30:39.026197] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-28T20:30:39.026323] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-28T20:30:39.027209] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-28T20:30:39.027303] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-28T20:30:39.028373] [DEBUG] [LOCAL ] OXM: Trimmed 46441 records to 32690 (keeping 200 days of data) [2025-10-28T20:30:39.182986] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-28T20:30:39.230583] [DEBUG] [LOCAL ] OXM: Primary data saved (32690 records). [2025-10-28T20:30:39.230750] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-28T20:30:39.230852] [INFO ] [MAIN ] Update Progress: 1616/2366 symbols completed. OXM took 35.8s. Estimated remaining: 1h 37m 45s. Rate: 7.7 symbols/min [2025-10-28T20:30:39.402477] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T20:30:39.425072] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:39.458389] [DEBUG] [LOCAL ] PACS: Loaded 34458 existing records from primary storage. [2025-10-28T20:30:39.458701] [INFO ] [MAIN ] PACS: Loaded 34458 existing records. [2025-10-28T20:30:39.632996] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:30:39.633244] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-28T20:30:39.633306] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-28T20:30:39.633631] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-28T20:30:39.633740] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-28T20:30:39.983164] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:39.983226] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-28T20:30:40.721438] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T20:30:40.780250] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-28T20:30:41.580237] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-28T20:30:41.788420] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-28T20:30:41.936579] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T20:30:42.380241] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-28T20:30:42.469913] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T20:30:43.180258] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-28T20:30:43.980263] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-28T20:30:44.208210] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T20:30:44.324414] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-28T20:30:44.780437] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-28T20:30:45.113036] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T20:30:45.580300] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-28T20:30:46.380265] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-28T20:30:46.631483] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T20:30:46.748865] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T20:30:47.067222] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T20:30:47.180234] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-28T20:30:47.980244] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-28T20:30:48.261454] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T20:30:48.610488] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T20:30:48.621338] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-28T20:30:48.621537] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-28T20:30:48.622398] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:30:48.622509] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:30:48.622552] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:30:48.622590] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-28T20:30:48.622670] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-28T20:30:48.622728] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-28T20:30:48.622772] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-28T20:30:48.622830] [INFO ] [MAIN ] Update Progress: 1617/2366 symbols completed. OXY took 31.4s. Estimated remaining: 1h 37m 37s. Rate: 7.7 symbols/min [2025-10-28T20:30:48.791899] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-28T20:30:48.795347] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:30:48.795484] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-28T20:30:48.796300] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-28T20:30:48.796413] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-28T20:30:48.796455] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-28T20:30:48.796495] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-28T20:30:48.796526] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-28T20:30:49.153214] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:30:49.580234] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-28T20:30:49.658141] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:30:50.380228] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-28T20:30:50.792106] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:30:51.180221] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-28T20:30:51.288970] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T20:30:51.980240] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-28T20:30:52.240582] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T20:30:52.780289] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-28T20:30:53.019484] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T20:30:53.580217] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-28T20:30:53.684731] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T20:30:54.380305] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-28T20:30:55.012292] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T20:30:55.029952] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T20:30:55.180262] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-28T20:30:55.980225] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-28T20:30:56.042109] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T20:30:56.780293] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-28T20:30:57.029305] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T20:30:57.462422] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T20:30:57.580243] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-28T20:30:58.380303] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-28T20:30:58.586803] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T20:30:59.018047] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:30:59.180265] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-28T20:30:59.980300] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-28T20:31:00.740046] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T20:31:00.755736] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T20:31:00.758314] [INFO ] [REMOTE ] PAC: Full fetch complete (16803 records). [2025-10-28T20:31:00.758384] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-28T20:31:00.787217] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-28T20:31:01.130762] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-28T20:31:01.130843] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-28T20:31:01.131222] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-28T20:31:01.131262] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-28T20:31:01.131876] [DEBUG] [LOCAL ] PAC: Trimmed 16803 records to 11226 (keeping 200 days of data) [2025-10-28T20:31:01.201130] [DEBUG] [LOCAL ] PAC: Primary data saved (11226 records). [2025-10-28T20:31:01.201270] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-28T20:31:01.201344] [INFO ] [MAIN ] Update Progress: 1618/2366 symbols completed. PAC took 33.9s. Estimated remaining: 1h 37m 32s. Rate: 7.7 symbols/min [2025-10-28T20:31:01.395801] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:01.447267] [DEBUG] [LOCAL ] PAGS: Loaded 52778 existing records from primary storage. [2025-10-28T20:31:01.447598] [INFO ] [MAIN ] PAGS: Loaded 52778 existing records. [2025-10-28T20:31:01.589117] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-28T20:31:01.630761] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:01.631127] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-28T20:31:01.631186] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-28T20:31:01.632215] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-28T20:31:01.632277] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-28T20:31:02.050174] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T20:31:02.081382] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:02.380291] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-28T20:31:02.732262] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T20:31:03.180261] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-28T20:31:03.982279] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-28T20:31:03.985306] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T20:31:04.299179] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T20:31:04.307195] [INFO ] [REMOTE ] PACS: Full fetch complete (50182 records). [2025-10-28T20:31:04.307357] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-28T20:31:04.731443] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-28T20:31:04.731534] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-28T20:31:04.732481] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-28T20:31:04.732543] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-28T20:31:04.733718] [DEBUG] [LOCAL ] PACS: Trimmed 50182 records to 34402 (keeping 200 days of data) [2025-10-28T20:31:04.788583] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-28T20:31:04.935499] [DEBUG] [LOCAL ] PACS: Primary data saved (34402 records). [2025-10-28T20:31:04.935620] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-28T20:31:04.935732] [INFO ] [MAIN ] Update Progress: 1619/2366 symbols completed. PACS took 25.7s. Estimated remaining: 1h 37m 22s. Rate: 7.7 symbols/min [2025-10-28T20:31:05.121728] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:05.142510] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T20:31:05.153187] [DEBUG] [LOCAL ] PAI: Loaded 2933 existing records from primary storage. [2025-10-28T20:31:05.153409] [INFO ] [MAIN ] PAI: Loaded 2933 existing records. [2025-10-28T20:31:05.337428] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:05.337731] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-28T20:31:05.337813] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-28T20:31:05.338016] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-28T20:31:05.338083] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-28T20:31:05.585347] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-28T20:31:05.697849] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:06.155522] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T20:31:06.380259] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-28T20:31:06.788839] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T20:31:06.887601] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T20:31:07.180275] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-28T20:31:07.980238] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-28T20:31:08.411090] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T20:31:08.777915] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T20:31:08.781892] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-28T20:31:09.580272] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-28T20:31:10.162709] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T20:31:10.380246] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-28T20:31:10.636765] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T20:31:10.644866] [INFO ] [REMOTE ] PACK: Full fetch complete (45764 records). [2025-10-28T20:31:10.645046] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-28T20:31:10.842001] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T20:31:11.059904] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-28T20:31:11.060029] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-28T20:31:11.061946] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-28T20:31:11.062027] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-28T20:31:11.063964] [DEBUG] [LOCAL ] PACK: Trimmed 45764 records to 31683 (keeping 200 days of data) [2025-10-28T20:31:11.180897] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-28T20:31:11.269535] [DEBUG] [LOCAL ] PACK: Primary data saved (31683 records). [2025-10-28T20:31:11.269782] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-28T20:31:11.269900] [INFO ] [MAIN ] Update Progress: 1620/2366 symbols completed. PACK took 35.4s. Estimated remaining: 1h 37m 14s. Rate: 7.7 symbols/min [2025-10-28T20:31:11.504217] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:11.504454] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-28T20:31:11.504494] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-28T20:31:11.504618] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-28T20:31:11.504695] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-28T20:31:11.504779] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-28T20:31:11.504820] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-28T20:31:11.908464] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:11.944673] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T20:31:11.980259] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-28T20:31:12.549672] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T20:31:12.780318] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-10-28T20:31:13.056713] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:31:13.057026] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-10-28T20:31:13.057134] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:31:13.057225] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-28T20:31:13.057309] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:31:13.057402] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-28T20:31:13.057484] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-28T20:31:13.057524] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-28T20:31:13.057564] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-28T20:31:13.057610] [INFO ] [MAIN ] Update Progress: 1621/2366 symbols completed. PAII took 1.8s. Estimated remaining: 1h 37m 3s. Rate: 7.7 symbols/min [2025-10-28T20:31:13.250597] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:13.284846] [DEBUG] [LOCAL ] PAM: Loaded 29099 existing records from primary storage. [2025-10-28T20:31:13.285214] [INFO ] [MAIN ] PAM: Loaded 29099 existing records. [2025-10-28T20:31:13.477296] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:13.477601] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-28T20:31:13.477682] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-28T20:31:13.478152] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-28T20:31:13.478254] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-28T20:31:13.584970] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-28T20:31:13.855691] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:14.380231] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-28T20:31:14.869444] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T20:31:15.025582] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T20:31:15.180291] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-28T20:31:15.980249] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-28T20:31:16.334555] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T20:31:16.780244] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-28T20:31:17.280789] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T20:31:17.580238] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-28T20:31:17.682140] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T20:31:18.380237] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-28T20:31:18.824416] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:31:18.916371] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T20:31:19.180242] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-28T20:31:19.629663] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T20:31:19.980291] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-28T20:31:20.368636] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T20:31:20.780244] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-28T20:31:21.580305] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-28T20:31:22.198683] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T20:31:22.347125] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T20:31:22.380227] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-28T20:31:23.180367] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-28T20:31:23.938585] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T20:31:23.980224] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-28T20:31:24.187529] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T20:31:24.404938] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T20:31:24.406484] [INFO ] [REMOTE ] PAI: Full fetch complete (4327 records). [2025-10-28T20:31:24.406562] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-28T20:31:24.756130] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-28T20:31:24.756206] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-28T20:31:24.756344] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-28T20:31:24.756383] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-28T20:31:24.756761] [DEBUG] [LOCAL ] PAI: Trimmed 4327 records to 2967 (keeping 200 days of data) [2025-10-28T20:31:24.774152] [DEBUG] [LOCAL ] PAI: Primary data saved (2967 records). [2025-10-28T20:31:24.774212] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-28T20:31:24.774277] [INFO ] [MAIN ] Update Progress: 1622/2366 symbols completed. PAI took 19.8s. Estimated remaining: 1h 36m 57s. Rate: 7.7 symbols/min [2025-10-28T20:31:24.785310] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-28T20:31:24.946170] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:24.982442] [DEBUG] [LOCAL ] PAR: Loaded 34182 existing records from primary storage. [2025-10-28T20:31:24.982750] [INFO ] [MAIN ] PAR: Loaded 34182 existing records. [2025-10-28T20:31:25.156813] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:25.157086] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-28T20:31:25.157140] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-28T20:31:25.157548] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-28T20:31:25.157607] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-28T20:31:25.505845] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:25.580210] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-28T20:31:25.964464] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T20:31:26.380254] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-28T20:31:26.788142] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:31:27.180243] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-28T20:31:27.820252] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T20:31:27.980406] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-28T20:31:28.079535] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T20:31:28.780293] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-28T20:31:29.385031] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T20:31:29.397442] [INFO ] [REMOTE ] PAGS: Full fetch complete (76498 records). [2025-10-28T20:31:29.397742] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-28T20:31:29.585602] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-28T20:31:30.008722] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-28T20:31:30.008845] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-28T20:31:30.010211] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-28T20:31:30.010369] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-28T20:31:30.027488] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T20:31:30.033234] [DEBUG] [LOCAL ] PAGS: Trimmed 76498 records to 52787 (keeping 200 days of data) [2025-10-28T20:31:30.371272] [DEBUG] [LOCAL ] PAGS: Primary data saved (52787 records). [2025-10-28T20:31:30.371393] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-28T20:31:30.371468] [INFO ] [MAIN ] Update Progress: 1623/2366 symbols completed. PAGS took 29.2s. Estimated remaining: 1h 36m 48s. Rate: 7.7 symbols/min [2025-10-28T20:31:30.385358] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-28T20:31:30.541816] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:30.541984] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-28T20:31:30.542034] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-28T20:31:30.542140] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-28T20:31:30.542212] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-28T20:31:30.542254] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-28T20:31:30.542285] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-28T20:31:30.907824] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:30.909363] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T20:31:31.180243] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-28T20:31:31.394842] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T20:31:31.980276] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-28T20:31:32.389200] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:31:32.780249] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-28T20:31:32.981260] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T20:31:33.580227] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-28T20:31:33.638302] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:31:34.380279] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-28T20:31:34.706800] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T20:31:35.180252] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-28T20:31:35.461926] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T20:31:35.980240] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-28T20:31:36.083018] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T20:31:36.780285] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-28T20:31:36.834715] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T20:31:36.839449] [INFO ] [REMOTE ] PAG: Full fetch complete (31080 records). [2025-10-28T20:31:36.839524] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-28T20:31:37.206345] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-28T20:31:37.206424] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-28T20:31:37.207075] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-28T20:31:37.207136] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-28T20:31:37.207857] [DEBUG] [LOCAL ] PAG: Trimmed 31080 records to 20871 (keeping 200 days of data) [2025-10-28T20:31:37.334109] [DEBUG] [LOCAL ] PAG: Primary data saved (20871 records). [2025-10-28T20:31:37.334228] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-28T20:31:37.334300] [INFO ] [MAIN ] Update Progress: 1624/2366 symbols completed. PAG took 48.7s. Estimated remaining: 1h 36m 40s. Rate: 7.7 symbols/min [2025-10-28T20:31:37.499314] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:37.549810] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-28T20:31:37.550108] [INFO ] [MAIN ] PATH: Loaded 53680 existing records. [2025-10-28T20:31:37.585485] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-28T20:31:37.727640] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:37.727890] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-28T20:31:37.727938] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-28T20:31:37.728424] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-28T20:31:37.728480] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-28T20:31:38.050585] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:31:38.107788] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:38.380247] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-28T20:31:38.949445] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T20:31:39.180248] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-28T20:31:39.980252] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-28T20:31:40.136669] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T20:31:40.587180] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-28T20:31:40.780221] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-28T20:31:40.999907] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T20:31:41.580239] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-28T20:31:42.380247] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-28T20:31:42.688797] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-28T20:31:43.180220] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-28T20:31:43.289910] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-28T20:31:43.379457] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T20:31:43.980256] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-28T20:31:44.780253] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-28T20:31:45.120210] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-28T20:31:45.190943] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T20:31:45.580288] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-28T20:31:45.940084] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T20:31:46.380255] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-28T20:31:46.791939] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T20:31:47.180242] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-28T20:31:47.991401] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-28T20:31:47.997167] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T20:31:48.279243] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T20:31:48.286616] [INFO ] [REMOTE ] PAM: Full fetch complete (42632 records). [2025-10-28T20:31:48.286746] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-28T20:31:48.653356] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-28T20:31:48.653434] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-28T20:31:48.654294] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-28T20:31:48.654354] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-28T20:31:48.655251] [DEBUG] [LOCAL ] PAM: Trimmed 42632 records to 29215 (keeping 200 days of data) [2025-10-28T20:31:48.790174] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-28T20:31:48.823309] [DEBUG] [LOCAL ] PAM: Primary data saved (29215 records). [2025-10-28T20:31:48.823439] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-28T20:31:48.823520] [INFO ] [MAIN ] Update Progress: 1625/2366 symbols completed. PAM took 35.8s. Estimated remaining: 1h 36m 34s. Rate: 7.7 symbols/min [2025-10-28T20:31:48.988046] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:49.008417] [DEBUG] [LOCAL ] PAXS: Loaded 20549 existing records from primary storage. [2025-10-28T20:31:49.008694] [INFO ] [MAIN ] PAXS: Loaded 20549 existing records. [2025-10-28T20:31:49.184371] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:49.184588] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-28T20:31:49.184634] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-28T20:31:49.184917] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-28T20:31:49.184974] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-28T20:31:49.545073] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:49.567681] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T20:31:49.580197] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-28T20:31:50.274805] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T20:31:50.380244] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-28T20:31:50.738539] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T20:31:50.748694] [INFO ] [REMOTE ] PAR: Full fetch complete (49246 records). [2025-10-28T20:31:50.749119] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-28T20:31:51.136170] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-28T20:31:51.136249] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-28T20:31:51.137375] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-28T20:31:51.137439] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-28T20:31:51.138553] [DEBUG] [LOCAL ] PAR: Trimmed 49246 records to 34132 (keeping 200 days of data) [2025-10-28T20:31:51.185563] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-28T20:31:51.337223] [DEBUG] [LOCAL ] PAR: Primary data saved (34132 records). [2025-10-28T20:31:51.337357] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-28T20:31:51.337436] [INFO ] [MAIN ] Update Progress: 1626/2366 symbols completed. PAR took 26.6s. Estimated remaining: 1h 36m 24s. Rate: 7.7 symbols/min [2025-10-28T20:31:51.503245] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:31:51.538418] [DEBUG] [LOCAL ] PAY: Loaded 38313 existing records from primary storage. [2025-10-28T20:31:51.538755] [INFO ] [MAIN ] PAY: Loaded 38313 existing records. [2025-10-28T20:31:51.714928] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:31:51.715127] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-28T20:31:51.715174] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-28T20:31:51.715566] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-28T20:31:51.715624] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-28T20:31:51.986627] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-28T20:31:52.074969] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:31:52.303919] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T20:31:52.713308] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T20:31:52.780221] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-28T20:31:52.909395] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T20:31:53.580317] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-28T20:31:53.877514] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:31:54.184247] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T20:31:54.380311] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-28T20:31:55.112527] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T20:31:55.180309] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-28T20:31:55.980344] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-28T20:31:56.780307] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-28T20:31:57.262500] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T20:31:57.344385] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-28T20:31:57.580294] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-28T20:31:57.924105] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:31:58.380292] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-28T20:31:59.105683] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T20:31:59.180225] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-28T20:31:59.312121] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T20:31:59.980241] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-28T20:32:00.457774] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:32:00.780310] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-28T20:32:01.038728] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T20:32:01.580365] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-28T20:32:02.380360] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-28T20:32:02.689382] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-28T20:32:03.085115] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T20:32:03.094307] [INFO ] [REMOTE ] PARR: Full fetch complete (69115 records). [2025-10-28T20:32:03.094455] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-28T20:32:03.185834] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-28T20:32:03.491822] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-28T20:32:03.491895] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-28T20:32:03.492944] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-28T20:32:03.493005] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-28T20:32:03.494226] [DEBUG] [LOCAL ] PARR: Trimmed 69115 records to 47790 (keeping 200 days of data) [2025-10-28T20:32:03.709116] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T20:32:03.793292] [DEBUG] [LOCAL ] PARR: Primary data saved (47790 records). [2025-10-28T20:32:03.793411] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-28T20:32:03.793481] [INFO ] [MAIN ] Update Progress: 1627/2366 symbols completed. PARR took 33.4s. Estimated remaining: 1h 36m 18s. Rate: 7.7 symbols/min [2025-10-28T20:32:03.961445] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:03.961602] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-28T20:32:03.961638] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-28T20:32:03.961774] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-28T20:32:03.961814] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-28T20:32:03.961854] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-28T20:32:03.961885] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-28T20:32:03.991896] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-28T20:32:04.316233] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:04.780217] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-28T20:32:04.914791] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T20:32:05.182586] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-28T20:32:05.580300] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-28T20:32:05.966296] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T20:32:06.380309] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-28T20:32:06.534230] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T20:32:07.180274] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-28T20:32:07.379463] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T20:32:07.978051] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T20:32:07.982349] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-28T20:32:08.780241] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-28T20:32:09.339767] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T20:32:09.580249] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-28T20:32:09.941355] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T20:32:10.380251] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-28T20:32:10.797663] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T20:32:11.158263] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T20:32:11.180210] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-28T20:32:11.980236] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-28T20:32:12.068778] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T20:32:12.073159] [INFO ] [REMOTE ] PAXS: Full fetch complete (29353 records). [2025-10-28T20:32:12.073254] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-28T20:32:12.487244] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-28T20:32:12.487325] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-28T20:32:12.488070] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-28T20:32:12.488136] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-28T20:32:12.488931] [DEBUG] [LOCAL ] PAXS: Trimmed 29353 records to 20453 (keeping 200 days of data) [2025-10-28T20:32:12.612048] [DEBUG] [LOCAL ] PAXS: Primary data saved (20453 records). [2025-10-28T20:32:12.612169] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-28T20:32:12.612247] [INFO ] [MAIN ] Update Progress: 1628/2366 symbols completed. PAXS took 23.8s. Estimated remaining: 1h 36m 11s. Rate: 7.7 symbols/min [2025-10-28T20:32:12.781172] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-28T20:32:12.781099] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:12.782164] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-28T20:32:12.782225] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-28T20:32:12.782333] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-28T20:32:12.782375] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-28T20:32:12.782418] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-28T20:32:12.782451] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-28T20:32:13.146188] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:13.252347] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T20:32:13.580251] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-28T20:32:14.004149] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T20:32:14.380318] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-28T20:32:14.884719] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T20:32:15.180299] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-28T20:32:15.607951] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T20:32:15.980304] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-28T20:32:16.780297] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-28T20:32:17.128882] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-28T20:32:17.184294] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T20:32:17.580250] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-28T20:32:18.051501] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T20:32:18.380320] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-28T20:32:18.769693] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T20:32:19.180260] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-28T20:32:19.598288] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:32:19.980276] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-28T20:32:20.294393] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T20:32:20.780295] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-28T20:32:21.394976] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T20:32:21.402811] [INFO ] [REMOTE ] PAY: Full fetch complete (53860 records). [2025-10-28T20:32:21.402972] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-28T20:32:21.590080] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-28T20:32:21.783044] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-28T20:32:21.783165] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-28T20:32:21.784387] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-28T20:32:21.784536] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-28T20:32:21.786240] [DEBUG] [LOCAL ] PAY: Trimmed 53860 records to 38268 (keeping 200 days of data) [2025-10-28T20:32:22.039974] [DEBUG] [LOCAL ] PAY: Primary data saved (38268 records). [2025-10-28T20:32:22.040690] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-28T20:32:22.041599] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T20:32:22.041761] [INFO ] [MAIN ] Update Progress: 1629/2366 symbols completed. PAY took 30.7s. Estimated remaining: 1h 36m 3s. Rate: 7.7 symbols/min [2025-10-28T20:32:22.232874] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:22.277357] [DEBUG] [LOCAL ] PBA: Loaded 49049 existing records from primary storage. [2025-10-28T20:32:22.277708] [INFO ] [MAIN ] PBA: Loaded 49049 existing records. [2025-10-28T20:32:22.384520] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-28T20:32:22.469798] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:32:22.470230] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-28T20:32:22.470396] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-28T20:32:22.470963] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-28T20:32:22.471023] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-28T20:32:22.681730] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T20:32:22.786471] [INFO ] [REMOTE ] PATH: Full fetch complete (77462 records). [2025-10-28T20:32:22.811689] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-28T20:32:22.824305] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:32:22.834898] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:32:22.854406] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:32:22.870135] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-28T20:32:22.876633] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-28T20:32:22.895540] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-28T20:32:22.899360] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:22.899823] [DEBUG] [LOCAL ] PATH: Deleted derivative data file. [2025-10-28T20:32:22.900266] [INFO ] [MAIN ] Update Progress: 1630/2366 symbols completed. PATH took 45.6s. Estimated remaining: 1h 35m 52s. Rate: 7.7 symbols/min [2025-10-28T20:32:23.104394] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:23.104570] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-28T20:32:23.104617] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-28T20:32:23.104787] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-28T20:32:23.104832] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-28T20:32:23.104874] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-28T20:32:23.104918] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-28T20:32:23.185486] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-28T20:32:23.467781] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:23.727532] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T20:32:23.980252] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-28T20:32:24.521540] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T20:32:24.780300] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-28T20:32:25.067635] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T20:32:25.580318] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-28T20:32:26.327983] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T20:32:26.380233] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-28T20:32:27.046993] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T20:32:27.180288] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-28T20:32:27.980278] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-28T20:32:28.109528] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T20:32:28.657145] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T20:32:28.780261] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-28T20:32:29.326760] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T20:32:29.580259] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-28T20:32:30.143988] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:32:30.380352] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-28T20:32:31.014836] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:32:31.180231] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-28T20:32:31.809757] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T20:32:31.980312] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-28T20:32:32.594509] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T20:32:32.780269] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-28T20:32:33.175777] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T20:32:33.580345] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-28T20:32:34.267615] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T20:32:34.380251] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-28T20:32:34.875216] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T20:32:34.882445] [INFO ] [REMOTE ] PAYC: Full fetch complete (53031 records). [2025-10-28T20:32:34.882566] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-28T20:32:35.185410] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-28T20:32:35.262723] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-28T20:32:35.262801] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-28T20:32:35.263710] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-28T20:32:35.263769] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-28T20:32:35.264822] [DEBUG] [LOCAL ] PAYC: Trimmed 53031 records to 35569 (keeping 200 days of data) [2025-10-28T20:32:35.483344] [DEBUG] [LOCAL ] PAYC: Primary data saved (35569 records). [2025-10-28T20:32:35.483493] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-28T20:32:35.483586] [INFO ] [MAIN ] Update Progress: 1631/2366 symbols completed. PAYC took 31.7s. Estimated remaining: 1h 35m 47s. Rate: 7.7 symbols/min [2025-10-28T20:32:35.652607] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:35.652772] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-28T20:32:35.652815] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-28T20:32:35.652918] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-28T20:32:35.652983] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-28T20:32:35.653087] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-28T20:32:35.653140] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-28T20:32:35.989477] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-28T20:32:36.020208] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:36.047598] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T20:32:36.780276] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-28T20:32:37.196774] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T20:32:37.334912] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-28T20:32:37.580285] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-28T20:32:38.216738] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:32:38.380222] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-28T20:32:38.531948] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T20:32:39.180250] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-28T20:32:39.980285] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-28T20:32:40.140460] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T20:32:40.569850] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T20:32:40.756224] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T20:32:40.780212] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-28T20:32:41.580269] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-28T20:32:42.380249] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-28T20:32:42.446577] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T20:32:42.888004] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T20:32:43.180259] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-28T20:32:43.802050] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T20:32:43.980256] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-28T20:32:44.552912] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T20:32:44.563816] [INFO ] [REMOTE ] PBA: Full fetch complete (71618 records). [2025-10-28T20:32:44.563981] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-28T20:32:44.786351] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-28T20:32:44.980749] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-28T20:32:44.980844] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-28T20:32:44.982012] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-28T20:32:44.982120] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-28T20:32:44.999802] [DEBUG] [LOCAL ] PBA: Trimmed 71618 records to 48986 (keeping 200 days of data) [2025-10-28T20:32:45.001169] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T20:32:45.310533] [DEBUG] [LOCAL ] PBA: Primary data saved (48986 records). [2025-10-28T20:32:45.310719] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-28T20:32:45.311261] [INFO ] [MAIN ] Update Progress: 1632/2366 symbols completed. PBA took 23.3s. Estimated remaining: 1h 35m 40s. Rate: 7.7 symbols/min [2025-10-28T20:32:45.487500] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:45.487669] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-28T20:32:45.487724] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-28T20:32:45.487843] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-28T20:32:45.487901] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-28T20:32:45.487981] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-28T20:32:45.488028] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-28T20:32:45.585338] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-28T20:32:45.866013] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:46.189747] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T20:32:46.380254] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-28T20:32:47.180236] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-28T20:32:47.347755] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T20:32:47.813704] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T20:32:47.980247] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-28T20:32:48.675748] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T20:32:48.780252] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-28T20:32:49.474946] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T20:32:49.580252] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-28T20:32:49.876349] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T20:32:50.380306] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-28T20:32:50.857790] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T20:32:50.866985] [INFO ] [REMOTE ] PB: Full fetch complete (60025 records). [2025-10-28T20:32:50.867140] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-28T20:32:51.183996] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-28T20:32:51.277257] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-28T20:32:51.277330] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-28T20:32:51.278346] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-28T20:32:51.278408] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-28T20:32:51.279537] [DEBUG] [LOCAL ] PB: Trimmed 60025 records to 42433 (keeping 200 days of data) [2025-10-28T20:32:51.534288] [DEBUG] [LOCAL ] PB: Primary data saved (42433 records). [2025-10-28T20:32:51.534436] [INFO ] [MAIN ] PB: Full history saved. [2025-10-28T20:32:51.534509] [INFO ] [MAIN ] Update Progress: 1633/2366 symbols completed. PB took 38.9s. Estimated remaining: 1h 35m 31s. Rate: 7.7 symbols/min [2025-10-28T20:32:51.741168] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:51.790434] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-28T20:32:51.790760] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-10-28T20:32:51.980516] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T20:32:51.995291] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-28T20:32:52.011105] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:32:52.011839] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-28T20:32:52.011910] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-28T20:32:52.013297] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-28T20:32:52.013354] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-28T20:32:52.362082] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:52.616773] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T20:32:52.780257] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-28T20:32:53.203174] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T20:32:53.580258] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-28T20:32:54.145459] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:32:54.380214] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-28T20:32:54.530267] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T20:32:55.180286] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-28T20:32:55.805217] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:32:55.980218] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-28T20:32:56.313109] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:32:56.780265] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-28T20:32:57.580304] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-28T20:32:58.041323] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-28T20:32:58.363400] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T20:32:58.374324] [INFO ] [REMOTE ] PBF: Full fetch complete (76763 records). [2025-10-28T20:32:58.374471] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-28T20:32:58.386611] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-28T20:32:58.773501] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-28T20:32:58.773752] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-28T20:32:58.775338] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-28T20:32:58.775400] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-28T20:32:58.776913] [DEBUG] [LOCAL ] PBF: Trimmed 76763 records to 53092 (keeping 200 days of data) [2025-10-28T20:32:59.096467] [DEBUG] [LOCAL ] PBF: Primary data saved (53092 records). [2025-10-28T20:32:59.106226] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-28T20:32:59.112231] [INFO ] [MAIN ] Update Progress: 1634/2366 symbols completed. PBF took 36.2s. Estimated remaining: 1h 35m 23s. Rate: 7.7 symbols/min [2025-10-28T20:32:59.187180] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-28T20:32:59.213206] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T20:32:59.314906] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:32:59.332665] [DEBUG] [LOCAL ] PBT: Loaded 17086 existing records from primary storage. [2025-10-28T20:32:59.332911] [INFO ] [MAIN ] PBT: Loaded 17086 existing records. [2025-10-28T20:32:59.514285] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:32:59.514482] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-28T20:32:59.514530] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-28T20:32:59.515085] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-28T20:32:59.515146] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-28T20:32:59.871131] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:32:59.980231] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-28T20:33:00.343052] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T20:33:00.387802] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-28T20:33:00.780304] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-28T20:33:01.580238] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-28T20:33:02.380306] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-28T20:33:02.779311] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T20:33:03.114275] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-10-28T20:33:03.180238] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-28T20:33:03.450503] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T20:33:03.980285] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-28T20:33:04.072585] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (3.29 seconds). [2025-10-28T20:33:04.414566] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T20:33:04.421522] [INFO ] [REMOTE ] PBH: Full fetch complete (44836 records). [2025-10-28T20:33:04.421696] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-28T20:33:04.792895] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-28T20:33:04.790391] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-28T20:33:04.793862] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-28T20:33:04.794741] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-28T20:33:04.794920] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-28T20:33:04.796022] [DEBUG] [LOCAL ] PBH: Trimmed 44836 records to 32203 (keeping 200 days of data) [2025-10-28T20:33:04.978829] [DEBUG] [LOCAL ] PBH: Primary data saved (32203 records). [2025-10-28T20:33:04.978947] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-28T20:33:04.979017] [INFO ] [MAIN ] Update Progress: 1635/2366 symbols completed. PBH took 29.5s. Estimated remaining: 1h 35m 15s. Rate: 7.7 symbols/min [2025-10-28T20:33:05.148135] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:05.158275] [DEBUG] [LOCAL ] PCF: Loaded 8934 existing records from primary storage. [2025-10-28T20:33:05.158469] [INFO ] [MAIN ] PCF: Loaded 8934 existing records. [2025-10-28T20:33:05.336941] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:33:05.337285] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-28T20:33:05.337357] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-28T20:33:05.337625] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-28T20:33:05.337706] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-28T20:33:05.583258] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-28T20:33:05.723070] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:33:05.725261] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T20:33:06.264332] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T20:33:06.380268] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-28T20:33:06.825899] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-28T20:33:07.185350] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-28T20:33:07.191433] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:33:07.923005] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T20:33:07.980249] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-28T20:33:08.769346] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T20:33:08.780242] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-28T20:33:09.422056] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T20:33:09.580328] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-28T20:33:10.380306] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-28T20:33:11.118264] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T20:33:11.180205] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-28T20:33:11.609189] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-28T20:33:11.786015] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T20:33:11.980253] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-28T20:33:12.780274] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-28T20:33:13.580225] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-28T20:33:13.648103] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T20:33:13.839623] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-28T20:33:14.297933] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T20:33:14.380242] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-28T20:33:15.180231] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-28T20:33:15.929273] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T20:33:15.954638] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T20:33:15.980224] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-28T20:33:16.661046] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T20:33:16.780265] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-28T20:33:17.416764] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T20:33:17.580243] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-28T20:33:18.380269] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-28T20:33:18.466538] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T20:33:19.180273] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-28T20:33:19.980258] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-28T20:33:20.015237] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T20:33:20.141519] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T20:33:20.780272] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-28T20:33:21.297853] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T20:33:21.580328] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-28T20:33:21.769586] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T20:33:22.240378] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T20:33:22.242597] [INFO ] [REMOTE ] PCF: Full fetch complete (13298 records). [2025-10-28T20:33:22.242691] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-28T20:33:22.385321] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-28T20:33:22.606397] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-28T20:33:22.606474] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-28T20:33:22.606819] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-28T20:33:22.606880] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-28T20:33:22.607341] [DEBUG] [LOCAL ] PCF: Trimmed 13298 records to 8935 (keeping 200 days of data) [2025-10-28T20:33:22.659085] [DEBUG] [LOCAL ] PCF: Primary data saved (8935 records). [2025-10-28T20:33:22.659204] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-28T20:33:22.659282] [INFO ] [MAIN ] Update Progress: 1636/2366 symbols completed. PCF took 17.7s. Estimated remaining: 1h 35m 11s. Rate: 7.7 symbols/min [2025-10-28T20:33:22.837580] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:22.837795] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-28T20:33:22.837847] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-28T20:33:22.837960] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-28T20:33:22.838001] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-28T20:33:22.838041] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-28T20:33:22.838073] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-28T20:33:23.187760] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:33:23.184139] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-28T20:33:23.980230] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-28T20:33:24.143097] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-28T20:33:24.153270] [INFO ] [REMOTE ] PBI: Full fetch complete (72484 records). [2025-10-28T20:33:24.153439] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-28T20:33:24.439028] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:33:24.575596] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-28T20:33:24.575694] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-28T20:33:24.576769] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-28T20:33:24.576830] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-28T20:33:24.578102] [DEBUG] [LOCAL ] PBI: Trimmed 72484 records to 49833 (keeping 200 days of data) [2025-10-28T20:33:24.780629] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-28T20:33:24.870699] [DEBUG] [LOCAL ] PBI: Primary data saved (49833 records). [2025-10-28T20:33:24.870820] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-28T20:33:24.870890] [INFO ] [MAIN ] Update Progress: 1637/2366 symbols completed. PBI took 39.6s. Estimated remaining: 1h 35m 1s. Rate: 7.7 symbols/min [2025-10-28T20:33:25.580274] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-28T20:33:25.706485] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T20:33:26.380280] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-28T20:33:26.420770] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T20:33:26.577236] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-28T20:33:27.180310] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-28T20:33:27.760424] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T20:33:27.980222] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-28T20:33:27.995144] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T20:33:27.998478] [INFO ] [REMOTE ] PBT: Full fetch complete (24439 records). [2025-10-28T20:33:27.998547] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-28T20:33:28.357105] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-28T20:33:28.357189] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-28T20:33:28.357679] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-28T20:33:28.357738] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-28T20:33:28.358378] [DEBUG] [LOCAL ] PBT: Trimmed 24439 records to 17051 (keeping 200 days of data) [2025-10-28T20:33:28.459021] [DEBUG] [LOCAL ] PBT: Primary data saved (17051 records). [2025-10-28T20:33:28.459135] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-28T20:33:28.459209] [INFO ] [MAIN ] Update Progress: 1638/2366 symbols completed. PBT took 29.3s. Estimated remaining: 1h 34m 51s. Rate: 7.7 symbols/min [2025-10-28T20:33:28.780305] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-28T20:33:29.751236] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T20:33:29.763314] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-28T20:33:30.407773] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T20:33:30.419204] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-28T20:33:31.678936] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T20:33:31.690871] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-28T20:33:32.073905] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T20:33:32.084683] [INFO ] [REMOTE ] PBR: Full fetch complete (77882 records). [2025-10-28T20:33:32.084867] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-28T20:33:32.490295] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-28T20:33:32.490397] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-28T20:33:32.491512] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-28T20:33:32.491577] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-28T20:33:32.493029] [DEBUG] [LOCAL ] PBR: Trimmed 77882 records to 53713 (keeping 200 days of data) [2025-10-28T20:33:32.820543] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-10-28T20:33:32.820717] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-28T20:33:32.820833] [INFO ] [MAIN ] Update Progress: 1639/2366 symbols completed. PBR took 41.3s. Estimated remaining: 1h 34m 42s. Rate: 7.7 symbols/min [2025-10-28T20:33:33.151732] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T20:33:33.162929] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-28T20:33:34.783245] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T20:33:34.794073] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-28T20:33:36.698184] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-28T20:33:36.709780] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-28T20:33:38.355620] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T20:33:38.367101] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-28T20:33:39.974057] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T20:33:39.985687] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-28T20:33:41.843860] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-28T20:33:41.854852] [INFO ] [REMOTE ] PCG: Full fetch complete (77898 records). [2025-10-28T20:33:41.854981] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-28T20:33:42.249554] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-10-28T20:33:42.249632] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-10-28T20:33:42.250765] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-10-28T20:33:42.250827] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-10-28T20:33:42.252260] [DEBUG] [LOCAL ] PCG: Trimmed 77898 records to 53719 (keeping 200 days of data) [2025-10-28T20:33:42.568755] [DEBUG] [LOCAL ] PCG: Primary data saved (53719 records). [2025-10-28T20:33:42.568881] [INFO ] [MAIN ] PCG: Full history saved. [2025-10-28T20:33:42.568950] [INFO ] [MAIN ] Update Progress: 1640/2366 symbols completed. PCG took 19.9s. Estimated remaining: 1h 34m 35s. Rate: 7.7 symbols/min [2025-10-28T20:33:43.130534] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:43.239446] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:43.247170] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:43.267953] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:43.278389] [DEBUG] [LOCAL ] PCM: Loaded 6775 existing records from primary storage. [2025-10-28T20:33:43.278728] [INFO ] [MAIN ] PCM: Loaded 6775 existing records. [2025-10-28T20:33:43.360762] [DEBUG] [LOCAL ] PCQ: Loaded 12003 existing records from primary storage. [2025-10-28T20:33:43.383193] [INFO ] [MAIN ] PCQ: Loaded 12003 existing records. [2025-10-28T20:33:43.410034] [DEBUG] [LOCAL ] PCN: Loaded 25100 existing records from primary storage. [2025-10-28T20:33:43.419962] [INFO ] [MAIN ] PCN: Loaded 25100 existing records. [2025-10-28T20:33:43.656638] [DEBUG] [LOCAL ] PCOR: Loaded 47151 existing records from primary storage. [2025-10-28T20:33:43.688903] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:33:43.704890] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-28T20:33:43.712691] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-28T20:33:43.699590] [INFO ] [MAIN ] PCOR: Loaded 47151 existing records. [2025-10-28T20:33:43.738860] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-28T20:33:43.784703] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-28T20:33:43.840871] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:33:43.929158] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-28T20:33:43.981992] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-28T20:33:44.050520] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-28T20:33:44.076827] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-28T20:33:44.071550] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:33:44.082417] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-28T20:33:44.094039] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-28T20:33:44.159147] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-28T20:33:44.203332] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-28T20:33:44.421321] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:33:44.471216] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-28T20:33:44.507265] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-28T20:33:44.631907] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-28T20:33:44.670265] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-28T20:33:45.279180] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:33:45.314793] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:33:45.330577] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-28T20:33:45.339244] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-28T20:33:45.524051] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:33:45.529919] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-28T20:33:45.604524] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:33:45.604856] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-28T20:33:46.521560] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T20:33:46.525592] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-28T20:33:46.658638] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T20:33:46.662248] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-28T20:33:46.776406] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T20:33:46.781083] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-28T20:33:47.056566] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:33:47.065741] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-28T20:33:47.164278] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T20:33:47.166693] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-28T20:33:47.291784] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T20:33:47.294306] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-28T20:33:47.614562] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T20:33:47.620089] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-28T20:33:47.841843] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T20:33:47.845124] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-28T20:33:47.953742] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T20:33:47.956971] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-28T20:33:48.244666] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:33:48.254703] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-28T20:33:48.387802] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T20:33:48.393561] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-28T20:33:48.400451] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T20:33:48.402983] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-28T20:33:48.587803] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T20:33:48.780294] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-28T20:33:48.847633] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T20:33:49.209822] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T20:33:49.250213] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T20:33:49.580357] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-28T20:33:49.624481] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:33:50.155192] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T20:33:50.380297] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-28T20:33:50.976742] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T20:33:51.180318] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-28T20:33:51.980305] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-28T20:33:52.132069] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T20:33:52.780276] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-28T20:33:52.848677] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T20:33:53.580244] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-28T20:33:54.352578] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T20:33:54.378265] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T20:33:54.382349] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-28T20:33:55.180309] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-28T20:33:55.692437] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T20:33:55.980254] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-28T20:33:56.074272] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T20:33:56.780250] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-28T20:33:57.382176] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T20:33:57.580232] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-28T20:33:57.679912] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T20:33:58.380221] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-28T20:33:58.519914] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T20:33:59.108766] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T20:33:59.112070] [INFO ] [REMOTE ] PCQ: Full fetch complete (17021 records). [2025-10-28T20:33:59.112183] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-28T20:33:59.185364] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-28T20:33:59.478669] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-28T20:33:59.478759] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-28T20:33:59.479174] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-28T20:33:59.479214] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-28T20:33:59.479853] [DEBUG] [LOCAL ] PCQ: Trimmed 17021 records to 11878 (keeping 200 days of data) [2025-10-28T20:33:59.548343] [DEBUG] [LOCAL ] PCQ: Primary data saved (11878 records). [2025-10-28T20:33:59.548465] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-28T20:33:59.548541] [INFO ] [MAIN ] Update Progress: 1641/2366 symbols completed. PCQ took 17.0s. Estimated remaining: 1h 34m 31s. Rate: 7.7 symbols/min [2025-10-28T20:33:59.715321] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:33:59.757828] [DEBUG] [LOCAL ] PD: Loaded 48212 existing records from primary storage. [2025-10-28T20:33:59.758134] [INFO ] [MAIN ] PD: Loaded 48212 existing records. [2025-10-28T20:33:59.945852] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:33:59.946072] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-28T20:33:59.946121] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-28T20:33:59.946419] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-28T20:33:59.946484] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-28T20:33:59.988231] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-28T20:34:00.306735] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:00.407096] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T20:34:00.780237] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-28T20:34:01.553787] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T20:34:01.580214] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-28T20:34:01.807116] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T20:34:02.380291] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-28T20:34:03.083851] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T20:34:03.180239] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-28T20:34:03.899542] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:34:03.980214] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-28T20:34:04.567699] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T20:34:04.780261] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-28T20:34:05.288453] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:34:05.580247] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-28T20:34:06.104697] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T20:34:06.107584] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:34:06.120344] [INFO ] [REMOTE ] PCOR: Full fetch complete (69084 records). [2025-10-28T20:34:06.120611] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-28T20:34:06.385358] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-28T20:34:06.523971] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-28T20:34:06.524084] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-28T20:34:06.525304] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-28T20:34:06.525371] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-28T20:34:06.526863] [DEBUG] [LOCAL ] PCOR: Trimmed 69084 records to 47096 (keeping 200 days of data) [2025-10-28T20:34:06.800433] [DEBUG] [LOCAL ] PCOR: Primary data saved (47096 records). [2025-10-28T20:34:06.800555] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-28T20:34:06.800632] [INFO ] [MAIN ] Update Progress: 1642/2366 symbols completed. PCOR took 24.2s. Estimated remaining: 1h 34m 23s. Rate: 7.7 symbols/min [2025-10-28T20:34:06.981756] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:06.981932] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-28T20:34:06.981968] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-28T20:34:06.982080] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-28T20:34:06.982121] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-28T20:34:06.982162] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-28T20:34:06.982195] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-28T20:34:07.179995] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T20:34:07.180773] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-28T20:34:07.393419] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:07.980313] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-28T20:34:08.780234] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-28T20:34:08.836390] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T20:34:09.020061] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T20:34:09.414188] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T20:34:09.416343] [INFO ] [REMOTE ] PCM: Full fetch complete (10118 records). [2025-10-28T20:34:09.416430] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-28T20:34:09.580256] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-28T20:34:09.790465] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-28T20:34:09.790537] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-28T20:34:09.790846] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-28T20:34:09.790908] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-28T20:34:09.791336] [DEBUG] [LOCAL ] PCM: Trimmed 10118 records to 6740 (keeping 200 days of data) [2025-10-28T20:34:09.830549] [DEBUG] [LOCAL ] PCM: Primary data saved (6740 records). [2025-10-28T20:34:09.830710] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-28T20:34:09.830803] [INFO ] [MAIN ] Update Progress: 1643/2366 symbols completed. PCM took 27.3s. Estimated remaining: 1h 34m 13s. Rate: 7.7 symbols/min [2025-10-28T20:34:10.007954] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:10.075325] [DEBUG] [LOCAL ] PDI: Loaded 50169 existing records from primary storage. [2025-10-28T20:34:10.075746] [INFO ] [MAIN ] PDI: Loaded 50169 existing records. [2025-10-28T20:34:10.156770] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T20:34:10.258170] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:34:10.258410] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-28T20:34:10.258458] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-28T20:34:10.259273] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-28T20:34:10.259331] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-28T20:34:10.395357] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-28T20:34:10.607457] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:11.180287] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-28T20:34:11.652387] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T20:34:11.783000] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T20:34:11.980271] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-28T20:34:12.780254] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-28T20:34:13.580281] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-28T20:34:14.006857] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T20:34:14.012679] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T20:34:14.079173] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-28T20:34:14.380289] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-28T20:34:15.180283] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-28T20:34:15.693831] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:34:15.980283] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-28T20:34:16.263609] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T20:34:16.457547] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T20:34:16.780261] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-28T20:34:17.580270] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-28T20:34:18.380247] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-28T20:34:18.425861] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T20:34:18.841112] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T20:34:18.948564] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T20:34:19.180251] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-28T20:34:19.980276] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-28T20:34:20.780240] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-28T20:34:20.860724] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T20:34:21.442709] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T20:34:21.580296] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-28T20:34:21.881972] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T20:34:21.887977] [INFO ] [REMOTE ] PCN: Full fetch complete (34947 records). [2025-10-28T20:34:21.888074] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-28T20:34:22.283436] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-28T20:34:22.283541] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-28T20:34:22.284316] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-28T20:34:22.284378] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-28T20:34:22.285168] [DEBUG] [LOCAL ] PCN: Trimmed 34947 records to 24966 (keeping 200 days of data) [2025-10-28T20:34:22.380722] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-28T20:34:22.437398] [DEBUG] [LOCAL ] PCN: Primary data saved (24966 records). [2025-10-28T20:34:22.437520] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-28T20:34:22.437595] [INFO ] [MAIN ] Update Progress: 1644/2366 symbols completed. PCN took 39.9s. Estimated remaining: 1h 34m 8s. Rate: 7.7 symbols/min [2025-10-28T20:34:22.606053] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:22.639817] [DEBUG] [LOCAL ] PDM: Loaded 39478 existing records from primary storage. [2025-10-28T20:34:22.640105] [INFO ] [MAIN ] PDM: Loaded 39478 existing records. [2025-10-28T20:34:22.818858] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:34:22.819059] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-28T20:34:22.819105] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-28T20:34:22.819716] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-28T20:34:22.819775] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-28T20:34:23.186852] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-28T20:34:23.192384] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:23.261001] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T20:34:23.550973] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T20:34:23.980313] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-28T20:34:24.261229] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T20:34:24.780309] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-28T20:34:25.391608] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T20:34:25.580238] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-28T20:34:26.257015] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T20:34:26.380262] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-28T20:34:26.832046] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:34:27.180256] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-28T20:34:27.860759] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T20:34:27.870824] [INFO ] [REMOTE ] PD: Full fetch complete (68305 records). [2025-10-28T20:34:27.870964] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-28T20:34:27.985401] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-28T20:34:28.259175] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-28T20:34:28.259344] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-28T20:34:28.260381] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-28T20:34:28.260441] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-28T20:34:28.261722] [DEBUG] [LOCAL ] PD: Trimmed 68305 records to 48145 (keeping 200 days of data) [2025-10-28T20:34:28.511481] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T20:34:28.572129] [DEBUG] [LOCAL ] PD: Primary data saved (48145 records). [2025-10-28T20:34:28.572268] [INFO ] [MAIN ] PD: Full history saved. [2025-10-28T20:34:28.572363] [INFO ] [MAIN ] Update Progress: 1645/2366 symbols completed. PD took 29.0s. Estimated remaining: 1h 33m 59s. Rate: 7.7 symbols/min [2025-10-28T20:34:28.735817] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:28.766765] [DEBUG] [LOCAL ] PDO: Loaded 30959 existing records from primary storage. [2025-10-28T20:34:28.767045] [INFO ] [MAIN ] PDO: Loaded 30959 existing records. [2025-10-28T20:34:28.787098] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-28T20:34:28.943808] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:34:28.944010] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-28T20:34:28.944058] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-28T20:34:28.944608] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-28T20:34:28.944700] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-28T20:34:29.220980] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T20:34:29.296876] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:29.580272] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-28T20:34:29.734871] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T20:34:29.895306] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T20:34:30.380246] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-28T20:34:31.180286] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-28T20:34:31.980247] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-28T20:34:32.049034] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T20:34:32.524691] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T20:34:32.651979] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T20:34:32.780241] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-28T20:34:33.254860] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T20:34:33.255571] [INFO ] [REMOTE ] PDCC: Full fetch complete (1396 records). [2025-10-28T20:34:33.255636] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-28T20:34:33.427742] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-28T20:34:33.427894] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:34:33.427938] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:34:33.427975] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-28T20:34:33.428028] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-28T20:34:33.428061] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-28T20:34:33.428099] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-28T20:34:33.428150] [INFO ] [MAIN ] Update Progress: 1646/2366 symbols completed. PDCC took 26.6s. Estimated remaining: 1h 33m 50s. Rate: 7.7 symbols/min [2025-10-28T20:34:33.586338] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-28T20:34:33.596685] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:33.616025] [DEBUG] [LOCAL ] PDS: Loaded 16191 existing records from primary storage. [2025-10-28T20:34:33.616421] [INFO ] [MAIN ] PDS: Loaded 16191 existing records. [2025-10-28T20:34:33.801054] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:34:33.801299] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-28T20:34:33.801348] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-28T20:34:33.801695] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-28T20:34:33.801767] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-28T20:34:34.174696] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:34.380253] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-28T20:34:35.180306] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-28T20:34:35.218487] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T20:34:35.441457] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T20:34:35.980302] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-28T20:34:36.358827] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:34:36.780232] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-28T20:34:37.344546] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T20:34:37.580240] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-28T20:34:37.905435] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T20:34:38.380217] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-28T20:34:38.477740] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T20:34:39.180248] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-28T20:34:39.812609] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T20:34:39.980221] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-28T20:34:40.780409] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T20:34:40.780581] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-28T20:34:40.793998] [INFO ] [REMOTE ] PDI: Full fetch complete (73161 records). [2025-10-28T20:34:40.794321] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-28T20:34:41.212452] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-28T20:34:41.212567] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-28T20:34:41.213747] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-28T20:34:41.213936] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-28T20:34:41.236942] [DEBUG] [LOCAL ] PDI: Trimmed 73161 records to 50163 (keeping 200 days of data) [2025-10-28T20:34:41.239221] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T20:34:41.565553] [DEBUG] [LOCAL ] PDI: Primary data saved (50163 records). [2025-10-28T20:34:41.565725] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-28T20:34:41.566346] [INFO ] [MAIN ] Update Progress: 1647/2366 symbols completed. PDI took 31.7s. Estimated remaining: 1h 33m 42s. Rate: 7.7 symbols/min [2025-10-28T20:34:41.586502] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-28T20:34:41.737187] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:41.755717] [DEBUG] [LOCAL ] PDT: Loaded 17343 existing records from primary storage. [2025-10-28T20:34:41.755989] [INFO ] [MAIN ] PDT: Loaded 17343 existing records. [2025-10-28T20:34:41.938221] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:34:41.938430] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-28T20:34:41.938499] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-28T20:34:41.938973] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-28T20:34:41.939030] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-28T20:34:42.291253] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:42.323858] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T20:34:42.380244] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-28T20:34:42.669107] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T20:34:43.180274] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-28T20:34:43.510720] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T20:34:43.980284] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-28T20:34:44.198615] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T20:34:44.780274] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-28T20:34:45.047452] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T20:34:45.490105] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:34:45.580250] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-28T20:34:46.380313] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-28T20:34:46.986551] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T20:34:47.180295] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-28T20:34:47.381557] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T20:34:47.980259] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-28T20:34:48.121298] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T20:34:48.780255] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-28T20:34:49.237192] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T20:34:49.544581] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T20:34:49.580296] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-28T20:34:50.373566] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T20:34:50.380198] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-28T20:34:51.180309] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-28T20:34:51.229045] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T20:34:51.980242] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-28T20:34:52.557639] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T20:34:52.780259] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-28T20:34:52.812745] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T20:34:53.580278] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-28T20:34:53.886313] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T20:34:53.895225] [INFO ] [REMOTE ] PDM: Full fetch complete (57297 records). [2025-10-28T20:34:53.895444] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-28T20:34:54.319816] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-28T20:34:54.320005] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-28T20:34:54.322681] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-28T20:34:54.322769] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-28T20:34:54.335204] [DEBUG] [LOCAL ] PDM: Trimmed 57297 records to 39412 (keeping 200 days of data) [2025-10-28T20:34:54.337380] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:34:54.385070] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-28T20:34:54.586773] [DEBUG] [LOCAL ] PDM: Primary data saved (39412 records). [2025-10-28T20:34:54.586973] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-28T20:34:54.587104] [INFO ] [MAIN ] Update Progress: 1648/2366 symbols completed. PDM took 32.1s. Estimated remaining: 1h 33m 37s. Rate: 7.7 symbols/min [2025-10-28T20:34:54.766401] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:34:54.783054] [DEBUG] [LOCAL ] PDX: Loaded 13856 existing records from primary storage. [2025-10-28T20:34:54.783373] [INFO ] [MAIN ] PDX: Loaded 13856 existing records. [2025-10-28T20:34:54.973438] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:34:54.973814] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-28T20:34:54.973873] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-28T20:34:54.974268] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-28T20:34:54.974318] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-28T20:34:55.190609] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-28T20:34:55.374055] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:34:55.690905] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T20:34:55.980300] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-28T20:34:56.001451] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T20:34:56.780284] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-28T20:34:57.389110] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T20:34:57.492529] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T20:34:57.580266] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-28T20:34:58.380313] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-28T20:34:58.623376] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T20:34:59.116518] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T20:34:59.180223] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-28T20:34:59.882815] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T20:34:59.980248] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-28T20:35:00.780357] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-28T20:35:01.238517] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T20:35:01.580262] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-28T20:35:02.318525] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T20:35:02.380247] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-28T20:35:02.593773] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T20:35:03.180314] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-28T20:35:03.488365] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T20:35:03.980252] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-28T20:35:04.195389] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T20:35:04.780361] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-28T20:35:05.020899] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T20:35:05.580267] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-28T20:35:05.704304] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T20:35:06.324396] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T20:35:06.328376] [INFO ] [REMOTE ] PDS: Full fetch complete (25690 records). [2025-10-28T20:35:06.328564] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-28T20:35:06.385420] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-28T20:35:06.704133] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-28T20:35:06.704213] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-28T20:35:06.704767] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-28T20:35:06.704830] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-28T20:35:06.705530] [DEBUG] [LOCAL ] PDS: Trimmed 25690 records to 16034 (keeping 200 days of data) [2025-10-28T20:35:06.801398] [DEBUG] [LOCAL ] PDS: Primary data saved (16034 records). [2025-10-28T20:35:06.801824] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-28T20:35:06.801913] [INFO ] [MAIN ] Update Progress: 1649/2366 symbols completed. PDS took 33.4s. Estimated remaining: 1h 33m 31s. Rate: 7.7 symbols/min [2025-10-28T20:35:06.972775] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:06.972981] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-28T20:35:06.973027] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-28T20:35:06.973135] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-28T20:35:06.973175] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-28T20:35:06.973214] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-28T20:35:06.973246] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-28T20:35:07.190593] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-28T20:35:07.332848] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:07.343158] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T20:35:07.980255] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-28T20:35:08.379910] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T20:35:08.386821] [INFO ] [REMOTE ] PDO: Full fetch complete (46583 records). [2025-10-28T20:35:08.386926] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-28T20:35:08.759421] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-28T20:35:08.759494] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-28T20:35:08.760331] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-28T20:35:08.760391] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-28T20:35:08.761261] [DEBUG] [LOCAL ] PDO: Trimmed 46583 records to 30847 (keeping 200 days of data) [2025-10-28T20:35:08.812075] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-28T20:35:08.948449] [DEBUG] [LOCAL ] PDO: Primary data saved (30847 records). [2025-10-28T20:35:08.948584] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-28T20:35:08.948698] [INFO ] [MAIN ] Update Progress: 1650/2366 symbols completed. PDO took 40.4s. Estimated remaining: 1h 33m 20s. Rate: 7.7 symbols/min [2025-10-28T20:35:09.114515] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:09.114720] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-28T20:35:09.114768] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-28T20:35:09.114899] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-28T20:35:09.114940] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-28T20:35:09.114981] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-28T20:35:09.115020] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-28T20:35:09.463007] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:09.580218] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-28T20:35:09.729043] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T20:35:09.733105] [INFO ] [REMOTE ] PDT: Full fetch complete (25063 records). [2025-10-28T20:35:09.733177] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-28T20:35:09.902188] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T20:35:10.147262] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-28T20:35:10.147336] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-28T20:35:10.147854] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-28T20:35:10.147914] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-28T20:35:10.148520] [DEBUG] [LOCAL ] PDT: Trimmed 25063 records to 17334 (keeping 200 days of data) [2025-10-28T20:35:10.251966] [DEBUG] [LOCAL ] PDT: Primary data saved (17334 records). [2025-10-28T20:35:10.252093] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-28T20:35:10.252167] [INFO ] [MAIN ] Update Progress: 1651/2366 symbols completed. PDT took 28.7s. Estimated remaining: 1h 33m 10s. Rate: 7.7 symbols/min [2025-10-28T20:35:10.393474] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-28T20:35:10.425270] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:10.425386] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-28T20:35:10.425423] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-28T20:35:10.425528] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-28T20:35:10.425570] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-28T20:35:10.425612] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-28T20:35:10.425669] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-28T20:35:10.782443] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:11.129279] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T20:35:11.180214] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-28T20:35:11.819594] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T20:35:11.980264] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-28T20:35:12.649023] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T20:35:12.780253] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-28T20:35:12.850044] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T20:35:13.580264] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-28T20:35:14.139459] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T20:35:14.380255] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-28T20:35:15.088553] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T20:35:15.136349] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T20:35:15.180218] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-28T20:35:15.980230] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-28T20:35:16.780291] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-28T20:35:16.885062] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T20:35:17.392821] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:35:17.580239] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-28T20:35:17.909463] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T20:35:18.380249] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-28T20:35:18.957019] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:35:19.180314] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-28T20:35:19.500627] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T20:35:19.912667] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T20:35:19.980225] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-28T20:35:20.696077] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T20:35:20.699203] [INFO ] [REMOTE ] PDX: Full fetch complete (23511 records). [2025-10-28T20:35:20.699292] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-28T20:35:20.785681] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-28T20:35:21.079050] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-28T20:35:21.079141] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-28T20:35:21.079743] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-28T20:35:21.079807] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-28T20:35:21.080513] [DEBUG] [LOCAL ] PDX: Trimmed 23511 records to 13733 (keeping 200 days of data) [2025-10-28T20:35:21.163446] [DEBUG] [LOCAL ] PDX: Primary data saved (13733 records). [2025-10-28T20:35:21.163572] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-28T20:35:21.163668] [INFO ] [MAIN ] Update Progress: 1652/2366 symbols completed. PDX took 26.6s. Estimated remaining: 1h 33m 3s. Rate: 7.7 symbols/min [2025-10-28T20:35:21.328607] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:21.340610] [DEBUG] [LOCAL ] PEO: Loaded 10939 existing records from primary storage. [2025-10-28T20:35:21.340829] [INFO ] [MAIN ] PEO: Loaded 10939 existing records. [2025-10-28T20:35:21.513245] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:35:21.513422] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-28T20:35:21.513467] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-28T20:35:21.513731] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-28T20:35:21.513787] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-28T20:35:21.586753] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-28T20:35:21.864187] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:22.258368] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:35:22.380219] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-28T20:35:23.146335] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T20:35:23.180225] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-28T20:35:23.548204] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T20:35:23.980250] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-28T20:35:24.780252] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-28T20:35:24.873108] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T20:35:25.129368] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T20:35:25.580245] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-28T20:35:25.839872] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T20:35:26.380258] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-28T20:35:27.185358] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-28T20:35:27.191806] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T20:35:27.846239] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:35:27.980212] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-28T20:35:28.371359] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T20:35:28.780257] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-28T20:35:29.427430] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T20:35:29.584229] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-28T20:35:29.589677] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T20:35:30.380254] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-28T20:35:31.183441] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-28T20:35:31.188701] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T20:35:31.647884] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T20:35:31.980278] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-28T20:35:32.528466] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T20:35:32.780281] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-28T20:35:33.187811] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T20:35:33.580290] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-28T20:35:34.315360] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T20:35:34.380218] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-28T20:35:35.180219] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-28T20:35:35.299537] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T20:35:35.310038] [INFO ] [REMOTE ] PEG: Full fetch complete (76990 records). [2025-10-28T20:35:35.310149] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-28T20:35:35.727769] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-10-28T20:35:35.728225] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-10-28T20:35:35.729425] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-10-28T20:35:35.729614] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-10-28T20:35:35.736407] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T20:35:35.740941] [DEBUG] [LOCAL ] PEG: Trimmed 76990 records to 53104 (keeping 200 days of data) [2025-10-28T20:35:35.769367] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T20:35:35.989628] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-28T20:35:36.100507] [DEBUG] [LOCAL ] PEG: Primary data saved (53104 records). [2025-10-28T20:35:36.100632] [INFO ] [MAIN ] PEG: Full history saved. [2025-10-28T20:35:36.100736] [INFO ] [MAIN ] Update Progress: 1653/2366 symbols completed. PEG took 27.2s. Estimated remaining: 1h 32m 59s. Rate: 7.7 symbols/min [2025-10-28T20:35:36.267246] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:36.282671] [DEBUG] [LOCAL ] PERF: Loaded 14553 existing records from primary storage. [2025-10-28T20:35:36.282864] [INFO ] [MAIN ] PERF: Loaded 14553 existing records. [2025-10-28T20:35:36.459173] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:35:36.459365] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-28T20:35:36.459410] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-28T20:35:36.459752] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-28T20:35:36.459816] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-28T20:35:36.785528] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-28T20:35:36.814826] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:37.021348] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T20:35:37.580244] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-28T20:35:38.196248] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T20:35:38.206412] [INFO ] [REMOTE ] PEB: Full fetch complete (73264 records). [2025-10-28T20:35:38.206524] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-28T20:35:38.381192] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-28T20:35:38.604707] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-28T20:35:38.604816] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-28T20:35:38.606017] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-28T20:35:38.606107] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-28T20:35:38.607987] [DEBUG] [LOCAL ] PEB: Trimmed 73264 records to 50640 (keeping 200 days of data) [2025-10-28T20:35:38.720793] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T20:35:38.746712] [INFO ] [REMOTE ] PEN: Full fetch complete (43921 records). [2025-10-28T20:35:38.752083] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-28T20:35:39.191294] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-28T20:35:39.284967] [DEBUG] [LOCAL ] PEB: Primary data saved (50640 records). [2025-10-28T20:35:39.301032] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-28T20:35:39.306249] [INFO ] [MAIN ] Update Progress: 1654/2366 symbols completed. PEB took 32.5s. Estimated remaining: 1h 32m 49s. Rate: 7.7 symbols/min [2025-10-28T20:35:39.440151] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-28T20:35:39.475191] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-28T20:35:39.479421] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-28T20:35:39.479698] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-28T20:35:39.547769] [DEBUG] [LOCAL ] PEN: Trimmed 43921 records to 29229 (keeping 200 days of data) [2025-10-28T20:35:39.566571] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:39.567031] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-28T20:35:39.568414] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T20:35:39.573243] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-28T20:35:39.573399] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-28T20:35:39.573470] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-28T20:35:39.573532] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-28T20:35:39.573578] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-28T20:35:39.990684] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-28T20:35:40.068135] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T20:35:40.130576] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:40.172619] [DEBUG] [LOCAL ] PEN: Primary data saved (29229 records). [2025-10-28T20:35:40.172770] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-28T20:35:40.172847] [INFO ] [MAIN ] Update Progress: 1655/2366 symbols completed. PEN took 29.9s. Estimated remaining: 1h 32m 38s. Rate: 7.7 symbols/min [2025-10-28T20:35:40.349679] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:40.357812] [DEBUG] [LOCAL ] PFD: Loaded 5255 existing records from primary storage. [2025-10-28T20:35:40.358014] [INFO ] [MAIN ] PFD: Loaded 5255 existing records. [2025-10-28T20:35:40.535556] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:35:40.535782] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-28T20:35:40.535833] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-28T20:35:40.536014] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-28T20:35:40.536081] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-28T20:35:40.785686] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-28T20:35:40.908932] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:40.922733] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T20:35:41.445114] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T20:35:41.580245] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-28T20:35:42.256453] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T20:35:42.380257] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-10-28T20:35:42.644301] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:35:42.644599] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-10-28T20:35:42.644714] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:35:42.644780] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-28T20:35:42.644844] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:35:42.644910] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-28T20:35:42.644971] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-28T20:35:42.645006] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-28T20:35:42.645045] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-28T20:35:42.645089] [INFO ] [MAIN ] Update Progress: 1656/2366 symbols completed. PEW took 3.3s. Estimated remaining: 1h 32m 28s. Rate: 7.7 symbols/min [2025-10-28T20:35:42.811754] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:42.811934] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-28T20:35:42.812020] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-28T20:35:42.812105] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-28T20:35:42.812142] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-28T20:35:42.812200] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-28T20:35:42.812233] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-28T20:35:43.188617] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:43.184939] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-28T20:35:43.955065] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T20:35:43.980234] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-28T20:35:44.498469] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T20:35:44.780313] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-28T20:35:45.326869] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T20:35:45.580349] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-28T20:35:46.170213] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T20:35:46.380264] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-28T20:35:46.888748] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T20:35:47.180307] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-28T20:35:47.986617] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-28T20:35:47.988506] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T20:35:48.780308] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-28T20:35:49.356499] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T20:35:49.580300] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-28T20:35:50.369836] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T20:35:50.380207] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-28T20:35:50.594384] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-28T20:35:51.118287] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T20:35:51.180270] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-28T20:35:51.980329] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-28T20:35:52.427417] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T20:35:52.780265] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-28T20:35:53.556238] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T20:35:53.554437] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-28T20:35:53.569115] [INFO ] [REMOTE ] PEO: Full fetch complete (16340 records). [2025-10-28T20:35:53.569849] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-28T20:35:53.590568] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-28T20:35:53.980247] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-28T20:35:53.980354] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-28T20:35:53.980874] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-28T20:35:53.980938] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-28T20:35:53.981582] [DEBUG] [LOCAL ] PEO: Trimmed 16340 records to 10885 (keeping 200 days of data) [2025-10-28T20:35:54.054120] [DEBUG] [LOCAL ] PEO: Primary data saved (10885 records). [2025-10-28T20:35:54.054319] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-28T20:35:54.054422] [INFO ] [MAIN ] Update Progress: 1657/2366 symbols completed. PEO took 32.9s. Estimated remaining: 1h 32m 22s. Rate: 7.7 symbols/min [2025-10-28T20:35:54.240469] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:35:54.240825] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-28T20:35:54.240878] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-28T20:35:54.241031] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-28T20:35:54.241083] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-28T20:35:54.241133] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-28T20:35:54.241168] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-28T20:35:54.385462] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-28T20:35:54.664948] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:35:55.118803] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T20:35:55.180241] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-28T20:35:55.956526] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T20:35:55.980214] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-28T20:35:56.117154] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-28T20:35:56.780289] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-28T20:35:56.843219] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:35:57.580251] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-28T20:35:58.301182] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:35:58.299879] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T20:35:58.380233] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-28T20:35:59.023496] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T20:35:59.180258] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-28T20:35:59.791708] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T20:35:59.793267] [INFO ] [REMOTE ] PFD: Full fetch complete (7476 records). [2025-10-28T20:35:59.793334] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-28T20:35:59.988612] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-28T20:36:00.148094] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-28T20:36:00.148172] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-28T20:36:00.148403] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-28T20:36:00.148463] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-28T20:36:00.148874] [DEBUG] [LOCAL ] PFD: Trimmed 7476 records to 5200 (keeping 200 days of data) [2025-10-28T20:36:00.179337] [DEBUG] [LOCAL ] PFD: Primary data saved (5200 records). [2025-10-28T20:36:00.179420] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-28T20:36:00.179492] [INFO ] [MAIN ] Update Progress: 1658/2366 symbols completed. PFD took 20.0s. Estimated remaining: 1h 32m 13s. Rate: 7.7 symbols/min [2025-10-28T20:36:00.350782] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:00.359394] [DEBUG] [LOCAL ] PFH: Loaded 6340 existing records from primary storage. [2025-10-28T20:36:00.359619] [INFO ] [MAIN ] PFH: Loaded 6340 existing records. [2025-10-28T20:36:00.544602] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:36:00.544828] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-28T20:36:00.544879] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-28T20:36:00.545175] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-28T20:36:00.545285] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-28T20:36:00.786866] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-28T20:36:00.905742] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:01.524397] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T20:36:01.580217] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-28T20:36:01.686909] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T20:36:02.380319] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-28T20:36:03.142500] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:36:03.180213] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-28T20:36:03.980212] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-28T20:36:04.197728] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-28T20:36:04.492673] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T20:36:04.511791] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T20:36:04.780284] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-28T20:36:05.580271] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-28T20:36:05.769414] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T20:36:06.380273] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-28T20:36:06.919551] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T20:36:07.180274] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-28T20:36:07.750181] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T20:36:07.980255] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-28T20:36:08.586244] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T20:36:08.780229] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-28T20:36:09.545802] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T20:36:09.580215] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-28T20:36:10.194597] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (3.81 seconds). [2025-10-28T20:36:10.227742] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T20:36:10.380266] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-28T20:36:11.165135] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T20:36:11.168669] [INFO ] [REMOTE ] PERF: Full fetch complete (21304 records). [2025-10-28T20:36:11.168756] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-28T20:36:11.189402] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-28T20:36:11.547124] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-28T20:36:11.547198] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-28T20:36:11.547631] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-28T20:36:11.547704] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-28T20:36:11.548274] [DEBUG] [LOCAL ] PERF: Trimmed 21304 records to 14651 (keeping 200 days of data) [2025-10-28T20:36:11.627628] [DEBUG] [LOCAL ] PERF: Primary data saved (14651 records). [2025-10-28T20:36:11.627776] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-28T20:36:11.627852] [INFO ] [MAIN ] Update Progress: 1659/2366 symbols completed. PERF took 35.5s. Estimated remaining: 1h 32m 7s. Rate: 7.7 symbols/min [2025-10-28T20:36:11.794635] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:11.808549] [DEBUG] [LOCAL ] PFL: Loaded 14163 existing records from primary storage. [2025-10-28T20:36:11.808778] [INFO ] [MAIN ] PFL: Loaded 14163 existing records. [2025-10-28T20:36:11.986331] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:36:11.982755] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-28T20:36:11.987444] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-28T20:36:11.987503] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-28T20:36:11.987778] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-28T20:36:11.987835] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-28T20:36:12.338527] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:12.650037] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T20:36:12.780274] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-28T20:36:13.325137] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T20:36:13.580233] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-28T20:36:13.986896] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-28T20:36:14.329762] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T20:36:14.380214] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-28T20:36:14.924629] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T20:36:15.180257] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-28T20:36:15.850379] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T20:36:15.980241] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-28T20:36:16.554821] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T20:36:16.556247] [INFO ] [REMOTE ] PFH: Full fetch complete (9523 records). [2025-10-28T20:36:16.556316] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-28T20:36:16.785472] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-28T20:36:16.928966] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-28T20:36:16.929051] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-28T20:36:16.929357] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-28T20:36:16.929430] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-28T20:36:16.930069] [DEBUG] [LOCAL ] PFH: Trimmed 9523 records to 6345 (keeping 200 days of data) [2025-10-28T20:36:16.975315] [DEBUG] [LOCAL ] PFH: Primary data saved (6345 records). [2025-10-28T20:36:16.975483] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-28T20:36:16.975573] [INFO ] [MAIN ] Update Progress: 1660/2366 symbols completed. PFH took 16.8s. Estimated remaining: 1h 31m 58s. Rate: 7.7 symbols/min [2025-10-28T20:36:17.164888] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:17.208542] [DEBUG] [LOCAL ] PFLT: Loaded 44070 existing records from primary storage. [2025-10-28T20:36:17.208903] [INFO ] [MAIN ] PFLT: Loaded 44070 existing records. [2025-10-28T20:36:17.382854] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:36:17.383054] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-28T20:36:17.383101] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-28T20:36:17.383734] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-28T20:36:17.383791] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-28T20:36:17.586096] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-28T20:36:17.754582] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:18.380245] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-28T20:36:18.669237] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T20:36:19.167384] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-28T20:36:19.180342] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-28T20:36:19.980256] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-28T20:36:20.091292] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T20:36:20.780263] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-28T20:36:21.481904] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T20:36:21.540100] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-28T20:36:21.580209] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-28T20:36:21.829687] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-28T20:36:22.380331] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-28T20:36:23.180277] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-28T20:36:23.679343] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T20:36:23.842910] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T20:36:23.980282] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-28T20:36:24.478178] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-28T20:36:24.780262] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-28T20:36:25.476774] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T20:36:25.579822] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:36:25.589898] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-28T20:36:25.594920] [INFO ] [REMOTE ] PFE: Full fetch complete (77603 records). [2025-10-28T20:36:25.595052] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-28T20:36:25.595734] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:36:25.595888] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:36:25.595981] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:36:25.596069] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-28T20:36:25.596152] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-28T20:36:25.596192] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-28T20:36:25.596232] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-28T20:36:25.596288] [INFO ] [MAIN ] Update Progress: 1661/2366 symbols completed. PFE took 43.0s. Estimated remaining: 1h 31m 50s. Rate: 7.7 symbols/min [2025-10-28T20:36:25.764111] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:25.784711] [DEBUG] [LOCAL ] PFN: Loaded 21859 existing records from primary storage. [2025-10-28T20:36:25.784945] [INFO ] [MAIN ] PFN: Loaded 21859 existing records. [2025-10-28T20:36:25.958685] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:36:25.958946] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-28T20:36:25.959000] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-28T20:36:25.959391] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-28T20:36:25.959448] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-28T20:36:26.310536] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:26.380266] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-28T20:36:27.180255] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-28T20:36:27.236776] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T20:36:27.325924] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-28T20:36:27.980247] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-28T20:36:28.334234] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T20:36:28.613491] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T20:36:28.780237] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-28T20:36:29.451006] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T20:36:29.580260] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-28T20:36:30.380217] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-28T20:36:30.441767] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T20:36:31.180251] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-28T20:36:31.829720] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T20:36:31.865757] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T20:36:31.980268] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-28T20:36:32.780301] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-28T20:36:33.308484] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T20:36:33.506293] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:36:33.580233] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-28T20:36:34.380226] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-28T20:36:34.409524] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T20:36:35.180373] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-28T20:36:35.899472] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T20:36:35.980223] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-28T20:36:36.045672] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T20:36:36.780296] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-28T20:36:37.424234] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:36:37.580239] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-28T20:36:38.377687] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T20:36:38.381322] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-28T20:36:39.180225] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-28T20:36:39.453737] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T20:36:39.980235] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-28T20:36:40.629859] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T20:36:40.780220] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-28T20:36:40.836526] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:36:41.557871] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T20:36:41.580213] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-28T20:36:42.380239] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-28T20:36:43.180323] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-28T20:36:43.232380] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T20:36:43.238543] [INFO ] [REMOTE ] PFL: Full fetch complete (20666 records). [2025-10-28T20:36:43.238734] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-28T20:36:43.615449] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-28T20:36:43.615529] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-28T20:36:43.616069] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-28T20:36:43.616131] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-28T20:36:43.616870] [DEBUG] [LOCAL ] PFL: Trimmed 20666 records to 13921 (keeping 200 days of data) [2025-10-28T20:36:43.725179] [DEBUG] [LOCAL ] PFL: Primary data saved (13921 records). [2025-10-28T20:36:43.725511] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-28T20:36:43.725591] [INFO ] [MAIN ] Update Progress: 1662/2366 symbols completed. PFL took 32.1s. Estimated remaining: 1h 31m 47s. Rate: 7.7 symbols/min [2025-10-28T20:36:43.937402] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:43.948342] [DEBUG] [LOCAL ] PFO: Loaded 6017 existing records from primary storage. [2025-10-28T20:36:43.948602] [INFO ] [MAIN ] PFO: Loaded 6017 existing records. [2025-10-28T20:36:44.149737] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:36:44.181337] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-28T20:36:44.284388] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (6.70 seconds). [2025-10-28T20:36:44.352398] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:36:44.353931] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-28T20:36:44.354158] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-28T20:36:44.354934] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-28T20:36:44.355005] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-28T20:36:44.785511] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-28T20:36:44.847054] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:45.580322] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-28T20:36:46.240475] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T20:36:46.380225] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-28T20:36:46.408837] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T20:36:47.180255] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-28T20:36:47.728342] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (6.15 seconds). [2025-10-28T20:36:47.738139] [INFO ] [REMOTE ] PFGC: Full fetch complete (67692 records). [2025-10-28T20:36:47.738291] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-28T20:36:47.843989] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T20:36:47.983861] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-28T20:36:48.145805] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-28T20:36:48.145922] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-28T20:36:48.147052] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-28T20:36:48.147114] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-28T20:36:48.148370] [DEBUG] [LOCAL ] PFGC: Trimmed 67692 records to 46489 (keeping 200 days of data) [2025-10-28T20:36:48.413788] [DEBUG] [LOCAL ] PFGC: Primary data saved (46489 records). [2025-10-28T20:36:48.413915] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-28T20:36:48.413986] [INFO ] [MAIN ] Update Progress: 1663/2366 symbols completed. PFGC took 54.4s. Estimated remaining: 1h 31m 38s. Rate: 7.7 symbols/min [2025-10-28T20:36:48.585494] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:48.585710] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-28T20:36:48.585760] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-28T20:36:48.585864] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-28T20:36:48.585905] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-28T20:36:48.585944] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-28T20:36:48.586017] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-28T20:36:48.659894] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T20:36:48.802060] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-28T20:36:48.954171] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:49.580277] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-28T20:36:49.688899] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T20:36:50.325857] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (6.14 seconds). [2025-10-28T20:36:50.380222] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-28T20:36:50.910588] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T20:36:50.995891] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T20:36:51.180243] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-28T20:36:51.700368] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T20:36:51.980258] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-28T20:36:52.780246] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-28T20:36:52.893059] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (6.51 seconds). [2025-10-28T20:36:52.902962] [INFO ] [REMOTE ] PFLT: Full fetch complete (64435 records). [2025-10-28T20:36:52.903080] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-28T20:36:53.289264] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-28T20:36:53.289365] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-28T20:36:53.290461] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-28T20:36:53.290521] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-28T20:36:53.291719] [DEBUG] [LOCAL ] PFLT: Trimmed 64435 records to 44018 (keeping 200 days of data) [2025-10-28T20:36:53.395243] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:36:53.571745] [DEBUG] [LOCAL ] PFLT: Primary data saved (44018 records). [2025-10-28T20:36:53.571862] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-28T20:36:53.571937] [INFO ] [MAIN ] Update Progress: 1664/2366 symbols completed. PFLT took 36.6s. Estimated remaining: 1h 31m 29s. Rate: 7.7 symbols/min [2025-10-28T20:36:53.585414] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-28T20:36:53.742986] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:36:53.764487] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T20:36:53.776746] [DEBUG] [LOCAL ] PFSI: Loaded 28901 existing records from primary storage. [2025-10-28T20:36:53.776973] [INFO ] [MAIN ] PFSI: Loaded 28901 existing records. [2025-10-28T20:36:53.949243] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:36:53.949465] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-28T20:36:53.949510] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-28T20:36:53.949974] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-28T20:36:53.950031] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-28T20:36:54.313128] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:36:54.380253] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-28T20:36:54.797063] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T20:36:55.180281] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-28T20:36:55.433783] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T20:36:55.884682] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T20:36:55.980261] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-28T20:36:56.780280] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-28T20:36:57.078548] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T20:36:57.477862] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T20:36:57.580246] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-28T20:36:58.380235] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-28T20:36:58.443909] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T20:36:59.180367] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-28T20:36:59.597546] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T20:36:59.980252] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-28T20:37:00.022388] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T20:37:00.780254] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-28T20:37:00.929774] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T20:37:01.580286] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-28T20:37:01.703435] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T20:37:01.708897] [INFO ] [REMOTE ] PFN: Full fetch complete (31368 records). [2025-10-28T20:37:01.709019] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-28T20:37:02.104145] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-28T20:37:02.104416] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-28T20:37:02.110688] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-28T20:37:02.111032] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-28T20:37:02.110929] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T20:37:02.113828] [INFO ] [REMOTE ] PFO: Full fetch complete (7928 records). [2025-10-28T20:37:02.114473] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-28T20:37:02.114587] [DEBUG] [LOCAL ] PFN: Trimmed 31368 records to 21635 (keeping 200 days of data) [2025-10-28T20:37:02.381003] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-28T20:37:02.534886] [DEBUG] [LOCAL ] PFN: Primary data saved (21635 records). [2025-10-28T20:37:02.557777] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-28T20:37:02.569305] [INFO ] [MAIN ] Update Progress: 1665/2366 symbols completed. PFN took 37.0s. Estimated remaining: 1h 31m 22s. Rate: 7.7 symbols/min [2025-10-28T20:37:02.787063] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-28T20:37:02.802708] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-28T20:37:02.820853] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-28T20:37:02.850418] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-28T20:37:02.853587] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:02.854806] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-28T20:37:02.854627] [DEBUG] [LOCAL ] PFO: Trimmed 7928 records to 6007 (keeping 200 days of data) [2025-10-28T20:37:02.854945] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-28T20:37:02.855860] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-28T20:37:02.856495] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-28T20:37:02.856571] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-28T20:37:02.856608] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-28T20:37:03.006881] [DEBUG] [LOCAL ] PFO: Primary data saved (6007 records). [2025-10-28T20:37:03.022436] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-28T20:37:03.027742] [INFO ] [MAIN ] Update Progress: 1666/2366 symbols completed. PFO took 19.3s. Estimated remaining: 1h 31m 11s. Rate: 7.7 symbols/min [2025-10-28T20:37:03.202950] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-28T20:37:03.346168] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:03.436527] [DEBUG] [LOCAL ] PGP: Loaded 5599 existing records from primary storage. [2025-10-28T20:37:03.459263] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:03.459787] [INFO ] [MAIN ] PGP: Loaded 5599 existing records. [2025-10-28T20:37:03.638106] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:37:03.638492] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-28T20:37:03.638634] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-28T20:37:03.639062] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-28T20:37:03.639125] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-28T20:37:03.733690] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T20:37:03.984738] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-28T20:37:04.019939] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:04.700693] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T20:37:04.780314] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-28T20:37:05.504244] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T20:37:05.580269] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-28T20:37:05.838594] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T20:37:06.380320] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-28T20:37:06.534849] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T20:37:06.845675] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T20:37:07.180293] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-28T20:37:07.689676] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:37:07.980228] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-28T20:37:08.695808] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T20:37:08.780226] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-28T20:37:09.270923] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T20:37:09.580305] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-28T20:37:10.150146] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T20:37:10.380250] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-28T20:37:10.886884] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T20:37:11.180288] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-28T20:37:11.980255] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-28T20:37:12.204978] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T20:37:12.519471] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T20:37:12.780264] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-28T20:37:13.580251] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-28T20:37:13.857405] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T20:37:14.380301] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-28T20:37:15.131865] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:37:15.180227] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-28T20:37:15.436379] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T20:37:15.980315] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-28T20:37:16.780331] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-28T20:37:17.059855] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T20:37:17.218047] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T20:37:17.316984] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T20:37:17.580332] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-28T20:37:18.380297] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-28T20:37:18.690268] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T20:37:19.180321] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-28T20:37:19.853572] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T20:37:19.980321] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-28T20:37:20.780284] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-28T20:37:20.969951] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T20:37:21.148237] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T20:37:21.476062] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:37:21.478163] [INFO ] [REMOTE ] PGP: Full fetch complete (8081 records). [2025-10-28T20:37:21.478234] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-28T20:37:21.586226] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-28T20:37:21.867747] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-28T20:37:21.867868] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-28T20:37:21.868108] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-28T20:37:21.868149] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-28T20:37:21.868612] [DEBUG] [LOCAL ] PGP: Trimmed 8081 records to 5651 (keeping 200 days of data) [2025-10-28T20:37:21.901460] [DEBUG] [LOCAL ] PGP: Primary data saved (5651 records). [2025-10-28T20:37:21.901579] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-28T20:37:21.901684] [INFO ] [MAIN ] Update Progress: 1667/2366 symbols completed. PGP took 18.9s. Estimated remaining: 1h 31m 7s. Rate: 7.7 symbols/min [2025-10-28T20:37:22.077924] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:22.078084] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-28T20:37:22.078122] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-28T20:37:22.078233] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-28T20:37:22.078278] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-28T20:37:22.078321] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-28T20:37:22.078361] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-28T20:37:22.385363] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-28T20:37:22.443929] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:23.180265] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-28T20:37:23.488978] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T20:37:23.498330] [INFO ] [REMOTE ] PFSI: Full fetch complete (41963 records). [2025-10-28T20:37:23.498507] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-28T20:37:23.924718] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-28T20:37:23.924827] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-28T20:37:23.926449] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-28T20:37:23.926557] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-28T20:37:23.927845] [DEBUG] [LOCAL ] PFSI: Trimmed 41963 records to 28803 (keeping 200 days of data) [2025-10-28T20:37:23.984317] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-28T20:37:24.097020] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-28T20:37:24.182191] [DEBUG] [LOCAL ] PFSI: Primary data saved (28803 records). [2025-10-28T20:37:24.182567] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-28T20:37:24.182744] [INFO ] [MAIN ] Update Progress: 1668/2366 symbols completed. PFSI took 30.6s. Estimated remaining: 1h 30m 57s. Rate: 7.7 symbols/min [2025-10-28T20:37:24.370540] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:24.391557] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T20:37:24.444280] [DEBUG] [LOCAL ] PGRE: Loaded 46857 existing records from primary storage. [2025-10-28T20:37:24.444680] [INFO ] [MAIN ] PGRE: Loaded 46857 existing records. [2025-10-28T20:37:24.626771] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:37:24.627071] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-28T20:37:24.627122] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-28T20:37:24.628042] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-28T20:37:24.628103] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-28T20:37:24.785502] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-28T20:37:25.016135] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:25.307281] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T20:37:25.315200] [INFO ] [REMOTE ] PFS: Full fetch complete (52007 records). [2025-10-28T20:37:25.315338] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-28T20:37:25.316119] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:37:25.316206] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:37:25.316275] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:37:25.316347] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-28T20:37:25.316411] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-28T20:37:25.316449] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-28T20:37:25.316490] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-28T20:37:25.316547] [INFO ] [MAIN ] Update Progress: 1669/2366 symbols completed. PFS took 36.9s. Estimated remaining: 1h 30m 47s. Rate: 7.7 symbols/min [2025-10-28T20:37:25.510292] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:25.544799] [DEBUG] [LOCAL ] PGZ: Loaded 5422 existing records from primary storage. [2025-10-28T20:37:25.545111] [INFO ] [MAIN ] PGZ: Loaded 5422 existing records. [2025-10-28T20:37:25.585499] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-28T20:37:25.606134] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T20:37:25.769256] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:37:25.769520] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-28T20:37:25.769572] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-28T20:37:25.769843] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-28T20:37:25.769900] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-28T20:37:26.126403] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:26.380253] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-28T20:37:26.921409] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T20:37:27.172590] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T20:37:27.180197] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-28T20:37:27.670048] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:37:27.980310] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-28T20:37:28.418142] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T20:37:28.780289] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-28T20:37:29.580261] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-28T20:37:29.815413] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T20:37:30.380267] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-28T20:37:31.180271] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-28T20:37:31.520853] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T20:37:31.554825] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T20:37:31.980291] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-28T20:37:32.690509] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:37:32.780291] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-28T20:37:32.979007] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-28T20:37:33.296584] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T20:37:33.580273] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-28T20:37:34.185499] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T20:37:34.380269] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-28T20:37:34.953322] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T20:37:35.180262] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-28T20:37:35.714005] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T20:37:35.980247] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-28T20:37:36.474580] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T20:37:36.476275] [INFO ] [REMOTE ] PGZ: Full fetch complete (8035 records). [2025-10-28T20:37:36.476344] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-28T20:37:36.785345] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-28T20:37:36.841194] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-28T20:37:36.841267] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-28T20:37:36.841493] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-28T20:37:36.841564] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-28T20:37:36.842007] [DEBUG] [LOCAL ] PGZ: Trimmed 8035 records to 5417 (keeping 200 days of data) [2025-10-28T20:37:36.874323] [DEBUG] [LOCAL ] PGZ: Primary data saved (5417 records). [2025-10-28T20:37:36.874411] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-28T20:37:36.874483] [INFO ] [MAIN ] Update Progress: 1670/2366 symbols completed. PGZ took 11.6s. Estimated remaining: 1h 30m 40s. Rate: 7.7 symbols/min [2025-10-28T20:37:37.042503] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:37.042730] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-28T20:37:37.042779] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-28T20:37:37.042852] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-28T20:37:37.042889] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-28T20:37:37.042929] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-28T20:37:37.042961] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-28T20:37:37.401241] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:37.580256] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-28T20:37:38.380266] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-28T20:37:38.475116] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T20:37:39.180234] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-28T20:37:39.406227] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-28T20:37:39.659113] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T20:37:39.980282] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-28T20:37:40.780224] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-28T20:37:40.958823] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-28T20:37:41.199197] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T20:37:41.580287] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-28T20:37:42.380269] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-28T20:37:42.696286] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T20:37:42.940027] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T20:37:43.180281] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-28T20:37:43.870824] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T20:37:43.980257] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-28T20:37:44.780235] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-28T20:37:45.580284] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-28T20:37:45.785432] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-28T20:37:46.381682] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-28T20:37:46.384590] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-28T20:37:46.547145] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T20:37:46.854959] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:37:47.180291] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-28T20:37:47.980245] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-28T20:37:48.139467] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T20:37:48.780250] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-28T20:37:48.830409] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T20:37:49.386884] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T20:37:49.580283] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-28T20:37:50.336978] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T20:37:50.380266] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-28T20:37:51.180282] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-28T20:37:51.748355] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T20:37:51.980277] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-28T20:37:52.780319] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-28T20:37:52.960014] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (3.38 seconds). [2025-10-28T20:37:53.182763] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:37:53.261142] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-28T20:37:53.580272] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-28T20:37:54.380328] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-28T20:37:54.528097] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T20:37:55.150976] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T20:37:55.180242] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-28T20:37:55.636447] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T20:37:55.646285] [INFO ] [REMOTE ] PGRE: Full fetch complete (64706 records). [2025-10-28T20:37:55.646480] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-28T20:37:55.989271] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-28T20:37:56.044518] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-28T20:37:56.044600] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-28T20:37:56.045729] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-28T20:37:56.045791] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-28T20:37:56.047113] [DEBUG] [LOCAL ] PGRE: Trimmed 64706 records to 46802 (keeping 200 days of data) [2025-10-28T20:37:56.299977] [DEBUG] [LOCAL ] PGRE: Primary data saved (46802 records). [2025-10-28T20:37:56.300105] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-28T20:37:56.300714] [INFO ] [MAIN ] Update Progress: 1671/2366 symbols completed. PGRE took 32.1s. Estimated remaining: 1h 30m 37s. Rate: 7.7 symbols/min [2025-10-28T20:37:56.472100] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:56.515270] [DEBUG] [LOCAL ] PHG: Loaded 45242 existing records from primary storage. [2025-10-28T20:37:56.515612] [INFO ] [MAIN ] PHG: Loaded 45242 existing records. [2025-10-28T20:37:56.717613] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:37:56.717987] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-28T20:37:56.718041] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-28T20:37:56.718477] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-28T20:37:56.718534] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-28T20:37:56.785411] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-28T20:37:57.035097] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T20:37:57.126636] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:57.157771] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T20:37:57.580290] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-28T20:37:58.380287] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-28T20:37:58.565137] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T20:37:58.576826] [INFO ] [REMOTE ] PG: Full fetch complete (77539 records). [2025-10-28T20:37:58.577088] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-28T20:37:58.787857] [WARN ] [VALIDATOR ] PG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T20:37:58.788815] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:37:58.788905] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:37:58.789004] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-28T20:37:58.789106] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-28T20:37:58.789149] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-28T20:37:58.789191] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-28T20:37:58.789266] [INFO ] [MAIN ] Update Progress: 1672/2366 symbols completed. PG took 56.2s. Estimated remaining: 1h 30m 27s. Rate: 7.7 symbols/min [2025-10-28T20:37:58.972266] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:37:58.991983] [DEBUG] [LOCAL ] PHI: Loaded 15075 existing records from primary storage. [2025-10-28T20:37:58.992333] [INFO ] [MAIN ] PHI: Loaded 15075 existing records. [2025-10-28T20:37:59.183950] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-28T20:37:59.192216] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:37:59.193011] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-28T20:37:59.193220] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-28T20:37:59.193941] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-28T20:37:59.194007] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-28T20:37:59.526761] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T20:37:59.622952] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:37:59.624089] [INFO ] [REMOTE ] PGR: Full fetch complete (76799 records). [2025-10-28T20:37:59.624404] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-28T20:37:59.853955] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T20:37:59.985397] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-28T20:38:00.080732] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-28T20:38:00.080843] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-28T20:38:00.082118] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-28T20:38:00.082183] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-28T20:38:00.083822] [DEBUG] [LOCAL ] PGR: Trimmed 76799 records to 52858 (keeping 200 days of data) [2025-10-28T20:38:00.407744] [DEBUG] [LOCAL ] PGR: Primary data saved (52858 records). [2025-10-28T20:38:00.407870] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-28T20:38:00.407940] [INFO ] [MAIN ] Update Progress: 1673/2366 symbols completed. PGR took 38.5s. Estimated remaining: 1h 30m 17s. Rate: 7.7 symbols/min [2025-10-28T20:38:00.575432] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:00.575583] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-28T20:38:00.575621] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-28T20:38:00.575751] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-28T20:38:00.575796] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-28T20:38:00.575875] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-28T20:38:00.575921] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-28T20:38:00.788806] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-28T20:38:00.950939] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:00.977878] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T20:38:01.081751] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T20:38:01.580277] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-28T20:38:01.968438] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T20:38:02.380249] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-28T20:38:02.716296] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:38:03.180279] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-28T20:38:03.424599] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T20:38:03.431606] [INFO ] [REMOTE ] PH: Full fetch complete (55516 records). [2025-10-28T20:38:03.431790] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-28T20:38:03.836420] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-28T20:38:03.836543] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-28T20:38:03.838075] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-28T20:38:03.838144] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-28T20:38:03.839838] [DEBUG] [LOCAL ] PH: Trimmed 55516 records to 35877 (keeping 200 days of data) [2025-10-28T20:38:04.019723] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-28T20:38:04.090790] [DEBUG] [LOCAL ] PH: Primary data saved (35877 records). [2025-10-28T20:38:04.091005] [INFO ] [MAIN ] PH: Full history saved. [2025-10-28T20:38:04.091097] [INFO ] [MAIN ] Update Progress: 1674/2366 symbols completed. PH took 27.2s. Estimated remaining: 1h 30m 7s. Rate: 7.7 symbols/min [2025-10-28T20:38:04.280665] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:04.313337] [DEBUG] [LOCAL ] PHK: Loaded 26352 existing records from primary storage. [2025-10-28T20:38:04.313729] [INFO ] [MAIN ] PHK: Loaded 26352 existing records. [2025-10-28T20:38:04.500495] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:38:04.500987] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-28T20:38:04.501104] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-28T20:38:04.501618] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-28T20:38:04.501775] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-28T20:38:04.626365] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T20:38:04.790744] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-28T20:38:04.914340] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:05.111285] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T20:38:05.580257] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-28T20:38:06.283764] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T20:38:06.380271] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-28T20:38:06.662141] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T20:38:07.180316] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-28T20:38:07.712225] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T20:38:07.980256] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-28T20:38:08.009370] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T20:38:08.780251] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-28T20:38:09.384112] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T20:38:09.527676] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T20:38:09.580212] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-28T20:38:10.380228] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-28T20:38:10.501327] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T20:38:11.180231] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-28T20:38:11.283426] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T20:38:11.980295] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-28T20:38:12.038208] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T20:38:12.780257] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-28T20:38:13.580293] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-28T20:38:13.671059] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T20:38:13.770788] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T20:38:14.380244] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-28T20:38:15.007735] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T20:38:15.180267] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-28T20:38:15.729318] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T20:38:15.980315] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-28T20:38:16.233883] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T20:38:16.780260] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-28T20:38:17.351426] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T20:38:17.580220] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-28T20:38:17.658985] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T20:38:18.315538] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T20:38:18.380272] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-28T20:38:19.180226] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-28T20:38:19.258705] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T20:38:19.980260] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-28T20:38:20.316022] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T20:38:20.647037] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T20:38:20.780288] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-28T20:38:21.580292] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-28T20:38:21.649188] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T20:38:22.380272] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-28T20:38:22.809360] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T20:38:23.180230] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-28T20:38:23.250474] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T20:38:23.980263] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-28T20:38:24.203832] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T20:38:24.780273] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-28T20:38:24.862550] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T20:38:25.580242] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-28T20:38:25.721916] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T20:38:26.380310] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-28T20:38:26.823400] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T20:38:26.831953] [INFO ] [REMOTE ] PHG: Full fetch complete (65847 records). [2025-10-28T20:38:26.832114] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-28T20:38:27.182863] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-28T20:38:27.230013] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-28T20:38:27.230265] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-28T20:38:27.231468] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-28T20:38:27.231537] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-28T20:38:27.232964] [DEBUG] [LOCAL ] PHG: Trimmed 65847 records to 45218 (keeping 200 days of data) [2025-10-28T20:38:27.343678] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T20:38:27.516600] [DEBUG] [LOCAL ] PHG: Primary data saved (45218 records). [2025-10-28T20:38:27.516751] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-28T20:38:27.517339] [INFO ] [MAIN ] Update Progress: 1675/2366 symbols completed. PHG took 31.2s. Estimated remaining: 1h 30m 6s. Rate: 7.7 symbols/min [2025-10-28T20:38:27.687041] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:27.687228] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-28T20:38:27.687273] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-28T20:38:27.687382] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-28T20:38:27.687426] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-28T20:38:27.687506] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-28T20:38:27.687567] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-28T20:38:27.985445] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-28T20:38:28.047235] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:28.245015] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T20:38:28.780287] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-28T20:38:29.267939] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T20:38:29.580219] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-28T20:38:29.707735] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T20:38:29.713577] [INFO ] [REMOTE ] PHK: Full fetch complete (39349 records). [2025-10-28T20:38:29.713680] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-28T20:38:30.078249] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-28T20:38:30.078367] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-28T20:38:30.079165] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-28T20:38:30.079225] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-28T20:38:30.080104] [DEBUG] [LOCAL ] PHK: Trimmed 39349 records to 26182 (keeping 200 days of data) [2025-10-28T20:38:30.227752] [DEBUG] [LOCAL ] PHK: Primary data saved (26182 records). [2025-10-28T20:38:30.227873] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-28T20:38:30.227947] [INFO ] [MAIN ] Update Progress: 1676/2366 symbols completed. PHK took 26.1s. Estimated remaining: 1h 29m 56s. Rate: 7.7 symbols/min [2025-10-28T20:38:30.395101] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:30.392574] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-28T20:38:30.432005] [DEBUG] [LOCAL ] PHR: Loaded 37683 existing records from primary storage. [2025-10-28T20:38:30.432262] [INFO ] [MAIN ] PHR: Loaded 37683 existing records. [2025-10-28T20:38:30.606586] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:38:30.606868] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-28T20:38:30.606938] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-28T20:38:30.607464] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-28T20:38:30.607519] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-28T20:38:30.959794] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:30.990465] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T20:38:31.180219] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-28T20:38:31.319995] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T20:38:31.980275] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-28T20:38:32.297024] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T20:38:32.781020] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-28T20:38:32.782617] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:38:32.786897] [INFO ] [REMOTE ] PHI: Full fetch complete (21566 records). [2025-10-28T20:38:32.786972] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-28T20:38:33.151293] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-28T20:38:33.151366] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-28T20:38:33.151829] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-28T20:38:33.151888] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-28T20:38:33.152425] [DEBUG] [LOCAL ] PHI: Trimmed 21566 records to 15150 (keeping 200 days of data) [2025-10-28T20:38:33.243595] [DEBUG] [LOCAL ] PHI: Primary data saved (15150 records). [2025-10-28T20:38:33.243770] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-28T20:38:33.243858] [INFO ] [MAIN ] Update Progress: 1677/2366 symbols completed. PHI took 34.5s. Estimated remaining: 1h 29m 46s. Rate: 7.7 symbols/min [2025-10-28T20:38:33.580299] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-28T20:38:33.993992] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T20:38:34.380269] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-28T20:38:35.180243] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-28T20:38:35.344368] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T20:38:35.350620] [INFO ] [REMOTE ] PHIN: Full fetch complete (47504 records). [2025-10-28T20:38:35.350729] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-28T20:38:35.743560] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-28T20:38:35.743632] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-28T20:38:35.744526] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-28T20:38:35.744574] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-28T20:38:35.745525] [DEBUG] [LOCAL ] PHIN: Trimmed 47504 records to 31139 (keeping 200 days of data) [2025-10-28T20:38:35.927070] [DEBUG] [LOCAL ] PHIN: Primary data saved (31139 records). [2025-10-28T20:38:35.927196] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-28T20:38:35.927264] [INFO ] [MAIN ] Update Progress: 1678/2366 symbols completed. PHIN took 35.5s. Estimated remaining: 1h 29m 36s. Rate: 7.7 symbols/min [2025-10-28T20:38:36.135576] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T20:38:36.142147] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-28T20:38:37.380254] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T20:38:37.388471] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-28T20:38:38.471765] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T20:38:38.480825] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-28T20:38:38.912215] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (5.33 seconds). [2025-10-28T20:38:38.922225] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-28T20:38:39.542691] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T20:38:39.551842] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-28T20:38:40.329071] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T20:38:40.343184] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-28T20:38:40.625476] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T20:38:40.780275] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-28T20:38:41.880952] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T20:38:41.892524] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-28T20:38:41.942818] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T20:38:42.380296] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-28T20:38:43.445597] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T20:38:43.457060] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-28T20:38:43.509378] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T20:38:43.980258] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-28T20:38:45.087883] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T20:38:45.100902] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-28T20:38:45.244804] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T20:38:45.580301] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-28T20:38:46.647247] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T20:38:46.658922] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-28T20:38:46.723866] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T20:38:46.731992] [INFO ] [REMOTE ] PHR: Full fetch complete (53276 records). [2025-10-28T20:38:46.732146] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-28T20:38:47.125315] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-28T20:38:47.125423] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-28T20:38:47.126373] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-28T20:38:47.126433] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-28T20:38:47.127443] [DEBUG] [LOCAL ] PHR: Trimmed 53276 records to 37604 (keeping 200 days of data) [2025-10-28T20:38:47.336946] [DEBUG] [LOCAL ] PHR: Primary data saved (37604 records). [2025-10-28T20:38:47.337072] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-28T20:38:47.337388] [INFO ] [MAIN ] Update Progress: 1679/2366 symbols completed. PHR took 17.1s. Estimated remaining: 1h 29m 30s. Rate: 7.7 symbols/min [2025-10-28T20:38:48.271227] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T20:38:48.282327] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-28T20:38:49.826801] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T20:38:49.838046] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-28T20:38:51.385189] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T20:38:51.395942] [INFO ] [REMOTE ] PHM: Full fetch complete (75249 records). [2025-10-28T20:38:51.396136] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-28T20:38:51.817702] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-10-28T20:38:51.817804] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-10-28T20:38:51.819495] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-10-28T20:38:51.819584] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-10-28T20:38:51.821167] [DEBUG] [LOCAL ] PHM: Trimmed 75249 records to 51674 (keeping 200 days of data) [2025-10-28T20:38:52.141926] [DEBUG] [LOCAL ] PHM: Primary data saved (51674 records). [2025-10-28T20:38:52.142060] [INFO ] [MAIN ] PHM: Full history saved. [2025-10-28T20:38:52.142130] [INFO ] [MAIN ] Update Progress: 1680/2366 symbols completed. PHM took 24.6s. Estimated remaining: 1h 29m 21s. Rate: 7.7 symbols/min [2025-10-28T20:38:52.847123] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:52.858057] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:52.855105] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:52.861178] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-28T20:38:52.875668] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-28T20:38:52.880504] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-28T20:38:52.880899] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-28T20:38:52.880321] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:38:52.881134] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-28T20:38:52.881275] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-28T20:38:52.926714] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-10-28T20:38:52.964053] [INFO ] [MAIN ] PIM: Loaded 4814 existing records. [2025-10-28T20:38:52.996343] [DEBUG] [LOCAL ] PINE: Loaded 14362 existing records from primary storage. [2025-10-28T20:38:53.011918] [INFO ] [MAIN ] PINE: Loaded 14362 existing records. [2025-10-28T20:38:53.508396] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-28T20:38:53.540350] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-10-28T20:38:53.580306] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:38:53.583160] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:38:53.583739] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-28T20:38:53.605002] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-28T20:38:53.630597] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-28T20:38:53.619810] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-28T20:38:53.678529] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-28T20:38:53.678755] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-28T20:38:53.712124] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-28T20:38:53.730148] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-28T20:38:53.767062] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:53.851888] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-28T20:38:54.058963] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:38:54.070584] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-28T20:38:54.086156] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-28T20:38:54.121294] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-28T20:38:54.121402] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-28T20:38:54.786124] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:54.811559] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-28T20:38:54.822209] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:54.840384] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-28T20:38:54.997304] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:38:54.997667] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-28T20:38:55.596933] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T20:38:55.609971] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-28T20:38:55.628076] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T20:38:55.638354] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-28T20:38:55.764411] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T20:38:55.765818] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-28T20:38:56.240138] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T20:38:56.241568] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-28T20:38:56.328532] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:38:56.332213] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-28T20:38:56.505734] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T20:38:56.516267] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-28T20:38:56.739479] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T20:38:56.780255] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-28T20:38:56.877445] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T20:38:56.904873] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T20:38:57.214056] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T20:38:57.580294] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-28T20:38:57.898591] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T20:38:58.093086] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T20:38:58.380267] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-28T20:38:58.892300] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T20:38:59.180271] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-28T20:38:59.980261] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-28T20:39:00.780236] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-28T20:39:00.807054] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T20:39:00.887423] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T20:39:01.256937] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T20:39:01.580292] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-28T20:39:02.202392] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T20:39:02.380269] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-28T20:39:03.180296] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-28T20:39:03.899205] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T20:39:03.980214] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-28T20:39:04.574298] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T20:39:04.780268] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-28T20:39:05.588940] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-28T20:39:05.616957] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T20:39:06.196141] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T20:39:06.239172] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T20:39:06.380252] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-28T20:39:07.180307] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-28T20:39:07.356868] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T20:39:07.787414] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T20:39:07.789233] [INFO ] [REMOTE ] PIM: Full fetch complete (6584 records). [2025-10-28T20:39:07.789317] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-28T20:39:07.990330] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-28T20:39:08.152052] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-28T20:39:08.152146] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-28T20:39:08.152362] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-28T20:39:08.152406] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-28T20:39:08.152821] [DEBUG] [LOCAL ] PIM: Trimmed 6584 records to 4884 (keeping 200 days of data) [2025-10-28T20:39:08.180586] [DEBUG] [LOCAL ] PIM: Primary data saved (4884 records). [2025-10-28T20:39:08.180705] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-28T20:39:08.180802] [INFO ] [MAIN ] Update Progress: 1681/2366 symbols completed. PIM took 16.0s. Estimated remaining: 1h 29m 17s. Rate: 7.7 symbols/min [2025-10-28T20:39:08.352602] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:08.353051] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-28T20:39:08.353103] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-28T20:39:08.353221] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-28T20:39:08.353263] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-28T20:39:08.353306] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-28T20:39:08.353339] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-28T20:39:08.714466] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:08.780215] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-28T20:39:09.468612] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T20:39:09.580277] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-28T20:39:09.765039] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T20:39:10.380332] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-28T20:39:10.424363] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T20:39:11.180226] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-28T20:39:11.267670] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T20:39:11.980341] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-28T20:39:12.735076] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T20:39:12.756754] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T20:39:12.780217] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-28T20:39:13.487773] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T20:39:13.580245] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-28T20:39:14.380241] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-28T20:39:14.427880] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T20:39:14.431562] [INFO ] [REMOTE ] PINE: Full fetch complete (21253 records). [2025-10-28T20:39:14.431724] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-28T20:39:14.820112] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-28T20:39:14.820190] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-28T20:39:14.820711] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-28T20:39:14.820772] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-28T20:39:14.821376] [DEBUG] [LOCAL ] PINE: Trimmed 21253 records to 14314 (keeping 200 days of data) [2025-10-28T20:39:14.912677] [DEBUG] [LOCAL ] PINE: Primary data saved (14314 records). [2025-10-28T20:39:14.912829] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-28T20:39:14.912915] [INFO ] [MAIN ] Update Progress: 1682/2366 symbols completed. PINE took 22.8s. Estimated remaining: 1h 29m 8s. Rate: 7.7 symbols/min [2025-10-28T20:39:15.094768] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:15.094949] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-28T20:39:15.094986] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-28T20:39:15.095093] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-28T20:39:15.095133] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-28T20:39:15.095173] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-28T20:39:15.095204] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-28T20:39:15.185458] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-28T20:39:15.448257] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:15.583317] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:39:15.980272] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-28T20:39:16.727628] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T20:39:16.780354] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-28T20:39:17.364769] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:39:17.580247] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-28T20:39:18.309375] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:39:18.380228] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-28T20:39:18.655085] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-28T20:39:19.123442] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T20:39:19.180215] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-28T20:39:19.980289] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-28T20:39:20.184281] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T20:39:20.780279] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-28T20:39:20.905988] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T20:39:21.580281] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-28T20:39:22.197685] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T20:39:22.380299] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-28T20:39:22.577031] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T20:39:23.180325] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-28T20:39:23.747559] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T20:39:23.980260] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-28T20:39:24.188960] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T20:39:24.780266] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-28T20:39:25.462271] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T20:39:25.580229] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-28T20:39:26.240703] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T20:39:26.250403] [INFO ] [REMOTE ] PII: Full fetch complete (71299 records). [2025-10-28T20:39:26.250540] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-28T20:39:26.382803] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-28T20:39:26.619171] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T20:39:26.680269] [INFO ] [REMOTE ] PINS: Full fetch complete (77481 records). [2025-10-28T20:39:26.719128] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-28T20:39:26.719315] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-28T20:39:26.719480] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-28T20:39:26.720909] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-28T20:39:26.721074] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-28T20:39:26.722115] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:39:26.722294] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:39:26.722363] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:39:26.722451] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-28T20:39:26.722531] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-28T20:39:26.722571] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-28T20:39:26.722849] [DEBUG] [LOCAL ] PINS: Deleted derivative data file. [2025-10-28T20:39:26.723864] [INFO ] [MAIN ] Update Progress: 1683/2366 symbols completed. PINS took 34.6s. Estimated remaining: 1h 29m 2s. Rate: 7.7 symbols/min [2025-10-28T20:39:26.771749] [DEBUG] [LOCAL ] PII: Trimmed 71299 records to 48536 (keeping 200 days of data) [2025-10-28T20:39:27.090561] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:27.098971] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-28T20:39:27.106502] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-28T20:39:27.109235] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-28T20:39:27.121154] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-28T20:39:27.121419] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-28T20:39:27.121488] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-28T20:39:27.264126] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-28T20:39:27.403782] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T20:39:27.863410] [DEBUG] [LOCAL ] PII: Primary data saved (48536 records). [2025-10-28T20:39:27.863184] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:27.863924] [INFO ] [MAIN ] PII: Full history saved. [2025-10-28T20:39:27.864016] [INFO ] [MAIN ] Update Progress: 1684/2366 symbols completed. PII took 35.7s. Estimated remaining: 1h 28m 52s. Rate: 7.7 symbols/min [2025-10-28T20:39:27.982038] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-28T20:39:28.061692] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:28.079591] [DEBUG] [LOCAL ] PKE: Loaded 14213 existing records from primary storage. [2025-10-28T20:39:28.079929] [INFO ] [MAIN ] PKE: Loaded 14213 existing records. [2025-10-28T20:39:28.259083] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:39:28.259427] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-28T20:39:28.259612] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-28T20:39:28.260057] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-28T20:39:28.260118] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-28T20:39:28.553770] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T20:39:28.657252] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:28.765249] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T20:39:28.780225] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-28T20:39:29.502844] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T20:39:29.580227] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-28T20:39:30.283430] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T20:39:30.380267] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-28T20:39:31.044637] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T20:39:31.180263] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-28T20:39:31.980250] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-28T20:39:32.629340] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:39:32.780267] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-28T20:39:32.876808] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T20:39:32.880189] [INFO ] [REMOTE ] PIPR: Full fetch complete (20963 records). [2025-10-28T20:39:32.880279] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-28T20:39:33.236527] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-28T20:39:33.236598] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-28T20:39:33.237045] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-28T20:39:33.237105] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-28T20:39:33.237694] [DEBUG] [LOCAL ] PIPR: Trimmed 20963 records to 14534 (keeping 200 days of data) [2025-10-28T20:39:33.325314] [DEBUG] [LOCAL ] PIPR: Primary data saved (14534 records). [2025-10-28T20:39:33.325444] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-28T20:39:33.325523] [INFO ] [MAIN ] Update Progress: 1685/2366 symbols completed. PIPR took 25.1s. Estimated remaining: 1h 28m 43s. Rate: 7.7 symbols/min [2025-10-28T20:39:33.496106] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:33.496293] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-28T20:39:33.496346] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-28T20:39:33.496467] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-28T20:39:33.496516] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-28T20:39:33.496557] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-28T20:39:33.496588] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-28T20:39:33.588751] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-28T20:39:33.852536] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:34.258836] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T20:39:34.310533] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:39:34.380253] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-28T20:39:35.180313] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-28T20:39:35.452774] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T20:39:35.980225] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-28T20:39:36.780238] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-28T20:39:36.837248] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T20:39:36.897867] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T20:39:37.357392] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T20:39:37.580301] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-28T20:39:38.380258] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-28T20:39:38.934157] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T20:39:39.180232] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-28T20:39:39.220084] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T20:39:39.777114] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T20:39:39.980259] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-28T20:39:40.780266] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-28T20:39:41.384255] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T20:39:41.580283] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-28T20:39:42.380308] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-28T20:39:42.801224] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T20:39:42.849117] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-28T20:39:43.013757] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:39:43.180302] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-28T20:39:43.980322] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-28T20:39:44.630775] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T20:39:44.780267] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-28T20:39:44.903309] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T20:39:45.580267] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-28T20:39:46.350739] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T20:39:46.380204] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-28T20:39:46.963161] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T20:39:47.180241] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-28T20:39:47.932286] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T20:39:47.980232] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-28T20:39:48.197970] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-28T20:39:48.780293] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-28T20:39:49.580225] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-28T20:39:49.875700] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-28T20:39:50.239487] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T20:39:50.380219] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-28T20:39:50.649890] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T20:39:51.180317] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-28T20:39:51.891593] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T20:39:51.952230] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T20:39:51.980214] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-28T20:39:52.780216] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:39:52.780284] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-28T20:39:52.785491] [INFO ] [REMOTE ] PKE: Full fetch complete (18573 records). [2025-10-28T20:39:52.785563] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-28T20:39:53.145131] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-28T20:39:53.145244] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-28T20:39:53.145691] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-28T20:39:53.145752] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-28T20:39:53.146406] [DEBUG] [LOCAL ] PKE: Trimmed 18573 records to 14234 (keeping 200 days of data) [2025-10-28T20:39:53.231800] [DEBUG] [LOCAL ] PKE: Primary data saved (14234 records). [2025-10-28T20:39:53.231941] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-28T20:39:53.232028] [INFO ] [MAIN ] Update Progress: 1686/2366 symbols completed. PKE took 25.4s. Estimated remaining: 1h 28m 40s. Rate: 7.7 symbols/min [2025-10-28T20:39:53.396680] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:53.416191] [DEBUG] [LOCAL ] PKST: Loaded 17944 existing records from primary storage. [2025-10-28T20:39:53.416436] [INFO ] [MAIN ] PKST: Loaded 17944 existing records. [2025-10-28T20:39:53.585074] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-28T20:39:53.588691] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:39:53.589858] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-28T20:39:53.589951] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-28T20:39:53.590280] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-28T20:39:53.590336] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-28T20:39:53.933100] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:54.189951] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T20:39:54.380311] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-28T20:39:54.483161] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T20:39:55.180317] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-28T20:39:55.637069] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:39:55.837222] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T20:39:55.980242] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-28T20:39:56.780283] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-28T20:39:57.584802] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-28T20:39:57.591587] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T20:39:57.911768] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T20:39:58.382896] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-28T20:39:58.385425] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:39:58.390413] [INFO ] [REMOTE ] PJT: Full fetch complete (31954 records). [2025-10-28T20:39:58.390489] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-28T20:39:58.794766] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-28T20:39:58.794844] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-28T20:39:58.795562] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-28T20:39:58.795601] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-28T20:39:58.796362] [DEBUG] [LOCAL ] PJT: Trimmed 31954 records to 20579 (keeping 200 days of data) [2025-10-28T20:39:58.921625] [DEBUG] [LOCAL ] PJT: Primary data saved (20579 records). [2025-10-28T20:39:58.921764] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-28T20:39:58.921833] [INFO ] [MAIN ] Update Progress: 1687/2366 symbols completed. PJT took 44.0s. Estimated remaining: 1h 28m 31s. Rate: 7.7 symbols/min [2025-10-28T20:39:59.113280] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:39:59.136581] [DEBUG] [LOCAL ] PKX: Loaded 22152 existing records from primary storage. [2025-10-28T20:39:59.136850] [INFO ] [MAIN ] PKX: Loaded 22152 existing records. [2025-10-28T20:39:59.190750] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-28T20:39:59.313499] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:39:59.313710] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-28T20:39:59.313765] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-28T20:39:59.314101] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-28T20:39:59.314157] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-28T20:39:59.660140] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:39:59.980249] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-28T20:40:00.112633] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T20:40:00.231955] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T20:40:00.780252] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-28T20:40:00.926797] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T20:40:01.580262] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-28T20:40:02.386273] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-28T20:40:02.415043] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T20:40:02.426602] [INFO ] [REMOTE ] PK: Full fetch complete (76521 records). [2025-10-28T20:40:02.426818] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-28T20:40:02.579912] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T20:40:02.861964] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-28T20:40:02.862058] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-28T20:40:02.863237] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-28T20:40:02.863307] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-28T20:40:02.864861] [DEBUG] [LOCAL ] PK: Trimmed 76521 records to 52716 (keeping 200 days of data) [2025-10-28T20:40:03.183319] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-28T20:40:03.183237] [DEBUG] [LOCAL ] PK: Primary data saved (52716 records). [2025-10-28T20:40:03.184271] [INFO ] [MAIN ] PK: Full history saved. [2025-10-28T20:40:03.184367] [INFO ] [MAIN ] Update Progress: 1688/2366 symbols completed. PK took 36.5s. Estimated remaining: 1h 28m 22s. Rate: 7.7 symbols/min [2025-10-28T20:40:03.362788] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:03.413328] [DEBUG] [LOCAL ] PL: Loaded 53218 existing records from primary storage. [2025-10-28T20:40:03.413701] [INFO ] [MAIN ] PL: Loaded 53218 existing records. [2025-10-28T20:40:03.602859] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:40:03.603139] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-28T20:40:03.603236] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-28T20:40:03.603945] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-28T20:40:03.604006] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-28T20:40:03.905241] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T20:40:03.995991] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:03.991414] [INFO ] [REMOTE ] PKG: Full fetch complete (57678 records). [2025-10-28T20:40:03.996281] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-28T20:40:03.991181] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-28T20:40:04.476826] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-28T20:40:04.476995] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-28T20:40:04.478105] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-28T20:40:04.478331] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-28T20:40:04.498172] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T20:40:04.504547] [DEBUG] [LOCAL ] PKG: Trimmed 57678 records to 38437 (keeping 200 days of data) [2025-10-28T20:40:04.749508] [DEBUG] [LOCAL ] PKG: Primary data saved (38437 records). [2025-10-28T20:40:04.749673] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-28T20:40:04.749766] [INFO ] [MAIN ] Update Progress: 1689/2366 symbols completed. PKG took 31.4s. Estimated remaining: 1h 28m 12s. Rate: 7.7 symbols/min [2025-10-28T20:40:04.785378] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-28T20:40:04.920326] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:04.920522] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-28T20:40:04.920558] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-28T20:40:04.920694] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-28T20:40:04.920747] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-28T20:40:04.920790] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-28T20:40:04.920822] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-28T20:40:05.285418] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:05.302963] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:40:05.580263] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-28T20:40:05.850252] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T20:40:06.380281] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-28T20:40:06.701761] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T20:40:07.162302] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T20:40:07.180225] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-28T20:40:07.980334] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-28T20:40:08.259531] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T20:40:08.780305] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-28T20:40:09.580302] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-28T20:40:09.990837] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T20:40:10.023687] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T20:40:10.301997] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T20:40:10.380227] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-28T20:40:11.180221] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-28T20:40:11.215166] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T20:40:11.980274] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-28T20:40:12.666355] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T20:40:12.780220] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-28T20:40:13.537419] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T20:40:13.580251] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-28T20:40:14.380286] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-28T20:40:14.490032] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-28T20:40:15.180231] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-28T20:40:15.231815] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T20:40:15.367183] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-28T20:40:15.980268] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-28T20:40:16.283526] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:40:16.780249] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-28T20:40:17.580264] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-28T20:40:17.919632] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-28T20:40:18.062776] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:40:18.380351] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-28T20:40:19.180250] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-28T20:40:19.340753] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-28T20:40:19.714339] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:40:19.721903] [INFO ] [REMOTE ] PKST: Full fetch complete (28830 records). [2025-10-28T20:40:19.722163] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-28T20:40:19.992267] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-28T20:40:20.180243] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-28T20:40:20.180332] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-28T20:40:20.181126] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-28T20:40:20.181191] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-28T20:40:20.182026] [DEBUG] [LOCAL ] PKST: Trimmed 28830 records to 17898 (keeping 200 days of data) [2025-10-28T20:40:20.301951] [DEBUG] [LOCAL ] PKST: Primary data saved (17898 records). [2025-10-28T20:40:20.302354] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-28T20:40:20.302619] [INFO ] [MAIN ] Update Progress: 1690/2366 symbols completed. PKST took 27.1s. Estimated remaining: 1h 28m 7s. Rate: 7.7 symbols/min [2025-10-28T20:40:20.417140] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T20:40:20.495686] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:20.495879] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-28T20:40:20.495915] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-28T20:40:20.496038] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-28T20:40:20.496085] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-28T20:40:20.496128] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-28T20:40:20.496160] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-28T20:40:20.785434] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-28T20:40:20.857886] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:21.580275] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-28T20:40:21.907962] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T20:40:22.380226] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-28T20:40:22.430251] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T20:40:22.453260] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T20:40:23.180329] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-28T20:40:23.980293] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-28T20:40:24.253888] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-28T20:40:24.331676] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T20:40:24.780250] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-28T20:40:25.571958] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T20:40:25.583590] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-28T20:40:25.964458] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:40:26.380256] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-28T20:40:27.180265] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-28T20:40:27.422053] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-28T20:40:27.812665] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T20:40:27.980256] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-28T20:40:28.551848] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:40:28.780251] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-28T20:40:28.904433] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T20:40:29.580301] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-28T20:40:30.380245] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-28T20:40:30.540469] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T20:40:30.545408] [INFO ] [REMOTE ] PKX: Full fetch complete (35686 records). [2025-10-28T20:40:30.545528] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-28T20:40:30.935581] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-28T20:40:30.951016] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-28T20:40:30.965915] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-28T20:40:30.966582] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-28T20:40:30.968001] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-28T20:40:30.980003] [DEBUG] [LOCAL ] PKX: Trimmed 35686 records to 21982 (keeping 200 days of data) [2025-10-28T20:40:31.113231] [DEBUG] [LOCAL ] PKX: Primary data saved (21982 records). [2025-10-28T20:40:31.113380] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-28T20:40:31.113467] [INFO ] [MAIN ] Update Progress: 1691/2366 symbols completed. PKX took 32.2s. Estimated remaining: 1h 28m 0s. Rate: 7.7 symbols/min [2025-10-28T20:40:31.185438] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-28T20:40:31.293375] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:31.321089] [DEBUG] [LOCAL ] PLOW: Loaded 19211 existing records from primary storage. [2025-10-28T20:40:31.321432] [INFO ] [MAIN ] PLOW: Loaded 19211 existing records. [2025-10-28T20:40:31.500181] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:40:31.500456] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-28T20:40:31.500503] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-28T20:40:31.500731] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-28T20:40:31.500788] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-28T20:40:31.867815] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:31.896171] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T20:40:31.980241] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-28T20:40:32.780276] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-28T20:40:33.283541] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T20:40:33.560959] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-28T20:40:33.580907] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-28T20:40:33.587796] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T20:40:34.380291] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-28T20:40:35.179737] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T20:40:35.190739] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-28T20:40:35.821180] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T20:40:35.980250] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-28T20:40:36.147897] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T20:40:36.780291] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-28T20:40:37.417318] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:40:37.580220] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-28T20:40:37.615290] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T20:40:38.380321] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-28T20:40:38.843226] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:40:39.180287] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-28T20:40:39.316702] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T20:40:39.980248] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-28T20:40:40.780265] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-28T20:40:40.991366] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T20:40:41.205132] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:40:41.580280] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-28T20:40:42.380247] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-28T20:40:42.919436] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-28T20:40:42.930017] [INFO ] [REMOTE ] PL: Full fetch complete (77162 records). [2025-10-28T20:40:42.930136] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-28T20:40:43.183556] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-28T20:40:43.336120] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-28T20:40:43.336337] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-28T20:40:43.337789] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-28T20:40:43.338131] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-28T20:40:43.339928] [DEBUG] [LOCAL ] PL: Trimmed 77162 records to 53219 (keeping 200 days of data) [2025-10-28T20:40:43.452135] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-28T20:40:43.487804] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T20:40:43.700184] [DEBUG] [LOCAL ] PL: Primary data saved (53219 records). [2025-10-28T20:40:43.700306] [INFO ] [MAIN ] PL: Full history saved. [2025-10-28T20:40:43.700926] [INFO ] [MAIN ] Update Progress: 1692/2366 symbols completed. PL took 40.5s. Estimated remaining: 1h 27m 54s. Rate: 7.7 symbols/min [2025-10-28T20:40:43.872773] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:43.903562] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T20:40:43.913542] [INFO ] [REMOTE ] PLNT: Full fetch complete (70527 records). [2025-10-28T20:40:43.913731] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-28T20:40:43.985482] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-28T20:40:44.079004] [DEBUG] [LOCAL ] PLYM: Loaded 34355 existing records from primary storage. [2025-10-28T20:40:44.093532] [INFO ] [MAIN ] PLYM: Loaded 34355 existing records. [2025-10-28T20:40:44.462987] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:40:44.464311] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-28T20:40:44.480250] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-28T20:40:44.500274] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-28T20:40:44.500327] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-28T20:40:44.501383] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-28T20:40:44.501425] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-28T20:40:44.501526] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-28T20:40:44.501593] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-28T20:40:44.602677] [DEBUG] [LOCAL ] PLNT: Trimmed 70527 records to 47899 (keeping 200 days of data) [2025-10-28T20:40:44.793757] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-28T20:40:45.070675] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:45.084481] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:40:45.163944] [DEBUG] [LOCAL ] PLNT: Primary data saved (47899 records). [2025-10-28T20:40:45.164063] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-28T20:40:45.164130] [INFO ] [MAIN ] Update Progress: 1693/2366 symbols completed. PLNT took 24.9s. Estimated remaining: 1h 27m 44s. Rate: 7.7 symbols/min [2025-10-28T20:40:45.329514] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:45.329688] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-28T20:40:45.329759] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-28T20:40:45.329867] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-28T20:40:45.329907] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-28T20:40:45.329946] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-28T20:40:45.329977] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-28T20:40:45.585400] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-28T20:40:45.685503] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:46.380226] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-28T20:40:46.488784] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T20:40:46.499556] [INFO ] [REMOTE ] PLD: Full fetch complete (77501 records). [2025-10-28T20:40:46.499714] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-28T20:40:46.891127] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-28T20:40:46.891272] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-28T20:40:46.892432] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-28T20:40:46.892599] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-28T20:40:46.909890] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T20:40:46.915775] [DEBUG] [LOCAL ] PLD: Trimmed 77501 records to 53404 (keeping 200 days of data) [2025-10-28T20:40:47.196733] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-28T20:40:47.246549] [DEBUG] [LOCAL ] PLD: Primary data saved (53404 records). [2025-10-28T20:40:47.246692] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-28T20:40:47.246774] [INFO ] [MAIN ] Update Progress: 1694/2366 symbols completed. PLD took 42.5s. Estimated remaining: 1h 27m 34s. Rate: 7.7 symbols/min [2025-10-28T20:40:47.430613] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:47.444342] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T20:40:47.467003] [DEBUG] [LOCAL ] PML: Loaded 21682 existing records from primary storage. [2025-10-28T20:40:47.467288] [INFO ] [MAIN ] PML: Loaded 21682 existing records. [2025-10-28T20:40:47.641891] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:40:47.642135] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-28T20:40:47.642182] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-28T20:40:47.642570] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-28T20:40:47.642628] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-28T20:40:47.985489] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-28T20:40:47.989610] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:48.783458] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T20:40:48.783563] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-28T20:40:48.801788] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T20:40:49.580279] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-28T20:40:50.037356] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:40:50.380244] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-28T20:40:50.622198] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T20:40:51.180281] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-28T20:40:51.293384] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T20:40:51.980303] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-28T20:40:52.720585] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T20:40:52.742372] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T20:40:52.780254] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-28T20:40:53.580325] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-28T20:40:54.380226] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-28T20:40:54.450979] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T20:40:54.473517] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T20:40:54.476595] [INFO ] [REMOTE ] PLOW: Full fetch complete (27974 records). [2025-10-28T20:40:54.476697] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-28T20:40:54.854098] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-28T20:40:54.854175] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-28T20:40:54.854752] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-28T20:40:54.854812] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-28T20:40:54.855458] [DEBUG] [LOCAL ] PLOW: Trimmed 27974 records to 19200 (keeping 200 days of data) [2025-10-28T20:40:54.970150] [DEBUG] [LOCAL ] PLOW: Primary data saved (19200 records). [2025-10-28T20:40:54.970362] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-28T20:40:54.970506] [INFO ] [MAIN ] Update Progress: 1695/2366 symbols completed. PLOW took 23.9s. Estimated remaining: 1h 27m 26s. Rate: 7.7 symbols/min [2025-10-28T20:40:55.120987] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T20:40:55.154922] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:40:55.165288] [DEBUG] [LOCAL ] PMM: Loaded 9732 existing records from primary storage. [2025-10-28T20:40:55.165479] [INFO ] [MAIN ] PMM: Loaded 9732 existing records. [2025-10-28T20:40:55.185389] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-28T20:40:55.342980] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:40:55.343223] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-28T20:40:55.343269] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-28T20:40:55.343518] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-28T20:40:55.343574] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-28T20:40:55.695758] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:40:55.946702] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T20:40:55.980258] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-28T20:40:56.780275] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-28T20:40:56.876204] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T20:40:57.580270] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-28T20:40:57.820215] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T20:40:58.380260] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-28T20:40:59.180227] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-28T20:40:59.220713] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T20:40:59.386240] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T20:40:59.980228] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-28T20:41:00.482674] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T20:41:00.780213] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-28T20:41:00.868760] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T20:41:01.580499] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-28T20:41:02.380299] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-28T20:41:02.578991] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T20:41:02.653946] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-28T20:41:03.013270] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:41:03.180335] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-28T20:41:03.863764] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T20:41:03.980252] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-28T20:41:04.780245] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-28T20:41:05.533569] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T20:41:05.580212] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-28T20:41:05.779766] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T20:41:06.329487] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T20:41:06.380352] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-28T20:41:07.180257] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-28T20:41:07.980232] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-28T20:41:08.134886] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T20:41:08.442593] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T20:41:08.780261] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-28T20:41:08.895165] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T20:41:09.580243] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-28T20:41:10.380282] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-28T20:41:10.568755] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T20:41:10.606505] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-28T20:41:11.180268] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-28T20:41:11.768746] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T20:41:11.813808] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T20:41:11.980267] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-28T20:41:12.515880] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T20:41:12.780288] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-28T20:41:13.580253] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-28T20:41:14.212276] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T20:41:14.380253] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-28T20:41:14.612479] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T20:41:15.180255] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-28T20:41:15.573337] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T20:41:15.581559] [INFO ] [REMOTE ] PLYM: Full fetch complete (48477 records). [2025-10-28T20:41:15.581673] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-28T20:41:15.960604] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-28T20:41:15.960721] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-28T20:41:15.961637] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-28T20:41:15.961719] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-28T20:41:15.962724] [DEBUG] [LOCAL ] PLYM: Trimmed 48477 records to 34436 (keeping 200 days of data) [2025-10-28T20:41:16.015279] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-28T20:41:16.197810] [DEBUG] [LOCAL ] PLYM: Primary data saved (34436 records). [2025-10-28T20:41:16.198326] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T20:41:16.204443] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-28T20:41:16.204572] [INFO ] [MAIN ] Update Progress: 1696/2366 symbols completed. PLYM took 32.5s. Estimated remaining: 1h 27m 24s. Rate: 7.7 symbols/min [2025-10-28T20:41:16.204712] [INFO ] [REMOTE ] PML: Full fetch complete (29622 records). [2025-10-28T20:41:16.239422] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-28T20:41:16.548453] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:16.693603] [DEBUG] [LOCAL ] PMO: Loaded 8998 existing records from primary storage. [2025-10-28T20:41:16.732579] [INFO ] [MAIN ] PMO: Loaded 8998 existing records. [2025-10-28T20:41:16.790287] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-28T20:41:17.002045] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-28T20:41:17.012391] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-28T20:41:17.013111] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-28T20:41:17.018345] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-28T20:41:17.079119] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:41:17.079561] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-28T20:41:17.079777] [DEBUG] [LOCAL ] PML: Trimmed 29622 records to 21633 (keeping 200 days of data) [2025-10-28T20:41:17.079933] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-28T20:41:17.080350] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-28T20:41:17.080414] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-28T20:41:17.398635] [DEBUG] [LOCAL ] PML: Primary data saved (21633 records). [2025-10-28T20:41:17.452469] [INFO ] [MAIN ] PML: Full history saved. [2025-10-28T20:41:17.490633] [INFO ] [MAIN ] Update Progress: 1697/2366 symbols completed. PML took 30.2s. Estimated remaining: 1h 27m 13s. Rate: 7.7 symbols/min [2025-10-28T20:41:17.741916] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:17.762855] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-28T20:41:17.796741] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:17.796923] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-28T20:41:17.796972] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-28T20:41:17.797095] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-28T20:41:17.797138] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-28T20:41:17.797179] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-28T20:41:17.797215] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-28T20:41:18.064044] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:41:18.191097] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:18.319725] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-28T20:41:18.380214] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-28T20:41:18.902487] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:41:19.180304] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-28T20:41:19.824421] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T20:41:19.980274] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-28T20:41:20.439195] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-28T20:41:20.449819] [INFO ] [REMOTE ] PM: Full fetch complete (77835 records). [2025-10-28T20:41:20.449944] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-28T20:41:20.726044] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:41:20.785332] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-28T20:41:20.859425] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-28T20:41:20.859506] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-28T20:41:20.860797] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-28T20:41:20.860861] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-28T20:41:20.862387] [DEBUG] [LOCAL ] PM: Trimmed 77835 records to 53674 (keeping 200 days of data) [2025-10-28T20:41:21.195769] [DEBUG] [LOCAL ] PM: Primary data saved (53674 records). [2025-10-28T20:41:21.195900] [INFO ] [MAIN ] PM: Full history saved. [2025-10-28T20:41:21.195985] [INFO ] [MAIN ] Update Progress: 1698/2366 symbols completed. PM took 36.0s. Estimated remaining: 1h 27m 4s. Rate: 7.7 symbols/min [2025-10-28T20:41:21.381456] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:21.381607] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-28T20:41:21.381663] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-28T20:41:21.381773] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-28T20:41:21.381834] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-28T20:41:21.381905] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-28T20:41:21.381950] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-28T20:41:21.587048] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-28T20:41:21.736971] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:22.250259] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T20:41:22.337823] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T20:41:22.380265] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-28T20:41:23.180263] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-28T20:41:23.630139] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:41:23.805162] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:41:23.980253] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-28T20:41:24.674214] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T20:41:24.780235] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-28T20:41:25.453385] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T20:41:25.456312] [INFO ] [REMOTE ] PMM: Full fetch complete (17160 records). [2025-10-28T20:41:25.456386] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-28T20:41:25.585388] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-28T20:41:25.865203] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-28T20:41:25.865308] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-28T20:41:25.865893] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-28T20:41:25.866003] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-28T20:41:25.866887] [DEBUG] [LOCAL ] PMM: Trimmed 17160 records to 9697 (keeping 200 days of data) [2025-10-28T20:41:25.924247] [DEBUG] [LOCAL ] PMM: Primary data saved (9697 records). [2025-10-28T20:41:25.924554] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-28T20:41:25.924633] [INFO ] [MAIN ] Update Progress: 1699/2366 symbols completed. PMM took 31.0s. Estimated remaining: 1h 26m 55s. Rate: 7.7 symbols/min [2025-10-28T20:41:26.094293] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:26.094449] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-28T20:41:26.094485] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-28T20:41:26.094592] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-28T20:41:26.094631] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-28T20:41:26.094712] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-28T20:41:26.094753] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-28T20:41:26.385353] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-28T20:41:26.453460] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:27.063871] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:41:27.110701] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T20:41:27.180234] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-28T20:41:27.477234] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-28T20:41:27.980223] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-28T20:41:28.291092] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T20:41:28.780248] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-28T20:41:29.467233] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T20:41:29.580249] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-28T20:41:30.175021] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T20:41:30.380261] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-28T20:41:30.694370] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T20:41:31.180241] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-28T20:41:31.980320] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-10-28T20:41:32.271458] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:41:32.271794] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-10-28T20:41:32.271883] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:41:32.271933] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-28T20:41:32.271991] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:41:32.272082] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-28T20:41:32.272148] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-28T20:41:32.272189] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-28T20:41:32.272229] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-28T20:41:32.272277] [INFO ] [MAIN ] Update Progress: 1700/2366 symbols completed. PMTV took 6.3s. Estimated remaining: 1h 26m 46s. Rate: 7.7 symbols/min [2025-10-28T20:41:32.446492] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:32.446690] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-28T20:41:32.446743] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-28T20:41:32.446849] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-28T20:41:32.446891] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-28T20:41:32.446932] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-28T20:41:32.446967] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-28T20:41:32.782539] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-28T20:41:32.825782] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:32.857597] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T20:41:33.460508] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T20:41:33.580251] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-28T20:41:33.989954] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T20:41:34.380285] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-28T20:41:35.010020] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T20:41:35.180313] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-28T20:41:35.867767] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:41:35.869905] [INFO ] [REMOTE ] PMO: Full fetch complete (15604 records). [2025-10-28T20:41:35.870000] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-28T20:41:35.985412] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-28T20:41:36.244276] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-28T20:41:36.244367] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-28T20:41:36.244862] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-28T20:41:36.244925] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-28T20:41:36.245418] [DEBUG] [LOCAL ] PMO: Trimmed 15604 records to 8969 (keeping 200 days of data) [2025-10-28T20:41:36.297475] [DEBUG] [LOCAL ] PMO: Primary data saved (8969 records). [2025-10-28T20:41:36.297623] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-28T20:41:36.297748] [INFO ] [MAIN ] Update Progress: 1701/2366 symbols completed. PMO took 20.1s. Estimated remaining: 1h 26m 37s. Rate: 7.7 symbols/min [2025-10-28T20:41:36.464751] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:36.464891] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-28T20:41:36.464935] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-28T20:41:36.465043] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-28T20:41:36.465084] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-28T20:41:36.465132] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-28T20:41:36.465170] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-28T20:41:36.785490] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-28T20:41:36.821808] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:37.370842] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T20:41:37.372291] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T20:41:37.580261] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-28T20:41:38.380266] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-28T20:41:38.639115] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T20:41:39.180280] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-28T20:41:39.842821] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T20:41:39.980261] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-28T20:41:40.666818] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T20:41:40.780269] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-28T20:41:41.460633] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T20:41:41.580278] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-28T20:41:41.881965] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T20:41:41.938422] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T20:41:42.380305] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-28T20:41:42.715928] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T20:41:43.180267] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-28T20:41:43.980279] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-28T20:41:44.286154] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T20:41:44.463333] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:41:44.780282] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-28T20:41:45.580300] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-10-28T20:41:45.795508] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:41:45.796050] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-10-28T20:41:45.796150] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:41:45.796204] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-28T20:41:45.796247] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:41:45.796328] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-28T20:41:45.796411] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-28T20:41:45.796451] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-28T20:41:45.796490] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-28T20:41:45.796544] [INFO ] [MAIN ] Update Progress: 1702/2366 symbols completed. PMTW took 13.5s. Estimated remaining: 1h 26m 30s. Rate: 7.7 symbols/min [2025-10-28T20:41:45.968277] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:45.977266] [DEBUG] [LOCAL ] PNI: Loaded 6656 existing records from primary storage. [2025-10-28T20:41:45.977598] [INFO ] [MAIN ] PNI: Loaded 6656 existing records. [2025-10-28T20:41:46.157919] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:41:46.158363] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-28T20:41:46.158505] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-28T20:41:46.158874] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-28T20:41:46.159048] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-28T20:41:46.284886] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T20:41:46.320760] [INFO ] [REMOTE ] PMT: Full fetch complete (58806 records). [2025-10-28T20:41:46.343983] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-28T20:41:46.385356] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-28T20:41:46.780810] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:46.827771] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T20:41:46.960683] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-28T20:41:46.960776] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-28T20:41:46.961815] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-28T20:41:46.961899] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-28T20:41:46.963125] [DEBUG] [LOCAL ] PMT: Trimmed 58806 records to 40471 (keeping 200 days of data) [2025-10-28T20:41:47.187115] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-28T20:41:47.205838] [DEBUG] [LOCAL ] PMT: Primary data saved (40471 records). [2025-10-28T20:41:47.205940] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-28T20:41:47.206057] [INFO ] [MAIN ] Update Progress: 1703/2366 symbols completed. PMT took 29.7s. Estimated remaining: 1h 26m 20s. Rate: 7.7 symbols/min [2025-10-28T20:41:47.378402] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:47.408147] [DEBUG] [LOCAL ] PNNT: Loaded 32889 existing records from primary storage. [2025-10-28T20:41:47.408419] [INFO ] [MAIN ] PNNT: Loaded 32889 existing records. [2025-10-28T20:41:47.585743] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:41:47.585932] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-28T20:41:47.586025] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-28T20:41:47.586237] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-28T20:41:47.586293] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-28T20:41:47.941986] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:47.980221] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-28T20:41:48.793420] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-28T20:41:48.795396] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T20:41:48.867403] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T20:41:49.580266] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-28T20:41:49.611552] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T20:41:50.380280] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-28T20:41:51.180257] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-28T20:41:51.308786] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T20:41:51.344377] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T20:41:51.532503] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T20:41:51.533269] [INFO ] [REMOTE ] PMTU: Full fetch complete (1162 records). [2025-10-28T20:41:51.533337] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-28T20:41:51.716900] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-28T20:41:51.717117] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:41:51.717206] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:41:51.717299] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-28T20:41:51.717379] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-28T20:41:51.717419] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-28T20:41:51.717458] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-28T20:41:51.717514] [INFO ] [MAIN ] Update Progress: 1704/2366 symbols completed. PMTU took 30.5s. Estimated remaining: 1h 26m 10s. Rate: 7.7 symbols/min [2025-10-28T20:41:51.889869] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:41:51.890028] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-28T20:41:51.890066] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-28T20:41:51.890222] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-28T20:41:51.890279] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-28T20:41:51.890326] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-28T20:41:51.890360] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-28T20:41:51.988547] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-28T20:41:52.259219] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:41:52.606669] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T20:41:52.780260] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-28T20:41:53.580269] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-28T20:41:53.911093] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T20:41:54.380245] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-28T20:41:54.979685] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T20:41:55.180229] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-28T20:41:55.980230] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-28T20:41:56.141334] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T20:41:56.383766] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T20:41:56.383977] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T20:41:56.780253] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-28T20:41:57.580246] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-28T20:41:58.013096] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T20:41:58.179730] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T20:41:58.380301] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-28T20:41:59.180273] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-28T20:41:59.715195] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T20:41:59.980290] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-28T20:42:00.111233] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T20:42:00.710859] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T20:42:00.780294] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-28T20:42:01.443462] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T20:42:01.580267] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-28T20:42:02.380320] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-28T20:42:02.777321] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T20:42:03.180252] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-28T20:42:03.980268] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-28T20:42:04.154005] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:42:04.207563] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-28T20:42:04.780305] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-28T20:42:05.536843] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T20:42:05.574767] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T20:42:05.580216] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-28T20:42:06.218043] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:42:06.380252] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-28T20:42:07.180243] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-28T20:42:07.828907] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T20:42:07.980224] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-28T20:42:08.780265] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-28T20:42:09.481605] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T20:42:09.580266] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-28T20:42:09.828544] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-28T20:42:10.058174] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T20:42:10.380262] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-28T20:42:11.058767] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T20:42:11.180284] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-28T20:42:11.412513] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T20:42:11.980327] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-28T20:42:12.406807] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T20:42:12.524720] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T20:42:12.526347] [INFO ] [REMOTE ] PNI: Full fetch complete (9574 records). [2025-10-28T20:42:12.526428] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-28T20:42:12.785345] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-28T20:42:12.884443] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-28T20:42:12.884520] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-28T20:42:12.884783] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-28T20:42:12.884845] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-28T20:42:12.885296] [DEBUG] [LOCAL ] PNI: Trimmed 9574 records to 6590 (keeping 200 days of data) [2025-10-28T20:42:12.923171] [DEBUG] [LOCAL ] PNI: Primary data saved (6590 records). [2025-10-28T20:42:12.923304] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-28T20:42:12.923384] [INFO ] [MAIN ] Update Progress: 1705/2366 symbols completed. PNI took 27.1s. Estimated remaining: 1h 26m 8s. Rate: 7.7 symbols/min [2025-10-28T20:42:13.093014] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:13.093180] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-28T20:42:13.093217] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-28T20:42:13.093333] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-28T20:42:13.093375] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-28T20:42:13.093417] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-28T20:42:13.093449] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-28T20:42:13.453270] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:13.580245] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-28T20:42:14.308535] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T20:42:14.319136] [INFO ] [REMOTE ] PNC: Full fetch complete (75772 records). [2025-10-28T20:42:14.319264] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-28T20:42:14.385345] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-28T20:42:14.716795] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-10-28T20:42:14.716879] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-10-28T20:42:14.718024] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-10-28T20:42:14.718084] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-10-28T20:42:14.719493] [DEBUG] [LOCAL ] PNC: Trimmed 75772 records to 52019 (keeping 200 days of data) [2025-10-28T20:42:15.078938] [DEBUG] [LOCAL ] PNC: Primary data saved (52019 records). [2025-10-28T20:42:15.079144] [INFO ] [MAIN ] PNC: Full history saved. [2025-10-28T20:42:15.079274] [INFO ] [MAIN ] Update Progress: 1706/2366 symbols completed. PNC took 38.8s. Estimated remaining: 1h 25m 58s. Rate: 7.7 symbols/min [2025-10-28T20:42:15.114464] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T20:42:15.187701] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-28T20:42:15.269544] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:15.269744] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-28T20:42:15.269798] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-28T20:42:15.269911] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-28T20:42:15.269953] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-28T20:42:15.269993] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-28T20:42:15.270024] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-28T20:42:15.743734] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:15.904867] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T20:42:15.980327] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-28T20:42:16.378068] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T20:42:16.780282] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-28T20:42:17.444311] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T20:42:17.580256] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-28T20:42:18.380299] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-28T20:42:18.519872] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T20:42:18.987238] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T20:42:19.180296] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-28T20:42:19.452493] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T20:42:19.980260] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-28T20:42:20.646107] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:42:20.780241] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-28T20:42:21.342380] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T20:42:21.580291] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-28T20:42:22.229051] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T20:42:22.380231] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-28T20:42:22.842090] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T20:42:23.180257] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-28T20:42:23.724467] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T20:42:23.980261] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-28T20:42:24.397002] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:42:24.780311] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-28T20:42:25.342741] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T20:42:25.580249] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-28T20:42:25.930152] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T20:42:26.380253] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-28T20:42:27.180302] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-28T20:42:27.732172] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T20:42:27.980249] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-28T20:42:28.344186] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T20:42:28.351214] [INFO ] [REMOTE ] PNNT: Full fetch complete (47809 records). [2025-10-28T20:42:28.351304] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-28T20:42:28.537892] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-10-28T20:42:28.783510] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-28T20:42:28.818027] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-28T20:42:28.818115] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-28T20:42:28.819125] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-28T20:42:28.819188] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-28T20:42:28.820268] [DEBUG] [LOCAL ] PNNT: Trimmed 47809 records to 32715 (keeping 200 days of data) [2025-10-28T20:42:29.003927] [DEBUG] [LOCAL ] PNNT: Primary data saved (32715 records). [2025-10-28T20:42:29.004056] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-28T20:42:29.004134] [INFO ] [MAIN ] Update Progress: 1707/2366 symbols completed. PNNT took 41.8s. Estimated remaining: 1h 25m 52s. Rate: 7.7 symbols/min [2025-10-28T20:42:29.171925] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:29.172191] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-28T20:42:29.172246] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-28T20:42:29.172351] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-28T20:42:29.172393] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-28T20:42:29.172454] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-28T20:42:29.172487] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-28T20:42:29.526582] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:29.580212] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-28T20:42:29.959877] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-28T20:42:30.163745] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:42:30.380255] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-28T20:42:30.663603] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T20:42:31.180330] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-28T20:42:31.666331] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T20:42:31.980266] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-28T20:42:32.434422] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T20:42:32.780298] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-28T20:42:33.492705] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T20:42:33.502019] [INFO ] [REMOTE ] PNR: Full fetch complete (69687 records). [2025-10-28T20:42:33.502135] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-28T20:42:33.585561] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-28T20:42:33.892145] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-10-28T20:42:33.892222] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-10-28T20:42:33.893280] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-10-28T20:42:33.893342] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-10-28T20:42:33.894639] [DEBUG] [LOCAL ] PNR: Trimmed 69687 records to 47303 (keeping 200 days of data) [2025-10-28T20:42:34.200260] [DEBUG] [LOCAL ] PNR: Primary data saved (47303 records). [2025-10-28T20:42:34.216209] [INFO ] [MAIN ] PNR: Full history saved. [2025-10-28T20:42:34.216513] [INFO ] [MAIN ] Update Progress: 1708/2366 symbols completed. PNR took 42.5s. Estimated remaining: 1h 25m 44s. Rate: 7.7 symbols/min [2025-10-28T20:42:34.229440] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T20:42:34.380776] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-28T20:42:34.399502] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:34.399677] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-28T20:42:34.399883] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-28T20:42:34.400545] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-28T20:42:34.400596] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-28T20:42:34.400662] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-28T20:42:34.400719] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-28T20:42:34.758438] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:34.796276] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T20:42:35.180287] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-28T20:42:35.824402] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T20:42:35.834042] [INFO ] [REMOTE ] POR: Full fetch complete (68265 records). [2025-10-28T20:42:35.834207] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-28T20:42:35.986849] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-28T20:42:36.229738] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-28T20:42:36.229835] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-28T20:42:36.230909] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-28T20:42:36.230972] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-28T20:42:36.232346] [DEBUG] [LOCAL ] POR: Trimmed 68265 records to 46612 (keeping 200 days of data) [2025-10-28T20:42:36.518481] [DEBUG] [LOCAL ] POR: Primary data saved (46612 records). [2025-10-28T20:42:36.518814] [INFO ] [MAIN ] POR: Full history saved. [2025-10-28T20:42:36.518925] [INFO ] [MAIN ] Update Progress: 1709/2366 symbols completed. POR took 21.4s. Estimated remaining: 1h 25m 34s. Rate: 7.7 symbols/min [2025-10-28T20:42:36.695766] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:36.696044] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-28T20:42:36.696114] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-28T20:42:36.696397] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-28T20:42:36.696538] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-28T20:42:36.696634] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-28T20:42:36.696742] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-28T20:42:36.797722] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-28T20:42:37.022737] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-28T20:42:37.110672] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:37.580265] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-28T20:42:37.604373] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T20:42:37.612916] [INFO ] [REMOTE ] PNW: Full fetch complete (65904 records). [2025-10-28T20:42:37.613014] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-28T20:42:38.015548] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-28T20:42:38.015759] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-28T20:42:38.017024] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-28T20:42:38.017105] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-28T20:42:38.040132] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T20:42:38.039124] [DEBUG] [LOCAL ] PNW: Trimmed 65904 records to 45297 (keeping 200 days of data) [2025-10-28T20:42:38.313806] [DEBUG] [LOCAL ] PNW: Primary data saved (45297 records). [2025-10-28T20:42:38.313929] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-28T20:42:38.313998] [INFO ] [MAIN ] Update Progress: 1710/2366 symbols completed. PNW took 25.4s. Estimated remaining: 1h 25m 23s. Rate: 7.7 symbols/min [2025-10-28T20:42:38.385426] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-28T20:42:38.492784] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:38.512075] [DEBUG] [LOCAL ] PPT: Loaded 19331 existing records from primary storage. [2025-10-28T20:42:38.512300] [INFO ] [MAIN ] PPT: Loaded 19331 existing records. [2025-10-28T20:42:38.697624] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:42:38.697839] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-28T20:42:38.697895] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-28T20:42:38.698292] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-28T20:42:38.698350] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-28T20:42:39.079488] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:39.189190] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-28T20:42:39.194551] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T20:42:39.915177] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:42:39.980226] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-28T20:42:40.733372] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T20:42:40.780216] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-28T20:42:41.585331] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-28T20:42:41.593150] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:42:42.380295] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-28T20:42:42.836362] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T20:42:43.180241] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-28T20:42:43.247580] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T20:42:43.980303] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-28T20:42:44.774125] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T20:42:44.781389] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-28T20:42:45.234521] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:42:45.567737] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (7.18 seconds). [2025-10-28T20:42:45.585332] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-28T20:42:45.594288] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T20:42:46.380257] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-28T20:42:47.053131] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T20:42:47.180263] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-28T20:42:47.816292] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T20:42:47.980256] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-28T20:42:48.372043] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T20:42:48.780261] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-28T20:42:49.580243] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-28T20:42:49.599188] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T20:42:50.380286] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-28T20:42:51.051277] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:42:51.180300] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-28T20:42:51.717859] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T20:42:51.980243] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-28T20:42:52.780252] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-28T20:42:53.066781] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T20:42:53.233198] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:42:53.579348] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T20:42:53.584400] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-28T20:42:54.380268] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-28T20:42:55.118324] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T20:42:55.180276] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-28T20:42:55.607140] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T20:42:55.878499] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T20:42:55.980255] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-28T20:42:56.780286] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-28T20:42:57.191136] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T20:42:57.198122] [INFO ] [REMOTE ] POST: Full fetch complete (55541 records). [2025-10-28T20:42:57.198241] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-28T20:42:57.582690] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-28T20:42:57.582479] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-28T20:42:57.582987] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-28T20:42:57.584860] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-28T20:42:57.585002] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-28T20:42:57.586212] [DEBUG] [LOCAL ] POST: Trimmed 55541 records to 38153 (keeping 200 days of data) [2025-10-28T20:42:57.807413] [DEBUG] [LOCAL ] POST: Primary data saved (38153 records). [2025-10-28T20:42:57.807538] [INFO ] [MAIN ] POST: Full history saved. [2025-10-28T20:42:57.807607] [INFO ] [MAIN ] Update Progress: 1711/2366 symbols completed. POST took 28.8s. Estimated remaining: 1h 25m 20s. Rate: 7.7 symbols/min [2025-10-28T20:42:57.975312] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:42:57.975495] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-28T20:42:57.975532] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-28T20:42:57.975664] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-28T20:42:57.975723] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-28T20:42:57.975783] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-28T20:42:57.975819] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-28T20:42:58.371255] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:42:58.374232] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (10.39 seconds). [2025-10-28T20:42:58.384522] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-28T20:42:58.401129] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:42:58.437803] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T20:42:59.180297] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-28T20:42:59.815035] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T20:42:59.893561] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T20:42:59.896784] [INFO ] [REMOTE ] PPT: Full fetch complete (28165 records). [2025-10-28T20:42:59.896873] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-28T20:42:59.985442] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-28T20:43:00.288992] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-28T20:43:00.289065] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-28T20:43:00.289623] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-28T20:43:00.289694] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-28T20:43:00.290363] [DEBUG] [LOCAL ] PPT: Trimmed 28165 records to 19088 (keeping 200 days of data) [2025-10-28T20:43:00.397751] [DEBUG] [LOCAL ] PPT: Primary data saved (19088 records). [2025-10-28T20:43:00.397885] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-28T20:43:00.397963] [INFO ] [MAIN ] Update Progress: 1712/2366 symbols completed. PPT took 22.1s. Estimated remaining: 1h 25m 10s. Rate: 7.7 symbols/min [2025-10-28T20:43:00.582246] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:00.582460] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-28T20:43:00.582502] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-28T20:43:00.582627] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-28T20:43:00.582706] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-28T20:43:00.582758] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-28T20:43:00.582792] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-28T20:43:00.791151] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-28T20:43:00.959379] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:01.472699] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T20:43:01.580277] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-28T20:43:02.380273] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-28T20:43:02.706294] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T20:43:03.144588] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T20:43:03.172792] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T20:43:03.180231] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-28T20:43:03.980254] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-28T20:43:04.780266] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-28T20:43:05.142079] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-28T20:43:05.580281] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-28T20:43:05.904175] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-28T20:43:06.380251] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-28T20:43:06.447698] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T20:43:06.458459] [INFO ] [REMOTE ] PPG: Full fetch complete (73894 records). [2025-10-28T20:43:06.458636] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-28T20:43:06.867441] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-28T20:43:06.867676] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-28T20:43:06.868912] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-28T20:43:06.868997] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-28T20:43:06.870477] [DEBUG] [LOCAL ] PPG: Trimmed 73894 records to 50400 (keeping 200 days of data) [2025-10-28T20:43:07.141303] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T20:43:07.194813] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-28T20:43:07.207809] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T20:43:07.251627] [DEBUG] [LOCAL ] PPG: Primary data saved (50400 records). [2025-10-28T20:43:07.251874] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-28T20:43:07.252002] [INFO ] [MAIN ] Update Progress: 1713/2366 symbols completed. PPG took 33.0s. Estimated remaining: 1h 25m 2s. Rate: 7.7 symbols/min [2025-10-28T20:43:07.428014] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:07.433595] [DEBUG] [LOCAL ] PRCS: Loaded 2724 existing records from primary storage. [2025-10-28T20:43:07.433838] [INFO ] [MAIN ] PRCS: Loaded 2724 existing records. [2025-10-28T20:43:07.618041] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:43:07.618346] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-28T20:43:07.618398] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-28T20:43:07.618693] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-28T20:43:07.618755] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-28T20:43:07.989371] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-28T20:43:08.005085] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:08.677746] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T20:43:08.780291] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-28T20:43:09.567639] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T20:43:09.580203] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-28T20:43:10.380293] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-28T20:43:10.411811] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T20:43:10.773234] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T20:43:10.893132] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T20:43:11.180282] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-28T20:43:11.560052] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T20:43:11.980294] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-28T20:43:12.780298] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-28T20:43:13.381729] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T20:43:13.580223] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-28T20:43:14.017702] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T20:43:14.380258] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-28T20:43:15.050589] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T20:43:15.180243] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-28T20:43:15.400478] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T20:43:15.980251] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-28T20:43:16.780222] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-28T20:43:16.828088] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T20:43:17.441665] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T20:43:17.580213] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-28T20:43:17.805442] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T20:43:18.001428] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T20:43:18.380312] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-28T20:43:19.180260] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-28T20:43:19.646479] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T20:43:19.964999] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T20:43:19.975795] [INFO ] [REMOTE ] PPL: Full fetch complete (77629 records). [2025-10-28T20:43:19.975984] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-28T20:43:19.987564] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-28T20:43:20.368003] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-10-28T20:43:20.368088] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-10-28T20:43:20.369361] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-10-28T20:43:20.369430] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-10-28T20:43:20.370902] [DEBUG] [LOCAL ] PPL: Trimmed 77629 records to 53503 (keeping 200 days of data) [2025-10-28T20:43:20.712879] [DEBUG] [LOCAL ] PPL: Primary data saved (53503 records). [2025-10-28T20:43:20.713015] [INFO ] [MAIN ] PPL: Full history saved. [2025-10-28T20:43:20.713088] [INFO ] [MAIN ] Update Progress: 1714/2366 symbols completed. PPL took 44.2s. Estimated remaining: 1h 24m 56s. Rate: 7.7 symbols/min [2025-10-28T20:43:20.785389] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-28T20:43:20.893445] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:20.893619] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-28T20:43:20.893688] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-28T20:43:20.893835] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-28T20:43:20.893881] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-28T20:43:20.893924] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-28T20:43:20.893956] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-28T20:43:21.257511] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:21.573805] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:43:21.581788] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-28T20:43:22.012980] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T20:43:22.162186] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:43:22.380251] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-28T20:43:23.180242] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-28T20:43:23.386040] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T20:43:23.980252] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-28T20:43:24.585580] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T20:43:24.780282] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-28T20:43:24.902916] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T20:43:25.228887] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T20:43:25.580291] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-28T20:43:26.059954] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T20:43:26.380328] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-28T20:43:27.180262] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-28T20:43:27.518578] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T20:43:27.980256] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-28T20:43:28.152715] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T20:43:28.160721] [INFO ] [REMOTE ] PRA: Full fetch complete (45400 records). [2025-10-28T20:43:28.160883] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-28T20:43:28.536844] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-28T20:43:28.536958] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-28T20:43:28.537863] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-28T20:43:28.537932] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-28T20:43:28.539024] [DEBUG] [LOCAL ] PRA: Trimmed 45400 records to 33736 (keeping 200 days of data) [2025-10-28T20:43:28.739397] [DEBUG] [LOCAL ] PRA: Primary data saved (33736 records). [2025-10-28T20:43:28.739536] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-28T20:43:28.739608] [INFO ] [MAIN ] Update Progress: 1715/2366 symbols completed. PRA took 28.3s. Estimated remaining: 1h 24m 49s. Rate: 7.7 symbols/min [2025-10-28T20:43:28.785402] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-28T20:43:28.936159] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:28.936537] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-28T20:43:28.936594] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-28T20:43:28.936789] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-28T20:43:28.936837] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-28T20:43:28.936883] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-28T20:43:28.936920] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-28T20:43:29.294347] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T20:43:29.331536] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T20:43:29.421106] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:29.580293] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-28T20:43:30.380312] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-28T20:43:31.000814] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T20:43:31.180248] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-28T20:43:31.951022] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T20:43:31.980223] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-28T20:43:32.419125] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T20:43:32.780268] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-28T20:43:33.180381] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T20:43:33.580263] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-28T20:43:33.955358] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T20:43:33.966213] [INFO ] [REMOTE ] PR: Full fetch complete (77761 records). [2025-10-28T20:43:33.966375] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-28T20:43:34.076032] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T20:43:34.088050] [INFO ] [REMOTE ] PRCS: Full fetch complete (3911 records). [2025-10-28T20:43:34.093268] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-28T20:43:34.407682] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-28T20:43:34.682372] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-28T20:43:34.682787] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-28T20:43:34.684036] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-28T20:43:34.684116] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-28T20:43:34.765691] [DEBUG] [LOCAL ] PR: Trimmed 77761 records to 53609 (keeping 200 days of data) [2025-10-28T20:43:34.766065] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-28T20:43:34.766448] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-28T20:43:34.766598] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-28T20:43:34.766704] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-28T20:43:34.767413] [DEBUG] [LOCAL ] PRCS: Trimmed 3911 records to 2689 (keeping 200 days of data) [2025-10-28T20:43:34.877424] [DEBUG] [LOCAL ] PRCS: Primary data saved (2689 records). [2025-10-28T20:43:34.878824] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-28T20:43:34.889469] [INFO ] [MAIN ] Update Progress: 1716/2366 symbols completed. PRCS took 27.6s. Estimated remaining: 1h 24m 40s. Rate: 7.7 symbols/min [2025-10-28T20:43:35.191479] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:35.181388] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-28T20:43:35.271700] [DEBUG] [LOCAL ] PRH: Loaded 4565 existing records from primary storage. [2025-10-28T20:43:35.274547] [INFO ] [MAIN ] PRH: Loaded 4565 existing records. [2025-10-28T20:43:35.364686] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-10-28T20:43:35.375556] [INFO ] [MAIN ] PR: Full history saved. [2025-10-28T20:43:35.394492] [INFO ] [MAIN ] Update Progress: 1717/2366 symbols completed. PR took 37.6s. Estimated remaining: 1h 24m 30s. Rate: 7.7 symbols/min [2025-10-28T20:43:35.472883] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:43:35.473060] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-28T20:43:35.473107] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-28T20:43:35.473360] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-28T20:43:35.473417] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-28T20:43:35.848493] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:35.866998] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T20:43:35.980250] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-28T20:43:36.647995] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T20:43:36.780256] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-28T20:43:37.402009] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T20:43:37.580261] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-28T20:43:38.069486] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T20:43:38.152010] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T20:43:38.380326] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-28T20:43:38.889083] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:43:39.180320] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-28T20:43:39.802400] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:43:39.980304] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-28T20:43:40.780272] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-28T20:43:41.357614] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T20:43:41.387408] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T20:43:41.580248] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-28T20:43:42.380256] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-28T20:43:42.814592] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T20:43:43.180265] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-28T20:43:43.510944] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T20:43:43.616032] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:43:43.980238] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-28T20:43:44.780251] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-28T20:43:44.972155] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T20:43:45.580266] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-28T20:43:46.052832] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:43:46.066423] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T20:43:46.380269] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-28T20:43:47.180302] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-28T20:43:47.413044] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T20:43:47.682906] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T20:43:47.980270] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-28T20:43:48.361688] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T20:43:48.780300] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-28T20:43:49.580341] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-28T20:43:49.998476] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T20:43:49.999849] [INFO ] [REMOTE ] PRH: Full fetch complete (7267 records). [2025-10-28T20:43:49.999916] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-28T20:43:50.383289] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-28T20:43:50.401922] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T20:43:50.408705] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-28T20:43:50.419142] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-28T20:43:50.419762] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-28T20:43:50.420036] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-28T20:43:50.420927] [DEBUG] [LOCAL ] PRH: Trimmed 7267 records to 4516 (keeping 200 days of data) [2025-10-28T20:43:50.447916] [DEBUG] [LOCAL ] PRH: Primary data saved (4516 records). [2025-10-28T20:43:50.448005] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-28T20:43:50.448078] [INFO ] [MAIN ] Update Progress: 1718/2366 symbols completed. PRH took 15.6s. Estimated remaining: 1h 24m 25s. Rate: 7.7 symbols/min [2025-10-28T20:43:51.180284] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-28T20:43:51.317816] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T20:43:51.980362] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-28T20:43:52.565750] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T20:43:52.780315] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-28T20:43:52.988440] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T20:43:53.580302] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-28T20:43:54.022471] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T20:43:54.032482] [INFO ] [REMOTE ] PRGO: Full fetch complete (68951 records). [2025-10-28T20:43:54.032603] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-28T20:43:54.428900] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-28T20:43:54.428990] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-28T20:43:54.430218] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-28T20:43:54.430286] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-28T20:43:54.431847] [DEBUG] [LOCAL ] PRGO: Trimmed 68951 records to 47033 (keeping 200 days of data) [2025-10-28T20:43:54.729107] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T20:43:54.785494] [INFO ] [REMOTE ] PRG: Full fetch complete (44668 records). [2025-10-28T20:43:54.794464] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-28T20:43:54.814701] [DEBUG] [LOCAL ] PRGO: Primary data saved (47033 records). [2025-10-28T20:43:54.844223] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-28T20:43:54.880869] [INFO ] [MAIN ] Update Progress: 1719/2366 symbols completed. PRGO took 26.1s. Estimated remaining: 1h 24m 16s. Rate: 7.7 symbols/min [2025-10-28T20:43:55.386145] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-28T20:43:55.386242] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-28T20:43:55.387323] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-28T20:43:55.387392] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-28T20:43:55.388534] [DEBUG] [LOCAL ] PRG: Trimmed 44668 records to 29520 (keeping 200 days of data) [2025-10-28T20:43:55.598472] [DEBUG] [LOCAL ] PRG: Primary data saved (29520 records). [2025-10-28T20:43:55.598613] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-28T20:43:55.598724] [INFO ] [MAIN ] Update Progress: 1720/2366 symbols completed. PRG took 34.9s. Estimated remaining: 1h 24m 5s. Rate: 7.7 symbols/min [2025-10-28T20:43:56.268677] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:56.314894] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-28T20:43:56.314708] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:56.313231] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:56.336219] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-28T20:43:56.336318] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-28T20:43:56.340182] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-28T20:43:56.340081] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-28T20:43:56.339440] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:43:56.340293] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-28T20:43:56.341048] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-28T20:43:56.341293] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-28T20:43:56.341224] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-28T20:43:56.346792] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-28T20:43:56.357700] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-28T20:43:56.357948] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-28T20:43:56.766966] [DEBUG] [LOCAL ] PRKS: Loaded 42027 existing records from primary storage. [2025-10-28T20:43:56.888966] [INFO ] [MAIN ] PRKS: Loaded 42027 existing records. [2025-10-28T20:43:56.992220] [DEBUG] [LOCAL ] PRIM: Loaded 43973 existing records from primary storage. [2025-10-28T20:43:57.029443] [INFO ] [MAIN ] PRIM: Loaded 43973 existing records. [2025-10-28T20:43:57.310297] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:57.318320] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:57.334114] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-28T20:43:57.334407] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-28T20:43:57.496079] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:43:57.514240] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-28T20:43:57.514767] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-28T20:43:57.517910] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:43:57.518095] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-28T20:43:57.518141] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-28T20:43:57.518583] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-28T20:43:57.518670] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-28T20:43:57.549489] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-28T20:43:57.580934] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-28T20:43:58.203917] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:58.236866] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-28T20:43:58.266323] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:43:58.277632] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-28T20:43:58.277267] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T20:43:58.281839] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-28T20:43:58.296706] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T20:43:58.380216] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-28T20:43:59.128802] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:43:59.180278] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-28T20:43:59.290209] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T20:43:59.445399] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:43:59.566608] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T20:43:59.929763] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T20:43:59.980260] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-28T20:44:00.780264] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-28T20:44:01.580249] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-28T20:44:01.676242] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T20:44:02.203029] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:44:02.380271] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-28T20:44:02.450254] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T20:44:03.180241] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-28T20:44:03.290479] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T20:44:03.980257] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-28T20:44:04.400686] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T20:44:04.780236] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-28T20:44:04.884906] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T20:44:05.580269] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-28T20:44:06.146741] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:44:06.380241] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-28T20:44:07.180353] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-28T20:44:07.541959] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T20:44:07.980231] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-28T20:44:08.395076] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T20:44:08.780267] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-28T20:44:09.120629] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T20:44:09.535893] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T20:44:09.580233] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-28T20:44:10.177446] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (4.60 seconds). [2025-10-28T20:44:10.380251] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-28T20:44:10.695852] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T20:44:11.180225] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-28T20:44:11.246105] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T20:44:11.938144] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:44:11.980203] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-28T20:44:12.780222] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-28T20:44:12.879289] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T20:44:13.580258] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-28T20:44:14.049115] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T20:44:14.353871] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T20:44:14.380211] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-28T20:44:15.125890] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T20:44:15.180252] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-28T20:44:15.980332] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-28T20:44:16.620863] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:44:16.740197] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:44:16.743963] [INFO ] [REMOTE ] PRI: Full fetch complete (25571 records). [2025-10-28T20:44:16.744046] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-28T20:44:16.785387] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-28T20:44:17.132771] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-28T20:44:17.132856] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-28T20:44:17.133501] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-28T20:44:17.133582] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-28T20:44:17.134721] [DEBUG] [LOCAL ] PRI: Trimmed 25571 records to 17299 (keeping 200 days of data) [2025-10-28T20:44:17.244567] [DEBUG] [LOCAL ] PRI: Primary data saved (17299 records). [2025-10-28T20:44:17.244718] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-28T20:44:17.244809] [INFO ] [MAIN ] Update Progress: 1721/2366 symbols completed. PRI took 21.6s. Estimated remaining: 1h 24m 2s. Rate: 7.7 symbols/min [2025-10-28T20:44:17.413446] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:44:17.453682] [DEBUG] [LOCAL ] PRM: Loaded 44124 existing records from primary storage. [2025-10-28T20:44:17.453961] [INFO ] [MAIN ] PRM: Loaded 44124 existing records. [2025-10-28T20:44:17.593951] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-28T20:44:17.637535] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:44:17.637932] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-28T20:44:17.638096] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-28T20:44:17.638688] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-28T20:44:17.638747] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-28T20:44:17.786067] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T20:44:18.024118] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:44:18.380278] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-28T20:44:18.932023] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T20:44:19.180253] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-28T20:44:19.541263] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T20:44:19.980307] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-28T20:44:20.620513] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:44:20.780255] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-28T20:44:21.420272] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T20:44:21.580243] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-28T20:44:22.380227] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-28T20:44:22.400537] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T20:44:22.471465] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-28T20:44:23.180234] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-28T20:44:23.942480] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T20:44:23.980249] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-28T20:44:24.530429] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T20:44:24.538705] [INFO ] [REMOTE ] PRKS: Full fetch complete (61429 records). [2025-10-28T20:44:24.538828] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-28T20:44:24.792109] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-28T20:44:24.929578] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-28T20:44:24.929760] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-28T20:44:24.930867] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-28T20:44:24.930931] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-28T20:44:24.932161] [DEBUG] [LOCAL ] PRKS: Trimmed 61429 records to 41902 (keeping 200 days of data) [2025-10-28T20:44:25.216823] [DEBUG] [LOCAL ] PRKS: Primary data saved (41902 records). [2025-10-28T20:44:25.217111] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-28T20:44:25.217212] [INFO ] [MAIN ] Update Progress: 1722/2366 symbols completed. PRKS took 29.6s. Estimated remaining: 1h 23m 55s. Rate: 7.7 symbols/min [2025-10-28T20:44:25.422243] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T20:44:25.424721] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:44:25.484383] [DEBUG] [LOCAL ] PRMB: Loaded 53066 existing records from primary storage. [2025-10-28T20:44:25.484749] [INFO ] [MAIN ] PRMB: Loaded 53066 existing records. [2025-10-28T20:44:25.583000] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-28T20:44:25.671171] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:44:25.676407] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-28T20:44:25.676815] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T20:44:25.680572] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-28T20:44:25.681618] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-28T20:44:25.681706] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-28T20:44:26.036552] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:44:26.380262] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-28T20:44:26.887734] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T20:44:27.180231] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-28T20:44:27.980235] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-28T20:44:28.459348] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T20:44:28.780311] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-28T20:44:29.137898] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T20:44:29.580317] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-28T20:44:29.901609] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (3.52 seconds). [2025-10-28T20:44:29.905572] [INFO ] [REMOTE ] PRLB: Full fetch complete (30411 records). [2025-10-28T20:44:29.905669] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-28T20:44:30.299974] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-28T20:44:30.300113] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-28T20:44:30.300861] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-28T20:44:30.300954] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-28T20:44:30.310582] [DEBUG] [LOCAL ] PRLB: Trimmed 30411 records to 19896 (keeping 200 days of data) [2025-10-28T20:44:30.328048] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:44:30.382219] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-28T20:44:30.452246] [DEBUG] [LOCAL ] PRLB: Primary data saved (19896 records). [2025-10-28T20:44:30.452375] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-28T20:44:30.452447] [INFO ] [MAIN ] Update Progress: 1723/2366 symbols completed. PRLB took 34.8s. Estimated remaining: 1h 23m 46s. Rate: 7.7 symbols/min [2025-10-28T20:44:30.623298] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:44:30.661636] [DEBUG] [LOCAL ] PRO: Loaded 39989 existing records from primary storage. [2025-10-28T20:44:30.661964] [INFO ] [MAIN ] PRO: Loaded 39989 existing records. [2025-10-28T20:44:30.844140] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:44:30.844485] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-28T20:44:30.844544] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-28T20:44:30.845216] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-28T20:44:30.845384] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-28T20:44:31.044973] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T20:44:31.185432] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-28T20:44:31.236162] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:44:31.739872] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T20:44:31.752274] [INFO ] [REMOTE ] PRIM: Full fetch complete (63964 records). [2025-10-28T20:44:31.752565] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-28T20:44:31.985746] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-28T20:44:32.173215] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-28T20:44:32.173292] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-28T20:44:32.174564] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-28T20:44:32.174625] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-28T20:44:32.175874] [DEBUG] [LOCAL ] PRIM: Trimmed 63964 records to 43903 (keeping 200 days of data) [2025-10-28T20:44:32.470582] [DEBUG] [LOCAL ] PRIM: Primary data saved (43903 records). [2025-10-28T20:44:32.483848] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-28T20:44:32.483990] [INFO ] [MAIN ] Update Progress: 1724/2366 symbols completed. PRIM took 36.9s. Estimated remaining: 1h 23m 36s. Rate: 7.7 symbols/min [2025-10-28T20:44:32.556483] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T20:44:32.663397] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:44:32.663557] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-28T20:44:32.663593] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-28T20:44:32.663725] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-28T20:44:32.663771] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-28T20:44:32.663812] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-28T20:44:32.663843] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-28T20:44:32.785543] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-28T20:44:33.023001] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:44:33.561445] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T20:44:33.580208] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-28T20:44:33.971852] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T20:44:34.380289] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-28T20:44:35.011101] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:44:35.180233] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-28T20:44:35.288370] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T20:44:35.980280] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-28T20:44:36.682604] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T20:44:36.780295] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-10-28T20:44:37.013966] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T20:44:37.580266] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-28T20:44:37.893220] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T20:44:38.380300] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-28T20:44:39.106683] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T20:44:39.180287] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-10-28T20:44:39.469982] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T20:44:39.980259] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-28T20:44:40.034010] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:44:40.780269] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-10-28T20:44:41.360942] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:44:41.580242] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-28T20:44:41.763229] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T20:44:42.380334] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-28T20:44:42.586331] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T20:44:43.180264] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-28T20:44:43.491344] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T20:44:43.980250] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-28T20:44:44.532953] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T20:44:44.780261] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-10-28T20:44:45.353267] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T20:44:45.580229] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-28T20:44:45.657714] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T20:44:46.380269] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-10-28T20:44:46.820517] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T20:44:47.180319] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-28T20:44:47.379233] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T20:44:47.980256] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-28T20:44:48.467402] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T20:44:48.780258] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-28T20:44:49.120404] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T20:44:49.580349] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-28T20:44:50.380229] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-28T20:44:50.505202] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T20:44:50.517139] [INFO ] [REMOTE ] PRMB: Full fetch complete (76326 records). [2025-10-28T20:44:50.517344] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-28T20:44:50.922009] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-28T20:44:50.922099] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-28T20:44:50.923255] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-28T20:44:50.923318] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-28T20:44:50.924995] [DEBUG] [LOCAL ] PRMB: Trimmed 76326 records to 53062 (keeping 200 days of data) [2025-10-28T20:44:51.041984] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T20:44:51.184753] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-28T20:44:51.282714] [DEBUG] [LOCAL ] PRMB: Primary data saved (53062 records). [2025-10-28T20:44:51.282842] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-28T20:44:51.283237] [INFO ] [MAIN ] Update Progress: 1725/2366 symbols completed. PRMB took 26.1s. Estimated remaining: 1h 23m 32s. Rate: 7.7 symbols/min [2025-10-28T20:44:51.457505] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:44:51.465535] [DEBUG] [LOCAL ] PRT: Loaded 4957 existing records from primary storage. [2025-10-28T20:44:51.465774] [INFO ] [MAIN ] PRT: Loaded 4957 existing records. [2025-10-28T20:44:51.654679] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:44:51.655024] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-28T20:44:51.655103] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-28T20:44:51.655498] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-28T20:44:51.655577] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-28T20:44:51.848148] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T20:44:51.989784] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-10-28T20:44:52.113265] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:44:52.409182] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:44:52.780283] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-28T20:44:52.958993] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:44:53.411773] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T20:44:53.580298] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-28T20:44:54.380292] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-28T20:44:54.860267] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:44:54.953174] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T20:44:55.180259] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-28T20:44:55.980251] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-28T20:44:56.373984] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T20:44:56.383489] [INFO ] [REMOTE ] PRM: Full fetch complete (64722 records). [2025-10-28T20:44:56.383692] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-28T20:44:56.698912] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T20:44:56.781228] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-28T20:44:56.799017] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-28T20:44:56.799139] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-28T20:44:56.800554] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-28T20:44:56.800634] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-28T20:44:56.802572] [DEBUG] [LOCAL ] PRM: Trimmed 64722 records to 44041 (keeping 200 days of data) [2025-10-28T20:44:57.076239] [DEBUG] [LOCAL ] PRM: Primary data saved (44041 records). [2025-10-28T20:44:57.076448] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-28T20:44:57.076589] [INFO ] [MAIN ] Update Progress: 1726/2366 symbols completed. PRM took 39.8s. Estimated remaining: 1h 23m 24s. Rate: 7.7 symbols/min [2025-10-28T20:44:57.265519] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:44:57.265817] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-28T20:44:57.265865] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-28T20:44:57.266035] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-28T20:44:57.266089] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-28T20:44:57.266135] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-28T20:44:57.266201] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-28T20:44:57.400543] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:44:57.586327] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-28T20:44:57.672669] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:44:58.148198] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:44:58.380299] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-28T20:44:58.847616] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T20:44:59.180292] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-10-28T20:44:59.980224] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-28T20:45:00.009133] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T20:45:00.380688] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T20:45:00.780278] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-28T20:45:01.465595] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T20:45:01.580265] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-28T20:45:02.380241] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-28T20:45:02.913886] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T20:45:03.088166] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T20:45:03.180292] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-28T20:45:03.980295] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-28T20:45:04.521218] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T20:45:04.522738] [INFO ] [REMOTE ] PRT: Full fetch complete (8343 records). [2025-10-28T20:45:04.522821] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-28T20:45:04.780899] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-28T20:45:04.902071] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-28T20:45:04.902176] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-28T20:45:04.902467] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-28T20:45:04.902539] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-28T20:45:04.903278] [DEBUG] [LOCAL ] PRT: Trimmed 8343 records to 4940 (keeping 200 days of data) [2025-10-28T20:45:04.968671] [DEBUG] [LOCAL ] PRT: Primary data saved (4940 records). [2025-10-28T20:45:04.969527] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-28T20:45:04.972459] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T20:45:04.972931] [INFO ] [MAIN ] Update Progress: 1727/2366 symbols completed. PRT took 13.7s. Estimated remaining: 1h 23m 16s. Rate: 7.7 symbols/min [2025-10-28T20:45:05.153349] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:05.153553] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-28T20:45:05.153590] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-28T20:45:05.153729] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-28T20:45:05.153775] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-28T20:45:05.153817] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-28T20:45:05.153868] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-28T20:45:05.518721] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:05.580265] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-28T20:45:06.006767] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T20:45:06.030600] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T20:45:06.039831] [INFO ] [REMOTE ] PRO: Full fetch complete (54191 records). [2025-10-28T20:45:06.039950] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-28T20:45:06.388391] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-28T20:45:06.424437] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-28T20:45:06.424518] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-28T20:45:06.425502] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-28T20:45:06.425567] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-28T20:45:06.426836] [DEBUG] [LOCAL ] PRO: Trimmed 54191 records to 39970 (keeping 200 days of data) [2025-10-28T20:45:06.650157] [DEBUG] [LOCAL ] PRO: Primary data saved (39970 records). [2025-10-28T20:45:06.650285] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-28T20:45:06.650358] [INFO ] [MAIN ] Update Progress: 1728/2366 symbols completed. PRO took 36.2s. Estimated remaining: 1h 23m 6s. Rate: 7.7 symbols/min [2025-10-28T20:45:06.791675] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T20:45:06.822323] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:06.822497] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-28T20:45:06.822533] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-28T20:45:06.822638] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-28T20:45:06.822716] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-28T20:45:06.822762] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-28T20:45:06.822794] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-28T20:45:07.167953] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:07.180210] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-28T20:45:07.980248] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-28T20:45:08.279910] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T20:45:08.780304] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-28T20:45:09.092130] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T20:45:09.469936] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T20:45:09.580242] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-28T20:45:10.380306] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-10-28T20:45:11.180263] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-28T20:45:11.236067] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T20:45:11.262106] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T20:45:11.481579] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T20:45:11.980272] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-10-28T20:45:12.780252] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-28T20:45:12.807630] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T20:45:13.580312] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-28T20:45:14.041211] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T20:45:14.380301] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-28T20:45:14.415713] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T20:45:15.180240] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-28T20:45:15.630218] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:45:15.980281] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-28T20:45:16.392082] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T20:45:16.609786] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T20:45:16.780254] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-28T20:45:17.580232] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-10. [2025-10-28T20:45:18.257971] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T20:45:18.380227] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-28T20:45:18.420511] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T20:45:18.424587] [INFO ] [REMOTE ] PRSU: Full fetch complete (33990 records). [2025-10-28T20:45:18.424687] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-10-28T20:45:18.801464] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-10-28T20:45:18.801567] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-10-28T20:45:18.802282] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-10-28T20:45:18.802343] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-10-28T20:45:18.803151] [DEBUG] [LOCAL ] PRSU: Trimmed 33990 records to 22587 (keeping 200 days of data) [2025-10-28T20:45:18.931490] [DEBUG] [LOCAL ] PRSU: Primary data saved (22587 records). [2025-10-28T20:45:18.931615] [INFO ] [MAIN ] PRSU: Full history saved. [2025-10-28T20:45:18.931714] [INFO ] [MAIN ] Update Progress: 1729/2366 symbols completed. PRSU took 46.4s. Estimated remaining: 1h 22m 60s. Rate: 7.7 symbols/min [2025-10-28T20:45:19.097491] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:19.107950] [DEBUG] [LOCAL ] PSBD: Loaded 8254 existing records from primary storage. [2025-10-28T20:45:19.108161] [INFO ] [MAIN ] PSBD: Loaded 8254 existing records. [2025-10-28T20:45:19.185427] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-28T20:45:19.282564] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:45:19.282823] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-28T20:45:19.282870] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-28T20:45:19.283119] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-28T20:45:19.283176] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-28T20:45:19.628611] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:19.980237] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-28T20:45:20.092187] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T20:45:20.365931] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T20:45:20.614497] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T20:45:20.780263] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-28T20:45:21.580311] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-28T20:45:21.915623] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T20:45:22.177639] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T20:45:22.380247] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-28T20:45:23.180244] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-28T20:45:23.980235] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-28T20:45:24.026664] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T20:45:24.037081] [INFO ] [REMOTE ] PRU: Full fetch complete (74557 records). [2025-10-28T20:45:24.037240] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-28T20:45:24.393168] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T20:45:24.440371] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-28T20:45:24.440459] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-28T20:45:24.441554] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-28T20:45:24.441613] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-28T20:45:24.442968] [DEBUG] [LOCAL ] PRU: Trimmed 74557 records to 51037 (keeping 200 days of data) [2025-10-28T20:45:24.753823] [DEBUG] [LOCAL ] PRU: Primary data saved (51037 records). [2025-10-28T20:45:24.754005] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-28T20:45:24.754117] [INFO ] [MAIN ] Update Progress: 1730/2366 symbols completed. PRU took 27.7s. Estimated remaining: 1h 22m 51s. Rate: 7.7 symbols/min [2025-10-28T20:45:24.785379] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-28T20:45:24.931073] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:24.958546] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-28T20:45:24.971638] [DEBUG] [LOCAL ] PSF: Loaded 6791 existing records from primary storage. [2025-10-28T20:45:24.971845] [INFO ] [MAIN ] PSF: Loaded 6791 existing records. [2025-10-28T20:45:25.145880] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:45:25.146176] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-28T20:45:25.146223] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-28T20:45:25.146737] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-28T20:45:25.146798] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-28T20:45:25.300675] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T20:45:25.336131] [INFO ] [REMOTE ] PRVS: Full fetch complete (1220 records). [2025-10-28T20:45:25.388373] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-28T20:45:25.602414] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-28T20:45:25.666630] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:25.709161] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-28T20:45:25.709320] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:45:25.709400] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:45:25.709487] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-28T20:45:25.709579] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-28T20:45:25.709628] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-28T20:45:25.709712] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-28T20:45:25.709780] [INFO ] [MAIN ] Update Progress: 1731/2366 symbols completed. PRVS took 20.7s. Estimated remaining: 1h 22m 41s. Rate: 7.7 symbols/min [2025-10-28T20:45:25.877324] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:25.907894] [DEBUG] [LOCAL ] PSFE: Loaded 29157 existing records from primary storage. [2025-10-28T20:45:25.908138] [INFO ] [MAIN ] PSFE: Loaded 29157 existing records. [2025-10-28T20:45:26.089234] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:45:26.089417] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-28T20:45:26.089495] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-28T20:45:26.089950] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-28T20:45:26.090009] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-28T20:45:26.385378] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-28T20:45:26.445207] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:26.949904] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T20:45:27.180236] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-28T20:45:27.233060] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T20:45:27.980251] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-28T20:45:28.200196] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T20:45:28.445461] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T20:45:28.780258] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-28T20:45:29.580246] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-28T20:45:30.029043] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T20:45:30.157624] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T20:45:30.380273] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-28T20:45:31.180306] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-28T20:45:31.508353] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T20:45:31.734470] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T20:45:31.980275] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-28T20:45:32.780252] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-28T20:45:33.194630] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T20:45:33.198197] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T20:45:33.580286] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-28T20:45:34.090557] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:45:34.380251] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-28T20:45:35.180334] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-28T20:45:35.746098] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:45:35.802663] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:45:35.980268] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-28T20:45:36.780264] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-28T20:45:37.235448] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:45:37.580217] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-28T20:45:37.741364] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T20:45:38.169595] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T20:45:38.380256] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-28T20:45:39.180275] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-28T20:45:39.462977] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T20:45:39.699237] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T20:45:39.980266] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-28T20:45:40.486383] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T20:45:40.780319] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-28T20:45:41.299332] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T20:45:41.580224] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-28T20:45:42.380297] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-28T20:45:42.793629] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T20:45:42.854744] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T20:45:43.180260] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-28T20:45:43.806323] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:45:43.980329] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-28T20:45:44.619741] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:45:44.780241] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-28T20:45:45.580271] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-28T20:45:46.233257] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T20:45:46.283545] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T20:45:46.380271] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-28T20:45:47.180243] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-28T20:45:47.793183] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T20:45:47.926626] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T20:45:47.934699] [INFO ] [REMOTE ] PSA: Full fetch complete (59690 records). [2025-10-28T20:45:47.934816] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-28T20:45:47.986453] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-28T20:45:48.311075] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-28T20:45:48.311164] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-28T20:45:48.312165] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-28T20:45:48.312227] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-28T20:45:48.313384] [DEBUG] [LOCAL ] PSA: Trimmed 59690 records to 41764 (keeping 200 days of data) [2025-10-28T20:45:48.565145] [DEBUG] [LOCAL ] PSA: Primary data saved (41764 records). [2025-10-28T20:45:48.565265] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-28T20:45:48.565333] [INFO ] [MAIN ] Update Progress: 1732/2366 symbols completed. PSA took 41.9s. Estimated remaining: 1h 22m 38s. Rate: 7.7 symbols/min [2025-10-28T20:45:48.728556] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:48.728755] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-28T20:45:48.728799] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-28T20:45:48.728905] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-28T20:45:48.728947] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-28T20:45:48.728989] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-28T20:45:48.729026] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-28T20:45:48.789785] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-28T20:45:49.082776] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:49.101437] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T20:45:49.386098] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T20:45:49.580268] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-28T20:45:50.088051] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T20:45:50.091099] [INFO ] [REMOTE ] PSF: Full fetch complete (9602 records). [2025-10-28T20:45:50.091286] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-28T20:45:50.381839] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-28T20:45:50.668732] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-28T20:45:50.668842] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-28T20:45:50.669198] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-28T20:45:50.669245] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-28T20:45:50.670016] [DEBUG] [LOCAL ] PSF: Trimmed 9602 records to 6736 (keeping 200 days of data) [2025-10-28T20:45:50.717837] [DEBUG] [LOCAL ] PSF: Primary data saved (6736 records). [2025-10-28T20:45:50.718002] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-28T20:45:50.718111] [INFO ] [MAIN ] Update Progress: 1733/2366 symbols completed. PSF took 26.0s. Estimated remaining: 1h 22m 28s. Rate: 7.7 symbols/min [2025-10-28T20:45:50.923304] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:50.968314] [DEBUG] [LOCAL ] PSO: Loaded 36199 existing records from primary storage. [2025-10-28T20:45:50.968670] [INFO ] [MAIN ] PSO: Loaded 36199 existing records. [2025-10-28T20:45:51.169513] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:45:51.169832] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-28T20:45:51.169889] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-28T20:45:51.170416] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-28T20:45:51.170473] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-28T20:45:51.190403] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-28T20:45:51.286831] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T20:45:51.318215] [INFO ] [REMOTE ] PSBD: Full fetch complete (11039 records). [2025-10-28T20:45:51.336817] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-28T20:45:51.793405] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:51.938035] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-28T20:45:51.938109] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-28T20:45:51.938343] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-28T20:45:51.938449] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-28T20:45:51.938951] [DEBUG] [LOCAL ] PSBD: Trimmed 11039 records to 8259 (keeping 200 days of data) [2025-10-28T20:45:51.985482] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-28T20:45:51.987490] [DEBUG] [LOCAL ] PSBD: Primary data saved (8259 records). [2025-10-28T20:45:51.988487] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-28T20:45:51.988583] [INFO ] [MAIN ] Update Progress: 1734/2366 symbols completed. PSBD took 33.1s. Estimated remaining: 1h 22m 18s. Rate: 7.7 symbols/min [2025-10-28T20:45:52.158806] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:45:52.193325] [DEBUG] [LOCAL ] PSQH: Loaded 35315 existing records from primary storage. [2025-10-28T20:45:52.193707] [INFO ] [MAIN ] PSQH: Loaded 35315 existing records. [2025-10-28T20:45:52.390071] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:45:52.391296] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T20:45:52.391548] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-28T20:45:52.398444] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-28T20:45:52.399255] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-28T20:45:52.399314] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-28T20:45:52.744258] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:45:52.780239] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-28T20:45:53.193707] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:45:53.580309] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-28T20:45:54.267320] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T20:45:54.380257] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-28T20:45:55.031257] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:45:55.180277] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-28T20:45:55.513473] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T20:45:55.980272] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-28T20:45:56.301199] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T20:45:56.780258] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-28T20:45:57.014817] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T20:45:57.580311] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-28T20:45:57.996418] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T20:45:58.380253] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-28T20:45:58.807842] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T20:45:59.180278] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-28T20:45:59.198994] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:45:59.980251] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-28T20:46:00.570090] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T20:46:00.780336] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-28T20:46:01.137179] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T20:46:01.580291] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-28T20:46:01.795392] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T20:46:01.800779] [INFO ] [REMOTE ] PSFE: Full fetch complete (42929 records). [2025-10-28T20:46:01.800865] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-28T20:46:02.177350] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-28T20:46:02.177456] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-28T20:46:02.178460] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-28T20:46:02.178522] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-28T20:46:02.179451] [DEBUG] [LOCAL ] PSFE: Trimmed 42929 records to 29016 (keeping 200 days of data) [2025-10-28T20:46:02.346698] [DEBUG] [LOCAL ] PSFE: Primary data saved (29016 records). [2025-10-28T20:46:02.346832] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-28T20:46:02.346912] [INFO ] [MAIN ] Update Progress: 1735/2366 symbols completed. PSFE took 36.6s. Estimated remaining: 1h 22m 11s. Rate: 7.7 symbols/min [2025-10-28T20:46:02.388882] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-28T20:46:02.516132] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:02.516299] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-28T20:46:02.516336] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-28T20:46:02.516448] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-28T20:46:02.516519] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-28T20:46:02.516592] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-28T20:46:02.516637] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-28T20:46:02.874220] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:02.909444] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T20:46:03.180260] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-28T20:46:03.627107] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T20:46:03.980257] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-28T20:46:04.780255] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-28T20:46:04.782219] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T20:46:05.242899] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T20:46:05.580254] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-28T20:46:06.386236] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-28T20:46:06.403691] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T20:46:06.777048] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:46:07.180269] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-28T20:46:07.735801] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T20:46:07.980309] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-28T20:46:08.499639] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T20:46:08.780262] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-28T20:46:09.398723] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T20:46:09.580243] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-28T20:46:10.111139] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T20:46:10.380287] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-28T20:46:11.180280] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-28T20:46:11.219742] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T20:46:11.602400] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T20:46:11.980295] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-28T20:46:12.258481] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T20:46:12.780271] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-28T20:46:13.027003] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T20:46:13.580245] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-28T20:46:14.308507] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T20:46:14.380221] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-28T20:46:15.180227] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-28T20:46:15.213834] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T20:46:15.704932] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T20:46:15.712201] [INFO ] [REMOTE ] PSO: Full fetch complete (52779 records). [2025-10-28T20:46:15.712303] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-28T20:46:15.987440] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-28T20:46:16.088527] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-28T20:46:16.088600] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-28T20:46:16.089531] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-28T20:46:16.089591] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-28T20:46:16.090692] [DEBUG] [LOCAL ] PSO: Trimmed 52779 records to 36033 (keeping 200 days of data) [2025-10-28T20:46:16.301775] [DEBUG] [LOCAL ] PSO: Primary data saved (36033 records). [2025-10-28T20:46:16.301888] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-28T20:46:16.301968] [INFO ] [MAIN ] Update Progress: 1736/2366 symbols completed. PSO took 25.6s. Estimated remaining: 1h 22m 6s. Rate: 7.7 symbols/min [2025-10-28T20:46:16.475164] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:16.493982] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T20:46:16.515719] [DEBUG] [LOCAL ] PSTL: Loaded 19704 existing records from primary storage. [2025-10-28T20:46:16.515974] [INFO ] [MAIN ] PSTL: Loaded 19704 existing records. [2025-10-28T20:46:16.687395] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:46:16.687617] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-28T20:46:16.687704] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-28T20:46:16.688090] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-28T20:46:16.688162] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-28T20:46:16.786464] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-28T20:46:17.049479] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:17.364546] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:46:17.580283] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-28T20:46:18.199627] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T20:46:18.367051] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T20:46:18.380195] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-28T20:46:19.180224] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-28T20:46:19.221583] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T20:46:19.980257] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-28T20:46:20.463569] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:46:20.780275] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-28T20:46:21.500676] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T20:46:21.580213] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-28T20:46:21.954916] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T20:46:21.964040] [INFO ] [REMOTE ] PSN: Full fetch complete (66671 records). [2025-10-28T20:46:21.964276] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-28T20:46:22.367628] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-28T20:46:22.367750] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-28T20:46:22.369099] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-28T20:46:22.369163] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-28T20:46:22.370520] [DEBUG] [LOCAL ] PSN: Trimmed 66671 records to 44784 (keeping 200 days of data) [2025-10-28T20:46:22.419533] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-28T20:46:22.635752] [DEBUG] [LOCAL ] PSN: Primary data saved (44784 records). [2025-10-28T20:46:22.635893] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-28T20:46:22.635986] [INFO ] [MAIN ] Update Progress: 1737/2366 symbols completed. PSN took 34.1s. Estimated remaining: 1h 21m 57s. Rate: 7.7 symbols/min [2025-10-28T20:46:22.814012] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:22.814214] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-28T20:46:22.814358] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-28T20:46:22.814712] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-28T20:46:22.814821] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-28T20:46:22.814907] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-28T20:46:22.815017] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-28T20:46:23.180914] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-28T20:46:23.170352] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T20:46:23.210985] [INFO ] [REMOTE ] PSQH: Full fetch complete (53183 records). [2025-10-28T20:46:23.232770] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-28T20:46:23.264912] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:23.645934] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-28T20:46:23.646038] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-28T20:46:23.647103] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-28T20:46:23.647166] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-28T20:46:23.648393] [DEBUG] [LOCAL ] PSQH: Trimmed 53183 records to 35305 (keeping 200 days of data) [2025-10-28T20:46:23.855268] [DEBUG] [LOCAL ] PSQH: Primary data saved (35305 records). [2025-10-28T20:46:23.855486] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-28T20:46:23.855591] [INFO ] [MAIN ] Update Progress: 1738/2366 symbols completed. PSQH took 31.9s. Estimated remaining: 1h 21m 47s. Rate: 7.7 symbols/min [2025-10-28T20:46:23.981167] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-28T20:46:24.036063] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:24.088472] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T20:46:24.106814] [DEBUG] [LOCAL ] PTA: Loaded 15268 existing records from primary storage. [2025-10-28T20:46:24.107082] [INFO ] [MAIN ] PTA: Loaded 15268 existing records. [2025-10-28T20:46:24.304948] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T20:46:24.304459] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:46:24.310630] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-28T20:46:24.310753] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-28T20:46:24.311044] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-28T20:46:24.311105] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-28T20:46:24.668579] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:24.780251] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-28T20:46:25.551777] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T20:46:25.580946] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-28T20:46:25.585126] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T20:46:26.380257] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-28T20:46:26.991671] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T20:46:27.136084] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T20:46:27.180213] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-28T20:46:27.980332] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-28T20:46:28.674409] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T20:46:28.780236] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-28T20:46:28.833255] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T20:46:29.580261] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-28T20:46:30.380615] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T20:46:30.380776] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-28T20:46:30.477227] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T20:46:31.180230] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-28T20:46:31.193679] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T20:46:31.980242] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-28T20:46:32.097902] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T20:46:32.780248] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-28T20:46:32.951414] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T20:46:33.580259] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-28T20:46:34.380417] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-28T20:46:34.380351] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T20:46:34.523637] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T20:46:35.040592] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T20:46:35.180262] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-28T20:46:35.962971] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T20:46:35.980247] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-28T20:46:36.780295] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-28T20:46:37.368344] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T20:46:37.587703] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-28T20:46:37.594114] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T20:46:38.380316] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-28T20:46:39.180265] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-28T20:46:39.432783] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-28T20:46:39.961924] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T20:46:39.985235] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-28T20:46:39.987282] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T20:46:40.780287] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-28T20:46:41.580256] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-28T20:46:42.177278] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-28T20:46:42.189191] [INFO ] [REMOTE ] PSTG: Full fetch complete (76642 records). [2025-10-28T20:46:42.189388] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-28T20:46:42.389822] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-28T20:46:42.469045] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T20:46:42.614699] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-28T20:46:42.614786] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-28T20:46:42.615873] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-28T20:46:42.615934] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-28T20:46:42.617382] [DEBUG] [LOCAL ] PSTG: Trimmed 76642 records to 52764 (keeping 200 days of data) [2025-10-28T20:46:42.917975] [DEBUG] [LOCAL ] PSTG: Primary data saved (52764 records). [2025-10-28T20:46:42.918115] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-28T20:46:42.918187] [INFO ] [MAIN ] Update Progress: 1739/2366 symbols completed. PSTG took 40.6s. Estimated remaining: 1h 21m 43s. Rate: 7.7 symbols/min [2025-10-28T20:46:43.081214] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:43.117946] [DEBUG] [LOCAL ] PTY: Loaded 37696 existing records from primary storage. [2025-10-28T20:46:43.118254] [INFO ] [MAIN ] PTY: Loaded 37696 existing records. [2025-10-28T20:46:43.190119] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-28T20:46:43.291639] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:46:43.291819] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-28T20:46:43.291895] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-28T20:46:43.292393] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-28T20:46:43.292456] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-28T20:46:43.642797] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:43.654132] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T20:46:43.927568] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-28T20:46:43.980261] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-28T20:46:44.010126] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T20:46:44.780316] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-28T20:46:45.580259] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-28T20:46:46.038037] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T20:46:46.042271] [INFO ] [REMOTE ] PSTL: Full fetch complete (29227 records). [2025-10-28T20:46:46.042423] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-28T20:46:46.386967] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-28T20:46:46.414077] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-28T20:46:46.414154] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-28T20:46:46.414978] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-28T20:46:46.415113] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-28T20:46:46.416103] [DEBUG] [LOCAL ] PSTL: Trimmed 29227 records to 19659 (keeping 200 days of data) [2025-10-28T20:46:46.543904] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-28T20:46:46.571138] [DEBUG] [LOCAL ] PSTL: Primary data saved (19659 records). [2025-10-28T20:46:46.571246] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-28T20:46:46.571318] [INFO ] [MAIN ] Update Progress: 1740/2366 symbols completed. PSTL took 30.3s. Estimated remaining: 1h 21m 34s. Rate: 7.7 symbols/min [2025-10-28T20:46:46.735264] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:46.773717] [DEBUG] [LOCAL ] PUK: Loaded 44209 existing records from primary storage. [2025-10-28T20:46:46.774044] [INFO ] [MAIN ] PUK: Loaded 44209 existing records. [2025-10-28T20:46:46.946324] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:46:46.946525] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-28T20:46:46.946569] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-28T20:46:46.947144] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-28T20:46:46.947200] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-28T20:46:47.183574] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-28T20:46:47.300598] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:47.320909] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T20:46:47.337569] [INFO ] [REMOTE ] PTA: Full fetch complete (22726 records). [2025-10-28T20:46:47.338251] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-28T20:46:47.338961] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T20:46:47.698705] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-28T20:46:47.698785] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-28T20:46:47.699152] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-28T20:46:47.699191] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-28T20:46:47.699757] [DEBUG] [LOCAL ] PTA: Trimmed 22726 records to 15193 (keeping 200 days of data) [2025-10-28T20:46:47.788206] [DEBUG] [LOCAL ] PTA: Primary data saved (15193 records). [2025-10-28T20:46:47.788326] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-28T20:46:47.788402] [INFO ] [MAIN ] Update Progress: 1741/2366 symbols completed. PTA took 23.9s. Estimated remaining: 1h 21m 24s. Rate: 7.7 symbols/min [2025-10-28T20:46:47.953332] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:46:47.953509] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-28T20:46:47.953552] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-28T20:46:47.953678] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-28T20:46:47.953730] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-28T20:46:47.953772] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-28T20:46:47.953810] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-28T20:46:47.985717] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-28T20:46:48.305273] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:46:48.644383] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T20:46:48.780240] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-28T20:46:49.265345] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T20:46:49.580322] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-28T20:46:50.272822] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T20:46:50.380230] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-28T20:46:50.609309] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T20:46:51.180236] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-28T20:46:51.614500] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T20:46:51.980327] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-28T20:46:52.780341] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-28T20:46:52.913297] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T20:46:53.226802] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T20:46:53.580271] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-28T20:46:54.046831] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T20:46:54.380291] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-28T20:46:55.027833] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:46:55.180254] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-28T20:46:55.687284] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T20:46:55.980269] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-28T20:46:56.763697] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T20:46:56.780236] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-28T20:46:57.580285] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-28T20:46:57.709801] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T20:46:58.330925] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T20:46:58.380215] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-28T20:46:58.754915] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T20:46:59.180251] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-28T20:46:59.629117] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T20:46:59.980288] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-28T20:47:00.497747] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T20:47:00.780328] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-28T20:47:01.388906] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T20:47:01.580302] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-28T20:47:02.215217] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:47:02.380289] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-28T20:47:03.085816] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T20:47:03.096737] [INFO ] [REMOTE ] PSX: Full fetch complete (77127 records). [2025-10-28T20:47:03.096882] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-28T20:47:03.185394] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-28T20:47:03.512020] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-28T20:47:03.512140] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-28T20:47:03.514200] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-28T20:47:03.514298] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-28T20:47:03.516425] [DEBUG] [LOCAL ] PSX: Trimmed 77127 records to 53107 (keeping 200 days of data) [2025-10-28T20:47:03.894143] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T20:47:03.930174] [DEBUG] [LOCAL ] PSX: Primary data saved (53107 records). [2025-10-28T20:47:03.930544] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-28T20:47:03.930693] [INFO ] [MAIN ] Update Progress: 1742/2366 symbols completed. PSX took 41.3s. Estimated remaining: 1h 21m 19s. Rate: 7.7 symbols/min [2025-10-28T20:47:03.989098] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-28T20:47:04.131852] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:04.132133] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-28T20:47:04.132184] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-28T20:47:04.132315] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-28T20:47:04.132358] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-28T20:47:04.132476] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-28T20:47:04.132519] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-28T20:47:04.517862] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:04.543715] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T20:47:04.780291] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-28T20:47:05.451525] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T20:47:05.580303] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-28T20:47:06.153811] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T20:47:06.380363] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-28T20:47:06.870700] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T20:47:07.180315] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-28T20:47:07.679349] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T20:47:07.980307] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-28T20:47:08.459404] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T20:47:08.780262] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-28T20:47:09.318547] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T20:47:09.580252] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-28T20:47:09.851050] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T20:47:10.380294] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-28T20:47:10.963956] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:47:11.180310] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-28T20:47:11.472283] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T20:47:11.980304] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-28T20:47:12.469305] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T20:47:12.780307] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-28T20:47:13.264402] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:47:13.580259] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-28T20:47:14.069567] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T20:47:14.078533] [INFO ] [REMOTE ] PUK: Full fetch complete (65263 records). [2025-10-28T20:47:14.078692] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-28T20:47:14.385388] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-28T20:47:14.462266] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-28T20:47:14.462352] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-28T20:47:14.463404] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-28T20:47:14.463467] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-28T20:47:14.464850] [DEBUG] [LOCAL ] PUK: Trimmed 65263 records to 44131 (keeping 200 days of data) [2025-10-28T20:47:14.733961] [DEBUG] [LOCAL ] PUK: Primary data saved (44131 records). [2025-10-28T20:47:14.734091] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-28T20:47:14.734171] [INFO ] [MAIN ] Update Progress: 1743/2366 symbols completed. PUK took 28.2s. Estimated remaining: 1h 21m 12s. Rate: 7.7 symbols/min [2025-10-28T20:47:14.911179] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:14.935434] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T20:47:14.945450] [INFO ] [REMOTE ] PTY: Full fetch complete (54716 records). [2025-10-28T20:47:14.945740] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-28T20:47:14.948713] [DEBUG] [LOCAL ] PVL: Loaded 4761 existing records from primary storage. [2025-10-28T20:47:14.949029] [INFO ] [MAIN ] PVL: Loaded 4761 existing records. [2025-10-28T20:47:15.181126] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-28T20:47:15.293762] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:47:15.364392] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-28T20:47:15.384852] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-28T20:47:15.417259] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-28T20:47:15.433325] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-28T20:47:15.692924] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-28T20:47:15.727101] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-28T20:47:15.735319] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-28T20:47:15.744674] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-28T20:47:15.847245] [DEBUG] [LOCAL ] PTY: Trimmed 54716 records to 37657 (keeping 200 days of data) [2025-10-28T20:47:15.903500] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:15.990338] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-28T20:47:15.992903] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T20:47:16.032028] [INFO ] [REMOTE ] PUMP: Full fetch complete (71851 records). [2025-10-28T20:47:16.033416] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-28T20:47:16.380395] [DEBUG] [LOCAL ] PTY: Primary data saved (37657 records). [2025-10-28T20:47:16.425788] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-28T20:47:16.439871] [INFO ] [MAIN ] Update Progress: 1744/2366 symbols completed. PTY took 33.5s. Estimated remaining: 1h 21m 2s. Rate: 7.7 symbols/min [2025-10-28T20:47:16.763825] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-28T20:47:16.764669] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:16.765009] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-28T20:47:16.766661] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-28T20:47:16.766825] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-28T20:47:16.767118] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-28T20:47:16.767348] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-28T20:47:16.767054] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-28T20:47:16.767726] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-28T20:47:16.767798] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-28T20:47:16.768015] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-28T20:47:16.855578] [DEBUG] [LOCAL ] PUMP: Trimmed 71851 records to 49411 (keeping 200 days of data) [2025-10-28T20:47:16.866979] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T20:47:16.878803] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-28T20:47:17.235284] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-28T20:47:17.450488] [DEBUG] [LOCAL ] PUMP: Primary data saved (49411 records). [2025-10-28T20:47:17.453817] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:17.454426] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-28T20:47:17.454874] [INFO ] [MAIN ] Update Progress: 1745/2366 symbols completed. PUMP took 29.7s. Estimated remaining: 1h 20m 52s. Rate: 7.7 symbols/min [2025-10-28T20:47:17.568231] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T20:47:17.580232] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-28T20:47:17.627287] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:17.659603] [DEBUG] [LOCAL ] PX: Loaded 33364 existing records from primary storage. [2025-10-28T20:47:17.659877] [INFO ] [MAIN ] PX: Loaded 33364 existing records. [2025-10-28T20:47:17.831142] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:47:17.831323] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-28T20:47:17.831369] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-28T20:47:17.831718] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-28T20:47:17.831774] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-28T20:47:18.192120] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:18.193326] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T20:47:18.380217] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-28T20:47:18.886578] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T20:47:19.180315] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-28T20:47:19.980298] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-28T20:47:20.632883] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:47:20.780207] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-28T20:47:21.432502] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:47:21.580255] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-28T20:47:22.191735] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:47:22.380258] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-28T20:47:22.932492] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T20:47:23.180245] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-28T20:47:23.912551] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T20:47:23.928431] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T20:47:23.980224] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-28T20:47:24.529198] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T20:47:24.780245] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-28T20:47:25.580266] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-28T20:47:25.861149] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T20:47:26.080064] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T20:47:26.380248] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-28T20:47:27.180213] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-28T20:47:27.380785] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T20:47:27.722550] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T20:47:27.980306] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-28T20:47:28.484698] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T20:47:28.780323] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-28T20:47:29.580285] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-28T20:47:29.975700] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T20:47:30.380262] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-28T20:47:31.076712] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T20:47:31.180273] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-28T20:47:31.803917] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:47:31.980315] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-28T20:47:32.389308] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T20:47:32.780290] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-28T20:47:33.580242] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-28T20:47:33.850157] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-28T20:47:34.066455] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T20:47:34.067952] [INFO ] [REMOTE ] PVL: Full fetch complete (7061 records). [2025-10-28T20:47:34.068022] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-28T20:47:34.384423] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-28T20:47:34.420772] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-28T20:47:34.420843] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-28T20:47:34.421045] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-28T20:47:34.421082] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-28T20:47:34.421458] [DEBUG] [LOCAL ] PVL: Trimmed 7061 records to 4790 (keeping 200 days of data) [2025-10-28T20:47:34.450845] [DEBUG] [LOCAL ] PVL: Primary data saved (4790 records). [2025-10-28T20:47:34.450930] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-28T20:47:34.451001] [INFO ] [MAIN ] Update Progress: 1746/2366 symbols completed. PVL took 19.7s. Estimated remaining: 1h 20m 48s. Rate: 7.7 symbols/min [2025-10-28T20:47:34.632037] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:34.632309] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-28T20:47:34.632355] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-28T20:47:34.632567] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-28T20:47:34.632623] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-28T20:47:34.632705] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-28T20:47:34.632751] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-28T20:47:35.000759] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:35.180345] [INFO ] [REMOTE ] PXED: Fetching primary data for 2025-01. [2025-10-28T20:47:35.413527] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:47:35.414079] [WARN ] [REMOTE ] PXED: No data returned for month 2025-01 [2025-10-28T20:47:35.414193] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:47:35.414248] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-28T20:47:35.414313] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:47:35.414391] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-28T20:47:35.414468] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-28T20:47:35.414509] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-28T20:47:35.414551] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-28T20:47:35.414606] [INFO ] [MAIN ] Update Progress: 1747/2366 symbols completed. PXED took 1.0s. Estimated remaining: 1h 20m 37s. Rate: 7.7 symbols/min [2025-10-28T20:47:35.594508] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:35.594892] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-28T20:47:35.595053] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-28T20:47:35.595216] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-28T20:47:35.595341] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-28T20:47:35.595431] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-28T20:47:35.595486] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-28T20:47:35.798478] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T20:47:35.987470] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-28T20:47:36.021096] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:36.780270] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-28T20:47:37.119955] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:47:37.580288] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-28T20:47:38.343788] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T20:47:38.380222] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-28T20:47:38.700672] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T20:47:39.180260] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-28T20:47:39.767958] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T20:47:39.980240] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-28T20:47:40.135484] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T20:47:40.780294] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-28T20:47:41.580280] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-28T20:47:42.622169] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-28T20:47:42.633265] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-28T20:47:43.188053] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-28T20:47:43.216082] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-28T20:47:43.218852] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T20:47:43.225337] [INFO ] [REMOTE ] PX: Full fetch complete (49349 records). [2025-10-28T20:47:43.225592] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-28T20:47:43.620803] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-28T20:47:43.620913] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-28T20:47:43.622733] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-28T20:47:43.622802] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-28T20:47:43.624429] [DEBUG] [LOCAL ] PX: Trimmed 49349 records to 33219 (keeping 200 days of data) [2025-10-28T20:47:43.840199] [DEBUG] [LOCAL ] PX: Primary data saved (33219 records). [2025-10-28T20:47:43.840400] [INFO ] [MAIN ] PX: Full history saved. [2025-10-28T20:47:43.840505] [INFO ] [MAIN ] Update Progress: 1748/2366 symbols completed. PX took 26.4s. Estimated remaining: 1h 20m 30s. Rate: 7.7 symbols/min [2025-10-28T20:47:44.017171] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:44.048140] [DEBUG] [LOCAL ] QD: Loaded 27303 existing records from primary storage. [2025-10-28T20:47:44.048528] [INFO ] [MAIN ] QD: Loaded 27303 existing records. [2025-10-28T20:47:44.236412] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:47:44.236728] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-28T20:47:44.236790] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-28T20:47:44.237323] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-28T20:47:44.237391] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-28T20:47:44.611101] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:44.611427] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-28T20:47:44.977411] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T20:47:44.990475] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-28T20:47:45.023917] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-28T20:47:45.580251] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-28T20:47:46.355115] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T20:47:46.380392] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-28T20:47:47.083743] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T20:47:47.180262] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-28T20:47:47.541879] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T20:47:47.772631] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (14.99 seconds). [2025-10-28T20:47:47.980282] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-28T20:47:48.594713] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T20:47:48.780254] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-28T20:47:48.845930] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (3.27 seconds). [2025-10-28T20:47:49.580269] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-28T20:47:50.185097] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T20:47:50.195566] [INFO ] [REMOTE ] PWR: Full fetch complete (69063 records). [2025-10-28T20:47:50.195837] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-28T20:47:50.392070] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-28T20:47:50.631424] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-28T20:47:50.631531] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-28T20:47:50.633893] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-28T20:47:50.633961] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-28T20:47:50.635844] [DEBUG] [LOCAL ] PWR: Trimmed 69063 records to 46230 (keeping 200 days of data) [2025-10-28T20:47:50.951591] [DEBUG] [LOCAL ] PWR: Primary data saved (46230 records). [2025-10-28T20:47:50.951803] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-28T20:47:50.951925] [INFO ] [MAIN ] Update Progress: 1749/2366 symbols completed. PWR took 34.5s. Estimated remaining: 1h 20m 22s. Rate: 7.7 symbols/min [2025-10-28T20:47:51.136360] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:51.188760] [DEBUG] [LOCAL ] QGEN: Loaded 48922 existing records from primary storage. [2025-10-28T20:47:51.189163] [INFO ] [MAIN ] QGEN: Loaded 48922 existing records. [2025-10-28T20:47:51.373632] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:47:51.373957] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-28T20:47:51.374011] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-28T20:47:51.374866] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-28T20:47:51.374926] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-28T20:47:51.752367] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:51.753392] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-28T20:47:51.797106] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-28T20:47:51.971529] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T20:47:51.980285] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-28T20:47:52.780306] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-28T20:47:53.039866] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T20:47:53.580354] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-28T20:47:54.112867] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T20:47:54.192431] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-28T20:47:54.380295] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-28T20:47:54.808062] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T20:47:55.180291] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-28T20:47:55.932131] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (7.95 seconds). [2025-10-28T20:47:55.980221] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-28T20:47:56.491601] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-28T20:47:56.571592] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T20:47:56.780232] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-28T20:47:56.972255] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T20:47:57.580281] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-28T20:47:58.146842] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T20:47:58.156198] [INFO ] [REMOTE ] PVH: Full fetch complete (70497 records). [2025-10-28T20:47:58.156405] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-28T20:47:58.386559] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-28T20:47:58.593888] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-28T20:47:58.593993] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-28T20:47:58.595566] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-28T20:47:58.595637] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-28T20:47:58.597610] [DEBUG] [LOCAL ] PVH: Trimmed 70497 records to 48888 (keeping 200 days of data) [2025-10-28T20:47:58.926125] [DEBUG] [LOCAL ] PVH: Primary data saved (48888 records). [2025-10-28T20:47:58.926324] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-28T20:47:58.926437] [INFO ] [MAIN ] Update Progress: 1750/2366 symbols completed. PVH took 55.0s. Estimated remaining: 1h 20m 14s. Rate: 7.7 symbols/min [2025-10-28T20:47:59.107803] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:47:59.166634] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-28T20:47:59.167142] [INFO ] [MAIN ] QS: Loaded 53760 existing records. [2025-10-28T20:47:59.188452] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-28T20:47:59.322686] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-28T20:47:59.461301] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:47:59.461617] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-28T20:47:59.461710] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-28T20:47:59.462481] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-28T20:47:59.462541] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-28T20:47:59.838891] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:47:59.980293] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-28T20:48:00.254880] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T20:48:00.785450] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-28T20:48:00.809104] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-28T20:48:01.580301] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-28T20:48:01.897639] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T20:48:02.389343] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-28T20:48:02.417133] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T20:48:02.535056] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T20:48:03.180295] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-28T20:48:03.980253] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-28T20:48:04.122305] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T20:48:04.575426] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T20:48:04.780270] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-28T20:48:05.580279] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-28T20:48:06.110569] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T20:48:06.217524] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T20:48:06.380316] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-28T20:48:07.180239] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-28T20:48:07.450767] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-28T20:48:07.980338] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-28T20:48:08.564320] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:48:08.642441] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-28T20:48:08.780292] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-28T20:48:08.915404] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T20:48:09.466442] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:48:09.476920] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-28T20:48:09.477044] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-28T20:48:09.477701] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:48:09.477783] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:48:09.477826] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:48:09.477892] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-28T20:48:09.477956] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-28T20:48:09.477991] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-28T20:48:09.478030] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-28T20:48:09.478084] [INFO ] [MAIN ] Update Progress: 1751/2366 symbols completed. QBTS took 34.1s. Estimated remaining: 1h 20m 7s. Rate: 7.7 symbols/min [2025-10-28T20:48:09.585356] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-28T20:48:09.647891] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:48:09.699742] [DEBUG] [LOCAL ] QSR: Loaded 52372 existing records from primary storage. [2025-10-28T20:48:09.700050] [INFO ] [MAIN ] QSR: Loaded 52372 existing records. [2025-10-28T20:48:09.875132] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:48:09.875360] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-28T20:48:09.875408] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-28T20:48:09.876203] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-28T20:48:09.876261] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-28T20:48:10.228780] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:48:10.380226] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-28T20:48:11.180247] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-28T20:48:11.224310] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T20:48:11.795670] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T20:48:11.980298] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-28T20:48:12.109911] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T20:48:12.780221] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-28T20:48:13.580244] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-28T20:48:13.825998] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T20:48:14.127865] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T20:48:14.380319] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-28T20:48:14.589177] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T20:48:15.180322] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-28T20:48:15.923781] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T20:48:15.980255] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-28T20:48:16.780280] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-28T20:48:17.192726] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T20:48:17.420490] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T20:48:17.580328] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-28T20:48:18.255815] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T20:48:18.266367] [INFO ] [REMOTE ] QGEN: Full fetch complete (70744 records). [2025-10-28T20:48:18.266637] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-28T20:48:18.385512] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-28T20:48:18.694113] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-28T20:48:18.694339] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-28T20:48:18.697176] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-28T20:48:18.697274] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-28T20:48:18.699805] [DEBUG] [LOCAL ] QGEN: Trimmed 70744 records to 48868 (keeping 200 days of data) [2025-10-28T20:48:19.026441] [DEBUG] [LOCAL ] QGEN: Primary data saved (48868 records). [2025-10-28T20:48:19.026834] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-28T20:48:19.027285] [INFO ] [MAIN ] Update Progress: 1752/2366 symbols completed. QGEN took 28.1s. Estimated remaining: 1h 19m 60s. Rate: 7.7 symbols/min [2025-10-28T20:48:19.200113] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-28T20:48:19.257742] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:48:19.263189] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-28T20:48:19.316967] [DEBUG] [LOCAL ] QTWO: Loaded 39260 existing records from primary storage. [2025-10-28T20:48:19.317392] [INFO ] [MAIN ] QTWO: Loaded 39260 existing records. [2025-10-28T20:48:19.515460] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:48:19.515717] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-28T20:48:19.515775] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-28T20:48:19.516349] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-28T20:48:19.516408] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-28T20:48:19.872220] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:48:19.980275] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-28T20:48:20.245066] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-28T20:48:20.287875] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T20:48:20.296580] [INFO ] [REMOTE ] QD: Full fetch complete (39962 records). [2025-10-28T20:48:20.296762] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-28T20:48:20.703393] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-28T20:48:20.703488] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-28T20:48:20.704502] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-28T20:48:20.704566] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-28T20:48:20.705576] [DEBUG] [LOCAL ] QD: Trimmed 39962 records to 27313 (keeping 200 days of data) [2025-10-28T20:48:20.789698] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-28T20:48:20.872912] [DEBUG] [LOCAL ] QD: Primary data saved (27313 records). [2025-10-28T20:48:20.873062] [INFO ] [MAIN ] QD: Full history saved. [2025-10-28T20:48:20.873152] [INFO ] [MAIN ] Update Progress: 1753/2366 symbols completed. QD took 37.0s. Estimated remaining: 1h 19m 50s. Rate: 7.7 symbols/min [2025-10-28T20:48:21.068998] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:48:21.093502] [DEBUG] [LOCAL ] QUAD: Loaded 22857 existing records from primary storage. [2025-10-28T20:48:21.093831] [INFO ] [MAIN ] QUAD: Loaded 22857 existing records. [2025-10-28T20:48:21.244031] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T20:48:21.324300] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:48:21.324567] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-28T20:48:21.324623] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-28T20:48:21.324945] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-28T20:48:21.325005] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-28T20:48:21.585490] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-28T20:48:21.702954] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:48:22.380260] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-28T20:48:22.808668] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T20:48:22.936900] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-28T20:48:23.180283] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-28T20:48:23.722790] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T20:48:23.980263] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-28T20:48:24.331719] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T20:48:24.780242] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-28T20:48:25.580257] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-28T20:48:25.950019] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T20:48:25.992846] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-28T20:48:26.380270] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-28T20:48:27.095478] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T20:48:27.180222] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-28T20:48:27.197513] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T20:48:27.980247] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-28T20:48:28.540338] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T20:48:28.780253] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-28T20:48:28.856401] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T20:48:29.580264] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-28T20:48:30.284473] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T20:48:30.380262] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-28T20:48:30.666992] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T20:48:31.180257] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-28T20:48:31.823622] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T20:48:31.834599] [INFO ] [REMOTE ] QSR: Full fetch complete (76044 records). [2025-10-28T20:48:31.834798] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-28T20:48:31.988219] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-28T20:48:32.242717] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-28T20:48:32.242811] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-28T20:48:32.243927] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-28T20:48:32.244061] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-28T20:48:32.263091] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T20:48:32.262365] [DEBUG] [LOCAL ] QSR: Trimmed 76044 records to 52364 (keeping 200 days of data) [2025-10-28T20:48:32.584803] [DEBUG] [LOCAL ] QSR: Primary data saved (52364 records). [2025-10-28T20:48:32.584961] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-28T20:48:32.585059] [INFO ] [MAIN ] Update Progress: 1754/2366 symbols completed. QSR took 23.1s. Estimated remaining: 1h 19m 44s. Rate: 7.7 symbols/min [2025-10-28T20:48:32.752229] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:48:32.762660] [DEBUG] [LOCAL ] QVCC: Loaded 8554 existing records from primary storage. [2025-10-28T20:48:32.762856] [INFO ] [MAIN ] QVCC: Loaded 8554 existing records. [2025-10-28T20:48:32.785538] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-28T20:48:32.944674] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:48:32.944889] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-28T20:48:32.944964] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-28T20:48:32.945128] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-28T20:48:32.945181] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-28T20:48:33.296548] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:48:33.580381] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-28T20:48:34.208216] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-28T20:48:34.294839] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T20:48:34.342726] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T20:48:34.380258] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-28T20:48:34.869123] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:48:35.180303] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-28T20:48:35.980239] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-28T20:48:36.093693] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T20:48:36.578343] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T20:48:36.780279] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-28T20:48:37.580242] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-28T20:48:37.691288] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T20:48:38.380259] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-28T20:48:38.826940] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T20:48:39.180289] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-28T20:48:39.811614] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T20:48:39.980222] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-28T20:48:40.780215] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-28T20:48:40.825509] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-28T20:48:40.836556] [INFO ] [REMOTE ] QS: Full fetch complete (77920 records). [2025-10-28T20:48:40.836821] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-28T20:48:41.228208] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T20:48:41.254421] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-28T20:48:41.254491] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-28T20:48:41.255619] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-28T20:48:41.255702] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-28T20:48:41.257065] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 53760 (keeping 200 days of data) [2025-10-28T20:48:41.559939] [DEBUG] [LOCAL ] QS: Primary data saved (53760 records). [2025-10-28T20:48:41.560061] [INFO ] [MAIN ] QS: Full history saved. [2025-10-28T20:48:41.560820] [INFO ] [MAIN ] Update Progress: 1755/2366 symbols completed. QS took 42.6s. Estimated remaining: 1h 19m 36s. Rate: 7.7 symbols/min [2025-10-28T20:48:41.589859] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-28T20:48:41.735983] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:48:41.743955] [DEBUG] [LOCAL ] QVCD: Loaded 4443 existing records from primary storage. [2025-10-28T20:48:41.744167] [INFO ] [MAIN ] QVCD: Loaded 4443 existing records. [2025-10-28T20:48:41.922021] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:48:41.922237] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-28T20:48:41.922290] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-28T20:48:41.922492] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-28T20:48:41.922548] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-28T20:48:42.282142] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:48:42.379489] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T20:48:42.385611] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-28T20:48:42.858984] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T20:48:43.180247] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-28T20:48:43.666574] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T20:48:43.980243] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-28T20:48:44.093354] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T20:48:44.780223] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-28T20:48:44.850164] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:48:45.580288] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-28T20:48:45.849244] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T20:48:46.380300] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-28T20:48:47.156778] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T20:48:47.180267] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-28T20:48:47.357391] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T20:48:47.980322] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-28T20:48:48.282232] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T20:48:48.780310] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-28T20:48:49.120795] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T20:48:49.129580] [INFO ] [REMOTE ] QTWO: Full fetch complete (58054 records). [2025-10-28T20:48:49.129720] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-28T20:48:49.453350] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T20:48:49.531077] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-28T20:48:49.531146] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-28T20:48:49.532406] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-28T20:48:49.532486] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-28T20:48:49.533915] [DEBUG] [LOCAL ] QTWO: Trimmed 58054 records to 39175 (keeping 200 days of data) [2025-10-28T20:48:49.582159] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-28T20:48:49.762158] [DEBUG] [LOCAL ] QTWO: Primary data saved (39175 records). [2025-10-28T20:48:49.762292] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-28T20:48:49.762664] [INFO ] [MAIN ] Update Progress: 1756/2366 symbols completed. QTWO took 30.7s. Estimated remaining: 1h 19m 28s. Rate: 7.7 symbols/min [2025-10-28T20:48:49.930779] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:48:49.983479] [DEBUG] [LOCAL ] QXO: Loaded 53489 existing records from primary storage. [2025-10-28T20:48:49.983832] [INFO ] [MAIN ] QXO: Loaded 53489 existing records. [2025-10-28T20:48:50.162454] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:48:50.162708] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-28T20:48:50.162766] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-28T20:48:50.163386] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-28T20:48:50.163444] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-28T20:48:50.381018] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-28T20:48:50.521096] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:48:50.532587] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T20:48:51.042397] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T20:48:51.180234] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-28T20:48:51.744765] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T20:48:51.746952] [INFO ] [REMOTE ] QVCC: Full fetch complete (11835 records). [2025-10-28T20:48:51.747020] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-28T20:48:51.980279] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-28T20:48:52.110244] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-28T20:48:52.110329] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-28T20:48:52.110599] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-28T20:48:52.110639] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-28T20:48:52.111117] [DEBUG] [LOCAL ] QVCC: Trimmed 11835 records to 8513 (keeping 200 days of data) [2025-10-28T20:48:52.159074] [DEBUG] [LOCAL ] QVCC: Primary data saved (8513 records). [2025-10-28T20:48:52.159173] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-28T20:48:52.159246] [INFO ] [MAIN ] Update Progress: 1757/2366 symbols completed. QVCC took 19.6s. Estimated remaining: 1h 19m 19s. Rate: 7.7 symbols/min [2025-10-28T20:48:52.513181] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T20:48:52.780277] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-28T20:48:53.580118] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:48:53.580236] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-28T20:48:53.585919] [INFO ] [REMOTE ] QUAD: Full fetch complete (33950 records). [2025-10-28T20:48:53.586035] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-28T20:48:53.969376] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-28T20:48:53.969450] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-28T20:48:53.970142] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-28T20:48:53.970205] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-28T20:48:53.970964] [DEBUG] [LOCAL ] QUAD: Trimmed 33950 records to 22828 (keeping 200 days of data) [2025-10-28T20:48:54.105114] [DEBUG] [LOCAL ] QUAD: Primary data saved (22828 records). [2025-10-28T20:48:54.105248] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-28T20:48:54.105332] [INFO ] [MAIN ] Update Progress: 1758/2366 symbols completed. QUAD took 33.2s. Estimated remaining: 1h 19m 9s. Rate: 7.7 symbols/min [2025-10-28T20:48:54.380364] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-28T20:48:54.874247] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T20:48:54.906203] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T20:48:55.180291] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-28T20:48:55.736404] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:48:55.980330] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-28T20:48:56.422032] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:48:56.780354] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-28T20:48:57.580370] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-28T20:48:57.999355] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T20:48:58.091451] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:48:58.380287] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-28T20:48:59.180303] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-28T20:48:59.637794] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T20:48:59.854587] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T20:48:59.980252] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-28T20:49:00.780267] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-28T20:49:01.256463] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T20:49:01.420204] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T20:49:01.580278] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-28T20:49:02.102434] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T20:49:02.103916] [INFO ] [REMOTE ] QVCD: Full fetch complete (6167 records). [2025-10-28T20:49:02.103999] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-28T20:49:02.385411] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-28T20:49:02.453980] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-28T20:49:02.454154] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-28T20:49:02.454319] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-28T20:49:02.454358] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-28T20:49:02.454746] [DEBUG] [LOCAL ] QVCD: Trimmed 6167 records to 4430 (keeping 200 days of data) [2025-10-28T20:49:02.479840] [DEBUG] [LOCAL ] QVCD: Primary data saved (4430 records). [2025-10-28T20:49:02.479905] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-28T20:49:02.480014] [INFO ] [MAIN ] Update Progress: 1759/2366 symbols completed. QVCD took 20.9s. Estimated remaining: 1h 19m 1s. Rate: 7.7 symbols/min [2025-10-28T20:49:03.926225] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T20:49:03.937437] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-28T20:49:05.471845] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T20:49:05.482558] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-28T20:49:07.099019] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T20:49:07.111072] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-28T20:49:14.175066] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (7.06 seconds). [2025-10-28T20:49:14.186337] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-28T20:49:15.979509] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T20:49:15.991059] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-28T20:49:17.600510] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T20:49:17.611295] [INFO ] [REMOTE ] QXO: Full fetch complete (76432 records). [2025-10-28T20:49:17.611429] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-28T20:49:18.013711] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-28T20:49:18.013814] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-28T20:49:18.014928] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-28T20:49:18.014989] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-28T20:49:18.016511] [DEBUG] [LOCAL ] QXO: Trimmed 76432 records to 53497 (keeping 200 days of data) [2025-10-28T20:49:18.327784] [DEBUG] [LOCAL ] QXO: Primary data saved (53497 records). [2025-10-28T20:49:18.327909] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-28T20:49:18.327998] [INFO ] [MAIN ] Update Progress: 1760/2366 symbols completed. QXO took 28.6s. Estimated remaining: 1h 18m 56s. Rate: 7.7 symbols/min [2025-10-28T20:49:18.931760] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:19.038908] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:19.048152] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-28T20:49:19.073191] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:19.070244] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-28T20:49:19.071445] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:19.074044] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-28T20:49:19.074783] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-28T20:49:19.074462] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-28T20:49:19.075306] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-28T20:49:19.075429] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-28T20:49:19.075630] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-28T20:49:19.075567] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-28T20:49:19.075763] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-28T20:49:19.081319] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-28T20:49:19.098622] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-28T20:49:19.323443] [DEBUG] [LOCAL ] RA: Loaded 21637 existing records from primary storage. [2025-10-28T20:49:19.415743] [INFO ] [MAIN ] RA: Loaded 21637 existing records. [2025-10-28T20:49:19.582348] [DEBUG] [LOCAL ] RACE: Loaded 32773 existing records from primary storage. [2025-10-28T20:49:19.684807] [INFO ] [MAIN ] RACE: Loaded 32773 existing records. [2025-10-28T20:49:20.071860] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:49:20.117162] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-28T20:49:20.140017] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-28T20:49:20.186899] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:20.221911] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-28T20:49:20.226048] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-28T20:49:20.226523] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-28T20:49:20.272397] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:20.321305] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-28T20:49:20.457168] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:49:20.473161] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-28T20:49:20.484196] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-28T20:49:20.500173] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-28T20:49:20.514331] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-28T20:49:21.062742] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:21.065603] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-28T20:49:21.146882] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:21.147274] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-28T20:49:21.435639] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:49:21.443496] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-28T20:49:21.504223] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T20:49:21.513134] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-28T20:49:22.105161] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T20:49:22.109789] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-28T20:49:22.353349] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T20:49:22.359885] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-28T20:49:22.453506] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T20:49:22.459536] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-28T20:49:22.607960] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T20:49:22.615765] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-28T20:49:22.903790] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T20:49:22.908545] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-28T20:49:23.453269] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T20:49:23.461957] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-28T20:49:23.512792] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T20:49:23.520636] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-28T20:49:23.758890] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T20:49:23.784343] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-28T20:49:23.785846] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T20:49:23.793399] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-28T20:49:24.743134] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T20:49:24.749173] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-28T20:49:24.862567] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T20:49:24.873042] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-28T20:49:24.989163] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:49:25.016814] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-28T20:49:25.037026] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T20:49:25.049618] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-28T20:49:25.600927] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T20:49:25.608034] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-28T20:49:26.157624] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T20:49:26.164794] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-28T20:49:26.213517] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T20:49:26.222143] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-28T20:49:26.249521] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:49:26.257910] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-28T20:49:26.311343] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T20:49:26.316407] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-28T20:49:26.983453] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T20:49:26.989091] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-28T20:49:27.302265] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T20:49:27.310635] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-28T20:49:27.335722] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T20:49:27.353364] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T20:49:27.983240] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-28T20:49:27.987855] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T20:49:28.409950] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T20:49:28.780299] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-28T20:49:28.851564] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T20:49:29.580294] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-28T20:49:29.990250] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T20:49:30.380291] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-28T20:49:30.505273] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T20:49:31.180306] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-28T20:49:31.484099] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T20:49:31.980228] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-28T20:49:32.057608] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T20:49:32.780292] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-28T20:49:33.095303] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T20:49:33.580304] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-28T20:49:33.790289] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T20:49:33.796616] [INFO ] [REMOTE ] R: Full fetch complete (42801 records). [2025-10-28T20:49:33.796765] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-28T20:49:34.168422] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-28T20:49:34.168502] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-28T20:49:34.169358] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-28T20:49:34.169419] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-28T20:49:34.170371] [DEBUG] [LOCAL ] R: Trimmed 42801 records to 27904 (keeping 200 days of data) [2025-10-28T20:49:34.348440] [DEBUG] [LOCAL ] R: Primary data saved (27904 records). [2025-10-28T20:49:34.348580] [INFO ] [MAIN ] R: Full history saved. [2025-10-28T20:49:34.348674] [INFO ] [MAIN ] Update Progress: 1761/2366 symbols completed. R took 16.0s. Estimated remaining: 1h 18m 51s. Rate: 7.7 symbols/min [2025-10-28T20:49:34.380730] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-28T20:49:34.538514] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:34.536119] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T20:49:34.538721] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-28T20:49:34.538791] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-28T20:49:34.543211] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-28T20:49:34.543283] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-28T20:49:34.543449] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-28T20:49:34.543493] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-28T20:49:34.896479] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:35.180297] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-28T20:49:35.715764] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T20:49:35.980305] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-28T20:49:36.780348] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-28T20:49:37.082609] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-28T20:49:37.295185] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T20:49:37.580271] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-28T20:49:37.648061] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T20:49:37.652912] [INFO ] [REMOTE ] RA: Full fetch complete (31897 records). [2025-10-28T20:49:37.653000] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-28T20:49:38.031779] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-28T20:49:38.031874] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-28T20:49:38.032609] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-28T20:49:38.032700] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-28T20:49:38.033406] [DEBUG] [LOCAL ] RA: Trimmed 31897 records to 21494 (keeping 200 days of data) [2025-10-28T20:49:38.159973] [DEBUG] [LOCAL ] RA: Primary data saved (21494 records). [2025-10-28T20:49:38.160092] [INFO ] [MAIN ] RA: Full history saved. [2025-10-28T20:49:38.160166] [INFO ] [MAIN ] Update Progress: 1762/2366 symbols completed. RA took 19.8s. Estimated remaining: 1h 18m 42s. Rate: 7.7 symbols/min [2025-10-28T20:49:38.324910] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:38.325071] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-28T20:49:38.325106] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-28T20:49:38.325212] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-28T20:49:38.325252] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-28T20:49:38.325292] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-28T20:49:38.325323] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-28T20:49:38.386405] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-28T20:49:38.740626] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:39.071818] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T20:49:39.080506] [INFO ] [REMOTE ] RACE: Full fetch complete (49877 records). [2025-10-28T20:49:39.080609] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-28T20:49:39.185478] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-28T20:49:39.471978] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-28T20:49:39.472068] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-28T20:49:39.473031] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-28T20:49:39.473094] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-28T20:49:39.474185] [DEBUG] [LOCAL ] RACE: Trimmed 49877 records to 32727 (keeping 200 days of data) [2025-10-28T20:49:39.671173] [DEBUG] [LOCAL ] RACE: Primary data saved (32727 records). [2025-10-28T20:49:39.671370] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-28T20:49:39.671582] [INFO ] [MAIN ] Update Progress: 1763/2366 symbols completed. RACE took 21.3s. Estimated remaining: 1h 18m 32s. Rate: 7.7 symbols/min [2025-10-28T20:49:39.762199] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T20:49:39.873576] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:39.926839] [DEBUG] [LOCAL ] RBLX: Loaded 53717 existing records from primary storage. [2025-10-28T20:49:39.927146] [INFO ] [MAIN ] RBLX: Loaded 53717 existing records. [2025-10-28T20:49:39.982883] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-28T20:49:40.064048] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T20:49:40.127595] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:49:40.127833] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-28T20:49:40.127888] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-28T20:49:40.128585] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-28T20:49:40.128681] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-28T20:49:40.505986] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:40.780293] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-28T20:49:41.482532] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T20:49:41.580283] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-28T20:49:42.332970] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T20:49:42.380260] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-28T20:49:43.180302] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-28T20:49:43.214981] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T20:49:43.235824] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T20:49:43.980262] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-28T20:49:44.504990] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T20:49:44.780320] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-28T20:49:45.580309] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-28T20:49:45.713970] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T20:49:46.325141] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T20:49:46.380332] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-28T20:49:46.605115] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T20:49:47.180278] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-28T20:49:47.980310] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-28T20:49:48.780324] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-28T20:49:48.874094] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T20:49:49.211453] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T20:49:49.221599] [INFO ] [REMOTE ] RAMP: Full fetch complete (54851 records). [2025-10-28T20:49:49.221813] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-28T20:49:49.580813] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-28T20:49:49.627998] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-28T20:49:49.628166] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-28T20:49:49.629373] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-28T20:49:49.629542] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-28T20:49:49.642222] [DEBUG] [LOCAL ] RAMP: Trimmed 54851 records to 37292 (keeping 200 days of data) [2025-10-28T20:49:49.643016] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T20:49:49.857329] [DEBUG] [LOCAL ] RAMP: Primary data saved (37292 records). [2025-10-28T20:49:49.857466] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-28T20:49:49.857536] [INFO ] [MAIN ] Update Progress: 1764/2366 symbols completed. RAMP took 31.5s. Estimated remaining: 1h 18m 25s. Rate: 7.7 symbols/min [2025-10-28T20:49:50.028146] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:49:50.036369] [DEBUG] [LOCAL ] RBOT: Loaded 6283 existing records from primary storage. [2025-10-28T20:49:50.036573] [INFO ] [MAIN ] RBOT: Loaded 6283 existing records. [2025-10-28T20:49:50.213621] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:49:50.213861] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-28T20:49:50.213910] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-28T20:49:50.214159] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-28T20:49:50.214229] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-28T20:49:50.398066] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-28T20:49:50.581888] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:49:51.180279] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-28T20:49:51.287965] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T20:49:51.384452] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-28T20:49:51.910691] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T20:49:51.980233] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-28T20:49:52.211852] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (5.83 seconds). [2025-10-28T20:49:52.462867] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T20:49:52.780266] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-28T20:49:53.293990] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:49:53.580260] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-28T20:49:54.336945] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T20:49:54.380226] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-28T20:49:55.132562] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T20:49:55.180225] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-28T20:49:55.841772] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T20:49:55.980265] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-28T20:49:56.700623] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T20:49:56.780287] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-28T20:49:57.580242] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-28T20:49:58.380236] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-28T20:49:58.473780] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T20:49:58.854622] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T20:49:58.907087] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T20:49:59.180276] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-28T20:49:59.882945] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:49:59.886941] [INFO ] [REMOTE ] RBC: Full fetch complete (22018 records). [2025-10-28T20:49:59.887021] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-28T20:49:59.985490] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-28T20:50:00.262976] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-28T20:50:00.263067] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-28T20:50:00.263588] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-28T20:50:00.263669] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-28T20:50:00.264249] [DEBUG] [LOCAL ] RBC: Trimmed 22018 records to 15204 (keeping 200 days of data) [2025-10-28T20:50:00.352563] [DEBUG] [LOCAL ] RBC: Primary data saved (15204 records). [2025-10-28T20:50:00.352711] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-28T20:50:00.352790] [INFO ] [MAIN ] Update Progress: 1765/2366 symbols completed. RBC took 22.2s. Estimated remaining: 1h 18m 18s. Rate: 7.7 symbols/min [2025-10-28T20:50:00.522467] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:00.571861] [DEBUG] [LOCAL ] RBRK: Loaded 53161 existing records from primary storage. [2025-10-28T20:50:00.572151] [INFO ] [MAIN ] RBRK: Loaded 53161 existing records. [2025-10-28T20:50:00.753762] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:50:00.753972] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-28T20:50:00.754027] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-28T20:50:00.754587] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-28T20:50:00.754674] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-28T20:50:00.786506] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-28T20:50:01.121620] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:01.580226] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-28T20:50:01.879975] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-28T20:50:02.224996] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T20:50:02.380310] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-28T20:50:03.080437] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T20:50:03.180267] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-28T20:50:03.522906] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T20:50:03.980252] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-28T20:50:04.673907] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T20:50:04.780285] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-28T20:50:05.580306] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-28T20:50:06.075420] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-28T20:50:06.115145] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:50:06.124866] [INFO ] [REMOTE ] RBA: Full fetch complete (66713 records). [2025-10-28T20:50:06.124994] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-28T20:50:06.385504] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-28T20:50:06.515459] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-28T20:50:06.515554] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-28T20:50:06.516959] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-28T20:50:06.517030] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-28T20:50:06.518447] [DEBUG] [LOCAL ] RBA: Trimmed 66713 records to 45883 (keeping 200 days of data) [2025-10-28T20:50:06.816547] [DEBUG] [LOCAL ] RBA: Primary data saved (45883 records). [2025-10-28T20:50:06.816727] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-28T20:50:06.816810] [INFO ] [MAIN ] Update Progress: 1766/2366 symbols completed. RBA took 32.5s. Estimated remaining: 1h 18m 10s. Rate: 7.7 symbols/min [2025-10-28T20:50:07.007810] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:07.007987] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-28T20:50:07.008073] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-28T20:50:07.008158] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-28T20:50:07.008197] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-28T20:50:07.008238] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-28T20:50:07.008278] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-28T20:50:07.187106] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-28T20:50:07.431024] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:07.467314] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T20:50:07.747746] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:50:07.980308] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-28T20:50:08.756039] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-28T20:50:08.780212] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-28T20:50:09.582077] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-28T20:50:09.585045] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T20:50:10.009826] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T20:50:10.380300] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-28T20:50:10.593776] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T20:50:10.984699] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T20:50:11.180278] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-28T20:50:11.980266] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-28T20:50:12.599781] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T20:50:12.780306] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-28T20:50:13.580229] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-28T20:50:14.076834] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-28T20:50:14.137545] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T20:50:14.380259] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-28T20:50:15.180274] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-28T20:50:15.601357] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T20:50:15.612111] [INFO ] [REMOTE ] RBLX: Full fetch complete (77886 records). [2025-10-28T20:50:15.612223] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-28T20:50:16.005193] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-28T20:50:16.005331] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-28T20:50:16.006371] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-28T20:50:16.007980] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-28T20:50:16.008229] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-28T20:50:16.009972] [DEBUG] [LOCAL ] RBLX: Trimmed 77886 records to 53718 (keeping 200 days of data) [2025-10-28T20:50:16.361638] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-28T20:50:16.385910] [DEBUG] [LOCAL ] RBLX: Primary data saved (53718 records). [2025-10-28T20:50:16.386423] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-28T20:50:16.387011] [INFO ] [MAIN ] Update Progress: 1767/2366 symbols completed. RBLX took 36.7s. Estimated remaining: 1h 18m 3s. Rate: 7.7 symbols/min [2025-10-28T20:50:16.571782] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:16.574710] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-28T20:50:16.576986] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-28T20:50:16.577706] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T20:50:16.579873] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-28T20:50:16.580168] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-28T20:50:16.580243] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-28T20:50:16.580280] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-28T20:50:16.786831] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-28T20:50:17.017218] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:17.020118] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-28T20:50:17.580245] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-28T20:50:18.132818] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:50:18.380226] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-28T20:50:18.592422] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-28T20:50:19.168065] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T20:50:19.171020] [INFO ] [REMOTE ] RBOT: Full fetch complete (9055 records). [2025-10-28T20:50:19.171103] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-28T20:50:19.185392] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-28T20:50:19.524788] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-28T20:50:19.524851] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-28T20:50:19.525097] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-28T20:50:19.525136] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-28T20:50:19.525543] [DEBUG] [LOCAL ] RBOT: Trimmed 9055 records to 6311 (keeping 200 days of data) [2025-10-28T20:50:19.560036] [DEBUG] [LOCAL ] RBOT: Primary data saved (6311 records). [2025-10-28T20:50:19.560151] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-28T20:50:19.560241] [INFO ] [MAIN ] Update Progress: 1768/2366 symbols completed. RBOT took 29.7s. Estimated remaining: 1h 17m 53s. Rate: 7.7 symbols/min [2025-10-28T20:50:19.735334] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:19.740964] [DEBUG] [LOCAL ] RCD: Loaded 3252 existing records from primary storage. [2025-10-28T20:50:19.741147] [INFO ] [MAIN ] RCD: Loaded 3252 existing records. [2025-10-28T20:50:19.917419] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:50:19.917617] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-28T20:50:19.917692] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-28T20:50:19.917848] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-10-28T20:50:19.917902] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-28T20:50:19.985369] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-28T20:50:20.268460] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:20.641363] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T20:50:20.780247] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-28T20:50:21.580231] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-28T20:50:21.653903] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T20:50:22.073308] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T20:50:22.149224] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T20:50:22.380284] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-28T20:50:22.883800] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T20:50:23.180303] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-28T20:50:23.724562] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T20:50:23.980293] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-28T20:50:24.780303] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-28T20:50:25.256123] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T20:50:25.302932] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T20:50:25.580245] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-28T20:50:26.380305] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-28T20:50:26.846476] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T20:50:27.180252] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-28T20:50:27.363878] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T20:50:27.671445] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:50:27.980298] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-28T20:50:28.572604] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T20:50:28.780224] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-28T20:50:29.580255] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-28T20:50:30.201308] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:50:30.380288] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-28T20:50:30.476340] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T20:50:30.487118] [INFO ] [REMOTE ] RBRK: Full fetch complete (76722 records). [2025-10-28T20:50:30.487256] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-28T20:50:30.876693] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-28T20:50:30.876790] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-28T20:50:30.877910] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-28T20:50:30.877971] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-28T20:50:30.879400] [DEBUG] [LOCAL ] RBRK: Trimmed 76722 records to 53163 (keeping 200 days of data) [2025-10-28T20:50:31.184351] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-28T20:50:31.184270] [DEBUG] [LOCAL ] RBRK: Primary data saved (53163 records). [2025-10-28T20:50:31.185323] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-28T20:50:31.185404] [INFO ] [MAIN ] Update Progress: 1769/2366 symbols completed. RBRK took 30.8s. Estimated remaining: 1h 17m 47s. Rate: 7.7 symbols/min [2025-10-28T20:50:31.352750] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:31.395080] [DEBUG] [LOCAL ] RCI: Loaded 48551 existing records from primary storage. [2025-10-28T20:50:31.395397] [INFO ] [MAIN ] RCI: Loaded 48551 existing records. [2025-10-28T20:50:31.574399] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:50:31.574559] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-28T20:50:31.574604] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-28T20:50:31.574848] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-28T20:50:31.574903] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-28T20:50:31.771800] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T20:50:31.970291] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:31.972117] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T20:50:31.981802] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-28T20:50:32.470743] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T20:50:32.780247] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-28T20:50:33.132564] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T20:50:33.580275] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-28T20:50:34.032609] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T20:50:34.380240] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-28T20:50:34.830797] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T20:50:35.180244] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-28T20:50:35.531897] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T20:50:35.980311] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-28T20:50:36.780305] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-28T20:50:37.255456] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T20:50:37.580274] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-28T20:50:37.961991] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T20:50:38.024708] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T20:50:38.380304] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-28T20:50:39.180282] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-28T20:50:39.939728] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:50:39.943684] [INFO ] [REMOTE ] RCB: Full fetch complete (3684 records). [2025-10-28T20:50:39.943507] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T20:50:39.954045] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-28T20:50:39.986044] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-28T20:50:40.157513] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T20:50:40.157755] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:50:40.157826] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:50:40.157898] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-28T20:50:40.157984] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-28T20:50:40.158048] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-28T20:50:40.158101] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-28T20:50:40.158172] [INFO ] [MAIN ] Update Progress: 1770/2366 symbols completed. RCB took 23.8s. Estimated remaining: 1h 17m 39s. Rate: 7.7 symbols/min [2025-10-28T20:50:40.335162] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:40.335442] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-28T20:50:40.335492] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-28T20:50:40.335618] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-28T20:50:40.335694] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-28T20:50:40.335752] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-28T20:50:40.335785] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-28T20:50:40.690138] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:40.780286] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-28T20:50:41.580273] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-28T20:50:42.161971] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:50:42.271938] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-28T20:50:42.282167] [INFO ] [REMOTE ] RC: Full fetch complete (71048 records). [2025-10-28T20:50:42.282327] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-28T20:50:42.387380] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-28T20:50:42.678387] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-28T20:50:42.678467] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-28T20:50:42.679585] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-28T20:50:42.679671] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-28T20:50:42.681003] [DEBUG] [LOCAL ] RC: Trimmed 71048 records to 48686 (keeping 200 days of data) [2025-10-28T20:50:42.961575] [DEBUG] [LOCAL ] RC: Primary data saved (48686 records). [2025-10-28T20:50:42.961746] [INFO ] [MAIN ] RC: Full history saved. [2025-10-28T20:50:42.961823] [INFO ] [MAIN ] Update Progress: 1771/2366 symbols completed. RC took 36.1s. Estimated remaining: 1h 17m 30s. Rate: 7.7 symbols/min [2025-10-28T20:50:43.127480] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:43.140830] [DEBUG] [LOCAL ] RCS: Loaded 12263 existing records from primary storage. [2025-10-28T20:50:43.141123] [INFO ] [MAIN ] RCS: Loaded 12263 existing records. [2025-10-28T20:50:43.203670] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-28T20:50:43.317767] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:50:43.317971] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-28T20:50:43.318017] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-28T20:50:43.318193] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-28T20:50:43.318249] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-28T20:50:43.663447] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:43.831304] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-28T20:50:43.862691] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T20:50:43.980255] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-28T20:50:44.348856] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-28T20:50:44.780289] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-28T20:50:45.580264] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-28T20:50:45.653538] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T20:50:46.380292] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-28T20:50:46.808687] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-28T20:50:47.180354] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-28T20:50:47.516466] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T20:50:47.921637] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-28T20:50:47.980303] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-28T20:50:48.780293] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-28T20:50:49.175754] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T20:50:49.176963] [INFO ] [REMOTE ] RCD: Full fetch complete (5689 records). [2025-10-28T20:50:49.177032] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-28T20:50:49.594619] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-28T20:50:49.603593] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-28T20:50:49.604526] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-28T20:50:49.608340] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-28T20:50:49.608790] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-28T20:50:49.616138] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-28T20:50:49.621538] [DEBUG] [LOCAL ] RCD: Trimmed 5689 records to 3240 (keeping 200 days of data) [2025-10-28T20:50:49.669673] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T20:50:49.685631] [DEBUG] [LOCAL ] RCD: Primary data saved (3240 records). [2025-10-28T20:50:49.686216] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-28T20:50:49.686305] [INFO ] [MAIN ] Update Progress: 1772/2366 symbols completed. RCD took 30.1s. Estimated remaining: 1h 17m 22s. Rate: 7.7 symbols/min [2025-10-28T20:50:49.869214] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:50:49.869360] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-28T20:50:49.869395] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-28T20:50:49.869528] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-28T20:50:49.869585] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-28T20:50:49.869629] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-28T20:50:49.869699] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-28T20:50:50.242869] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:50:50.321166] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T20:50:50.380208] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-28T20:50:51.180266] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-28T20:50:51.494484] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T20:50:51.980300] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-28T20:50:52.784552] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-28T20:50:52.789789] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T20:50:52.909062] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T20:50:53.580309] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-28T20:50:54.114322] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T20:50:54.203905] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T20:50:54.380327] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-28T20:50:55.180295] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-28T20:50:55.864550] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T20:50:55.980213] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-28T20:50:56.230725] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-28T20:50:56.780284] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-28T20:50:57.129764] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:50:57.580304] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-28T20:50:58.035011] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T20:50:58.380302] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-28T20:50:58.815242] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T20:50:59.180291] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-28T20:50:59.985789] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-28T20:51:00.005617] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T20:51:00.339300] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T20:51:00.746826] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T20:51:00.780212] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-28T20:51:01.580275] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-28T20:51:02.162532] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:51:02.380270] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-28T20:51:03.180233] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-28T20:51:03.216255] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T20:51:03.677889] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T20:51:03.878098] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T20:51:03.980263] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-28T20:51:04.780315] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-28T20:51:05.198289] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T20:51:05.443878] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T20:51:05.580313] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-28T20:51:06.380257] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-28T20:51:06.883931] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T20:51:07.180268] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-28T20:51:07.928328] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T20:51:07.980234] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-28T20:51:08.525277] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T20:51:08.535164] [INFO ] [REMOTE ] RCI: Full fetch complete (70776 records). [2025-10-28T20:51:08.535277] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-28T20:51:08.788017] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-28T20:51:08.923176] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-28T20:51:08.923279] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-28T20:51:08.924537] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-28T20:51:08.924602] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-28T20:51:08.926054] [DEBUG] [LOCAL ] RCI: Trimmed 70776 records to 48534 (keeping 200 days of data) [2025-10-28T20:51:09.220451] [DEBUG] [LOCAL ] RCI: Primary data saved (48534 records). [2025-10-28T20:51:09.220594] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-28T20:51:09.220703] [INFO ] [MAIN ] Update Progress: 1773/2366 symbols completed. RCI took 38.0s. Estimated remaining: 1h 17m 18s. Rate: 7.7 symbols/min [2025-10-28T20:51:09.389378] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:09.440738] [DEBUG] [LOCAL ] RDDT: Loaded 53769 existing records from primary storage. [2025-10-28T20:51:09.441047] [INFO ] [MAIN ] RDDT: Loaded 53769 existing records. [2025-10-28T20:51:09.580283] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-28T20:51:09.627796] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:51:09.628077] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-28T20:51:09.628239] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-28T20:51:09.638560] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-10-28T20:51:09.653671] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-28T20:51:09.734162] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T20:51:10.048167] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:10.285964] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T20:51:10.325787] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T20:51:10.380247] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-28T20:51:11.150825] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T20:51:11.154579] [INFO ] [REMOTE ] RCS: Full fetch complete (18543 records). [2025-10-28T20:51:11.154673] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-28T20:51:11.185396] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-28T20:51:11.538490] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-28T20:51:11.538563] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-28T20:51:11.538983] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-28T20:51:11.539042] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-28T20:51:11.539537] [DEBUG] [LOCAL ] RCS: Trimmed 18543 records to 12242 (keeping 200 days of data) [2025-10-28T20:51:11.625914] [DEBUG] [LOCAL ] RCS: Primary data saved (12242 records). [2025-10-28T20:51:11.626143] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-28T20:51:11.626238] [INFO ] [MAIN ] Update Progress: 1774/2366 symbols completed. RCS took 28.7s. Estimated remaining: 1h 17m 8s. Rate: 7.7 symbols/min [2025-10-28T20:51:11.799780] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:11.799951] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-28T20:51:11.800231] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-28T20:51:11.800313] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-28T20:51:11.800349] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-28T20:51:11.800388] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-28T20:51:11.800420] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-28T20:51:11.988776] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-28T20:51:12.158478] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:12.402774] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T20:51:12.780260] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-28T20:51:13.473068] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T20:51:13.483026] [INFO ] [REMOTE ] RCL: Full fetch complete (74977 records). [2025-10-28T20:51:13.483189] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-28T20:51:13.484337] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:51:13.484440] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:51:13.484530] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:51:13.484617] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-28T20:51:13.484747] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-28T20:51:13.484818] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-28T20:51:13.484905] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-28T20:51:13.485053] [INFO ] [MAIN ] Update Progress: 1775/2366 symbols completed. RCL took 33.3s. Estimated remaining: 1h 16m 58s. Rate: 7.7 symbols/min [2025-10-28T20:51:13.585737] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-28T20:51:13.671259] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:13.723821] [DEBUG] [LOCAL ] RDW: Loaded 52316 existing records from primary storage. [2025-10-28T20:51:13.724121] [INFO ] [MAIN ] RDW: Loaded 52316 existing records. [2025-10-28T20:51:13.918638] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:51:13.919034] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-28T20:51:13.919159] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-28T20:51:13.919939] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-28T20:51:13.919998] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-28T20:51:14.307903] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:14.309931] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-28T20:51:14.380207] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-28T20:51:15.011323] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T20:51:15.180242] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-28T20:51:15.980323] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-28T20:51:16.376701] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T20:51:16.411892] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-28T20:51:16.780354] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-28T20:51:17.580230] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-28T20:51:17.647141] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T20:51:17.909471] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T20:51:18.380244] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-28T20:51:19.180247] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-28T20:51:19.558050] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-28T20:51:19.705431] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T20:51:19.980251] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-28T20:51:20.780269] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-28T20:51:20.967204] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T20:51:21.580351] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-28T20:51:22.127551] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T20:51:22.169183] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-28T20:51:22.380273] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-28T20:51:22.757442] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T20:51:22.767322] [INFO ] [REMOTE ] RCUS: Full fetch complete (61441 records). [2025-10-28T20:51:22.767530] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-28T20:51:23.156549] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-28T20:51:23.156686] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-28T20:51:23.157694] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-28T20:51:23.157756] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-28T20:51:23.158994] [DEBUG] [LOCAL ] RCUS: Trimmed 61441 records to 42731 (keeping 200 days of data) [2025-10-28T20:51:23.204167] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-28T20:51:23.411046] [DEBUG] [LOCAL ] RCUS: Primary data saved (42731 records). [2025-10-28T20:51:23.411277] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-28T20:51:23.411408] [INFO ] [MAIN ] Update Progress: 1776/2366 symbols completed. RCUS took 33.7s. Estimated remaining: 1h 16m 51s. Rate: 7.7 symbols/min [2025-10-28T20:51:23.585319] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:23.617402] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T20:51:23.665917] [DEBUG] [LOCAL ] RDY: Loaded 46035 existing records from primary storage. [2025-10-28T20:51:23.666226] [INFO ] [MAIN ] RDY: Loaded 46035 existing records. [2025-10-28T20:51:23.837957] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:51:23.838187] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-28T20:51:23.838235] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-28T20:51:23.838796] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-28T20:51:23.838853] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-28T20:51:23.987429] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-28T20:51:24.190774] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:24.780286] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-28T20:51:25.329507] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T20:51:25.464110] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-28T20:51:25.580295] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-28T20:51:26.380319] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-28T20:51:26.511946] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T20:51:26.924509] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T20:51:27.180282] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-28T20:51:27.651961] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T20:51:27.980308] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-28T20:51:28.493973] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:51:28.780276] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-28T20:51:29.580266] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-28T20:51:29.988716] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-28T20:51:30.364306] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T20:51:30.380218] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-28T20:51:30.845879] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T20:51:31.180318] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-28T20:51:31.948722] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T20:51:31.980229] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-28T20:51:32.780312] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-28T20:51:33.212232] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-28T20:51:33.580249] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-28T20:51:33.793116] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T20:51:33.946506] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T20:51:34.380315] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-28T20:51:35.180239] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-28T20:51:35.664432] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-28T20:51:35.980317] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-28T20:51:36.342261] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T20:51:36.385231] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-28T20:51:36.780304] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-28T20:51:37.580246] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-28T20:51:38.057777] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-28T20:51:38.094530] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T20:51:38.380251] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-28T20:51:39.180355] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-28T20:51:39.515485] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-28T20:51:39.980308] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-28T20:51:40.486019] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-28T20:51:40.497160] [INFO ] [REMOTE ] RDDT: Full fetch complete (77928 records). [2025-10-28T20:51:40.497319] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-28T20:51:40.788940] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-28T20:51:40.902072] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-28T20:51:40.902208] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-28T20:51:40.903619] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-28T20:51:40.903719] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-28T20:51:40.932362] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T20:51:40.942474] [DEBUG] [LOCAL ] RDDT: Trimmed 77928 records to 53769 (keeping 200 days of data) [2025-10-28T20:51:41.186424] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T20:51:41.218817] [INFO ] [REMOTE ] RDN: Full fetch complete (65395 records). [2025-10-28T20:51:41.218951] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-28T20:51:41.402508] [DEBUG] [LOCAL ] RDDT: Primary data saved (53769 records). [2025-10-28T20:51:41.402977] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-28T20:51:41.403097] [INFO ] [MAIN ] Update Progress: 1777/2366 symbols completed. RDDT took 32.2s. Estimated remaining: 1h 16m 47s. Rate: 7.7 symbols/min [2025-10-28T20:51:41.590373] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-28T20:51:41.756514] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:41.874938] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-28T20:51:41.875110] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-28T20:51:41.876349] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-28T20:51:41.876471] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-28T20:51:41.878005] [DEBUG] [LOCAL ] RDN: Trimmed 65395 records to 43547 (keeping 200 days of data) [2025-10-28T20:51:42.012154] [DEBUG] [LOCAL ] RELX: Loaded 48478 existing records from primary storage. [2025-10-28T20:51:42.019288] [INFO ] [MAIN ] RELX: Loaded 48478 existing records. [2025-10-28T20:51:42.309232] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:51:42.312853] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-28T20:51:42.314227] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-28T20:51:42.317691] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-28T20:51:42.318278] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-28T20:51:42.450012] [DEBUG] [LOCAL ] RDN: Primary data saved (43547 records). [2025-10-28T20:51:42.450374] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-28T20:51:42.450468] [INFO ] [MAIN ] Update Progress: 1778/2366 symbols completed. RDN took 30.8s. Estimated remaining: 1h 16m 37s. Rate: 7.7 symbols/min [2025-10-28T20:51:42.808188] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:42.892791] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:42.893261] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-28T20:51:42.941219] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-28T20:51:42.979450] [DEBUG] [LOCAL ] RERE: Loaded 41754 existing records from primary storage. [2025-10-28T20:51:42.979813] [INFO ] [MAIN ] RERE: Loaded 41754 existing records. [2025-10-28T20:51:43.184348] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-28T20:51:43.184261] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:51:43.187389] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T20:51:43.197851] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-28T20:51:43.198639] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-28T20:51:43.199753] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-28T20:51:43.199849] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-28T20:51:43.562564] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:43.980220] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-28T20:51:44.196325] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T20:51:44.780314] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-28T20:51:45.149266] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T20:51:45.337898] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-28T20:51:45.351931] [INFO ] [REMOTE ] RDW: Full fetch complete (75650 records). [2025-10-28T20:51:45.352103] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-28T20:51:45.585444] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-28T20:51:45.747951] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-28T20:51:45.748092] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-28T20:51:45.749261] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-28T20:51:45.749415] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-28T20:51:45.770113] [DEBUG] [LOCAL ] RDW: Trimmed 75650 records to 52320 (keeping 200 days of data) [2025-10-28T20:51:45.771055] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T20:51:46.077460] [DEBUG] [LOCAL ] RDW: Primary data saved (52320 records). [2025-10-28T20:51:46.077594] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-28T20:51:46.078231] [INFO ] [MAIN ] Update Progress: 1779/2366 symbols completed. RDW took 32.6s. Estimated remaining: 1h 16m 27s. Rate: 7.7 symbols/min [2025-10-28T20:51:46.242841] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:51:46.243000] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-28T20:51:46.243037] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-28T20:51:46.243142] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-28T20:51:46.243182] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-28T20:51:46.243222] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-28T20:51:46.243252] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-28T20:51:46.389770] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-28T20:51:46.593593] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:51:46.981757] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T20:51:47.180327] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-28T20:51:47.651994] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T20:51:47.980323] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-28T20:51:48.619883] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T20:51:48.780274] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-28T20:51:48.972978] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T20:51:49.580241] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-28T20:51:50.380229] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-28T20:51:50.502829] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T20:51:50.858709] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T20:51:51.180257] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-28T20:51:51.319292] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T20:51:51.980311] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-28T20:51:52.438260] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T20:51:52.780314] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-28T20:51:53.184861] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T20:51:53.580291] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-28T20:51:53.920239] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T20:51:54.380331] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-28T20:51:54.915745] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T20:51:55.180266] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-28T20:51:55.716139] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T20:51:55.980283] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-28T20:51:56.137043] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T20:51:56.780332] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-28T20:51:57.406123] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:51:57.580250] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-28T20:51:57.854818] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T20:51:58.380250] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-28T20:51:58.727399] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T20:51:59.180242] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-28T20:51:59.585323] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T20:51:59.594705] [INFO ] [REMOTE ] RDY: Full fetch complete (68377 records). [2025-10-28T20:51:59.594848] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-28T20:51:59.973327] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-28T20:51:59.973413] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-28T20:51:59.974477] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-28T20:51:59.974540] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-28T20:51:59.975893] [DEBUG] [LOCAL ] RDY: Trimmed 68377 records to 46012 (keeping 200 days of data) [2025-10-28T20:52:00.028027] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-28T20:52:00.254376] [DEBUG] [LOCAL ] RDY: Primary data saved (46012 records). [2025-10-28T20:52:00.254500] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-28T20:52:00.254836] [INFO ] [MAIN ] Update Progress: 1780/2366 symbols completed. RDY took 36.8s. Estimated remaining: 1h 16m 22s. Rate: 7.7 symbols/min [2025-10-28T20:52:00.423515] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:00.450233] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T20:52:00.492353] [DEBUG] [LOCAL ] REVG: Loaded 39843 existing records from primary storage. [2025-10-28T20:52:00.492635] [INFO ] [MAIN ] REVG: Loaded 39843 existing records. [2025-10-28T20:52:00.663863] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:52:00.664017] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-28T20:52:00.664063] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-28T20:52:00.664491] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-28T20:52:00.664547] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-28T20:52:00.785391] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-28T20:52:01.017128] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:01.097757] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T20:52:01.580258] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-28T20:52:02.107138] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T20:52:02.380266] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-28T20:52:02.919149] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T20:52:03.180286] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-28T20:52:03.828233] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T20:52:03.980212] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-28T20:52:04.229744] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T20:52:04.780254] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-28T20:52:05.356732] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:52:05.580233] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-28T20:52:06.036481] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T20:52:06.380247] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-28T20:52:06.719372] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T20:52:07.180243] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-28T20:52:07.455256] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T20:52:07.980255] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-28T20:52:08.463541] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:52:08.780315] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-28T20:52:09.198519] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T20:52:09.580245] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-28T20:52:09.827951] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T20:52:09.836111] [INFO ] [REMOTE ] RERE: Full fetch complete (58211 records). [2025-10-28T20:52:09.836222] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-28T20:52:10.215368] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-28T20:52:10.215452] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-28T20:52:10.216481] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-28T20:52:10.216543] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-28T20:52:10.217796] [DEBUG] [LOCAL ] RERE: Trimmed 58211 records to 41655 (keeping 200 days of data) [2025-10-28T20:52:10.381684] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-28T20:52:10.449088] [DEBUG] [LOCAL ] RERE: Primary data saved (41655 records). [2025-10-28T20:52:10.449214] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-28T20:52:10.449308] [INFO ] [MAIN ] Update Progress: 1781/2366 symbols completed. RERE took 28.0s. Estimated remaining: 1h 16m 15s. Rate: 7.7 symbols/min [2025-10-28T20:52:10.624167] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:10.624351] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-28T20:52:10.624388] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-28T20:52:10.624500] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-28T20:52:10.624542] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-28T20:52:10.624584] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-28T20:52:10.624615] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-28T20:52:11.001191] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:11.031062] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T20:52:11.180265] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-28T20:52:11.656432] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T20:52:11.923339] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T20:52:11.980257] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-28T20:52:12.631744] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T20:52:12.780263] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-28T20:52:13.580243] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-28T20:52:14.116262] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T20:52:14.380230] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-28T20:52:14.911103] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T20:52:15.180254] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-28T20:52:15.707573] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:52:15.718053] [INFO ] [REMOTE ] RES: Full fetch complete (68745 records). [2025-10-28T20:52:15.718223] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-28T20:52:15.984845] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-28T20:52:16.072946] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T20:52:16.131753] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-28T20:52:16.131826] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-28T20:52:16.132934] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-28T20:52:16.132995] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-28T20:52:16.134281] [DEBUG] [LOCAL ] RES: Trimmed 68745 records to 46787 (keeping 200 days of data) [2025-10-28T20:52:16.392475] [DEBUG] [LOCAL ] RES: Primary data saved (46787 records). [2025-10-28T20:52:16.392594] [INFO ] [MAIN ] RES: Full history saved. [2025-10-28T20:52:16.392686] [INFO ] [MAIN ] Update Progress: 1782/2366 symbols completed. RES took 30.3s. Estimated remaining: 1h 16m 6s. Rate: 7.7 symbols/min [2025-10-28T20:52:16.556619] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:16.556813] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-28T20:52:16.556858] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-28T20:52:16.556986] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-28T20:52:16.557046] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-28T20:52:16.557088] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-28T20:52:16.557119] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-28T20:52:16.785419] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-28T20:52:16.930278] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:17.181342] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T20:52:17.580216] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-28T20:52:17.733952] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T20:52:18.380300] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-28T20:52:19.035033] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T20:52:19.180297] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-28T20:52:19.807393] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T20:52:19.817363] [INFO ] [REMOTE ] RELX: Full fetch complete (68559 records). [2025-10-28T20:52:19.817494] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-28T20:52:19.992323] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-28T20:52:20.237793] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-28T20:52:20.237870] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-28T20:52:20.238911] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-28T20:52:20.238973] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-28T20:52:20.240260] [DEBUG] [LOCAL ] RELX: Trimmed 68559 records to 48428 (keeping 200 days of data) [2025-10-28T20:52:20.524311] [DEBUG] [LOCAL ] RELX: Primary data saved (48428 records). [2025-10-28T20:52:20.524595] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-28T20:52:20.524765] [INFO ] [MAIN ] Update Progress: 1783/2366 symbols completed. RELX took 39.1s. Estimated remaining: 1h 15m 57s. Rate: 7.7 symbols/min [2025-10-28T20:52:20.696183] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:20.696826] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-28T20:52:20.697045] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-28T20:52:20.697523] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-28T20:52:20.697793] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-28T20:52:20.707785] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-28T20:52:20.707880] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-28T20:52:20.773573] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T20:52:20.801953] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T20:52:20.802112] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-28T20:52:21.123512] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:21.580317] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-28T20:52:22.093783] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T20:52:22.380248] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-28T20:52:23.036763] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T20:52:23.180244] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-28T20:52:23.354713] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T20:52:23.980272] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-28T20:52:24.667680] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T20:52:24.776135] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T20:52:24.780198] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-28T20:52:25.485921] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T20:52:25.580260] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-28T20:52:26.322480] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T20:52:26.380208] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-28T20:52:27.180205] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-28T20:52:27.222416] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T20:52:27.980266] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-28T20:52:28.401928] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T20:52:28.780343] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-28T20:52:29.415228] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T20:52:29.580239] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-28T20:52:29.926174] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T20:52:30.380317] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-28T20:52:30.742592] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T20:52:31.181171] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-28T20:52:31.183307] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T20:52:31.189431] [INFO ] [REMOTE ] REX: Full fetch complete (21063 records). [2025-10-28T20:52:31.189588] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-28T20:52:31.553035] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-28T20:52:31.553112] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-28T20:52:31.553573] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-28T20:52:31.553616] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-28T20:52:31.554272] [DEBUG] [LOCAL ] REX: Trimmed 21063 records to 14064 (keeping 200 days of data) [2025-10-28T20:52:31.638320] [DEBUG] [LOCAL ] REX: Primary data saved (14064 records). [2025-10-28T20:52:31.638455] [INFO ] [MAIN ] REX: Full history saved. [2025-10-28T20:52:31.638523] [INFO ] [MAIN ] Update Progress: 1784/2366 symbols completed. REX took 21.2s. Estimated remaining: 1h 15m 51s. Rate: 7.7 symbols/min [2025-10-28T20:52:31.818321] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:31.818505] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-28T20:52:31.818543] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-28T20:52:31.818679] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-28T20:52:31.818737] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-28T20:52:31.818781] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-28T20:52:31.818815] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-28T20:52:31.994253] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-28T20:52:32.210094] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:32.530700] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T20:52:32.780276] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-28T20:52:33.133313] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T20:52:33.140835] [INFO ] [REMOTE ] REVG: Full fetch complete (57840 records). [2025-10-28T20:52:33.140972] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-28T20:52:33.526378] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-28T20:52:33.526452] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-28T20:52:33.527427] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-28T20:52:33.527488] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-28T20:52:33.528589] [DEBUG] [LOCAL ] REVG: Trimmed 57840 records to 39757 (keeping 200 days of data) [2025-10-28T20:52:33.580587] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-28T20:52:33.772381] [DEBUG] [LOCAL ] REVG: Primary data saved (39757 records). [2025-10-28T20:52:33.772529] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-28T20:52:33.772867] [INFO ] [MAIN ] Update Progress: 1785/2366 symbols completed. REVG took 33.5s. Estimated remaining: 1h 15m 41s. Rate: 7.7 symbols/min [2025-10-28T20:52:33.952502] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:33.964765] [DEBUG] [LOCAL ] RFI: Loaded 9914 existing records from primary storage. [2025-10-28T20:52:33.964985] [INFO ] [MAIN ] RFI: Loaded 9914 existing records. [2025-10-28T20:52:34.148571] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:52:34.149011] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-28T20:52:34.149155] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-28T20:52:34.149400] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-28T20:52:34.149461] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-28T20:52:34.385368] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-28T20:52:34.551469] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:34.565572] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T20:52:35.180289] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-28T20:52:35.305560] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T20:52:35.621672] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T20:52:35.980292] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-28T20:52:36.499686] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T20:52:36.780336] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-28T20:52:37.231205] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T20:52:37.580269] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-28T20:52:38.385772] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-28T20:52:38.392486] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T20:52:39.015744] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T20:52:39.180294] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-28T20:52:39.723504] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T20:52:39.980259] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-28T20:52:40.625009] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T20:52:40.780302] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-28T20:52:40.870474] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T20:52:41.580242] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-28T20:52:42.200332] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T20:52:42.380238] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-28T20:52:42.833890] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T20:52:43.071496] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T20:52:43.180218] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-28T20:52:43.980310] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-28T20:52:44.290318] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T20:52:44.638782] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T20:52:44.780265] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-28T20:52:45.481671] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T20:52:45.580272] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-28T20:52:46.380322] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-28T20:52:46.957734] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T20:52:46.968366] [INFO ] [REMOTE ] REXR: Full fetch complete (75348 records). [2025-10-28T20:52:46.968523] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-28T20:52:47.095843] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T20:52:47.185464] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-28T20:52:47.389886] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-28T20:52:47.389981] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-28T20:52:47.391166] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-28T20:52:47.391234] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-28T20:52:47.392758] [DEBUG] [LOCAL ] REXR: Trimmed 75348 records to 52140 (keeping 200 days of data) [2025-10-28T20:52:47.719081] [DEBUG] [LOCAL ] REXR: Primary data saved (52140 records). [2025-10-28T20:52:47.719210] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-28T20:52:47.719280] [INFO ] [MAIN ] Update Progress: 1786/2366 symbols completed. REXR took 31.3s. Estimated remaining: 1h 15m 35s. Rate: 7.7 symbols/min [2025-10-28T20:52:47.896958] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:47.909884] [DEBUG] [LOCAL ] RFL: Loaded 11378 existing records from primary storage. [2025-10-28T20:52:47.910085] [INFO ] [MAIN ] RFL: Loaded 11378 existing records. [2025-10-28T20:52:47.983963] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-28T20:52:48.024262] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T20:52:48.097873] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:52:48.098059] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-28T20:52:48.098157] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-28T20:52:48.098374] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-28T20:52:48.098450] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-28T20:52:48.442131] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:48.780280] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-28T20:52:49.240888] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T20:52:49.580269] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-28T20:52:49.693154] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T20:52:50.203313] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T20:52:50.380260] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-28T20:52:51.180323] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-28T20:52:51.933047] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T20:52:51.955031] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T20:52:51.980219] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-28T20:52:52.780320] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-28T20:52:53.503018] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T20:52:53.580242] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-28T20:52:54.070841] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T20:52:54.206780] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T20:52:54.380268] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-28T20:52:55.180252] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-28T20:52:55.929191] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T20:52:55.980272] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-28T20:52:56.556435] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T20:52:56.586977] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T20:52:56.589469] [INFO ] [REMOTE ] RFI: Full fetch complete (15035 records). [2025-10-28T20:52:56.589552] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-28T20:52:56.785400] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-28T20:52:56.979272] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-28T20:52:56.979347] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-28T20:52:56.979704] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-28T20:52:56.979764] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-28T20:52:56.980234] [DEBUG] [LOCAL ] RFI: Trimmed 15035 records to 9985 (keeping 200 days of data) [2025-10-28T20:52:57.039494] [DEBUG] [LOCAL ] RFI: Primary data saved (9985 records). [2025-10-28T20:52:57.039610] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-28T20:52:57.039720] [INFO ] [MAIN ] Update Progress: 1787/2366 symbols completed. RFI took 23.3s. Estimated remaining: 1h 15m 28s. Rate: 7.7 symbols/min [2025-10-28T20:52:57.208475] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:52:57.214854] [DEBUG] [LOCAL ] RFM: Loaded 4090 existing records from primary storage. [2025-10-28T20:52:57.215018] [INFO ] [MAIN ] RFM: Loaded 4090 existing records. [2025-10-28T20:52:57.387106] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:52:57.387325] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-28T20:52:57.387370] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-28T20:52:57.387567] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-28T20:52:57.387625] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-28T20:52:57.589764] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-28T20:52:57.736198] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:52:58.075275] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T20:52:58.283170] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T20:52:58.380232] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-28T20:52:59.180239] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-28T20:52:59.849425] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T20:52:59.860371] [INFO ] [REMOTE ] RF: Full fetch complete (77798 records). [2025-10-28T20:52:59.860527] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-28T20:52:59.985366] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-28T20:53:00.382537] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-28T20:53:00.382720] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-28T20:53:00.385369] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-28T20:53:00.385518] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-28T20:53:00.387856] [DEBUG] [LOCAL ] RF: Trimmed 77798 records to 53633 (keeping 200 days of data) [2025-10-28T20:53:00.770043] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T20:53:00.780267] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-28T20:53:00.780138] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T20:53:00.974000] [DEBUG] [LOCAL ] RF: Primary data saved (53633 records). [2025-10-28T20:53:00.974201] [INFO ] [MAIN ] RF: Full history saved. [2025-10-28T20:53:00.974339] [INFO ] [MAIN ] Update Progress: 1788/2366 symbols completed. RF took 29.3s. Estimated remaining: 1h 15m 19s. Rate: 7.7 symbols/min [2025-10-28T20:53:01.211121] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:01.221594] [DEBUG] [LOCAL ] RFMZ: Loaded 8929 existing records from primary storage. [2025-10-28T20:53:01.221845] [INFO ] [MAIN ] RFMZ: Loaded 8929 existing records. [2025-10-28T20:53:01.403958] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:53:01.404995] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-28T20:53:01.405055] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-28T20:53:01.405255] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-28T20:53:01.405297] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-28T20:53:01.563341] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T20:53:01.597280] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-28T20:53:01.823979] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:02.211855] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T20:53:02.380253] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-28T20:53:02.751629] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T20:53:03.180242] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-28T20:53:03.629554] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T20:53:03.980241] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-28T20:53:04.780252] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-28T20:53:05.404399] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T20:53:05.431083] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T20:53:05.440401] [INFO ] [REMOTE ] REZI: Full fetch complete (66388 records). [2025-10-28T20:53:05.440523] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-28T20:53:05.585341] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-28T20:53:05.833364] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-28T20:53:05.833467] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-28T20:53:05.834543] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-28T20:53:05.834604] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-28T20:53:05.836160] [DEBUG] [LOCAL ] REZI: Trimmed 66388 records to 47007 (keeping 200 days of data) [2025-10-28T20:53:06.104293] [DEBUG] [LOCAL ] REZI: Primary data saved (47007 records). [2025-10-28T20:53:06.104409] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-28T20:53:06.104498] [INFO ] [MAIN ] Update Progress: 1789/2366 symbols completed. REZI took 45.6s. Estimated remaining: 1h 15m 10s. Rate: 7.7 symbols/min [2025-10-28T20:53:06.214764] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T20:53:06.285157] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:06.285325] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-28T20:53:06.285364] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-28T20:53:06.285474] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-28T20:53:06.285520] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-28T20:53:06.285564] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-28T20:53:06.285617] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-28T20:53:06.385505] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-28T20:53:06.648770] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:07.002200] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T20:53:07.180233] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-28T20:53:07.694482] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T20:53:07.980251] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-28T20:53:08.517626] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T20:53:08.780259] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-28T20:53:09.457574] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:53:09.580239] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-28T20:53:10.380227] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-28T20:53:10.526725] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T20:53:11.180278] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-28T20:53:11.445604] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T20:53:11.800598] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T20:53:11.980292] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-28T20:53:12.780269] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-28T20:53:13.141509] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T20:53:13.344763] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:53:13.580253] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-28T20:53:14.166068] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T20:53:14.380260] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-28T20:53:15.180248] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-28T20:53:15.473789] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T20:53:15.943727] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T20:53:15.980213] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-28T20:53:16.645023] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T20:53:16.648231] [INFO ] [REMOTE ] RFL: Full fetch complete (13290 records). [2025-10-28T20:53:16.648396] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-28T20:53:16.785348] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-28T20:53:17.029679] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-28T20:53:17.029770] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-28T20:53:17.030108] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-28T20:53:17.030149] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-28T20:53:17.030616] [DEBUG] [LOCAL ] RFL: Trimmed 13290 records to 11399 (keeping 200 days of data) [2025-10-28T20:53:17.093814] [DEBUG] [LOCAL ] RFL: Primary data saved (11399 records). [2025-10-28T20:53:17.093947] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-28T20:53:17.094025] [INFO ] [MAIN ] Update Progress: 1790/2366 symbols completed. RFL took 29.4s. Estimated remaining: 1h 15m 3s. Rate: 7.7 symbols/min [2025-10-28T20:53:17.259757] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:17.259918] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-28T20:53:17.259954] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-28T20:53:17.260082] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-28T20:53:17.260122] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-28T20:53:17.260184] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-28T20:53:17.260216] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-28T20:53:17.591047] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-28T20:53:17.613013] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:18.149754] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T20:53:18.265231] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T20:53:18.380240] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-28T20:53:18.931552] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T20:53:19.180266] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-28T20:53:19.709152] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T20:53:19.980256] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-28T20:53:20.780218] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-28T20:53:20.836676] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T20:53:21.331692] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T20:53:21.580232] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-28T20:53:22.126973] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T20:53:22.380326] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-28T20:53:23.180300] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-28T20:53:23.504176] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T20:53:23.701784] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T20:53:23.703204] [INFO ] [REMOTE ] RFM: Full fetch complete (5614 records). [2025-10-28T20:53:23.703273] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-28T20:53:23.985530] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-28T20:53:24.077740] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-28T20:53:24.077821] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-28T20:53:24.078065] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-28T20:53:24.078105] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-28T20:53:24.078480] [DEBUG] [LOCAL ] RFM: Trimmed 5614 records to 4077 (keeping 200 days of data) [2025-10-28T20:53:24.104536] [DEBUG] [LOCAL ] RFM: Primary data saved (4077 records). [2025-10-28T20:53:24.104638] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-28T20:53:24.104761] [INFO ] [MAIN ] Update Progress: 1791/2366 symbols completed. RFM took 27.1s. Estimated remaining: 1h 14m 55s. Rate: 7.7 symbols/min [2025-10-28T20:53:24.298263] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:24.304038] [DEBUG] [LOCAL ] RGT: Loaded 2623 existing records from primary storage. [2025-10-28T20:53:24.304218] [INFO ] [MAIN ] RGT: Loaded 2623 existing records. [2025-10-28T20:53:24.483333] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:53:24.483523] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-28T20:53:24.483569] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-28T20:53:24.483913] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-28T20:53:24.483975] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-28T20:53:24.785379] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-28T20:53:24.839681] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:24.916686] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T20:53:25.580282] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-28T20:53:25.634256] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:53:26.380231] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-28T20:53:26.499101] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T20:53:26.786545] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T20:53:27.180257] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-28T20:53:27.986171] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-28T20:53:27.989259] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:53:28.564144] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T20:53:28.780249] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-28T20:53:29.569754] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T20:53:29.580213] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-28T20:53:30.380313] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-28T20:53:30.495334] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T20:53:31.180274] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-28T20:53:31.446675] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T20:53:31.850962] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T20:53:31.980314] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-28T20:53:32.780272] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-28T20:53:33.032978] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T20:53:33.336403] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T20:53:33.580354] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-28T20:53:33.987999] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T20:53:34.380309] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-28T20:53:35.180260] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-28T20:53:35.255015] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T20:53:35.776334] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T20:53:35.980262] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-28T20:53:36.780247] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-28T20:53:36.983801] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T20:53:36.989796] [INFO ] [REMOTE ] RGA: Full fetch complete (44595 records). [2025-10-28T20:53:36.989921] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-28T20:53:37.291675] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T20:53:37.377617] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-28T20:53:37.377715] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-28T20:53:37.378539] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-28T20:53:37.378579] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-28T20:53:37.379448] [DEBUG] [LOCAL ] RGA: Trimmed 44595 records to 28878 (keeping 200 days of data) [2025-10-28T20:53:37.552630] [DEBUG] [LOCAL ] RGA: Primary data saved (28878 records). [2025-10-28T20:53:37.552774] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-28T20:53:37.552859] [INFO ] [MAIN ] Update Progress: 1792/2366 symbols completed. RGA took 31.4s. Estimated remaining: 1h 14m 49s. Rate: 7.7 symbols/min [2025-10-28T20:53:37.584600] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-28T20:53:37.729486] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:37.729632] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-28T20:53:37.729724] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-28T20:53:37.729831] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-28T20:53:37.729872] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-28T20:53:37.729911] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-28T20:53:37.729943] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-28T20:53:38.082635] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:38.310274] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T20:53:38.312883] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12417 records). [2025-10-28T20:53:38.312950] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-28T20:53:38.385429] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-28T20:53:38.543053] [DEBUG] [REMOTE ] RH: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-28T20:53:38.575115] [WARN ] [REMOTE ] RH: No data returned for month 2025-01 [2025-10-28T20:53:38.580345] [FATAL] [REMOTE ] RH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:53:38.600530] [FATAL] [MAIN ] RH: Failed to fetch primary data. [2025-10-28T20:53:38.603327] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:53:38.603701] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-28T20:53:38.619429] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-28T20:53:38.642981] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-28T20:53:38.659046] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-28T20:53:38.677600] [INFO ] [MAIN ] Update Progress: 1793/2366 symbols completed. RH took 1.1s. Estimated remaining: 1h 14m 39s. Rate: 7.7 symbols/min [2025-10-28T20:53:38.719269] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-28T20:53:38.743691] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-28T20:53:38.764488] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-28T20:53:38.769711] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-28T20:53:38.791074] [DEBUG] [LOCAL ] RFMZ: Trimmed 12417 records to 8852 (keeping 200 days of data) [2025-10-28T20:53:38.906868] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:38.913801] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-28T20:53:38.913882] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8852 records). [2025-10-28T20:53:38.914013] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-28T20:53:38.914149] [INFO ] [MAIN ] Update Progress: 1794/2366 symbols completed. RFMZ took 37.9s. Estimated remaining: 1h 14m 29s. Rate: 7.7 symbols/min [2025-10-28T20:53:38.913950] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-28T20:53:38.937984] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-28T20:53:38.945375] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-28T20:53:38.980709] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-28T20:53:38.995399] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-28T20:53:39.195967] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-28T20:53:39.259617] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:39.294658] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-28T20:53:39.294958] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-28T20:53:39.362412] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-28T20:53:39.367941] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-28T20:53:39.378844] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-28T20:53:39.397296] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-28T20:53:39.627544] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:39.760607] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T20:53:39.836504] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:39.980211] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-10-28T20:53:40.201468] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T20:53:40.201710] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-10-28T20:53:40.201794] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:53:40.201839] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-28T20:53:40.201872] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:53:40.201908] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-28T20:53:40.201958] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-28T20:53:40.201991] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-28T20:53:40.202039] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-28T20:53:40.202083] [INFO ] [MAIN ] Update Progress: 1795/2366 symbols completed. RHLD took 1.3s. Estimated remaining: 1h 14m 19s. Rate: 7.7 symbols/min [2025-10-28T20:53:40.367382] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:40.367512] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-28T20:53:40.367548] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-28T20:53:40.367674] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-28T20:53:40.367727] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-28T20:53:40.367770] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-28T20:53:40.367805] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-28T20:53:40.711020] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:40.780204] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-28T20:53:41.580281] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-28T20:53:41.781465] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T20:53:42.374250] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T20:53:42.380195] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-28T20:53:43.174977] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T20:53:43.180203] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-28T20:53:43.980266] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-28T20:53:44.134074] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T20:53:44.382199] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T20:53:44.780275] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-28T20:53:45.561950] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T20:53:45.566064] [INFO ] [REMOTE ] RGR: Full fetch complete (28781 records). [2025-10-28T20:53:45.566136] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-28T20:53:45.586385] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-28T20:53:45.932177] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-28T20:53:45.932248] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-28T20:53:45.932870] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-28T20:53:45.932931] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-28T20:53:45.933586] [DEBUG] [LOCAL ] RGR: Trimmed 28781 records to 20750 (keeping 200 days of data) [2025-10-28T20:53:46.054196] [DEBUG] [LOCAL ] RGR: Primary data saved (20750 records). [2025-10-28T20:53:46.054309] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-28T20:53:46.054375] [INFO ] [MAIN ] Update Progress: 1796/2366 symbols completed. RGR took 29.0s. Estimated remaining: 1h 14m 11s. Rate: 7.7 symbols/min [2025-10-28T20:53:46.121133] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T20:53:46.228879] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:53:46.277632] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-28T20:53:46.277957] [INFO ] [MAIN ] RIG: Loaded 53675 existing records. [2025-10-28T20:53:46.380429] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-28T20:53:46.461325] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:53:46.461530] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-28T20:53:46.461585] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-28T20:53:46.462020] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-28T20:53:46.462078] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-28T20:53:46.818764] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:53:47.180236] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-28T20:53:47.617683] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T20:53:47.980318] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-28T20:53:48.234795] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T20:53:48.408924] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T20:53:48.780252] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-28T20:53:49.182903] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T20:53:49.580262] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-28T20:53:50.081041] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T20:53:50.380270] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-28T20:53:51.180246] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-28T20:53:51.556971] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T20:53:51.980260] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-28T20:53:52.589471] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T20:53:52.780277] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-28T20:53:53.144387] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T20:53:53.145465] [INFO ] [REMOTE ] RGT: Full fetch complete (3906 records). [2025-10-28T20:53:53.145563] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-28T20:53:53.510463] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-28T20:53:53.510671] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-28T20:53:53.510880] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-28T20:53:53.511048] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-28T20:53:53.511586] [DEBUG] [LOCAL ] RGT: Trimmed 3906 records to 2621 (keeping 200 days of data) [2025-10-28T20:53:53.527090] [DEBUG] [LOCAL ] RGT: Primary data saved (2621 records). [2025-10-28T20:53:53.527208] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-28T20:53:53.527363] [INFO ] [MAIN ] Update Progress: 1797/2366 symbols completed. RGT took 29.4s. Estimated remaining: 1h 14m 3s. Rate: 7.7 symbols/min [2025-10-28T20:53:53.558102] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T20:53:53.580232] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-28T20:53:54.380302] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-28T20:53:55.125659] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T20:53:55.180218] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-28T20:53:55.793488] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:53:55.980255] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-28T20:53:56.708669] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T20:53:56.780259] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-28T20:53:57.236883] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T20:53:57.580247] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-28T20:53:58.316362] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T20:53:58.380220] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-28T20:53:58.989275] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:53:59.180311] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-28T20:53:59.933145] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T20:53:59.980251] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-28T20:54:00.368834] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T20:54:00.780246] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-28T20:54:01.582418] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-28T20:54:01.591182] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T20:54:02.032877] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T20:54:02.380314] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-28T20:54:02.706497] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T20:54:03.180236] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-28T20:54:03.937043] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T20:54:03.980211] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-28T20:54:04.545317] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T20:54:04.780226] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-28T20:54:05.478722] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T20:54:05.580221] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-28T20:54:06.046534] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:54:06.380243] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-28T20:54:07.134249] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T20:54:07.180212] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-28T20:54:07.708056] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T20:54:07.980238] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-28T20:54:08.786465] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-28T20:54:08.805351] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T20:54:08.816536] [INFO ] [REMOTE ] RIG: Full fetch complete (77845 records). [2025-10-28T20:54:08.816695] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-28T20:54:09.217896] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-28T20:54:09.217978] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-28T20:54:09.219174] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-28T20:54:09.219235] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-28T20:54:09.220894] [DEBUG] [LOCAL ] RIG: Trimmed 77845 records to 53675 (keeping 200 days of data) [2025-10-28T20:54:09.452873] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T20:54:09.567797] [DEBUG] [LOCAL ] RIG: Primary data saved (53675 records). [2025-10-28T20:54:09.567934] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-28T20:54:09.568623] [INFO ] [MAIN ] Update Progress: 1798/2366 symbols completed. RIG took 23.5s. Estimated remaining: 1h 13m 57s. Rate: 7.7 symbols/min [2025-10-28T20:54:09.580212] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-28T20:54:09.976224] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T20:54:10.380291] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-28T20:54:10.917472] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T20:54:11.180247] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-28T20:54:11.548850] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T20:54:11.980326] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-28T20:54:12.524043] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T20:54:12.534148] [INFO ] [REMOTE ] RHI: Full fetch complete (71131 records). [2025-10-28T20:54:12.534293] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-28T20:54:12.915967] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-28T20:54:12.916068] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-28T20:54:12.917162] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-28T20:54:12.917225] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-28T20:54:12.918614] [DEBUG] [LOCAL ] RHI: Trimmed 71131 records to 49745 (keeping 200 days of data) [2025-10-28T20:54:13.234605] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T20:54:13.248119] [DEBUG] [LOCAL ] RHI: Primary data saved (49745 records). [2025-10-28T20:54:13.255569] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-28T20:54:13.255976] [INFO ] [MAIN ] Update Progress: 1799/2366 symbols completed. RHI took 34.6s. Estimated remaining: 1h 13m 48s. Rate: 7.7 symbols/min [2025-10-28T20:54:13.256528] [INFO ] [REMOTE ] RHP: Full fetch complete (58204 records). [2025-10-28T20:54:13.256719] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-28T20:54:13.633732] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-28T20:54:13.633815] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-28T20:54:13.634766] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-28T20:54:13.634826] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-28T20:54:13.635974] [DEBUG] [LOCAL ] RHP: Trimmed 58204 records to 39770 (keeping 200 days of data) [2025-10-28T20:54:13.878377] [DEBUG] [LOCAL ] RHP: Primary data saved (39770 records). [2025-10-28T20:54:13.878507] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-28T20:54:13.878577] [INFO ] [MAIN ] Update Progress: 1800/2366 symbols completed. RHP took 33.7s. Estimated remaining: 1h 13m 38s. Rate: 7.7 symbols/min [2025-10-28T20:54:14.501622] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:14.528955] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:14.560908] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:14.595241] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:14.595742] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-28T20:54:14.595787] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-28T20:54:14.595871] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-28T20:54:14.595907] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-28T20:54:14.595978] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-28T20:54:14.596029] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-28T20:54:14.711355] [DEBUG] [LOCAL ] RIV: Loaded 12453 existing records from primary storage. [2025-10-28T20:54:14.712331] [INFO ] [MAIN ] RIV: Loaded 12453 existing records. [2025-10-28T20:54:15.160921] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:54:15.161860] [DEBUG] [LOCAL ] RITM: Loaded 52932 existing records from primary storage. [2025-10-28T20:54:15.173574] [DEBUG] [LOCAL ] RIO: Loaded 53401 existing records from primary storage. [2025-10-28T20:54:15.179278] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-28T20:54:15.183544] [INFO ] [MAIN ] RITM: Loaded 52932 existing records. [2025-10-28T20:54:15.183140] [INFO ] [MAIN ] RIO: Loaded 53401 existing records. [2025-10-28T20:54:15.183601] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-28T20:54:15.268778] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-28T20:54:15.384364] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-28T20:54:15.403796] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:15.497705] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-28T20:54:15.725639] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:54:15.741316] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-28T20:54:15.751696] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-28T20:54:15.795973] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-28T20:54:15.850170] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-28T20:54:15.854634] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:54:15.906137] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-28T20:54:15.992549] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-28T20:54:16.091355] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-28T20:54:16.096618] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-28T20:54:16.515767] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:16.538956] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-28T20:54:16.836165] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:16.846926] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-28T20:54:16.924022] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:16.924408] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-28T20:54:17.020363] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:54:17.029959] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-28T20:54:17.394034] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T20:54:17.397386] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-28T20:54:18.006386] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T20:54:18.009066] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-28T20:54:18.339511] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T20:54:18.383618] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-28T20:54:18.390847] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T20:54:18.473172] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T20:54:18.652223] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T20:54:19.180252] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-28T20:54:19.818246] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T20:54:19.980284] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-28T20:54:20.724615] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T20:54:20.780250] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-28T20:54:21.580322] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-28T20:54:21.724365] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-28T20:54:22.280797] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T20:54:22.380274] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-28T20:54:23.007500] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:54:23.047117] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T20:54:23.180236] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-28T20:54:23.980256] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-28T20:54:24.776382] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T20:54:24.780284] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-28T20:54:25.342977] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:54:25.580218] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-28T20:54:25.679142] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T20:54:26.380327] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-28T20:54:27.049575] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:54:27.180231] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-28T20:54:27.536054] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T20:54:27.980260] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-28T20:54:28.644498] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T20:54:28.780247] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-28T20:54:29.395523] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T20:54:29.420511] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T20:54:29.580338] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-28T20:54:30.380300] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-28T20:54:31.180268] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-28T20:54:31.237709] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T20:54:31.975222] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T20:54:31.980197] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-28T20:54:32.465385] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-28T20:54:32.599687] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T20:54:32.780233] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-28T20:54:33.580260] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-28T20:54:34.385466] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-28T20:54:34.402035] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T20:54:35.087199] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-28T20:54:35.180217] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-28T20:54:35.781234] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T20:54:35.980349] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-28T20:54:36.780248] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-28T20:54:36.823605] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T20:54:36.931843] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T20:54:37.580299] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-28T20:54:38.380281] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-28T20:54:38.588842] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T20:54:39.066508] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T20:54:39.077321] [INFO ] [REMOTE ] RITM: Full fetch complete (76739 records). [2025-10-28T20:54:39.077480] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-28T20:54:39.185465] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-28T20:54:39.503590] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-28T20:54:39.503711] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-28T20:54:39.504915] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-28T20:54:39.504987] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-28T20:54:39.506583] [DEBUG] [LOCAL ] RITM: Trimmed 76739 records to 52926 (keeping 200 days of data) [2025-10-28T20:54:39.932773] [DEBUG] [LOCAL ] RITM: Primary data saved (52926 records). [2025-10-28T20:54:39.948327] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:54:39.946715] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-28T20:54:39.953459] [INFO ] [REMOTE ] RIV: Full fetch complete (17581 records). [2025-10-28T20:54:39.956674] [INFO ] [MAIN ] Update Progress: 1801/2366 symbols completed. RITM took 26.1s. Estimated remaining: 1h 13m 36s. Rate: 7.7 symbols/min [2025-10-28T20:54:39.962402] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-28T20:54:39.990399] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-28T20:54:40.382314] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-28T20:54:40.477746] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:40.758930] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-28T20:54:40.759030] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-28T20:54:40.759424] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-28T20:54:40.759465] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-28T20:54:40.760019] [DEBUG] [LOCAL ] RIV: Trimmed 17581 records to 12416 (keeping 200 days of data) [2025-10-28T20:54:40.792255] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-28T20:54:40.861300] [DEBUG] [LOCAL ] RIV: Primary data saved (12416 records). [2025-10-28T20:54:40.861536] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-28T20:54:40.861683] [INFO ] [MAIN ] Update Progress: 1802/2366 symbols completed. RIV took 27.0s. Estimated remaining: 1h 13m 26s. Rate: 7.7 symbols/min [2025-10-28T20:54:40.863482] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-28T20:54:40.927271] [INFO ] [MAIN ] RKT: Loaded 53729 existing records. [2025-10-28T20:54:41.191089] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:41.206471] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-28T20:54:41.210670] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:54:41.210724] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-28T20:54:41.210874] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-28T20:54:41.210984] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-28T20:54:41.211106] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-28T20:54:41.211055] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-28T20:54:41.211211] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-28T20:54:41.211273] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-28T20:54:41.242463] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-28T20:54:41.273961] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-28T20:54:41.963415] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:41.967586] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:41.968354] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-28T20:54:42.004281] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-28T20:54:42.120252] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T20:54:42.380268] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-28T20:54:43.180323] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-28T20:54:43.485792] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:54:43.980278] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-28T20:54:44.082326] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-28T20:54:44.439298] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T20:54:44.780285] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-28T20:54:45.086882] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T20:54:45.580236] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-28T20:54:46.195419] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T20:54:46.380311] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-28T20:54:46.909173] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:54:46.918917] [INFO ] [REMOTE ] RJF: Full fetch complete (68884 records). [2025-10-28T20:54:46.919104] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-28T20:54:47.185452] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-28T20:54:47.300151] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-28T20:54:47.300223] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-28T20:54:47.301264] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-28T20:54:47.301324] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-28T20:54:47.302543] [DEBUG] [LOCAL ] RJF: Trimmed 68884 records to 46444 (keeping 200 days of data) [2025-10-28T20:54:47.582620] [DEBUG] [LOCAL ] RJF: Primary data saved (46444 records). [2025-10-28T20:54:47.582764] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-28T20:54:47.582838] [INFO ] [MAIN ] Update Progress: 1803/2366 symbols completed. RJF took 33.7s. Estimated remaining: 1h 13m 18s. Rate: 7.7 symbols/min [2025-10-28T20:54:47.758130] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:47.758449] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-28T20:54:47.758524] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-28T20:54:47.758704] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-28T20:54:47.758779] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-28T20:54:47.758976] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-28T20:54:47.759093] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-28T20:54:47.981437] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-28T20:54:48.135008] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:48.185152] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-28T20:54:48.735727] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T20:54:48.780218] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-28T20:54:49.580220] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-28T20:54:49.749937] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-28T20:54:50.246329] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:54:50.380220] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-28T20:54:50.660888] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T20:54:51.180250] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-28T20:54:51.799017] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T20:54:51.980270] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-28T20:54:52.780255] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-28T20:54:52.959610] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T20:54:52.970688] [INFO ] [REMOTE ] RIO: Full fetch complete (77514 records). [2025-10-28T20:54:52.970814] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-28T20:54:53.307353] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T20:54:53.387934] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-28T20:54:53.388011] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-28T20:54:53.389117] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-28T20:54:53.389179] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-28T20:54:53.390574] [DEBUG] [LOCAL ] RIO: Trimmed 77514 records to 53401 (keeping 200 days of data) [2025-10-28T20:54:53.598905] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-28T20:54:53.715692] [DEBUG] [LOCAL ] RIO: Primary data saved (53401 records). [2025-10-28T20:54:53.715841] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-28T20:54:53.715922] [INFO ] [MAIN ] Update Progress: 1804/2366 symbols completed. RIO took 39.8s. Estimated remaining: 1h 13m 10s. Rate: 7.7 symbols/min [2025-10-28T20:54:53.921326] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:54:53.963722] [DEBUG] [LOCAL ] RLJ: Loaded 47747 existing records from primary storage. [2025-10-28T20:54:53.964026] [INFO ] [MAIN ] RLJ: Loaded 47747 existing records. [2025-10-28T20:54:54.146234] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:54:54.146576] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-28T20:54:54.146700] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-28T20:54:54.154421] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-28T20:54:54.167170] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-28T20:54:54.173696] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T20:54:54.389529] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-28T20:54:54.546860] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:54:54.589265] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T20:54:55.180248] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-28T20:54:55.528436] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T20:54:55.980253] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-28T20:54:56.428591] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T20:54:56.780271] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-28T20:54:57.580236] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-28T20:54:57.742961] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T20:54:58.305210] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T20:54:58.380245] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-28T20:54:58.828298] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T20:54:59.180285] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-28T20:54:59.980269] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-28T20:55:00.067262] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T20:55:00.437025] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T20:55:00.780251] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-28T20:55:01.160450] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T20:55:01.580273] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-28T20:55:02.380328] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-28T20:55:02.757580] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-28T20:55:02.935924] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:55:03.180259] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-28T20:55:03.649089] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T20:55:03.980285] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-28T20:55:04.780303] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-28T20:55:04.968031] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-28T20:55:05.190679] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T20:55:05.580272] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-28T20:55:06.165510] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T20:55:06.380254] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-28T20:55:06.909876] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:55:06.916502] [INFO ] [REMOTE ] RL: Full fetch complete (58822 records). [2025-10-28T20:55:06.916673] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-28T20:55:07.185346] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-28T20:55:07.299184] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-28T20:55:07.299256] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-28T20:55:07.300247] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-28T20:55:07.300307] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-28T20:55:07.301945] [DEBUG] [LOCAL ] RL: Trimmed 58822 records to 38681 (keeping 200 days of data) [2025-10-28T20:55:07.554467] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T20:55:07.581082] [DEBUG] [LOCAL ] RL: Primary data saved (38681 records). [2025-10-28T20:55:07.581200] [INFO ] [MAIN ] RL: Full history saved. [2025-10-28T20:55:07.581268] [INFO ] [MAIN ] Update Progress: 1805/2366 symbols completed. RL took 26.7s. Estimated remaining: 1h 13m 4s. Rate: 7.7 symbols/min [2025-10-28T20:55:07.745397] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:07.757734] [DEBUG] [LOCAL ] RLTY: Loaded 10808 existing records from primary storage. [2025-10-28T20:55:07.757941] [INFO ] [MAIN ] RLTY: Loaded 10808 existing records. [2025-10-28T20:55:07.928690] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:07.928899] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-28T20:55:07.928946] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-28T20:55:07.929212] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-28T20:55:07.929271] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-28T20:55:07.990258] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-28T20:55:08.277850] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:08.619151] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:55:08.780257] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-28T20:55:09.320419] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T20:55:09.329989] [INFO ] [REMOTE ] RLI: Full fetch complete (49775 records). [2025-10-28T20:55:09.330237] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-28T20:55:09.589408] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-28T20:55:09.735126] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-28T20:55:09.735252] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-28T20:55:09.737195] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-28T20:55:09.737272] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-28T20:55:09.738941] [DEBUG] [LOCAL ] RLI: Trimmed 49775 records to 34528 (keeping 200 days of data) [2025-10-28T20:55:09.970434] [DEBUG] [LOCAL ] RLI: Primary data saved (34528 records). [2025-10-28T20:55:09.970603] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-28T20:55:09.970704] [INFO ] [MAIN ] Update Progress: 1806/2366 symbols completed. RLI took 22.4s. Estimated remaining: 1h 12m 54s. Rate: 7.7 symbols/min [2025-10-28T20:55:10.137185] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:10.178772] [DEBUG] [LOCAL ] RLX: Loaded 47964 existing records from primary storage. [2025-10-28T20:55:10.179099] [INFO ] [MAIN ] RLX: Loaded 47964 existing records. [2025-10-28T20:55:10.357701] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:10.357900] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-28T20:55:10.357947] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-28T20:55:10.358459] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-28T20:55:10.358515] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-28T20:55:10.402756] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-28T20:55:10.484949] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T20:55:10.745482] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:10.776456] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-28T20:55:11.180277] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-28T20:55:11.963712] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T20:55:11.980219] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-28T20:55:12.406864] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T20:55:12.780259] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-28T20:55:13.251676] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T20:55:13.521548] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T20:55:13.580229] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-28T20:55:14.314119] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T20:55:14.380241] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-28T20:55:15.180271] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-28T20:55:15.885510] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T20:55:15.980241] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-28T20:55:16.112373] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T20:55:16.616363] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T20:55:16.780291] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-28T20:55:17.456546] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T20:55:17.580246] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-28T20:55:18.326809] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T20:55:18.380244] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-28T20:55:18.979397] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T20:55:19.180232] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-28T20:55:19.980373] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-28T20:55:20.388486] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T20:55:20.780307] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-28T20:55:21.422032] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T20:55:21.545160] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T20:55:21.580219] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-28T20:55:22.380243] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-28T20:55:23.033161] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T20:55:23.035805] [INFO ] [REMOTE ] RLTY: Full fetch complete (17225 records). [2025-10-28T20:55:23.035874] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-28T20:55:23.182197] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-28T20:55:23.439881] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-28T20:55:23.440341] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-28T20:55:23.442549] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T20:55:23.440863] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-28T20:55:23.451994] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-28T20:55:23.453092] [DEBUG] [LOCAL ] RLTY: Trimmed 17225 records to 10826 (keeping 200 days of data) [2025-10-28T20:55:23.524277] [DEBUG] [LOCAL ] RLTY: Primary data saved (10826 records). [2025-10-28T20:55:23.524507] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-28T20:55:23.524677] [INFO ] [MAIN ] Update Progress: 1807/2366 symbols completed. RLTY took 15.9s. Estimated remaining: 1h 12m 48s. Rate: 7.7 symbols/min [2025-10-28T20:55:23.698146] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:23.707269] [DEBUG] [LOCAL ] RM: Loaded 7343 existing records from primary storage. [2025-10-28T20:55:23.707468] [INFO ] [MAIN ] RM: Loaded 7343 existing records. [2025-10-28T20:55:23.886355] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:23.886575] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-28T20:55:23.886622] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-28T20:55:23.886825] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-28T20:55:23.886878] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-28T20:55:23.986345] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-28T20:55:24.239973] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:24.678368] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T20:55:24.780265] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-28T20:55:25.222214] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T20:55:25.580292] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-28T20:55:26.249886] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T20:55:26.380252] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-28T20:55:26.467219] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-28T20:55:27.180284] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-28T20:55:27.715568] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T20:55:27.727857] [INFO ] [REMOTE ] RLJ: Full fetch complete (69320 records). [2025-10-28T20:55:27.728057] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-28T20:55:27.990738] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-28T20:55:28.221197] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-28T20:55:28.221308] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-28T20:55:28.222392] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-28T20:55:28.222454] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-28T20:55:28.223787] [DEBUG] [LOCAL ] RLJ: Trimmed 69320 records to 47701 (keeping 200 days of data) [2025-10-28T20:55:28.502059] [DEBUG] [LOCAL ] RLJ: Primary data saved (47701 records). [2025-10-28T20:55:28.502304] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-28T20:55:28.502708] [INFO ] [MAIN ] Update Progress: 1808/2366 symbols completed. RLJ took 34.8s. Estimated remaining: 1h 12m 40s. Rate: 7.7 symbols/min [2025-10-28T20:55:28.702442] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T20:55:28.705594] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:28.737858] [DEBUG] [LOCAL ] RMAX: Loaded 21402 existing records from primary storage. [2025-10-28T20:55:28.738101] [INFO ] [MAIN ] RMAX: Loaded 21402 existing records. [2025-10-28T20:55:28.791350] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-28T20:55:28.917615] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:28.917876] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-28T20:55:28.917933] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-28T20:55:28.918254] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-28T20:55:28.918311] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-28T20:55:29.267797] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:29.580304] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-28T20:55:29.951508] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-28T20:55:29.964462] [INFO ] [REMOTE ] RKT: Full fetch complete (77624 records). [2025-10-28T20:55:29.964632] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-28T20:55:30.367184] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T20:55:30.385608] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-28T20:55:30.394913] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-28T20:55:30.395448] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-28T20:55:30.397488] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-28T20:55:30.398069] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-28T20:55:30.409995] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T20:55:30.410097] [DEBUG] [LOCAL ] RKT: Trimmed 77624 records to 53729 (keeping 200 days of data) [2025-10-28T20:55:30.726488] [DEBUG] [LOCAL ] RKT: Primary data saved (53729 records). [2025-10-28T20:55:30.726623] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-28T20:55:30.726744] [INFO ] [MAIN ] Update Progress: 1809/2366 symbols completed. RKT took 50.8s. Estimated remaining: 1h 12m 30s. Rate: 7.7 symbols/min [2025-10-28T20:55:30.892989] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:30.893096] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-28T20:55:30.893131] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-28T20:55:30.893235] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-28T20:55:30.893275] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-28T20:55:30.893315] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-28T20:55:30.893346] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-28T20:55:31.151083] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T20:55:31.185300] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-28T20:55:31.257584] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:31.894754] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T20:55:31.980304] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-28T20:55:32.780252] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-28T20:55:33.472047] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T20:55:33.580297] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-28T20:55:34.032209] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T20:55:34.380293] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-28T20:55:34.961874] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:55:35.180302] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-28T20:55:35.757736] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T20:55:35.757449] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T20:55:35.980305] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-28T20:55:36.780242] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-28T20:55:37.353989] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:55:37.354701] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T20:55:37.580292] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-28T20:55:38.379008] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T20:55:38.381589] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-28T20:55:39.058906] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T20:55:39.180314] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-28T20:55:39.980251] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-28T20:55:40.328546] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T20:55:40.525607] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T20:55:40.780323] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-28T20:55:41.580249] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-28T20:55:41.924157] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T20:55:42.380259] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-28T20:55:42.646989] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T20:55:43.180314] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-28T20:55:43.794877] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T20:55:43.980302] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-28T20:55:44.432720] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T20:55:44.442593] [INFO ] [REMOTE ] RLX: Full fetch complete (69957 records). [2025-10-28T20:55:44.442782] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-28T20:55:44.786287] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-28T20:55:44.834684] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-28T20:55:44.834897] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-28T20:55:44.836161] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-28T20:55:44.836239] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-28T20:55:44.848752] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T20:55:44.853751] [DEBUG] [LOCAL ] RLX: Trimmed 69957 records to 47925 (keeping 200 days of data) [2025-10-28T20:55:45.130185] [DEBUG] [LOCAL ] RLX: Primary data saved (47925 records). [2025-10-28T20:55:45.130307] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-28T20:55:45.130382] [INFO ] [MAIN ] Update Progress: 1810/2366 symbols completed. RLX took 35.2s. Estimated remaining: 1h 12m 24s. Rate: 7.7 symbols/min [2025-10-28T20:55:45.305184] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:45.312404] [DEBUG] [LOCAL ] RMI: Loaded 4737 existing records from primary storage. [2025-10-28T20:55:45.312594] [INFO ] [MAIN ] RMI: Loaded 4737 existing records. [2025-10-28T20:55:45.417502] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T20:55:45.494276] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:45.494462] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-28T20:55:45.494507] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-28T20:55:45.494759] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-28T20:55:45.494822] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-28T20:55:45.589123] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-28T20:55:45.857406] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:46.286829] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T20:55:46.380251] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-28T20:55:46.790463] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T20:55:47.180265] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-28T20:55:47.688176] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T20:55:47.980250] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-28T20:55:48.780222] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-28T20:55:48.814147] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T20:55:49.580255] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-28T20:55:50.012662] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T20:55:50.078572] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T20:55:50.380249] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-28T20:55:51.180256] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-28T20:55:51.520099] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T20:55:51.596571] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T20:55:51.980283] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-28T20:55:52.780221] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-28T20:55:52.875493] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T20:55:53.270129] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T20:55:53.272255] [INFO ] [REMOTE ] RM: Full fetch complete (11381 records). [2025-10-28T20:55:53.272372] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-28T20:55:53.585453] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-28T20:55:53.657041] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-28T20:55:53.657118] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-28T20:55:53.657422] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-28T20:55:53.657467] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-28T20:55:53.657995] [DEBUG] [LOCAL ] RM: Trimmed 11381 records to 7302 (keeping 200 days of data) [2025-10-28T20:55:53.702158] [DEBUG] [LOCAL ] RM: Primary data saved (7302 records). [2025-10-28T20:55:53.702298] [INFO ] [MAIN ] RM: Full history saved. [2025-10-28T20:55:53.702388] [INFO ] [MAIN ] Update Progress: 1811/2366 symbols completed. RM took 30.2s. Estimated remaining: 1h 12m 17s. Rate: 7.7 symbols/min [2025-10-28T20:55:53.894384] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:53.909094] [DEBUG] [LOCAL ] RMM: Loaded 10696 existing records from primary storage. [2025-10-28T20:55:53.909335] [INFO ] [MAIN ] RMM: Loaded 10696 existing records. [2025-10-28T20:55:54.089363] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:54.089571] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-28T20:55:54.089617] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-28T20:55:54.089859] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-28T20:55:54.089911] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-28T20:55:54.385317] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-28T20:55:54.457228] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:54.562140] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T20:55:54.919960] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T20:55:55.180281] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-28T20:55:55.789076] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T20:55:55.980305] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-28T20:55:56.780252] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-28T20:55:57.304336] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T20:55:57.478198] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T20:55:57.580234] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-28T20:55:58.380232] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-28T20:55:58.415325] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T20:55:58.419355] [INFO ] [REMOTE ] RMAX: Full fetch complete (29747 records). [2025-10-28T20:55:58.419470] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-28T20:55:58.794872] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-28T20:55:58.794956] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-28T20:55:58.795556] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-28T20:55:58.795616] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-28T20:55:58.796505] [DEBUG] [LOCAL ] RMAX: Trimmed 29747 records to 21340 (keeping 200 days of data) [2025-10-28T20:55:58.916013] [DEBUG] [LOCAL ] RMAX: Primary data saved (21340 records). [2025-10-28T20:55:58.916134] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-28T20:55:58.916211] [INFO ] [MAIN ] Update Progress: 1812/2366 symbols completed. RMAX took 30.4s. Estimated remaining: 1h 12m 8s. Rate: 7.7 symbols/min [2025-10-28T20:55:59.086178] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:55:59.093295] [DEBUG] [LOCAL ] RMMZ: Loaded 4722 existing records from primary storage. [2025-10-28T20:55:59.093530] [INFO ] [MAIN ] RMMZ: Loaded 4722 existing records. [2025-10-28T20:55:59.185339] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-28T20:55:59.274482] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:55:59.274710] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-28T20:55:59.274765] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-28T20:55:59.274935] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-28T20:55:59.274974] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-28T20:55:59.654700] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:55:59.740142] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T20:55:59.903075] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:55:59.980214] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-28T20:56:00.780246] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-28T20:56:01.229074] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T20:56:01.329517] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T20:56:01.580296] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-28T20:56:02.128263] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T20:56:02.380243] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-28T20:56:02.881511] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T20:56:03.180235] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-28T20:56:03.980250] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-28T20:56:04.348714] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T20:56:04.357070] [INFO ] [REMOTE ] RMD: Full fetch complete (61712 records). [2025-10-28T20:56:04.357182] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-28T20:56:04.486098] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T20:56:04.744577] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-28T20:56:04.744690] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-28T20:56:04.745755] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-28T20:56:04.745818] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-28T20:56:04.747130] [DEBUG] [LOCAL ] RMD: Trimmed 61712 records to 41643 (keeping 200 days of data) [2025-10-28T20:56:04.802271] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-28T20:56:05.001838] [DEBUG] [LOCAL ] RMD: Primary data saved (41643 records). [2025-10-28T20:56:05.001956] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-28T20:56:05.002023] [INFO ] [MAIN ] Update Progress: 1813/2366 symbols completed. RMD took 34.3s. Estimated remaining: 1h 11m 60s. Rate: 7.7 symbols/min [2025-10-28T20:56:05.169681] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:05.187020] [DEBUG] [LOCAL ] RMT: Loaded 17005 existing records from primary storage. [2025-10-28T20:56:05.187238] [INFO ] [MAIN ] RMT: Loaded 17005 existing records. [2025-10-28T20:56:05.359527] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:56:05.359786] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-28T20:56:05.359840] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-28T20:56:05.360071] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-28T20:56:05.360126] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-28T20:56:05.586353] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-28T20:56:05.586250] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T20:56:05.728706] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:06.124311] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T20:56:06.380236] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-28T20:56:07.180222] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-28T20:56:07.243466] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T20:56:07.623575] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T20:56:07.980227] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-28T20:56:08.420141] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T20:56:08.780256] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-28T20:56:09.500130] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T20:56:09.580250] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-28T20:56:10.368974] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T20:56:10.380205] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-28T20:56:11.180217] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-28T20:56:11.222699] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T20:56:11.761493] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T20:56:11.980289] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-28T20:56:12.476125] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T20:56:12.780238] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-28T20:56:13.526091] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T20:56:13.580218] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-28T20:56:14.139795] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:56:14.380238] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-28T20:56:14.953694] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T20:56:15.180255] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-28T20:56:15.868253] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T20:56:15.980246] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-28T20:56:16.554471] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T20:56:16.556050] [INFO ] [REMOTE ] RMI: Full fetch complete (6191 records). [2025-10-28T20:56:16.556137] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-28T20:56:16.785412] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-28T20:56:16.930998] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-28T20:56:16.931082] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-28T20:56:16.931268] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-28T20:56:16.931309] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-28T20:56:16.931755] [DEBUG] [LOCAL ] RMI: Trimmed 6191 records to 4744 (keeping 200 days of data) [2025-10-28T20:56:16.960983] [DEBUG] [LOCAL ] RMI: Primary data saved (4744 records). [2025-10-28T20:56:16.961117] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-28T20:56:16.961196] [INFO ] [MAIN ] Update Progress: 1814/2366 symbols completed. RMI took 31.8s. Estimated remaining: 1h 11m 53s. Rate: 7.7 symbols/min [2025-10-28T20:56:17.134566] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:17.177826] [DEBUG] [LOCAL ] RNG: Loaded 47862 existing records from primary storage. [2025-10-28T20:56:17.178147] [INFO ] [MAIN ] RNG: Loaded 47862 existing records. [2025-10-28T20:56:17.359307] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:56:17.359505] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-28T20:56:17.359552] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-28T20:56:17.360021] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-28T20:56:17.360078] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-28T20:56:17.580258] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-28T20:56:17.720326] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:17.732847] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T20:56:18.362043] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T20:56:18.380206] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-28T20:56:19.079826] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T20:56:19.180285] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-28T20:56:19.722500] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T20:56:19.980243] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-28T20:56:20.474166] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T20:56:20.780438] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-28T20:56:21.409284] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T20:56:21.580247] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-28T20:56:22.091245] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T20:56:22.380246] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-28T20:56:22.843710] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T20:56:23.180250] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-28T20:56:23.980262] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-28T20:56:24.445315] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T20:56:24.652538] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T20:56:24.655339] [INFO ] [REMOTE ] RMM: Full fetch complete (15001 records). [2025-10-28T20:56:24.655409] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-28T20:56:24.790326] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-28T20:56:25.020290] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-28T20:56:25.020384] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-28T20:56:25.020755] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-28T20:56:25.020817] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-28T20:56:25.021577] [DEBUG] [LOCAL ] RMM: Trimmed 15001 records to 10685 (keeping 200 days of data) [2025-10-28T20:56:25.084504] [DEBUG] [LOCAL ] RMM: Primary data saved (10685 records). [2025-10-28T20:56:25.084620] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-28T20:56:25.084731] [INFO ] [MAIN ] Update Progress: 1815/2366 symbols completed. RMM took 31.4s. Estimated remaining: 1h 11m 45s. Rate: 7.7 symbols/min [2025-10-28T20:56:25.252896] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:25.273343] [DEBUG] [LOCAL ] RNGR: Loaded 20643 existing records from primary storage. [2025-10-28T20:56:25.273575] [INFO ] [MAIN ] RNGR: Loaded 20643 existing records. [2025-10-28T20:56:25.384152] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T20:56:25.407110] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6568 records). [2025-10-28T20:56:25.412425] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-28T20:56:25.563067] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:56:25.563245] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-28T20:56:25.563376] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-28T20:56:25.579466] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-28T20:56:25.589954] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-28T20:56:25.589851] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-28T20:56:26.054681] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-28T20:56:26.060225] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-28T20:56:26.083151] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-28T20:56:26.091017] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-28T20:56:26.093581] [DEBUG] [LOCAL ] RMMZ: Trimmed 6568 records to 4731 (keeping 200 days of data) [2025-10-28T20:56:26.179282] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4731 records). [2025-10-28T20:56:26.195028] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-28T20:56:26.198512] [INFO ] [MAIN ] Update Progress: 1816/2366 symbols completed. RMMZ took 27.3s. Estimated remaining: 1h 11m 36s. Rate: 7.7 symbols/min [2025-10-28T20:56:26.198434] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:26.363181] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:26.379253] [DEBUG] [LOCAL ] RNP: Loaded 15772 existing records from primary storage. [2025-10-28T20:56:26.379465] [INFO ] [MAIN ] RNP: Loaded 15772 existing records. [2025-10-28T20:56:26.390275] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-28T20:56:26.572901] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:56:26.573129] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-28T20:56:26.573176] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-28T20:56:26.573474] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-28T20:56:26.573529] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-28T20:56:26.918745] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:27.024378] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T20:56:27.180212] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-28T20:56:27.234697] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T20:56:27.980218] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-28T20:56:28.586063] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T20:56:28.780339] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-28T20:56:29.164012] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T20:56:29.538730] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T20:56:29.580263] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-28T20:56:30.234609] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T20:56:30.380366] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-28T20:56:31.180292] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-28T20:56:31.719421] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T20:56:31.980267] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-28T20:56:32.062989] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T20:56:32.640631] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T20:56:32.780329] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-28T20:56:33.482403] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T20:56:33.580226] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-28T20:56:34.364630] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T20:56:34.380215] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-28T20:56:35.107278] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T20:56:35.180226] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-28T20:56:35.943346] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T20:56:35.980324] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-28T20:56:36.780281] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-28T20:56:36.931420] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T20:56:37.580227] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-28T20:56:37.593214] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T20:56:38.211017] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T20:56:38.380260] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-28T20:56:39.180266] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-28T20:56:39.204409] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T20:56:39.980280] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-28T20:56:40.411770] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T20:56:40.758151] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T20:56:40.780291] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-28T20:56:41.580256] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-28T20:56:41.962786] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T20:56:42.314871] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T20:56:42.380243] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-28T20:56:43.153282] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T20:56:43.180212] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-28T20:56:43.884152] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:56:43.888342] [INFO ] [REMOTE ] RNP: Full fetch complete (23255 records). [2025-10-28T20:56:43.888439] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-28T20:56:43.985410] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-28T20:56:44.251356] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-28T20:56:44.251428] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-28T20:56:44.251925] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-28T20:56:44.251984] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-28T20:56:44.252545] [DEBUG] [LOCAL ] RNP: Trimmed 23255 records to 15768 (keeping 200 days of data) [2025-10-28T20:56:44.345323] [DEBUG] [LOCAL ] RNP: Primary data saved (15768 records). [2025-10-28T20:56:44.345452] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-28T20:56:44.345525] [INFO ] [MAIN ] Update Progress: 1817/2366 symbols completed. RNP took 18.1s. Estimated remaining: 1h 11m 31s. Rate: 7.7 symbols/min [2025-10-28T20:56:44.529451] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:44.529705] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-28T20:56:44.529761] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-28T20:56:44.529877] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-28T20:56:44.529939] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-28T20:56:44.529981] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-28T20:56:44.530014] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-28T20:56:44.783035] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-28T20:56:44.943142] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:44.955481] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T20:56:45.580286] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-28T20:56:46.172110] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T20:56:46.380351] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-28T20:56:46.842400] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T20:56:47.144666] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T20:56:47.148559] [INFO ] [REMOTE ] RMT: Full fetch complete (25266 records). [2025-10-28T20:56:47.148632] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-28T20:56:47.185406] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-28T20:56:47.522261] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-28T20:56:47.522335] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-28T20:56:47.522868] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-28T20:56:47.522928] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-28T20:56:47.523506] [DEBUG] [LOCAL ] RMT: Trimmed 25266 records to 17002 (keeping 200 days of data) [2025-10-28T20:56:47.618921] [DEBUG] [LOCAL ] RMT: Primary data saved (17002 records). [2025-10-28T20:56:47.619044] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-28T20:56:47.619119] [INFO ] [MAIN ] Update Progress: 1818/2366 symbols completed. RMT took 42.6s. Estimated remaining: 1h 11m 22s. Rate: 7.7 symbols/min [2025-10-28T20:56:47.783920] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:47.784086] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-28T20:56:47.784122] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-28T20:56:47.784225] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-28T20:56:47.784266] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-28T20:56:47.784306] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-28T20:56:47.784340] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-28T20:56:47.993321] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-28T20:56:48.243252] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:48.420734] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T20:56:48.780275] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-28T20:56:49.445474] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T20:56:49.580216] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-28T20:56:49.924566] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T20:56:50.380265] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-28T20:56:50.886407] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T20:56:51.180273] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-28T20:56:51.528440] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T20:56:51.980306] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-28T20:56:52.324111] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:56:52.780225] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-28T20:56:52.835427] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T20:56:53.580294] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-28T20:56:54.002230] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T20:56:54.012078] [INFO ] [REMOTE ] RNG: Full fetch complete (69937 records). [2025-10-28T20:56:54.012190] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-28T20:56:54.384792] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-28T20:56:54.402083] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-28T20:56:54.403297] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-28T20:56:54.404517] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-28T20:56:54.404861] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-28T20:56:54.406292] [DEBUG] [LOCAL ] RNG: Trimmed 69937 records to 47856 (keeping 200 days of data) [2025-10-28T20:56:54.513208] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T20:56:54.693031] [DEBUG] [LOCAL ] RNG: Primary data saved (47856 records). [2025-10-28T20:56:54.693152] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-28T20:56:54.693225] [INFO ] [MAIN ] Update Progress: 1819/2366 symbols completed. RNG took 37.7s. Estimated remaining: 1h 11m 14s. Rate: 7.7 symbols/min [2025-10-28T20:56:54.862904] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:56:54.863039] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-28T20:56:54.863077] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-28T20:56:54.863184] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-28T20:56:54.863245] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-28T20:56:54.863289] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-28T20:56:54.863322] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-28T20:56:55.182936] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-28T20:56:55.218384] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:56:55.669461] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T20:56:55.980280] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-28T20:56:56.349463] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T20:56:56.780304] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-28T20:56:57.213175] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T20:56:57.580302] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-28T20:56:57.897974] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T20:56:58.380272] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-28T20:56:58.405820] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T20:56:59.180302] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-28T20:56:59.662738] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T20:56:59.921956] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T20:56:59.926096] [INFO ] [REMOTE ] RNGR: Full fetch complete (28335 records). [2025-10-28T20:56:59.926168] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-28T20:56:59.986806] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-28T20:57:00.286533] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-28T20:57:00.286604] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-28T20:57:00.287106] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-28T20:57:00.287166] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-28T20:57:00.287817] [DEBUG] [LOCAL ] RNGR: Trimmed 28335 records to 20575 (keeping 200 days of data) [2025-10-28T20:57:00.405846] [DEBUG] [LOCAL ] RNGR: Primary data saved (20575 records). [2025-10-28T20:57:00.405983] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-28T20:57:00.406069] [INFO ] [MAIN ] Update Progress: 1820/2366 symbols completed. RNGR took 35.3s. Estimated remaining: 1h 11m 5s. Rate: 7.7 symbols/min [2025-10-28T20:57:00.573359] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:00.573517] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-28T20:57:00.573554] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-28T20:57:00.573680] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-28T20:57:00.573733] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-28T20:57:00.573775] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-28T20:57:00.573806] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-28T20:57:00.786184] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-28T20:57:00.919961] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:01.279776] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T20:57:01.580226] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-28T20:57:01.638406] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T20:57:02.380305] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-28T20:57:02.873942] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T20:57:03.180262] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-28T20:57:03.552446] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T20:57:03.980234] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-28T20:57:04.046970] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T20:57:04.780257] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-28T20:57:05.149331] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T20:57:05.580320] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-28T20:57:05.670929] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T20:57:06.380310] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-28T20:57:06.764091] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T20:57:07.180313] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-28T20:57:07.443621] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T20:57:07.980273] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-28T20:57:08.536799] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T20:57:08.780254] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-28T20:57:09.070772] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T20:57:09.580250] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-28T20:57:09.942436] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T20:57:10.380309] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-28T20:57:10.995630] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T20:57:11.180218] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-28T20:57:11.335456] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T20:57:11.980258] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-28T20:57:12.608238] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:57:12.780215] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-28T20:57:12.970182] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T20:57:13.580221] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-28T20:57:13.866283] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T20:57:14.335160] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T20:57:14.380314] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-28T20:57:15.180362] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-28T20:57:15.291928] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T20:57:15.980314] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-28T20:57:16.629768] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T20:57:16.780310] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-28T20:57:17.078353] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T20:57:17.580352] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-28T20:57:17.814103] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T20:57:17.821923] [INFO ] [REMOTE ] RNST: Full fetch complete (52796 records). [2025-10-28T20:57:17.822255] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-28T20:57:18.220492] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-28T20:57:18.220602] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-28T20:57:18.221921] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-28T20:57:18.221985] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-28T20:57:18.223468] [DEBUG] [LOCAL ] RNST: Trimmed 52796 records to 35472 (keeping 200 days of data) [2025-10-28T20:57:18.394571] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-28T20:57:18.460919] [DEBUG] [LOCAL ] RNST: Primary data saved (35472 records). [2025-10-28T20:57:18.461138] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-28T20:57:18.461239] [INFO ] [MAIN ] Update Progress: 1821/2366 symbols completed. RNST took 30.8s. Estimated remaining: 1h 11m 0s. Rate: 7.7 symbols/min [2025-10-28T20:57:18.646386] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:18.646714] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-28T20:57:18.646793] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-28T20:57:18.647020] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-28T20:57:18.647073] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-28T20:57:18.647118] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-28T20:57:18.647152] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-28T20:57:19.061606] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:19.088758] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T20:57:19.180290] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-28T20:57:19.566267] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T20:57:19.573693] [INFO ] [REMOTE ] RNR: Full fetch complete (50783 records). [2025-10-28T20:57:19.573893] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-28T20:57:19.972328] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-28T20:57:19.972450] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-28T20:57:19.974069] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-28T20:57:19.974145] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-28T20:57:19.975866] [DEBUG] [LOCAL ] RNR: Trimmed 50783 records to 33055 (keeping 200 days of data) [2025-10-28T20:57:20.035198] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-28T20:57:20.203196] [DEBUG] [LOCAL ] RNR: Primary data saved (33055 records). [2025-10-28T20:57:20.203388] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-28T20:57:20.203475] [INFO ] [MAIN ] Update Progress: 1822/2366 symbols completed. RNR took 35.9s. Estimated remaining: 1h 10m 51s. Rate: 7.7 symbols/min [2025-10-28T20:57:20.386289] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:20.386775] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-28T20:57:20.386849] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-28T20:57:20.386998] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-28T20:57:20.387141] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-28T20:57:20.387349] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-28T20:57:20.387409] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-28T20:57:20.756706] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:20.782134] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-28T20:57:20.788327] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T20:57:20.987294] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T20:57:21.580316] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-28T20:57:21.967119] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T20:57:22.380280] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-28T20:57:22.940952] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T20:57:23.130895] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T20:57:23.180342] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-28T20:57:23.980304] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-28T20:57:24.470324] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T20:57:24.780301] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-28T20:57:25.176257] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T20:57:25.580251] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-28T20:57:26.119480] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T20:57:26.380264] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-28T20:57:27.067273] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T20:57:27.180252] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-28T20:57:27.676182] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T20:57:27.879233] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T20:57:27.882484] [INFO ] [REMOTE ] ROG: Full fetch complete (30662 records). [2025-10-28T20:57:27.882560] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-28T20:57:27.981857] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-28T20:57:28.273900] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-28T20:57:28.273976] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-28T20:57:28.274580] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-28T20:57:28.274621] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-28T20:57:28.275304] [DEBUG] [LOCAL ] ROG: Trimmed 30662 records to 20916 (keeping 200 days of data) [2025-10-28T20:57:28.397984] [DEBUG] [LOCAL ] ROG: Primary data saved (20916 records). [2025-10-28T20:57:28.398160] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-28T20:57:28.398245] [INFO ] [MAIN ] Update Progress: 1823/2366 symbols completed. ROG took 33.7s. Estimated remaining: 1h 10m 43s. Rate: 7.7 symbols/min [2025-10-28T20:57:28.564203] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:28.582849] [DEBUG] [LOCAL ] RPT: Loaded 18695 existing records from primary storage. [2025-10-28T20:57:28.583100] [INFO ] [MAIN ] RPT: Loaded 18695 existing records. [2025-10-28T20:57:28.756969] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:57:28.757195] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-28T20:57:28.757242] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-28T20:57:28.757604] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-28T20:57:28.757707] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-28T20:57:28.787408] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-28T20:57:29.106508] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:29.503477] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T20:57:29.580218] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-28T20:57:30.067676] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T20:57:30.380267] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-28T20:57:30.965211] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T20:57:31.180285] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-28T20:57:31.619303] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T20:57:31.980255] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-28T20:57:32.303567] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T20:57:32.311171] [INFO ] [REMOTE ] ROK: Full fetch complete (62412 records). [2025-10-28T20:57:32.311286] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-28T20:57:32.705608] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-28T20:57:32.705715] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-28T20:57:32.706731] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-28T20:57:32.706791] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-28T20:57:32.707961] [DEBUG] [LOCAL ] ROK: Trimmed 62412 records to 42234 (keeping 200 days of data) [2025-10-28T20:57:32.797936] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-28T20:57:32.971134] [DEBUG] [LOCAL ] ROK: Primary data saved (42234 records). [2025-10-28T20:57:32.971264] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-28T20:57:32.971368] [INFO ] [MAIN ] Update Progress: 1824/2366 symbols completed. ROK took 32.6s. Estimated remaining: 1h 10m 34s. Rate: 7.7 symbols/min [2025-10-28T20:57:33.146707] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:33.176181] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T20:57:33.208696] [DEBUG] [LOCAL ] RQI: Loaded 28409 existing records from primary storage. [2025-10-28T20:57:33.208988] [INFO ] [MAIN ] RQI: Loaded 28409 existing records. [2025-10-28T20:57:33.380384] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:57:33.380565] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-28T20:57:33.380637] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-28T20:57:33.381161] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-28T20:57:33.381221] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-28T20:57:33.591803] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-28T20:57:33.738698] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:34.352999] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T20:57:34.380225] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-28T20:57:34.872822] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T20:57:35.180288] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-28T20:57:35.645825] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T20:57:35.980234] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-28T20:57:36.024582] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T20:57:36.780336] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-28T20:57:37.364563] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T20:57:37.580251] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-28T20:57:37.633336] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T20:57:38.380311] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-28T20:57:38.924034] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T20:57:39.180275] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-28T20:57:39.595841] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T20:57:39.980292] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-28T20:57:40.671784] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T20:57:40.780238] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-28T20:57:40.850159] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T20:57:41.580258] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-28T20:57:41.639189] [DEBUG] [REMOTE ] ROL: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-28T20:57:41.639543] [WARN ] [REMOTE ] ROL: No data returned for month 2025-10 [2025-10-28T20:57:41.639635] [FATAL] [REMOTE ] ROL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T20:57:41.639763] [FATAL] [MAIN ] ROL: Failed to fetch primary data. [2025-10-28T20:57:41.639849] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T20:57:41.639939] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-28T20:57:41.640021] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-28T20:57:41.640062] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-28T20:57:41.640101] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-28T20:57:41.640146] [INFO ] [MAIN ] Update Progress: 1825/2366 symbols completed. ROL took 23.2s. Estimated remaining: 1h 10m 27s. Rate: 7.7 symbols/min [2025-10-28T20:57:41.809330] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:41.809491] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-28T20:57:41.809528] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-28T20:57:41.809638] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-28T20:57:41.809714] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-28T20:57:41.809760] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-28T20:57:41.809797] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-28T20:57:42.187235] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:42.188795] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T20:57:42.380256] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-28T20:57:43.180294] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-28T20:57:43.740239] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T20:57:43.980227] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-28T20:57:44.020320] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T20:57:44.780252] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-28T20:57:45.097012] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T20:57:45.580263] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-28T20:57:46.257110] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T20:57:46.291275] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T20:57:46.380219] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-28T20:57:47.180256] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-28T20:57:47.208976] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T20:57:47.980256] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-28T20:57:48.304582] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T20:57:48.701186] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T20:57:48.780278] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-28T20:57:49.580244] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-28T20:57:49.827724] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T20:57:50.380249] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-28T20:57:50.994119] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T20:57:51.180279] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-28T20:57:51.638674] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T20:57:51.647809] [INFO ] [REMOTE ] RPM: Full fetch complete (59674 records). [2025-10-28T20:57:51.647960] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-28T20:57:51.985423] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-28T20:57:52.063532] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-28T20:57:52.063631] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-28T20:57:52.064733] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-28T20:57:52.064797] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-28T20:57:52.066196] [DEBUG] [LOCAL ] RPM: Trimmed 59674 records to 41739 (keeping 200 days of data) [2025-10-28T20:57:52.322226] [DEBUG] [LOCAL ] RPM: Primary data saved (41739 records). [2025-10-28T20:57:52.322345] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-28T20:57:52.322411] [INFO ] [MAIN ] Update Progress: 1826/2366 symbols completed. RPM took 32.1s. Estimated remaining: 1h 10m 20s. Rate: 7.7 symbols/min [2025-10-28T20:57:52.493104] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:52.493333] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-28T20:57:52.493397] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-28T20:57:52.493520] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-28T20:57:52.493595] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-28T20:57:52.493749] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-28T20:57:52.493794] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-28T20:57:52.787515] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-28T20:57:52.873469] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:52.914756] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T20:57:52.915748] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T20:57:53.580249] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-28T20:57:53.786539] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T20:57:54.380280] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-28T20:57:54.724265] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:57:55.180245] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-28T20:57:55.853500] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T20:57:55.870175] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T20:57:55.980251] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-28T20:57:56.719195] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T20:57:56.722831] [INFO ] [REMOTE ] RPT: Full fetch complete (28136 records). [2025-10-28T20:57:56.722905] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-28T20:57:56.785439] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-28T20:57:57.094561] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-28T20:57:57.094663] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-28T20:57:57.095359] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-28T20:57:57.095422] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-28T20:57:57.096206] [DEBUG] [LOCAL ] RPT: Trimmed 28136 records to 18664 (keeping 200 days of data) [2025-10-28T20:57:57.202020] [DEBUG] [LOCAL ] RPT: Primary data saved (18664 records). [2025-10-28T20:57:57.202154] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-28T20:57:57.202233] [INFO ] [MAIN ] Update Progress: 1827/2366 symbols completed. RPT took 28.8s. Estimated remaining: 1h 10m 11s. Rate: 7.7 symbols/min [2025-10-28T20:57:57.371470] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:57:57.371678] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-28T20:57:57.371733] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-28T20:57:57.371845] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-28T20:57:57.371886] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-28T20:57:57.371926] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-28T20:57:57.371958] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-28T20:57:57.589734] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-28T20:57:57.728288] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:57:58.212409] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T20:57:58.380248] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-28T20:57:58.851107] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T20:57:59.180242] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-28T20:57:59.443675] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T20:57:59.980309] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-28T20:58:00.394334] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T20:58:00.780267] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-28T20:58:01.401294] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T20:58:01.580266] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-28T20:58:02.123463] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T20:58:02.380275] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-28T20:58:02.745858] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T20:58:03.180243] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-28T20:58:03.366613] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T20:58:03.980270] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-28T20:58:04.549983] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T20:58:04.780234] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-28T20:58:05.049842] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T20:58:05.580322] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-28T20:58:05.826766] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T20:58:06.380284] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-28T20:58:06.997858] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T20:58:07.141146] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T20:58:07.180248] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-28T20:58:07.980269] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-28T20:58:08.612697] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T20:58:08.780251] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-28T20:58:09.115144] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T20:58:09.580274] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-28T20:58:09.700184] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T20:58:10.380302] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-28T20:58:10.812204] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T20:58:11.180323] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-28T20:58:11.835462] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T20:58:11.846396] [INFO ] [REMOTE ] RRC: Full fetch complete (76763 records). [2025-10-28T20:58:11.846556] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-28T20:58:11.986411] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-28T20:58:12.247339] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-28T20:58:12.247486] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-28T20:58:12.248679] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-28T20:58:12.248764] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-28T20:58:12.264623] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T20:58:12.271230] [DEBUG] [LOCAL ] RRC: Trimmed 76763 records to 52911 (keeping 200 days of data) [2025-10-28T20:58:12.593087] [DEBUG] [LOCAL ] RRC: Primary data saved (52911 records). [2025-10-28T20:58:12.593231] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-28T20:58:12.593303] [INFO ] [MAIN ] Update Progress: 1828/2366 symbols completed. RRC took 31.0s. Estimated remaining: 1h 10m 6s. Rate: 7.7 symbols/min [2025-10-28T20:58:12.760638] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:12.767388] [DEBUG] [LOCAL ] RSF: Loaded 4184 existing records from primary storage. [2025-10-28T20:58:12.767593] [INFO ] [MAIN ] RSF: Loaded 4184 existing records. [2025-10-28T20:58:12.787930] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-28T20:58:12.943091] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:58:12.943289] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-28T20:58:12.943343] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-28T20:58:12.943563] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-28T20:58:12.943623] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-28T20:58:13.299460] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:13.346175] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T20:58:13.580240] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-28T20:58:13.849716] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T20:58:14.037341] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T20:58:14.380274] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-28T20:58:15.180324] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-28T20:58:15.366716] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T20:58:15.980354] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-28T20:58:16.266959] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T20:58:16.433212] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T20:58:16.780229] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-28T20:58:17.143741] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T20:58:17.580329] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-28T20:58:18.380263] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-28T20:58:18.440737] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T20:58:19.180267] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-28T20:58:19.345022] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T20:58:19.980249] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-28T20:58:20.298212] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T20:58:20.409397] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T20:58:20.780281] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-28T20:58:21.580305] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-28T20:58:21.951047] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T20:58:21.958818] [INFO ] [REMOTE ] RRX: Full fetch complete (58780 records). [2025-10-28T20:58:21.958916] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-28T20:58:22.335302] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-28T20:58:22.335377] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-28T20:58:22.340090] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-28T20:58:22.340208] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-28T20:58:22.341472] [DEBUG] [LOCAL ] RRX: Trimmed 58780 records to 40460 (keeping 200 days of data) [2025-10-28T20:58:22.394894] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-28T20:58:22.595702] [DEBUG] [LOCAL ] RRX: Primary data saved (40460 records). [2025-10-28T20:58:22.595836] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-28T20:58:22.595906] [INFO ] [MAIN ] Update Progress: 1829/2366 symbols completed. RRX took 30.3s. Estimated remaining: 1h 9m 58s. Rate: 7.7 symbols/min [2025-10-28T20:58:22.766195] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:22.766430] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-28T20:58:22.766503] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-28T20:58:22.784232] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-28T20:58:22.784672] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-28T20:58:22.785238] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T20:58:22.785353] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-28T20:58:22.785623] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-28T20:58:23.161271] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:23.180224] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-28T20:58:23.348808] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T20:58:23.354222] [INFO ] [REMOTE ] RS: Full fetch complete (38388 records). [2025-10-28T20:58:23.354370] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-28T20:58:23.740510] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-28T20:58:23.740580] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-28T20:58:23.741328] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-28T20:58:23.741388] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-28T20:58:23.742175] [DEBUG] [LOCAL ] RS: Trimmed 38388 records to 24224 (keeping 200 days of data) [2025-10-28T20:58:23.887831] [DEBUG] [LOCAL ] RS: Primary data saved (24224 records). [2025-10-28T20:58:23.887948] [INFO ] [MAIN ] RS: Full history saved. [2025-10-28T20:58:23.888013] [INFO ] [MAIN ] Update Progress: 1830/2366 symbols completed. RS took 26.7s. Estimated remaining: 1h 9m 49s. Rate: 7.7 symbols/min [2025-10-28T20:58:23.985361] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-28T20:58:24.069061] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:24.111916] [DEBUG] [LOCAL ] RSI: Loaded 46926 existing records from primary storage. [2025-10-28T20:58:24.112193] [INFO ] [MAIN ] RSI: Loaded 46926 existing records. [2025-10-28T20:58:24.295182] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:58:24.295371] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-28T20:58:24.295439] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-28T20:58:24.296126] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-28T20:58:24.296186] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-28T20:58:24.672755] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:24.697369] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T20:58:24.780212] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-28T20:58:24.923249] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T20:58:24.928885] [INFO ] [REMOTE ] RQI: Full fetch complete (42544 records). [2025-10-28T20:58:24.928984] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-28T20:58:25.304587] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-28T20:58:25.304691] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-28T20:58:25.305668] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-28T20:58:25.305731] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-28T20:58:25.306614] [DEBUG] [LOCAL ] RQI: Trimmed 42544 records to 28424 (keeping 200 days of data) [2025-10-28T20:58:25.474293] [DEBUG] [LOCAL ] RQI: Primary data saved (28424 records). [2025-10-28T20:58:25.474418] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-28T20:58:25.474497] [INFO ] [MAIN ] Update Progress: 1831/2366 symbols completed. RQI took 52.5s. Estimated remaining: 1h 9m 39s. Rate: 7.7 symbols/min [2025-10-28T20:58:25.583845] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-28T20:58:25.654608] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:25.685117] [DEBUG] [LOCAL ] RSKD: Loaded 33127 existing records from primary storage. [2025-10-28T20:58:25.685361] [INFO ] [MAIN ] RSKD: Loaded 33127 existing records. [2025-10-28T20:58:25.869066] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:58:25.869278] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-28T20:58:25.869324] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-28T20:58:25.869761] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-28T20:58:25.869817] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-28T20:58:26.143388] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T20:58:26.261742] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:26.287564] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T20:58:26.380203] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-28T20:58:26.848257] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T20:58:27.180257] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-28T20:58:27.760678] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T20:58:27.980237] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-28T20:58:28.780230] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-28T20:58:28.903370] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T20:58:29.580305] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-28T20:58:30.022058] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T20:58:30.380227] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-28T20:58:30.501248] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T20:58:31.180306] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-28T20:58:31.720872] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T20:58:31.980263] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-28T20:58:32.564157] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T20:58:32.780247] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-28T20:58:33.026920] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T20:58:33.580309] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-28T20:58:34.231159] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T20:58:34.380255] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-28T20:58:34.672375] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T20:58:35.180251] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-28T20:58:35.894194] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T20:58:35.980271] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-28T20:58:36.458014] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T20:58:36.780283] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-28T20:58:37.289703] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T20:58:37.352208] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T20:58:37.580259] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-28T20:58:38.380300] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-28T20:58:38.747064] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T20:58:39.180301] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-28T20:58:39.760186] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T20:58:39.980243] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-28T20:58:40.221374] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T20:58:40.327238] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T20:58:40.780253] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-28T20:58:41.580208] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-28T20:58:41.790062] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T20:58:42.380300] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-28T20:58:42.967332] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T20:58:43.180271] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-28T20:58:43.348575] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T20:58:43.689861] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T20:58:43.691265] [INFO ] [REMOTE ] RSF: Full fetch complete (5623 records). [2025-10-28T20:58:43.691337] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-28T20:58:43.988985] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-28T20:58:44.076251] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-28T20:58:44.076325] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-28T20:58:44.076477] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-28T20:58:44.076535] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-28T20:58:44.076929] [DEBUG] [LOCAL ] RSF: Trimmed 5623 records to 4249 (keeping 200 days of data) [2025-10-28T20:58:44.102009] [DEBUG] [LOCAL ] RSF: Primary data saved (4249 records). [2025-10-28T20:58:44.102092] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-28T20:58:44.102163] [INFO ] [MAIN ] Update Progress: 1832/2366 symbols completed. RSF took 31.5s. Estimated remaining: 1h 9m 34s. Rate: 7.7 symbols/min [2025-10-28T20:58:44.271951] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:44.309286] [DEBUG] [LOCAL ] RTO: Loaded 39710 existing records from primary storage. [2025-10-28T20:58:44.309569] [INFO ] [MAIN ] RTO: Loaded 39710 existing records. [2025-10-28T20:58:44.488544] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:58:44.488810] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-28T20:58:44.488879] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-28T20:58:44.489391] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-28T20:58:44.489450] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-28T20:58:44.785369] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-28T20:58:44.848871] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:45.116843] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T20:58:45.580256] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-28T20:58:46.092589] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T20:58:46.380261] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-28T20:58:46.746636] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T20:58:47.180297] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-28T20:58:47.783076] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T20:58:47.980247] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-28T20:58:48.534607] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T20:58:48.780245] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-28T20:58:49.019128] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T20:58:49.580325] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-28T20:58:50.158003] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T20:58:50.168771] [INFO ] [REMOTE ] RSG: Full fetch complete (68412 records). [2025-10-28T20:58:50.169036] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-28T20:58:50.385376] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-28T20:58:50.603635] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-28T20:58:50.603804] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-28T20:58:50.605276] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-28T20:58:50.605357] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-28T20:58:50.607039] [DEBUG] [LOCAL ] RSG: Trimmed 68412 records to 47204 (keeping 200 days of data) [2025-10-28T20:58:50.754704] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T20:58:50.957795] [DEBUG] [LOCAL ] RSG: Primary data saved (47204 records). [2025-10-28T20:58:50.957920] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-28T20:58:50.957989] [INFO ] [MAIN ] Update Progress: 1833/2366 symbols completed. RSG took 28.4s. Estimated remaining: 1h 9m 26s. Rate: 7.7 symbols/min [2025-10-28T20:58:51.124345] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:51.124519] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-28T20:58:51.124556] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-28T20:58:51.124686] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-28T20:58:51.124741] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-28T20:58:51.124782] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-28T20:58:51.124813] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-28T20:58:51.185957] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-28T20:58:51.492240] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:51.509694] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T20:58:51.980269] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-28T20:58:52.545207] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T20:58:52.780320] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-28T20:58:53.018858] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T20:58:53.025584] [INFO ] [REMOTE ] RSKD: Full fetch complete (48561 records). [2025-10-28T20:58:53.025746] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-28T20:58:53.407616] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-28T20:58:53.407745] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-28T20:58:53.408872] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-28T20:58:53.408934] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-28T20:58:53.410074] [DEBUG] [LOCAL ] RSKD: Trimmed 48561 records to 33093 (keeping 200 days of data) [2025-10-28T20:58:53.580707] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-28T20:58:53.601798] [DEBUG] [LOCAL ] RSKD: Primary data saved (33093 records). [2025-10-28T20:58:53.601951] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-28T20:58:53.602039] [INFO ] [MAIN ] Update Progress: 1834/2366 symbols completed. RSKD took 28.1s. Estimated remaining: 1h 9m 17s. Rate: 7.7 symbols/min [2025-10-28T20:58:53.779858] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:53.826595] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T20:58:53.850929] [DEBUG] [LOCAL ] RVLV: Loaded 47137 existing records from primary storage. [2025-10-28T20:58:53.851260] [INFO ] [MAIN ] RVLV: Loaded 47137 existing records. [2025-10-28T20:58:54.034010] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:58:54.034269] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-28T20:58:54.034318] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-28T20:58:54.034881] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-28T20:58:54.034942] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-28T20:58:54.386292] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-28T20:58:54.391441] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:55.170835] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T20:58:55.180864] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-28T20:58:55.640958] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T20:58:55.980232] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-28T20:58:56.538965] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T20:58:56.549003] [INFO ] [REMOTE ] RSI: Full fetch complete (69636 records). [2025-10-28T20:58:56.549136] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-28T20:58:56.785384] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-28T20:58:56.936531] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-28T20:58:56.936620] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-28T20:58:56.937762] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-28T20:58:56.937825] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-28T20:58:56.939152] [DEBUG] [LOCAL ] RSI: Trimmed 69636 records to 46918 (keeping 200 days of data) [2025-10-28T20:58:57.205106] [DEBUG] [LOCAL ] RSI: Primary data saved (46918 records). [2025-10-28T20:58:57.205273] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-28T20:58:57.205360] [INFO ] [MAIN ] Update Progress: 1835/2366 symbols completed. RSI took 33.3s. Estimated remaining: 1h 9m 8s. Rate: 7.7 symbols/min [2025-10-28T20:58:57.376562] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:58:57.404678] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T20:58:57.434561] [DEBUG] [LOCAL ] RVT: Loaded 25758 existing records from primary storage. [2025-10-28T20:58:57.434844] [INFO ] [MAIN ] RVT: Loaded 25758 existing records. [2025-10-28T20:58:57.585395] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-28T20:58:57.613715] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:58:57.613986] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-28T20:58:57.614069] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-28T20:58:57.614470] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-28T20:58:57.614525] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-28T20:58:57.968373] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:58:58.098312] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T20:58:58.380249] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-28T20:58:58.820596] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T20:58:59.180247] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-28T20:58:59.390132] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T20:58:59.980237] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-28T20:59:00.112048] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T20:59:00.780254] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-28T20:59:01.130509] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T20:59:01.580254] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-28T20:59:01.808240] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T20:59:02.380798] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-28T20:59:03.044773] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T20:59:03.180261] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-28T20:59:03.672345] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T20:59:03.980241] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-28T20:59:04.476876] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T20:59:04.780317] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-28T20:59:05.083897] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T20:59:05.580241] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-28T20:59:06.380232] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-28T20:59:06.428672] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T20:59:06.929921] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T20:59:07.180277] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-28T20:59:07.621430] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T20:59:07.980298] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-28T20:59:08.780230] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-28T20:59:08.853986] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T20:59:09.090158] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T20:59:09.580298] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-28T20:59:10.050778] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T20:59:10.380253] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-28T20:59:10.551852] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T20:59:11.180248] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-28T20:59:11.980250] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-28T20:59:12.110094] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-28T20:59:12.121768] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T20:59:12.780267] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-28T20:59:13.136209] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T20:59:13.580230] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-28T20:59:13.636787] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T20:59:14.380316] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-28T20:59:15.180222] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-28T20:59:15.284173] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T20:59:15.350444] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T20:59:15.980263] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-28T20:59:16.333227] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T20:59:16.341704] [INFO ] [REMOTE ] RTO: Full fetch complete (58911 records). [2025-10-28T20:59:16.341830] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-28T20:59:16.719806] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-28T20:59:16.719892] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-28T20:59:16.721122] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-28T20:59:16.721707] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-28T20:59:16.723082] [DEBUG] [LOCAL ] RTO: Trimmed 58911 records to 39664 (keeping 200 days of data) [2025-10-28T20:59:16.783768] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-28T20:59:16.923797] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T20:59:16.994376] [DEBUG] [LOCAL ] RTO: Primary data saved (39664 records). [2025-10-28T20:59:16.994513] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-28T20:59:16.994593] [INFO ] [MAIN ] Update Progress: 1836/2366 symbols completed. RTO took 32.9s. Estimated remaining: 1h 9m 4s. Rate: 7.7 symbols/min [2025-10-28T20:59:17.194819] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:17.194964] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-28T20:59:17.195000] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-28T20:59:17.195108] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-28T20:59:17.195149] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-28T20:59:17.195190] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-28T20:59:17.195223] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-28T20:59:17.579427] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:17.580211] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-28T20:59:18.048424] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T20:59:18.380247] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-28T20:59:18.716471] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:59:19.180223] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-28T20:59:19.285205] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T20:59:19.980255] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-28T20:59:20.446866] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T20:59:20.780253] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-28T20:59:21.580229] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-28T20:59:21.643216] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T20:59:21.648730] [INFO ] [REMOTE ] RVT: Full fetch complete (38879 records). [2025-10-28T20:59:21.648929] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-28T20:59:21.856672] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T20:59:22.070107] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-28T20:59:22.070204] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-28T20:59:22.070984] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-28T20:59:22.071048] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-28T20:59:22.071912] [DEBUG] [LOCAL ] RVT: Trimmed 38879 records to 25721 (keeping 200 days of data) [2025-10-28T20:59:22.222562] [DEBUG] [LOCAL ] RVT: Primary data saved (25721 records). [2025-10-28T20:59:22.222718] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-28T20:59:22.222823] [INFO ] [MAIN ] Update Progress: 1837/2366 symbols completed. RVT took 25.0s. Estimated remaining: 1h 8m 55s. Rate: 7.7 symbols/min [2025-10-28T20:59:22.380239] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-28T20:59:22.928594] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T20:59:23.180241] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-28T20:59:23.767140] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T20:59:23.980288] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-28T20:59:24.709366] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T20:59:24.780210] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-28T20:59:25.589263] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-28T20:59:25.594709] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T20:59:26.249414] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T20:59:26.380283] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-28T20:59:26.928516] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T20:59:26.937728] [INFO ] [REMOTE ] RVLV: Full fetch complete (68840 records). [2025-10-28T20:59:26.937889] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-28T20:59:27.197677] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-28T20:59:27.330962] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-28T20:59:27.331195] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-28T20:59:27.332359] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-28T20:59:27.332423] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-28T20:59:27.333864] [DEBUG] [LOCAL ] RVLV: Trimmed 68840 records to 47068 (keeping 200 days of data) [2025-10-28T20:59:27.605147] [DEBUG] [LOCAL ] RVLV: Primary data saved (47068 records). [2025-10-28T20:59:27.605272] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-28T20:59:27.605351] [INFO ] [MAIN ] Update Progress: 1838/2366 symbols completed. RVLV took 34.0s. Estimated remaining: 1h 8m 47s. Rate: 7.7 symbols/min [2025-10-28T20:59:27.687772] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T20:59:27.980300] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-28T20:59:28.812750] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T20:59:28.823972] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-28T20:59:29.127343] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T20:59:29.428976] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T20:59:29.439324] [INFO ] [REMOTE ] RTX: Full fetch complete (77488 records). [2025-10-28T20:59:29.439452] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-28T20:59:29.440150] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T20:59:29.440236] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:59:29.440290] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:59:29.440361] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-28T20:59:29.440424] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-28T20:59:29.440459] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-28T20:59:29.440498] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-28T20:59:29.440552] [INFO ] [MAIN ] Update Progress: 1839/2366 symbols completed. RTX took 38.5s. Estimated remaining: 1h 8m 37s. Rate: 7.7 symbols/min [2025-10-28T20:59:29.580253] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-28T20:59:30.952957] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T20:59:30.963812] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-28T20:59:32.247145] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T20:59:32.263967] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-28T20:59:33.505089] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T20:59:33.515174] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-28T20:59:34.814537] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T20:59:34.824220] [INFO ] [REMOTE ] RVTY: Full fetch complete (68383 records). [2025-10-28T20:59:34.824327] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-28T20:59:35.200533] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-28T20:59:35.200608] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-28T20:59:35.201672] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-28T20:59:35.201756] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-28T20:59:35.202957] [DEBUG] [LOCAL ] RVTY: Trimmed 68383 records to 47719 (keeping 200 days of data) [2025-10-28T20:59:35.492049] [DEBUG] [LOCAL ] RVTY: Primary data saved (47719 records). [2025-10-28T20:59:35.492194] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-28T20:59:35.492282] [INFO ] [MAIN ] Update Progress: 1840/2366 symbols completed. RVTY took 18.5s. Estimated remaining: 1h 8m 29s. Rate: 7.7 symbols/min [2025-10-28T20:59:36.076811] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:36.132815] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:36.169054] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-28T20:59:36.179372] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:36.197555] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:36.179443] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-28T20:59:36.197800] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-28T20:59:36.196737] [DEBUG] [LOCAL ] RWT: No existing data file found in primary storage. [2025-10-28T20:59:36.197931] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-28T20:59:36.198296] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-28T20:59:36.198229] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-28T20:59:36.198745] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-28T20:59:36.179682] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-28T20:59:36.198585] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-28T20:59:36.199145] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-28T20:59:36.198543] [WARN ] [MAIN ] RWT: No existing data found, performing full refresh instead. [2025-10-28T20:59:36.199069] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-28T20:59:36.199431] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-28T20:59:36.199802] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-28T20:59:36.199589] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-28T20:59:36.212610] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-28T20:59:36.236380] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-28T20:59:36.212772] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-28T20:59:36.222527] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-28T20:59:36.310063] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-28T20:59:36.341007] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-28T20:59:36.373816] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-28T20:59:36.373918] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-28T20:59:37.436589] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:37.448371] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-28T20:59:37.441757] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:37.468373] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-10-28T20:59:37.621486] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:37.637293] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-28T20:59:37.694802] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:37.695107] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-28T20:59:38.022820] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T20:59:38.024593] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-10-28T20:59:38.031350] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T20:59:38.033513] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-28T20:59:38.236372] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T20:59:38.237617] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-28T20:59:38.402354] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T20:59:38.403818] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-28T20:59:38.530519] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T20:59:38.630046] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T20:59:38.814176] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T20:59:38.830939] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T20:59:39.180270] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-28T20:59:39.638782] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T20:59:39.980261] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-28T20:59:40.345414] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T20:59:40.780289] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-28T20:59:41.138717] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T20:59:41.580262] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-28T20:59:41.961671] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T20:59:42.380299] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-28T20:59:43.180268] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-10-28T20:59:43.595107] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T20:59:43.653814] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T20:59:43.980258] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-28T20:59:44.355717] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T20:59:44.780259] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-28T20:59:45.103903] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-28T20:59:45.580268] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-10-28T20:59:46.035815] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T20:59:46.380256] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-28T20:59:46.894136] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T20:59:47.180244] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-28T20:59:47.675671] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T20:59:47.980279] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-28T20:59:48.420227] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T20:59:48.780305] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-28T20:59:49.085787] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T20:59:49.580255] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-28T20:59:49.905099] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T20:59:50.380232] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-28T20:59:50.840004] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T20:59:51.180258] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-28T20:59:51.599708] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T20:59:51.600730] [INFO ] [REMOTE ] RWTO: Full fetch complete (4783 records). [2025-10-28T20:59:51.600797] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-28T20:59:51.789059] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T20:59:51.789276] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:59:51.789360] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:59:51.789452] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-28T20:59:51.789530] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-28T20:59:51.789567] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-28T20:59:51.789605] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-28T20:59:51.789683] [INFO ] [MAIN ] Update Progress: 1841/2366 symbols completed. RWTO took 16.3s. Estimated remaining: 1h 8m 23s. Rate: 7.7 symbols/min [2025-10-28T20:59:51.958777] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:51.958958] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-28T20:59:51.958994] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-28T20:59:51.959126] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-28T20:59:51.959192] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-28T20:59:51.959243] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-28T20:59:51.959276] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-28T20:59:51.990307] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-10-28T20:59:52.326082] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:52.485329] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T20:59:52.780276] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-28T20:59:53.160284] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T20:59:53.580257] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-28T20:59:54.380246] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-28T20:59:54.784080] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T20:59:55.180256] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-28T20:59:55.497124] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T20:59:55.498164] [INFO ] [REMOTE ] RWTN: Full fetch complete (3185 records). [2025-10-28T20:59:55.498234] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-28T20:59:55.714497] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T20:59:55.755951] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T20:59:55.757529] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T20:59:55.757624] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T20:59:55.757726] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-28T20:59:55.757792] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-28T20:59:55.757831] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-28T20:59:55.757872] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-28T20:59:55.757953] [INFO ] [MAIN ] Update Progress: 1842/2366 symbols completed. RWTN took 20.3s. Estimated remaining: 1h 8m 14s. Rate: 7.7 symbols/min [2025-10-28T20:59:55.962752] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T20:59:55.988414] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-28T20:59:56.011389] [DEBUG] [LOCAL ] RY: Loaded 47292 existing records from primary storage. [2025-10-28T20:59:56.011783] [INFO ] [MAIN ] RY: Loaded 47292 existing records. [2025-10-28T20:59:56.182713] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T20:59:56.182912] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-28T20:59:56.182957] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-28T20:59:56.183564] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-28T20:59:56.183624] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-28T20:59:56.544287] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T20:59:56.780273] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-28T20:59:57.422807] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T20:59:57.580279] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-28T20:59:58.004834] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T20:59:58.380269] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-28T20:59:58.718154] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T20:59:59.180255] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-28T20:59:59.539226] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T20:59:59.980281] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-10-28T21:00:00.415008] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T21:00:00.416551] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:00:00.780240] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-28T21:00:01.580307] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-28T21:00:02.007954] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T21:00:02.380255] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-10-28T21:00:02.831178] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T21:00:03.153824] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T21:00:03.180256] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-28T21:00:03.980256] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-10-28T21:00:04.780238] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-28T21:00:04.867472] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T21:00:04.966729] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T21:00:05.580245] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-10-28T21:00:06.062864] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T21:00:06.170290] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T21:00:06.380323] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-28T21:00:07.180254] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-28T21:00:07.882517] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T21:00:07.980264] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-28T21:00:08.437931] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T21:00:08.780256] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-10. [2025-10-28T21:00:09.210964] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T21:00:09.211914] [INFO ] [REMOTE ] RWTP: Full fetch complete (4740 records). [2025-10-28T21:00:09.211982] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-10-28T21:00:09.417569] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-28T21:00:09.417856] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:00:09.417934] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:00:09.418120] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-28T21:00:09.418243] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-28T21:00:09.418290] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-28T21:00:09.418350] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-28T21:00:09.418408] [INFO ] [MAIN ] Update Progress: 1843/2366 symbols completed. RWTP took 33.9s. Estimated remaining: 1h 8m 8s. Rate: 7.7 symbols/min [2025-10-28T21:00:09.589787] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-28T21:00:09.592381] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:09.626044] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T21:00:09.662223] [DEBUG] [LOCAL ] RYAM: Loaded 34795 existing records from primary storage. [2025-10-28T21:00:09.662493] [INFO ] [MAIN ] RYAM: Loaded 34795 existing records. [2025-10-28T21:00:09.843609] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:00:09.843863] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-28T21:00:09.843911] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-28T21:00:09.844306] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-28T21:00:09.844363] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-28T21:00:10.206830] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:10.380241] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-28T21:00:11.032283] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T21:00:11.180262] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-28T21:00:11.311309] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T21:00:11.980310] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-28T21:00:12.374766] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T21:00:12.780266] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-28T21:00:12.849170] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T21:00:13.580307] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-28T21:00:14.380289] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-28T21:00:14.502075] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T21:00:15.072792] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T21:00:15.180310] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-28T21:00:15.980266] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-28T21:00:16.021721] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T21:00:16.029343] [INFO ] [REMOTE ] RWT: Full fetch complete (58170 records). [2025-10-28T21:00:16.029438] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-28T21:00:16.414050] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-28T21:00:16.414156] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-28T21:00:16.415458] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-28T21:00:16.415601] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-28T21:00:16.417373] [DEBUG] [LOCAL ] RWT: Trimmed 58170 records to 40088 (keeping 200 days of data) [2025-10-28T21:00:16.564228] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T21:00:16.688471] [DEBUG] [LOCAL ] RWT: Primary data saved (40088 records). [2025-10-28T21:00:16.688588] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-28T21:00:16.688683] [INFO ] [MAIN ] Update Progress: 1844/2366 symbols completed. RWT took 41.2s. Estimated remaining: 1h 8m 0s. Rate: 7.7 symbols/min [2025-10-28T21:00:16.785427] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-28T21:00:16.855757] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:16.855907] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-28T21:00:16.855965] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-28T21:00:16.856075] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-28T21:00:16.856117] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-28T21:00:16.856157] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-28T21:00:16.856187] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-28T21:00:17.217106] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T21:00:17.235765] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:17.580235] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-28T21:00:18.034970] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T21:00:18.380253] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-28T21:00:18.973963] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T21:00:19.180258] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-28T21:00:19.568320] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T21:00:19.980240] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-28T21:00:20.516967] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:00:20.780313] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-28T21:00:21.350627] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T21:00:21.580256] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-28T21:00:22.204529] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T21:00:22.380260] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-28T21:00:22.516402] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T21:00:23.180255] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-28T21:00:23.623916] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:00:23.980296] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-28T21:00:24.522170] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T21:00:24.532343] [INFO ] [REMOTE ] RXO: Full fetch complete (69074 records). [2025-10-28T21:00:24.532501] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-28T21:00:24.791178] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-28T21:00:24.930542] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-28T21:00:24.930617] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-28T21:00:24.931800] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-28T21:00:24.931862] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-28T21:00:24.933144] [DEBUG] [LOCAL ] RXO: Trimmed 69074 records to 48288 (keeping 200 days of data) [2025-10-28T21:00:25.215314] [DEBUG] [LOCAL ] RXO: Primary data saved (48288 records). [2025-10-28T21:00:25.215476] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-28T21:00:25.215554] [INFO ] [MAIN ] Update Progress: 1845/2366 symbols completed. RXO took 33.4s. Estimated remaining: 1h 7m 53s. Rate: 7.7 symbols/min [2025-10-28T21:00:25.388664] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:25.417263] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T21:00:25.442016] [DEBUG] [LOCAL ] RYI: Loaded 21465 existing records from primary storage. [2025-10-28T21:00:25.442260] [INFO ] [MAIN ] RYI: Loaded 21465 existing records. [2025-10-28T21:00:25.589106] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-28T21:00:25.620584] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:00:25.620781] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-28T21:00:25.620828] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-28T21:00:25.621153] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-28T21:00:25.621213] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-28T21:00:25.934739] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T21:00:25.995324] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:26.380215] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-28T21:00:26.936939] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T21:00:26.945903] [INFO ] [REMOTE ] RY: Full fetch complete (69172 records). [2025-10-28T21:00:26.946023] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-28T21:00:27.190717] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-28T21:00:27.328265] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-28T21:00:27.328338] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-28T21:00:27.329392] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-28T21:00:27.329453] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-28T21:00:27.330803] [DEBUG] [LOCAL ] RY: Trimmed 69172 records to 47237 (keeping 200 days of data) [2025-10-28T21:00:27.594895] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:00:27.655155] [DEBUG] [LOCAL ] RY: Primary data saved (47237 records). [2025-10-28T21:00:27.655295] [INFO ] [MAIN ] RY: Full history saved. [2025-10-28T21:00:27.655399] [INFO ] [MAIN ] Update Progress: 1846/2366 symbols completed. RY took 31.9s. Estimated remaining: 1h 7m 43s. Rate: 7.7 symbols/min [2025-10-28T21:00:27.823297] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:27.823450] [DEBUG] [LOCAL ] RYN: No existing data file found in primary storage. [2025-10-28T21:00:27.823488] [WARN ] [MAIN ] RYN: No existing data found, performing full refresh instead. [2025-10-28T21:00:27.823600] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-28T21:00:27.823662] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-28T21:00:27.823746] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-28T21:00:27.823793] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-28T21:00:27.997981] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-28T21:00:28.190927] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:28.209745] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T21:00:28.780357] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-28T21:00:29.156978] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T21:00:29.580274] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-28T21:00:29.769232] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T21:00:30.380237] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-28T21:00:30.965195] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T21:00:31.180687] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-28T21:00:31.180580] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T21:00:31.980274] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-28T21:00:32.381180] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T21:00:32.742970] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T21:00:32.780214] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-28T21:00:33.580316] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-28T21:00:34.126929] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T21:00:34.380267] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-28T21:00:34.969941] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T21:00:35.137054] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T21:00:35.180267] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-28T21:00:35.980224] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-28T21:00:36.089431] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T21:00:36.780249] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-28T21:00:37.253912] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:00:37.580285] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-28T21:00:37.832953] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T21:00:38.380305] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-28T21:00:38.652861] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T21:00:39.180259] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-28T21:00:39.436890] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T21:00:39.980250] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-28T21:00:40.375808] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:00:40.780232] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-28T21:00:40.933034] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T21:00:41.580252] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-28T21:00:41.802465] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T21:00:41.809393] [INFO ] [REMOTE ] RYAM: Full fetch complete (49234 records). [2025-10-28T21:00:41.809504] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-28T21:00:42.183261] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-28T21:00:42.183367] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-28T21:00:42.184344] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-28T21:00:42.184406] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-28T21:00:42.185420] [DEBUG] [LOCAL ] RYAM: Trimmed 49234 records to 34710 (keeping 200 days of data) [2025-10-28T21:00:42.378321] [DEBUG] [LOCAL ] RYAM: Primary data saved (34710 records). [2025-10-28T21:00:42.378452] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-28T21:00:42.378529] [INFO ] [MAIN ] Update Progress: 1847/2366 symbols completed. RYAM took 33.0s. Estimated remaining: 1h 7m 37s. Rate: 7.7 symbols/min [2025-10-28T21:00:42.399069] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-28T21:00:42.550480] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:42.558251] [DEBUG] [LOCAL ] RZB: Loaded 5780 existing records from primary storage. [2025-10-28T21:00:42.558470] [INFO ] [MAIN ] RZB: Loaded 5780 existing records. [2025-10-28T21:00:42.738476] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:00:42.738803] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-28T21:00:42.738887] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-28T21:00:42.739161] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-28T21:00:42.739228] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-28T21:00:43.098706] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:43.125498] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T21:00:43.180244] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-28T21:00:43.241064] [DEBUG] [REMOTE ] RZB: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-28T21:00:43.241387] [WARN ] [REMOTE ] RZB: No data returned for month 2025-01 [2025-10-28T21:00:43.241482] [FATAL] [REMOTE ] RZB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:00:43.241554] [FATAL] [MAIN ] RZB: Failed to fetch primary data. [2025-10-28T21:00:43.241622] [WARN ] [MAIN ] RZB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:00:43.241739] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-28T21:00:43.241846] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-28T21:00:43.241902] [INFO ] [LOCAL ] RZB: Starting deletion of derivative data. [2025-10-28T21:00:43.242066] [DEBUG] [LOCAL ] RZB: Deleted derivative data file. [2025-10-28T21:00:43.242158] [INFO ] [MAIN ] Update Progress: 1848/2366 symbols completed. RZB took 0.9s. Estimated remaining: 1h 7m 28s. Rate: 7.7 symbols/min [2025-10-28T21:00:43.414804] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:43.428191] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T21:00:43.440491] [DEBUG] [LOCAL ] RZC: Loaded 6300 existing records from primary storage. [2025-10-28T21:00:43.440740] [INFO ] [MAIN ] RZC: Loaded 6300 existing records. [2025-10-28T21:00:43.620551] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:00:43.620776] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-28T21:00:43.620826] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-28T21:00:43.621032] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-28T21:00:43.621089] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-28T21:00:43.968408] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:43.980223] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-28T21:00:44.780246] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-28T21:00:45.130386] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T21:00:45.580445] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-28T21:00:45.620997] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T21:00:45.625371] [INFO ] [REMOTE ] RYI: Full fetch complete (31723 records). [2025-10-28T21:00:45.625445] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-28T21:00:45.987055] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-28T21:00:45.987148] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-28T21:00:45.987768] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-28T21:00:45.987827] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-28T21:00:45.988540] [DEBUG] [LOCAL ] RYI: Trimmed 31723 records to 21393 (keeping 200 days of data) [2025-10-28T21:00:46.112710] [DEBUG] [LOCAL ] RYI: Primary data saved (21393 records). [2025-10-28T21:00:46.112826] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-28T21:00:46.112899] [INFO ] [MAIN ] Update Progress: 1849/2366 symbols completed. RYI took 20.9s. Estimated remaining: 1h 7m 18s. Rate: 7.7 symbols/min [2025-10-28T21:00:46.269064] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T21:00:46.285681] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:46.337363] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-28T21:00:46.337693] [INFO ] [MAIN ] S: Loaded 53536 existing records. [2025-10-28T21:00:46.389799] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-28T21:00:46.517110] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:00:46.517400] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-28T21:00:46.517452] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-28T21:00:46.518023] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-28T21:00:46.518080] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-28T21:00:46.860445] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:47.180233] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-28T21:00:47.635187] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T21:00:47.725821] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T21:00:47.980316] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-28T21:00:48.780294] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-28T21:00:49.307390] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T21:00:49.398594] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:00:49.580252] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-28T21:00:50.380245] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-28T21:00:50.838422] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T21:00:51.180290] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-28T21:00:51.980224] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-28T21:00:52.081607] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T21:00:52.388340] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T21:00:52.780247] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-28T21:00:53.309250] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T21:00:53.580243] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-28T21:00:54.304463] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T21:00:54.380212] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-28T21:00:55.021820] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:00:55.033014] [INFO ] [REMOTE ] RYAN: Full fetch complete (64917 records). [2025-10-28T21:00:55.033258] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-28T21:00:55.182592] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-28T21:00:55.423592] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-28T21:00:55.423695] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-28T21:00:55.424891] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-28T21:00:55.424953] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-28T21:00:55.426280] [DEBUG] [LOCAL ] RYAN: Trimmed 64917 records to 44909 (keeping 200 days of data) [2025-10-28T21:00:55.691896] [DEBUG] [LOCAL ] RYAN: Primary data saved (44909 records). [2025-10-28T21:00:55.692023] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-28T21:00:55.692093] [INFO ] [MAIN ] Update Progress: 1850/2366 symbols completed. RYAN took 39.0s. Estimated remaining: 1h 7m 11s. Rate: 7.7 symbols/min [2025-10-28T21:00:55.868854] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:00:55.876431] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T21:00:55.919276] [DEBUG] [LOCAL ] SA: Loaded 44537 existing records from primary storage. [2025-10-28T21:00:55.919637] [INFO ] [MAIN ] SA: Loaded 44537 existing records. [2025-10-28T21:00:55.992891] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-28T21:00:56.102593] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:00:56.102942] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-28T21:00:56.103007] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-28T21:00:56.103625] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-28T21:00:56.103718] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-28T21:00:56.255259] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T21:00:56.495131] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:00:56.572161] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T21:00:56.780251] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-28T21:00:57.396350] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T21:00:57.580245] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-28T21:00:58.380276] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-28T21:00:58.941718] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T21:00:59.054760] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T21:00:59.180278] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-28T21:00:59.980292] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-28T21:01:00.398180] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:01:00.461709] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T21:01:00.780261] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-28T21:01:01.329771] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:01:01.580292] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-28T21:01:02.380337] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-28T21:01:02.860562] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T21:01:02.862227] [INFO ] [REMOTE ] RZC: Full fetch complete (9507 records). [2025-10-28T21:01:02.862296] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-28T21:01:03.185394] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-28T21:01:03.225593] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-28T21:01:03.225727] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-28T21:01:03.226035] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-28T21:01:03.226098] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-28T21:01:03.226502] [DEBUG] [LOCAL ] RZC: Trimmed 9507 records to 6222 (keeping 200 days of data) [2025-10-28T21:01:03.264713] [DEBUG] [LOCAL ] RZC: Primary data saved (6222 records). [2025-10-28T21:01:03.264810] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-28T21:01:03.264884] [INFO ] [MAIN ] Update Progress: 1851/2366 symbols completed. RZC took 20.0s. Estimated remaining: 1h 7m 3s. Rate: 7.7 symbols/min [2025-10-28T21:01:03.431634] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:03.442566] [DEBUG] [LOCAL ] SABA: Loaded 9051 existing records from primary storage. [2025-10-28T21:01:03.442948] [INFO ] [MAIN ] SABA: Loaded 9051 existing records. [2025-10-28T21:01:03.625952] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:01:03.626230] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-28T21:01:03.626308] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-28T21:01:03.626516] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-28T21:01:03.626571] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-28T21:01:03.844616] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-28T21:01:03.985314] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-28T21:01:04.061860] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:04.412225] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T21:01:04.780255] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-28T21:01:05.580247] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-28T21:01:05.808714] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T21:01:06.065741] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T21:01:06.380285] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-28T21:01:06.606117] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T21:01:07.180272] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-28T21:01:07.725180] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T21:01:07.980259] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-28T21:01:08.391175] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:01:08.780259] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-28T21:01:09.452135] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T21:01:09.580256] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-28T21:01:09.899843] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T21:01:10.380277] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-28T21:01:10.743163] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T21:01:11.180265] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-28T21:01:11.713698] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T21:01:11.723236] [INFO ] [REMOTE ] RYN: Full fetch complete (65938 records). [2025-10-28T21:01:11.723347] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-28T21:01:11.889706] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T21:01:11.989007] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-28T21:01:12.126483] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-28T21:01:12.126551] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-28T21:01:12.127576] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-28T21:01:12.127636] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-28T21:01:12.129027] [DEBUG] [LOCAL ] RYN: Trimmed 65938 records to 45650 (keeping 200 days of data) [2025-10-28T21:01:12.400233] [DEBUG] [LOCAL ] RYN: Primary data saved (45650 records). [2025-10-28T21:01:12.400369] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-28T21:01:12.400456] [INFO ] [MAIN ] Update Progress: 1852/2366 symbols completed. RYN took 44.7s. Estimated remaining: 1h 6m 56s. Rate: 7.7 symbols/min [2025-10-28T21:01:12.563621] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:12.563817] [DEBUG] [LOCAL ] SAFE: No existing data file found in primary storage. [2025-10-28T21:01:12.563858] [WARN ] [MAIN ] SAFE: No existing data found, performing full refresh instead. [2025-10-28T21:01:12.563969] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-28T21:01:12.564011] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-28T21:01:12.564051] [DEBUG] [LOCAL ] SAFE: No primary data file found to delete. [2025-10-28T21:01:12.564082] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-28T21:01:12.786272] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-28T21:01:12.906955] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:13.405744] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T21:01:13.435669] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T21:01:13.580277] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-28T21:01:14.380311] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-28T21:01:14.721555] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T21:01:15.180372] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-28T21:01:15.722542] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T21:01:15.990886] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-28T21:01:15.994468] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T21:01:16.780356] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-28T21:01:17.116980] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:01:17.580322] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-28T21:01:18.169276] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T21:01:18.236979] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T21:01:18.380310] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-28T21:01:19.052869] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T21:01:19.180362] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-28T21:01:19.980263] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-28T21:01:20.252500] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T21:01:20.780321] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-28T21:01:21.271749] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T21:01:21.580297] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-28T21:01:22.380231] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-28T21:01:22.586989] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T21:01:22.862982] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:01:22.994836] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:01:23.180268] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-28T21:01:23.980355] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-28T21:01:24.124079] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T21:01:24.773285] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T21:01:24.780220] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-28T21:01:25.379026] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T21:01:25.381276] [INFO ] [REMOTE ] SABA: Full fetch complete (14958 records). [2025-10-28T21:01:25.381510] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-28T21:01:25.589553] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-28T21:01:25.778282] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-28T21:01:25.778390] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-28T21:01:25.778921] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-28T21:01:25.778984] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-28T21:01:25.779696] [DEBUG] [LOCAL ] SABA: Trimmed 14958 records to 8968 (keeping 200 days of data) [2025-10-28T21:01:25.839901] [DEBUG] [LOCAL ] SABA: Primary data saved (8968 records). [2025-10-28T21:01:25.840116] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-28T21:01:25.840272] [INFO ] [MAIN ] Update Progress: 1853/2366 symbols completed. SABA took 22.6s. Estimated remaining: 1h 6m 50s. Rate: 7.7 symbols/min [2025-10-28T21:01:26.023121] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:26.023371] [DEBUG] [LOCAL ] SAH: No existing data file found in primary storage. [2025-10-28T21:01:26.023409] [WARN ] [MAIN ] SAH: No existing data found, performing full refresh instead. [2025-10-28T21:01:26.023539] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-28T21:01:26.023583] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-28T21:01:26.023627] [DEBUG] [LOCAL ] SAH: No primary data file found to delete. [2025-10-28T21:01:26.023698] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-28T21:01:26.385413] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-28T21:01:26.419084] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:27.018349] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T21:01:27.180235] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-28T21:01:27.980303] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-28T21:01:28.376252] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T21:01:28.412247] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T21:01:28.422962] [INFO ] [REMOTE ] S: Full fetch complete (77657 records). [2025-10-28T21:01:28.423080] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-28T21:01:28.785411] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-28T21:01:28.831754] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-28T21:01:28.831831] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-28T21:01:28.832986] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-28T21:01:28.833080] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-28T21:01:28.834581] [DEBUG] [LOCAL ] S: Trimmed 77657 records to 53536 (keeping 200 days of data) [2025-10-28T21:01:29.148676] [DEBUG] [LOCAL ] S: Primary data saved (53536 records). [2025-10-28T21:01:29.148816] [INFO ] [MAIN ] S: Full history saved. [2025-10-28T21:01:29.149146] [INFO ] [MAIN ] Update Progress: 1854/2366 symbols completed. S took 43.0s. Estimated remaining: 1h 6m 40s. Rate: 7.7 symbols/min [2025-10-28T21:01:29.321372] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:29.321523] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-28T21:01:29.321561] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-28T21:01:29.321708] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-28T21:01:29.321762] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-28T21:01:29.321805] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-28T21:01:29.321840] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-28T21:01:29.582966] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-28T21:01:29.681835] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:29.710562] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T21:01:29.720387] [INFO ] [REMOTE ] SA: Full fetch complete (63706 records). [2025-10-28T21:01:29.720491] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-28T21:01:30.072061] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T21:01:30.134631] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-28T21:01:30.134749] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-28T21:01:30.135844] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-28T21:01:30.135906] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-28T21:01:30.137224] [DEBUG] [LOCAL ] SA: Trimmed 63706 records to 44474 (keeping 200 days of data) [2025-10-28T21:01:30.384552] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-28T21:01:30.391875] [DEBUG] [LOCAL ] SA: Primary data saved (44474 records). [2025-10-28T21:01:30.392996] [INFO ] [MAIN ] SA: Full history saved. [2025-10-28T21:01:30.393090] [INFO ] [MAIN ] Update Progress: 1855/2366 symbols completed. SA took 34.7s. Estimated remaining: 1h 6m 31s. Rate: 7.7 symbols/min [2025-10-28T21:01:30.568294] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:30.585705] [DEBUG] [LOCAL ] SAM: No existing data file found in primary storage. [2025-10-28T21:01:30.586468] [WARN ] [MAIN ] SAM: No existing data found, performing full refresh instead. [2025-10-28T21:01:30.587289] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T21:01:30.587510] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-28T21:01:30.592127] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-28T21:01:30.592187] [DEBUG] [LOCAL ] SAM: No primary data file found to delete. [2025-10-28T21:01:30.592221] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-28T21:01:30.953135] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:31.180256] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-28T21:01:31.472887] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T21:01:31.980264] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-28T21:01:32.156477] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T21:01:32.780308] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-28T21:01:33.112546] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T21:01:33.196488] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T21:01:33.580247] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-28T21:01:34.380301] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-28T21:01:34.407255] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T21:01:34.756451] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T21:01:35.180254] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-28T21:01:35.505019] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T21:01:35.980264] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-28T21:01:36.780266] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-28T21:01:37.308317] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T21:01:37.580307] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-28T21:01:38.335945] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T21:01:38.338244] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T21:01:38.380211] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-28T21:01:38.725446] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T21:01:39.180279] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-28T21:01:39.980259] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-28T21:01:40.004996] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T21:01:40.780321] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-28T21:01:41.325056] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T21:01:41.504702] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T21:01:41.580220] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-28T21:01:42.380288] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-28T21:01:42.549765] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T21:01:42.886670] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T21:01:43.180290] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-28T21:01:43.980224] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-28T21:01:44.055407] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T21:01:44.060683] [INFO ] [REMOTE ] SAFE: Full fetch complete (43464 records). [2025-10-28T21:01:44.060807] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-28T21:01:44.435790] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-28T21:01:44.435876] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-28T21:01:44.436792] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-28T21:01:44.436854] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-28T21:01:44.437861] [DEBUG] [LOCAL ] SAFE: Trimmed 43464 records to 29374 (keeping 200 days of data) [2025-10-28T21:01:44.612280] [DEBUG] [LOCAL ] SAFE: Primary data saved (29374 records). [2025-10-28T21:01:44.612417] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-28T21:01:44.612496] [INFO ] [MAIN ] Update Progress: 1856/2366 symbols completed. SAFE took 32.2s. Estimated remaining: 1h 6m 25s. Rate: 7.7 symbols/min [2025-10-28T21:01:44.788961] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:44.785346] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-28T21:01:44.804391] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T21:01:44.852835] [DEBUG] [LOCAL ] SAN: Loaded 52944 existing records from primary storage. [2025-10-28T21:01:44.853130] [INFO ] [MAIN ] SAN: Loaded 52944 existing records. [2025-10-28T21:01:45.025666] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:01:45.025880] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-28T21:01:45.025951] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-28T21:01:45.026526] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-28T21:01:45.026582] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-28T21:01:45.193718] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T21:01:45.385864] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:45.580251] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-28T21:01:46.380225] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-28T21:01:46.551730] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T21:01:47.180212] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-28T21:01:47.315420] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T21:01:47.560139] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T21:01:47.980257] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-28T21:01:48.780279] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-28T21:01:49.464389] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T21:01:49.580252] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-28T21:01:49.763754] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T21:01:50.380296] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-28T21:01:50.926996] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T21:01:51.180336] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-28T21:01:51.298331] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T21:01:51.980261] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-28T21:01:52.780280] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-28T21:01:52.992995] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T21:01:53.002499] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:01:53.580261] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-28T21:01:53.684858] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T21:01:54.380256] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-28T21:01:54.701101] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T21:01:54.701957] [INFO ] [REMOTE ] SAJ: Full fetch complete (1024 records). [2025-10-28T21:01:54.702025] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-28T21:01:54.879365] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-28T21:01:54.879554] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:01:54.879626] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:01:54.879733] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-28T21:01:54.879796] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-28T21:01:54.879831] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-28T21:01:54.879871] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-28T21:01:54.879928] [INFO ] [MAIN ] Update Progress: 1857/2366 symbols completed. SAJ took 25.7s. Estimated remaining: 1h 6m 18s. Rate: 7.7 symbols/min [2025-10-28T21:01:55.051006] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:55.098514] [DEBUG] [LOCAL ] SAP: Loaded 49830 existing records from primary storage. [2025-10-28T21:01:55.098917] [INFO ] [MAIN ] SAP: Loaded 49830 existing records. [2025-10-28T21:01:55.180690] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-28T21:01:55.316203] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:01:55.316593] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-28T21:01:55.316700] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-28T21:01:55.318899] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T21:01:55.318964] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-28T21:01:55.329699] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-28T21:01:55.686085] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:55.980253] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-28T21:01:56.065756] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T21:01:56.070242] [INFO ] [REMOTE ] SAM: Full fetch complete (31251 records). [2025-10-28T21:01:56.070325] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-28T21:01:56.445200] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-28T21:01:56.445282] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-28T21:01:56.445947] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-28T21:01:56.446009] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-28T21:01:56.446817] [DEBUG] [LOCAL ] SAM: Trimmed 31251 records to 21247 (keeping 200 days of data) [2025-10-28T21:01:56.574297] [DEBUG] [LOCAL ] SAM: Primary data saved (21247 records). [2025-10-28T21:01:56.574417] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-28T21:01:56.574484] [INFO ] [MAIN ] Update Progress: 1858/2366 symbols completed. SAM took 26.2s. Estimated remaining: 1h 6m 8s. Rate: 7.7 symbols/min [2025-10-28T21:01:56.749437] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:01:56.766596] [DEBUG] [LOCAL ] SAR: Loaded 16865 existing records from primary storage. [2025-10-28T21:01:56.766871] [INFO ] [MAIN ] SAR: Loaded 16865 existing records. [2025-10-28T21:01:56.786986] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-28T21:01:56.969284] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T21:01:56.983577] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:01:56.988678] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-28T21:01:56.988742] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-28T21:01:56.988989] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-28T21:01:56.989049] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-28T21:01:57.341597] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:01:57.580236] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-28T21:01:58.380347] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-28T21:01:58.399693] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T21:01:58.461660] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T21:01:59.180285] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-28T21:01:59.643873] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T21:01:59.980295] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-28T21:02:00.785438] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-28T21:02:00.803178] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T21:02:01.505714] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T21:02:01.580271] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-28T21:02:01.655279] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T21:02:02.380240] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-28T21:02:03.032299] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T21:02:03.180239] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-28T21:02:03.409634] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T21:02:03.980246] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-28T21:02:04.786912] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-28T21:02:04.793306] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T21:02:04.881039] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T21:02:05.580279] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-28T21:02:06.241029] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T21:02:06.380281] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-28T21:02:07.058184] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T21:02:07.062291] [INFO ] [REMOTE ] SAH: Full fetch complete (31134 records). [2025-10-28T21:02:07.062375] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-28T21:02:07.185397] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-28T21:02:07.429846] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-28T21:02:07.429925] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-28T21:02:07.430547] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-28T21:02:07.430586] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-28T21:02:07.431404] [DEBUG] [LOCAL ] SAH: Trimmed 31134 records to 20506 (keeping 200 days of data) [2025-10-28T21:02:07.556260] [DEBUG] [LOCAL ] SAH: Primary data saved (20506 records). [2025-10-28T21:02:07.556575] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-28T21:02:07.556662] [INFO ] [MAIN ] Update Progress: 1859/2366 symbols completed. SAH took 41.7s. Estimated remaining: 1h 6m 1s. Rate: 7.7 symbols/min [2025-10-28T21:02:07.730327] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:07.773269] [DEBUG] [LOCAL ] SARO: Loaded 48144 existing records from primary storage. [2025-10-28T21:02:07.773592] [INFO ] [MAIN ] SARO: Loaded 48144 existing records. [2025-10-28T21:02:07.952603] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:02:07.952951] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-28T21:02:07.953024] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-28T21:02:07.953749] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-28T21:02:07.953828] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-28T21:02:07.985742] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-28T21:02:08.284307] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T21:02:08.386958] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:08.413045] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-28T21:02:08.780289] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-28T21:02:09.580314] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-28T21:02:10.380291] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-28T21:02:10.458875] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T21:02:10.626005] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-28T21:02:10.819042] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:02:11.180243] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-28T21:02:11.216396] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T21:02:11.980267] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-28T21:02:12.750162] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T21:02:12.780209] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-28T21:02:12.895518] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T21:02:13.502201] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T21:02:13.580247] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-28T21:02:14.380351] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-28T21:02:15.180349] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-28T21:02:15.277908] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T21:02:15.897445] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T21:02:15.980276] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-28T21:02:16.663730] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T21:02:16.781908] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-28T21:02:16.784188] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:02:17.580261] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-28T21:02:18.195202] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:02:18.380231] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-28T21:02:18.556838] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T21:02:19.180262] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-28T21:02:19.985397] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-28T21:02:20.010434] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T21:02:20.036067] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:02:20.780277] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-28T21:02:21.580230] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-28T21:02:22.177842] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T21:02:22.282576] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-28T21:02:22.293920] [INFO ] [REMOTE ] SAN: Full fetch complete (76624 records). [2025-10-28T21:02:22.294098] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-28T21:02:22.390466] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-28T21:02:22.705489] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-28T21:02:22.705578] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-28T21:02:22.706861] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-28T21:02:22.706929] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-28T21:02:22.708432] [DEBUG] [LOCAL ] SAN: Trimmed 76624 records to 52938 (keeping 200 days of data) [2025-10-28T21:02:23.026314] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T21:02:23.038133] [DEBUG] [LOCAL ] SAN: Primary data saved (52938 records). [2025-10-28T21:02:23.038313] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-28T21:02:23.038539] [INFO ] [MAIN ] Update Progress: 1860/2366 symbols completed. SAN took 38.4s. Estimated remaining: 1h 5m 56s. Rate: 7.7 symbols/min [2025-10-28T21:02:23.038435] [INFO ] [REMOTE ] SAR: Full fetch complete (24118 records). [2025-10-28T21:02:23.071063] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-28T21:02:23.188621] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-28T21:02:23.447516] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:23.460126] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-28T21:02:23.487110] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-28T21:02:23.498435] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-28T21:02:23.532343] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-28T21:02:23.537759] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-28T21:02:23.561607] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-28T21:02:23.663113] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-28T21:02:23.670873] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-28T21:02:23.676805] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-28T21:02:23.691823] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-28T21:02:23.765738] [DEBUG] [LOCAL ] SAR: Trimmed 24118 records to 16842 (keeping 200 days of data) [2025-10-28T21:02:24.076684] [DEBUG] [LOCAL ] SAR: Primary data saved (16842 records). [2025-10-28T21:02:24.143770] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-28T21:02:24.185408] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:24.185765] [INFO ] [MAIN ] Update Progress: 1861/2366 symbols completed. SAR took 27.6s. Estimated remaining: 1h 5m 46s. Rate: 7.7 symbols/min [2025-10-28T21:02:24.191639] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-28T21:02:24.201086] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T21:02:24.369748] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:24.369918] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-28T21:02:24.369955] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-28T21:02:24.370091] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-28T21:02:24.370168] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-28T21:02:24.370231] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-28T21:02:24.370264] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-28T21:02:24.733501] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:24.735996] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T21:02:24.780252] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-28T21:02:25.114544] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T21:02:25.580327] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-28T21:02:26.060449] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T21:02:26.380272] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-28T21:02:26.713398] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T21:02:27.180255] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-28T21:02:27.581755] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T21:02:27.980267] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-28T21:02:28.414047] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T21:02:28.780306] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-28T21:02:29.133467] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (5.94 seconds). [2025-10-28T21:02:29.171511] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T21:02:29.580266] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-28T21:02:30.380293] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-28T21:02:31.058128] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T21:02:31.180269] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-28T21:02:31.542906] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T21:02:31.873832] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T21:02:31.980302] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-28T21:02:32.378998] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T21:02:32.780263] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-28T21:02:33.113396] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T21:02:33.580264] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-28T21:02:33.913668] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-28T21:02:34.380319] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-28T21:02:35.180248] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-28T21:02:35.780718] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T21:02:35.980262] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-28T21:02:36.278884] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T21:02:36.780337] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-28T21:02:37.093088] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-28T21:02:37.103924] [INFO ] [REMOTE ] SAP: Full fetch complete (72368 records). [2025-10-28T21:02:37.104107] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-28T21:02:37.494357] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-28T21:02:37.494441] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-28T21:02:37.495564] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-28T21:02:37.495628] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-28T21:02:37.497107] [DEBUG] [LOCAL ] SAP: Trimmed 72368 records to 49816 (keeping 200 days of data) [2025-10-28T21:02:37.588785] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-28T21:02:37.917760] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-28T21:02:37.957961] [DEBUG] [LOCAL ] SAP: Primary data saved (49816 records). [2025-10-28T21:02:37.958236] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-28T21:02:37.958843] [INFO ] [MAIN ] Update Progress: 1862/2366 symbols completed. SAP took 43.1s. Estimated remaining: 1h 5m 40s. Rate: 7.7 symbols/min [2025-10-28T21:02:38.195064] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T21:02:38.308966] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:38.309286] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-28T21:02:38.309334] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-28T21:02:38.309488] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-28T21:02:38.309539] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-28T21:02:38.309594] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-28T21:02:38.309636] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-28T21:02:38.385496] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-28T21:02:38.743188] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:39.180302] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-28T21:02:39.604023] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T21:02:39.753278] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T21:02:39.980281] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-28T21:02:40.780257] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-28T21:02:41.356860] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T21:02:41.580304] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-28T21:02:41.967838] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-28T21:02:41.977696] [INFO ] [REMOTE ] SARO: Full fetch complete (68988 records). [2025-10-28T21:02:41.977818] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-28T21:02:42.366847] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-28T21:02:42.367011] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T21:02:42.367175] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-28T21:02:42.368489] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-28T21:02:42.369636] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-28T21:02:42.371068] [DEBUG] [LOCAL ] SARO: Trimmed 68988 records to 48122 (keeping 200 days of data) [2025-10-28T21:02:42.418483] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-28T21:02:42.652088] [DEBUG] [LOCAL ] SARO: Primary data saved (48122 records). [2025-10-28T21:02:42.652215] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-28T21:02:42.652722] [INFO ] [MAIN ] Update Progress: 1863/2366 symbols completed. SARO took 35.1s. Estimated remaining: 1h 5m 31s. Rate: 7.7 symbols/min [2025-10-28T21:02:42.823726] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:42.858560] [DEBUG] [LOCAL ] SB: Loaded 32237 existing records from primary storage. [2025-10-28T21:02:42.858838] [INFO ] [MAIN ] SB: Loaded 32237 existing records. [2025-10-28T21:02:43.061580] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:02:43.064612] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-28T21:02:43.064776] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T21:02:43.066345] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-28T21:02:43.066789] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-28T21:02:43.066848] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-28T21:02:43.185340] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-28T21:02:43.426822] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:43.814401] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T21:02:43.980259] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-28T21:02:44.346958] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-28T21:02:44.347811] [INFO ] [REMOTE ] SAY: Full fetch complete (1395 records). [2025-10-28T21:02:44.347878] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-28T21:02:44.535997] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-28T21:02:44.536269] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:02:44.536355] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:02:44.536449] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-28T21:02:44.536533] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-28T21:02:44.536572] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-28T21:02:44.536626] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-28T21:02:44.536739] [INFO ] [MAIN ] Update Progress: 1864/2366 symbols completed. SAY took 20.4s. Estimated remaining: 1h 5m 22s. Rate: 7.7 symbols/min [2025-10-28T21:02:44.703771] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:44.703950] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-28T21:02:44.704003] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-28T21:02:44.704108] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-28T21:02:44.704148] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-28T21:02:44.704188] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-28T21:02:44.704219] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-28T21:02:44.785379] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-28T21:02:45.076084] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:45.580263] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-28T21:02:45.983763] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T21:02:46.006581] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:02:46.380255] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-28T21:02:46.904128] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T21:02:47.180256] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-28T21:02:47.980256] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-10-28T21:02:48.204146] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:02:48.204493] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-10-28T21:02:48.204618] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:02:48.204717] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-28T21:02:48.204782] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:02:48.204869] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-28T21:02:48.204932] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-28T21:02:48.204967] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-28T21:02:48.205005] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-28T21:02:48.205052] [INFO ] [MAIN ] Update Progress: 1865/2366 symbols completed. SBDS took 3.7s. Estimated remaining: 1h 5m 13s. Rate: 7.7 symbols/min [2025-10-28T21:02:48.407483] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:48.407823] [DEBUG] [LOCAL ] SBH: No existing data file found in primary storage. [2025-10-28T21:02:48.407889] [WARN ] [MAIN ] SBH: No existing data found, performing full refresh instead. [2025-10-28T21:02:48.408041] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-28T21:02:48.408158] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-28T21:02:48.408227] [DEBUG] [LOCAL ] SBH: No primary data file found to delete. [2025-10-28T21:02:48.408262] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-28T21:02:48.794329] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T21:02:48.793408] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-28T21:02:48.799965] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:49.183872] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T21:02:49.580246] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-28T21:02:50.380256] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-28T21:02:50.648604] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:02:50.741751] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T21:02:51.180282] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-28T21:02:51.561369] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T21:02:51.980227] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-28T21:02:52.354528] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T21:02:52.780247] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-28T21:02:53.177994] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T21:02:53.580293] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-28T21:02:53.910739] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T21:02:53.911484] [INFO ] [REMOTE ] SAT: Full fetch complete (1464 records). [2025-10-28T21:02:53.911552] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-28T21:02:54.122524] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T21:02:54.122740] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:02:54.122811] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:02:54.122884] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-28T21:02:54.122947] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-28T21:02:54.122985] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-28T21:02:54.123044] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-28T21:02:54.123101] [INFO ] [MAIN ] Update Progress: 1866/2366 symbols completed. SAT took 31.1s. Estimated remaining: 1h 5m 4s. Rate: 7.7 symbols/min [2025-10-28T21:02:54.327935] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:02:54.337440] [DEBUG] [LOCAL ] SBI: Loaded 7458 existing records from primary storage. [2025-10-28T21:02:54.337673] [INFO ] [MAIN ] SBI: Loaded 7458 existing records. [2025-10-28T21:02:54.390447] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-28T21:02:54.520143] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:02:54.520377] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-28T21:02:54.520441] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-28T21:02:54.520742] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-28T21:02:54.520803] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-28T21:02:54.886199] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:02:55.180289] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-28T21:02:55.605822] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T21:02:55.980292] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-28T21:02:56.575945] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T21:02:56.580889] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:02:56.780250] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-28T21:02:57.580317] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-28T21:02:58.098603] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T21:02:58.120466] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:02:58.380293] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-28T21:02:58.730331] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T21:02:59.180283] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-28T21:02:59.980263] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-28T21:03:00.405129] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T21:03:00.407242] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T21:03:00.780277] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-28T21:03:01.580305] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-28T21:03:01.823808] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T21:03:02.380295] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-28T21:03:03.092298] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T21:03:03.180253] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-28T21:03:03.510487] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T21:03:03.980250] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-28T21:03:04.442413] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:03:04.780246] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-28T21:03:04.878374] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:03:05.356787] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T21:03:05.580283] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-28T21:03:06.380247] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-28T21:03:06.751695] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-28T21:03:06.752518] [INFO ] [REMOTE ] SAZ: Full fetch complete (1866 records). [2025-10-28T21:03:06.752590] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-28T21:03:06.936747] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T21:03:06.937038] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:03:06.937152] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:03:06.937475] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-28T21:03:06.937637] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-28T21:03:06.937739] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-28T21:03:06.937788] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-28T21:03:06.937847] [INFO ] [MAIN ] Update Progress: 1867/2366 symbols completed. SAZ took 29.0s. Estimated remaining: 1h 4m 58s. Rate: 7.7 symbols/min [2025-10-28T21:03:07.112628] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:07.123208] [DEBUG] [LOCAL ] SBR: Loaded 7713 existing records from primary storage. [2025-10-28T21:03:07.123584] [INFO ] [MAIN ] SBR: Loaded 7713 existing records. [2025-10-28T21:03:07.185599] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-28T21:03:07.282995] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T21:03:07.357422] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:03:07.357916] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-28T21:03:07.357968] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-28T21:03:07.358510] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-28T21:03:07.358582] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-28T21:03:07.708803] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:07.937250] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T21:03:07.980216] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-28T21:03:08.516535] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T21:03:08.780267] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-28T21:03:09.580336] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-28T21:03:09.920311] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T21:03:10.298492] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T21:03:10.380278] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-28T21:03:10.946073] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T21:03:11.180299] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-28T21:03:11.942285] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T21:03:11.980303] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-28T21:03:12.664802] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T21:03:12.780248] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-28T21:03:13.580250] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-28T21:03:13.663481] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T21:03:13.670134] [INFO ] [REMOTE ] SB: Full fetch complete (49197 records). [2025-10-28T21:03:13.670242] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-28T21:03:14.057011] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-28T21:03:14.057089] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-28T21:03:14.058019] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-28T21:03:14.058080] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-28T21:03:14.059071] [DEBUG] [LOCAL ] SB: Trimmed 49197 records to 32180 (keeping 200 days of data) [2025-10-28T21:03:14.245400] [DEBUG] [LOCAL ] SB: Primary data saved (32180 records). [2025-10-28T21:03:14.245573] [INFO ] [MAIN ] SB: Full history saved. [2025-10-28T21:03:14.245700] [INFO ] [MAIN ] Update Progress: 1868/2366 symbols completed. SB took 31.6s. Estimated remaining: 1h 4m 50s. Rate: 7.7 symbols/min [2025-10-28T21:03:14.385440] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-28T21:03:14.417974] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:14.462430] [DEBUG] [LOCAL ] SBS: Loaded 49193 existing records from primary storage. [2025-10-28T21:03:14.462770] [INFO ] [MAIN ] SBS: Loaded 49193 existing records. [2025-10-28T21:03:14.642415] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:03:14.642637] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-28T21:03:14.642717] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-28T21:03:14.643277] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-28T21:03:14.643333] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-28T21:03:14.971120] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T21:03:15.042460] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:15.046818] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T21:03:15.180238] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-28T21:03:15.980306] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-28T21:03:16.564748] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T21:03:16.597384] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T21:03:16.780258] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-28T21:03:17.580249] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-28T21:03:18.023443] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T21:03:18.070899] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T21:03:18.380246] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-28T21:03:19.180231] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-28T21:03:19.679195] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T21:03:19.851893] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T21:03:19.980274] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-28T21:03:20.780261] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-28T21:03:21.285470] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T21:03:21.287871] [INFO ] [REMOTE ] SBI: Full fetch complete (10574 records). [2025-10-28T21:03:21.288057] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-28T21:03:21.412478] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:03:21.585344] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-28T21:03:21.703513] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-28T21:03:21.703591] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-28T21:03:21.703882] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-28T21:03:21.703950] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-28T21:03:21.704409] [DEBUG] [LOCAL ] SBI: Trimmed 10574 records to 7363 (keeping 200 days of data) [2025-10-28T21:03:21.747629] [DEBUG] [LOCAL ] SBI: Primary data saved (7363 records). [2025-10-28T21:03:21.747788] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-28T21:03:21.747872] [INFO ] [MAIN ] Update Progress: 1869/2366 symbols completed. SBI took 27.6s. Estimated remaining: 1h 4m 42s. Rate: 7.7 symbols/min [2025-10-28T21:03:21.922930] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:21.923140] [DEBUG] [LOCAL ] SBSI: No existing data file found in primary storage. [2025-10-28T21:03:21.923196] [WARN ] [MAIN ] SBSI: No existing data found, performing full refresh instead. [2025-10-28T21:03:21.923301] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-28T21:03:21.923342] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-28T21:03:21.923382] [DEBUG] [LOCAL ] SBSI: No primary data file found to delete. [2025-10-28T21:03:21.923412] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-28T21:03:22.258295] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T21:03:22.280526] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:22.380225] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-28T21:03:23.127792] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T21:03:23.180212] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-28T21:03:23.960197] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T21:03:23.980220] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-28T21:03:24.780263] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-28T21:03:25.170261] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T21:03:25.580267] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-28T21:03:26.176322] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T21:03:26.380276] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-28T21:03:26.983951] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:03:27.180268] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-28T21:03:27.726331] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T21:03:27.781341] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:03:27.980331] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-28T21:03:28.780256] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-28T21:03:29.580244] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-28T21:03:30.037853] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:03:30.315537] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-28T21:03:30.354853] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T21:03:30.380241] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-28T21:03:31.180233] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-28T21:03:31.793877] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T21:03:31.804528] [INFO ] [REMOTE ] SBH: Full fetch complete (72937 records). [2025-10-28T21:03:31.804739] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-28T21:03:31.984734] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-28T21:03:32.096369] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T21:03:32.217108] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-28T21:03:32.217212] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-28T21:03:32.218427] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-28T21:03:32.218490] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-28T21:03:32.219889] [DEBUG] [LOCAL ] SBH: Trimmed 72937 records to 49719 (keeping 200 days of data) [2025-10-28T21:03:32.504849] [DEBUG] [LOCAL ] SBH: Primary data saved (49719 records). [2025-10-28T21:03:32.504991] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-28T21:03:32.505062] [INFO ] [MAIN ] Update Progress: 1870/2366 symbols completed. SBH took 44.3s. Estimated remaining: 1h 4m 35s. Rate: 7.7 symbols/min [2025-10-28T21:03:32.612786] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T21:03:32.684496] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:32.734347] [DEBUG] [LOCAL ] SBSW: Loaded 53183 existing records from primary storage. [2025-10-28T21:03:32.734667] [INFO ] [MAIN ] SBSW: Loaded 53183 existing records. [2025-10-28T21:03:32.789951] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-28T21:03:32.919776] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:03:32.919991] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-28T21:03:32.920047] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-28T21:03:32.920696] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-28T21:03:32.920765] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-28T21:03:33.265993] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:33.531736] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T21:03:33.580228] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-28T21:03:34.308674] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T21:03:34.380310] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-28T21:03:35.035902] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T21:03:35.180271] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-28T21:03:35.980230] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-28T21:03:36.090051] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T21:03:36.780307] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-28T21:03:37.358485] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T21:03:37.475472] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T21:03:37.580255] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-28T21:03:38.159720] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T21:03:38.162235] [INFO ] [REMOTE ] SBR: Full fetch complete (11439 records). [2025-10-28T21:03:38.162305] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-28T21:03:38.385818] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-28T21:03:38.562231] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-28T21:03:38.562310] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-28T21:03:38.562587] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-28T21:03:38.562626] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-28T21:03:38.563103] [DEBUG] [LOCAL ] SBR: Trimmed 11439 records to 7734 (keeping 200 days of data) [2025-10-28T21:03:38.612351] [DEBUG] [LOCAL ] SBR: Primary data saved (7734 records). [2025-10-28T21:03:38.612525] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-28T21:03:38.612700] [INFO ] [MAIN ] Update Progress: 1871/2366 symbols completed. SBR took 31.7s. Estimated remaining: 1h 4m 27s. Rate: 7.7 symbols/min [2025-10-28T21:03:38.813832] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:38.814029] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-28T21:03:38.814066] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-28T21:03:38.814175] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-28T21:03:38.814215] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-28T21:03:38.814255] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-28T21:03:38.814286] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-28T21:03:39.201885] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-28T21:03:39.204364] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:39.208125] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T21:03:39.980242] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-28T21:03:40.375258] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T21:03:40.780248] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-28T21:03:41.133725] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T21:03:41.580245] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-28T21:03:41.863259] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T21:03:41.989498] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-10-28T21:03:42.380282] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-28T21:03:42.674202] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T21:03:43.180275] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-28T21:03:43.980304] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-28T21:03:44.780257] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-28T21:03:45.580257] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-28T21:03:45.913559] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T21:03:46.203781] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:03:46.263516] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-28T21:03:46.270782] [INFO ] [REMOTE ] SBSI: Full fetch complete (21417 records). [2025-10-28T21:03:46.271076] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-28T21:03:46.390950] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-28T21:03:46.797922] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-28T21:03:46.798292] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-28T21:03:46.799405] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-28T21:03:46.799473] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-28T21:03:46.801143] [DEBUG] [LOCAL ] SBSI: Trimmed 21417 records to 14601 (keeping 200 days of data) [2025-10-28T21:03:46.906025] [DEBUG] [LOCAL ] SBSI: Primary data saved (14601 records). [2025-10-28T21:03:46.906234] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-28T21:03:46.906327] [INFO ] [MAIN ] Update Progress: 1872/2366 symbols completed. SBSI took 25.2s. Estimated remaining: 1h 4m 19s. Rate: 7.7 symbols/min [2025-10-28T21:03:47.084549] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:47.136757] [DEBUG] [LOCAL ] SCCO: Loaded 49479 existing records from primary storage. [2025-10-28T21:03:47.137171] [INFO ] [MAIN ] SCCO: Loaded 49479 existing records. [2025-10-28T21:03:47.182284] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-28T21:03:47.334536] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:03:47.334867] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-28T21:03:47.334919] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-28T21:03:47.336023] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-28T21:03:47.336088] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-28T21:03:47.680571] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (4.50 seconds). [2025-10-28T21:03:47.767987] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:47.797466] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T21:03:47.980247] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-28T21:03:48.780242] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-28T21:03:49.164601] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-28T21:03:49.359627] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T21:03:49.580257] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-28T21:03:50.101370] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T21:03:50.380301] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-28T21:03:50.420882] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T21:03:50.840314] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T21:03:51.180249] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-28T21:03:51.520529] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T21:03:51.980245] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-28T21:03:52.780295] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-28T21:03:53.385663] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T21:03:53.580271] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-28T21:03:54.201863] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T21:03:54.212497] [INFO ] [REMOTE ] SBS: Full fetch complete (70705 records). [2025-10-28T21:03:54.212728] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-28T21:03:54.390124] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-28T21:03:54.632614] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-28T21:03:54.632783] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-28T21:03:54.634755] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-28T21:03:54.634833] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-28T21:03:54.636946] [DEBUG] [LOCAL ] SBS: Trimmed 70705 records to 49125 (keeping 200 days of data) [2025-10-28T21:03:54.971589] [DEBUG] [LOCAL ] SBS: Primary data saved (49125 records). [2025-10-28T21:03:54.971955] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-28T21:03:54.990059] [INFO ] [MAIN ] Update Progress: 1873/2366 symbols completed. SBS took 40.7s. Estimated remaining: 1h 4m 11s. Rate: 7.7 symbols/min [2025-10-28T21:03:55.042193] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T21:03:55.180677] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-28T21:03:55.198973] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:55.216294] [DEBUG] [LOCAL ] SCD: Loaded 13576 existing records from primary storage. [2025-10-28T21:03:55.216534] [INFO ] [MAIN ] SCD: Loaded 13576 existing records. [2025-10-28T21:03:55.403961] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:03:55.404158] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-28T21:03:55.404206] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-28T21:03:55.404522] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-28T21:03:55.404580] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-28T21:03:55.776457] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:55.980303] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-28T21:03:56.620040] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:03:56.726570] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T21:03:56.780295] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-28T21:03:57.580251] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-28T21:03:57.961365] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T21:03:57.962380] [INFO ] [REMOTE ] SBXD: Full fetch complete (3133 records). [2025-10-28T21:03:57.962463] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-28T21:03:58.143382] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-28T21:03:58.143519] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:03:58.143586] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:03:58.143679] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-28T21:03:58.143751] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-28T21:03:58.143789] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-28T21:03:58.143828] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-28T21:03:58.143881] [INFO ] [MAIN ] Update Progress: 1874/2366 symbols completed. SBXD took 19.5s. Estimated remaining: 1h 4m 2s. Rate: 7.7 symbols/min [2025-10-28T21:03:58.310866] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:03:58.311119] [DEBUG] [LOCAL ] SCHW: No existing data file found in primary storage. [2025-10-28T21:03:58.311171] [WARN ] [MAIN ] SCHW: No existing data found, performing full refresh instead. [2025-10-28T21:03:58.311277] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-28T21:03:58.311319] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-28T21:03:58.311359] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-10-28T21:03:58.311401] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-28T21:03:58.385365] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-28T21:03:58.665024] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:03:59.019595] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T21:03:59.023166] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (4.63 seconds). [2025-10-28T21:03:59.180216] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-28T21:03:59.980222] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-28T21:04:00.224874] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (3.44 seconds). [2025-10-28T21:04:00.659020] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T21:04:00.780225] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-28T21:04:00.937169] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T21:04:01.580242] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-28T21:04:02.227225] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T21:04:02.380260] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-28T21:04:03.180239] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-28T21:04:03.877931] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T21:04:03.878020] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T21:04:03.980338] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-28T21:04:04.201045] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-10-28T21:04:04.780309] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-28T21:04:05.329682] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T21:04:05.580275] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-28T21:04:06.118859] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:04:06.380268] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-28T21:04:07.161697] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T21:04:07.185008] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-28T21:04:07.197701] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T21:04:07.980299] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-28T21:04:08.686235] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T21:04:08.780210] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-28T21:04:09.580229] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-28T21:04:09.735815] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T21:04:10.380254] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-28T21:04:10.682380] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-28T21:04:11.077019] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T21:04:11.180245] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-28T21:04:11.926332] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T21:04:11.980218] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-28T21:04:12.646293] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T21:04:12.727686] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T21:04:12.780256] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-28T21:04:13.580261] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-28T21:04:14.275804] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T21:04:14.385505] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-28T21:04:14.404281] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T21:04:14.420852] [INFO ] [REMOTE ] SCCO: Full fetch complete (71886 records). [2025-10-28T21:04:14.421023] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-28T21:04:14.834840] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-28T21:04:14.834918] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-28T21:04:14.836033] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-28T21:04:14.836096] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-28T21:04:14.837436] [DEBUG] [LOCAL ] SCCO: Trimmed 71886 records to 49472 (keeping 200 days of data) [2025-10-28T21:04:15.129968] [DEBUG] [LOCAL ] SCCO: Primary data saved (49472 records). [2025-10-28T21:04:15.130098] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-28T21:04:15.130178] [INFO ] [MAIN ] Update Progress: 1875/2366 symbols completed. SCCO took 28.2s. Estimated remaining: 1h 3m 57s. Rate: 7.7 symbols/min [2025-10-28T21:04:15.192092] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-28T21:04:15.296686] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:04:15.296873] [DEBUG] [LOCAL ] SCI: No existing data file found in primary storage. [2025-10-28T21:04:15.296948] [WARN ] [MAIN ] SCI: No existing data found, performing full refresh instead. [2025-10-28T21:04:15.297058] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-28T21:04:15.297117] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-28T21:04:15.297158] [DEBUG] [LOCAL ] SCI: No primary data file found to delete. [2025-10-28T21:04:15.297190] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-28T21:04:15.642874] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:04:15.983776] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-28T21:04:15.986847] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T21:04:15.990933] [INFO ] [REMOTE ] SCD: Full fetch complete (17332 records). [2025-10-28T21:04:15.991143] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-28T21:04:16.352971] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-28T21:04:16.353120] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-28T21:04:16.353529] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-28T21:04:16.353571] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-28T21:04:16.354109] [DEBUG] [LOCAL ] SCD: Trimmed 17332 records to 13651 (keeping 200 days of data) [2025-10-28T21:04:16.439492] [DEBUG] [LOCAL ] SCD: Primary data saved (13651 records). [2025-10-28T21:04:16.439624] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-28T21:04:16.439744] [INFO ] [MAIN ] Update Progress: 1876/2366 symbols completed. SCD took 21.4s. Estimated remaining: 1h 3m 47s. Rate: 7.7 symbols/min [2025-10-28T21:04:16.635627] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:04:16.637340] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-28T21:04:16.648046] [DEBUG] [LOCAL ] SCL: No existing data file found in primary storage. [2025-10-28T21:04:16.648227] [WARN ] [MAIN ] SCL: No existing data found, performing full refresh instead. [2025-10-28T21:04:16.648346] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-28T21:04:16.648391] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-28T21:04:16.648456] [DEBUG] [LOCAL ] SCL: No primary data file found to delete. [2025-10-28T21:04:16.648515] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-28T21:04:16.786187] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-28T21:04:16.999630] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:04:17.351829] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T21:04:17.580267] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-28T21:04:18.380302] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-28T21:04:18.710590] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T21:04:18.721738] [INFO ] [REMOTE ] SBSW: Full fetch complete (76800 records). [2025-10-28T21:04:18.721891] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-28T21:04:19.127405] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-28T21:04:19.127500] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-28T21:04:19.128766] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-28T21:04:19.128909] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-28T21:04:19.153363] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T21:04:19.162450] [DEBUG] [LOCAL ] SBSW: Trimmed 76800 records to 53185 (keeping 200 days of data) [2025-10-28T21:04:19.208011] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-28T21:04:19.468824] [DEBUG] [LOCAL ] SBSW: Primary data saved (53185 records). [2025-10-28T21:04:19.468952] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-28T21:04:19.469030] [INFO ] [MAIN ] Update Progress: 1877/2366 symbols completed. SBSW took 47.0s. Estimated remaining: 1h 3m 38s. Rate: 7.7 symbols/min [2025-10-28T21:04:19.988987] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-28T21:04:19.994456] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T21:04:20.684196] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T21:04:20.775209] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T21:04:20.780200] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-28T21:04:21.407100] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T21:04:21.580226] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-28T21:04:22.337305] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T21:04:22.380266] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-28T21:04:23.180317] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-28T21:04:23.980276] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-28T21:04:24.044931] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T21:04:24.780276] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-28T21:04:24.863123] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-28T21:04:25.580319] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-28T21:04:25.969955] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-28T21:04:26.143458] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:04:26.380244] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-28T21:04:26.995508] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T21:04:27.180309] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-28T21:04:27.894189] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-28T21:04:27.980599] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-28T21:04:27.983561] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:04:28.780316] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-28T21:04:29.440897] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T21:04:29.564212] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T21:04:29.580208] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-28T21:04:30.380293] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-28T21:04:30.890069] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T21:04:31.180282] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-28T21:04:31.374265] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T21:04:31.980256] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-28T21:04:32.555430] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T21:04:32.780251] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-28T21:04:33.580359] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-28T21:04:33.662084] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T21:04:34.147381] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T21:04:34.247012] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:04:34.250955] [INFO ] [REMOTE ] SCL: Full fetch complete (21752 records). [2025-10-28T21:04:34.251058] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-28T21:04:34.385381] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-28T21:04:34.625073] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-28T21:04:34.625171] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-28T21:04:34.625663] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-28T21:04:34.625722] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-28T21:04:34.626287] [DEBUG] [LOCAL ] SCL: Trimmed 21752 records to 15104 (keeping 200 days of data) [2025-10-28T21:04:34.721924] [DEBUG] [LOCAL ] SCL: Primary data saved (15104 records). [2025-10-28T21:04:34.722043] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-28T21:04:34.722109] [INFO ] [MAIN ] Update Progress: 1878/2366 symbols completed. SCL took 18.3s. Estimated remaining: 1h 3m 32s. Rate: 7.7 symbols/min [2025-10-28T21:04:35.180236] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-28T21:04:36.404810] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T21:04:36.414181] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-28T21:04:36.981908] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-28T21:04:36.993212] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-28T21:04:38.201226] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T21:04:38.210232] [INFO ] [REMOTE ] SCI: Full fetch complete (67283 records). [2025-10-28T21:04:38.210394] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-28T21:04:38.634432] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-28T21:04:38.634617] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-28T21:04:38.636035] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-28T21:04:38.636164] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-28T21:04:38.638111] [DEBUG] [LOCAL ] SCI: Trimmed 67283 records to 45755 (keeping 200 days of data) [2025-10-28T21:04:38.917542] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-28T21:04:38.939377] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-28T21:04:39.004546] [DEBUG] [LOCAL ] SCI: Primary data saved (45755 records). [2025-10-28T21:04:39.004724] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-28T21:04:39.004817] [INFO ] [MAIN ] Update Progress: 1879/2366 symbols completed. SCI took 23.9s. Estimated remaining: 1h 3m 24s. Rate: 7.7 symbols/min [2025-10-28T21:04:39.574026] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T21:04:39.585991] [INFO ] [REMOTE ] SCHW: Full fetch complete (77865 records). [2025-10-28T21:04:39.586375] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-28T21:04:39.972001] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-28T21:04:39.972096] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-28T21:04:39.974128] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-28T21:04:39.974192] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-28T21:04:39.975848] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 53685 (keeping 200 days of data) [2025-10-28T21:04:40.294217] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-28T21:04:40.294357] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-28T21:04:40.294434] [INFO ] [MAIN ] Update Progress: 1880/2366 symbols completed. SCHW took 42.2s. Estimated remaining: 1h 3m 14s. Rate: 7.7 symbols/min [2025-10-28T21:04:40.818443] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:04:40.958384] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:04:41.051986] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:04:41.053331] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:04:41.064973] [DEBUG] [LOCAL ] SDHC: Loaded 10241 existing records from primary storage. [2025-10-28T21:04:41.065386] [INFO ] [MAIN ] SDHC: Loaded 10241 existing records. [2025-10-28T21:04:41.265420] [DEBUG] [LOCAL ] SCM: Loaded 19935 existing records from primary storage. [2025-10-28T21:04:41.266371] [DEBUG] [LOCAL ] SD: Loaded 27795 existing records from primary storage. [2025-10-28T21:04:41.270452] [INFO ] [MAIN ] SD: Loaded 27795 existing records. [2025-10-28T21:04:41.273039] [INFO ] [MAIN ] SCM: Loaded 19935 existing records. [2025-10-28T21:04:41.314529] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:04:41.359638] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-28T21:04:41.404899] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-28T21:04:41.480392] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-28T21:04:41.486599] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-28T21:04:41.569771] [DEBUG] [LOCAL ] SCS: Loaded 43002 existing records from primary storage. [2025-10-28T21:04:41.657141] [INFO ] [MAIN ] SCS: Loaded 43002 existing records. [2025-10-28T21:04:41.869549] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:04:41.986127] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-28T21:04:42.003192] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:04:41.999972] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-28T21:04:42.035862] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-28T21:04:42.041175] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-28T21:04:42.059948] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-28T21:04:42.084048] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-28T21:04:42.101993] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-28T21:04:42.156457] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-28T21:04:42.161734] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:04:42.201402] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-28T21:04:42.201510] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-28T21:04:42.252207] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-28T21:04:42.262554] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-28T21:04:42.543316] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:04:42.567919] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-28T21:04:43.333681] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:04:43.377597] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:04:43.401029] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-28T21:04:43.389069] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-28T21:04:43.451922] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:04:43.452398] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-28T21:04:43.487924] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T21:04:43.491926] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-28T21:04:44.263376] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:04:44.268334] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-28T21:04:44.304301] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T21:04:44.310329] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-28T21:04:44.594995] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:04:44.598316] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-28T21:04:44.663742] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T21:04:44.780334] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-28T21:04:44.971941] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T21:04:45.220514] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T21:04:45.336015] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T21:04:45.580260] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-28T21:04:46.293011] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T21:04:46.380258] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-28T21:04:46.519694] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T21:04:47.180264] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-28T21:04:47.379721] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T21:04:47.980303] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-28T21:04:48.780244] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-28T21:04:49.071445] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T21:04:49.580293] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-28T21:04:50.380273] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-28T21:04:50.658958] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-28T21:04:50.804077] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T21:04:50.911464] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-28T21:04:51.180264] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-28T21:04:51.688887] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T21:04:51.984881] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-28T21:04:51.986046] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T21:04:52.654705] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T21:04:52.780243] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-28T21:04:53.580280] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-28T21:04:53.592241] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T21:04:54.380251] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-28T21:04:55.180295] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-28T21:04:55.284995] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T21:04:55.708635] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T21:04:55.980246] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-28T21:04:56.311969] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T21:04:56.780279] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-28T21:04:56.815347] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T21:04:57.580313] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-28T21:04:57.901227] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T21:04:58.380288] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-28T21:04:58.412776] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T21:04:59.180318] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-28T21:04:59.476520] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T21:04:59.980275] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-28T21:05:00.785399] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-28T21:05:00.792774] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T21:05:01.109021] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T21:05:01.460819] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T21:05:01.580263] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-28T21:05:02.380298] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-28T21:05:02.736313] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:05:03.180277] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-28T21:05:03.744416] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T21:05:03.980264] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-28T21:05:04.090410] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T21:05:04.096025] [INFO ] [REMOTE ] SD: Full fetch complete (40575 records). [2025-10-28T21:05:04.096178] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-28T21:05:04.516705] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-28T21:05:04.516791] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-28T21:05:04.517743] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-28T21:05:04.517807] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-28T21:05:04.518745] [DEBUG] [LOCAL ] SD: Trimmed 40575 records to 27679 (keeping 200 days of data) [2025-10-28T21:05:04.706790] [DEBUG] [LOCAL ] SD: Primary data saved (27679 records). [2025-10-28T21:05:04.706922] [INFO ] [MAIN ] SD: Full history saved. [2025-10-28T21:05:04.707009] [INFO ] [MAIN ] Update Progress: 1881/2366 symbols completed. SD took 24.4s. Estimated remaining: 1h 3m 11s. Rate: 7.7 symbols/min [2025-10-28T21:05:04.788745] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-28T21:05:04.900349] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:04.913975] [DEBUG] [LOCAL ] SDHY: Loaded 11160 existing records from primary storage. [2025-10-28T21:05:04.914258] [INFO ] [MAIN ] SDHY: Loaded 11160 existing records. [2025-10-28T21:05:05.106476] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:05.106717] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-28T21:05:05.106775] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-28T21:05:05.107090] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-28T21:05:05.107148] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-28T21:05:05.498713] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:05.541753] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T21:05:05.580287] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-28T21:05:05.988611] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-28T21:05:06.281811] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T21:05:06.380282] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-28T21:05:07.180324] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-28T21:05:07.911906] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T21:05:07.980239] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-28T21:05:08.002977] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T21:05:08.005778] [INFO ] [REMOTE ] SDHC: Full fetch complete (16514 records). [2025-10-28T21:05:08.005860] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-28T21:05:08.365683] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-28T21:05:08.365765] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-28T21:05:08.366177] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-28T21:05:08.366236] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-28T21:05:08.366801] [DEBUG] [LOCAL ] SDHC: Trimmed 16514 records to 10229 (keeping 200 days of data) [2025-10-28T21:05:08.427034] [DEBUG] [LOCAL ] SDHC: Primary data saved (10229 records). [2025-10-28T21:05:08.427169] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-28T21:05:08.427250] [INFO ] [MAIN ] Update Progress: 1882/2366 symbols completed. SDHC took 28.1s. Estimated remaining: 1h 3m 2s. Rate: 7.7 symbols/min [2025-10-28T21:05:08.594506] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:08.634423] [DEBUG] [LOCAL ] SDRL: Loaded 40933 existing records from primary storage. [2025-10-28T21:05:08.634854] [INFO ] [MAIN ] SDRL: Loaded 40933 existing records. [2025-10-28T21:05:08.785360] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-28T21:05:08.824918] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:08.825450] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-28T21:05:08.825513] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-28T21:05:08.826245] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-28T21:05:08.826304] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-28T21:05:08.917530] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T21:05:09.219469] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:09.580293] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-28T21:05:10.095837] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T21:05:10.104906] [INFO ] [REMOTE ] SCS: Full fetch complete (61101 records). [2025-10-28T21:05:10.105053] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-28T21:05:10.267024] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T21:05:10.385444] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-28T21:05:10.510822] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-28T21:05:10.510907] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-28T21:05:10.511914] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-28T21:05:10.511981] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-28T21:05:10.513315] [DEBUG] [LOCAL ] SCS: Trimmed 61101 records to 42961 (keeping 200 days of data) [2025-10-28T21:05:10.780376] [DEBUG] [LOCAL ] SCS: Primary data saved (42961 records). [2025-10-28T21:05:10.780512] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-28T21:05:10.780592] [INFO ] [MAIN ] Update Progress: 1883/2366 symbols completed. SCS took 30.5s. Estimated remaining: 1h 2m 53s. Rate: 7.7 symbols/min [2025-10-28T21:05:10.954540] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:11.005450] [DEBUG] [LOCAL ] SE: Loaded 53300 existing records from primary storage. [2025-10-28T21:05:11.005767] [INFO ] [MAIN ] SE: Loaded 53300 existing records. [2025-10-28T21:05:11.186089] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-28T21:05:11.185980] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:11.187560] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-28T21:05:11.187616] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-28T21:05:11.188291] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-28T21:05:11.188351] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-28T21:05:11.564854] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:11.980282] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-28T21:05:12.210125] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-28T21:05:12.780231] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-28T21:05:12.797774] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T21:05:13.510238] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T21:05:13.580292] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-28T21:05:14.258122] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T21:05:14.380249] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-28T21:05:14.497216] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T21:05:15.180314] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-28T21:05:15.970397] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T21:05:15.989716] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-28T21:05:15.989605] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:05:16.780272] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-28T21:05:17.322844] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T21:05:17.580306] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-28T21:05:17.705033] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T21:05:17.710622] [INFO ] [REMOTE ] SCM: Full fetch complete (29736 records). [2025-10-28T21:05:17.710786] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-28T21:05:18.085523] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-28T21:05:18.085609] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-28T21:05:18.086273] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-28T21:05:18.086336] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-28T21:05:18.087186] [DEBUG] [LOCAL ] SCM: Trimmed 29736 records to 19958 (keeping 200 days of data) [2025-10-28T21:05:18.193015] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T21:05:18.219399] [DEBUG] [LOCAL ] SCM: Primary data saved (19958 records). [2025-10-28T21:05:18.219538] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-28T21:05:18.219616] [INFO ] [MAIN ] Update Progress: 1884/2366 symbols completed. SCM took 37.9s. Estimated remaining: 1h 2m 45s. Rate: 7.7 symbols/min [2025-10-28T21:05:18.380707] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-28T21:05:18.397916] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:18.398151] [DEBUG] [LOCAL ] SEE: No existing data file found in primary storage. [2025-10-28T21:05:18.398221] [WARN ] [MAIN ] SEE: No existing data found, performing full refresh instead. [2025-10-28T21:05:18.398921] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-28T21:05:18.398980] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-28T21:05:18.399026] [DEBUG] [LOCAL ] SEE: No primary data file found to delete. [2025-10-28T21:05:18.399061] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-28T21:05:18.746211] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:19.180243] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-28T21:05:19.973630] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T21:05:19.982617] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-28T21:05:20.780303] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-28T21:05:21.266789] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-28T21:05:21.491914] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T21:05:21.580222] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-28T21:05:21.963006] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T21:05:22.380288] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-28T21:05:22.816422] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T21:05:23.056095] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T21:05:23.180303] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-28T21:05:23.980273] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-28T21:05:24.777197] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:05:24.780290] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-28T21:05:24.833456] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T21:05:25.580279] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-28T21:05:26.221035] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T21:05:26.391757] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-28T21:05:26.395408] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T21:05:27.180315] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-28T21:05:27.673769] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T21:05:27.980288] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-28T21:05:28.780289] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-28T21:05:29.275047] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-28T21:05:29.580262] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-28T21:05:29.927604] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-28T21:05:30.380314] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-28T21:05:30.742530] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-28T21:05:30.854545] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T21:05:31.180290] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-28T21:05:31.573169] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:05:31.787551] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T21:05:31.791040] [INFO ] [REMOTE ] SDHY: Full fetch complete (16104 records). [2025-10-28T21:05:31.791114] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-28T21:05:31.991379] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-28T21:05:32.178537] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-28T21:05:32.178614] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-28T21:05:32.179034] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-28T21:05:32.179092] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-28T21:05:32.179580] [DEBUG] [LOCAL ] SDHY: Trimmed 16104 records to 11122 (keeping 200 days of data) [2025-10-28T21:05:32.248477] [DEBUG] [LOCAL ] SDHY: Primary data saved (11122 records). [2025-10-28T21:05:32.248679] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-28T21:05:32.248808] [INFO ] [MAIN ] Update Progress: 1885/2366 symbols completed. SDHY took 27.5s. Estimated remaining: 1h 2m 38s. Rate: 7.7 symbols/min [2025-10-28T21:05:32.417308] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:32.431122] [DEBUG] [LOCAL ] SEG: Loaded 12236 existing records from primary storage. [2025-10-28T21:05:32.431347] [INFO ] [MAIN ] SEG: Loaded 12236 existing records. [2025-10-28T21:05:32.607111] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:32.607339] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-28T21:05:32.607387] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-28T21:05:32.607688] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-28T21:05:32.607747] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-28T21:05:32.786783] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-28T21:05:32.965848] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:33.405113] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T21:05:33.580257] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-28T21:05:34.133458] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T21:05:34.380258] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-28T21:05:34.920915] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:05:35.180292] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-28T21:05:35.758025] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T21:05:35.766000] [INFO ] [REMOTE ] SDRL: Full fetch complete (61202 records). [2025-10-28T21:05:35.766105] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-28T21:05:35.980307] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-28T21:05:36.151777] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-28T21:05:36.151864] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-28T21:05:36.152870] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-28T21:05:36.152933] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-28T21:05:36.154181] [DEBUG] [LOCAL ] SDRL: Trimmed 61202 records to 40863 (keeping 200 days of data) [2025-10-28T21:05:36.383950] [DEBUG] [LOCAL ] SDRL: Primary data saved (40863 records). [2025-10-28T21:05:36.384074] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-28T21:05:36.384487] [INFO ] [MAIN ] Update Progress: 1886/2366 symbols completed. SDRL took 28.0s. Estimated remaining: 1h 2m 30s. Rate: 7.7 symbols/min [2025-10-28T21:05:36.556627] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:36.603349] [DEBUG] [LOCAL ] SEI: Loaded 50033 existing records from primary storage. [2025-10-28T21:05:36.603684] [INFO ] [MAIN ] SEI: Loaded 50033 existing records. [2025-10-28T21:05:36.782406] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:36.782830] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-28T21:05:36.782609] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-28T21:05:36.783039] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-28T21:05:36.784732] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-28T21:05:36.784903] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-28T21:05:36.996542] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T21:05:37.175520] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:37.580256] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-28T21:05:37.963051] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T21:05:38.380254] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-28T21:05:38.451171] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T21:05:39.180315] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-28T21:05:39.840698] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T21:05:39.980265] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-28T21:05:40.086514] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-28T21:05:40.276707] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T21:05:40.689276] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T21:05:40.780239] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-28T21:05:41.580314] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-28T21:05:42.352326] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T21:05:42.380263] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-28T21:05:43.180301] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-28T21:05:43.282352] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T21:05:43.346012] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-28T21:05:43.980311] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-28T21:05:44.780765] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-28T21:05:44.780695] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T21:05:45.515240] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T21:05:45.527020] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T21:05:45.580242] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-28T21:05:46.228199] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T21:05:46.380254] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-28T21:05:47.180250] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-28T21:05:47.980361] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-28T21:05:48.133392] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-28T21:05:48.623063] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:05:48.633379] [INFO ] [REMOTE ] SEE: Full fetch complete (69987 records). [2025-10-28T21:05:48.633529] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-28T21:05:48.782099] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-28T21:05:49.046742] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-28T21:05:49.046871] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-28T21:05:49.047992] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-28T21:05:49.048056] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-28T21:05:49.049448] [DEBUG] [LOCAL ] SEE: Trimmed 69987 records to 47820 (keeping 200 days of data) [2025-10-28T21:05:49.290808] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T21:05:49.308738] [INFO ] [REMOTE ] SE: Full fetch complete (76919 records). [2025-10-28T21:05:49.315160] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-28T21:05:49.328583] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T21:05:49.334389] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:05:49.356523] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:05:49.367508] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-28T21:05:49.371209] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-28T21:05:49.373450] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-10-28T21:05:49.382077] [DEBUG] [LOCAL ] SEE: Primary data saved (47820 records). [2025-10-28T21:05:49.382299] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-28T21:05:49.382410] [INFO ] [MAIN ] Update Progress: 1887/2366 symbols completed. SEE took 31.2s. Estimated remaining: 1h 2m 23s. Rate: 7.7 symbols/min [2025-10-28T21:05:49.382480] [DEBUG] [LOCAL ] SE: Deleted derivative data file. [2025-10-28T21:05:49.416840] [INFO ] [MAIN ] Update Progress: 1888/2366 symbols completed. SE took 38.6s. Estimated remaining: 1h 2m 13s. Rate: 7.7 symbols/min [2025-10-28T21:05:49.585057] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-28T21:05:49.707142] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:49.760207] [DEBUG] [LOCAL ] SEM: No existing data file found in primary storage. [2025-10-28T21:05:49.778994] [WARN ] [MAIN ] SEM: No existing data found, performing full refresh instead. [2025-10-28T21:05:49.778926] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:49.779181] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-28T21:05:49.779294] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-28T21:05:49.779379] [DEBUG] [LOCAL ] SEM: No primary data file found to delete. [2025-10-28T21:05:49.779707] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-28T21:05:50.104049] [DEBUG] [LOCAL ] SEMR: Loaded 41931 existing records from primary storage. [2025-10-28T21:05:50.120410] [INFO ] [MAIN ] SEMR: Loaded 41931 existing records. [2025-10-28T21:05:50.276064] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:50.376917] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:50.377368] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-28T21:05:50.377517] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-28T21:05:50.378146] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-28T21:05:50.378209] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-28T21:05:50.411727] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-28T21:05:50.589917] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T21:05:50.736935] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-28T21:05:50.819973] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:51.180267] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-28T21:05:51.576126] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T21:05:51.980306] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-28T21:05:52.000733] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T21:05:52.780330] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-28T21:05:53.301585] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T21:05:53.437545] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T21:05:53.580298] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-28T21:05:54.189536] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T21:05:54.192255] [INFO ] [REMOTE ] SEG: Full fetch complete (19727 records). [2025-10-28T21:05:54.192367] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-28T21:05:54.395746] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-28T21:05:54.589220] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-28T21:05:54.589298] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-28T21:05:54.589718] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-28T21:05:54.589799] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-28T21:05:54.590378] [DEBUG] [LOCAL ] SEG: Trimmed 19727 records to 12210 (keeping 200 days of data) [2025-10-28T21:05:54.661945] [DEBUG] [LOCAL ] SEG: Primary data saved (12210 records). [2025-10-28T21:05:54.662081] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-28T21:05:54.662162] [INFO ] [MAIN ] Update Progress: 1889/2366 symbols completed. SEG took 22.4s. Estimated remaining: 1h 2m 5s. Rate: 7.7 symbols/min [2025-10-28T21:05:54.829769] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:05:54.879457] [DEBUG] [LOCAL ] SES: Loaded 51646 existing records from primary storage. [2025-10-28T21:05:54.879815] [INFO ] [MAIN ] SES: Loaded 51646 existing records. [2025-10-28T21:05:55.060274] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:05:55.060509] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-28T21:05:55.060589] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-28T21:05:55.061188] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-28T21:05:55.061245] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-28T21:05:55.185463] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-28T21:05:55.421712] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:05:55.889812] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T21:05:55.980260] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-28T21:05:56.230901] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T21:05:56.780248] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-28T21:05:57.436956] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T21:05:57.580280] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-28T21:05:57.894751] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T21:05:58.380297] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-28T21:05:58.946614] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T21:05:59.180286] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-28T21:05:59.656363] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T21:05:59.980282] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-28T21:06:00.695772] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T21:06:00.780284] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-28T21:06:01.580268] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-28T21:06:02.380235] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-28T21:06:02.442035] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-28T21:06:02.487066] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T21:06:02.651858] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:06:03.180261] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-28T21:06:03.651759] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:06:03.980341] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-28T21:06:04.780326] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-28T21:06:04.988187] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T21:06:04.999279] [INFO ] [REMOTE ] SEI: Full fetch complete (71509 records). [2025-10-28T21:06:04.999740] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-28T21:06:05.414444] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-28T21:06:05.414682] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-28T21:06:05.416185] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-28T21:06:05.416383] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-28T21:06:05.440841] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T21:06:05.441004] [DEBUG] [LOCAL ] SEI: Trimmed 71509 records to 50023 (keeping 200 days of data) [2025-10-28T21:06:05.623253] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-28T21:06:05.758677] [DEBUG] [LOCAL ] SEI: Primary data saved (50023 records). [2025-10-28T21:06:05.758824] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-28T21:06:05.759216] [INFO ] [MAIN ] Update Progress: 1890/2366 symbols completed. SEI took 29.4s. Estimated remaining: 1h 1m 58s. Rate: 7.7 symbols/min [2025-10-28T21:06:05.925705] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:05.925852] [DEBUG] [LOCAL ] SF: No existing data file found in primary storage. [2025-10-28T21:06:05.925889] [WARN ] [MAIN ] SF: No existing data found, performing full refresh instead. [2025-10-28T21:06:05.926008] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-28T21:06:05.926051] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-28T21:06:05.926094] [DEBUG] [LOCAL ] SF: No primary data file found to delete. [2025-10-28T21:06:05.926126] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-28T21:06:06.271968] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:06.380213] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-28T21:06:06.827633] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T21:06:06.884383] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-28T21:06:07.180314] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-28T21:06:07.980230] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-28T21:06:08.019984] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T21:06:08.625398] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T21:06:08.780337] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-28T21:06:09.110661] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:06:09.580258] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-28T21:06:10.380310] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-28T21:06:10.795113] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:06:11.180276] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-28T21:06:11.301188] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-28T21:06:11.664294] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T21:06:11.980278] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-28T21:06:12.454136] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:06:12.780317] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-28T21:06:13.450819] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T21:06:13.580319] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-28T21:06:14.380424] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-28T21:06:14.789390] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-28T21:06:15.127864] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T21:06:15.180260] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-28T21:06:15.486480] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T21:06:15.980261] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-28T21:06:16.699769] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T21:06:16.780330] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-28T21:06:17.480934] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T21:06:17.580280] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-28T21:06:17.990828] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T21:06:17.999993] [INFO ] [REMOTE ] SEMR: Full fetch complete (60822 records). [2025-10-28T21:06:18.000170] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-28T21:06:18.386148] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-28T21:06:18.387150] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-28T21:06:18.387542] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-28T21:06:18.389545] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-28T21:06:18.389790] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-28T21:06:18.391016] [DEBUG] [LOCAL ] SEMR: Trimmed 60822 records to 41938 (keeping 200 days of data) [2025-10-28T21:06:18.620201] [DEBUG] [LOCAL ] SEMR: Primary data saved (41938 records). [2025-10-28T21:06:18.620327] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-28T21:06:18.620406] [INFO ] [MAIN ] Update Progress: 1891/2366 symbols completed. SEMR took 29.2s. Estimated remaining: 1h 1m 51s. Rate: 7.7 symbols/min [2025-10-28T21:06:18.790284] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:18.796574] [DEBUG] [LOCAL ] SFB: Loaded 3585 existing records from primary storage. [2025-10-28T21:06:18.796802] [INFO ] [MAIN ] SFB: Loaded 3585 existing records. [2025-10-28T21:06:19.004012] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:06:19.004426] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-28T21:06:19.004568] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-28T21:06:19.004853] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-28T21:06:19.004920] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-28T21:06:19.103778] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T21:06:19.194930] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-28T21:06:19.416490] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:19.980300] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-28T21:06:20.554446] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T21:06:20.745222] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:06:20.788728] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-28T21:06:20.794215] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-28T21:06:21.580262] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-28T21:06:22.147805] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T21:06:22.380304] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-28T21:06:23.180246] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-28T21:06:23.492833] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T21:06:23.582948] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T21:06:23.672894] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-28T21:06:23.980276] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-28T21:06:24.780242] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-28T21:06:25.290189] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T21:06:25.371864] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T21:06:25.580312] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-28T21:06:26.380265] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-28T21:06:26.876467] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T21:06:26.885763] [INFO ] [REMOTE ] SEM: Full fetch complete (61441 records). [2025-10-28T21:06:26.885951] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-28T21:06:27.183754] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-28T21:06:27.286246] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-28T21:06:27.286353] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-28T21:06:27.287629] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-28T21:06:27.287718] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-28T21:06:27.288970] [DEBUG] [LOCAL ] SEM: Trimmed 61441 records to 42966 (keeping 200 days of data) [2025-10-28T21:06:27.547236] [DEBUG] [LOCAL ] SEM: Primary data saved (42966 records). [2025-10-28T21:06:27.547365] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-28T21:06:27.547433] [INFO ] [MAIN ] Update Progress: 1892/2366 symbols completed. SEM took 38.2s. Estimated remaining: 1h 1m 44s. Rate: 7.7 symbols/min [2025-10-28T21:06:27.725625] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:27.726074] [DEBUG] [LOCAL ] SFBS: No existing data file found in primary storage. [2025-10-28T21:06:27.726226] [WARN ] [MAIN ] SFBS: No existing data found, performing full refresh instead. [2025-10-28T21:06:27.726470] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-28T21:06:27.726532] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-28T21:06:27.726625] [DEBUG] [LOCAL ] SFBS: No primary data file found to delete. [2025-10-28T21:06:27.726716] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-28T21:06:27.838880] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T21:06:27.944697] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T21:06:27.980571] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-28T21:06:28.143692] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:28.780275] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-28T21:06:29.580248] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-28T21:06:29.766296] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T21:06:30.061582] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T21:06:30.380211] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-28T21:06:30.719289] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-28T21:06:30.865895] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T21:06:31.180244] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-28T21:06:31.980247] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-28T21:06:32.421200] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T21:06:32.433007] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T21:06:32.780252] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-28T21:06:33.557755] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T21:06:33.580220] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-28T21:06:34.380227] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-28T21:06:34.421846] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T21:06:35.180232] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-28T21:06:35.541549] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:06:35.980221] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-28T21:06:36.098005] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T21:06:36.780249] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-28T21:06:37.219021] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T21:06:37.580247] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-28T21:06:37.922840] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-28T21:06:38.380267] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-28T21:06:38.776765] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T21:06:38.785585] [INFO ] [REMOTE ] SF: Full fetch complete (60450 records). [2025-10-28T21:06:38.785772] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-28T21:06:39.161509] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T21:06:39.181998] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-28T21:06:39.182254] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-28T21:06:39.184143] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-28T21:06:39.185413] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-28T21:06:39.185480] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-28T21:06:39.186938] [DEBUG] [LOCAL ] SF: Trimmed 60450 records to 41065 (keeping 200 days of data) [2025-10-28T21:06:39.439375] [DEBUG] [LOCAL ] SF: Primary data saved (41065 records). [2025-10-28T21:06:39.439497] [INFO ] [MAIN ] SF: Full history saved. [2025-10-28T21:06:39.439575] [INFO ] [MAIN ] Update Progress: 1893/2366 symbols completed. SF took 33.7s. Estimated remaining: 1h 1m 37s. Rate: 7.7 symbols/min [2025-10-28T21:06:39.611013] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:39.651973] [DEBUG] [LOCAL ] SFL: Loaded 45033 existing records from primary storage. [2025-10-28T21:06:39.652289] [INFO ] [MAIN ] SFL: Loaded 45033 existing records. [2025-10-28T21:06:39.826963] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:06:39.827185] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-28T21:06:39.827236] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-28T21:06:39.827833] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-28T21:06:39.827916] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-28T21:06:39.980332] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-28T21:06:40.183216] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T21:06:40.208350] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:40.549881] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T21:06:40.551093] [INFO ] [REMOTE ] SFB: Full fetch complete (5639 records). [2025-10-28T21:06:40.551163] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-28T21:06:40.785523] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-28T21:06:40.914357] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-28T21:06:40.914432] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-28T21:06:40.914590] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-28T21:06:40.914628] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-28T21:06:40.915044] [DEBUG] [LOCAL ] SFB: Trimmed 5639 records to 3567 (keeping 200 days of data) [2025-10-28T21:06:40.936507] [DEBUG] [LOCAL ] SFB: Primary data saved (3567 records). [2025-10-28T21:06:40.936624] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-28T21:06:40.936745] [INFO ] [MAIN ] Update Progress: 1894/2366 symbols completed. SFB took 22.3s. Estimated remaining: 1h 1m 28s. Rate: 7.7 symbols/min [2025-10-28T21:06:41.106601] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:41.157540] [DEBUG] [LOCAL ] SG: Loaded 53500 existing records from primary storage. [2025-10-28T21:06:41.157891] [INFO ] [MAIN ] SG: Loaded 53500 existing records. [2025-10-28T21:06:41.332505] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:06:41.332713] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-28T21:06:41.332768] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-28T21:06:41.333320] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-28T21:06:41.333377] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-28T21:06:41.585344] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-28T21:06:41.698103] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:42.380207] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-28T21:06:42.420730] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T21:06:42.596751] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T21:06:43.180266] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-28T21:06:43.780994] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:06:43.980213] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-28T21:06:44.717082] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T21:06:44.780212] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-28T21:06:44.864461] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T21:06:45.580252] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-28T21:06:46.194290] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T21:06:46.380254] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-28T21:06:46.974615] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T21:06:47.180249] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-28T21:06:47.252847] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T21:06:47.263693] [INFO ] [REMOTE ] SES: Full fetch complete (75647 records). [2025-10-28T21:06:47.263829] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-28T21:06:47.645176] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-28T21:06:47.645238] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-28T21:06:47.646396] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-28T21:06:47.646461] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-28T21:06:47.647895] [DEBUG] [LOCAL ] SES: Trimmed 75647 records to 51656 (keeping 200 days of data) [2025-10-28T21:06:47.936526] [DEBUG] [LOCAL ] SES: Primary data saved (51656 records). [2025-10-28T21:06:47.936674] [INFO ] [MAIN ] SES: Full history saved. [2025-10-28T21:06:47.936799] [INFO ] [MAIN ] Update Progress: 1895/2366 symbols completed. SES took 53.3s. Estimated remaining: 1h 1m 20s. Rate: 7.7 symbols/min [2025-10-28T21:06:47.989438] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-28T21:06:48.108533] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:48.120966] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T21:06:48.162946] [DEBUG] [LOCAL ] SGHC: Loaded 47273 existing records from primary storage. [2025-10-28T21:06:48.163260] [INFO ] [MAIN ] SGHC: Loaded 47273 existing records. [2025-10-28T21:06:48.337866] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:06:48.338084] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-28T21:06:48.338130] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-28T21:06:48.338484] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-28T21:06:48.338540] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-28T21:06:48.686484] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:48.780210] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-28T21:06:49.576076] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T21:06:49.586482] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-28T21:06:50.224866] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T21:06:50.380251] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-28T21:06:50.447227] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:06:51.180254] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-28T21:06:51.749570] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T21:06:51.980283] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-28T21:06:52.254290] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T21:06:52.259343] [INFO ] [REMOTE ] SFBS: Full fetch complete (30664 records). [2025-10-28T21:06:52.259488] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-28T21:06:52.649918] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-28T21:06:52.650010] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-28T21:06:52.650755] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-28T21:06:52.650822] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-28T21:06:52.651588] [DEBUG] [LOCAL ] SFBS: Trimmed 30664 records to 21036 (keeping 200 days of data) [2025-10-28T21:06:52.780783] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-28T21:06:52.797916] [DEBUG] [LOCAL ] SFBS: Primary data saved (21036 records). [2025-10-28T21:06:52.798063] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-28T21:06:52.798160] [INFO ] [MAIN ] Update Progress: 1896/2366 symbols completed. SFBS took 25.3s. Estimated remaining: 1h 1m 11s. Rate: 7.7 symbols/min [2025-10-28T21:06:53.003200] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:53.003367] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-28T21:06:53.003403] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-28T21:06:53.003514] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-28T21:06:53.003556] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-28T21:06:53.003598] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-28T21:06:53.003630] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-28T21:06:53.383244] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:53.492117] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T21:06:53.580276] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-10-28T21:06:53.871700] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:06:53.872037] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-10-28T21:06:53.872130] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:06:53.872177] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-28T21:06:53.872242] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:06:53.872314] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-28T21:06:53.872377] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-28T21:06:53.872414] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-28T21:06:53.872454] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-28T21:06:53.872500] [INFO ] [MAIN ] Update Progress: 1897/2366 symbols completed. SGI took 1.1s. Estimated remaining: 1h 1m 2s. Rate: 7.7 symbols/min [2025-10-28T21:06:54.056992] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:06:54.066361] [DEBUG] [LOCAL ] SGU: Loaded 6395 existing records from primary storage. [2025-10-28T21:06:54.066572] [INFO ] [MAIN ] SGU: Loaded 6395 existing records. [2025-10-28T21:06:54.257117] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:06:54.257547] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-28T21:06:54.257733] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-28T21:06:54.258025] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-28T21:06:54.258219] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-28T21:06:54.381827] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-28T21:06:54.509743] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T21:06:54.673856] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:06:55.180292] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-28T21:06:55.980266] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-28T21:06:56.170608] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T21:06:56.378325] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T21:06:56.640385] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T21:06:56.780270] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-28T21:06:57.282455] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T21:06:57.580320] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-28T21:06:58.229404] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T21:06:58.380307] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-28T21:06:59.180261] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-28T21:06:59.718729] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:06:59.980275] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-28T21:07:00.780313] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-28T21:07:01.086836] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-28T21:07:01.562496] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T21:07:01.580242] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-28T21:07:02.054185] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:07:02.380243] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-28T21:07:02.857737] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T21:07:03.180250] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-28T21:07:03.762095] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T21:07:03.980225] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-28T21:07:04.019395] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T21:07:04.490110] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:07:04.780367] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-28T21:07:05.345242] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T21:07:05.580248] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-28T21:07:06.380257] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-28T21:07:06.995490] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T21:07:07.180245] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-28T21:07:07.729833] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T21:07:07.751968] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T21:07:07.980283] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-28T21:07:08.780250] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-28T21:07:09.392091] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:07:09.580270] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-28T21:07:10.108495] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T21:07:10.380319] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-28T21:07:10.819159] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T21:07:10.949174] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T21:07:11.180312] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-28T21:07:11.980264] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-28T21:07:12.691421] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T21:07:12.740135] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T21:07:12.741555] [INFO ] [REMOTE ] SGU: Full fetch complete (8892 records). [2025-10-28T21:07:12.741621] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-28T21:07:12.785442] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-28T21:07:13.100778] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-28T21:07:13.100850] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-28T21:07:13.101060] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-28T21:07:13.101098] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-28T21:07:13.101501] [DEBUG] [LOCAL ] SGU: Trimmed 8892 records to 6375 (keeping 200 days of data) [2025-10-28T21:07:13.139061] [DEBUG] [LOCAL ] SGU: Primary data saved (6375 records). [2025-10-28T21:07:13.139165] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-28T21:07:13.139246] [INFO ] [MAIN ] Update Progress: 1898/2366 symbols completed. SGU took 19.3s. Estimated remaining: 1h 0m 57s. Rate: 7.7 symbols/min [2025-10-28T21:07:13.306635] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:13.306833] [DEBUG] [LOCAL ] SHAK: No existing data file found in primary storage. [2025-10-28T21:07:13.306872] [WARN ] [MAIN ] SHAK: No existing data found, performing full refresh instead. [2025-10-28T21:07:13.306977] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-28T21:07:13.307019] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-28T21:07:13.307060] [DEBUG] [LOCAL ] SHAK: No primary data file found to delete. [2025-10-28T21:07:13.307093] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-28T21:07:13.584520] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-28T21:07:13.660981] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:14.380252] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-28T21:07:14.915085] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-28T21:07:14.951205] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T21:07:14.960515] [INFO ] [REMOTE ] SFL: Full fetch complete (65913 records). [2025-10-28T21:07:14.960670] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-28T21:07:15.185423] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-28T21:07:15.349442] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-28T21:07:15.349541] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-28T21:07:15.350606] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-28T21:07:15.350689] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-28T21:07:15.351977] [DEBUG] [LOCAL ] SFL: Trimmed 65913 records to 45012 (keeping 200 days of data) [2025-10-28T21:07:15.612879] [DEBUG] [LOCAL ] SFL: Primary data saved (45012 records). [2025-10-28T21:07:15.612997] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-28T21:07:15.613343] [INFO ] [MAIN ] Update Progress: 1899/2366 symbols completed. SFL took 36.2s. Estimated remaining: 1h 0m 48s. Rate: 7.7 symbols/min [2025-10-28T21:07:15.788001] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:15.812431] [DEBUG] [LOCAL ] SHCO: Loaded 24877 existing records from primary storage. [2025-10-28T21:07:15.812758] [INFO ] [MAIN ] SHCO: Loaded 24877 existing records. [2025-10-28T21:07:15.991576] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:07:15.985832] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-28T21:07:15.992735] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-28T21:07:15.992913] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-28T21:07:15.993320] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-28T21:07:15.993392] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-28T21:07:16.120499] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-28T21:07:16.382076] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:16.590972] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T21:07:16.780226] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-28T21:07:17.580270] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-28T21:07:17.782754] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T21:07:18.014710] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T21:07:18.025382] [INFO ] [REMOTE ] SG: Full fetch complete (77485 records). [2025-10-28T21:07:18.025509] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-28T21:07:18.386831] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-28T21:07:18.410781] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-28T21:07:18.410849] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-28T21:07:18.411976] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-28T21:07:18.412139] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-28T21:07:18.413567] [DEBUG] [LOCAL ] SG: Trimmed 77485 records to 53500 (keeping 200 days of data) [2025-10-28T21:07:18.714099] [DEBUG] [LOCAL ] SG: Primary data saved (53500 records). [2025-10-28T21:07:18.714222] [INFO ] [MAIN ] SG: Full history saved. [2025-10-28T21:07:18.714862] [INFO ] [MAIN ] Update Progress: 1900/2366 symbols completed. SG took 37.8s. Estimated remaining: 1h 0m 39s. Rate: 7.7 symbols/min [2025-10-28T21:07:18.888632] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:18.940268] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-28T21:07:18.940631] [INFO ] [MAIN ] SHEL: Loaded 53675 existing records. [2025-10-28T21:07:19.138873] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:07:19.150110] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-28T21:07:19.150183] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-28T21:07:19.151745] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T21:07:19.152251] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-28T21:07:19.162062] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-28T21:07:19.185392] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-28T21:07:19.408932] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T21:07:19.551388] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:19.980296] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-28T21:07:20.588568] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:07:20.780306] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-28T21:07:21.580325] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-28T21:07:21.658839] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T21:07:22.302745] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T21:07:22.380223] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-28T21:07:22.616854] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T21:07:23.180291] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-28T21:07:23.980280] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-28T21:07:24.252107] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-28T21:07:24.593401] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:07:24.780237] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-28T21:07:25.400389] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T21:07:25.580320] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-28T21:07:26.380312] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-28T21:07:26.547368] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T21:07:26.860585] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-28T21:07:27.180301] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-28T21:07:27.695558] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T21:07:27.706373] [INFO ] [REMOTE ] SGHC: Full fetch complete (66192 records). [2025-10-28T21:07:27.706528] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-28T21:07:27.985414] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-28T21:07:28.105723] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-28T21:07:28.105811] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-28T21:07:28.106865] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-28T21:07:28.106927] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-28T21:07:28.108151] [DEBUG] [LOCAL ] SGHC: Trimmed 66192 records to 47336 (keeping 200 days of data) [2025-10-28T21:07:28.380992] [DEBUG] [LOCAL ] SGHC: Primary data saved (47336 records). [2025-10-28T21:07:28.381114] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-28T21:07:28.381190] [INFO ] [MAIN ] Update Progress: 1901/2366 symbols completed. SGHC took 40.4s. Estimated remaining: 1h 0m 31s. Rate: 7.7 symbols/min [2025-10-28T21:07:28.555096] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:28.581097] [DEBUG] [LOCAL ] SHG: Loaded 26469 existing records from primary storage. [2025-10-28T21:07:28.581329] [INFO ] [MAIN ] SHG: Loaded 26469 existing records. [2025-10-28T21:07:28.768311] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:07:28.768638] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-28T21:07:28.768726] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-28T21:07:28.769142] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-28T21:07:28.769201] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-28T21:07:28.814264] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-28T21:07:29.093193] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T21:07:29.180814] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:29.580207] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-28T21:07:29.621382] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T21:07:30.192557] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-28T21:07:30.380254] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-28T21:07:31.069299] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T21:07:31.180327] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-28T21:07:31.980254] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-28T21:07:32.060885] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-28T21:07:32.504955] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T21:07:32.780252] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-28T21:07:32.883924] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T21:07:33.476072] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T21:07:33.580216] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-28T21:07:34.380221] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-28T21:07:34.583938] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T21:07:35.180261] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-28T21:07:35.391749] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T21:07:35.980224] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-28T21:07:36.458534] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:07:36.780254] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-28T21:07:37.580262] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-28T21:07:37.675320] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T21:07:38.284635] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T21:07:38.380246] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-28T21:07:38.651334] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:07:39.180265] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-28T21:07:39.792215] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T21:07:39.980256] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-28T21:07:40.231481] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T21:07:40.780249] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-28T21:07:41.580252] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-28T21:07:41.750603] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T21:07:42.380292] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-28T21:07:42.543634] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T21:07:42.562062] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T21:07:43.180258] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-28T21:07:43.346815] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T21:07:43.980354] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-28T21:07:44.013342] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T21:07:44.780271] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-28T21:07:45.580306] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-28T21:07:45.815622] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T21:07:45.856201] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-28T21:07:46.380327] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-28T21:07:46.973133] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T21:07:46.983358] [INFO ] [REMOTE ] SHAK: Full fetch complete (71182 records). [2025-10-28T21:07:46.983561] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-28T21:07:47.194385] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-28T21:07:47.398361] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-28T21:07:47.398460] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-28T21:07:47.399550] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-28T21:07:47.399615] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-28T21:07:47.401097] [DEBUG] [LOCAL ] SHAK: Trimmed 71182 records to 48515 (keeping 200 days of data) [2025-10-28T21:07:47.694467] [DEBUG] [LOCAL ] SHAK: Primary data saved (48515 records). [2025-10-28T21:07:47.694606] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-28T21:07:47.694729] [INFO ] [MAIN ] Update Progress: 1902/2366 symbols completed. SHAK took 34.6s. Estimated remaining: 1h 0m 26s. Rate: 7.7 symbols/min [2025-10-28T21:07:47.868318] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:47.868558] [DEBUG] [LOCAL ] SHO: No existing data file found in primary storage. [2025-10-28T21:07:47.868621] [WARN ] [MAIN ] SHO: No existing data found, performing full refresh instead. [2025-10-28T21:07:47.868892] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-28T21:07:47.868939] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-28T21:07:47.869064] [DEBUG] [LOCAL ] SHO: No primary data file found to delete. [2025-10-28T21:07:47.869130] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-28T21:07:47.985195] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-28T21:07:48.279386] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:48.290469] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-28T21:07:48.303970] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T21:07:48.317913] [INFO ] [REMOTE ] SHCO: Full fetch complete (37700 records). [2025-10-28T21:07:48.318017] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-28T21:07:48.704244] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-28T21:07:48.704361] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-28T21:07:48.705212] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-28T21:07:48.705273] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-28T21:07:48.706170] [DEBUG] [LOCAL ] SHCO: Trimmed 37700 records to 24825 (keeping 200 days of data) [2025-10-28T21:07:48.787399] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-28T21:07:48.850131] [DEBUG] [LOCAL ] SHCO: Primary data saved (24825 records). [2025-10-28T21:07:48.850508] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-28T21:07:48.850692] [INFO ] [MAIN ] Update Progress: 1903/2366 symbols completed. SHCO took 33.2s. Estimated remaining: 1h 0m 17s. Rate: 7.7 symbols/min [2025-10-28T21:07:48.965299] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T21:07:49.052399] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:49.057598] [DEBUG] [LOCAL ] SHOC: Loaded 2916 existing records from primary storage. [2025-10-28T21:07:49.057786] [INFO ] [MAIN ] SHOC: Loaded 2916 existing records. [2025-10-28T21:07:49.239063] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:07:49.239292] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-28T21:07:49.239341] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-28T21:07:49.239568] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-28T21:07:49.239704] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-28T21:07:49.587869] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-28T21:07:49.592724] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:50.380239] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-28T21:07:50.446743] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:07:51.036358] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-28T21:07:51.047157] [INFO ] [REMOTE ] SHEL: Full fetch complete (77838 records). [2025-10-28T21:07:51.047309] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-28T21:07:51.193568] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-28T21:07:51.454518] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-28T21:07:51.454597] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-28T21:07:51.455735] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-28T21:07:51.455798] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-28T21:07:51.457271] [DEBUG] [LOCAL ] SHEL: Trimmed 77838 records to 53675 (keeping 200 days of data) [2025-10-28T21:07:51.791152] [DEBUG] [LOCAL ] SHEL: Primary data saved (53675 records). [2025-10-28T21:07:51.791295] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-28T21:07:51.791951] [INFO ] [MAIN ] Update Progress: 1904/2366 symbols completed. SHEL took 33.1s. Estimated remaining: 1h 0m 8s. Rate: 7.7 symbols/min [2025-10-28T21:07:51.998235] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-28T21:07:52.001248] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:52.002174] [DEBUG] [LOCAL ] SHW: No existing data file found in primary storage. [2025-10-28T21:07:52.002229] [WARN ] [MAIN ] SHW: No existing data found, performing full refresh instead. [2025-10-28T21:07:52.002364] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-28T21:07:52.002419] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-28T21:07:52.002464] [DEBUG] [LOCAL ] SHW: No primary data file found to delete. [2025-10-28T21:07:52.002499] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-28T21:07:52.369067] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:52.385751] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T21:07:52.392068] [INFO ] [REMOTE ] SHG: Full fetch complete (41383 records). [2025-10-28T21:07:52.392172] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-28T21:07:52.763789] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-28T21:07:52.777052] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-28T21:07:52.777148] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-28T21:07:52.778060] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-28T21:07:52.778123] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-28T21:07:52.779069] [DEBUG] [LOCAL ] SHG: Trimmed 41383 records to 26435 (keeping 200 days of data) [2025-10-28T21:07:52.780210] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-28T21:07:52.934181] [DEBUG] [LOCAL ] SHG: Primary data saved (26435 records). [2025-10-28T21:07:52.934311] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-28T21:07:52.934388] [INFO ] [MAIN ] Update Progress: 1905/2366 symbols completed. SHG took 24.6s. Estimated remaining: 59m 58s. Rate: 7.7 symbols/min [2025-10-28T21:07:53.102775] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:53.102934] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-28T21:07:53.102994] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-28T21:07:53.103103] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-28T21:07:53.103144] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-28T21:07:53.103185] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-28T21:07:53.103218] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-28T21:07:53.491862] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:53.503882] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T21:07:53.580235] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-10-28T21:07:53.695066] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T21:07:53.821354] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:07:53.821724] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-10-28T21:07:53.821814] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:07:53.821888] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-28T21:07:53.821952] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:07:53.822022] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-28T21:07:53.822087] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-28T21:07:53.822122] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-28T21:07:53.822161] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-28T21:07:53.822208] [INFO ] [MAIN ] Update Progress: 1906/2366 symbols completed. SI took 0.9s. Estimated remaining: 59m 49s. Rate: 7.7 symbols/min [2025-10-28T21:07:53.996092] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:07:54.036818] [DEBUG] [LOCAL ] SID: Loaded 42838 existing records from primary storage. [2025-10-28T21:07:54.037097] [INFO ] [MAIN ] SID: Loaded 42838 existing records. [2025-10-28T21:07:54.214932] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:07:54.215148] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-28T21:07:54.215196] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-28T21:07:54.215746] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-28T21:07:54.215806] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-28T21:07:54.386358] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-28T21:07:54.572499] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:07:55.180243] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-28T21:07:55.866853] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T21:07:55.980242] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-28T21:07:56.305718] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:07:56.780242] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-28T21:07:57.585415] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-28T21:07:57.601293] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T21:07:58.338727] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T21:07:58.380242] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-28T21:07:58.529362] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-28T21:07:58.884765] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T21:07:59.180322] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-28T21:07:59.980288] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-28T21:08:00.584372] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T21:08:00.780300] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-28T21:08:01.168635] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-28T21:08:01.580255] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-28T21:08:02.380264] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-28T21:08:02.583160] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-28T21:08:03.104683] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T21:08:03.180229] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-28T21:08:03.507360] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:08:03.980262] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-28T21:08:04.787795] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-28T21:08:04.790555] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T21:08:05.195041] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:08:05.580254] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-28T21:08:06.140153] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T21:08:06.380240] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-28T21:08:06.832077] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T21:08:07.180287] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-28T21:08:07.809496] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T21:08:07.980263] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-28T21:08:08.720137] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T21:08:08.780692] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-28T21:08:09.189382] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T21:08:09.355465] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T21:08:09.580299] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-28T21:08:10.380271] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-28T21:08:11.084922] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T21:08:11.180261] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-28T21:08:11.891273] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T21:08:11.980274] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-28T21:08:12.371084] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T21:08:12.780275] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-28T21:08:13.424143] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T21:08:13.580312] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-28T21:08:14.380259] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-28T21:08:14.724118] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-28T21:08:14.880695] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T21:08:15.180235] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-28T21:08:15.711915] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T21:08:15.840107] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T21:08:15.980222] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-28T21:08:16.780263] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-28T21:08:17.580259] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-28T21:08:17.678185] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-28T21:08:18.064333] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T21:08:18.214159] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T21:08:18.380247] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-28T21:08:18.878214] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T21:08:18.879490] [INFO ] [REMOTE ] SHOC: Full fetch complete (6638 records). [2025-10-28T21:08:18.879558] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-28T21:08:19.187505] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-28T21:08:19.230238] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-28T21:08:19.230310] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-28T21:08:19.230518] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-28T21:08:19.230557] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-28T21:08:19.230970] [DEBUG] [LOCAL ] SHOC: Trimmed 6638 records to 2907 (keeping 200 days of data) [2025-10-28T21:08:19.249348] [DEBUG] [LOCAL ] SHOC: Primary data saved (2907 records). [2025-10-28T21:08:19.249440] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-28T21:08:19.249511] [INFO ] [MAIN ] Update Progress: 1907/2366 symbols completed. SHOC took 30.4s. Estimated remaining: 59m 45s. Rate: 7.7 symbols/min [2025-10-28T21:08:19.415678] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:08:19.415862] [DEBUG] [LOCAL ] SIG: No existing data file found in primary storage. [2025-10-28T21:08:19.415898] [WARN ] [MAIN ] SIG: No existing data found, performing full refresh instead. [2025-10-28T21:08:19.416031] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-28T21:08:19.416080] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-28T21:08:19.416127] [DEBUG] [LOCAL ] SIG: No primary data file found to delete. [2025-10-28T21:08:19.416158] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-28T21:08:19.765102] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:08:19.980244] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-28T21:08:20.592346] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T21:08:20.780281] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-28T21:08:21.342568] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T21:08:21.580251] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-28T21:08:22.380289] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-28T21:08:22.513341] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T21:08:22.524704] [INFO ] [REMOTE ] SHW: Full fetch complete (73408 records). [2025-10-28T21:08:22.524908] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-28T21:08:22.959458] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-28T21:08:22.959666] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-28T21:08:22.960912] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-28T21:08:22.960976] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-28T21:08:22.962410] [DEBUG] [LOCAL ] SHW: Trimmed 73408 records to 50365 (keeping 200 days of data) [2025-10-28T21:08:23.182092] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-28T21:08:23.285414] [DEBUG] [LOCAL ] SHW: Primary data saved (50365 records). [2025-10-28T21:08:23.285554] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-28T21:08:23.285627] [INFO ] [MAIN ] Update Progress: 1908/2366 symbols completed. SHW took 31.5s. Estimated remaining: 59m 37s. Rate: 7.7 symbols/min [2025-10-28T21:08:23.469196] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-28T21:08:23.501942] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:08:23.535470] [DEBUG] [LOCAL ] SII: Loaded 23928 existing records from primary storage. [2025-10-28T21:08:23.535743] [INFO ] [MAIN ] SII: Loaded 23928 existing records. [2025-10-28T21:08:23.748965] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:08:23.744523] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T21:08:23.757091] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-28T21:08:23.757503] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-28T21:08:23.757890] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-28T21:08:23.758233] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-28T21:08:23.986624] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-28T21:08:24.109500] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:08:24.313913] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T21:08:24.322766] [INFO ] [REMOTE ] SHO: Full fetch complete (70594 records). [2025-10-28T21:08:24.322854] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-28T21:08:24.702461] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-28T21:08:24.702539] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-28T21:08:24.703727] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-28T21:08:24.703825] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-28T21:08:24.705601] [DEBUG] [LOCAL ] SHO: Trimmed 70594 records to 48792 (keeping 200 days of data) [2025-10-28T21:08:24.795692] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-28T21:08:25.031282] [DEBUG] [LOCAL ] SHO: Primary data saved (48792 records). [2025-10-28T21:08:25.031477] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-28T21:08:25.031569] [INFO ] [MAIN ] Update Progress: 1909/2366 symbols completed. SHO took 37.3s. Estimated remaining: 59m 27s. Rate: 7.7 symbols/min [2025-10-28T21:08:25.221950] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:08:25.254980] [DEBUG] [LOCAL ] SILA: Loaded 29508 existing records from primary storage. [2025-10-28T21:08:25.255348] [INFO ] [MAIN ] SILA: Loaded 29508 existing records. [2025-10-28T21:08:25.445514] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:08:25.445961] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-28T21:08:25.446211] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-28T21:08:25.446762] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-28T21:08:25.446945] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-28T21:08:25.583820] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-28T21:08:25.735342] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-28T21:08:25.882128] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:08:25.989826] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T21:08:25.999478] [INFO ] [REMOTE ] SID: Full fetch complete (61144 records). [2025-10-28T21:08:25.999603] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-28T21:08:26.386789] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-28T21:08:26.403737] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-28T21:08:26.403825] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-28T21:08:26.405052] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-28T21:08:26.405225] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-28T21:08:26.406773] [DEBUG] [LOCAL ] SID: Trimmed 61144 records to 42915 (keeping 200 days of data) [2025-10-28T21:08:26.512561] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T21:08:26.662169] [DEBUG] [LOCAL ] SID: Primary data saved (42915 records). [2025-10-28T21:08:26.662319] [INFO ] [MAIN ] SID: Full history saved. [2025-10-28T21:08:26.662407] [INFO ] [MAIN ] Update Progress: 1910/2366 symbols completed. SID took 32.8s. Estimated remaining: 59m 18s. Rate: 7.7 symbols/min [2025-10-28T21:08:26.829212] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:08:26.829364] [DEBUG] [LOCAL ] SITC: No existing data file found in primary storage. [2025-10-28T21:08:26.829400] [WARN ] [MAIN ] SITC: No existing data found, performing full refresh instead. [2025-10-28T21:08:26.829510] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-28T21:08:26.829550] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-28T21:08:26.829590] [DEBUG] [LOCAL ] SITC: No primary data file found to delete. [2025-10-28T21:08:26.829621] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-28T21:08:27.170058] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:08:27.180210] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-28T21:08:27.911592] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T21:08:27.980260] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-28T21:08:28.433358] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T21:08:28.708345] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T21:08:28.780233] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-28T21:08:29.580294] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-28T21:08:30.380219] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-28T21:08:30.398370] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T21:08:30.659889] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-28T21:08:31.180247] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-28T21:08:31.414167] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T21:08:31.980267] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-28T21:08:32.308880] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:08:32.780263] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-28T21:08:33.580225] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-28T21:08:33.972164] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-28T21:08:34.189698] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T21:08:34.380282] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-28T21:08:34.640302] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T21:08:35.180298] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-28T21:08:35.526433] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T21:08:35.980239] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-28T21:08:36.545004] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T21:08:36.780298] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-28T21:08:37.156764] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T21:08:37.580257] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-28T21:08:37.906842] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T21:08:38.380235] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-28T21:08:39.119068] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T21:08:39.180247] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-28T21:08:39.434682] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T21:08:39.980263] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-28T21:08:40.596989] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T21:08:40.780299] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-28T21:08:41.071969] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T21:08:41.573941] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T21:08:41.580213] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-28T21:08:42.380240] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-28T21:08:42.570388] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T21:08:43.180315] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-28T21:08:43.616096] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T21:08:43.980292] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-28T21:08:44.592730] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T21:08:44.780224] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-28T21:08:44.856236] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T21:08:45.580261] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-28T21:08:45.989795] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:08:46.380298] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-28T21:08:46.873308] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T21:08:46.881627] [INFO ] [REMOTE ] SIG: Full fetch complete (67176 records). [2025-10-28T21:08:46.881769] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-28T21:08:47.185397] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-28T21:08:47.270560] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-28T21:08:47.270634] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-28T21:08:47.271744] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-28T21:08:47.271803] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-28T21:08:47.273028] [DEBUG] [LOCAL ] SIG: Trimmed 67176 records to 44739 (keeping 200 days of data) [2025-10-28T21:08:47.525354] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T21:08:47.584000] [DEBUG] [LOCAL ] SIG: Primary data saved (44739 records). [2025-10-28T21:08:47.584121] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-28T21:08:47.584190] [INFO ] [MAIN ] Update Progress: 1911/2366 symbols completed. SIG took 28.3s. Estimated remaining: 59m 13s. Rate: 7.7 symbols/min [2025-10-28T21:08:47.752228] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:08:47.787408] [DEBUG] [LOCAL ] SITE: Loaded 35349 existing records from primary storage. [2025-10-28T21:08:47.787709] [INFO ] [MAIN ] SITE: Loaded 35349 existing records. [2025-10-28T21:08:47.967203] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:08:47.967447] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-28T21:08:47.967500] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-28T21:08:47.967956] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-28T21:08:47.968012] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-28T21:08:47.988427] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-28T21:08:48.348679] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:08:48.350092] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:08:48.780309] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-28T21:08:49.505824] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T21:08:49.580200] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-28T21:08:49.750310] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T21:08:49.758083] [INFO ] [REMOTE ] SII: Full fetch complete (31752 records). [2025-10-28T21:08:49.758237] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-28T21:08:50.127177] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-28T21:08:50.127285] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-28T21:08:50.128170] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-28T21:08:50.128252] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-28T21:08:50.129325] [DEBUG] [LOCAL ] SII: Trimmed 31752 records to 23836 (keeping 200 days of data) [2025-10-28T21:08:50.282295] [DEBUG] [LOCAL ] SII: Primary data saved (23836 records). [2025-10-28T21:08:50.282416] [INFO ] [MAIN ] SII: Full history saved. [2025-10-28T21:08:50.282491] [INFO ] [MAIN ] Update Progress: 1912/2366 symbols completed. SII took 27.0s. Estimated remaining: 59m 4s. Rate: 7.7 symbols/min [2025-10-28T21:08:50.381309] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-28T21:08:50.449202] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:08:50.449331] [DEBUG] [LOCAL ] SJM: No existing data file found in primary storage. [2025-10-28T21:08:50.449368] [WARN ] [MAIN ] SJM: No existing data found, performing full refresh instead. [2025-10-28T21:08:50.449472] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-28T21:08:50.449512] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-28T21:08:50.449551] [DEBUG] [LOCAL ] SJM: No primary data file found to delete. [2025-10-28T21:08:50.449582] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-28T21:08:50.823581] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:08:50.852900] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T21:08:51.180231] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-28T21:08:51.732094] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T21:08:51.980269] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-28T21:08:52.474296] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T21:08:52.780250] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-28T21:08:53.002682] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T21:08:53.580229] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-28T21:08:53.653264] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T21:08:54.380263] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-28T21:08:55.046990] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T21:08:55.180224] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-28T21:08:55.551469] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T21:08:55.980277] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-28T21:08:56.667441] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T21:08:56.780235] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-28T21:08:56.887606] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T21:08:57.580257] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-28T21:08:58.122458] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:08:58.380345] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-28T21:08:58.586084] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T21:08:59.180307] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-28T21:08:59.810133] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T21:08:59.980248] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-28T21:09:00.052451] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T21:09:00.780260] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-28T21:09:01.424441] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T21:09:01.580340] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-28T21:09:01.951718] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:09:01.958696] [INFO ] [REMOTE ] SILA: Full fetch complete (44067 records). [2025-10-28T21:09:01.958892] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-28T21:09:02.385443] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-28T21:09:02.449813] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-28T21:09:02.449954] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-28T21:09:02.451881] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-28T21:09:02.452148] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-28T21:09:02.454005] [DEBUG] [LOCAL ] SILA: Trimmed 44067 records to 29405 (keeping 200 days of data) [2025-10-28T21:09:02.657461] [DEBUG] [LOCAL ] SILA: Primary data saved (29405 records). [2025-10-28T21:09:02.657688] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-28T21:09:02.657826] [INFO ] [MAIN ] Update Progress: 1913/2366 symbols completed. SILA took 37.6s. Estimated remaining: 58m 58s. Rate: 7.7 symbols/min [2025-10-28T21:09:02.847476] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:02.872138] [DEBUG] [LOCAL ] SJT: Loaded 22426 existing records from primary storage. [2025-10-28T21:09:02.872480] [INFO ] [MAIN ] SJT: Loaded 22426 existing records. [2025-10-28T21:09:03.052257] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T21:09:03.099604] [INFO ] [REMOTE ] SITC: Full fetch complete (60744 records). [2025-10-28T21:09:03.123851] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-28T21:09:03.123716] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:09:03.124176] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-28T21:09:03.124271] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-28T21:09:03.129953] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-28T21:09:03.170176] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-28T21:09:03.197776] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-28T21:09:03.969301] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-28T21:09:03.969151] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:03.969877] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-28T21:09:03.971950] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-28T21:09:03.972243] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-28T21:09:03.974581] [DEBUG] [LOCAL ] SITC: Trimmed 60744 records to 41657 (keeping 200 days of data) [2025-10-28T21:09:04.033218] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-28T21:09:04.267448] [DEBUG] [LOCAL ] SITC: Primary data saved (41657 records). [2025-10-28T21:09:04.267615] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-28T21:09:04.267752] [INFO ] [MAIN ] Update Progress: 1914/2366 symbols completed. SITC took 37.6s. Estimated remaining: 58m 48s. Rate: 7.7 symbols/min [2025-10-28T21:09:04.444991] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-28T21:09:04.588985] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:04.628512] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:09:04.674552] [DEBUG] [LOCAL ] SKE: Loaded 37289 existing records from primary storage. [2025-10-28T21:09:04.674911] [INFO ] [MAIN ] SKE: Loaded 37289 existing records. [2025-10-28T21:09:04.785399] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-28T21:09:04.874546] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:09:04.874796] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-28T21:09:04.874849] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-28T21:09:04.875333] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-28T21:09:04.875464] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-28T21:09:05.241452] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:05.580243] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-28T21:09:05.645676] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T21:09:06.045911] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:09:06.380251] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-28T21:09:07.017512] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T21:09:07.180289] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-28T21:09:07.259728] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T21:09:07.980302] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-28T21:09:08.216438] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T21:09:08.780262] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-28T21:09:09.580254] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-28T21:09:09.721682] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T21:09:09.906630] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T21:09:10.380217] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-28T21:09:10.427851] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T21:09:11.180240] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-28T21:09:11.700850] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T21:09:11.712125] [INFO ] [REMOTE ] SJM: Full fetch complete (72269 records). [2025-10-28T21:09:11.712302] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-28T21:09:11.991744] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-28T21:09:12.131749] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-28T21:09:12.131850] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-28T21:09:12.133196] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-28T21:09:12.133276] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-28T21:09:12.134909] [DEBUG] [LOCAL ] SJM: Trimmed 72269 records to 49994 (keeping 200 days of data) [2025-10-28T21:09:12.267769] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T21:09:12.467801] [DEBUG] [LOCAL ] SJM: Primary data saved (49994 records). [2025-10-28T21:09:12.467931] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-28T21:09:12.468001] [INFO ] [MAIN ] Update Progress: 1915/2366 symbols completed. SJM took 22.2s. Estimated remaining: 58m 41s. Rate: 7.7 symbols/min [2025-10-28T21:09:12.635537] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:12.645377] [DEBUG] [LOCAL ] SKIL: Loaded 7006 existing records from primary storage. [2025-10-28T21:09:12.645593] [INFO ] [MAIN ] SKIL: Loaded 7006 existing records. [2025-10-28T21:09:12.785489] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-28T21:09:12.823117] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:09:12.823348] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-28T21:09:12.823415] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-28T21:09:12.823634] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-28T21:09:12.823718] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-28T21:09:13.197075] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:13.215229] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T21:09:13.580257] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-28T21:09:13.827421] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T21:09:14.380258] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-28T21:09:14.510285] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T21:09:15.180300] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-28T21:09:15.342796] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T21:09:15.980348] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-28T21:09:16.236333] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T21:09:16.780248] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-28T21:09:16.824785] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T21:09:17.580308] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-28T21:09:18.108226] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T21:09:18.380222] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-28T21:09:18.508096] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T21:09:19.180321] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-28T21:09:19.793007] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T21:09:19.980223] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-28T21:09:20.261982] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T21:09:20.529686] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T21:09:20.780249] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-28T21:09:21.580329] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-28T21:09:21.883996] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T21:09:22.169786] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T21:09:22.380285] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-28T21:09:22.970920] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T21:09:23.180322] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-28T21:09:23.808723] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T21:09:23.980345] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-28T21:09:24.780247] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-28T21:09:24.843353] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T21:09:25.580309] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-28T21:09:26.380217] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-28T21:09:26.545032] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T21:09:26.569953] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-28T21:09:26.948320] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T21:09:27.180288] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-28T21:09:27.980317] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-28T21:09:28.323149] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T21:09:28.530718] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T21:09:28.780266] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-28T21:09:29.588379] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-28T21:09:29.592170] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T21:09:29.597474] [INFO ] [REMOTE ] SJT: Full fetch complete (31892 records). [2025-10-28T21:09:29.597591] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-28T21:09:29.991348] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-28T21:09:29.991464] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-28T21:09:29.992186] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-28T21:09:29.992247] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-28T21:09:29.993129] [DEBUG] [LOCAL ] SJT: Trimmed 31892 records to 22327 (keeping 200 days of data) [2025-10-28T21:09:30.114695] [DEBUG] [LOCAL ] SJT: Primary data saved (22327 records). [2025-10-28T21:09:30.114813] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-28T21:09:30.114887] [INFO ] [MAIN ] Update Progress: 1916/2366 symbols completed. SJT took 27.5s. Estimated remaining: 58m 35s. Rate: 7.7 symbols/min [2025-10-28T21:09:30.284580] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:30.296895] [DEBUG] [LOCAL ] SKLZ: Loaded 11398 existing records from primary storage. [2025-10-28T21:09:30.297123] [INFO ] [MAIN ] SKLZ: Loaded 11398 existing records. [2025-10-28T21:09:30.387135] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-28T21:09:30.478634] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:09:30.478927] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-28T21:09:30.478977] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-28T21:09:30.479191] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-28T21:09:30.479249] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-28T21:09:30.837052] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:30.866112] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T21:09:31.180253] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-28T21:09:31.589819] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T21:09:31.976744] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T21:09:31.980893] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-28T21:09:32.629043] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T21:09:32.780319] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-28T21:09:33.580298] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-28T21:09:34.380232] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-28T21:09:34.421782] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T21:09:34.779294] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T21:09:34.787849] [INFO ] [REMOTE ] SITE: Full fetch complete (51151 records). [2025-10-28T21:09:34.787995] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-28T21:09:35.181558] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T21:09:35.181635] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-28T21:09:35.203206] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-28T21:09:35.203583] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-28T21:09:35.204526] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-28T21:09:35.204587] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-28T21:09:35.205533] [DEBUG] [LOCAL ] SITE: Trimmed 51151 records to 35338 (keeping 200 days of data) [2025-10-28T21:09:35.420608] [DEBUG] [LOCAL ] SITE: Primary data saved (35338 records). [2025-10-28T21:09:35.420753] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-28T21:09:35.421094] [INFO ] [MAIN ] Update Progress: 1917/2366 symbols completed. SITE took 47.8s. Estimated remaining: 58m 27s. Rate: 7.7 symbols/min [2025-10-28T21:09:35.980253] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-28T21:09:36.702152] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T21:09:36.730990] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T21:09:36.740249] [INFO ] [REMOTE ] SKE: Full fetch complete (52791 records). [2025-10-28T21:09:36.740368] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-28T21:09:36.785345] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-28T21:09:37.127262] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-28T21:09:37.127331] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-28T21:09:37.128251] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-28T21:09:37.128311] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-28T21:09:37.129300] [DEBUG] [LOCAL ] SKE: Trimmed 52791 records to 37297 (keeping 200 days of data) [2025-10-28T21:09:37.342100] [DEBUG] [LOCAL ] SKE: Primary data saved (37297 records). [2025-10-28T21:09:37.342242] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-28T21:09:37.342340] [INFO ] [MAIN ] Update Progress: 1918/2366 symbols completed. SKE took 33.1s. Estimated remaining: 58m 18s. Rate: 7.7 symbols/min [2025-10-28T21:09:37.521128] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T21:09:37.580204] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-28T21:09:38.117008] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T21:09:38.380263] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-28T21:09:39.125182] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T21:09:39.180244] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-28T21:09:39.909411] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T21:09:39.980220] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-28T21:09:40.780322] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-28T21:09:41.047893] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:09:41.368881] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T21:09:41.580320] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-28T21:09:42.180025] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T21:09:42.380261] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-28T21:09:43.106810] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T21:09:43.109548] [INFO ] [REMOTE ] SKLZ: Full fetch complete (17516 records). [2025-10-28T21:09:43.109628] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-28T21:09:43.191616] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-28T21:09:43.545394] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-28T21:09:43.545466] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-28T21:09:43.545898] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-28T21:09:43.545986] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-28T21:09:43.546588] [DEBUG] [LOCAL ] SKLZ: Trimmed 17516 records to 11329 (keeping 200 days of data) [2025-10-28T21:09:43.615211] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11329 records). [2025-10-28T21:09:43.615350] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-28T21:09:43.615429] [INFO ] [MAIN ] Update Progress: 1919/2366 symbols completed. SKLZ took 13.5s. Estimated remaining: 58m 9s. Rate: 7.7 symbols/min [2025-10-28T21:09:43.922411] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T21:09:43.925475] [INFO ] [REMOTE ] SKIL: Full fetch complete (10543 records). [2025-10-28T21:09:43.925575] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-28T21:09:44.286055] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-28T21:09:44.286148] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-28T21:09:44.286470] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-28T21:09:44.286529] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-28T21:09:44.287030] [DEBUG] [LOCAL ] SKIL: Trimmed 10543 records to 7092 (keeping 200 days of data) [2025-10-28T21:09:44.326381] [DEBUG] [LOCAL ] SKIL: Primary data saved (7092 records). [2025-10-28T21:09:44.326466] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-28T21:09:44.326541] [INFO ] [MAIN ] Update Progress: 1920/2366 symbols completed. SKIL took 31.9s. Estimated remaining: 58m 0s. Rate: 7.7 symbols/min [2025-10-28T21:09:44.930493] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:45.045686] [DEBUG] [LOCAL ] SKY: No existing data file found in primary storage. [2025-10-28T21:09:45.028183] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:44.979470] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:45.047270] [WARN ] [MAIN ] SKY: No existing data found, performing full refresh instead. [2025-10-28T21:09:45.067489] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-28T21:09:45.070012] [DEBUG] [LOCAL ] SKT: No existing data file found in primary storage. [2025-10-28T21:09:45.067674] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-28T21:09:45.071240] [WARN ] [MAIN ] SKT: No existing data found, performing full refresh instead. [2025-10-28T21:09:45.070767] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:09:45.071507] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-28T21:09:45.071691] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-10-28T21:09:45.071831] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-28T21:09:45.071794] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-28T21:09:45.077184] [DEBUG] [LOCAL ] SKT: No primary data file found to delete. [2025-10-28T21:09:45.077266] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-28T21:09:45.294852] [DEBUG] [LOCAL ] SKYH: Loaded 15393 existing records from primary storage. [2025-10-28T21:09:45.327717] [INFO ] [MAIN ] SKYH: Loaded 15393 existing records. [2025-10-28T21:09:45.591985] [DEBUG] [LOCAL ] SKM: Loaded 35082 existing records from primary storage. [2025-10-28T21:09:45.678726] [INFO ] [MAIN ] SKM: Loaded 35082 existing records. [2025-10-28T21:09:46.163757] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:46.230374] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:46.239250] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-28T21:09:46.242857] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:09:46.249815] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-28T21:09:46.255222] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-28T21:09:46.282688] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-28T21:09:46.309047] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-28T21:09:46.315255] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:09:46.315532] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-28T21:09:46.320990] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-28T21:09:46.334882] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-28T21:09:46.366020] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-28T21:09:46.394375] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-28T21:09:47.070732] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:47.087358] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-28T21:09:47.092078] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:09:47.092396] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-28T21:09:47.418902] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:09:47.426288] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-28T21:09:47.531229] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T21:09:47.774763] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T21:09:47.980225] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-28T21:09:47.996512] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T21:09:48.780378] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-28T21:09:49.212049] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T21:09:49.370715] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T21:09:49.505059] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T21:09:49.580226] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-28T21:09:50.385137] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-28T21:09:50.388988] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T21:09:51.180263] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-28T21:09:51.764975] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T21:09:51.980233] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-28T21:09:52.481539] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T21:09:52.780267] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-28T21:09:53.209462] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T21:09:53.580240] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-28T21:09:53.921281] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:09:54.380279] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-28T21:09:54.566821] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T21:09:55.180263] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-28T21:09:55.724734] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:09:55.980270] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-28T21:09:56.130705] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T21:09:56.690396] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T21:09:56.780223] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-28T21:09:57.548218] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T21:09:57.580220] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-28T21:09:58.312604] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T21:09:58.380211] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-28T21:09:59.180289] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-28T21:09:59.528873] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:09:59.980254] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-28T21:10:00.780234] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-28T21:10:00.885240] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T21:10:01.580307] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-28T21:10:01.926808] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-28T21:10:02.170798] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T21:10:02.358707] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T21:10:02.380269] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-28T21:10:03.180311] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-28T21:10:03.645332] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T21:10:03.980340] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-28T21:10:04.719410] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T21:10:04.780273] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-28T21:10:05.580263] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-28T21:10:05.742014] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T21:10:06.004393] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T21:10:06.009813] [INFO ] [REMOTE ] SKYH: Full fetch complete (22353 records). [2025-10-28T21:10:06.009936] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-28T21:10:06.380258] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-28T21:10:06.408705] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-28T21:10:06.409136] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-28T21:10:06.410129] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-28T21:10:06.410382] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-28T21:10:06.411467] [DEBUG] [LOCAL ] SKYH: Trimmed 22353 records to 15303 (keeping 200 days of data) [2025-10-28T21:10:06.510250] [DEBUG] [LOCAL ] SKYH: Primary data saved (15303 records). [2025-10-28T21:10:06.510588] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-28T21:10:06.510892] [INFO ] [MAIN ] Update Progress: 1921/2366 symbols completed. SKYH took 22.2s. Estimated remaining: 57m 56s. Rate: 7.7 symbols/min [2025-10-28T21:10:06.658216] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-28T21:10:06.738263] [INFO ] [MAIN ] SLAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:06.738435] [DEBUG] [LOCAL ] SLAI: No existing data file found in primary storage. [2025-10-28T21:10:06.738472] [WARN ] [MAIN ] SLAI: No existing data found, performing full refresh instead. [2025-10-28T21:10:06.738609] [INFO ] [MAIN ] SLAI: Wiping existing primary data before full refresh. [2025-10-28T21:10:06.738694] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-28T21:10:06.738750] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-28T21:10:06.738816] [INFO ] [MAIN ] SLAI: Starting full primary refresh. [2025-10-28T21:10:07.090747] [INFO ] [REMOTE ] SLAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:07.180235] [INFO ] [REMOTE ] SLAI: Fetching primary data for 2025-01. [2025-10-28T21:10:07.449910] [DEBUG] [REMOTE ] SLAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:10:07.450190] [WARN ] [REMOTE ] SLAI: No data returned for month 2025-01 [2025-10-28T21:10:07.450276] [FATAL] [REMOTE ] SLAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:10:07.450323] [FATAL] [MAIN ] SLAI: Failed to fetch primary data. [2025-10-28T21:10:07.450382] [WARN ] [MAIN ] SLAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:10:07.450451] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-28T21:10:07.450512] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-28T21:10:07.450548] [INFO ] [LOCAL ] SLAI: Starting deletion of derivative data. [2025-10-28T21:10:07.450585] [DEBUG] [LOCAL ] SLAI: No derivative data file found to delete. [2025-10-28T21:10:07.450673] [INFO ] [MAIN ] Update Progress: 1922/2366 symbols completed. SLAI took 0.9s. Estimated remaining: 57m 46s. Rate: 7.7 symbols/min [2025-10-28T21:10:07.618179] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:07.618357] [DEBUG] [LOCAL ] SLB: No existing data file found in primary storage. [2025-10-28T21:10:07.618395] [WARN ] [MAIN ] SLB: No existing data found, performing full refresh instead. [2025-10-28T21:10:07.618502] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-28T21:10:07.618542] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-28T21:10:07.618581] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-28T21:10:07.618612] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-28T21:10:07.981096] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-28T21:10:07.984140] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:08.203893] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T21:10:08.780252] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-28T21:10:09.326720] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T21:10:09.580236] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-28T21:10:10.380316] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-28T21:10:10.746906] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T21:10:10.894020] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-28T21:10:11.180281] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-28T21:10:11.980282] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-28T21:10:12.500498] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-28T21:10:12.780289] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-28T21:10:13.313472] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-28T21:10:13.479314] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T21:10:13.580235] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-28T21:10:14.123476] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:10:14.380252] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-28T21:10:14.866131] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T21:10:14.873955] [INFO ] [REMOTE ] SKY: Full fetch complete (54214 records). [2025-10-28T21:10:14.874063] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-28T21:10:15.185474] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-28T21:10:15.255638] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-28T21:10:15.255745] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-28T21:10:15.256748] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-28T21:10:15.256807] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-28T21:10:15.257888] [DEBUG] [LOCAL ] SKY: Trimmed 54214 records to 38376 (keeping 200 days of data) [2025-10-28T21:10:15.480268] [DEBUG] [LOCAL ] SKY: Primary data saved (38376 records). [2025-10-28T21:10:15.480457] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-28T21:10:15.480536] [INFO ] [MAIN ] Update Progress: 1923/2366 symbols completed. SKY took 31.2s. Estimated remaining: 57m 38s. Rate: 7.7 symbols/min [2025-10-28T21:10:15.652090] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:15.673097] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T21:10:15.711303] [DEBUG] [LOCAL ] SLF: Loaded 37845 existing records from primary storage. [2025-10-28T21:10:15.711577] [INFO ] [MAIN ] SLF: Loaded 37845 existing records. [2025-10-28T21:10:15.883494] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:10:15.883749] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-28T21:10:15.883801] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-28T21:10:15.884298] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-28T21:10:15.884355] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-28T21:10:15.982327] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-28T21:10:16.235305] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:16.785669] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-28T21:10:16.812855] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T21:10:17.173514] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T21:10:17.181222] [INFO ] [REMOTE ] SKM: Full fetch complete (49654 records). [2025-10-28T21:10:17.181366] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-28T21:10:17.564390] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-28T21:10:17.564702] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-28T21:10:17.565743] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-28T21:10:17.565802] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-28T21:10:17.566867] [DEBUG] [LOCAL ] SKM: Trimmed 49654 records to 35072 (keeping 200 days of data) [2025-10-28T21:10:17.619562] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-28T21:10:17.779745] [DEBUG] [LOCAL ] SKM: Primary data saved (35072 records). [2025-10-28T21:10:17.779984] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-28T21:10:17.780079] [INFO ] [MAIN ] Update Progress: 1924/2366 symbols completed. SKM took 33.5s. Estimated remaining: 57m 29s. Rate: 7.7 symbols/min [2025-10-28T21:10:17.952733] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:17.952934] [DEBUG] [LOCAL ] SLG: No existing data file found in primary storage. [2025-10-28T21:10:17.953047] [WARN ] [MAIN ] SLG: No existing data found, performing full refresh instead. [2025-10-28T21:10:17.953200] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-28T21:10:17.953241] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-28T21:10:17.953283] [DEBUG] [LOCAL ] SLG: No primary data file found to delete. [2025-10-28T21:10:17.953315] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-28T21:10:18.225031] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T21:10:18.348675] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:18.380244] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-28T21:10:18.904303] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:10:19.180247] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-28T21:10:19.679436] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T21:10:19.980259] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-28T21:10:20.659334] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T21:10:20.780218] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-28T21:10:21.580253] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-28T21:10:21.852488] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-28T21:10:22.019266] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T21:10:22.027298] [INFO ] [REMOTE ] SKT: Full fetch complete (60671 records). [2025-10-28T21:10:22.027403] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-28T21:10:22.392889] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-28T21:10:22.412955] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-28T21:10:22.413027] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-28T21:10:22.414096] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-28T21:10:22.414157] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-28T21:10:22.415452] [DEBUG] [LOCAL ] SKT: Trimmed 60671 records to 41814 (keeping 200 days of data) [2025-10-28T21:10:22.657351] [DEBUG] [LOCAL ] SKT: Primary data saved (41814 records). [2025-10-28T21:10:22.657465] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-28T21:10:22.657542] [INFO ] [MAIN ] Update Progress: 1925/2366 symbols completed. SKT took 38.3s. Estimated remaining: 57m 21s. Rate: 7.7 symbols/min [2025-10-28T21:10:22.827149] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:22.827311] [DEBUG] [LOCAL ] SLGN: No existing data file found in primary storage. [2025-10-28T21:10:22.827348] [WARN ] [MAIN ] SLGN: No existing data found, performing full refresh instead. [2025-10-28T21:10:22.827451] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-28T21:10:22.827491] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-28T21:10:22.827532] [DEBUG] [LOCAL ] SLGN: No primary data file found to delete. [2025-10-28T21:10:22.827563] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-28T21:10:23.196101] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-28T21:10:23.196038] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:23.252833] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T21:10:23.980301] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-28T21:10:24.412287] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-28T21:10:24.780237] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-28T21:10:25.339961] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-28T21:10:25.371815] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T21:10:25.580240] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-28T21:10:26.121926] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:10:26.380289] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-28T21:10:26.890902] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T21:10:27.180254] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-28T21:10:27.795886] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T21:10:27.980270] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-28T21:10:28.348366] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T21:10:28.780253] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-28T21:10:29.580230] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-28T21:10:29.941181] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-28T21:10:30.154883] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T21:10:30.380240] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-28T21:10:30.818435] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T21:10:31.180218] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-28T21:10:31.601408] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T21:10:31.980306] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-28T21:10:32.780248] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-28T21:10:33.580243] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-28T21:10:33.848460] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-28T21:10:34.146027] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-28T21:10:34.358333] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T21:10:34.380208] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-28T21:10:34.985831] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T21:10:35.180244] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-28T21:10:35.677228] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:10:35.980257] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-28T21:10:36.513260] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T21:10:36.780241] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-28T21:10:37.557676] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T21:10:37.580209] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-28T21:10:38.180590] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:10:38.380243] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-28T21:10:39.180245] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-28T21:10:39.353401] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-28T21:10:39.656847] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T21:10:39.980282] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-28T21:10:40.251825] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T21:10:40.654806] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:10:40.665240] [INFO ] [REMOTE ] SLB: Full fetch complete (77487 records). [2025-10-28T21:10:40.665387] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-28T21:10:40.666241] [FATAL] [VALIDATOR ] SLB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T21:10:40.666354] [FATAL] [MAIN ] SLB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:10:40.666397] [WARN ] [MAIN ] SLB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:10:40.666462] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-28T21:10:40.666525] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-28T21:10:40.666561] [INFO ] [LOCAL ] SLB: Starting deletion of derivative data. [2025-10-28T21:10:40.666599] [DEBUG] [LOCAL ] SLB: No derivative data file found to delete. [2025-10-28T21:10:40.666675] [INFO ] [MAIN ] Update Progress: 1926/2366 symbols completed. SLB took 33.2s. Estimated remaining: 57m 15s. Rate: 7.7 symbols/min [2025-10-28T21:10:40.785424] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-28T21:10:40.849216] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:40.849370] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-28T21:10:40.849405] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-28T21:10:40.849514] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-28T21:10:40.849554] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-28T21:10:40.849594] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-28T21:10:40.849624] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-28T21:10:41.217375] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:41.580291] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-28T21:10:42.337965] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:10:42.380249] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-28T21:10:42.800120] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T21:10:43.180382] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-28T21:10:43.531226] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T21:10:43.597202] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T21:10:43.980254] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-28T21:10:44.780269] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-28T21:10:45.580272] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-28T21:10:45.833060] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T21:10:45.898541] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T21:10:46.296014] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T21:10:46.380239] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-28T21:10:47.180328] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-28T21:10:47.501492] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T21:10:47.844566] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T21:10:47.853895] [INFO ] [REMOTE ] SLG: Full fetch complete (65325 records). [2025-10-28T21:10:47.854054] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-28T21:10:47.993227] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-28T21:10:48.238675] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-28T21:10:48.238753] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-28T21:10:48.239773] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-28T21:10:48.239850] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-28T21:10:48.241055] [DEBUG] [LOCAL ] SLG: Trimmed 65325 records to 45710 (keeping 200 days of data) [2025-10-28T21:10:48.510228] [DEBUG] [LOCAL ] SLG: Primary data saved (45710 records). [2025-10-28T21:10:48.510345] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-28T21:10:48.510412] [INFO ] [MAIN ] Update Progress: 1927/2366 symbols completed. SLG took 30.7s. Estimated remaining: 57m 8s. Rate: 7.7 symbols/min [2025-10-28T21:10:48.675419] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:48.713840] [DEBUG] [LOCAL ] SLQT: Loaded 43116 existing records from primary storage. [2025-10-28T21:10:48.714157] [INFO ] [MAIN ] SLQT: Loaded 43116 existing records. [2025-10-28T21:10:48.785499] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-28T21:10:48.899618] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:10:48.899784] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-28T21:10:48.899829] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-28T21:10:48.900321] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-28T21:10:48.900379] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-28T21:10:49.254595] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:49.361622] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T21:10:49.580281] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-28T21:10:50.217627] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T21:10:50.380220] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-28T21:10:50.711106] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:10:51.180266] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-28T21:10:51.523758] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T21:10:51.777526] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T21:10:51.787009] [INFO ] [REMOTE ] SLGN: Full fetch complete (59619 records). [2025-10-28T21:10:51.787130] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-28T21:10:51.988980] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-28T21:10:52.166858] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-28T21:10:52.166930] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-28T21:10:52.167921] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-28T21:10:52.167981] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-28T21:10:52.169090] [DEBUG] [LOCAL ] SLGN: Trimmed 59619 records to 40954 (keeping 200 days of data) [2025-10-28T21:10:52.410190] [DEBUG] [LOCAL ] SLGN: Primary data saved (40954 records). [2025-10-28T21:10:52.410300] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-28T21:10:52.410367] [INFO ] [MAIN ] Update Progress: 1928/2366 symbols completed. SLGN took 29.8s. Estimated remaining: 56m 59s. Rate: 7.7 symbols/min [2025-10-28T21:10:52.575626] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:52.575811] [DEBUG] [LOCAL ] SLVM: No existing data file found in primary storage. [2025-10-28T21:10:52.575851] [WARN ] [MAIN ] SLVM: No existing data found, performing full refresh instead. [2025-10-28T21:10:52.575979] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-28T21:10:52.576031] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-28T21:10:52.576072] [DEBUG] [LOCAL ] SLVM: No primary data file found to delete. [2025-10-28T21:10:52.576147] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-28T21:10:52.785449] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-28T21:10:52.926633] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:53.162694] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:10:53.169523] [INFO ] [REMOTE ] SLF: Full fetch complete (56003 records). [2025-10-28T21:10:53.169639] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-28T21:10:53.483333] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T21:10:53.575231] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-28T21:10:53.575308] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-28T21:10:53.576312] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-28T21:10:53.576373] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-28T21:10:53.577488] [DEBUG] [LOCAL ] SLF: Trimmed 56003 records to 37723 (keeping 200 days of data) [2025-10-28T21:10:53.629526] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-28T21:10:53.802606] [DEBUG] [LOCAL ] SLF: Primary data saved (37723 records). [2025-10-28T21:10:53.802759] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-28T21:10:53.802842] [INFO ] [MAIN ] Update Progress: 1929/2366 symbols completed. SLF took 38.3s. Estimated remaining: 56m 50s. Rate: 7.7 symbols/min [2025-10-28T21:10:53.971095] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:10:53.971278] [DEBUG] [LOCAL ] SM: No existing data file found in primary storage. [2025-10-28T21:10:53.971316] [WARN ] [MAIN ] SM: No existing data found, performing full refresh instead. [2025-10-28T21:10:53.971429] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-28T21:10:53.971492] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-28T21:10:53.971568] [DEBUG] [LOCAL ] SM: No primary data file found to delete. [2025-10-28T21:10:53.971612] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-28T21:10:54.347239] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:10:54.380223] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-28T21:10:54.997171] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T21:10:55.180247] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-28T21:10:55.808254] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:10:55.980239] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-28T21:10:56.613216] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:10:56.780341] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-28T21:10:57.101600] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-28T21:10:57.580238] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-28T21:10:57.622855] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T21:10:58.380222] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-28T21:10:58.877110] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T21:10:59.180250] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-28T21:10:59.944062] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T21:10:59.980212] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-28T21:11:00.347526] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T21:11:00.780258] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-28T21:11:01.476278] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T21:11:01.580248] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-28T21:11:01.683214] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T21:11:02.035456] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T21:11:02.380248] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-28T21:11:02.728995] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T21:11:03.180256] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-28T21:11:03.980250] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-28T21:11:04.780250] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-28T21:11:04.813194] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T21:11:05.580284] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-28T21:11:05.788388] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T21:11:05.815292] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T21:11:06.380260] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-28T21:11:06.963742] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T21:11:07.180246] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-28T21:11:07.715671] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:11:07.980251] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-28T21:11:08.170628] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:11:08.780304] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-28T21:11:09.403555] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T21:11:09.580447] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-28T21:11:09.784600] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T21:11:10.380242] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-28T21:11:10.995585] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:11:11.180228] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-28T21:11:11.509353] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T21:11:11.980250] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-28T21:11:12.295906] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T21:11:12.629706] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T21:11:12.780264] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-28T21:11:13.252192] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T21:11:13.252932] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1047 records). [2025-10-28T21:11:13.252997] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-28T21:11:13.443572] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T21:11:13.443765] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:11:13.443833] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:11:13.443901] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-28T21:11:13.443966] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-28T21:11:13.444022] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-28T21:11:13.444064] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-28T21:11:13.444118] [INFO ] [MAIN ] Update Progress: 1930/2366 symbols completed. SLNZ took 32.8s. Estimated remaining: 56m 45s. Rate: 7.7 symbols/min [2025-10-28T21:11:13.592695] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-28T21:11:13.626166] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:13.626350] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-28T21:11:13.626396] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-28T21:11:13.626503] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-28T21:11:13.626544] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-28T21:11:13.626587] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-28T21:11:13.626619] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-28T21:11:13.980317] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:14.380250] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-28T21:11:15.038412] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T21:11:15.180235] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-28T21:11:15.753604] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T21:11:15.980249] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-28T21:11:16.769810] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T21:11:16.780753] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-10-28T21:11:16.782897] [INFO ] [REMOTE ] SM: Full fetch complete (75937 records). [2025-10-28T21:11:16.783023] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-28T21:11:17.066195] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:11:17.111764] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-10-28T21:11:17.134873] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:11:17.135051] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-28T21:11:17.145808] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:11:17.156221] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-28T21:11:17.161631] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-28T21:11:17.208889] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-28T21:11:17.233942] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-28T21:11:17.234132] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-28T21:11:17.234388] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-28T21:11:17.235797] [INFO ] [MAIN ] Update Progress: 1931/2366 symbols completed. SMA took 3.8s. Estimated remaining: 56m 36s. Rate: 7.7 symbols/min [2025-10-28T21:11:17.235714] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-28T21:11:17.269795] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-28T21:11:17.364419] [DEBUG] [LOCAL ] SM: Trimmed 75937 records to 52333 (keeping 200 days of data) [2025-10-28T21:11:17.438769] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:17.492598] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T21:11:17.539767] [INFO ] [REMOTE ] SLQT: Full fetch complete (63576 records). [2025-10-28T21:11:17.559001] [DEBUG] [LOCAL ] SMBK: Loaded 8191 existing records from primary storage. [2025-10-28T21:11:17.559215] [INFO ] [MAIN ] SMBK: Loaded 8191 existing records. [2025-10-28T21:11:17.558798] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-28T21:11:17.581366] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-28T21:11:18.177688] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:11:18.202499] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-28T21:11:18.240417] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-28T21:11:18.257394] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-28T21:11:18.265185] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-28T21:11:18.341873] [DEBUG] [LOCAL ] SM: Primary data saved (52333 records). [2025-10-28T21:11:18.377717] [INFO ] [MAIN ] SM: Full history saved. [2025-10-28T21:11:18.385301] [INFO ] [MAIN ] Update Progress: 1932/2366 symbols completed. SM took 24.6s. Estimated remaining: 56m 27s. Rate: 7.7 symbols/min [2025-10-28T21:11:18.539621] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-28T21:11:18.586593] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-28T21:11:18.634331] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-28T21:11:18.694569] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-28T21:11:18.820997] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:18.804198] [DEBUG] [LOCAL ] SLQT: Trimmed 63576 records to 43041 (keeping 200 days of data) [2025-10-28T21:11:19.051271] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T21:11:19.102429] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:19.104703] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-28T21:11:19.103394] [DEBUG] [LOCAL ] SMC: Loaded 10460 existing records from primary storage. [2025-10-28T21:11:19.107726] [INFO ] [MAIN ] SMC: Loaded 10460 existing records. [2025-10-28T21:11:19.182472] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-28T21:11:19.409267] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:11:19.420088] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-28T21:11:19.428696] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-28T21:11:19.439426] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-28T21:11:19.444765] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-28T21:11:19.449360] [DEBUG] [LOCAL ] SLQT: Primary data saved (43041 records). [2025-10-28T21:11:19.480685] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-28T21:11:19.492288] [INFO ] [MAIN ] Update Progress: 1933/2366 symbols completed. SLQT took 31.0s. Estimated remaining: 56m 17s. Rate: 7.7 symbols/min [2025-10-28T21:11:19.889602] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:19.998907] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:19.999814] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-28T21:11:20.040769] [DEBUG] [LOCAL ] SMFG: Loaded 48106 existing records from primary storage. [2025-10-28T21:11:20.048284] [INFO ] [MAIN ] SMFG: Loaded 48106 existing records. [2025-10-28T21:11:20.048530] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T21:11:20.233752] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:11:20.234110] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-28T21:11:20.234215] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-28T21:11:20.240191] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-28T21:11:20.249279] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-28T21:11:20.282720] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T21:11:20.623805] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:20.632585] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T21:11:20.780236] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-28T21:11:21.580250] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-28T21:11:22.076398] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:11:22.380303] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-28T21:11:22.855161] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T21:11:23.180246] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-28T21:11:23.525254] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:11:23.980283] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-28T21:11:24.246302] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:11:24.514566] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T21:11:24.780306] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-28T21:11:25.580236] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-28T21:11:26.037333] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T21:11:26.213487] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T21:11:26.380275] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-28T21:11:26.992592] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T21:11:27.180259] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-28T21:11:27.980238] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-28T21:11:28.777928] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T21:11:28.788237] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-28T21:11:29.140010] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T21:11:29.145819] [INFO ] [REMOTE ] SLVM: Full fetch complete (40107 records). [2025-10-28T21:11:29.145982] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-28T21:11:29.504057] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T21:11:29.546166] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-28T21:11:29.546241] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-28T21:11:29.547166] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-28T21:11:29.547230] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-28T21:11:29.548139] [DEBUG] [LOCAL ] SLVM: Trimmed 40107 records to 27529 (keeping 200 days of data) [2025-10-28T21:11:29.599928] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-28T21:11:29.717709] [DEBUG] [LOCAL ] SLVM: Primary data saved (27529 records). [2025-10-28T21:11:29.717863] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-28T21:11:29.717948] [INFO ] [MAIN ] Update Progress: 1934/2366 symbols completed. SLVM took 37.3s. Estimated remaining: 56m 10s. Rate: 7.7 symbols/min [2025-10-28T21:11:29.885164] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:29.885271] [DEBUG] [LOCAL ] SMG: No existing data file found in primary storage. [2025-10-28T21:11:29.885307] [WARN ] [MAIN ] SMG: No existing data found, performing full refresh instead. [2025-10-28T21:11:29.885409] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-28T21:11:29.885449] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-28T21:11:29.885490] [DEBUG] [LOCAL ] SMG: No primary data file found to delete. [2025-10-28T21:11:29.885521] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-28T21:11:30.234540] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:30.291941] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T21:11:30.380215] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-28T21:11:31.180251] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-28T21:11:31.782255] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T21:11:31.842148] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T21:11:31.980252] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-28T21:11:32.780253] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-28T21:11:33.383869] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:11:33.438396] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T21:11:33.580238] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-28T21:11:34.380235] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-28T21:11:34.823142] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:11:34.942382] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T21:11:35.180271] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-28T21:11:35.870168] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T21:11:35.980223] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-28T21:11:36.654632] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T21:11:36.780264] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-28T21:11:37.448723] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T21:11:37.580237] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-28T21:11:38.297428] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T21:11:38.380233] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-28T21:11:39.009775] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T21:11:39.180237] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-28T21:11:39.860240] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T21:11:39.980263] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-28T21:11:40.780251] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-28T21:11:41.451229] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:11:41.453737] [INFO ] [REMOTE ] SMBK: Full fetch complete (11827 records). [2025-10-28T21:11:41.453811] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-28T21:11:41.586770] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-28T21:11:41.918762] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-28T21:11:41.919073] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-28T21:11:41.919900] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-28T21:11:41.919981] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-28T21:11:41.923224] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-28T21:11:41.934693] [DEBUG] [LOCAL ] SMBK: Trimmed 11827 records to 8154 (keeping 200 days of data) [2025-10-28T21:11:41.988705] [DEBUG] [LOCAL ] SMBK: Primary data saved (8154 records). [2025-10-28T21:11:41.988862] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-28T21:11:41.988958] [INFO ] [MAIN ] Update Progress: 1935/2366 symbols completed. SMBK took 24.8s. Estimated remaining: 56m 3s. Rate: 7.7 symbols/min [2025-10-28T21:11:42.154795] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:42.167810] [DEBUG] [LOCAL ] SMHI: Loaded 12130 existing records from primary storage. [2025-10-28T21:11:42.168081] [INFO ] [MAIN ] SMHI: Loaded 12130 existing records. [2025-10-28T21:11:42.346330] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:11:42.346626] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-28T21:11:42.346728] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-28T21:11:42.346999] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-28T21:11:42.347057] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-28T21:11:42.385454] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-28T21:11:42.445546] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T21:11:42.742053] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:43.180295] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-28T21:11:43.966519] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T21:11:43.980229] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-28T21:11:44.108101] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T21:11:44.780303] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-28T21:11:45.344839] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T21:11:45.580269] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-28T21:11:45.919579] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:11:46.381052] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-28T21:11:46.384128] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T21:11:47.001104] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T21:11:47.180291] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-28T21:11:47.980273] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-28T21:11:48.133401] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T21:11:48.780243] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-28T21:11:49.439706] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T21:11:49.449543] [INFO ] [REMOTE ] SMFG: Full fetch complete (69308 records). [2025-10-28T21:11:49.449698] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-28T21:11:49.599051] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-28T21:11:49.771623] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T21:11:49.869392] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-28T21:11:49.869475] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-28T21:11:49.870755] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-28T21:11:49.870818] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-28T21:11:49.872154] [DEBUG] [LOCAL ] SMFG: Trimmed 69308 records to 48067 (keeping 200 days of data) [2025-10-28T21:11:50.147476] [DEBUG] [LOCAL ] SMFG: Primary data saved (48067 records). [2025-10-28T21:11:50.147671] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-28T21:11:50.148035] [INFO ] [MAIN ] Update Progress: 1936/2366 symbols completed. SMFG took 30.6s. Estimated remaining: 55m 55s. Rate: 7.7 symbols/min [2025-10-28T21:11:50.319124] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:50.319263] [DEBUG] [LOCAL ] SMP: No existing data file found in primary storage. [2025-10-28T21:11:50.319299] [WARN ] [MAIN ] SMP: No existing data found, performing full refresh instead. [2025-10-28T21:11:50.319404] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-28T21:11:50.319444] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-28T21:11:50.319490] [DEBUG] [LOCAL ] SMP: No primary data file found to delete. [2025-10-28T21:11:50.319521] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-28T21:11:50.383478] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-28T21:11:50.446395] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T21:11:50.491253] [INFO ] [REMOTE ] SMC: Full fetch complete (16437 records). [2025-10-28T21:11:50.521543] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-28T21:11:50.845375] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:51.046314] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-28T21:11:51.046387] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-28T21:11:51.046770] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-28T21:11:51.046832] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-28T21:11:51.047332] [DEBUG] [LOCAL ] SMC: Trimmed 16437 records to 10370 (keeping 200 days of data) [2025-10-28T21:11:51.105806] [DEBUG] [LOCAL ] SMC: Primary data saved (10370 records). [2025-10-28T21:11:51.105910] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-28T21:11:51.106021] [INFO ] [MAIN ] Update Progress: 1937/2366 symbols completed. SMC took 32.7s. Estimated remaining: 55m 46s. Rate: 7.7 symbols/min [2025-10-28T21:11:51.185383] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-28T21:11:51.277946] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:11:51.287139] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T21:11:51.335235] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-28T21:11:51.335548] [INFO ] [MAIN ] SMR: Loaded 53799 existing records. [2025-10-28T21:11:51.512982] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:11:51.513170] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-28T21:11:51.513225] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-28T21:11:51.513679] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-28T21:11:51.513735] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-28T21:11:51.861618] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:11:51.980206] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-28T21:11:52.017109] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T21:11:52.780228] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-28T21:11:53.420992] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T21:11:53.580275] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-28T21:11:54.347458] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T21:11:54.380230] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-28T21:11:54.525625] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-28T21:11:55.180250] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-28T21:11:55.402746] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T21:11:55.980285] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-28T21:11:56.780319] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-28T21:11:57.027531] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T21:11:57.139987] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-28T21:11:57.462965] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T21:11:57.580224] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-28T21:11:58.380223] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-28T21:11:58.498181] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T21:11:59.180272] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-28T21:11:59.802472] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T21:11:59.980288] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-28T21:12:00.534741] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-28T21:12:00.780308] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-28T21:12:01.465711] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T21:12:01.467927] [INFO ] [REMOTE ] SMHI: Full fetch complete (20745 records). [2025-10-28T21:12:01.468014] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-28T21:12:01.580912] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-28T21:12:01.888838] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T21:12:01.904072] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-28T21:12:01.904453] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-28T21:12:01.904954] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-28T21:12:01.905018] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-28T21:12:01.905611] [DEBUG] [LOCAL ] SMHI: Trimmed 20745 records to 11974 (keeping 200 days of data) [2025-10-28T21:12:01.972847] [DEBUG] [LOCAL ] SMHI: Primary data saved (11974 records). [2025-10-28T21:12:01.972987] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-28T21:12:01.973069] [INFO ] [MAIN ] Update Progress: 1938/2366 symbols completed. SMHI took 20.0s. Estimated remaining: 55m 39s. Rate: 7.7 symbols/min [2025-10-28T21:12:02.149910] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:02.190782] [DEBUG] [LOCAL ] SMRT: Loaded 43592 existing records from primary storage. [2025-10-28T21:12:02.191092] [INFO ] [MAIN ] SMRT: Loaded 43592 existing records. [2025-10-28T21:12:02.377724] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:12:02.377978] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-28T21:12:02.378026] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-28T21:12:02.378559] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-28T21:12:02.378617] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-28T21:12:02.389946] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-28T21:12:02.735802] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:03.180272] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-28T21:12:03.420479] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T21:12:03.980316] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-28T21:12:04.550470] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-10-28T21:12:04.780232] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-28T21:12:05.024146] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-28T21:12:05.580305] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-28T21:12:06.380248] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-28T21:12:06.809610] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-28T21:12:06.943590] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:12:07.021703] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T21:12:07.180239] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-28T21:12:07.980248] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-28T21:12:08.197688] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T21:12:08.780297] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-28T21:12:09.580218] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-28T21:12:09.687865] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-28T21:12:09.835847] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T21:12:10.380272] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-28T21:12:10.938843] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T21:12:11.001553] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (6.22 seconds). [2025-10-28T21:12:11.180226] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-28T21:12:11.230113] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T21:12:11.980320] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-28T21:12:12.780242] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-28T21:12:13.321036] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T21:12:13.367638] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-28T21:12:13.580220] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-28T21:12:13.606401] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T21:12:13.610056] [INFO ] [REMOTE ] SMP: Full fetch complete (26707 records). [2025-10-28T21:12:13.610125] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-28T21:12:13.981320] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-28T21:12:13.981400] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-28T21:12:13.981971] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-28T21:12:13.982039] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-28T21:12:13.982749] [DEBUG] [LOCAL ] SMP: Trimmed 26707 records to 18315 (keeping 200 days of data) [2025-10-28T21:12:14.089766] [DEBUG] [LOCAL ] SMP: Primary data saved (18315 records). [2025-10-28T21:12:14.089890] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-28T21:12:14.089975] [INFO ] [MAIN ] Update Progress: 1939/2366 symbols completed. SMP took 23.9s. Estimated remaining: 55m 32s. Rate: 7.7 symbols/min [2025-10-28T21:12:14.257549] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:14.287107] [DEBUG] [LOCAL ] SMWB: Loaded 31282 existing records from primary storage. [2025-10-28T21:12:14.287352] [INFO ] [MAIN ] SMWB: Loaded 31282 existing records. [2025-10-28T21:12:14.385787] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-28T21:12:14.466836] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:12:14.467005] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-28T21:12:14.467052] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-28T21:12:14.467389] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-28T21:12:14.467448] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-28T21:12:14.831253] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:15.180298] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-28T21:12:15.926176] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T21:12:15.967047] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-28T21:12:15.980210] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-28T21:12:16.468607] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T21:12:16.780244] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-28T21:12:17.580247] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-28T21:12:18.095510] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-28T21:12:18.319253] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T21:12:18.380212] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-28T21:12:18.821983] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T21:12:19.180286] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-28T21:12:19.756824] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T21:12:19.980316] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-28T21:12:20.473672] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T21:12:20.780301] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-28T21:12:21.057525] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T21:12:21.580257] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-28T21:12:22.380294] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-28T21:12:22.945492] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T21:12:23.180275] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-28T21:12:23.558025] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-28T21:12:23.696556] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T21:12:23.980252] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-28T21:12:24.406018] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T21:12:24.473702] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T21:12:24.485303] [INFO ] [REMOTE ] SMR: Full fetch complete (77587 records). [2025-10-28T21:12:24.485477] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-28T21:12:24.489753] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T21:12:24.489971] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:12:24.490045] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:12:24.490127] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-28T21:12:24.490193] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-28T21:12:24.490229] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-10-28T21:12:24.490426] [DEBUG] [LOCAL ] SMR: Deleted derivative data file. [2025-10-28T21:12:24.490523] [INFO ] [MAIN ] Update Progress: 1940/2366 symbols completed. SMR took 33.4s. Estimated remaining: 55m 25s. Rate: 7.7 symbols/min [2025-10-28T21:12:24.673904] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:24.718769] [DEBUG] [LOCAL ] SN: Loaded 49918 existing records from primary storage. [2025-10-28T21:12:24.719085] [INFO ] [MAIN ] SN: Loaded 49918 existing records. [2025-10-28T21:12:24.785468] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-28T21:12:24.900281] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:12:24.900473] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-28T21:12:24.900520] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-28T21:12:24.901145] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-28T21:12:24.901204] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-28T21:12:25.244855] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:25.580240] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-28T21:12:25.855311] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:12:26.380245] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-28T21:12:26.934908] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T21:12:27.180299] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-28T21:12:27.739884] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:12:27.980243] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-28T21:12:28.512521] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T21:12:28.520461] [INFO ] [REMOTE ] SMG: Full fetch complete (62633 records). [2025-10-28T21:12:28.520589] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-28T21:12:28.785345] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-28T21:12:28.921729] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-28T21:12:28.921824] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-28T21:12:28.922862] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-28T21:12:28.922928] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-28T21:12:28.924269] [DEBUG] [LOCAL ] SMG: Trimmed 62633 records to 42158 (keeping 200 days of data) [2025-10-28T21:12:29.178567] [DEBUG] [LOCAL ] SMG: Primary data saved (42158 records). [2025-10-28T21:12:29.178721] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-28T21:12:29.178803] [INFO ] [MAIN ] Update Progress: 1941/2366 symbols completed. SMG took 59.5s. Estimated remaining: 55m 16s. Rate: 7.7 symbols/min [2025-10-28T21:12:29.353059] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:29.353291] [DEBUG] [LOCAL ] SNA: No existing data file found in primary storage. [2025-10-28T21:12:29.353348] [WARN ] [MAIN ] SNA: No existing data found, performing full refresh instead. [2025-10-28T21:12:29.353573] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-28T21:12:29.353679] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-28T21:12:29.353824] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-10-28T21:12:29.353952] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-28T21:12:29.594279] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-28T21:12:29.653981] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T21:12:29.763215] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:29.785379] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T21:12:30.380291] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-28T21:12:31.180224] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-28T21:12:31.232261] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T21:12:31.240969] [INFO ] [REMOTE ] SMRT: Full fetch complete (62565 records). [2025-10-28T21:12:31.241086] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-28T21:12:31.629998] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-28T21:12:31.630087] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-28T21:12:31.636742] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-28T21:12:31.646451] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-28T21:12:31.648007] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T21:12:31.654743] [DEBUG] [LOCAL ] SMRT: Trimmed 62565 records to 43504 (keeping 200 days of data) [2025-10-28T21:12:31.893209] [DEBUG] [LOCAL ] SMRT: Primary data saved (43504 records). [2025-10-28T21:12:31.893330] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-28T21:12:31.893406] [INFO ] [MAIN ] Update Progress: 1942/2366 symbols completed. SMRT took 29.9s. Estimated remaining: 55m 7s. Rate: 7.7 symbols/min [2025-10-28T21:12:31.986015] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-28T21:12:32.067103] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:32.115693] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-28T21:12:32.116032] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-28T21:12:32.297094] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:12:32.297618] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-28T21:12:32.297777] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-28T21:12:32.306096] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-28T21:12:32.311295] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-28T21:12:32.399835] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T21:12:32.711427] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:32.780218] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-28T21:12:33.580219] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-28T21:12:33.691307] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T21:12:34.380298] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-28T21:12:34.575346] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T21:12:34.723136] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:12:35.180227] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-28T21:12:35.391398] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T21:12:35.980322] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-28T21:12:36.461495] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T21:12:36.780334] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-28T21:12:37.073402] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T21:12:37.580281] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-28T21:12:38.363069] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T21:12:38.380217] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-28T21:12:39.180334] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-28T21:12:39.441284] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-28T21:12:39.990621] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-28T21:12:39.996522] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T21:12:40.573550] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T21:12:40.780254] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-28T21:12:41.238039] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T21:12:41.580217] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-28T21:12:41.745232] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T21:12:42.380235] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-28T21:12:43.180374] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-28T21:12:43.637179] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-28T21:12:43.673823] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T21:12:43.980256] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-28T21:12:44.239336] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T21:12:44.780282] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-28T21:12:45.462213] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T21:12:45.580247] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-28T21:12:46.380271] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-28T21:12:46.940968] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T21:12:47.093188] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-28T21:12:47.180211] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-28T21:12:47.284256] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T21:12:47.289597] [INFO ] [REMOTE ] SMWB: Full fetch complete (48301 records). [2025-10-28T21:12:47.289727] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-28T21:12:47.663628] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-28T21:12:47.663742] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-28T21:12:47.664790] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-28T21:12:47.664854] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-28T21:12:47.665958] [DEBUG] [LOCAL ] SMWB: Trimmed 48301 records to 31332 (keeping 200 days of data) [2025-10-28T21:12:47.842165] [DEBUG] [LOCAL ] SMWB: Primary data saved (31332 records). [2025-10-28T21:12:47.842304] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-28T21:12:47.842384] [INFO ] [MAIN ] Update Progress: 1943/2366 symbols completed. SMWB took 33.8s. Estimated remaining: 55m 1s. Rate: 7.7 symbols/min [2025-10-28T21:12:47.987452] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-28T21:12:48.012897] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:48.022366] [DEBUG] [LOCAL ] SNDA: Loaded 4410 existing records from primary storage. [2025-10-28T21:12:48.022814] [INFO ] [MAIN ] SNDA: Loaded 4410 existing records. [2025-10-28T21:12:48.199827] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:12:48.200011] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-28T21:12:48.200058] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-28T21:12:48.200250] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-28T21:12:48.200306] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-28T21:12:48.572160] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:48.609230] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T21:12:48.780257] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-28T21:12:48.925914] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T21:12:49.580274] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-28T21:12:50.380306] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-28T21:12:50.578761] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-28T21:12:51.013619] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T21:12:51.180255] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-28T21:12:51.231606] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T21:12:51.241727] [INFO ] [REMOTE ] SN: Full fetch complete (71845 records). [2025-10-28T21:12:51.241873] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-28T21:12:51.631576] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-28T21:12:51.631691] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-28T21:12:51.633013] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-28T21:12:51.633109] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-28T21:12:51.634589] [DEBUG] [LOCAL ] SN: Trimmed 71845 records to 49838 (keeping 200 days of data) [2025-10-28T21:12:51.926954] [DEBUG] [LOCAL ] SN: Primary data saved (49838 records). [2025-10-28T21:12:51.927076] [INFO ] [MAIN ] SN: Full history saved. [2025-10-28T21:12:51.927151] [INFO ] [MAIN ] Update Progress: 1944/2366 symbols completed. SN took 27.4s. Estimated remaining: 54m 53s. Rate: 7.7 symbols/min [2025-10-28T21:12:51.991745] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-28T21:12:52.101619] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:12:52.101872] [DEBUG] [LOCAL ] SNDR: No existing data file found in primary storage. [2025-10-28T21:12:52.101918] [WARN ] [MAIN ] SNDR: No existing data found, performing full refresh instead. [2025-10-28T21:12:52.102028] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-28T21:12:52.102071] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-28T21:12:52.102117] [DEBUG] [LOCAL ] SNDR: No primary data file found to delete. [2025-10-28T21:12:52.102204] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-28T21:12:52.470764] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:12:52.780240] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-28T21:12:52.999144] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T21:12:53.199721] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:12:53.247345] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T21:12:53.580272] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-28T21:12:54.380305] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-28T21:12:55.180229] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-28T21:12:55.328482] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T21:12:55.665767] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T21:12:55.980263] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-28T21:12:56.372409] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:12:56.780301] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-28T21:12:57.417679] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T21:12:57.580230] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-28T21:12:58.180279] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-28T21:12:58.380277] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-28T21:12:58.858795] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T21:12:59.180245] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-28T21:12:59.435041] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T21:12:59.443517] [INFO ] [REMOTE ] SNA: Full fetch complete (38785 records). [2025-10-28T21:12:59.443681] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-28T21:12:59.818048] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-28T21:12:59.818127] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-28T21:12:59.819011] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-28T21:12:59.819076] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-28T21:12:59.819964] [DEBUG] [LOCAL ] SNA: Trimmed 38785 records to 25216 (keeping 200 days of data) [2025-10-28T21:12:59.975897] [DEBUG] [LOCAL ] SNA: Primary data saved (25216 records). [2025-10-28T21:12:59.976049] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-28T21:12:59.976129] [INFO ] [MAIN ] Update Progress: 1945/2366 symbols completed. SNA took 30.8s. Estimated remaining: 54m 45s. Rate: 7.7 symbols/min [2025-10-28T21:12:59.987106] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-28T21:13:00.149770] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:00.191160] [DEBUG] [LOCAL ] SNN: Loaded 44156 existing records from primary storage. [2025-10-28T21:13:00.191527] [INFO ] [MAIN ] SNN: Loaded 44156 existing records. [2025-10-28T21:13:00.385842] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:13:00.386093] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-28T21:13:00.386153] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-28T21:13:00.386716] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-28T21:13:00.386779] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-28T21:13:00.631595] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T21:13:00.730966] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T21:13:00.781477] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-28T21:13:00.803908] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:01.580314] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-28T21:13:02.259335] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:13:02.278552] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T21:13:02.380251] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-28T21:13:03.180259] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-28T21:13:03.603751] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T21:13:03.980281] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-28T21:13:04.403338] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:13:04.460633] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T21:13:04.780258] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-28T21:13:05.580257] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-28T21:13:06.380299] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-28T21:13:06.749244] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-28T21:13:06.841840] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T21:13:07.084875] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T21:13:07.180288] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-28T21:13:07.980291] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-28T21:13:08.780266] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-28T21:13:09.206986] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T21:13:09.245710] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-28T21:13:09.256788] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-28T21:13:09.256963] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-28T21:13:09.260898] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T21:13:09.585330] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-28T21:13:09.657150] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-28T21:13:09.657234] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-28T21:13:09.658485] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-28T21:13:09.658548] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-28T21:13:09.660108] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 53796 (keeping 200 days of data) [2025-10-28T21:13:09.965682] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-28T21:13:09.965815] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-28T21:13:09.966464] [INFO ] [MAIN ] Update Progress: 1946/2366 symbols completed. SNAP took 38.1s. Estimated remaining: 54m 38s. Rate: 7.7 symbols/min [2025-10-28T21:13:10.139792] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:10.176100] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T21:13:10.197900] [DEBUG] [LOCAL ] SNOW: Loaded 53575 existing records from primary storage. [2025-10-28T21:13:10.198247] [INFO ] [MAIN ] SNOW: Loaded 53575 existing records. [2025-10-28T21:13:10.373886] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:13:10.374087] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-28T21:13:10.374134] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-28T21:13:10.374729] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-28T21:13:10.374788] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-28T21:13:10.385550] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-28T21:13:10.726633] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:10.939136] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:13:11.180251] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-28T21:13:11.980290] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-28T21:13:12.457343] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T21:13:12.458675] [INFO ] [REMOTE ] SNDA: Full fetch complete (7262 records). [2025-10-28T21:13:12.458745] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-28T21:13:12.791137] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-28T21:13:12.832256] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-28T21:13:12.832330] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-28T21:13:12.832518] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-28T21:13:12.832556] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-28T21:13:12.832997] [DEBUG] [LOCAL ] SNDA: Trimmed 7262 records to 4370 (keeping 200 days of data) [2025-10-28T21:13:12.857964] [DEBUG] [LOCAL ] SNDA: Primary data saved (4370 records). [2025-10-28T21:13:12.858042] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-28T21:13:12.858113] [INFO ] [MAIN ] Update Progress: 1947/2366 symbols completed. SNDA took 25.0s. Estimated remaining: 54m 29s. Rate: 7.7 symbols/min [2025-10-28T21:13:13.035120] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:13.035415] [DEBUG] [LOCAL ] SNV: No existing data file found in primary storage. [2025-10-28T21:13:13.035492] [WARN ] [MAIN ] SNV: No existing data found, performing full refresh instead. [2025-10-28T21:13:13.035733] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-28T21:13:13.035782] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-28T21:13:13.035825] [DEBUG] [LOCAL ] SNV: No primary data file found to delete. [2025-10-28T21:13:13.035859] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-28T21:13:13.403366] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:13.436461] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-28T21:13:13.580248] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-28T21:13:14.197255] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:13:14.380250] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-28T21:13:14.924785] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:13:15.180259] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-28T21:13:15.683223] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T21:13:15.980257] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-28T21:13:16.551803] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T21:13:16.780281] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-28T21:13:17.521803] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T21:13:17.580216] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-28T21:13:18.121136] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:13:18.380257] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-28T21:13:18.870248] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T21:13:19.180263] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-28T21:13:19.980259] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-28T21:13:20.623905] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-28T21:13:20.724900] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T21:13:20.780244] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-28T21:13:21.580437] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T21:13:21.580620] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-28T21:13:22.140623] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T21:13:22.380254] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-28T21:13:23.180247] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-28T21:13:23.316399] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T21:13:23.748363] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T21:13:23.980299] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-28T21:13:24.648795] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T21:13:24.780242] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-28T21:13:25.350900] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T21:13:25.580290] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-28T21:13:26.123359] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T21:13:26.380221] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-28T21:13:26.863355] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T21:13:27.180271] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-28T21:13:27.788727] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T21:13:27.797540] [INFO ] [REMOTE ] SNN: Full fetch complete (63002 records). [2025-10-28T21:13:27.797747] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-28T21:13:27.989476] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-28T21:13:28.187989] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-28T21:13:28.188067] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-28T21:13:28.189108] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-28T21:13:28.189218] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-28T21:13:28.190513] [DEBUG] [LOCAL ] SNN: Trimmed 63002 records to 44096 (keeping 200 days of data) [2025-10-28T21:13:28.449863] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T21:13:28.467780] [INFO ] [REMOTE ] SNDR: Full fetch complete (60296 records). [2025-10-28T21:13:28.470107] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-28T21:13:28.619741] [DEBUG] [LOCAL ] SNN: Primary data saved (44096 records). [2025-10-28T21:13:28.630183] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-28T21:13:28.643848] [INFO ] [MAIN ] Update Progress: 1948/2366 symbols completed. SNN took 28.7s. Estimated remaining: 54m 23s. Rate: 7.7 symbols/min [2025-10-28T21:13:28.792499] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-28T21:13:29.016898] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:29.032464] [DEBUG] [LOCAL ] SNX: No existing data file found in primary storage. [2025-10-28T21:13:29.044439] [WARN ] [MAIN ] SNX: No existing data found, performing full refresh instead. [2025-10-28T21:13:29.044582] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-28T21:13:29.044667] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-28T21:13:29.062413] [DEBUG] [LOCAL ] SNX: No primary data file found to delete. [2025-10-28T21:13:29.078867] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-28T21:13:29.174148] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-28T21:13:29.179357] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-28T21:13:29.190923] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-28T21:13:29.198923] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-28T21:13:29.240871] [DEBUG] [LOCAL ] SNDR: Trimmed 60296 records to 41435 (keeping 200 days of data) [2025-10-28T21:13:29.582370] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:29.585531] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-28T21:13:29.716630] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-28T21:13:29.745913] [DEBUG] [LOCAL ] SNDR: Primary data saved (41435 records). [2025-10-28T21:13:29.746053] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-28T21:13:29.746120] [INFO ] [MAIN ] Update Progress: 1949/2366 symbols completed. SNDR took 37.8s. Estimated remaining: 54m 14s. Rate: 7.7 symbols/min [2025-10-28T21:13:29.925312] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:29.925487] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-10-28T21:13:29.925525] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-10-28T21:13:29.925631] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-28T21:13:29.925709] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-28T21:13:29.925760] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-10-28T21:13:29.925794] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-28T21:13:30.298838] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:30.380208] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-28T21:13:31.011004] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:13:31.106155] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-28T21:13:31.180216] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-28T21:13:31.813511] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:13:31.980243] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-28T21:13:32.780285] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-28T21:13:33.141400] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-28T21:13:33.394102] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T21:13:33.580284] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-28T21:13:34.385524] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-28T21:13:34.402057] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T21:13:34.642260] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T21:13:35.180299] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-28T21:13:35.980344] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-28T21:13:36.248369] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-28T21:13:36.521031] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:13:36.780256] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-28T21:13:37.430819] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T21:13:37.580246] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-28T21:13:38.088769] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T21:13:38.380251] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-28T21:13:39.129920] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T21:13:39.180231] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-28T21:13:39.813248] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:13:39.980283] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-28T21:13:40.507598] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T21:13:40.780255] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-28T21:13:41.580251] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-28T21:13:42.380228] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-28T21:13:42.951492] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-28T21:13:43.067434] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T21:13:43.150252] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-28T21:13:43.160950] [INFO ] [REMOTE ] SNV: Full fetch complete (71885 records). [2025-10-28T21:13:43.161075] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-28T21:13:43.185383] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-28T21:13:43.575588] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-28T21:13:43.575693] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-28T21:13:43.576858] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-28T21:13:43.576919] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-28T21:13:43.578263] [DEBUG] [LOCAL ] SNV: Trimmed 71885 records to 48991 (keeping 200 days of data) [2025-10-28T21:13:43.873195] [DEBUG] [LOCAL ] SNV: Primary data saved (48991 records). [2025-10-28T21:13:43.873419] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-28T21:13:43.873527] [INFO ] [MAIN ] Update Progress: 1950/2366 symbols completed. SNV took 31.0s. Estimated remaining: 54m 7s. Rate: 7.7 symbols/min [2025-10-28T21:13:43.981931] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-28T21:13:44.056000] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:44.085394] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T21:13:44.126386] [DEBUG] [LOCAL ] SOBO: Loaded 39066 existing records from primary storage. [2025-10-28T21:13:44.126687] [INFO ] [MAIN ] SOBO: Loaded 39066 existing records. [2025-10-28T21:13:44.304603] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:13:44.304882] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-28T21:13:44.304932] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-28T21:13:44.305379] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-28T21:13:44.305434] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-28T21:13:44.703838] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:44.780235] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-28T21:13:44.839621] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T21:13:45.580243] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-28T21:13:45.928197] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:13:46.091886] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-28T21:13:46.380245] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-28T21:13:46.707095] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:13:47.180308] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-28T21:13:47.964430] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T21:13:47.980215] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-28T21:13:48.601365] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T21:13:48.780277] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-28T21:13:49.328337] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-28T21:13:49.580258] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-28T21:13:50.380234] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-28T21:13:50.429220] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T21:13:50.440405] [DEBUG] [REMOTE ] SNX: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-28T21:13:50.440886] [WARN ] [REMOTE ] SNX: No data returned for month 2025-06 [2025-10-28T21:13:50.441070] [INFO ] [REMOTE ] SO: Full fetch complete (77777 records). [2025-10-28T21:13:50.441129] [FATAL] [REMOTE ] SNX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:13:50.441270] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-28T21:13:50.441561] [FATAL] [MAIN ] SNX: Failed to fetch primary data. [2025-10-28T21:13:50.441691] [WARN ] [MAIN ] SNX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:13:50.441850] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-28T21:13:50.441955] [DEBUG] [LOCAL ] SNX: No primary data file found to delete. [2025-10-28T21:13:50.442025] [INFO ] [LOCAL ] SNX: Starting deletion of derivative data. [2025-10-28T21:13:50.520787] [DEBUG] [LOCAL ] SNX: No derivative data file found to delete. [2025-10-28T21:13:50.550491] [INFO ] [MAIN ] Update Progress: 1951/2366 symbols completed. SNX took 21.9s. Estimated remaining: 53m 59s. Rate: 7.7 symbols/min [2025-10-28T21:13:50.852478] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:51.052675] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-28T21:13:51.052829] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-28T21:13:51.054326] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-28T21:13:51.054529] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-28T21:13:51.077017] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T21:13:51.084526] [DEBUG] [LOCAL ] SO: Trimmed 77777 records to 53614 (keeping 200 days of data) [2025-10-28T21:13:51.186098] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-28T21:13:51.227745] [DEBUG] [LOCAL ] SOC: Loaded 51235 existing records from primary storage. [2025-10-28T21:13:51.230627] [INFO ] [MAIN ] SOC: Loaded 51235 existing records. [2025-10-28T21:13:51.528708] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:13:51.536226] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-28T21:13:51.536576] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-28T21:13:51.539198] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-28T21:13:51.539805] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-28T21:13:51.901342] [DEBUG] [LOCAL ] SO: Primary data saved (53614 records). [2025-10-28T21:13:51.911672] [INFO ] [MAIN ] SO: Full history saved. [2025-10-28T21:13:51.911776] [INFO ] [MAIN ] Update Progress: 1952/2366 symbols completed. SO took 22.2s. Estimated remaining: 53m 50s. Rate: 7.7 symbols/min [2025-10-28T21:13:51.995299] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-28T21:13:52.095188] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:52.166271] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:52.172592] [DEBUG] [LOCAL ] SOJC: Loaded 4435 existing records from primary storage. [2025-10-28T21:13:52.172785] [INFO ] [MAIN ] SOJC: Loaded 4435 existing records. [2025-10-28T21:13:52.361930] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:13:52.362199] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-28T21:13:52.362270] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-28T21:13:52.362677] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-28T21:13:52.362853] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-28T21:13:52.681948] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T21:13:52.770407] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:52.785327] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-28T21:13:52.803019] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T21:13:52.813681] [INFO ] [REMOTE ] SNOW: Full fetch complete (77326 records). [2025-10-28T21:13:52.813798] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-28T21:13:52.814577] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T21:13:52.814691] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:13:52.814754] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:13:52.814833] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-28T21:13:52.814905] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-28T21:13:52.814940] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-10-28T21:13:52.815093] [DEBUG] [LOCAL ] SNOW: Deleted derivative data file. [2025-10-28T21:13:52.815423] [INFO ] [MAIN ] Update Progress: 1953/2366 symbols completed. SNOW took 42.8s. Estimated remaining: 53m 41s. Rate: 7.7 symbols/min [2025-10-28T21:13:52.981138] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:13:52.995786] [DEBUG] [LOCAL ] SOJD: Loaded 12400 existing records from primary storage. [2025-10-28T21:13:52.996046] [INFO ] [MAIN ] SOJD: Loaded 12400 existing records. [2025-10-28T21:13:53.177442] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:13:53.177612] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-28T21:13:53.177691] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-28T21:13:53.177938] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-28T21:13:53.177980] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-28T21:13:53.304274] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T21:13:53.536066] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:13:53.580222] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-28T21:13:54.053498] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T21:13:54.380266] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-28T21:13:55.145106] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T21:13:55.180239] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-28T21:13:55.931711] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T21:13:55.980248] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-28T21:13:56.780229] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-28T21:13:56.792336] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T21:13:57.580314] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-28T21:13:57.961340] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T21:13:58.380297] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-28T21:13:58.696672] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T21:13:59.145215] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T21:13:59.180206] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-28T21:13:59.775038] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T21:13:59.980257] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-28T21:14:00.780265] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-28T21:14:01.203244] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T21:14:01.509214] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T21:14:01.580294] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-28T21:14:02.380301] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-28T21:14:02.904539] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T21:14:02.973124] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T21:14:03.180336] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-28T21:14:03.718298] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T21:14:03.980282] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-28T21:14:04.654220] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T21:14:04.780269] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-28T21:14:05.497823] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T21:14:05.500748] [INFO ] [REMOTE ] SOJD: Full fetch complete (18907 records). [2025-10-28T21:14:05.500823] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-28T21:14:05.585409] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-28T21:14:05.872270] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-28T21:14:05.872364] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-28T21:14:05.872839] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-28T21:14:05.872899] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-28T21:14:05.873412] [DEBUG] [LOCAL ] SOJD: Trimmed 18907 records to 12374 (keeping 200 days of data) [2025-10-28T21:14:05.944987] [DEBUG] [LOCAL ] SOJD: Primary data saved (12374 records). [2025-10-28T21:14:05.945109] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-28T21:14:05.945184] [INFO ] [MAIN ] Update Progress: 1954/2366 symbols completed. SOJD took 13.1s. Estimated remaining: 53m 34s. Rate: 7.7 symbols/min [2025-10-28T21:14:06.110367] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:06.121840] [DEBUG] [LOCAL ] SOJE: Loaded 8594 existing records from primary storage. [2025-10-28T21:14:06.122047] [INFO ] [MAIN ] SOJE: Loaded 8594 existing records. [2025-10-28T21:14:06.289674] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T21:14:06.308574] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:14:06.311351] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-28T21:14:06.311402] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-28T21:14:06.311634] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-28T21:14:06.311726] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-28T21:14:06.385457] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-28T21:14:06.671935] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:07.180259] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-28T21:14:07.677258] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T21:14:07.980272] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-28T21:14:08.483611] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T21:14:08.510516] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T21:14:08.780259] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-28T21:14:09.323849] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T21:14:09.580309] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-28T21:14:10.380266] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-28T21:14:10.965206] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T21:14:11.105681] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T21:14:11.180233] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-28T21:14:11.980307] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-28T21:14:12.437476] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T21:14:12.780264] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-28T21:14:13.461096] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T21:14:13.522480] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T21:14:13.580272] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-28T21:14:14.380254] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-28T21:14:14.952768] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T21:14:15.180261] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-28T21:14:15.569792] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:14:15.980253] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-28T21:14:16.701278] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T21:14:16.706450] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T21:14:16.780287] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-28T21:14:17.580301] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-28T21:14:18.031555] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T21:14:18.148751] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T21:14:18.380233] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-28T21:14:18.830809] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T21:14:19.180286] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-28T21:14:19.980257] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-28T21:14:20.780212] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-28T21:14:20.819792] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T21:14:21.338201] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T21:14:21.465053] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T21:14:21.580288] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-28T21:14:22.065398] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T21:14:22.380320] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-28T21:14:23.180255] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-28T21:14:23.820442] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:14:23.828702] [INFO ] [REMOTE ] SOBO: Full fetch complete (58513 records). [2025-10-28T21:14:23.828810] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-28T21:14:24.001050] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-28T21:14:24.217068] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-28T21:14:24.217148] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-28T21:14:24.218197] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-28T21:14:24.218259] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-28T21:14:24.219550] [DEBUG] [LOCAL ] SOBO: Trimmed 58513 records to 39029 (keeping 200 days of data) [2025-10-28T21:14:24.450892] [DEBUG] [LOCAL ] SOBO: Primary data saved (39029 records). [2025-10-28T21:14:24.451040] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-28T21:14:24.451385] [INFO ] [MAIN ] Update Progress: 1955/2366 symbols completed. SOBO took 40.6s. Estimated remaining: 53m 28s. Rate: 7.7 symbols/min [2025-10-28T21:14:24.559380] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T21:14:24.581840] [INFO ] [REMOTE ] SOJC: Full fetch complete (7110 records). [2025-10-28T21:14:24.599800] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-28T21:14:24.665280] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:24.714745] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-28T21:14:24.725982] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-28T21:14:24.737708] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-28T21:14:24.738176] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-28T21:14:24.777067] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-28T21:14:24.791856] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-28T21:14:24.833127] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-28T21:14:25.148947] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-28T21:14:25.184045] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-28T21:14:25.192894] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-28T21:14:25.193007] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-28T21:14:25.244209] [DEBUG] [LOCAL ] SOJC: Trimmed 7110 records to 4384 (keeping 200 days of data) [2025-10-28T21:14:25.428032] [DEBUG] [LOCAL ] SOJC: Primary data saved (4384 records). [2025-10-28T21:14:25.428289] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-28T21:14:25.425734] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:25.428428] [INFO ] [MAIN ] Update Progress: 1956/2366 symbols completed. SOJC took 33.5s. Estimated remaining: 53m 19s. Rate: 7.7 symbols/min [2025-10-28T21:14:25.438882] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-28T21:14:25.493911] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T21:14:25.546288] [INFO ] [REMOTE ] SOC: Full fetch complete (72560 records). [2025-10-28T21:14:25.556570] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-28T21:14:25.588075] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-10-28T21:14:25.702504] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:25.884360] [DEBUG] [LOCAL ] SOL: Loaded 13500 existing records from primary storage. [2025-10-28T21:14:25.935443] [INFO ] [MAIN ] SOL: Loaded 13500 existing records. [2025-10-28T21:14:26.205869] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-28T21:14:26.207754] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-28T21:14:26.210697] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-28T21:14:26.210778] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-28T21:14:26.230906] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:14:26.232008] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-28T21:14:26.232419] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-28T21:14:26.232607] [DEBUG] [LOCAL ] SOC: Trimmed 72560 records to 51237 (keeping 200 days of data) [2025-10-28T21:14:26.233009] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-28T21:14:26.233080] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-28T21:14:26.407742] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-28T21:14:26.624752] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T21:14:26.869602] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:26.943531] [DEBUG] [LOCAL ] SOC: Primary data saved (51237 records). [2025-10-28T21:14:26.943691] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-28T21:14:26.943788] [INFO ] [MAIN ] Update Progress: 1957/2366 symbols completed. SOC took 36.4s. Estimated remaining: 53m 10s. Rate: 7.7 symbols/min [2025-10-28T21:14:27.180284] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-28T21:14:27.259482] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T21:14:27.980287] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-10-28T21:14:28.123608] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T21:14:28.720476] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T21:14:28.780231] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-10-28T21:14:29.495282] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T21:14:29.580208] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-10-28T21:14:30.185480] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T21:14:30.380239] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-28T21:14:31.180251] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-10-28T21:14:31.254697] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T21:14:31.722775] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T21:14:31.980281] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-28T21:14:32.780219] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-28T21:14:32.807818] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T21:14:33.466997] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T21:14:33.580264] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-28T21:14:34.122110] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T21:14:34.380247] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-28T21:14:35.130677] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T21:14:35.180216] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-28T21:14:35.980214] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-10-28T21:14:36.021367] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T21:14:36.578581] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T21:14:36.780242] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-28T21:14:37.580276] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-28T21:14:37.660087] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T21:14:38.217850] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T21:14:38.380266] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-28T21:14:39.153346] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T21:14:39.180238] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-28T21:14:39.822731] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T21:14:39.980269] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-28T21:14:40.744348] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T21:14:40.780257] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-28T21:14:41.580257] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-28T21:14:41.643606] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T21:14:41.652688] [INFO ] [REMOTE ] SOL: Full fetch complete (20711 records). [2025-10-28T21:14:41.652883] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-28T21:14:42.031216] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-28T21:14:42.031322] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-28T21:14:42.031843] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-28T21:14:42.031923] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-28T21:14:42.032706] [DEBUG] [LOCAL ] SOL: Trimmed 20711 records to 13524 (keeping 200 days of data) [2025-10-28T21:14:42.103092] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T21:14:42.116944] [DEBUG] [LOCAL ] SOL: Primary data saved (13524 records). [2025-10-28T21:14:42.117096] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-28T21:14:42.117177] [INFO ] [MAIN ] Update Progress: 1958/2366 symbols completed. SOL took 16.7s. Estimated remaining: 53m 4s. Rate: 7.7 symbols/min [2025-10-28T21:14:42.380348] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-28T21:14:42.917872] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T21:14:42.919839] [INFO ] [REMOTE ] SOJE: Full fetch complete (13351 records). [2025-10-28T21:14:42.919907] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-28T21:14:43.185427] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-10-28T21:14:43.291794] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-28T21:14:43.291872] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-28T21:14:43.292218] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-28T21:14:43.292258] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-28T21:14:43.292788] [DEBUG] [LOCAL ] SOJE: Trimmed 13351 records to 8575 (keeping 200 days of data) [2025-10-28T21:14:43.345244] [DEBUG] [LOCAL ] SOJE: Primary data saved (8575 records). [2025-10-28T21:14:43.345363] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-28T21:14:43.345439] [INFO ] [MAIN ] Update Progress: 1959/2366 symbols completed. SOJE took 37.4s. Estimated remaining: 52m 55s. Rate: 7.7 symbols/min [2025-10-28T21:14:43.976535] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T21:14:43.980192] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-10-28T21:14:44.565175] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T21:14:44.780224] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-10-28T21:14:45.343034] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T21:14:45.580239] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-10. [2025-10-28T21:14:46.043143] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:14:46.045028] [INFO ] [REMOTE ] SOJF: Full fetch complete (14254 records). [2025-10-28T21:14:46.045122] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-10-28T21:14:46.265569] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T21:14:46.265900] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:14:46.265988] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:14:46.266038] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-28T21:14:46.266117] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-28T21:14:46.266214] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-28T21:14:46.266310] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-28T21:14:46.266389] [INFO ] [MAIN ] Update Progress: 1960/2366 symbols completed. SOJF took 21.8s. Estimated remaining: 52m 46s. Rate: 7.7 symbols/min [2025-10-28T21:14:46.841817] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:46.924828] [DEBUG] [LOCAL ] SON: No existing data file found in primary storage. [2025-10-28T21:14:46.958217] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:46.969492] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:46.968613] [WARN ] [MAIN ] SON: No existing data found, performing full refresh instead. [2025-10-28T21:14:46.985465] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-28T21:14:46.987124] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:14:46.987217] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-28T21:14:46.987554] [DEBUG] [LOCAL ] SON: No primary data file found to delete. [2025-10-28T21:14:46.987595] [DEBUG] [LOCAL ] SOLV: No existing data file found in primary storage. [2025-10-28T21:14:46.987829] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-28T21:14:46.987787] [WARN ] [MAIN ] SOLV: No existing data found, performing full refresh instead. [2025-10-28T21:14:46.987970] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-28T21:14:47.020199] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-28T21:14:47.030854] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-28T21:14:47.047849] [DEBUG] [LOCAL ] SOR: Loaded 2796 existing records from primary storage. [2025-10-28T21:14:47.061992] [INFO ] [MAIN ] SOR: Loaded 2796 existing records. [2025-10-28T21:14:47.094457] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-28T21:14:47.635837] [DEBUG] [LOCAL ] SONY: Loaded 53367 existing records from primary storage. [2025-10-28T21:14:47.630822] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:14:47.658896] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-28T21:14:47.679095] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-28T21:14:47.714767] [INFO ] [MAIN ] SONY: Loaded 53367 existing records. [2025-10-28T21:14:47.714858] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-28T21:14:47.759730] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-28T21:14:48.045409] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:48.096448] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-28T21:14:48.283323] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:48.277986] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:14:48.283782] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-28T21:14:48.297769] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-28T21:14:48.309313] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-28T21:14:48.374522] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-28T21:14:48.400899] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-28T21:14:48.690984] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:48.742391] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-28T21:14:48.890118] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:14:48.890382] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-28T21:14:49.324673] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T21:14:49.351325] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T21:14:49.580296] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-28T21:14:49.684750] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:14:50.056477] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T21:14:50.380285] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-28T21:14:50.487034] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-28T21:14:50.870019] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T21:14:51.180320] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-28T21:14:51.980304] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-28T21:14:52.424015] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T21:14:52.425198] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T21:14:52.780313] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-28T21:14:53.580230] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-28T21:14:54.380289] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-28T21:14:54.514459] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T21:14:55.037041] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T21:14:55.180280] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-28T21:14:55.649218] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T21:14:55.980296] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-28T21:14:56.783695] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-28T21:14:56.793148] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T21:14:57.440713] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T21:14:57.580286] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-28T21:14:58.050278] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T21:14:58.380302] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-28T21:14:58.779761] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T21:14:59.180320] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-28T21:14:59.223969] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T21:14:59.695827] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T21:14:59.980303] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-28T21:15:00.780263] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-28T21:15:01.317626] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T21:15:01.580269] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-28T21:15:01.643401] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T21:15:02.380254] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-28T21:15:02.870496] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T21:15:03.091937] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T21:15:03.180220] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-28T21:15:03.980283] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-28T21:15:04.670791] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T21:15:04.780229] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-28T21:15:05.327116] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T21:15:05.580331] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-28T21:15:05.893909] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T21:15:06.059287] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T21:15:06.380260] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-28T21:15:07.180256] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-28T21:15:07.980272] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-28T21:15:08.780260] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-28T21:15:08.875614] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T21:15:09.563343] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T21:15:09.580207] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-28T21:15:10.388177] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-28T21:15:10.407393] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T21:15:10.527229] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (4.15 seconds). [2025-10-28T21:15:10.528386] [INFO ] [REMOTE ] SOR: Full fetch complete (4265 records). [2025-10-28T21:15:10.528459] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-28T21:15:10.900788] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-28T21:15:10.900891] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-28T21:15:10.901066] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-28T21:15:10.901209] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-28T21:15:10.901743] [DEBUG] [LOCAL ] SOR: Trimmed 4265 records to 2788 (keeping 200 days of data) [2025-10-28T21:15:10.919354] [DEBUG] [LOCAL ] SOR: Primary data saved (2788 records). [2025-10-28T21:15:10.919579] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-28T21:15:10.919909] [INFO ] [MAIN ] Update Progress: 1961/2366 symbols completed. SOR took 24.6s. Estimated remaining: 52m 42s. Rate: 7.7 symbols/min [2025-10-28T21:15:11.066386] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T21:15:11.135693] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:11.148440] [DEBUG] [LOCAL ] SOS: Loaded 9774 existing records from primary storage. [2025-10-28T21:15:11.148699] [INFO ] [MAIN ] SOS: Loaded 9774 existing records. [2025-10-28T21:15:11.185459] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-28T21:15:11.351578] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:15:11.351786] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-28T21:15:11.351835] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-28T21:15:11.352062] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-28T21:15:11.352121] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-28T21:15:11.717567] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:11.980238] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-28T21:15:12.034968] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T21:15:12.555208] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T21:15:12.780318] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-28T21:15:13.196295] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T21:15:13.452750] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T21:15:13.580255] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-28T21:15:14.380247] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-28T21:15:14.834637] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T21:15:14.850461] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T21:15:15.180233] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-28T21:15:15.980257] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-28T21:15:16.707511] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T21:15:16.717395] [INFO ] [REMOTE ] SON: Full fetch complete (63212 records). [2025-10-28T21:15:16.717535] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-28T21:15:16.785505] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-28T21:15:17.102249] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-28T21:15:17.102335] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-28T21:15:17.103386] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-28T21:15:17.103448] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-28T21:15:17.104689] [DEBUG] [LOCAL ] SON: Trimmed 63212 records to 43641 (keeping 200 days of data) [2025-10-28T21:15:17.285562] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T21:15:17.366903] [DEBUG] [LOCAL ] SON: Primary data saved (43641 records). [2025-10-28T21:15:17.367040] [INFO ] [MAIN ] SON: Full history saved. [2025-10-28T21:15:17.367117] [INFO ] [MAIN ] Update Progress: 1962/2366 symbols completed. SON took 31.1s. Estimated remaining: 52m 33s. Rate: 7.7 symbols/min [2025-10-28T21:15:17.559094] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:17.580240] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-28T21:15:17.592054] [DEBUG] [LOCAL ] SPB: Loaded 33564 existing records from primary storage. [2025-10-28T21:15:17.592334] [INFO ] [MAIN ] SPB: Loaded 33564 existing records. [2025-10-28T21:15:17.777720] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:15:17.778095] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-28T21:15:17.778174] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-28T21:15:17.778912] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-28T21:15:17.779147] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-28T21:15:18.107535] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T21:15:18.197137] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:18.380256] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-28T21:15:18.803555] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T21:15:19.180251] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-28T21:15:19.347122] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T21:15:19.980277] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-28T21:15:20.260341] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T21:15:20.268591] [INFO ] [REMOTE ] SOLV: Full fetch complete (63297 records). [2025-10-28T21:15:20.268747] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-28T21:15:20.379235] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T21:15:20.664859] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-28T21:15:20.664944] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-28T21:15:20.666036] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-28T21:15:20.666099] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-28T21:15:20.667401] [DEBUG] [LOCAL ] SOLV: Trimmed 63297 records to 43064 (keeping 200 days of data) [2025-10-28T21:15:20.783299] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-28T21:15:20.934742] [DEBUG] [LOCAL ] SOLV: Primary data saved (43064 records). [2025-10-28T21:15:20.934861] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-28T21:15:20.934929] [INFO ] [MAIN ] Update Progress: 1963/2366 symbols completed. SOLV took 34.7s. Estimated remaining: 52m 25s. Rate: 7.7 symbols/min [2025-10-28T21:15:21.101742] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:21.144923] [DEBUG] [LOCAL ] SPCE: Loaded 50083 existing records from primary storage. [2025-10-28T21:15:21.145242] [INFO ] [MAIN ] SPCE: Loaded 50083 existing records. [2025-10-28T21:15:21.321433] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:15:21.321683] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-28T21:15:21.321740] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-28T21:15:21.322275] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-28T21:15:21.322339] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-28T21:15:21.590024] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-28T21:15:21.671019] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:22.157432] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T21:15:22.380280] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-28T21:15:22.684478] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T21:15:23.180252] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-28T21:15:23.622388] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T21:15:23.980269] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-28T21:15:24.355806] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-28T21:15:24.780254] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-28T21:15:25.082829] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:15:25.580250] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-28T21:15:25.802066] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T21:15:26.380301] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-28T21:15:27.147726] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T21:15:27.180209] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-28T21:15:27.480086] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T21:15:27.490847] [INFO ] [REMOTE ] SONY: Full fetch complete (77397 records). [2025-10-28T21:15:27.490979] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-28T21:15:27.891099] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-28T21:15:27.891175] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-28T21:15:27.892303] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-28T21:15:27.892364] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-28T21:15:27.893846] [DEBUG] [LOCAL ] SONY: Trimmed 77397 records to 53356 (keeping 200 days of data) [2025-10-28T21:15:27.984710] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-28T21:15:28.206311] [DEBUG] [LOCAL ] SONY: Primary data saved (53356 records). [2025-10-28T21:15:28.206444] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-28T21:15:28.207075] [INFO ] [MAIN ] Update Progress: 1964/2366 symbols completed. SONY took 41.9s. Estimated remaining: 52m 17s. Rate: 7.7 symbols/min [2025-10-28T21:15:28.380173] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:28.392403] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:15:28.403289] [DEBUG] [LOCAL ] SPE: Loaded 6006 existing records from primary storage. [2025-10-28T21:15:28.403501] [INFO ] [MAIN ] SPE: Loaded 6006 existing records. [2025-10-28T21:15:28.583711] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:15:28.583946] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-28T21:15:28.583999] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-28T21:15:28.584191] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-28T21:15:28.584236] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-28T21:15:28.785558] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-28T21:15:28.952279] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:29.136826] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T21:15:29.580249] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-28T21:15:30.380279] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-28T21:15:30.392585] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T21:15:30.395170] [INFO ] [REMOTE ] SOS: Full fetch complete (11260 records). [2025-10-28T21:15:30.395240] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-28T21:15:30.769819] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-28T21:15:30.785844] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-28T21:15:30.786054] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-28T21:15:30.786674] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-28T21:15:30.786760] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-28T21:15:30.787513] [DEBUG] [LOCAL ] SOS: Trimmed 11260 records to 9803 (keeping 200 days of data) [2025-10-28T21:15:30.840614] [DEBUG] [LOCAL ] SOS: Primary data saved (9803 records). [2025-10-28T21:15:30.840783] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-28T21:15:30.840876] [INFO ] [MAIN ] Update Progress: 1965/2366 symbols completed. SOS took 19.9s. Estimated remaining: 52m 8s. Rate: 7.7 symbols/min [2025-10-28T21:15:31.007979] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:31.013154] [DEBUG] [LOCAL ] SPG: No existing data file found in primary storage. [2025-10-28T21:15:31.013375] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T21:15:31.013464] [WARN ] [MAIN ] SPG: No existing data found, performing full refresh instead. [2025-10-28T21:15:31.015739] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-28T21:15:31.015785] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-28T21:15:31.015826] [DEBUG] [LOCAL ] SPG: No primary data file found to delete. [2025-10-28T21:15:31.015859] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-28T21:15:31.190583] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-28T21:15:31.362143] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:31.980209] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-28T21:15:32.387172] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T21:15:32.780271] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-28T21:15:33.454712] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T21:15:33.580269] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-28T21:15:34.106301] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T21:15:34.380268] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-28T21:15:34.878809] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T21:15:34.989463] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T21:15:35.180321] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-28T21:15:35.980271] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-28T21:15:36.337085] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T21:15:36.780306] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-28T21:15:37.314274] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T21:15:37.424659] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:15:37.580284] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-28T21:15:38.225635] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T21:15:38.380267] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-28T21:15:39.180252] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-28T21:15:39.651593] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T21:15:39.980283] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-28T21:15:40.780253] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-28T21:15:40.837858] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T21:15:41.108145] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T21:15:41.286443] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:15:41.580241] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-28T21:15:42.380257] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-28T21:15:43.029290] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T21:15:43.180243] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-28T21:15:43.582461] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-28T21:15:43.736254] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T21:15:43.980354] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-28T21:15:44.780329] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-28T21:15:45.464602] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:15:45.580259] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-28T21:15:46.380266] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-28T21:15:46.416992] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T21:15:46.957890] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T21:15:47.052731] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T21:15:47.180270] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-28T21:15:47.980322] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-28T21:15:48.632783] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T21:15:48.780259] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-28T21:15:49.046809] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:15:49.580328] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-28T21:15:50.125027] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T21:15:50.346029] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T21:15:50.380266] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-28T21:15:51.180316] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-28T21:15:51.663974] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:15:51.980291] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-28T21:15:52.509514] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T21:15:52.511055] [INFO ] [REMOTE ] SPE: Full fetch complete (9750 records). [2025-10-28T21:15:52.511129] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-28T21:15:52.785499] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-28T21:15:52.885102] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-28T21:15:52.885179] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-28T21:15:52.885437] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-28T21:15:52.885476] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-28T21:15:52.885995] [DEBUG] [LOCAL ] SPE: Trimmed 9750 records to 5991 (keeping 200 days of data) [2025-10-28T21:15:52.925445] [DEBUG] [LOCAL ] SPE: Primary data saved (5991 records). [2025-10-28T21:15:52.925598] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-28T21:15:52.925742] [INFO ] [MAIN ] Update Progress: 1966/2366 symbols completed. SPE took 24.7s. Estimated remaining: 52m 3s. Rate: 7.7 symbols/min [2025-10-28T21:15:53.103524] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:53.103755] [DEBUG] [LOCAL ] SPGI: No existing data file found in primary storage. [2025-10-28T21:15:53.103801] [WARN ] [MAIN ] SPGI: No existing data found, performing full refresh instead. [2025-10-28T21:15:53.103876] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-28T21:15:53.103911] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-28T21:15:53.103952] [DEBUG] [LOCAL ] SPGI: No primary data file found to delete. [2025-10-28T21:15:53.103985] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-28T21:15:53.482121] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:53.521516] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-28T21:15:53.580232] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-28T21:15:53.969198] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T21:15:54.380330] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-28T21:15:55.180312] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-28T21:15:55.612584] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-28T21:15:55.900123] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T21:15:55.980265] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-28T21:15:56.199188] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T21:15:56.204800] [INFO ] [REMOTE ] SPB: Full fetch complete (47475 records). [2025-10-28T21:15:56.204913] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-28T21:15:56.598456] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-28T21:15:56.598542] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-28T21:15:56.599579] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-28T21:15:56.599662] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-28T21:15:56.600826] [DEBUG] [LOCAL ] SPB: Trimmed 47475 records to 33376 (keeping 200 days of data) [2025-10-28T21:15:56.791774] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-28T21:15:56.818486] [DEBUG] [LOCAL ] SPB: Primary data saved (33376 records). [2025-10-28T21:15:56.818673] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-28T21:15:56.818777] [INFO ] [MAIN ] Update Progress: 1967/2366 symbols completed. SPB took 39.5s. Estimated remaining: 51m 54s. Rate: 7.7 symbols/min [2025-10-28T21:15:57.015917] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:57.033802] [DEBUG] [LOCAL ] SPH: Loaded 16274 existing records from primary storage. [2025-10-28T21:15:57.034050] [INFO ] [MAIN ] SPH: Loaded 16274 existing records. [2025-10-28T21:15:57.238777] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:15:57.239128] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-28T21:15:57.239184] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-28T21:15:57.239505] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-28T21:15:57.239565] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-28T21:15:57.604398] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-28T21:15:57.635837] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:57.668837] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T21:15:58.380284] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-28T21:15:58.381230] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T21:15:58.392201] [INFO ] [REMOTE ] SPG: Full fetch complete (71977 records). [2025-10-28T21:15:58.392339] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-28T21:15:58.839255] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-28T21:15:58.839390] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-28T21:15:58.840677] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-28T21:15:58.840743] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-28T21:15:58.842193] [DEBUG] [LOCAL ] SPG: Trimmed 71977 records to 49802 (keeping 200 days of data) [2025-10-28T21:15:59.159136] [DEBUG] [LOCAL ] SPG: Primary data saved (49802 records). [2025-10-28T21:15:59.159412] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-28T21:15:59.159490] [INFO ] [MAIN ] Update Progress: 1968/2366 symbols completed. SPG took 28.3s. Estimated remaining: 51m 46s. Rate: 7.7 symbols/min [2025-10-28T21:15:59.197109] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-28T21:15:59.243836] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T21:15:59.372518] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:15:59.386998] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T21:15:59.426930] [DEBUG] [LOCAL ] SPHR: Loaded 40518 existing records from primary storage. [2025-10-28T21:15:59.427200] [INFO ] [MAIN ] SPHR: Loaded 40518 existing records. [2025-10-28T21:15:59.605048] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:15:59.605239] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-28T21:15:59.605285] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-28T21:15:59.605821] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-28T21:15:59.605880] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-28T21:15:59.955040] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:15:59.980232] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-28T21:16:00.780263] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-28T21:16:01.021413] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T21:16:01.581632] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T21:16:01.580739] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-28T21:16:01.708795] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T21:16:02.380285] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-28T21:16:02.901348] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T21:16:03.180341] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-28T21:16:03.326430] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T21:16:03.847392] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:16:03.858072] [INFO ] [REMOTE ] SPCE: Full fetch complete (72709 records). [2025-10-28T21:16:03.858226] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-28T21:16:03.985470] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-28T21:16:04.259482] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-28T21:16:04.259576] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-28T21:16:04.261154] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-28T21:16:04.261368] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-28T21:16:04.262859] [DEBUG] [LOCAL ] SPCE: Trimmed 72709 records to 50110 (keeping 200 days of data) [2025-10-28T21:16:04.538622] [DEBUG] [LOCAL ] SPCE: Primary data saved (50110 records). [2025-10-28T21:16:04.538776] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-28T21:16:04.538857] [INFO ] [MAIN ] Update Progress: 1969/2366 symbols completed. SPCE took 43.6s. Estimated remaining: 51m 37s. Rate: 7.7 symbols/min [2025-10-28T21:16:04.702301] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:04.743375] [DEBUG] [LOCAL ] SPIR: Loaded 37107 existing records from primary storage. [2025-10-28T21:16:04.743788] [INFO ] [MAIN ] SPIR: Loaded 37107 existing records. [2025-10-28T21:16:04.786495] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-28T21:16:04.933833] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:16:04.934074] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-28T21:16:04.934123] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-28T21:16:04.934408] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-28T21:16:04.934450] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-28T21:16:05.278056] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:05.580299] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-28T21:16:05.705852] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T21:16:05.867868] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-28T21:16:06.380268] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-28T21:16:06.618056] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T21:16:07.180350] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-28T21:16:07.750561] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T21:16:07.980347] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-28T21:16:08.415004] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T21:16:08.778114] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T21:16:08.781893] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-28T21:16:09.580269] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-28T21:16:10.297414] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T21:16:10.380297] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-28T21:16:11.056083] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T21:16:11.180318] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-28T21:16:11.574441] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T21:16:11.980269] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-28T21:16:12.047842] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T21:16:12.780303] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-28T21:16:13.518822] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T21:16:13.548867] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T21:16:13.580223] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-28T21:16:14.380312] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-28T21:16:15.034916] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T21:16:15.180302] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-28T21:16:15.574234] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T21:16:15.980279] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-28T21:16:16.705093] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T21:16:16.780236] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-28T21:16:17.008924] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T21:16:17.444492] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T21:16:17.580246] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-28T21:16:18.380289] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-28T21:16:19.156502] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T21:16:19.180231] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-28T21:16:19.351662] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T21:16:19.362228] [INFO ] [REMOTE ] SPGI: Full fetch complete (67804 records). [2025-10-28T21:16:19.362363] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-28T21:16:19.798111] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-28T21:16:19.798203] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-28T21:16:19.799301] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-28T21:16:19.799374] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-28T21:16:19.800706] [DEBUG] [LOCAL ] SPGI: Trimmed 67804 records to 45742 (keeping 200 days of data) [2025-10-28T21:16:19.993868] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-28T21:16:20.067074] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T21:16:20.126309] [DEBUG] [LOCAL ] SPGI: Primary data saved (45742 records). [2025-10-28T21:16:20.126460] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-28T21:16:20.126542] [INFO ] [MAIN ] Update Progress: 1970/2366 symbols completed. SPGI took 27.2s. Estimated remaining: 51m 31s. Rate: 7.7 symbols/min [2025-10-28T21:16:20.299954] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:20.306421] [DEBUG] [LOCAL ] SPMC: Loaded 5211 existing records from primary storage. [2025-10-28T21:16:20.306599] [INFO ] [MAIN ] SPMC: Loaded 5211 existing records. [2025-10-28T21:16:20.483766] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:16:20.483993] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-28T21:16:20.484041] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-28T21:16:20.484243] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-28T21:16:20.484281] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-28T21:16:20.793843] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-28T21:16:20.833851] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:21.416597] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T21:16:21.580267] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-28T21:16:21.978933] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T21:16:22.380255] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-28T21:16:22.640518] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T21:16:23.180271] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-28T21:16:23.721109] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T21:16:23.980264] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-28T21:16:24.345575] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T21:16:24.392933] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T21:16:24.780236] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-28T21:16:25.454370] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:16:25.457530] [INFO ] [REMOTE ] SPH: Full fetch complete (27640 records). [2025-10-28T21:16:25.457598] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-28T21:16:25.585370] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-28T21:16:25.824213] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-28T21:16:25.824286] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-28T21:16:25.824860] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-28T21:16:25.824923] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-28T21:16:25.825531] [DEBUG] [LOCAL ] SPH: Trimmed 27640 records to 16195 (keeping 200 days of data) [2025-10-28T21:16:25.919217] [DEBUG] [LOCAL ] SPH: Primary data saved (16195 records). [2025-10-28T21:16:25.919343] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-28T21:16:25.919419] [INFO ] [MAIN ] Update Progress: 1971/2366 symbols completed. SPH took 29.1s. Estimated remaining: 51m 23s. Rate: 7.7 symbols/min [2025-10-28T21:16:26.088269] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:26.088437] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-28T21:16:26.088490] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-28T21:16:26.088594] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-28T21:16:26.088634] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-28T21:16:26.088733] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-28T21:16:26.088772] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-28T21:16:26.394871] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-28T21:16:26.434991] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:26.825440] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T21:16:27.017975] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T21:16:27.180242] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-10-28T21:16:27.465843] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:16:27.466178] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-10-28T21:16:27.466275] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:16:27.466353] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-28T21:16:27.466417] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:16:27.466483] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-28T21:16:27.466545] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-28T21:16:27.466580] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-28T21:16:27.466620] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-28T21:16:27.466697] [INFO ] [MAIN ] Update Progress: 1972/2366 symbols completed. SPME took 1.5s. Estimated remaining: 51m 14s. Rate: 7.7 symbols/min [2025-10-28T21:16:27.632616] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:27.632780] [DEBUG] [LOCAL ] SPNT: No existing data file found in primary storage. [2025-10-28T21:16:27.632822] [WARN ] [MAIN ] SPNT: No existing data found, performing full refresh instead. [2025-10-28T21:16:27.632926] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-28T21:16:27.632966] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-28T21:16:27.633005] [DEBUG] [LOCAL ] SPNT: No primary data file found to delete. [2025-10-28T21:16:27.633036] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-28T21:16:27.982883] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-28T21:16:27.982788] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:28.780256] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-28T21:16:29.152434] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T21:16:29.580370] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-28T21:16:30.380309] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-28T21:16:30.478301] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-28T21:16:30.528112] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T21:16:31.180299] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-28T21:16:31.553843] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T21:16:31.980302] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-28T21:16:32.501426] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T21:16:32.780237] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-28T21:16:32.834080] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T21:16:32.843152] [INFO ] [REMOTE ] SPHR: Full fetch complete (58722 records). [2025-10-28T21:16:32.843293] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-28T21:16:33.217154] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-28T21:16:33.217249] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-28T21:16:33.218328] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-28T21:16:33.218392] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-28T21:16:33.219587] [DEBUG] [LOCAL ] SPHR: Trimmed 58722 records to 40410 (keeping 200 days of data) [2025-10-28T21:16:33.340883] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T21:16:33.457789] [DEBUG] [LOCAL ] SPHR: Primary data saved (40410 records). [2025-10-28T21:16:33.457905] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-28T21:16:33.457993] [INFO ] [MAIN ] Update Progress: 1973/2366 symbols completed. SPHR took 34.3s. Estimated remaining: 51m 6s. Rate: 7.7 symbols/min [2025-10-28T21:16:33.594329] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-28T21:16:33.624706] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:33.667222] [DEBUG] [LOCAL ] SPOT: Loaded 50113 existing records from primary storage. [2025-10-28T21:16:33.667518] [INFO ] [MAIN ] SPOT: Loaded 50113 existing records. [2025-10-28T21:16:33.845071] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:16:33.845501] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-28T21:16:33.845553] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-28T21:16:33.846704] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-28T21:16:33.846763] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-28T21:16:34.192609] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:34.291242] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T21:16:34.380342] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-28T21:16:35.180243] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-28T21:16:35.337993] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T21:16:35.670989] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T21:16:35.980260] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-28T21:16:36.780231] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-28T21:16:37.174030] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T21:16:37.327589] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T21:16:37.580251] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-28T21:16:38.136333] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T21:16:38.380250] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-28T21:16:39.180252] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-28T21:16:39.469189] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T21:16:39.980305] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-28T21:16:40.313444] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T21:16:40.321161] [INFO ] [REMOTE ] SPIR: Full fetch complete (54245 records). [2025-10-28T21:16:40.321271] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-28T21:16:40.703048] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-28T21:16:40.703143] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-28T21:16:40.704241] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-28T21:16:40.704305] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-28T21:16:40.705448] [DEBUG] [LOCAL ] SPIR: Trimmed 54245 records to 36972 (keeping 200 days of data) [2025-10-28T21:16:40.785611] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-28T21:16:40.915869] [DEBUG] [LOCAL ] SPIR: Primary data saved (36972 records). [2025-10-28T21:16:40.916009] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-28T21:16:40.916093] [INFO ] [MAIN ] Update Progress: 1974/2366 symbols completed. SPIR took 36.4s. Estimated remaining: 50m 58s. Rate: 7.7 symbols/min [2025-10-28T21:16:41.087033] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:41.107821] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T21:16:41.145612] [DEBUG] [LOCAL ] SPR: Loaded 40319 existing records from primary storage. [2025-10-28T21:16:41.145929] [INFO ] [MAIN ] SPR: Loaded 40319 existing records. [2025-10-28T21:16:41.322844] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:16:41.323072] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-28T21:16:41.323118] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-28T21:16:41.323295] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-28T21:16:41.323362] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-28T21:16:41.585450] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-28T21:16:41.686284] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:42.380240] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-28T21:16:42.435469] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T21:16:42.692278] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T21:16:42.935018] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T21:16:42.937456] [INFO ] [REMOTE ] SPMC: Full fetch complete (8449 records). [2025-10-28T21:16:42.937524] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-28T21:16:43.185460] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-28T21:16:43.297439] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-28T21:16:43.297518] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-28T21:16:43.297768] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-28T21:16:43.297830] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-28T21:16:43.298293] [DEBUG] [LOCAL ] SPMC: Trimmed 8449 records to 5174 (keeping 200 days of data) [2025-10-28T21:16:43.330058] [DEBUG] [LOCAL ] SPMC: Primary data saved (5174 records). [2025-10-28T21:16:43.330200] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-28T21:16:43.330309] [INFO ] [MAIN ] Update Progress: 1975/2366 symbols completed. SPMC took 23.2s. Estimated remaining: 50m 49s. Rate: 7.7 symbols/min [2025-10-28T21:16:43.501075] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:43.511326] [DEBUG] [LOCAL ] SPRU: Loaded 9926 existing records from primary storage. [2025-10-28T21:16:43.511525] [INFO ] [MAIN ] SPRU: Loaded 9926 existing records. [2025-10-28T21:16:43.692053] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:16:43.692350] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-28T21:16:43.692432] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-28T21:16:43.692929] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-28T21:16:43.693002] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-28T21:16:43.985464] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-28T21:16:44.047544] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:44.780313] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-28T21:16:45.172067] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-28T21:16:45.204831] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:16:45.315380] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T21:16:45.580244] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-28T21:16:46.074831] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T21:16:46.380239] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-28T21:16:47.180304] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-28T21:16:47.578185] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T21:16:47.980386] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-28T21:16:48.780292] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-28T21:16:49.007044] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-28T21:16:49.517982] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:16:49.580311] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-28T21:16:49.929010] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:16:50.380281] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-28T21:16:50.913825] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T21:16:51.037940] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T21:16:51.180288] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-28T21:16:51.980248] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-28T21:16:52.041920] [DEBUG] [REMOTE ] SPRU: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-28T21:16:52.042202] [WARN ] [REMOTE ] SPRU: No data returned for month 2025-04 [2025-10-28T21:16:52.042313] [FATAL] [REMOTE ] SPRU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:16:52.042428] [FATAL] [MAIN ] SPRU: Failed to fetch primary data. [2025-10-28T21:16:52.042511] [WARN ] [MAIN ] SPRU: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:16:52.042604] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-28T21:16:52.042723] [DEBUG] [LOCAL ] SPRU: No primary data file found to delete. [2025-10-28T21:16:52.042779] [INFO ] [LOCAL ] SPRU: Starting deletion of derivative data. [2025-10-28T21:16:52.042951] [DEBUG] [LOCAL ] SPRU: Deleted derivative data file. [2025-10-28T21:16:52.043044] [INFO ] [MAIN ] Update Progress: 1976/2366 symbols completed. SPRU took 8.7s. Estimated remaining: 50m 41s. Rate: 7.7 symbols/min [2025-10-28T21:16:52.213686] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:16:52.213894] [DEBUG] [LOCAL ] SPXC: No existing data file found in primary storage. [2025-10-28T21:16:52.213962] [WARN ] [MAIN ] SPXC: No existing data found, performing full refresh instead. [2025-10-28T21:16:52.214105] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-28T21:16:52.214254] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-28T21:16:52.214318] [DEBUG] [LOCAL ] SPXC: No primary data file found to delete. [2025-10-28T21:16:52.214360] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-28T21:16:52.483217] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:16:52.598631] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:16:52.780249] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-28T21:16:53.580248] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-28T21:16:53.788590] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T21:16:54.380286] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-28T21:16:54.704912] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T21:16:55.180254] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-28T21:16:55.286994] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T21:16:55.980320] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-28T21:16:56.289972] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T21:16:56.780239] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-28T21:16:56.919126] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T21:16:57.580281] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-28T21:16:58.073134] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T21:16:58.380309] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-28T21:16:58.513337] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T21:16:59.180333] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-28T21:16:59.980300] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-28T21:17:00.294848] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T21:17:00.357885] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-28T21:17:00.780279] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-28T21:17:00.847284] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T21:17:01.580378] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-28T21:17:01.758898] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T21:17:01.765815] [INFO ] [REMOTE ] SPNT: Full fetch complete (48396 records). [2025-10-28T21:17:01.766041] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-28T21:17:02.163739] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-28T21:17:02.163841] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-28T21:17:02.164983] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-28T21:17:02.165049] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-28T21:17:02.166267] [DEBUG] [LOCAL ] SPNT: Trimmed 48396 records to 33898 (keeping 200 days of data) [2025-10-28T21:17:02.365192] [DEBUG] [LOCAL ] SPNT: Primary data saved (33898 records). [2025-10-28T21:17:02.365338] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-28T21:17:02.365412] [INFO ] [MAIN ] Update Progress: 1977/2366 symbols completed. SPNT took 34.9s. Estimated remaining: 50m 34s. Rate: 7.7 symbols/min [2025-10-28T21:17:02.387363] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-28T21:17:02.545461] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:02.555446] [DEBUG] [LOCAL ] SPXX: Loaded 8945 existing records from primary storage. [2025-10-28T21:17:02.555630] [INFO ] [MAIN ] SPXX: Loaded 8945 existing records. [2025-10-28T21:17:02.735333] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:17:02.735864] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-28T21:17:02.735979] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-28T21:17:02.736425] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-28T21:17:02.736487] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-28T21:17:03.130569] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:03.134639] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T21:17:03.180220] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-28T21:17:03.547353] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T21:17:03.980243] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-28T21:17:04.265731] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T21:17:04.780310] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-28T21:17:05.382225] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T21:17:05.580281] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-28T21:17:06.235145] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T21:17:06.305444] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-28T21:17:06.380262] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-28T21:17:07.180272] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-28T21:17:07.755144] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T21:17:07.980265] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-28T21:17:08.299172] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T21:17:08.780279] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-28T21:17:09.067303] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T21:17:09.541079] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T21:17:09.580233] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-28T21:17:10.202056] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T21:17:10.380256] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-28T21:17:11.180255] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-28T21:17:11.845862] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T21:17:11.980214] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-28T21:17:12.301015] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-28T21:17:12.780285] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-28T21:17:13.379315] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T21:17:13.580265] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-28T21:17:14.054987] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T21:17:14.062608] [INFO ] [REMOTE ] SPR: Full fetch complete (59432 records). [2025-10-28T21:17:14.062790] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-28T21:17:14.063484] [FATAL] [VALIDATOR ] SPR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T21:17:14.063611] [FATAL] [MAIN ] SPR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:17:14.063687] [WARN ] [MAIN ] SPR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:17:14.063743] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-28T21:17:14.063801] [DEBUG] [LOCAL ] SPR: No primary data file found to delete. [2025-10-28T21:17:14.063836] [INFO ] [LOCAL ] SPR: Starting deletion of derivative data. [2025-10-28T21:17:14.064013] [DEBUG] [LOCAL ] SPR: Deleted derivative data file. [2025-10-28T21:17:14.064103] [INFO ] [MAIN ] Update Progress: 1978/2366 symbols completed. SPR took 33.1s. Estimated remaining: 50m 27s. Rate: 7.7 symbols/min [2025-10-28T21:17:14.239328] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:14.283048] [DEBUG] [LOCAL ] SQM: Loaded 48867 existing records from primary storage. [2025-10-28T21:17:14.283335] [INFO ] [MAIN ] SQM: Loaded 48867 existing records. [2025-10-28T21:17:14.382426] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-28T21:17:14.460605] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:17:14.460838] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-28T21:17:14.460884] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-28T21:17:14.461239] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-28T21:17:14.461296] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-28T21:17:14.813052] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:14.921919] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-28T21:17:15.082884] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T21:17:15.180315] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-28T21:17:15.980320] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-28T21:17:16.780334] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-28T21:17:17.035125] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-28T21:17:17.064549] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T21:17:17.580306] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-28T21:17:18.291143] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T21:17:18.380266] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-28T21:17:18.636126] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T21:17:19.180274] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-28T21:17:19.980281] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-28T21:17:20.383877] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T21:17:20.429241] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T21:17:20.528774] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T21:17:20.780249] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-28T21:17:21.580281] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-28T21:17:21.918783] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T21:17:21.923513] [INFO ] [REMOTE ] SPXC: Full fetch complete (34039 records). [2025-10-28T21:17:21.923598] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-28T21:17:22.330399] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-28T21:17:22.330691] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-28T21:17:22.339685] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-28T21:17:22.340323] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-28T21:17:22.340686] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T21:17:22.345188] [DEBUG] [LOCAL ] SPXC: Trimmed 34039 records to 22782 (keeping 200 days of data) [2025-10-28T21:17:22.397042] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-28T21:17:22.490292] [DEBUG] [LOCAL ] SPXC: Primary data saved (22782 records). [2025-10-28T21:17:22.490419] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-28T21:17:22.490490] [INFO ] [MAIN ] Update Progress: 1979/2366 symbols completed. SPXC took 30.4s. Estimated remaining: 50m 19s. Rate: 7.7 symbols/min [2025-10-28T21:17:22.685745] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:22.713624] [DEBUG] [LOCAL ] SQNS: Loaded 28649 existing records from primary storage. [2025-10-28T21:17:22.713900] [INFO ] [MAIN ] SQNS: Loaded 28649 existing records. [2025-10-28T21:17:22.902607] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:17:22.902901] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-28T21:17:22.903032] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-28T21:17:22.903312] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-28T21:17:22.903398] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-28T21:17:23.183831] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-28T21:17:23.275489] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T21:17:23.294916] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:23.305728] [INFO ] [REMOTE ] SPOT: Full fetch complete (73367 records). [2025-10-28T21:17:23.305857] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-28T21:17:23.307245] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T21:17:23.307438] [FATAL] [MAIN ] SPOT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:17:23.307504] [WARN ] [MAIN ] SPOT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:17:23.307585] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-28T21:17:23.307683] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-28T21:17:23.307741] [INFO ] [LOCAL ] SPOT: Starting deletion of derivative data. [2025-10-28T21:17:23.307914] [DEBUG] [LOCAL ] SPOT: Deleted derivative data file. [2025-10-28T21:17:23.308267] [INFO ] [MAIN ] Update Progress: 1980/2366 symbols completed. SPOT took 49.9s. Estimated remaining: 50m 10s. Rate: 7.7 symbols/min [2025-10-28T21:17:23.474322] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:23.474468] [DEBUG] [LOCAL ] SR: No existing data file found in primary storage. [2025-10-28T21:17:23.474504] [WARN ] [MAIN ] SR: No existing data found, performing full refresh instead. [2025-10-28T21:17:23.474607] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-28T21:17:23.474674] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-28T21:17:23.474737] [DEBUG] [LOCAL ] SR: No primary data file found to delete. [2025-10-28T21:17:23.474771] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-28T21:17:23.815340] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:23.980236] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-28T21:17:24.027199] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T21:17:24.029895] [INFO ] [REMOTE ] SPXX: Full fetch complete (13445 records). [2025-10-28T21:17:24.029962] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-28T21:17:24.399147] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-28T21:17:24.399226] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-28T21:17:24.399518] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-28T21:17:24.399555] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-28T21:17:24.400019] [DEBUG] [LOCAL ] SPXX: Trimmed 13445 records to 8894 (keeping 200 days of data) [2025-10-28T21:17:24.451950] [DEBUG] [LOCAL ] SPXX: Primary data saved (8894 records). [2025-10-28T21:17:24.452071] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-28T21:17:24.452147] [INFO ] [MAIN ] Update Progress: 1981/2366 symbols completed. SPXX took 22.1s. Estimated remaining: 50m 1s. Rate: 7.7 symbols/min [2025-10-28T21:17:24.622782] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:24.623219] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-10-28T21:17:24.623275] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-10-28T21:17:24.623391] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-28T21:17:24.623433] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-28T21:17:24.623476] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-10-28T21:17:24.623508] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-28T21:17:24.788920] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-28T21:17:24.856210] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T21:17:25.009147] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:25.580279] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-28T21:17:26.247768] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T21:17:26.334064] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T21:17:26.380267] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-28T21:17:27.180255] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-28T21:17:27.727861] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:17:27.839349] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T21:17:27.980247] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-28T21:17:28.623023] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T21:17:28.780263] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-28T21:17:29.436736] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T21:17:29.580273] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-28T21:17:30.380286] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-28T21:17:30.889764] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T21:17:31.180277] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-28T21:17:31.757763] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T21:17:31.980242] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-28T21:17:32.599448] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T21:17:32.780261] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-28T21:17:32.996863] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T21:17:33.580318] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-28T21:17:34.193630] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T21:17:34.380215] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-28T21:17:35.180248] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-28T21:17:35.980236] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-28T21:17:36.042620] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-28T21:17:36.219846] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T21:17:36.638242] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-28T21:17:36.780294] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-28T21:17:37.489702] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T21:17:37.580253] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-28T21:17:37.786844] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T21:17:38.380266] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-28T21:17:39.049527] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T21:17:39.180293] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-28T21:17:39.491296] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T21:17:39.980308] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-28T21:17:40.632827] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T21:17:40.780263] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-28T21:17:41.580313] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-28T21:17:42.380278] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-28T21:17:42.419447] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-28T21:17:42.462597] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T21:17:42.472770] [INFO ] [REMOTE ] SQM: Full fetch complete (69896 records). [2025-10-28T21:17:42.472884] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-28T21:17:42.857601] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-28T21:17:42.857709] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-28T21:17:42.858881] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-28T21:17:42.858945] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-28T21:17:42.860286] [DEBUG] [LOCAL ] SQM: Trimmed 69896 records to 48813 (keeping 200 days of data) [2025-10-28T21:17:43.158152] [DEBUG] [LOCAL ] SQM: Primary data saved (48813 records). [2025-10-28T21:17:43.158304] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-28T21:17:43.158397] [INFO ] [MAIN ] Update Progress: 1982/2366 symbols completed. SQM took 29.1s. Estimated remaining: 49m 55s. Rate: 7.7 symbols/min [2025-10-28T21:17:43.187231] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-28T21:17:43.337639] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T21:17:43.410481] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:43.423629] [DEBUG] [LOCAL ] SREA: Loaded 9512 existing records from primary storage. [2025-10-28T21:17:43.423901] [INFO ] [MAIN ] SREA: Loaded 9512 existing records. [2025-10-28T21:17:43.606233] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:17:43.606485] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-28T21:17:43.606557] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-28T21:17:43.606973] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-28T21:17:43.607084] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-28T21:17:43.811057] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T21:17:43.992126] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:43.986586] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-28T21:17:44.388980] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:17:44.780298] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-28T21:17:45.349794] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:17:45.580361] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-28T21:17:45.799807] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T21:17:45.804968] [INFO ] [REMOTE ] SQNS: Full fetch complete (33448 records). [2025-10-28T21:17:45.805043] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-28T21:17:46.175228] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-28T21:17:46.175320] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-28T21:17:46.176073] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-28T21:17:46.176133] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-28T21:17:46.176917] [DEBUG] [LOCAL ] SQNS: Trimmed 33448 records to 28866 (keeping 200 days of data) [2025-10-28T21:17:46.333066] [DEBUG] [LOCAL ] SQNS: Primary data saved (28866 records). [2025-10-28T21:17:46.333187] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-28T21:17:46.333267] [INFO ] [MAIN ] Update Progress: 1983/2366 symbols completed. SQNS took 23.8s. Estimated remaining: 49m 47s. Rate: 7.7 symbols/min [2025-10-28T21:17:46.387794] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-28T21:17:46.528133] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:17:46.565312] [DEBUG] [LOCAL ] SRFM: Loaded 40662 existing records from primary storage. [2025-10-28T21:17:46.565587] [INFO ] [MAIN ] SRFM: Loaded 40662 existing records. [2025-10-28T21:17:46.747623] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:17:46.748028] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-28T21:17:46.748139] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-28T21:17:46.748725] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-28T21:17:46.748858] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-28T21:17:46.892691] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T21:17:47.140706] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:17:47.180221] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-28T21:17:47.980222] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-28T21:17:48.060137] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T21:17:48.087243] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T21:17:48.607797] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T21:17:48.780234] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-28T21:17:49.580243] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-28T21:17:49.968153] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T21:17:50.380291] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-28T21:17:50.647311] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T21:17:51.180233] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-28T21:17:51.964685] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T21:17:51.980215] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-28T21:17:52.413293] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T21:17:52.780314] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-28T21:17:53.364737] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T21:17:53.580240] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-28T21:17:53.735866] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T21:17:54.380282] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-28T21:17:54.393422] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T21:17:55.180289] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-28T21:17:55.703320] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T21:17:55.906915] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T21:17:55.980229] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-28T21:17:56.780246] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-28T21:17:56.972017] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:17:57.580316] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-28T21:17:58.071375] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T21:17:58.380307] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-28T21:17:59.079661] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T21:17:59.091225] [INFO ] [REMOTE ] SRE: Full fetch complete (77482 records). [2025-10-28T21:17:59.091465] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-28T21:17:59.187261] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-28T21:17:59.527065] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-28T21:17:59.533960] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-28T21:17:59.546185] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-28T21:17:59.547107] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-28T21:17:59.548364] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:17:59.555670] [INFO ] [REMOTE ] SR: Full fetch complete (46116 records). [2025-10-28T21:17:59.556205] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-28T21:17:59.556628] [DEBUG] [LOCAL ] SRE: Trimmed 77482 records to 53389 (keeping 200 days of data) [2025-10-28T21:17:59.984104] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-28T21:18:00.236086] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-28T21:18:00.238672] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-28T21:18:00.241789] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-28T21:18:00.253153] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-28T21:18:00.337468] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T21:18:00.297793] [DEBUG] [LOCAL ] SR: Trimmed 46116 records to 31980 (keeping 200 days of data) [2025-10-28T21:18:00.500228] [DEBUG] [LOCAL ] SRE: Primary data saved (53389 records). [2025-10-28T21:18:00.505720] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-28T21:18:00.507750] [INFO ] [MAIN ] Update Progress: 1984/2366 symbols completed. SRE took 36.1s. Estimated remaining: 49m 40s. Rate: 7.7 symbols/min [2025-10-28T21:18:00.706992] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:00.780332] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-28T21:18:00.792247] [DEBUG] [LOCAL ] SRG: Loaded 14441 existing records from primary storage. [2025-10-28T21:18:00.796581] [DEBUG] [LOCAL ] SR: Primary data saved (31980 records). [2025-10-28T21:18:00.796883] [INFO ] [MAIN ] SR: Full history saved. [2025-10-28T21:18:00.797259] [INFO ] [MAIN ] SRG: Loaded 14441 existing records. [2025-10-28T21:18:00.825102] [INFO ] [MAIN ] Update Progress: 1985/2366 symbols completed. SR took 37.5s. Estimated remaining: 49m 31s. Rate: 7.7 symbols/min [2025-10-28T21:18:00.881312] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T21:18:01.177663] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:01.213976] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:18:01.214504] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-28T21:18:01.214625] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-28T21:18:01.215097] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-28T21:18:01.215340] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-28T21:18:01.408313] [DEBUG] [LOCAL ] SRI: Loaded 25815 existing records from primary storage. [2025-10-28T21:18:01.434418] [INFO ] [MAIN ] SRI: Loaded 25815 existing records. [2025-10-28T21:18:01.587887] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-28T21:18:01.791895] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:18:01.846635] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:01.847811] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-28T21:18:01.849055] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T21:18:01.849212] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-28T21:18:01.855492] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-28T21:18:01.855590] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-28T21:18:02.248114] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:02.380268] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-28T21:18:02.541118] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T21:18:03.180388] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-28T21:18:03.980291] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-28T21:18:04.183233] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T21:18:04.780225] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-28T21:18:04.848286] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:18:05.151990] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-28T21:18:05.580292] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-28T21:18:05.923566] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:18:06.380302] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-28T21:18:07.187391] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-28T21:18:07.191183] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T21:18:07.738268] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T21:18:07.749880] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-28T21:18:07.980344] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-28T21:18:08.780280] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-28T21:18:09.580227] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-28T21:18:09.658187] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T21:18:09.696597] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T21:18:10.162863] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T21:18:10.380234] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-28T21:18:11.180272] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-28T21:18:11.443802] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T21:18:11.825309] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T21:18:11.980258] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-28T21:18:12.780255] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-28T21:18:13.360457] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T21:18:13.580245] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-28T21:18:13.613411] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T21:18:14.321351] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T21:18:14.323458] [INFO ] [REMOTE ] SREA: Full fetch complete (14507 records). [2025-10-28T21:18:14.323548] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-28T21:18:14.389086] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-28T21:18:14.696395] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-28T21:18:14.696470] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-28T21:18:14.696813] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-28T21:18:14.696873] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-28T21:18:14.697331] [DEBUG] [LOCAL ] SREA: Trimmed 14507 records to 9491 (keeping 200 days of data) [2025-10-28T21:18:14.752536] [DEBUG] [LOCAL ] SREA: Primary data saved (9491 records). [2025-10-28T21:18:14.752671] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-28T21:18:14.752769] [INFO ] [MAIN ] Update Progress: 1986/2366 symbols completed. SREA took 31.6s. Estimated remaining: 49m 24s. Rate: 7.7 symbols/min [2025-10-28T21:18:14.919261] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:14.919439] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-28T21:18:14.919478] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-28T21:18:14.919590] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-28T21:18:14.919632] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-28T21:18:14.919720] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-28T21:18:14.919762] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-28T21:18:15.190347] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-28T21:18:15.273495] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:15.384604] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T21:18:15.980237] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-28T21:18:16.294827] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T21:18:16.780297] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-28T21:18:17.196913] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T21:18:17.580308] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-28T21:18:17.820591] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T21:18:17.834563] [INFO ] [REMOTE ] SRFM: Full fetch complete (51928 records). [2025-10-28T21:18:17.834746] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-28T21:18:17.994281] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T21:18:18.207815] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-28T21:18:18.207889] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-28T21:18:18.208830] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-28T21:18:18.208890] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-28T21:18:18.209931] [DEBUG] [LOCAL ] SRFM: Trimmed 51928 records to 40945 (keeping 200 days of data) [2025-10-28T21:18:18.399072] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-28T21:18:18.440221] [DEBUG] [LOCAL ] SRFM: Primary data saved (40945 records). [2025-10-28T21:18:18.440345] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-28T21:18:18.440420] [INFO ] [MAIN ] Update Progress: 1987/2366 symbols completed. SRFM took 32.1s. Estimated remaining: 49m 16s. Rate: 7.7 symbols/min [2025-10-28T21:18:18.625235] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:18.635761] [DEBUG] [LOCAL ] SRV: Loaded 7153 existing records from primary storage. [2025-10-28T21:18:18.636061] [INFO ] [MAIN ] SRV: Loaded 7153 existing records. [2025-10-28T21:18:18.857378] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-28T21:18:18.856611] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:18:18.858773] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-28T21:18:18.858827] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-28T21:18:18.858973] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-28T21:18:18.859012] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-28T21:18:19.185315] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-28T21:18:19.208507] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:19.980289] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-28T21:18:20.219169] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T21:18:20.698181] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T21:18:20.780254] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-28T21:18:21.332690] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T21:18:21.580255] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-28T21:18:22.306820] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T21:18:22.380249] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-28T21:18:23.025547] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T21:18:23.180248] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-28T21:18:23.980265] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-28T21:18:24.110880] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T21:18:24.454475] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T21:18:24.780308] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-28T21:18:25.580258] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-28T21:18:26.056356] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T21:18:26.220710] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T21:18:26.380259] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-28T21:18:27.022532] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T21:18:27.180253] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-28T21:18:27.980240] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-28T21:18:28.058710] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T21:18:28.613820] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T21:18:28.780248] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-28T21:18:29.155252] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T21:18:29.580300] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-28T21:18:29.948638] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T21:18:30.380271] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-28T21:18:31.110109] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T21:18:31.180262] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-28T21:18:31.553429] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T21:18:31.980316] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-28T21:18:32.657495] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T21:18:32.780246] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-28T21:18:33.520875] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T21:18:33.580337] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-28T21:18:34.248112] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:18:34.253283] [INFO ] [REMOTE ] SRG: Full fetch complete (23198 records). [2025-10-28T21:18:34.253732] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-28T21:18:34.385602] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-28T21:18:34.631850] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-28T21:18:34.631931] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-28T21:18:34.632565] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-28T21:18:34.632606] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-28T21:18:34.633181] [DEBUG] [LOCAL ] SRG: Trimmed 23198 records to 14344 (keeping 200 days of data) [2025-10-28T21:18:34.709678] [DEBUG] [LOCAL ] SRG: Primary data saved (14344 records). [2025-10-28T21:18:34.709812] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-28T21:18:34.709892] [INFO ] [MAIN ] Update Progress: 1988/2366 symbols completed. SRG took 34.2s. Estimated remaining: 49m 9s. Rate: 7.7 symbols/min [2025-10-28T21:18:34.876210] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:34.876352] [DEBUG] [LOCAL ] SSB: No existing data file found in primary storage. [2025-10-28T21:18:34.876395] [WARN ] [MAIN ] SSB: No existing data found, performing full refresh instead. [2025-10-28T21:18:34.876510] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-28T21:18:34.876551] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-28T21:18:34.876590] [DEBUG] [LOCAL ] SSB: No primary data file found to delete. [2025-10-28T21:18:34.876621] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-28T21:18:34.947088] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T21:18:35.185501] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-28T21:18:35.235272] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:35.597157] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T21:18:35.980295] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-28T21:18:36.780297] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-28T21:18:36.839455] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:18:37.368541] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T21:18:37.580271] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-28T21:18:38.166538] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T21:18:38.380283] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-28T21:18:39.180300] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-28T21:18:39.660423] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T21:18:39.695481] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T21:18:39.980252] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-28T21:18:40.565895] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T21:18:40.568816] [INFO ] [REMOTE ] SRV: Full fetch complete (11211 records). [2025-10-28T21:18:40.568948] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-28T21:18:40.788433] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-28T21:18:40.940708] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-28T21:18:40.940785] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-28T21:18:40.941052] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-28T21:18:40.941090] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-28T21:18:40.941500] [DEBUG] [LOCAL ] SRV: Trimmed 11211 records to 7158 (keeping 200 days of data) [2025-10-28T21:18:40.982991] [DEBUG] [LOCAL ] SRV: Primary data saved (7158 records). [2025-10-28T21:18:40.983087] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-28T21:18:40.983173] [INFO ] [MAIN ] Update Progress: 1989/2366 symbols completed. SRV took 22.5s. Estimated remaining: 49m 1s. Rate: 7.7 symbols/min [2025-10-28T21:18:41.151763] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:41.152113] [DEBUG] [LOCAL ] SSD: No existing data file found in primary storage. [2025-10-28T21:18:41.152168] [WARN ] [MAIN ] SSD: No existing data found, performing full refresh instead. [2025-10-28T21:18:41.152298] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-28T21:18:41.152341] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-28T21:18:41.152382] [DEBUG] [LOCAL ] SSD: No primary data file found to delete. [2025-10-28T21:18:41.152413] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-28T21:18:41.493146] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:41.580275] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-28T21:18:41.709894] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T21:18:41.714150] [INFO ] [REMOTE ] SRI: Full fetch complete (39365 records). [2025-10-28T21:18:41.714267] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-28T21:18:42.117216] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-28T21:18:42.117342] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-28T21:18:42.118248] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-28T21:18:42.118312] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-28T21:18:42.119281] [DEBUG] [LOCAL ] SRI: Trimmed 39365 records to 25711 (keeping 200 days of data) [2025-10-28T21:18:42.260753] [DEBUG] [LOCAL ] SRI: Primary data saved (25711 records). [2025-10-28T21:18:42.260884] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-28T21:18:42.260962] [INFO ] [MAIN ] Update Progress: 1990/2366 symbols completed. SRI took 41.4s. Estimated remaining: 48m 52s. Rate: 7.7 symbols/min [2025-10-28T21:18:42.385341] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-28T21:18:42.439310] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:42.476521] [DEBUG] [LOCAL ] SSL: Loaded 41245 existing records from primary storage. [2025-10-28T21:18:42.476823] [INFO ] [MAIN ] SSL: Loaded 41245 existing records. [2025-10-28T21:18:42.659071] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:18:42.659352] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-28T21:18:42.659423] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-28T21:18:42.659963] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-28T21:18:42.660020] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-28T21:18:42.809398] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T21:18:43.084220] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:43.180215] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-28T21:18:43.564961] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:18:43.980313] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-28T21:18:44.339728] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T21:18:44.534354] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T21:18:44.780239] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-28T21:18:45.320838] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T21:18:45.321700] [INFO ] [REMOTE ] SRL: Full fetch complete (1642 records). [2025-10-28T21:18:45.321766] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-28T21:18:45.518302] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T21:18:45.518507] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:18:45.518576] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:18:45.518666] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-28T21:18:45.518743] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-28T21:18:45.518780] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-28T21:18:45.518819] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-28T21:18:45.518892] [INFO ] [MAIN ] Update Progress: 1991/2366 symbols completed. SRL took 30.8s. Estimated remaining: 48m 44s. Rate: 7.7 symbols/min [2025-10-28T21:18:45.585411] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-28T21:18:45.687905] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:18:45.700168] [DEBUG] [LOCAL ] SST: Loaded 11226 existing records from primary storage. [2025-10-28T21:18:45.700388] [INFO ] [MAIN ] SST: Loaded 11226 existing records. [2025-10-28T21:18:45.877135] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:18:45.877397] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-28T21:18:45.877448] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-28T21:18:45.877702] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-28T21:18:45.877760] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-28T21:18:46.228062] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:18:46.380218] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-28T21:18:47.031617] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T21:18:47.180239] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-28T21:18:47.289908] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T21:18:47.980301] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-28T21:18:48.412917] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T21:18:48.780297] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-28T21:18:49.023527] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T21:18:49.580243] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-28T21:18:49.679751] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T21:18:50.380260] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-28T21:18:50.773173] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T21:18:51.019483] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T21:18:51.180285] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-28T21:18:51.980291] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-28T21:18:52.569576] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T21:18:52.780270] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-28T21:18:53.297997] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T21:18:53.493145] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T21:18:53.580303] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-28T21:18:54.380323] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-28T21:18:54.571049] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:18:55.180262] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-28T21:18:55.676825] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:18:55.839563] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T21:18:55.980311] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-28T21:18:56.691075] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T21:18:56.780260] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-28T21:18:57.580302] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-28T21:18:57.674197] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T21:18:58.380300] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-28T21:18:58.989066] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T21:18:59.043433] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T21:18:59.180268] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-28T21:18:59.980303] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-28T21:19:00.590739] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T21:19:00.780238] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-28T21:19:01.148511] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T21:19:01.580309] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-28T21:19:02.014494] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T21:19:02.380269] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-28T21:19:02.980583] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T21:19:03.180234] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-28T21:19:03.226409] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T21:19:03.980327] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-28T21:19:04.379919] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T21:19:04.780303] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-28T21:19:05.301180] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T21:19:05.580239] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-28T21:19:06.107703] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T21:19:06.380289] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-28T21:19:06.483231] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T21:19:06.958221] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T21:19:07.180258] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-28T21:19:07.727047] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:19:07.980255] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-28T21:19:08.780249] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-28T21:19:09.141250] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:19:09.329579] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T21:19:09.331180] [INFO ] [REMOTE ] SST: Full fetch complete (17588 records). [2025-10-28T21:19:09.331256] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-28T21:19:09.585450] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-28T21:19:09.700871] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-28T21:19:09.700948] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-28T21:19:09.701343] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-28T21:19:09.701382] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-28T21:19:09.701931] [DEBUG] [LOCAL ] SST: Trimmed 17588 records to 11196 (keeping 200 days of data) [2025-10-28T21:19:09.765301] [DEBUG] [LOCAL ] SST: Primary data saved (11196 records). [2025-10-28T21:19:09.765443] [INFO ] [MAIN ] SST: Full history saved. [2025-10-28T21:19:09.765523] [INFO ] [MAIN ] Update Progress: 1992/2366 symbols completed. SST took 24.2s. Estimated remaining: 48m 39s. Rate: 7.7 symbols/min [2025-10-28T21:19:09.934500] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:09.934681] [DEBUG] [LOCAL ] SSTK: No existing data file found in primary storage. [2025-10-28T21:19:09.934733] [WARN ] [MAIN ] SSTK: No existing data found, performing full refresh instead. [2025-10-28T21:19:09.934841] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-28T21:19:09.934882] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-28T21:19:09.934922] [DEBUG] [LOCAL ] SSTK: No primary data file found to delete. [2025-10-28T21:19:09.934954] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-28T21:19:10.286284] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:10.380253] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-28T21:19:10.949740] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T21:19:10.958251] [INFO ] [REMOTE ] SSB: Full fetch complete (61571 records). [2025-10-28T21:19:10.958352] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-28T21:19:11.187890] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-28T21:19:11.339704] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-28T21:19:11.339853] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-28T21:19:11.341006] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-28T21:19:11.341069] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-28T21:19:11.342297] [DEBUG] [LOCAL ] SSB: Trimmed 61571 records to 42723 (keeping 200 days of data) [2025-10-28T21:19:11.606495] [DEBUG] [LOCAL ] SSB: Primary data saved (42723 records). [2025-10-28T21:19:11.606665] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-28T21:19:11.606844] [INFO ] [MAIN ] Update Progress: 1993/2366 symbols completed. SSB took 36.9s. Estimated remaining: 48m 30s. Rate: 7.7 symbols/min [2025-10-28T21:19:11.737915] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T21:19:11.800780] [INFO ] [REMOTE ] SSL: Full fetch complete (60006 records). [2025-10-28T21:19:11.809015] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-28T21:19:11.826566] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:11.826807] [DEBUG] [LOCAL ] ST: No existing data file found in primary storage. [2025-10-28T21:19:11.826915] [WARN ] [MAIN ] ST: No existing data found, performing full refresh instead. [2025-10-28T21:19:11.827036] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-28T21:19:11.827082] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-28T21:19:11.827126] [DEBUG] [LOCAL ] ST: No primary data file found to delete. [2025-10-28T21:19:11.858477] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-28T21:19:11.980803] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-28T21:19:12.602679] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:12.617876] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-28T21:19:12.618023] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-28T21:19:12.619252] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-28T21:19:12.619328] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-28T21:19:12.620826] [DEBUG] [LOCAL ] SSL: Trimmed 60006 records to 41158 (keeping 200 days of data) [2025-10-28T21:19:12.790839] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-28T21:19:12.857505] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T21:19:12.892044] [DEBUG] [LOCAL ] SSL: Primary data saved (41158 records). [2025-10-28T21:19:12.892191] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-28T21:19:12.892572] [INFO ] [MAIN ] Update Progress: 1994/2366 symbols completed. SSL took 30.6s. Estimated remaining: 48m 21s. Rate: 7.7 symbols/min [2025-10-28T21:19:13.066415] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:13.066635] [DEBUG] [LOCAL ] STAG: No existing data file found in primary storage. [2025-10-28T21:19:13.066829] [WARN ] [MAIN ] STAG: No existing data found, performing full refresh instead. [2025-10-28T21:19:13.067061] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-28T21:19:13.067117] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-28T21:19:13.067194] [DEBUG] [LOCAL ] STAG: No primary data file found to delete. [2025-10-28T21:19:13.067347] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-28T21:19:13.227011] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T21:19:13.449261] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:13.580238] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-28T21:19:14.124974] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T21:19:14.380287] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-28T21:19:15.049103] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T21:19:15.180239] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-28T21:19:15.322577] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T21:19:15.980273] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-28T21:19:16.603798] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T21:19:16.780219] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-28T21:19:17.063252] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:19:17.580252] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-28T21:19:18.224388] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:19:18.380264] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-28T21:19:18.834396] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T21:19:19.180287] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-28T21:19:19.869364] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T21:19:19.980245] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-28T21:19:20.257178] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T21:19:20.780319] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-28T21:19:21.070950] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T21:19:21.580249] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-28T21:19:22.142808] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T21:19:22.380271] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-28T21:19:22.494900] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T21:19:23.180275] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-28T21:19:23.373059] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T21:19:23.377968] [INFO ] [REMOTE ] SSD: Full fetch complete (32551 records). [2025-10-28T21:19:23.378120] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-28T21:19:23.757479] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-28T21:19:23.757603] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-28T21:19:23.758979] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-28T21:19:23.759050] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-28T21:19:23.760744] [DEBUG] [LOCAL ] SSD: Trimmed 32551 records to 22119 (keeping 200 days of data) [2025-10-28T21:19:23.910162] [DEBUG] [LOCAL ] SSD: Primary data saved (22119 records). [2025-10-28T21:19:23.910336] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-28T21:19:23.910428] [INFO ] [MAIN ] Update Progress: 1995/2366 symbols completed. SSD took 42.9s. Estimated remaining: 48m 14s. Rate: 7.7 symbols/min [2025-10-28T21:19:23.985424] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-28T21:19:24.083562] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:24.083834] [DEBUG] [LOCAL ] STC: No existing data file found in primary storage. [2025-10-28T21:19:24.083878] [WARN ] [MAIN ] STC: No existing data found, performing full refresh instead. [2025-10-28T21:19:24.084001] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-28T21:19:24.084043] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-28T21:19:24.084085] [DEBUG] [LOCAL ] STC: No primary data file found to delete. [2025-10-28T21:19:24.084117] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-28T21:19:24.452220] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:24.514349] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T21:19:24.780317] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-28T21:19:25.580289] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-28T21:19:25.614897] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T21:19:25.641162] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T21:19:26.380250] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-28T21:19:26.944250] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T21:19:27.180283] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-28T21:19:27.355545] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T21:19:27.980274] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-28T21:19:28.426533] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T21:19:28.784802] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-28T21:19:28.786504] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T21:19:29.580272] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-28T21:19:30.281596] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T21:19:30.380254] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-28T21:19:30.477566] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T21:19:31.180237] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-28T21:19:31.235127] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T21:19:31.980250] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-28T21:19:32.520748] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:19:32.780246] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-28T21:19:33.161775] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T21:19:33.580266] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-28T21:19:34.237193] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T21:19:34.380318] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-28T21:19:34.414818] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T21:19:35.180287] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-28T21:19:35.980216] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-28T21:19:36.078225] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T21:19:36.326308] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T21:19:36.336449] [INFO ] [REMOTE ] STAG: Full fetch complete (72589 records). [2025-10-28T21:19:36.336561] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-28T21:19:36.722329] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-28T21:19:36.722425] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-28T21:19:36.723592] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-28T21:19:36.723677] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-28T21:19:36.725049] [DEBUG] [LOCAL ] STAG: Trimmed 72589 records to 49968 (keeping 200 days of data) [2025-10-28T21:19:36.785578] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-28T21:19:37.025216] [DEBUG] [LOCAL ] STAG: Primary data saved (49968 records). [2025-10-28T21:19:37.025347] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-28T21:19:37.025417] [INFO ] [MAIN ] Update Progress: 1996/2366 symbols completed. STAG took 24.1s. Estimated remaining: 48m 7s. Rate: 7.7 symbols/min [2025-10-28T21:19:37.196083] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:37.196523] [DEBUG] [LOCAL ] STE: No existing data file found in primary storage. [2025-10-28T21:19:37.196597] [WARN ] [MAIN ] STE: No existing data found, performing full refresh instead. [2025-10-28T21:19:37.196806] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-28T21:19:37.196947] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-28T21:19:37.197065] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-28T21:19:37.197136] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-28T21:19:37.584186] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-28T21:19:37.587692] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T21:19:37.591898] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:37.675723] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T21:19:38.380271] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-28T21:19:38.631741] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T21:19:39.180264] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-28T21:19:39.622440] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:19:39.980273] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-28T21:19:40.007214] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T21:19:40.780262] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-28T21:19:41.269689] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T21:19:41.580353] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-28T21:19:41.592861] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T21:19:42.380238] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-28T21:19:42.481687] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T21:19:43.180284] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-28T21:19:43.749419] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T21:19:43.983369] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-28T21:19:43.986223] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T21:19:43.991072] [INFO ] [REMOTE ] STC: Full fetch complete (25516 records). [2025-10-28T21:19:43.991169] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-28T21:19:44.364796] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-28T21:19:44.364870] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-28T21:19:44.365388] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-28T21:19:44.365426] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-28T21:19:44.366059] [DEBUG] [LOCAL ] STC: Trimmed 25516 records to 17291 (keeping 200 days of data) [2025-10-28T21:19:44.469905] [DEBUG] [LOCAL ] STC: Primary data saved (17291 records). [2025-10-28T21:19:44.470029] [INFO ] [MAIN ] STC: Full history saved. [2025-10-28T21:19:44.470112] [INFO ] [MAIN ] Update Progress: 1997/2366 symbols completed. STC took 20.6s. Estimated remaining: 47m 59s. Rate: 7.7 symbols/min [2025-10-28T21:19:44.780284] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-28T21:19:45.282567] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T21:19:45.580307] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-28T21:19:45.876290] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T21:19:45.882095] [INFO ] [REMOTE ] SSTK: Full fetch complete (40978 records). [2025-10-28T21:19:45.882233] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-28T21:19:46.266082] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-28T21:19:46.266162] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-28T21:19:46.267113] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-28T21:19:46.267182] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-28T21:19:46.268114] [DEBUG] [LOCAL ] SSTK: Trimmed 40978 records to 24677 (keeping 200 days of data) [2025-10-28T21:19:46.385049] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-28T21:19:46.434202] [DEBUG] [LOCAL ] SSTK: Primary data saved (24677 records). [2025-10-28T21:19:46.434942] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-28T21:19:46.435061] [INFO ] [MAIN ] Update Progress: 1998/2366 symbols completed. SSTK took 36.7s. Estimated remaining: 47m 50s. Rate: 7.7 symbols/min [2025-10-28T21:19:46.843320] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:19:47.180329] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-28T21:19:47.560142] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:19:47.980281] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-28T21:19:48.510991] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T21:19:48.520935] [INFO ] [REMOTE ] ST: Full fetch complete (72200 records). [2025-10-28T21:19:48.521098] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-28T21:19:48.970725] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-28T21:19:48.970824] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-28T21:19:48.972135] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-28T21:19:48.972207] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-28T21:19:48.973680] [DEBUG] [LOCAL ] ST: Trimmed 72200 records to 49565 (keeping 200 days of data) [2025-10-28T21:19:49.280394] [DEBUG] [LOCAL ] ST: Primary data saved (49565 records). [2025-10-28T21:19:49.280562] [INFO ] [MAIN ] ST: Full history saved. [2025-10-28T21:19:49.280755] [INFO ] [MAIN ] Update Progress: 1999/2366 symbols completed. ST took 37.7s. Estimated remaining: 47m 42s. Rate: 7.7 symbols/min [2025-10-28T21:19:49.301041] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T21:19:49.308549] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-28T21:19:50.555261] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T21:19:50.562943] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-28T21:19:51.750096] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T21:19:51.758186] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-28T21:19:52.903669] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T21:19:52.910794] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-28T21:19:54.061345] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T21:19:54.069855] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-28T21:19:55.209154] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T21:19:55.216415] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-28T21:19:55.574709] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T21:19:55.582419] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-28T21:19:56.653715] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T21:19:56.660813] [INFO ] [REMOTE ] STE: Full fetch complete (50801 records). [2025-10-28T21:19:56.660920] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-28T21:19:57.078377] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-28T21:19:57.078477] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-28T21:19:57.079662] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-28T21:19:57.079729] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-28T21:19:57.080956] [DEBUG] [LOCAL ] STE: Trimmed 50801 records to 34715 (keeping 200 days of data) [2025-10-28T21:19:57.292220] [DEBUG] [LOCAL ] STE: Primary data saved (34715 records). [2025-10-28T21:19:57.292347] [INFO ] [MAIN ] STE: Full history saved. [2025-10-28T21:19:57.292412] [INFO ] [MAIN ] Update Progress: 2000/2366 symbols completed. STE took 20.3s. Estimated remaining: 47m 34s. Rate: 7.7 symbols/min [2025-10-28T21:19:57.970726] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:57.971616] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:58.021758] [DEBUG] [LOCAL ] STEL: No existing data file found in primary storage. [2025-10-28T21:19:58.021551] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-28T21:19:58.021843] [WARN ] [MAIN ] STEL: No existing data found, performing full refresh instead. [2025-10-28T21:19:58.022028] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-28T21:19:58.064862] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-28T21:19:58.044090] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:58.064731] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:19:58.059802] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-28T21:19:58.066385] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-28T21:19:58.066443] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-28T21:19:58.066569] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-28T21:19:58.066680] [DEBUG] [LOCAL ] STEL: No primary data file found to delete. [2025-10-28T21:19:58.066737] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-28T21:19:58.066837] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-28T21:19:58.253824] [DEBUG] [LOCAL ] STEW: Loaded 14632 existing records from primary storage. [2025-10-28T21:19:58.288876] [INFO ] [MAIN ] STEW: Loaded 14632 existing records. [2025-10-28T21:19:58.663792] [DEBUG] [LOCAL ] STEM: Loaded 38072 existing records from primary storage. [2025-10-28T21:19:58.730944] [INFO ] [MAIN ] STEM: Loaded 38072 existing records. [2025-10-28T21:19:59.003110] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:19:59.053491] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-28T21:19:59.129977] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:59.131142] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-28T21:19:59.171862] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-28T21:19:59.176566] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:59.195445] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-28T21:19:59.190272] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-28T21:19:59.232263] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-28T21:19:59.239119] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:19:59.296011] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-28T21:19:59.316858] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-28T21:19:59.348995] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-28T21:19:59.359414] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-28T21:19:59.773966] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T21:19:59.785226] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-28T21:19:59.907271] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:19:59.926065] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-28T21:20:00.068165] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:00.068691] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-28T21:20:00.081032] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T21:20:00.085415] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-28T21:20:00.214699] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T21:20:00.215919] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-28T21:20:00.622922] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T21:20:00.624351] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-28T21:20:00.679022] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T21:20:00.780251] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-28T21:20:01.040997] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T21:20:01.068121] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T21:20:01.437849] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T21:20:01.580297] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-28T21:20:01.979351] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-28T21:20:02.380251] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-28T21:20:02.445130] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T21:20:03.180291] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-28T21:20:03.695241] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:20:03.970953] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T21:20:03.980429] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-28T21:20:04.330436] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T21:20:04.780297] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-28T21:20:05.580240] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-28T21:20:05.727396] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T21:20:06.380294] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-28T21:20:07.119851] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:20:07.180212] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-28T21:20:07.330746] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T21:20:07.980311] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-28T21:20:08.780328] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-28T21:20:08.924126] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T21:20:09.009731] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-28T21:20:09.453417] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T21:20:09.580253] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-28T21:20:10.348383] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T21:20:10.380220] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-28T21:20:11.180334] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-28T21:20:11.301492] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T21:20:11.609367] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T21:20:11.980271] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-28T21:20:12.531153] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:20:12.780306] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-28T21:20:13.185496] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T21:20:13.186320] [INFO ] [REMOTE ] STG: Full fetch complete (2495 records). [2025-10-28T21:20:13.186385] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-28T21:20:13.364406] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-28T21:20:13.364589] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:20:13.364685] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:20:13.364741] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-28T21:20:13.364798] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-28T21:20:13.364835] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-28T21:20:13.364895] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-28T21:20:13.364952] [INFO ] [MAIN ] Update Progress: 2001/2366 symbols completed. STG took 16.1s. Estimated remaining: 47m 27s. Rate: 7.7 symbols/min [2025-10-28T21:20:13.532324] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:20:13.542890] [DEBUG] [LOCAL ] STK: Loaded 9509 existing records from primary storage. [2025-10-28T21:20:13.543097] [INFO ] [MAIN ] STK: Loaded 9509 existing records. [2025-10-28T21:20:13.585501] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-28T21:20:13.720405] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:20:13.720556] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-28T21:20:13.720601] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-28T21:20:13.720894] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-28T21:20:13.720950] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-28T21:20:14.080017] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:14.322072] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T21:20:14.380241] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-28T21:20:15.010169] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T21:20:15.180242] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-28T21:20:15.980305] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-28T21:20:16.762546] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T21:20:16.780209] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-28T21:20:17.051902] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:20:17.458500] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T21:20:17.580255] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-28T21:20:18.249456] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:20:18.252497] [INFO ] [REMOTE ] STEW: Full fetch complete (21757 records). [2025-10-28T21:20:18.252577] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-28T21:20:18.385445] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-28T21:20:18.633248] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-28T21:20:18.633325] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-28T21:20:18.633852] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-28T21:20:18.633915] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-28T21:20:18.634482] [DEBUG] [LOCAL ] STEW: Trimmed 21757 records to 14525 (keeping 200 days of data) [2025-10-28T21:20:18.721609] [DEBUG] [LOCAL ] STEW: Primary data saved (14525 records). [2025-10-28T21:20:18.721781] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-28T21:20:18.721904] [INFO ] [MAIN ] Update Progress: 2002/2366 symbols completed. STEW took 21.4s. Estimated remaining: 47m 19s. Rate: 7.7 symbols/min [2025-10-28T21:20:18.893214] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:20:18.941571] [DEBUG] [LOCAL ] STLA: Loaded 53547 existing records from primary storage. [2025-10-28T21:20:18.941924] [INFO ] [MAIN ] STLA: Loaded 53547 existing records. [2025-10-28T21:20:19.121594] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:20:19.121786] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-28T21:20:19.121858] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-28T21:20:19.122685] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-28T21:20:19.122752] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-28T21:20:19.189060] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-28T21:20:19.497206] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:19.513237] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T21:20:19.980281] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-28T21:20:20.601390] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T21:20:20.780228] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-28T21:20:20.941012] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T21:20:21.530201] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T21:20:21.580208] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-28T21:20:22.380229] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-28T21:20:22.445035] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T21:20:23.180305] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-28T21:20:23.980278] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-28T21:20:24.166373] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T21:20:24.501000] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:20:24.739102] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T21:20:24.780207] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-28T21:20:25.389026] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T21:20:25.580235] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-28T21:20:26.380236] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-28T21:20:27.180331] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-28T21:20:27.273961] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-28T21:20:27.300288] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T21:20:27.980305] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-28T21:20:28.297876] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T21:20:28.780220] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-28T21:20:28.881877] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:20:29.408829] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T21:20:29.580287] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-28T21:20:30.255374] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T21:20:30.380272] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-28T21:20:31.180304] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-28T21:20:31.980295] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-28T21:20:32.070580] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T21:20:32.599254] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T21:20:32.733751] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-28T21:20:32.780211] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-28T21:20:33.580338] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-28T21:20:34.380332] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-28T21:20:34.685532] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T21:20:34.754838] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T21:20:35.180273] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-28T21:20:35.196918] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T21:20:35.201182] [INFO ] [REMOTE ] STEL: Full fetch complete (32313 records). [2025-10-28T21:20:35.201275] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-28T21:20:35.571951] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-28T21:20:35.572024] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-28T21:20:35.572698] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-28T21:20:35.572758] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-28T21:20:35.573445] [DEBUG] [LOCAL ] STEL: Trimmed 32313 records to 21774 (keeping 200 days of data) [2025-10-28T21:20:35.700028] [DEBUG] [LOCAL ] STEL: Primary data saved (21774 records). [2025-10-28T21:20:35.700149] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-28T21:20:35.700218] [INFO ] [MAIN ] Update Progress: 2003/2366 symbols completed. STEL took 38.4s. Estimated remaining: 47m 13s. Rate: 7.7 symbols/min [2025-10-28T21:20:35.865316] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:20:35.913838] [DEBUG] [LOCAL ] STM: Loaded 53572 existing records from primary storage. [2025-10-28T21:20:35.914160] [INFO ] [MAIN ] STM: Loaded 53572 existing records. [2025-10-28T21:20:35.987522] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-28T21:20:36.092975] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:20:36.093159] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-28T21:20:36.093212] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-28T21:20:36.094010] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-28T21:20:36.094070] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-28T21:20:36.444736] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:36.465591] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T21:20:36.473171] [INFO ] [REMOTE ] STEM: Full fetch complete (60155 records). [2025-10-28T21:20:36.473269] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-28T21:20:36.786354] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-28T21:20:36.830357] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T21:20:36.881331] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-28T21:20:36.881434] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-28T21:20:36.882794] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-28T21:20:36.882858] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-28T21:20:36.884220] [DEBUG] [LOCAL ] STEM: Trimmed 60155 records to 38006 (keeping 200 days of data) [2025-10-28T21:20:37.099922] [DEBUG] [LOCAL ] STEM: Primary data saved (38006 records). [2025-10-28T21:20:37.100068] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-28T21:20:37.100146] [INFO ] [MAIN ] Update Progress: 2004/2366 symbols completed. STEM took 39.8s. Estimated remaining: 47m 4s. Rate: 7.7 symbols/min [2025-10-28T21:20:37.269053] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:20:37.291320] [DEBUG] [LOCAL ] STN: Loaded 22127 existing records from primary storage. [2025-10-28T21:20:37.291557] [INFO ] [MAIN ] STN: Loaded 22127 existing records. [2025-10-28T21:20:37.470261] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:20:37.470475] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-28T21:20:37.470520] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-28T21:20:37.470947] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-28T21:20:37.471003] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-28T21:20:37.585402] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-28T21:20:37.818977] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:38.380240] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-28T21:20:38.515453] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T21:20:38.518588] [INFO ] [REMOTE ] STK: Full fetch complete (14408 records). [2025-10-28T21:20:38.518694] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-28T21:20:38.912623] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-28T21:20:38.912905] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-28T21:20:38.913289] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-28T21:20:38.913365] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-28T21:20:38.914319] [DEBUG] [LOCAL ] STK: Trimmed 14408 records to 9462 (keeping 200 days of data) [2025-10-28T21:20:39.016629] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-28T21:20:39.022379] [DEBUG] [LOCAL ] STK: Primary data saved (9462 records). [2025-10-28T21:20:39.034172] [INFO ] [MAIN ] STK: Full history saved. [2025-10-28T21:20:39.034488] [INFO ] [MAIN ] Update Progress: 2005/2366 symbols completed. STK took 25.7s. Estimated remaining: 46m 55s. Rate: 7.7 symbols/min [2025-10-28T21:20:39.183212] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-28T21:20:39.208876] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:20:39.247005] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:20:39.265860] [DEBUG] [LOCAL ] STNG: Loaded 42971 existing records from primary storage. [2025-10-28T21:20:39.269511] [INFO ] [MAIN ] STNG: Loaded 42971 existing records. [2025-10-28T21:20:39.446317] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:20:39.446562] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-28T21:20:39.446621] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-28T21:20:39.447216] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-28T21:20:39.447274] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-28T21:20:39.788118] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:39.980264] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-28T21:20:40.780243] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-28T21:20:40.905393] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T21:20:41.492957] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T21:20:41.547751] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T21:20:41.580224] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-28T21:20:42.380271] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-28T21:20:42.987807] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T21:20:43.180330] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-28T21:20:43.270344] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T21:20:43.980336] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-28T21:20:44.780285] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-28T21:20:44.836979] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T21:20:44.903255] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T21:20:45.580337] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-28T21:20:45.989067] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:20:46.380252] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-28T21:20:46.587840] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T21:20:47.180276] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-28T21:20:47.927583] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T21:20:47.980347] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-28T21:20:48.166505] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T21:20:48.780268] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-28T21:20:48.837283] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T21:20:49.580338] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-28T21:20:50.380268] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-28T21:20:50.509949] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T21:20:51.176885] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T21:20:51.182460] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-28T21:20:51.276252] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T21:20:51.980293] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-28T21:20:52.497890] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T21:20:52.780278] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-28T21:20:53.451223] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T21:20:53.580277] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-28T21:20:54.191516] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T21:20:54.380321] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-28T21:20:54.500765] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T21:20:55.180330] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-28T21:20:55.931075] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:20:55.980280] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-28T21:20:56.089909] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T21:20:56.716424] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T21:20:56.780275] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-28T21:20:57.580304] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-28T21:20:58.242906] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T21:20:58.364071] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T21:20:58.368293] [INFO ] [REMOTE ] STN: Full fetch complete (32581 records). [2025-10-28T21:20:58.368441] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-28T21:20:58.388876] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-28T21:20:58.746754] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-28T21:20:58.746841] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-28T21:20:58.747569] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-28T21:20:58.747609] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-28T21:20:58.748373] [DEBUG] [LOCAL ] STN: Trimmed 32581 records to 22015 (keeping 200 days of data) [2025-10-28T21:20:58.880557] [DEBUG] [LOCAL ] STN: Primary data saved (22015 records). [2025-10-28T21:20:58.880719] [INFO ] [MAIN ] STN: Full history saved. [2025-10-28T21:20:58.880844] [INFO ] [MAIN ] Update Progress: 2006/2366 symbols completed. STN took 21.8s. Estimated remaining: 46m 50s. Rate: 7.7 symbols/min [2025-10-28T21:20:59.055820] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:20:59.067265] [DEBUG] [LOCAL ] STRV: Loaded 10323 existing records from primary storage. [2025-10-28T21:20:59.067484] [INFO ] [MAIN ] STRV: Loaded 10323 existing records. [2025-10-28T21:20:59.185551] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-28T21:20:59.250703] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:20:59.250904] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-28T21:20:59.250950] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-28T21:20:59.251211] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-28T21:20:59.251267] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-28T21:20:59.595371] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:20:59.980255] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-28T21:21:00.780308] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-28T21:21:00.969596] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-28T21:21:00.970827] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T21:21:01.047236] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T21:21:01.580314] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-28T21:21:02.000616] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T21:21:02.380260] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-28T21:21:03.189278] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-28T21:21:03.213325] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T21:21:03.225021] [INFO ] [REMOTE ] STM: Full fetch complete (77696 records). [2025-10-28T21:21:03.225189] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-28T21:21:03.647706] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-28T21:21:03.647821] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-28T21:21:03.649455] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-28T21:21:03.649524] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-28T21:21:03.651535] [DEBUG] [LOCAL ] STM: Trimmed 77696 records to 53571 (keeping 200 days of data) [2025-10-28T21:21:03.976866] [DEBUG] [LOCAL ] STM: Primary data saved (53571 records). [2025-10-28T21:21:03.977026] [INFO ] [MAIN ] STM: Full history saved. [2025-10-28T21:21:03.977681] [INFO ] [MAIN ] Update Progress: 2007/2366 symbols completed. STM took 28.3s. Estimated remaining: 46m 41s. Rate: 7.7 symbols/min [2025-10-28T21:21:03.989138] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-28T21:21:04.149187] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:04.149344] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-10-28T21:21:04.149381] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-10-28T21:21:04.149487] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-28T21:21:04.149528] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-28T21:21:04.149567] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-28T21:21:04.149598] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-28T21:21:04.472393] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T21:21:04.568589] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:04.605446] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T21:21:04.627188] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T21:21:04.780243] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-28T21:21:05.457305] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T21:21:05.580231] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-28T21:21:06.380303] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-28T21:21:07.180251] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-28T21:21:07.980267] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-28T21:21:08.213017] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-28T21:21:08.486828] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T21:21:08.780252] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-28T21:21:08.810211] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T21:21:09.580257] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-28T21:21:09.692857] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (4.11 seconds). [2025-10-28T21:21:09.974409] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T21:21:10.157825] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T21:21:10.380267] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-28T21:21:11.000557] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T21:21:11.180282] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-28T21:21:11.980248] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-28T21:21:12.530777] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T21:21:12.780254] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-28T21:21:13.580249] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-28T21:21:13.776327] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T21:21:13.787625] [INFO ] [REMOTE ] STLA: Full fetch complete (77660 records). [2025-10-28T21:21:13.787927] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-28T21:21:13.911073] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T21:21:13.945349] [INFO ] [REMOTE ] STNG: Full fetch complete (63769 records). [2025-10-28T21:21:13.966142] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-28T21:21:14.355301] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T21:21:14.383689] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-28T21:21:14.592510] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-28T21:21:14.592965] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-28T21:21:14.594422] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-28T21:21:14.610223] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-28T21:21:14.690883] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-28T21:21:14.690970] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-28T21:21:14.691550] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-28T21:21:14.691864] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-28T21:21:14.691759] [DEBUG] [LOCAL ] STLA: Trimmed 77660 records to 53547 (keeping 200 days of data) [2025-10-28T21:21:14.693780] [DEBUG] [LOCAL ] STNG: Trimmed 63769 records to 42894 (keeping 200 days of data) [2025-10-28T21:21:15.182593] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-28T21:21:15.226965] [DEBUG] [LOCAL ] STNG: Primary data saved (42894 records). [2025-10-28T21:21:15.234343] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-28T21:21:15.234957] [INFO ] [MAIN ] Update Progress: 2008/2366 symbols completed. STNG took 36.2s. Estimated remaining: 46m 34s. Rate: 7.7 symbols/min [2025-10-28T21:21:15.404252] [DEBUG] [LOCAL ] STLA: Primary data saved (53547 records). [2025-10-28T21:21:15.419907] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-28T21:21:15.441319] [INFO ] [MAIN ] Update Progress: 2009/2366 symbols completed. STLA took 56.7s. Estimated remaining: 46m 25s. Rate: 7.7 symbols/min [2025-10-28T21:21:15.517604] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:15.534170] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-28T21:21:15.543440] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-28T21:21:15.579163] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-28T21:21:15.581780] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-28T21:21:15.582149] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-28T21:21:15.587620] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-28T21:21:15.761482] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:15.979023] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T21:21:16.015586] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-28T21:21:16.027197] [DEBUG] [LOCAL ] STVN: Loaded 26459 existing records from primary storage. [2025-10-28T21:21:16.057897] [INFO ] [MAIN ] STVN: Loaded 26459 existing records. [2025-10-28T21:21:16.162424] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:16.293217] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:21:16.293469] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-28T21:21:16.293548] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-28T21:21:16.294737] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-28T21:21:16.294802] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-28T21:21:16.627452] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-28T21:21:16.727195] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:16.728292] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T21:21:16.780234] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-28T21:21:17.580243] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-28T21:21:17.721212] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T21:21:18.118405] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T21:21:18.120752] [INFO ] [REMOTE ] STRV: Full fetch complete (17036 records). [2025-10-28T21:21:18.120922] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-28T21:21:18.385359] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-10-28T21:21:18.491844] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-28T21:21:18.491920] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-28T21:21:18.492326] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-28T21:21:18.492368] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-28T21:21:18.492916] [DEBUG] [LOCAL ] STRV: Trimmed 17036 records to 10231 (keeping 200 days of data) [2025-10-28T21:21:18.555785] [DEBUG] [LOCAL ] STRV: Primary data saved (10231 records). [2025-10-28T21:21:18.555912] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-28T21:21:18.556022] [INFO ] [MAIN ] Update Progress: 2010/2366 symbols completed. STRV took 19.7s. Estimated remaining: 46m 16s. Rate: 7.7 symbols/min [2025-10-28T21:21:18.599697] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:21:18.637204] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-10-28T21:21:18.659400] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:21:18.659523] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-28T21:21:18.659572] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:21:18.659957] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-28T21:21:18.675608] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-28T21:21:18.686059] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-28T21:21:18.730031] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:18.710144] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-28T21:21:18.730204] [DEBUG] [LOCAL ] STWD: No existing data file found in primary storage. [2025-10-28T21:21:18.730293] [INFO ] [MAIN ] Update Progress: 2011/2366 symbols completed. STUB took 3.5s. Estimated remaining: 46m 7s. Rate: 7.7 symbols/min [2025-10-28T21:21:18.730333] [WARN ] [MAIN ] STWD: No existing data found, performing full refresh instead. [2025-10-28T21:21:18.749289] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-28T21:21:18.809088] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-28T21:21:18.820443] [DEBUG] [LOCAL ] STWD: No primary data file found to delete. [2025-10-28T21:21:18.820496] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-28T21:21:19.039958] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:19.175631] [DEBUG] [LOCAL ] STXD: Loaded 1302 existing records from primary storage. [2025-10-28T21:21:19.192046] [INFO ] [MAIN ] STXD: Loaded 1302 existing records. [2025-10-28T21:21:19.180932] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-28T21:21:19.442694] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:19.462875] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:21:19.463047] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-28T21:21:19.463094] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-28T21:21:19.463281] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-28T21:21:19.463338] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-28T21:21:19.813869] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:19.980298] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-28T21:21:20.012822] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T21:21:20.431233] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T21:21:20.780228] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-28T21:21:21.580289] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-28T21:21:22.294707] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T21:21:22.380251] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-28T21:21:22.856561] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T21:21:23.180228] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-28T21:21:23.459549] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T21:21:23.616209] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:21:23.980273] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-28T21:21:24.263009] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T21:21:24.780262] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-28T21:21:25.580269] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-28T21:21:26.210662] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:21:26.380254] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-28T21:21:26.656059] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:21:27.180270] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-28T21:21:27.709384] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T21:21:27.980287] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-28T21:21:28.686943] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-28T21:21:28.780221] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-28T21:21:29.436265] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T21:21:29.580266] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-28T21:21:30.252024] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T21:21:30.364431] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T21:21:30.380214] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-28T21:21:31.180290] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-28T21:21:31.279959] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T21:21:31.428050] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T21:21:31.980265] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-28T21:21:32.780281] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-28T21:21:33.117179] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T21:21:33.541557] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T21:21:33.552039] [INFO ] [REMOTE ] STT: Full fetch complete (74558 records). [2025-10-28T21:21:33.552193] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-28T21:21:33.585408] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-28T21:21:33.979546] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-28T21:21:33.979638] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-28T21:21:33.980845] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-28T21:21:33.980907] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-28T21:21:33.982396] [DEBUG] [LOCAL ] STT: Trimmed 74558 records to 51107 (keeping 200 days of data) [2025-10-28T21:21:34.293137] [DEBUG] [LOCAL ] STT: Primary data saved (51107 records). [2025-10-28T21:21:34.293266] [INFO ] [MAIN ] STT: Full history saved. [2025-10-28T21:21:34.293353] [INFO ] [MAIN ] Update Progress: 2012/2366 symbols completed. STT took 30.3s. Estimated remaining: 46m 1s. Rate: 7.7 symbols/min [2025-10-28T21:21:34.385553] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-28T21:21:34.492135] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:34.498415] [DEBUG] [LOCAL ] STXE: Loaded 2018 existing records from primary storage. [2025-10-28T21:21:34.498738] [INFO ] [MAIN ] STXE: Loaded 2018 existing records. [2025-10-28T21:21:34.709858] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T21:21:34.739954] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:21:34.737825] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:21:34.746471] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-28T21:21:34.747031] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-28T21:21:34.747221] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-28T21:21:34.747266] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-28T21:21:35.128561] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:35.180220] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-28T21:21:35.763105] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T21:21:35.980260] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-28T21:21:36.344045] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T21:21:36.780321] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-28T21:21:37.141319] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T21:21:37.580263] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-28T21:21:38.380243] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-28T21:21:38.674951] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T21:21:39.180236] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-28T21:21:39.298750] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T21:21:39.936708] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T21:21:39.980253] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-28T21:21:40.780230] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-28T21:21:40.862542] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T21:21:41.065966] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T21:21:41.580387] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-28T21:21:42.380242] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-28T21:21:42.465481] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T21:21:43.180266] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-28T21:21:43.461076] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-28T21:21:43.741287] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:21:43.980251] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-28T21:21:44.298821] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T21:21:44.780261] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-28T21:21:45.143972] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T21:21:45.580249] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-28T21:21:45.822290] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T21:21:46.380294] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-28T21:21:46.756100] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T21:21:46.757110] [INFO ] [REMOTE ] STXD: Full fetch complete (2152 records). [2025-10-28T21:21:46.757176] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-28T21:21:47.101364] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-28T21:21:47.101435] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-28T21:21:47.101521] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-28T21:21:47.101557] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-28T21:21:47.101890] [DEBUG] [LOCAL ] STXD: Trimmed 2152 records to 1277 (keeping 200 days of data) [2025-10-28T21:21:47.109683] [DEBUG] [LOCAL ] STXD: Primary data saved (1277 records). [2025-10-28T21:21:47.109742] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-28T21:21:47.109805] [INFO ] [MAIN ] Update Progress: 2013/2366 symbols completed. STXD took 28.4s. Estimated remaining: 45m 54s. Rate: 7.7 symbols/min [2025-10-28T21:21:47.185405] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-28T21:21:47.276381] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:47.280579] [DEBUG] [LOCAL ] STXG: Loaded 2194 existing records from primary storage. [2025-10-28T21:21:47.280743] [INFO ] [MAIN ] STXG: Loaded 2194 existing records. [2025-10-28T21:21:47.464544] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:21:47.464810] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-28T21:21:47.464862] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-28T21:21:47.465043] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-28T21:21:47.465102] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-28T21:21:47.828053] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:47.980213] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-28T21:21:48.125857] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T21:21:48.359313] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T21:21:48.780258] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-28T21:21:49.580321] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-28T21:21:50.004093] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T21:21:50.053037] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T21:21:50.380236] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-28T21:21:51.180291] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-28T21:21:51.427717] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-28T21:21:51.596279] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T21:21:51.980267] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-28T21:21:52.347141] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T21:21:52.780318] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-28T21:21:53.521833] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T21:21:53.527442] [INFO ] [REMOTE ] STVN: Full fetch complete (38955 records). [2025-10-28T21:21:53.527529] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-28T21:21:53.586911] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-28T21:21:53.919886] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-28T21:21:53.919961] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-28T21:21:53.920787] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-28T21:21:53.920847] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-28T21:21:53.921710] [DEBUG] [LOCAL ] STVN: Trimmed 38955 records to 26335 (keeping 200 days of data) [2025-10-28T21:21:54.096893] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T21:21:54.110623] [DEBUG] [LOCAL ] STVN: Primary data saved (26335 records). [2025-10-28T21:21:54.110813] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-28T21:21:54.110925] [INFO ] [MAIN ] Update Progress: 2014/2366 symbols completed. STVN took 38.6s. Estimated remaining: 45m 46s. Rate: 7.7 symbols/min [2025-10-28T21:21:54.308309] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:54.312057] [DEBUG] [LOCAL ] STXK: Loaded 1440 existing records from primary storage. [2025-10-28T21:21:54.312206] [INFO ] [MAIN ] STXK: Loaded 1440 existing records. [2025-10-28T21:21:54.385316] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-28T21:21:54.498944] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:21:54.499138] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-28T21:21:54.499191] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-28T21:21:54.499344] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-28T21:21:54.499393] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-28T21:21:54.872176] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:54.876036] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T21:21:55.180261] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-28T21:21:55.980252] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-28T21:21:56.042436] [DEBUG] [REMOTE ] STXK: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-28T21:21:56.042680] [WARN ] [REMOTE ] STXK: No data returned for month 2025-01 [2025-10-28T21:21:56.042762] [FATAL] [REMOTE ] STXK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:21:56.042833] [FATAL] [MAIN ] STXK: Failed to fetch primary data. [2025-10-28T21:21:56.042898] [WARN ] [MAIN ] STXK: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:21:56.042977] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-28T21:21:56.043039] [DEBUG] [LOCAL ] STXK: No primary data file found to delete. [2025-10-28T21:21:56.043075] [INFO ] [LOCAL ] STXK: Starting deletion of derivative data. [2025-10-28T21:21:56.043221] [DEBUG] [LOCAL ] STXK: Deleted derivative data file. [2025-10-28T21:21:56.043307] [INFO ] [MAIN ] Update Progress: 2015/2366 symbols completed. STXK took 1.9s. Estimated remaining: 45m 37s. Rate: 7.7 symbols/min [2025-10-28T21:21:56.209800] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:21:56.209987] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-28T21:21:56.210026] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-28T21:21:56.210136] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-28T21:21:56.210176] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-28T21:21:56.210215] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-28T21:21:56.210245] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-28T21:21:56.566472] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:21:56.622910] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T21:21:56.780215] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-28T21:21:57.019760] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-28T21:21:57.580292] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-28T21:21:58.380280] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-28T21:21:58.683104] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T21:21:59.129809] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T21:21:59.180281] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-28T21:21:59.482946] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-28T21:21:59.980255] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-28T21:22:00.780286] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-28T21:22:01.142078] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T21:22:01.580258] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-28T21:22:01.637184] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T21:22:01.648590] [INFO ] [REMOTE ] STWD: Full fetch complete (75354 records). [2025-10-28T21:22:01.648849] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-28T21:22:01.944330] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T21:22:01.983687] [INFO ] [REMOTE ] STXE: Full fetch complete (3459 records). [2025-10-28T21:22:02.015588] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-28T21:22:02.268726] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-28T21:22:02.285404] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-28T21:22:02.316023] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-28T21:22:02.384873] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-28T21:22:02.384807] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-28T21:22:02.430496] [DEBUG] [LOCAL ] STWD: Trimmed 75354 records to 51924 (keeping 200 days of data) [2025-10-28T21:22:02.632222] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-28T21:22:02.639008] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-28T21:22:02.645735] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-28T21:22:02.649476] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-28T21:22:02.657830] [DEBUG] [LOCAL ] STXE: Trimmed 3459 records to 2010 (keeping 200 days of data) [2025-10-28T21:22:02.728692] [DEBUG] [LOCAL ] STXE: Primary data saved (2010 records). [2025-10-28T21:22:02.762952] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-28T21:22:02.766484] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T21:22:02.768415] [INFO ] [MAIN ] Update Progress: 2016/2366 symbols completed. STXE took 28.5s. Estimated remaining: 45m 29s. Rate: 7.7 symbols/min [2025-10-28T21:22:02.947317] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:02.959787] [DEBUG] [LOCAL ] STXT: Loaded 2504 existing records from primary storage. [2025-10-28T21:22:02.962062] [INFO ] [MAIN ] STXT: Loaded 2504 existing records. [2025-10-28T21:22:03.195988] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-28T21:22:03.166694] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:03.202747] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-28T21:22:03.203061] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-28T21:22:03.219145] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-28T21:22:03.219718] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-28T21:22:03.338488] [DEBUG] [LOCAL ] STWD: Primary data saved (51924 records). [2025-10-28T21:22:03.352636] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-28T21:22:03.363717] [INFO ] [MAIN ] Update Progress: 2017/2366 symbols completed. STWD took 44.8s. Estimated remaining: 45m 20s. Rate: 7.7 symbols/min [2025-10-28T21:22:03.741364] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:03.799868] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T21:22:03.823081] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:03.828512] [DEBUG] [LOCAL ] STXV: Loaded 1426 existing records from primary storage. [2025-10-28T21:22:03.828803] [INFO ] [MAIN ] STXV: Loaded 1426 existing records. [2025-10-28T21:22:03.983147] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-28T21:22:04.008274] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:04.008559] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-28T21:22:04.008609] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-28T21:22:04.008797] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-28T21:22:04.008854] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-28T21:22:04.359687] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:04.530600] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T21:22:04.780274] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-28T21:22:05.100667] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T21:22:05.580263] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-28T21:22:05.920103] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T21:22:06.380251] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-28T21:22:06.668203] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T21:22:07.180264] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-28T21:22:07.406970] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T21:22:07.980251] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-28T21:22:08.279765] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T21:22:08.780277] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-28T21:22:09.059001] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T21:22:09.580254] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-28T21:22:09.890098] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T21:22:09.891154] [INFO ] [REMOTE ] STXG: Full fetch complete (4001 records). [2025-10-28T21:22:09.891227] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-28T21:22:10.259520] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-28T21:22:10.259593] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-28T21:22:10.259743] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-28T21:22:10.259804] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-28T21:22:10.260165] [DEBUG] [LOCAL ] STXG: Trimmed 4001 records to 2178 (keeping 200 days of data) [2025-10-28T21:22:10.273117] [DEBUG] [LOCAL ] STXG: Primary data saved (2178 records). [2025-10-28T21:22:10.273184] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-28T21:22:10.273269] [INFO ] [MAIN ] Update Progress: 2018/2366 symbols completed. STXG took 23.2s. Estimated remaining: 45m 12s. Rate: 7.7 symbols/min [2025-10-28T21:22:10.385419] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-28T21:22:10.442456] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:10.493772] [DEBUG] [LOCAL ] STZ: Loaded 52389 existing records from primary storage. [2025-10-28T21:22:10.494098] [INFO ] [MAIN ] STZ: Loaded 52389 existing records. [2025-10-28T21:22:10.671433] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:10.671667] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-28T21:22:10.671728] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-28T21:22:10.672297] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-28T21:22:10.672355] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-28T21:22:10.797773] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T21:22:11.031218] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:11.180237] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-28T21:22:11.980245] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-28T21:22:12.286950] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T21:22:12.776729] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-28T21:22:12.786347] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-28T21:22:13.177050] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T21:22:13.580239] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-28T21:22:14.004075] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T21:22:14.380246] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-28T21:22:14.601461] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-28T21:22:15.180256] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-28T21:22:15.980301] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-28T21:22:16.343060] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T21:22:16.771595] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T21:22:16.782376] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-28T21:22:17.062747] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T21:22:17.580252] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-28T21:22:17.875374] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T21:22:18.380270] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-28T21:22:19.180304] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-28T21:22:19.459486] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T21:22:19.947493] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T21:22:19.980246] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-28T21:22:20.250256] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T21:22:20.780266] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-28T21:22:21.040381] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-28T21:22:21.580296] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-28T21:22:21.825544] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T21:22:22.380307] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-28T21:22:22.658903] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T21:22:23.180273] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-28T21:22:23.420468] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T21:22:23.980282] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-28T21:22:24.780238] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-28T21:22:25.005092] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-28T21:22:25.005875] [INFO ] [REMOTE ] STXM: Full fetch complete (1371 records). [2025-10-28T21:22:25.005966] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-28T21:22:25.185452] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T21:22:25.185625] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:22:25.185706] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:22:25.185754] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-28T21:22:25.185809] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-28T21:22:25.185844] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-28T21:22:25.185884] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-28T21:22:25.185938] [INFO ] [MAIN ] Update Progress: 2019/2366 symbols completed. STXM took 29.1s. Estimated remaining: 45m 6s. Rate: 7.7 symbols/min [2025-10-28T21:22:25.354964] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:25.402762] [DEBUG] [LOCAL ] SU: Loaded 53426 existing records from primary storage. [2025-10-28T21:22:25.403077] [INFO ] [MAIN ] SU: Loaded 53426 existing records. [2025-10-28T21:22:25.585032] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:25.582140] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-28T21:22:25.585865] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-28T21:22:25.585989] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-28T21:22:25.599751] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-28T21:22:25.619858] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-28T21:22:25.700013] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T21:22:25.923892] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T21:22:26.008988] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:26.380253] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-28T21:22:27.180330] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-28T21:22:27.463628] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T21:22:27.810330] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:22:27.980257] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-28T21:22:28.780245] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-28T21:22:29.077623] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T21:22:29.369031] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T21:22:29.580241] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-28T21:22:29.861136] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T21:22:30.380319] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-28T21:22:31.180250] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-28T21:22:31.530542] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T21:22:31.955278] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T21:22:31.980222] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-28T21:22:32.780302] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-28T21:22:33.161747] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T21:22:33.162888] [INFO ] [REMOTE ] STXT: Full fetch complete (3872 records). [2025-10-28T21:22:33.162958] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-28T21:22:33.539679] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-28T21:22:33.539827] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-28T21:22:33.540003] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-28T21:22:33.540079] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-28T21:22:33.540749] [DEBUG] [LOCAL ] STXT: Trimmed 3872 records to 2505 (keeping 200 days of data) [2025-10-28T21:22:33.557755] [DEBUG] [LOCAL ] STXT: Primary data saved (2505 records). [2025-10-28T21:22:33.557864] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-28T21:22:33.558011] [INFO ] [MAIN ] Update Progress: 2020/2366 symbols completed. STXT took 30.8s. Estimated remaining: 44m 58s. Rate: 7.7 symbols/min [2025-10-28T21:22:33.587748] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-28T21:22:33.777437] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-28T21:22:33.782150] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:33.832003] [DEBUG] [LOCAL ] SUI: Loaded 41573 existing records from primary storage. [2025-10-28T21:22:33.832314] [INFO ] [MAIN ] SUI: Loaded 41573 existing records. [2025-10-28T21:22:34.006010] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:34.006255] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-28T21:22:34.006302] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-28T21:22:34.006734] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-28T21:22:34.006791] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-28T21:22:34.355403] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:34.380239] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-28T21:22:35.180257] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-28T21:22:35.555266] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:22:35.980238] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-28T21:22:36.021181] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-28T21:22:36.737968] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T21:22:36.780218] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-28T21:22:37.318011] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T21:22:37.580244] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-28T21:22:38.238236] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T21:22:38.380267] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-28T21:22:38.605276] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-28T21:22:38.606166] [INFO ] [REMOTE ] STXV: Full fetch complete (2489 records). [2025-10-28T21:22:38.606235] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-28T21:22:38.991481] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-28T21:22:38.991592] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-28T21:22:38.991774] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-28T21:22:38.991850] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-28T21:22:38.992401] [DEBUG] [LOCAL ] STXV: Trimmed 2489 records to 1421 (keeping 200 days of data) [2025-10-28T21:22:39.003383] [DEBUG] [LOCAL ] STXV: Primary data saved (1421 records). [2025-10-28T21:22:39.003635] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-28T21:22:39.003856] [INFO ] [MAIN ] Update Progress: 2021/2366 symbols completed. STXV took 35.6s. Estimated remaining: 44m 50s. Rate: 7.7 symbols/min [2025-10-28T21:22:39.194325] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-28T21:22:39.217838] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:39.221768] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T21:22:39.268024] [DEBUG] [LOCAL ] SUN: Loaded 38670 existing records from primary storage. [2025-10-28T21:22:39.268307] [INFO ] [MAIN ] SUN: Loaded 38670 existing records. [2025-10-28T21:22:39.455906] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:39.456191] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-28T21:22:39.456425] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-28T21:22:39.456805] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-28T21:22:39.456863] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-28T21:22:39.817061] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:39.980285] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-28T21:22:40.433505] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T21:22:40.780271] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-28T21:22:41.008754] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T21:22:41.580327] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-28T21:22:42.110818] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T21:22:42.380260] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-28T21:22:42.862305] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T21:22:43.180317] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-28T21:22:43.513819] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T21:22:43.980254] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-28T21:22:44.780264] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-28T21:22:44.812714] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T21:22:45.084471] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:22:45.580255] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-28T21:22:46.059811] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T21:22:46.380243] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-28T21:22:46.568274] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:22:47.180246] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-28T21:22:47.980305] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-28T21:22:48.166539] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T21:22:48.177779] [INFO ] [REMOTE ] STZ: Full fetch complete (76193 records). [2025-10-28T21:22:48.177934] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-28T21:22:48.591889] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-28T21:22:48.592113] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-28T21:22:48.593367] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-28T21:22:48.593579] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-28T21:22:48.605912] [DEBUG] [LOCAL ] STZ: Trimmed 76193 records to 52384 (keeping 200 days of data) [2025-10-28T21:22:48.628456] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T21:22:48.820669] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-28T21:22:48.976543] [DEBUG] [LOCAL ] STZ: Primary data saved (52384 records). [2025-10-28T21:22:48.976770] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-28T21:22:48.976920] [INFO ] [MAIN ] Update Progress: 2022/2366 symbols completed. STZ took 38.7s. Estimated remaining: 44m 42s. Rate: 7.7 symbols/min [2025-10-28T21:22:49.149737] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T21:22:49.168542] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:49.218637] [DEBUG] [LOCAL ] SUPV: Loaded 48100 existing records from primary storage. [2025-10-28T21:22:49.218995] [INFO ] [MAIN ] SUPV: Loaded 48100 existing records. [2025-10-28T21:22:49.396256] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:49.396460] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-28T21:22:49.396509] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-28T21:22:49.396823] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-28T21:22:49.396882] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-28T21:22:49.585448] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-28T21:22:49.762862] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:50.332114] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T21:22:50.380275] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-28T21:22:50.815086] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T21:22:51.180270] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-28T21:22:51.734179] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T21:22:51.980255] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-28T21:22:52.335507] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T21:22:52.780305] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-28T21:22:53.193074] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:22:53.580323] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-28T21:22:54.174743] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T21:22:54.380275] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-28T21:22:54.588939] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T21:22:55.180305] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-28T21:22:55.726833] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T21:22:55.980305] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-28T21:22:56.463525] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T21:22:56.471632] [INFO ] [REMOTE ] SUI: Full fetch complete (60481 records). [2025-10-28T21:22:56.471803] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-28T21:22:56.785435] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-28T21:22:56.867885] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-28T21:22:56.867977] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-28T21:22:56.869196] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-28T21:22:56.869265] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-28T21:22:56.870538] [DEBUG] [LOCAL ] SUI: Trimmed 60481 records to 41481 (keeping 200 days of data) [2025-10-28T21:22:57.127583] [DEBUG] [LOCAL ] SUI: Primary data saved (41481 records). [2025-10-28T21:22:57.127724] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-28T21:22:57.127806] [INFO ] [MAIN ] Update Progress: 2023/2366 symbols completed. SUI took 23.6s. Estimated remaining: 44m 35s. Rate: 7.7 symbols/min [2025-10-28T21:22:57.300957] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:57.344752] [DEBUG] [LOCAL ] SUZ: Loaded 45267 existing records from primary storage. [2025-10-28T21:22:57.345088] [INFO ] [MAIN ] SUZ: Loaded 45267 existing records. [2025-10-28T21:22:57.498180] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T21:22:57.564381] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:57.564563] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-28T21:22:57.564609] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-28T21:22:57.565105] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-28T21:22:57.565163] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-28T21:22:57.585335] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-28T21:22:57.914056] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:58.230392] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:22:58.241313] [INFO ] [REMOTE ] SU: Full fetch complete (77560 records). [2025-10-28T21:22:58.241451] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-28T21:22:58.385350] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-28T21:22:58.656965] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-28T21:22:58.657114] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-28T21:22:58.658278] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-28T21:22:58.658340] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-28T21:22:58.659794] [DEBUG] [LOCAL ] SU: Trimmed 77560 records to 53420 (keeping 200 days of data) [2025-10-28T21:22:58.786821] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T21:22:59.046680] [DEBUG] [LOCAL ] SU: Primary data saved (53420 records). [2025-10-28T21:22:59.046824] [INFO ] [MAIN ] SU: Full history saved. [2025-10-28T21:22:59.046905] [INFO ] [MAIN ] Update Progress: 2024/2366 symbols completed. SU took 33.9s. Estimated remaining: 44m 26s. Rate: 7.7 symbols/min [2025-10-28T21:22:59.185386] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-28T21:22:59.251688] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:22:59.291276] [DEBUG] [LOCAL ] SVV: Loaded 40123 existing records from primary storage. [2025-10-28T21:22:59.291557] [INFO ] [MAIN ] SVV: Loaded 40123 existing records. [2025-10-28T21:22:59.499853] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:22:59.500300] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-28T21:22:59.500458] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-28T21:22:59.500992] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-28T21:22:59.501074] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-28T21:22:59.642698] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T21:22:59.943746] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:22:59.980218] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-28T21:23:00.243877] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T21:23:00.780229] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-28T21:23:00.983470] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T21:23:01.580317] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-28T21:23:02.380304] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-28T21:23:03.180308] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-28T21:23:06.024191] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (4.44 seconds). [2025-10-28T21:23:06.031372] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-28T21:23:06.150591] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (3.77 seconds). [2025-10-28T21:23:06.159138] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-28T21:23:06.244198] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (5.46 seconds). [2025-10-28T21:23:06.253592] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-28T21:23:06.409818] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (3.23 seconds). [2025-10-28T21:23:06.419516] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-28T21:23:07.212064] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T21:23:07.220515] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-28T21:23:07.314958] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T21:23:07.325567] [INFO ] [REMOTE ] SUN: Full fetch complete (55766 records). [2025-10-28T21:23:07.326050] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-28T21:23:07.716393] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-28T21:23:07.716509] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-28T21:23:07.717582] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-28T21:23:07.717687] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-28T21:23:07.719348] [DEBUG] [LOCAL ] SUN: Trimmed 55766 records to 38673 (keeping 200 days of data) [2025-10-28T21:23:07.864415] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T21:23:07.984227] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-28T21:23:08.016572] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T21:23:08.034711] [DEBUG] [LOCAL ] SUN: Primary data saved (38673 records). [2025-10-28T21:23:08.035597] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-28T21:23:08.035723] [INFO ] [MAIN ] Update Progress: 2025/2366 symbols completed. SUN took 29.0s. Estimated remaining: 44m 18s. Rate: 7.7 symbols/min [2025-10-28T21:23:08.201558] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:08.250160] [DEBUG] [LOCAL ] SW: Loaded 53172 existing records from primary storage. [2025-10-28T21:23:08.250469] [INFO ] [MAIN ] SW: Loaded 53172 existing records. [2025-10-28T21:23:08.431581] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:08.432074] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-28T21:23:08.432145] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-28T21:23:08.432772] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-28T21:23:08.432851] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-28T21:23:08.570692] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:23:08.785462] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-28T21:23:08.840511] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:09.357501] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T21:23:09.580236] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-28T21:23:10.342840] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T21:23:10.380213] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-28T21:23:10.828493] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T21:23:11.180238] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-28T21:23:11.926089] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T21:23:11.980257] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-28T21:23:12.351000] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T21:23:12.780269] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-28T21:23:13.147548] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T21:23:13.580250] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-28T21:23:13.958351] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T21:23:14.380295] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-28T21:23:14.903270] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T21:23:15.180304] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-28T21:23:15.774039] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T21:23:15.980316] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-28T21:23:16.570345] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T21:23:16.780267] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-28T21:23:17.392208] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T21:23:17.580239] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-28T21:23:17.717932] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T21:23:18.380262] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-28T21:23:19.062748] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T21:23:19.180233] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-28T21:23:19.805006] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:23:19.980242] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-28T21:23:20.418118] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:23:20.780313] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-28T21:23:21.128161] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T21:23:21.580294] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-28T21:23:22.300152] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T21:23:22.380444] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-28T21:23:23.089414] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T21:23:23.180306] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-28T21:23:23.455246] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:23:23.980234] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-28T21:23:24.458140] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T21:23:24.780303] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-28T21:23:25.327723] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T21:23:25.580245] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-28T21:23:25.727913] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T21:23:26.222700] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T21:23:26.380254] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-28T21:23:27.180265] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-28T21:23:27.864205] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T21:23:27.874892] [INFO ] [REMOTE ] SUPV: Full fetch complete (69069 records). [2025-10-28T21:23:27.875039] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-28T21:23:27.985349] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-28T21:23:28.306244] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-28T21:23:28.306829] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-28T21:23:28.308702] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T21:23:28.307998] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-28T21:23:28.315899] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-28T21:23:28.317631] [DEBUG] [LOCAL ] SUPV: Trimmed 69069 records to 48124 (keeping 200 days of data) [2025-10-28T21:23:28.590587] [DEBUG] [LOCAL ] SUPV: Primary data saved (48124 records). [2025-10-28T21:23:28.590746] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-28T21:23:28.591304] [INFO ] [MAIN ] Update Progress: 2026/2366 symbols completed. SUPV took 39.6s. Estimated remaining: 44m 12s. Rate: 7.7 symbols/min [2025-10-28T21:23:28.755204] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:28.783376] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-28T21:23:28.803730] [DEBUG] [LOCAL ] SWK: Loaded 52318 existing records from primary storage. [2025-10-28T21:23:28.804027] [INFO ] [MAIN ] SWK: Loaded 52318 existing records. [2025-10-28T21:23:28.985028] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:28.985278] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-28T21:23:28.985325] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-28T21:23:28.985942] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-28T21:23:28.986023] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-28T21:23:29.361354] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:29.551956] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T21:23:29.563000] [INFO ] [REMOTE ] SW: Full fetch complete (77133 records). [2025-10-28T21:23:29.563158] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-28T21:23:29.585382] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-28T21:23:29.963408] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-28T21:23:29.963515] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-28T21:23:29.964880] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-28T21:23:29.964945] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-28T21:23:29.966559] [DEBUG] [LOCAL ] SW: Trimmed 77133 records to 53172 (keeping 200 days of data) [2025-10-28T21:23:30.202022] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T21:23:30.216454] [INFO ] [REMOTE ] SUZ: Full fetch complete (66614 records). [2025-10-28T21:23:30.220617] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-28T21:23:30.399702] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-28T21:23:30.593272] [DEBUG] [LOCAL ] SW: Primary data saved (53172 records). [2025-10-28T21:23:30.609061] [INFO ] [MAIN ] SW: Full history saved. [2025-10-28T21:23:30.620091] [INFO ] [MAIN ] Update Progress: 2027/2366 symbols completed. SW took 22.6s. Estimated remaining: 44m 4s. Rate: 7.7 symbols/min [2025-10-28T21:23:30.820447] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-28T21:23:30.821066] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-28T21:23:30.833208] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-28T21:23:30.838494] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-28T21:23:30.907336] [DEBUG] [LOCAL ] SUZ: Trimmed 66614 records to 45209 (keeping 200 days of data) [2025-10-28T21:23:30.907179] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:31.014539] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T21:23:31.179059] [DEBUG] [LOCAL ] SWX: Loaded 30113 existing records from primary storage. [2025-10-28T21:23:31.189102] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-28T21:23:31.204515] [INFO ] [MAIN ] SWX: Loaded 30113 existing records. [2025-10-28T21:23:31.293437] [DEBUG] [LOCAL ] SUZ: Primary data saved (45209 records). [2025-10-28T21:23:31.304459] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-28T21:23:31.323595] [INFO ] [MAIN ] Update Progress: 2028/2366 symbols completed. SUZ took 34.2s. Estimated remaining: 43m 55s. Rate: 7.7 symbols/min [2025-10-28T21:23:31.530041] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:31.530609] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-28T21:23:31.536145] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-28T21:23:31.557491] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-28T21:23:31.578095] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-28T21:23:31.618739] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:31.732910] [DEBUG] [LOCAL ] SWZ: Loaded 5900 existing records from primary storage. [2025-10-28T21:23:31.769549] [INFO ] [MAIN ] SWZ: Loaded 5900 existing records. [2025-10-28T21:23:32.141497] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:32.147303] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-28T21:23:32.157805] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-28T21:23:32.191046] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-28T21:23:32.215350] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-28T21:23:32.219926] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:32.240313] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-28T21:23:32.352083] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T21:23:32.651453] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:32.678259] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T21:23:32.780307] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-28T21:23:33.159912] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T21:23:33.580280] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-28T21:23:34.194169] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T21:23:34.294711] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T21:23:34.380223] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-28T21:23:35.180296] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-28T21:23:35.366471] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:23:35.980237] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-28T21:23:36.293746] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T21:23:36.302621] [INFO ] [REMOTE ] SVV: Full fetch complete (57500 records). [2025-10-28T21:23:36.302767] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-28T21:23:36.700398] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-28T21:23:36.700488] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-28T21:23:36.701607] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-28T21:23:36.701693] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-28T21:23:36.702877] [DEBUG] [LOCAL ] SVV: Trimmed 57500 records to 40038 (keeping 200 days of data) [2025-10-28T21:23:36.788562] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-28T21:23:36.949772] [DEBUG] [LOCAL ] SVV: Primary data saved (40038 records). [2025-10-28T21:23:36.965584] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-28T21:23:36.965792] [INFO ] [MAIN ] Update Progress: 2029/2366 symbols completed. SVV took 37.9s. Estimated remaining: 43m 47s. Rate: 7.7 symbols/min [2025-10-28T21:23:36.966954] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T21:23:37.139129] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:37.175010] [DEBUG] [LOCAL ] SXC: Loaded 41299 existing records from primary storage. [2025-10-28T21:23:37.175303] [INFO ] [MAIN ] SXC: Loaded 41299 existing records. [2025-10-28T21:23:37.347999] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:37.348223] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-28T21:23:37.348268] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-28T21:23:37.348593] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-28T21:23:37.348633] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-28T21:23:37.585503] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-28T21:23:37.698213] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:38.004224] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T21:23:38.380305] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-28T21:23:38.668520] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T21:23:39.180255] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-28T21:23:39.357478] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T21:23:39.582334] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T21:23:39.980260] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-28T21:23:40.780268] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-28T21:23:40.903874] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T21:23:41.182746] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T21:23:41.580255] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-28T21:23:42.380256] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-28T21:23:42.707968] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:23:43.180252] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-28T21:23:43.815384] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T21:23:43.980226] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-28T21:23:44.154458] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T21:23:44.780260] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-28T21:23:45.031177] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T21:23:45.129276] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T21:23:45.580243] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-28T21:23:46.380252] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-28T21:23:46.914753] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T21:23:47.180255] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-28T21:23:47.428543] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T21:23:47.980273] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-28T21:23:48.151956] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T21:23:48.388395] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T21:23:48.780301] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-28T21:23:49.097550] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-28T21:23:49.580262] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-28T21:23:50.183408] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T21:23:50.380248] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-28T21:23:50.994819] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:23:51.180235] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-28T21:23:51.980217] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-28T21:23:52.015225] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T21:23:52.780260] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-28T21:23:53.072592] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T21:23:53.580231] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-28T21:23:53.637914] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T21:23:53.644925] [INFO ] [REMOTE ] SWX: Full fetch complete (43667 records). [2025-10-28T21:23:53.645044] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-28T21:23:54.030792] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-28T21:23:54.030876] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-28T21:23:54.031743] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-28T21:23:54.031815] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-28T21:23:54.032819] [DEBUG] [LOCAL ] SWX: Trimmed 43667 records to 29970 (keeping 200 days of data) [2025-10-28T21:23:54.216562] [DEBUG] [LOCAL ] SWX: Primary data saved (29970 records). [2025-10-28T21:23:54.216765] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-28T21:23:54.216859] [INFO ] [MAIN ] Update Progress: 2030/2366 symbols completed. SWX took 23.6s. Estimated remaining: 43m 40s. Rate: 7.7 symbols/min [2025-10-28T21:23:54.385219] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-28T21:23:54.385136] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:54.400806] [DEBUG] [LOCAL ] SXI: Loaded 11922 existing records from primary storage. [2025-10-28T21:23:54.401063] [INFO ] [MAIN ] SXI: Loaded 11922 existing records. [2025-10-28T21:23:54.584204] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:54.584428] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-28T21:23:54.584503] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-28T21:23:54.584865] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-28T21:23:54.584974] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-28T21:23:54.840605] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:23:54.881093] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T21:23:54.987184] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:55.180248] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-28T21:23:55.782142] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T21:23:55.980270] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-28T21:23:56.335407] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T21:23:56.337008] [INFO ] [REMOTE ] SWZ: Full fetch complete (8276 records). [2025-10-28T21:23:56.337075] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-28T21:23:56.687626] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-28T21:23:56.687744] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-28T21:23:56.687967] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-28T21:23:56.688006] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-28T21:23:56.688434] [DEBUG] [LOCAL ] SWZ: Trimmed 8276 records to 5859 (keeping 200 days of data) [2025-10-28T21:23:56.719368] [DEBUG] [LOCAL ] SWZ: Primary data saved (5859 records). [2025-10-28T21:23:56.719465] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-28T21:23:56.719538] [INFO ] [MAIN ] Update Progress: 2031/2366 symbols completed. SWZ took 25.4s. Estimated remaining: 43m 32s. Rate: 7.7 symbols/min [2025-10-28T21:23:56.785474] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-28T21:23:56.887218] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:23:56.916918] [DEBUG] [LOCAL ] SXT: Loaded 29243 existing records from primary storage. [2025-10-28T21:23:56.917176] [INFO ] [MAIN ] SXT: Loaded 29243 existing records. [2025-10-28T21:23:57.088785] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:23:57.089005] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-28T21:23:57.089051] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-28T21:23:57.089436] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-28T21:23:57.089493] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-28T21:23:57.451538] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:23:57.580232] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-28T21:23:58.223115] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T21:23:58.273861] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T21:23:58.380214] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-28T21:23:59.178440] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T21:23:59.182582] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-28T21:23:59.727331] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T21:23:59.980225] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-28T21:24:00.780278] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-28T21:24:00.948196] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T21:24:01.580286] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-28T21:24:02.158579] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T21:24:02.307468] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T21:24:02.380259] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-28T21:24:03.180279] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-28T21:24:03.980230] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-28T21:24:04.185023] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T21:24:04.300811] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T21:24:04.780234] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-28T21:24:04.794374] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:24:05.580337] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-28T21:24:06.205939] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T21:24:06.380243] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-28T21:24:06.555783] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T21:24:07.180321] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-28T21:24:07.545477] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T21:24:07.980301] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-28T21:24:08.780219] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-28T21:24:08.929357] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T21:24:09.012078] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T21:24:09.580336] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-28T21:24:09.733779] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T21:24:10.380313] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-28T21:24:10.435130] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T21:24:11.180312] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-28T21:24:11.695591] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T21:24:11.980240] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-28T21:24:12.092566] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T21:24:12.102699] [INFO ] [REMOTE ] SWK: Full fetch complete (75531 records). [2025-10-28T21:24:12.102811] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-28T21:24:12.484861] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-28T21:24:12.484933] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-28T21:24:12.489041] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-28T21:24:12.489128] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-28T21:24:12.490669] [DEBUG] [LOCAL ] SWK: Trimmed 75531 records to 52301 (keeping 200 days of data) [2025-10-28T21:24:12.781854] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-28T21:24:12.804403] [DEBUG] [LOCAL ] SWK: Primary data saved (52301 records). [2025-10-28T21:24:12.804490] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-28T21:24:12.804836] [INFO ] [MAIN ] Update Progress: 2032/2366 symbols completed. SWK took 44.2s. Estimated remaining: 43m 25s. Rate: 7.7 symbols/min [2025-10-28T21:24:12.974310] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:24:13.024332] [DEBUG] [LOCAL ] SYF: Loaded 53447 existing records from primary storage. [2025-10-28T21:24:13.024611] [INFO ] [MAIN ] SYF: Loaded 53447 existing records. [2025-10-28T21:24:13.191947] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:24:13.227506] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:24:13.227803] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-28T21:24:13.227876] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-28T21:24:13.228781] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-28T21:24:13.228839] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-28T21:24:13.575611] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:24:13.580208] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-28T21:24:13.901145] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T21:24:13.909805] [INFO ] [REMOTE ] SXC: Full fetch complete (60743 records). [2025-10-28T21:24:13.909929] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-28T21:24:14.305546] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-28T21:24:14.305625] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-28T21:24:14.306761] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-28T21:24:14.306825] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-28T21:24:14.308029] [DEBUG] [LOCAL ] SXC: Trimmed 60743 records to 41215 (keeping 200 days of data) [2025-10-28T21:24:14.393007] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-28T21:24:14.555549] [DEBUG] [LOCAL ] SXC: Primary data saved (41215 records). [2025-10-28T21:24:14.555691] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-28T21:24:14.555779] [INFO ] [MAIN ] Update Progress: 2033/2366 symbols completed. SXC took 37.6s. Estimated remaining: 43m 16s. Rate: 7.7 symbols/min [2025-10-28T21:24:14.726956] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:24:14.770595] [DEBUG] [LOCAL ] SYK: Loaded 46656 existing records from primary storage. [2025-10-28T21:24:14.770994] [INFO ] [MAIN ] SYK: Loaded 46656 existing records. [2025-10-28T21:24:14.957757] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:24:14.958088] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-28T21:24:14.958138] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-28T21:24:14.958620] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-28T21:24:14.958719] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-28T21:24:15.183350] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-28T21:24:15.278599] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T21:24:15.381754] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:24:15.407122] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T21:24:15.780667] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T21:24:15.980242] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-28T21:24:16.780310] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-28T21:24:17.559403] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T21:24:17.580208] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-28T21:24:17.622232] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T21:24:18.380290] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-28T21:24:19.010745] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T21:24:19.180218] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-28T21:24:19.372941] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T21:24:19.980252] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-28T21:24:20.664586] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T21:24:20.780241] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-28T21:24:20.947365] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T21:24:20.953611] [INFO ] [REMOTE ] SXT: Full fetch complete (39786 records). [2025-10-28T21:24:20.953808] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-28T21:24:21.365388] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-28T21:24:21.365498] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-28T21:24:21.366578] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-28T21:24:21.366716] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-28T21:24:21.377966] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T21:24:21.382785] [DEBUG] [LOCAL ] SXT: Trimmed 39786 records to 29296 (keeping 200 days of data) [2025-10-28T21:24:21.562910] [DEBUG] [LOCAL ] SXT: Primary data saved (29296 records). [2025-10-28T21:24:21.563039] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-28T21:24:21.563116] [INFO ] [MAIN ] Update Progress: 2034/2366 symbols completed. SXT took 24.8s. Estimated remaining: 43m 9s. Rate: 7.7 symbols/min [2025-10-28T21:24:21.585385] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-28T21:24:21.737926] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:24:21.787511] [DEBUG] [LOCAL ] SYY: Loaded 53192 existing records from primary storage. [2025-10-28T21:24:21.787869] [INFO ] [MAIN ] SYY: Loaded 53192 existing records. [2025-10-28T21:24:21.970047] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:24:21.970247] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-28T21:24:21.970295] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-28T21:24:21.970941] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-28T21:24:21.971000] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-28T21:24:22.343216] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:24:22.380245] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-28T21:24:22.996520] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:24:23.180229] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-28T21:24:23.817079] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:24:23.980234] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-28T21:24:24.602264] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T21:24:24.780271] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-28T21:24:25.325102] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:24:25.580244] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-28T21:24:26.218696] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T21:24:26.380272] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-28T21:24:26.915557] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T21:24:26.949733] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T21:24:27.180259] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-28T21:24:27.980269] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-28T21:24:28.405004] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T21:24:28.569983] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T21:24:28.573159] [INFO ] [REMOTE ] SXI: Full fetch complete (15998 records). [2025-10-28T21:24:28.573229] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-28T21:24:28.786049] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-28T21:24:28.930628] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-28T21:24:28.930731] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-28T21:24:28.931115] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-28T21:24:28.931153] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-28T21:24:28.931673] [DEBUG] [LOCAL ] SXI: Trimmed 15998 records to 11886 (keeping 200 days of data) [2025-10-28T21:24:29.004372] [DEBUG] [LOCAL ] SXI: Primary data saved (11886 records). [2025-10-28T21:24:29.004508] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-28T21:24:29.004631] [INFO ] [MAIN ] Update Progress: 2035/2366 symbols completed. SXI took 34.8s. Estimated remaining: 43m 1s. Rate: 7.7 symbols/min [2025-10-28T21:24:29.169463] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:24:29.218936] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-28T21:24:29.219242] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-28T21:24:29.390934] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:24:29.391155] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-28T21:24:29.391201] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-28T21:24:29.391810] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-28T21:24:29.391868] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-28T21:24:29.585338] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-28T21:24:29.743431] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:24:30.350071] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T21:24:30.380207] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-28T21:24:30.929786] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:24:31.180251] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-28T21:24:31.775276] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T21:24:31.980246] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-28T21:24:32.780230] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-28T21:24:32.850853] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T21:24:33.379775] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T21:24:33.580248] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-28T21:24:34.380230] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-28T21:24:34.540580] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T21:24:35.060961] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:24:35.180272] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-28T21:24:35.653828] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T21:24:35.980324] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-28T21:24:36.780292] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-28T21:24:37.260609] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-28T21:24:37.444068] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T21:24:37.580224] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-28T21:24:38.285708] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T21:24:38.380274] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-28T21:24:39.180289] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-28T21:24:39.363416] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-28T21:24:39.611638] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T21:24:39.980279] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-28T21:24:40.445528] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T21:24:40.455867] [INFO ] [REMOTE ] SYK: Full fetch complete (69097 records). [2025-10-28T21:24:40.456084] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-28T21:24:40.795228] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-28T21:24:40.854613] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-28T21:24:40.854722] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-28T21:24:40.855827] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-28T21:24:40.855905] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-28T21:24:40.857284] [DEBUG] [LOCAL ] SYK: Trimmed 69097 records to 46629 (keeping 200 days of data) [2025-10-28T21:24:41.156582] [DEBUG] [LOCAL ] SYK: Primary data saved (46629 records). [2025-10-28T21:24:41.156734] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-28T21:24:41.156819] [INFO ] [MAIN ] Update Progress: 2036/2366 symbols completed. SYK took 26.6s. Estimated remaining: 42m 54s. Rate: 7.7 symbols/min [2025-10-28T21:24:41.327095] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:24:41.366456] [DEBUG] [LOCAL ] TAC: Loaded 43453 existing records from primary storage. [2025-10-28T21:24:41.366784] [INFO ] [MAIN ] TAC: Loaded 43453 existing records. [2025-10-28T21:24:41.553092] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:24:41.553343] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-28T21:24:41.553429] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-28T21:24:41.554098] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-28T21:24:41.554233] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-28T21:24:41.591083] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-28T21:24:41.776615] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-28T21:24:41.996320] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:24:42.380301] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-28T21:24:43.138422] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T21:24:43.180246] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-28T21:24:43.401601] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-28T21:24:43.787043] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T21:24:43.980291] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-28T21:24:44.369041] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T21:24:44.379700] [INFO ] [REMOTE ] SYF: Full fetch complete (77577 records). [2025-10-28T21:24:44.379837] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-28T21:24:44.794396] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-28T21:24:44.863490] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-28T21:24:44.863605] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-28T21:24:44.866215] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-28T21:24:44.866333] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-28T21:24:44.868343] [DEBUG] [LOCAL ] SYF: Trimmed 77577 records to 53443 (keeping 200 days of data) [2025-10-28T21:24:45.197377] [DEBUG] [LOCAL ] SYF: Primary data saved (53443 records). [2025-10-28T21:24:45.197494] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-28T21:24:45.197821] [INFO ] [MAIN ] Update Progress: 2037/2366 symbols completed. SYF took 32.4s. Estimated remaining: 42m 45s. Rate: 7.7 symbols/min [2025-10-28T21:24:45.413100] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:24:45.580224] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-28T21:24:46.243032] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T21:24:46.380255] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-28T21:24:46.748477] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T21:24:47.180299] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-28T21:24:47.980243] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-28T21:24:48.157318] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T21:24:48.573351] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-28T21:24:48.780303] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-28T21:24:49.381853] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:24:49.580233] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-28T21:24:50.380319] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-28T21:24:50.602949] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T21:24:50.904796] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T21:24:51.180306] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-28T21:24:51.509145] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T21:24:51.980249] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-28T21:24:52.490899] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T21:24:52.501876] [INFO ] [REMOTE ] SYY: Full fetch complete (77255 records). [2025-10-28T21:24:52.502034] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-28T21:24:52.789598] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-28T21:24:52.895114] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-28T21:24:52.895211] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-28T21:24:52.896444] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-28T21:24:52.896513] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-28T21:24:52.898085] [DEBUG] [LOCAL ] SYY: Trimmed 77255 records to 53196 (keeping 200 days of data) [2025-10-28T21:24:53.228852] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T21:24:53.271046] [DEBUG] [LOCAL ] SYY: Primary data saved (53196 records). [2025-10-28T21:24:53.271194] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-28T21:24:53.271784] [INFO ] [MAIN ] Update Progress: 2038/2366 symbols completed. SYY took 31.7s. Estimated remaining: 42m 37s. Rate: 7.7 symbols/min [2025-10-28T21:24:53.580283] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-28T21:24:54.604224] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T21:24:54.613708] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-28T21:24:54.658111] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-28T21:24:55.180251] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-28T21:24:55.847901] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T21:24:55.980235] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-28T21:24:56.866917] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T21:24:56.878189] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-28T21:24:57.165374] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:24:57.580304] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-28T21:24:58.540543] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T21:24:58.549547] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-28T21:24:58.866999] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-28T21:24:59.180243] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-28T21:25:00.042424] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T21:25:00.052536] [INFO ] [REMOTE ] TAC: Full fetch complete (64815 records). [2025-10-28T21:25:00.052732] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-28T21:25:00.442558] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-28T21:25:00.442676] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-28T21:25:00.443759] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-28T21:25:00.443821] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-28T21:25:00.445015] [DEBUG] [LOCAL ] TAC: Trimmed 64815 records to 43456 (keeping 200 days of data) [2025-10-28T21:25:00.698795] [DEBUG] [LOCAL ] TAC: Primary data saved (43456 records). [2025-10-28T21:25:00.698903] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-28T21:25:00.698976] [INFO ] [MAIN ] Update Progress: 2039/2366 symbols completed. TAC took 19.5s. Estimated remaining: 42m 30s. Rate: 7.7 symbols/min [2025-10-28T21:25:01.784882] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-28T21:25:01.795530] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-28T21:25:01.795687] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-28T21:25:02.222389] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-28T21:25:02.222464] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-28T21:25:02.223614] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-28T21:25:02.223697] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-28T21:25:02.225119] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 53798 (keeping 200 days of data) [2025-10-28T21:25:02.570325] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-28T21:25:02.570493] [INFO ] [MAIN ] T: Full history saved. [2025-10-28T21:25:02.570631] [INFO ] [MAIN ] Update Progress: 2040/2366 symbols completed. T took 33.6s. Estimated remaining: 42m 21s. Rate: 7.7 symbols/min [2025-10-28T21:25:03.196478] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:03.273725] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:03.296220] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:03.295310] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:03.383918] [DEBUG] [LOCAL ] TALO: Loaded 50918 existing records from primary storage. [2025-10-28T21:25:03.414296] [INFO ] [MAIN ] TALO: Loaded 50918 existing records. [2025-10-28T21:25:03.415273] [DEBUG] [LOCAL ] TAK: Loaded 50158 existing records from primary storage. [2025-10-28T21:25:03.451049] [DEBUG] [LOCAL ] TAP: Loaded 52942 existing records from primary storage. [2025-10-28T21:25:03.473085] [INFO ] [MAIN ] TAP: Loaded 52942 existing records. [2025-10-28T21:25:03.472894] [DEBUG] [LOCAL ] TAL: Loaded 51657 existing records from primary storage. [2025-10-28T21:25:03.511872] [INFO ] [MAIN ] TAL: Loaded 51657 existing records. [2025-10-28T21:25:03.492585] [INFO ] [MAIN ] TAK: Loaded 50158 existing records. [2025-10-28T21:25:03.913392] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:03.976319] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-28T21:25:04.043108] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-28T21:25:04.097213] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-28T21:25:04.084783] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:04.118877] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-28T21:25:04.140717] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-28T21:25:04.118832] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-28T21:25:04.135433] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:04.189943] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-28T21:25:04.189676] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-28T21:25:04.196344] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-28T21:25:04.201577] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-28T21:25:04.196113] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:04.275143] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-28T21:25:04.285800] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-28T21:25:04.294164] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-28T21:25:04.294276] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-28T21:25:04.366149] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-28T21:25:04.425199] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-28T21:25:05.705665] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:05.742673] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:05.767194] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-28T21:25:05.767600] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-28T21:25:05.828162] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:05.879250] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-28T21:25:05.884018] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:05.885041] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-28T21:25:07.069669] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:25:07.080099] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-28T21:25:07.108098] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:25:07.118055] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-28T21:25:07.224580] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T21:25:07.234801] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-28T21:25:07.408183] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T21:25:07.418619] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-28T21:25:08.243089] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:25:08.252238] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-28T21:25:08.365894] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:25:08.376009] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-28T21:25:08.568899] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T21:25:08.579131] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-28T21:25:08.764199] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T21:25:08.780218] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-28T21:25:09.486295] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T21:25:09.580261] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-28T21:25:09.630514] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T21:25:10.035587] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T21:25:10.380222] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-28T21:25:10.840351] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:25:11.180228] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-28T21:25:11.253953] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-28T21:25:11.646304] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T21:25:11.980260] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-28T21:25:12.780228] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-28T21:25:12.997809] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-28T21:25:13.393270] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T21:25:13.580335] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-28T21:25:14.321857] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T21:25:14.380170] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-28T21:25:14.933315] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T21:25:15.180330] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-28T21:25:15.577266] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T21:25:15.980320] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-28T21:25:16.580515] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:25:16.780252] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-28T21:25:17.257752] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T21:25:17.580277] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-28T21:25:18.063244] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T21:25:18.380321] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-28T21:25:18.864918] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:25:19.180309] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-28T21:25:19.556550] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T21:25:19.980248] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-28T21:25:20.390798] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:25:20.780288] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-28T21:25:21.126449] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:25:21.580304] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-28T21:25:22.179482] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T21:25:22.380311] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-28T21:25:22.871954] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T21:25:23.180238] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-28T21:25:23.618560] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T21:25:23.628686] [INFO ] [REMOTE ] TAK: Full fetch complete (72032 records). [2025-10-28T21:25:23.628837] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-28T21:25:23.992737] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-28T21:25:24.016327] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-28T21:25:24.016392] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-28T21:25:24.017549] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-28T21:25:24.017610] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-28T21:25:24.019022] [DEBUG] [LOCAL ] TAK: Trimmed 72032 records to 50143 (keeping 200 days of data) [2025-10-28T21:25:24.313806] [DEBUG] [LOCAL ] TAK: Primary data saved (50143 records). [2025-10-28T21:25:24.313939] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-28T21:25:24.314016] [INFO ] [MAIN ] Update Progress: 2041/2366 symbols completed. TAK took 21.7s. Estimated remaining: 42m 15s. Rate: 7.7 symbols/min [2025-10-28T21:25:24.491332] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:24.503611] [DEBUG] [LOCAL ] TBB: Loaded 11028 existing records from primary storage. [2025-10-28T21:25:24.503859] [INFO ] [MAIN ] TBB: Loaded 11028 existing records. [2025-10-28T21:25:24.689659] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:24.689970] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-28T21:25:24.690049] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-28T21:25:24.690359] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-28T21:25:24.690432] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-28T21:25:24.785221] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-28T21:25:24.886151] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T21:25:25.114054] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:25.390260] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T21:25:25.580238] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-28T21:25:26.254476] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T21:25:26.380273] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-28T21:25:26.737334] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:25:27.180257] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-28T21:25:27.769246] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T21:25:27.980228] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-28T21:25:28.363303] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-28T21:25:28.780308] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-28T21:25:29.276144] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T21:25:29.286499] [INFO ] [REMOTE ] TALO: Full fetch complete (73358 records). [2025-10-28T21:25:29.286622] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-28T21:25:29.585424] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-28T21:25:29.676958] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-28T21:25:29.677040] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-28T21:25:29.678194] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-28T21:25:29.678256] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-28T21:25:29.679614] [DEBUG] [LOCAL ] TALO: Trimmed 73358 records to 50889 (keeping 200 days of data) [2025-10-28T21:25:29.969291] [DEBUG] [LOCAL ] TALO: Primary data saved (50889 records). [2025-10-28T21:25:29.969564] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-28T21:25:29.969759] [INFO ] [MAIN ] Update Progress: 2042/2366 symbols completed. TALO took 27.4s. Estimated remaining: 42m 7s. Rate: 7.7 symbols/min [2025-10-28T21:25:30.101312] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T21:25:30.154156] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:30.185334] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T21:25:30.222497] [DEBUG] [LOCAL ] TBBB: Loaded 35391 existing records from primary storage. [2025-10-28T21:25:30.222824] [INFO ] [MAIN ] TBBB: Loaded 35391 existing records. [2025-10-28T21:25:30.391335] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-28T21:25:30.396395] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:30.397254] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-28T21:25:30.397303] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-28T21:25:30.397695] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-28T21:25:30.397756] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-28T21:25:30.748548] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:30.972342] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T21:25:31.180251] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-28T21:25:31.677324] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T21:25:31.980247] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-28T21:25:32.489376] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:25:32.780311] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-28T21:25:33.580314] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-28T21:25:34.217410] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:25:34.228036] [INFO ] [REMOTE ] TAP: Full fetch complete (76503 records). [2025-10-28T21:25:34.228179] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-28T21:25:34.383806] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-28T21:25:34.663567] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-28T21:25:34.664276] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-28T21:25:34.666232] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-28T21:25:34.664829] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T21:25:34.666346] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-28T21:25:34.673316] [DEBUG] [LOCAL ] TAP: Trimmed 76503 records to 52933 (keeping 200 days of data) [2025-10-28T21:25:34.982271] [DEBUG] [LOCAL ] TAP: Primary data saved (52933 records). [2025-10-28T21:25:34.982403] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-28T21:25:34.982479] [INFO ] [MAIN ] Update Progress: 2043/2366 symbols completed. TAP took 32.4s. Estimated remaining: 41m 59s. Rate: 7.7 symbols/min [2025-10-28T21:25:35.151295] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:35.173250] [DEBUG] [LOCAL ] TBI: Loaded 22549 existing records from primary storage. [2025-10-28T21:25:35.173501] [INFO ] [MAIN ] TBI: Loaded 22549 existing records. [2025-10-28T21:25:35.186332] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-28T21:25:35.353228] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:35.353420] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-28T21:25:35.353465] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-28T21:25:35.353629] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-28T21:25:35.353711] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-28T21:25:35.707092] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:35.736822] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T21:25:35.980294] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-28T21:25:36.481317] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T21:25:36.746208] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T21:25:36.780218] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-28T21:25:37.580221] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-28T21:25:37.850137] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:25:38.226800] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T21:25:38.380287] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-28T21:25:39.180292] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-28T21:25:39.361551] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T21:25:39.875978] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T21:25:39.980315] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-28T21:25:40.622191] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T21:25:40.780280] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-28T21:25:41.300110] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T21:25:41.580237] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-28T21:25:42.380274] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-28T21:25:42.725098] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T21:25:42.950411] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T21:25:43.180326] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-28T21:25:43.980306] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-28T21:25:44.368840] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T21:25:44.379189] [INFO ] [REMOTE ] TAL: Full fetch complete (75667 records). [2025-10-28T21:25:44.379342] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-28T21:25:44.699121] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T21:25:44.717108] [INFO ] [REMOTE ] TBB: Full fetch complete (16154 records). [2025-10-28T21:25:44.739903] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-28T21:25:44.784175] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-28T21:25:44.809058] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-28T21:25:44.864994] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-28T21:25:44.882629] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-28T21:25:44.893565] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-28T21:25:44.952740] [DEBUG] [LOCAL ] TAL: Trimmed 75667 records to 51637 (keeping 200 days of data) [2025-10-28T21:25:45.257557] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-28T21:25:45.264847] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-28T21:25:45.268570] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-28T21:25:45.284478] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-28T21:25:45.285300] [DEBUG] [LOCAL ] TBB: Trimmed 16154 records to 11036 (keeping 200 days of data) [2025-10-28T21:25:45.443638] [DEBUG] [LOCAL ] TBB: Primary data saved (11036 records). [2025-10-28T21:25:45.449258] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-28T21:25:45.450984] [INFO ] [MAIN ] Update Progress: 2044/2366 symbols completed. TBB took 21.1s. Estimated remaining: 41m 51s. Rate: 7.7 symbols/min [2025-10-28T21:25:45.581529] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-28T21:25:45.703015] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:45.704123] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-28T21:25:45.704579] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-28T21:25:45.706884] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-28T21:25:45.710961] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-28T21:25:45.713988] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-28T21:25:45.714703] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-28T21:25:45.794748] [DEBUG] [LOCAL ] TAL: Primary data saved (51637 records). [2025-10-28T21:25:45.821886] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T21:25:45.822011] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-28T21:25:45.855635] [INFO ] [MAIN ] Update Progress: 2045/2366 symbols completed. TAL took 43.3s. Estimated remaining: 41m 43s. Rate: 7.7 symbols/min [2025-10-28T21:25:46.256039] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:25:46.296730] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:46.302908] [DEBUG] [LOCAL ] TBN: Loaded 4471 existing records from primary storage. [2025-10-28T21:25:46.303144] [INFO ] [MAIN ] TBN: Loaded 4471 existing records. [2025-10-28T21:25:46.385383] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-28T21:25:46.506003] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:25:46.506213] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-28T21:25:46.506262] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-28T21:25:46.506508] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-28T21:25:46.506576] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-28T21:25:46.875434] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:25:46.896368] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T21:25:47.180300] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-28T21:25:47.287844] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T21:25:47.980339] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-28T21:25:48.365001] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T21:25:48.433784] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T21:25:48.780319] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-28T21:25:49.020589] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-28T21:25:49.580341] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-28T21:25:50.380304] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-28T21:25:50.534781] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T21:25:51.180319] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-28T21:25:51.470291] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T21:25:51.512147] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T21:25:51.980237] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-28T21:25:52.715153] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T21:25:52.780219] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-28T21:25:53.580220] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-28T21:25:53.628860] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T21:25:53.898031] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T21:25:54.380257] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-28T21:25:55.180244] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-28T21:25:55.340585] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T21:25:55.444295] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-28T21:25:55.980266] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-28T21:25:56.763734] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T21:25:56.780231] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-28T21:25:56.996821] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T21:25:57.580271] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-28T21:25:57.843270] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T21:25:58.380316] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-28T21:25:59.180258] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-28T21:25:59.314689] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T21:25:59.322193] [INFO ] [REMOTE ] TBBB: Full fetch complete (52457 records). [2025-10-28T21:25:59.322318] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-28T21:25:59.700031] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-28T21:25:59.700115] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-28T21:25:59.701074] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-28T21:25:59.701136] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-28T21:25:59.702183] [DEBUG] [LOCAL ] TBBB: Trimmed 52457 records to 35261 (keeping 200 days of data) [2025-10-28T21:25:59.903318] [DEBUG] [LOCAL ] TBBB: Primary data saved (35261 records). [2025-10-28T21:25:59.903531] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-28T21:25:59.903618] [INFO ] [MAIN ] Update Progress: 2046/2366 symbols completed. TBBB took 29.9s. Estimated remaining: 41m 36s. Rate: 7.7 symbols/min [2025-10-28T21:25:59.984531] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-28T21:26:00.047155] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T21:26:00.099151] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:00.099320] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-28T21:26:00.099357] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-28T21:26:00.099467] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-28T21:26:00.099507] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-28T21:26:00.099548] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-28T21:26:00.099580] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-28T21:26:00.370109] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T21:26:00.458312] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:00.780307] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-10-28T21:26:01.223325] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:26:01.223629] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-10-28T21:26:01.223739] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:26:01.223789] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-28T21:26:01.223849] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:26:01.223918] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-28T21:26:01.223982] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-28T21:26:01.224017] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-28T21:26:01.224055] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-28T21:26:01.224101] [INFO ] [MAIN ] Update Progress: 2047/2366 symbols completed. TCAI took 1.3s. Estimated remaining: 41m 27s. Rate: 7.7 symbols/min [2025-10-28T21:26:01.395722] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:01.406264] [DEBUG] [LOCAL ] TCBX: Loaded 10015 existing records from primary storage. [2025-10-28T21:26:01.406446] [INFO ] [MAIN ] TCBX: Loaded 10015 existing records. [2025-10-28T21:26:01.584157] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:01.584250] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-28T21:26:01.584527] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-28T21:26:01.585320] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-28T21:26:01.585533] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-28T21:26:01.585573] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-28T21:26:01.992009] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:02.027446] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T21:26:02.380305] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-28T21:26:03.023756] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:26:03.180221] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-28T21:26:03.686242] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T21:26:03.980257] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-28T21:26:04.692218] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T21:26:04.780265] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-28T21:26:05.580270] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-28T21:26:05.743626] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T21:26:05.748691] [INFO ] [REMOTE ] TBI: Full fetch complete (32110 records). [2025-10-28T21:26:05.748768] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-28T21:26:05.851679] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T21:26:06.119147] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-28T21:26:06.119240] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-28T21:26:06.119949] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-28T21:26:06.120009] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-28T21:26:06.120711] [DEBUG] [LOCAL ] TBI: Trimmed 32110 records to 22409 (keeping 200 days of data) [2025-10-28T21:26:06.243745] [DEBUG] [LOCAL ] TBI: Primary data saved (22409 records). [2025-10-28T21:26:06.243873] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-28T21:26:06.243953] [INFO ] [MAIN ] Update Progress: 2048/2366 symbols completed. TBI took 31.3s. Estimated remaining: 41m 19s. Rate: 7.7 symbols/min [2025-10-28T21:26:06.391170] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-28T21:26:06.423959] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:06.424330] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-28T21:26:06.424383] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-28T21:26:06.424492] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-28T21:26:06.424536] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-28T21:26:06.424577] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-28T21:26:06.424610] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-28T21:26:06.788435] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:06.794265] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T21:26:07.180239] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2025-01. [2025-10-28T21:26:07.320907] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:26:07.321414] [WARN ] [REMOTE ] TCPA: No data returned for month 2025-01 [2025-10-28T21:26:07.321522] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:26:07.321572] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-28T21:26:07.321607] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:26:07.321703] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-28T21:26:07.321782] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-28T21:26:07.321821] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-28T21:26:07.321861] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-28T21:26:07.321914] [INFO ] [MAIN ] Update Progress: 2049/2366 symbols completed. TCPA took 1.1s. Estimated remaining: 41m 10s. Rate: 7.7 symbols/min [2025-10-28T21:26:07.497079] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:07.544752] [DEBUG] [LOCAL ] TD: Loaded 52135 existing records from primary storage. [2025-10-28T21:26:07.545064] [INFO ] [MAIN ] TD: Loaded 52135 existing records. [2025-10-28T21:26:07.717305] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:07.717518] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-28T21:26:07.717564] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-28T21:26:07.717961] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-28T21:26:07.718020] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-28T21:26:07.985234] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-28T21:26:08.066211] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:08.738317] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T21:26:08.780235] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-28T21:26:09.411220] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T21:26:09.580244] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-28T21:26:10.075687] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T21:26:10.380260] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-28T21:26:10.971310] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T21:26:11.180253] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-28T21:26:11.408845] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T21:26:11.980266] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-28T21:26:12.503413] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T21:26:12.780313] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-28T21:26:13.101240] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T21:26:13.580295] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-28T21:26:14.380310] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-28T21:26:14.891715] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T21:26:14.995469] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T21:26:15.180245] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-28T21:26:15.693692] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T21:26:15.980253] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-28T21:26:16.199177] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-28T21:26:16.780287] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-28T21:26:17.393618] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T21:26:17.396286] [INFO ] [REMOTE ] TCBX: Full fetch complete (15648 records). [2025-10-28T21:26:17.396357] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-28T21:26:17.580243] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-28T21:26:17.762407] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-28T21:26:17.762479] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-28T21:26:17.762858] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-28T21:26:17.762950] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-28T21:26:17.763471] [DEBUG] [LOCAL ] TCBX: Trimmed 15648 records to 9919 (keeping 200 days of data) [2025-10-28T21:26:17.820943] [DEBUG] [LOCAL ] TCBX: Primary data saved (9919 records). [2025-10-28T21:26:17.821069] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-28T21:26:17.821144] [INFO ] [MAIN ] Update Progress: 2050/2366 symbols completed. TCBX took 16.6s. Estimated remaining: 41m 2s. Rate: 7.7 symbols/min [2025-10-28T21:26:17.989435] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:18.029528] [DEBUG] [LOCAL ] TDC: Loaded 46307 existing records from primary storage. [2025-10-28T21:26:18.029838] [INFO ] [MAIN ] TDC: Loaded 46307 existing records. [2025-10-28T21:26:18.204113] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:18.204318] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-28T21:26:18.204381] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-28T21:26:18.204822] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-28T21:26:18.204879] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-28T21:26:18.388339] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-28T21:26:18.560785] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:18.711155] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T21:26:18.967593] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T21:26:19.180274] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-28T21:26:19.980293] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-28T21:26:20.421696] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T21:26:20.780314] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-28T21:26:21.042932] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T21:26:21.580340] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-28T21:26:21.875310] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T21:26:22.043627] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:26:22.380316] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-28T21:26:22.864305] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T21:26:23.180315] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-28T21:26:23.980299] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-28T21:26:24.583019] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:26:24.602240] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T21:26:24.606374] [INFO ] [REMOTE ] TBN: Full fetch complete (6384 records). [2025-10-28T21:26:24.606454] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-28T21:26:24.789914] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-28T21:26:24.989044] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-28T21:26:24.989117] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-28T21:26:24.989285] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-28T21:26:24.989322] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-28T21:26:24.989909] [DEBUG] [LOCAL ] TBN: Trimmed 6384 records to 4506 (keeping 200 days of data) [2025-10-28T21:26:25.015265] [DEBUG] [LOCAL ] TBN: Primary data saved (4506 records). [2025-10-28T21:26:25.015341] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-28T21:26:25.015420] [INFO ] [MAIN ] Update Progress: 2051/2366 symbols completed. TBN took 39.1s. Estimated remaining: 40m 55s. Rate: 7.7 symbols/min [2025-10-28T21:26:25.186460] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:25.194580] [DEBUG] [LOCAL ] TDF: Loaded 6033 existing records from primary storage. [2025-10-28T21:26:25.194800] [INFO ] [MAIN ] TDF: Loaded 6033 existing records. [2025-10-28T21:26:25.368750] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:25.368978] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-28T21:26:25.369025] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-28T21:26:25.369239] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-28T21:26:25.369296] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-28T21:26:25.585509] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-28T21:26:25.716317] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:25.883081] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T21:26:26.010593] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T21:26:26.380296] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-28T21:26:26.855387] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T21:26:27.180279] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-28T21:26:27.980240] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-28T21:26:28.404427] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T21:26:28.423801] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T21:26:28.780303] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-28T21:26:29.317392] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T21:26:29.580262] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-28T21:26:30.043539] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T21:26:30.380296] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-28T21:26:31.180269] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-28T21:26:31.698908] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:26:31.980216] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-28T21:26:32.387471] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T21:26:32.590201] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T21:26:32.780302] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-28T21:26:33.315883] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T21:26:33.580249] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-28T21:26:33.975535] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T21:26:34.380259] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-28T21:26:35.180285] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-28T21:26:35.696166] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T21:26:35.980283] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-28T21:26:36.497821] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T21:26:36.780252] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-28T21:26:37.580278] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-28T21:26:37.719502] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T21:26:37.978423] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T21:26:38.134407] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T21:26:38.380254] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-28T21:26:39.180262] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-28T21:26:39.417863] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-28T21:26:39.418710] [INFO ] [REMOTE ] TBLU: Full fetch complete (1229 records). [2025-10-28T21:26:39.418778] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-28T21:26:39.603512] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T21:26:39.603744] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:26:39.603862] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:26:39.603941] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-28T21:26:39.604144] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-28T21:26:39.604212] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-28T21:26:39.604339] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-28T21:26:39.604409] [INFO ] [MAIN ] Update Progress: 2052/2366 symbols completed. TBLU took 54.2s. Estimated remaining: 40m 48s. Rate: 7.7 symbols/min [2025-10-28T21:26:39.804122] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:39.801674] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T21:26:39.835337] [DEBUG] [LOCAL ] TDG: Loaded 21549 existing records from primary storage. [2025-10-28T21:26:39.835577] [INFO ] [MAIN ] TDG: Loaded 21549 existing records. [2025-10-28T21:26:39.987630] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-28T21:26:40.024631] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:40.024929] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-28T21:26:40.025001] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-28T21:26:40.025344] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-28T21:26:40.025402] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-28T21:26:40.395365] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:40.780248] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-28T21:26:41.580276] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-28T21:26:41.742368] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T21:26:41.753132] [INFO ] [REMOTE ] TD: Full fetch complete (75785 records). [2025-10-28T21:26:41.753280] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-28T21:26:42.096467] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T21:26:42.192338] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-28T21:26:42.192417] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-28T21:26:42.193535] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-28T21:26:42.193598] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-28T21:26:42.194987] [DEBUG] [LOCAL ] TD: Trimmed 75785 records to 52115 (keeping 200 days of data) [2025-10-28T21:26:42.405409] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-28T21:26:42.513099] [DEBUG] [LOCAL ] TD: Primary data saved (52115 records). [2025-10-28T21:26:42.513234] [INFO ] [MAIN ] TD: Full history saved. [2025-10-28T21:26:42.513322] [INFO ] [MAIN ] Update Progress: 2053/2366 symbols completed. TD took 35.2s. Estimated remaining: 40m 39s. Rate: 7.7 symbols/min [2025-10-28T21:26:42.679485] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:42.727571] [DEBUG] [LOCAL ] TDOC: Loaded 53368 existing records from primary storage. [2025-10-28T21:26:42.727940] [INFO ] [MAIN ] TDOC: Loaded 53368 existing records. [2025-10-28T21:26:42.891924] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T21:26:42.926334] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:42.926609] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-28T21:26:42.926928] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-28T21:26:42.927518] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-28T21:26:42.927676] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-28T21:26:43.107251] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T21:26:43.185522] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-28T21:26:43.324492] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:43.980223] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-28T21:26:44.060571] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T21:26:44.780265] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-28T21:26:45.258244] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T21:26:45.260351] [INFO ] [REMOTE ] TDF: Full fetch complete (10278 records). [2025-10-28T21:26:45.260422] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-28T21:26:45.583342] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-28T21:26:45.650892] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-28T21:26:45.651058] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-28T21:26:45.651491] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-28T21:26:45.651558] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-28T21:26:45.652243] [DEBUG] [LOCAL ] TDF: Trimmed 10278 records to 6026 (keeping 200 days of data) [2025-10-28T21:26:45.692108] [DEBUG] [LOCAL ] TDF: Primary data saved (6026 records). [2025-10-28T21:26:45.692566] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-28T21:26:45.692731] [INFO ] [MAIN ] Update Progress: 2054/2366 symbols completed. TDF took 20.7s. Estimated remaining: 40m 31s. Rate: 7.7 symbols/min [2025-10-28T21:26:45.817068] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-28T21:26:45.937936] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:45.976479] [DEBUG] [LOCAL ] TDS: Loaded 41768 existing records from primary storage. [2025-10-28T21:26:45.976807] [INFO ] [MAIN ] TDS: Loaded 41768 existing records. [2025-10-28T21:26:46.157469] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:46.157729] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-28T21:26:46.157782] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-28T21:26:46.158194] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-28T21:26:46.158234] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-28T21:26:46.387557] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-28T21:26:46.511745] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:46.941955] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T21:26:47.180238] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-28T21:26:47.316016] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T21:26:47.980304] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-28T21:26:48.319606] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T21:26:48.780232] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-28T21:26:48.916469] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T21:26:49.580342] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-28T21:26:50.380222] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-28T21:26:50.476392] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T21:26:50.828214] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T21:26:51.180273] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-28T21:26:51.230162] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T21:26:51.980273] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-28T21:26:52.685974] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T21:26:52.780268] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-28T21:26:53.221676] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T21:26:53.232344] [INFO ] [REMOTE ] TDC: Full fetch complete (67924 records). [2025-10-28T21:26:53.232621] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-28T21:26:53.585474] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-28T21:26:53.679320] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-28T21:26:53.679419] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-28T21:26:53.680706] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-28T21:26:53.680773] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-28T21:26:53.682230] [DEBUG] [LOCAL ] TDC: Trimmed 67924 records to 46254 (keeping 200 days of data) [2025-10-28T21:26:53.963010] [DEBUG] [LOCAL ] TDC: Primary data saved (46254 records). [2025-10-28T21:26:53.963147] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-28T21:26:53.963250] [INFO ] [MAIN ] Update Progress: 2055/2366 symbols completed. TDC took 36.1s. Estimated remaining: 40m 23s. Rate: 7.7 symbols/min [2025-10-28T21:26:54.136289] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:26:54.174548] [DEBUG] [LOCAL ] TDW: Loaded 44739 existing records from primary storage. [2025-10-28T21:26:54.174846] [INFO ] [MAIN ] TDW: Loaded 44739 existing records. [2025-10-28T21:26:54.357207] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:26:54.357442] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-28T21:26:54.357607] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-28T21:26:54.357871] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-28T21:26:54.357926] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-28T21:26:54.388259] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-28T21:26:54.620130] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-28T21:26:54.768748] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:26:54.792050] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:26:54.972616] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T21:26:55.180325] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-28T21:26:55.980303] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-28T21:26:56.780227] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-28T21:26:57.029938] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-28T21:26:57.145163] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T21:26:57.452311] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T21:26:57.580334] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-28T21:26:58.380267] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-28T21:26:58.579794] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:26:59.180243] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-28T21:26:59.734344] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:26:59.980309] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-28T21:27:00.452082] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T21:27:00.780312] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-28T21:27:01.097729] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T21:27:01.580312] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-28T21:27:01.852708] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T21:27:02.380254] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-28T21:27:02.567447] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T21:27:02.572687] [INFO ] [REMOTE ] TDG: Full fetch complete (31922 records). [2025-10-28T21:27:02.572813] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-28T21:27:03.000073] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-28T21:27:03.000205] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-28T21:27:03.001168] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-28T21:27:03.001233] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-28T21:27:03.002724] [DEBUG] [LOCAL ] TDG: Trimmed 31922 records to 21518 (keeping 200 days of data) [2025-10-28T21:27:03.148177] [DEBUG] [LOCAL ] TDG: Primary data saved (21518 records). [2025-10-28T21:27:03.148363] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-28T21:27:03.148464] [INFO ] [MAIN ] Update Progress: 2056/2366 symbols completed. TDG took 23.5s. Estimated remaining: 40m 15s. Rate: 7.7 symbols/min [2025-10-28T21:27:03.185430] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-28T21:27:03.327332] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:03.357974] [DEBUG] [LOCAL ] TDY: Loaded 21896 existing records from primary storage. [2025-10-28T21:27:03.358358] [INFO ] [MAIN ] TDY: Loaded 21896 existing records. [2025-10-28T21:27:03.545916] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:03.546283] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-28T21:27:03.546351] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-28T21:27:03.546738] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-28T21:27:03.546831] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-28T21:27:03.934836] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T21:27:03.964894] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:03.980226] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-28T21:27:04.274057] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T21:27:04.780311] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-28T21:27:05.519517] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:27:05.580290] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-28T21:27:06.158026] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T21:27:06.380259] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-28T21:27:06.850783] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T21:27:07.180276] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-28T21:27:07.467251] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T21:27:07.970337] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T21:27:07.980211] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-28T21:27:08.780231] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-28T21:27:08.845507] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T21:27:09.580241] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-28T21:27:10.313879] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T21:27:10.374623] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T21:27:10.380204] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-28T21:27:11.180298] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-28T21:27:11.492148] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T21:27:11.980265] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-28T21:27:12.388828] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:27:12.780238] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-28T21:27:12.891577] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T21:27:13.580233] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-28T21:27:13.996002] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T21:27:14.005222] [INFO ] [REMOTE ] TDS: Full fetch complete (60989 records). [2025-10-28T21:27:14.005408] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-28T21:27:14.392245] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-28T21:27:14.396241] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-28T21:27:14.396370] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-28T21:27:14.397490] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-28T21:27:14.397659] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-28T21:27:14.398830] [DEBUG] [LOCAL ] TDS: Trimmed 60989 records to 41639 (keeping 200 days of data) [2025-10-28T21:27:14.628950] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T21:27:14.675558] [DEBUG] [LOCAL ] TDS: Primary data saved (41639 records). [2025-10-28T21:27:14.675736] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-28T21:27:14.675839] [INFO ] [MAIN ] Update Progress: 2057/2366 symbols completed. TDS took 29.0s. Estimated remaining: 40m 8s. Rate: 7.7 symbols/min [2025-10-28T21:27:14.842267] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:14.842461] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-28T21:27:14.842500] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-28T21:27:14.842610] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-28T21:27:14.842675] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-28T21:27:14.842737] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-28T21:27:14.842781] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-28T21:27:15.186798] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-28T21:27:15.186715] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:15.980297] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-28T21:27:16.120957] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T21:27:16.352988] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T21:27:16.780304] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-28T21:27:17.307011] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T21:27:17.527051] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T21:27:17.580211] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-28T21:27:18.320634] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T21:27:18.380236] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-28T21:27:19.072132] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T21:27:19.076934] [INFO ] [REMOTE ] TDY: Full fetch complete (32222 records). [2025-10-28T21:27:19.077038] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-28T21:27:19.188254] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-28T21:27:19.468184] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-28T21:27:19.468289] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-28T21:27:19.469547] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-28T21:27:19.469634] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-28T21:27:19.470764] [DEBUG] [LOCAL ] TDY: Trimmed 32222 records to 21796 (keeping 200 days of data) [2025-10-28T21:27:19.612583] [DEBUG] [LOCAL ] TDY: Primary data saved (21796 records). [2025-10-28T21:27:19.612788] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-28T21:27:19.612896] [INFO ] [MAIN ] Update Progress: 2058/2366 symbols completed. TDY took 16.5s. Estimated remaining: 40m 0s. Rate: 7.7 symbols/min [2025-10-28T21:27:19.785343] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:19.797233] [DEBUG] [LOCAL ] TEAF: Loaded 7257 existing records from primary storage. [2025-10-28T21:27:19.797597] [INFO ] [MAIN ] TEAF: Loaded 7257 existing records. [2025-10-28T21:27:19.986114] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-28T21:27:19.992724] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:19.993961] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-28T21:27:19.994047] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-28T21:27:19.994314] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-28T21:27:19.994384] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-28T21:27:20.362437] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:20.388144] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T21:27:20.780292] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-28T21:27:21.490396] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T21:27:21.580303] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-28T21:27:22.125262] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T21:27:22.380289] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-28T21:27:23.037181] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T21:27:23.180306] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-28T21:27:23.648100] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T21:27:23.710350] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T21:27:23.980336] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-28T21:27:24.780297] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-28T21:27:25.153930] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T21:27:25.580218] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-10-28T21:27:25.740526] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:27:25.741194] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-10-28T21:27:25.741353] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:27:25.741553] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-28T21:27:25.741627] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:27:25.741724] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-28T21:27:25.741799] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-28T21:27:25.741838] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-28T21:27:25.741878] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-28T21:27:25.741929] [INFO ] [MAIN ] Update Progress: 2059/2366 symbols completed. TE took 11.1s. Estimated remaining: 39m 52s. Rate: 7.7 symbols/min [2025-10-28T21:27:25.966857] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:25.962969] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T21:27:25.979283] [INFO ] [REMOTE ] TDOC: Full fetch complete (77454 records). [2025-10-28T21:27:25.979483] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-28T21:27:26.383011] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-28T21:27:26.382890] [DEBUG] [LOCAL ] TECK: Loaded 53429 existing records from primary storage. [2025-10-28T21:27:26.430769] [INFO ] [MAIN ] TECK: Loaded 53429 existing records. [2025-10-28T21:27:26.524846] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-28T21:27:26.546735] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-28T21:27:26.559090] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-28T21:27:26.564966] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-28T21:27:26.619847] [DEBUG] [LOCAL ] TDOC: Trimmed 77454 records to 53369 (keeping 200 days of data) [2025-10-28T21:27:26.640303] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:26.640804] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-28T21:27:26.640867] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-28T21:27:26.641476] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-28T21:27:26.641533] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-28T21:27:26.983418] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T21:27:27.185452] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-28T21:27:27.224310] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:27.428909] [DEBUG] [LOCAL ] TDOC: Primary data saved (53369 records). [2025-10-28T21:27:27.429096] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-28T21:27:27.429196] [INFO ] [MAIN ] Update Progress: 2060/2366 symbols completed. TDOC took 44.9s. Estimated remaining: 39m 43s. Rate: 7.7 symbols/min [2025-10-28T21:27:27.621673] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:27.661792] [DEBUG] [LOCAL ] TEF: Loaded 36539 existing records from primary storage. [2025-10-28T21:27:27.662223] [INFO ] [MAIN ] TEF: Loaded 36539 existing records. [2025-10-28T21:27:27.863240] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:27.863722] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-28T21:27:27.863787] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-28T21:27:27.864177] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-28T21:27:27.864237] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-28T21:27:27.989800] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-28T21:27:28.002845] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T21:27:28.297829] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:28.780274] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-28T21:27:29.193465] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T21:27:29.484921] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T21:27:29.580265] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-28T21:27:30.380290] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-28T21:27:30.895620] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T21:27:31.180235] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-28T21:27:31.374298] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T21:27:31.980283] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-28T21:27:32.507907] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T21:27:32.780322] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-28T21:27:33.255931] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T21:27:33.580262] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-28T21:27:33.705703] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T21:27:34.380324] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-28T21:27:34.844482] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T21:27:34.854242] [INFO ] [REMOTE ] TDW: Full fetch complete (66541 records). [2025-10-28T21:27:34.854439] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-28T21:27:35.185406] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-28T21:27:35.260114] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-28T21:27:35.260238] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-28T21:27:35.261991] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-28T21:27:35.262060] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-28T21:27:35.263955] [DEBUG] [LOCAL ] TDW: Trimmed 66541 records to 44631 (keeping 200 days of data) [2025-10-28T21:27:35.540100] [DEBUG] [LOCAL ] TDW: Primary data saved (44631 records). [2025-10-28T21:27:35.540275] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-28T21:27:35.540373] [INFO ] [MAIN ] Update Progress: 2061/2366 symbols completed. TDW took 41.6s. Estimated remaining: 39m 36s. Rate: 7.7 symbols/min [2025-10-28T21:27:35.729417] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:35.753015] [DEBUG] [LOCAL ] TEI: Loaded 21032 existing records from primary storage. [2025-10-28T21:27:35.753384] [INFO ] [MAIN ] TEI: Loaded 21032 existing records. [2025-10-28T21:27:35.885920] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T21:27:35.966523] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:35.985013] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-28T21:27:35.985397] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-28T21:27:35.985181] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-28T21:27:36.001025] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-28T21:27:36.002703] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-28T21:27:36.039856] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T21:27:36.408904] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:36.780256] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-28T21:27:37.185039] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T21:27:37.580308] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-28T21:27:38.165819] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T21:27:38.189998] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T21:27:38.380229] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-28T21:27:39.180256] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-28T21:27:39.682030] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T21:27:39.681856] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:27:39.980292] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-28T21:27:40.499605] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T21:27:40.780261] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-28T21:27:41.580325] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-28T21:27:42.329155] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:27:42.355200] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T21:27:42.380251] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-28T21:27:43.178808] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T21:27:43.183290] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-28T21:27:43.980275] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-28T21:27:44.344126] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T21:27:44.704245] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T21:27:44.780348] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-28T21:27:45.580239] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-28T21:27:45.866471] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T21:27:46.361043] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T21:27:46.380244] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-28T21:27:47.083421] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T21:27:47.180217] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-28T21:27:47.841449] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T21:27:47.980238] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-28T21:27:48.780223] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-28T21:27:48.937090] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T21:27:49.580253] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-28T21:27:49.989064] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T21:27:50.380225] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-28T21:27:50.495620] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T21:27:51.180253] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-28T21:27:51.897797] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T21:27:51.980242] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-28T21:27:52.009837] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T21:27:52.444211] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:27:52.446394] [INFO ] [REMOTE ] TEAF: Full fetch complete (10223 records). [2025-10-28T21:27:52.446465] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-28T21:27:52.789992] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-28T21:27:52.804716] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-28T21:27:52.805026] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-28T21:27:52.805615] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-28T21:27:52.805784] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-28T21:27:52.806960] [DEBUG] [LOCAL ] TEAF: Trimmed 10223 records to 7221 (keeping 200 days of data) [2025-10-28T21:27:52.854196] [DEBUG] [LOCAL ] TEAF: Primary data saved (7221 records). [2025-10-28T21:27:52.854352] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-28T21:27:52.854439] [INFO ] [MAIN ] Update Progress: 2062/2366 symbols completed. TEAF took 33.2s. Estimated remaining: 39m 29s. Rate: 7.7 symbols/min [2025-10-28T21:27:53.024762] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:53.073988] [DEBUG] [LOCAL ] TEL: Loaded 51002 existing records from primary storage. [2025-10-28T21:27:53.074281] [INFO ] [MAIN ] TEL: Loaded 51002 existing records. [2025-10-28T21:27:53.247962] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:53.248150] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-28T21:27:53.248195] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-28T21:27:53.248808] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-28T21:27:53.248868] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-28T21:27:53.605394] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:53.599718] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-28T21:27:53.700276] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T21:27:54.380259] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-28T21:27:54.631804] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T21:27:55.180249] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-28T21:27:55.807584] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:27:55.980240] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-28T21:27:56.568250] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T21:27:56.580307] [INFO ] [REMOTE ] TECK: Full fetch complete (77533 records). [2025-10-28T21:27:56.580519] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-28T21:27:56.785466] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-28T21:27:57.004601] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-28T21:27:57.004756] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-28T21:27:57.006955] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-28T21:27:57.007026] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-28T21:27:57.009106] [DEBUG] [LOCAL ] TECK: Trimmed 77533 records to 53429 (keeping 200 days of data) [2025-10-28T21:27:57.410807] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T21:27:57.437705] [DEBUG] [LOCAL ] TECK: Primary data saved (53429 records). [2025-10-28T21:27:57.437915] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-28T21:27:57.438822] [INFO ] [MAIN ] Update Progress: 2063/2366 symbols completed. TECK took 31.7s. Estimated remaining: 39m 21s. Rate: 7.7 symbols/min [2025-10-28T21:27:57.585418] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-28T21:27:57.623343] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:27:57.656083] [DEBUG] [LOCAL ] TEN: Loaded 29787 existing records from primary storage. [2025-10-28T21:27:57.656417] [INFO ] [MAIN ] TEN: Loaded 29787 existing records. [2025-10-28T21:27:57.850056] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:27:57.850438] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-28T21:27:57.850527] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-28T21:27:57.851313] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-28T21:27:57.851374] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-28T21:27:58.036107] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T21:27:58.271983] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:27:58.380246] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-28T21:27:59.180260] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-28T21:27:59.253875] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T21:27:59.327694] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T21:27:59.980263] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-28T21:28:00.217390] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T21:28:00.780296] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-28T21:28:01.436580] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T21:28:01.580296] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-28T21:28:01.637338] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T21:28:02.380297] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-28T21:28:02.905391] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T21:28:03.180296] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-28T21:28:03.465244] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T21:28:03.473249] [INFO ] [REMOTE ] TEF: Full fetch complete (54217 records). [2025-10-28T21:28:03.473432] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-28T21:28:03.919523] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-28T21:28:03.919674] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-28T21:28:03.921302] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-28T21:28:03.921396] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-28T21:28:03.923218] [DEBUG] [LOCAL ] TEF: Trimmed 54217 records to 36416 (keeping 200 days of data) [2025-10-28T21:28:03.985363] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-28T21:28:04.153153] [DEBUG] [LOCAL ] TEF: Primary data saved (36416 records). [2025-10-28T21:28:04.153358] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-28T21:28:04.153495] [INFO ] [MAIN ] Update Progress: 2064/2366 symbols completed. TEF took 36.7s. Estimated remaining: 39m 13s. Rate: 7.7 symbols/min [2025-10-28T21:28:04.343443] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:04.367995] [DEBUG] [LOCAL ] TEO: Loaded 23080 existing records from primary storage. [2025-10-28T21:28:04.368683] [INFO ] [MAIN ] TEO: Loaded 23080 existing records. [2025-10-28T21:28:04.552280] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:04.552598] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-28T21:28:04.552675] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-28T21:28:04.552880] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-28T21:28:04.552922] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-28T21:28:04.755228] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T21:28:04.812774] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-28T21:28:04.972243] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:05.148470] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T21:28:05.580214] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-28T21:28:05.716833] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T21:28:05.721505] [INFO ] [REMOTE ] TEI: Full fetch complete (30797 records). [2025-10-28T21:28:05.721584] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-28T21:28:06.104865] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-28T21:28:06.104940] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-28T21:28:06.105667] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-28T21:28:06.105729] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-28T21:28:06.106458] [DEBUG] [LOCAL ] TEI: Trimmed 30797 records to 20993 (keeping 200 days of data) [2025-10-28T21:28:06.224122] [DEBUG] [LOCAL ] TEI: Primary data saved (20993 records). [2025-10-28T21:28:06.224244] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-28T21:28:06.224318] [INFO ] [MAIN ] Update Progress: 2065/2366 symbols completed. TEI took 30.7s. Estimated remaining: 39m 4s. Rate: 7.7 symbols/min [2025-10-28T21:28:06.389690] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-28T21:28:06.394688] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:06.451017] [DEBUG] [LOCAL ] TEVA: Loaded 53616 existing records from primary storage. [2025-10-28T21:28:06.451400] [INFO ] [MAIN ] TEVA: Loaded 53616 existing records. [2025-10-28T21:28:06.652748] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:06.653157] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-28T21:28:06.653256] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-28T21:28:06.653598] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-28T21:28:06.653713] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-28T21:28:06.801314] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T21:28:07.033683] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:07.180237] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-28T21:28:07.806594] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:28:07.980249] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-28T21:28:08.550635] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T21:28:08.780221] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-28T21:28:08.812585] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T21:28:09.580288] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-28T21:28:10.262980] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T21:28:10.380217] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-28T21:28:10.544214] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T21:28:11.180264] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-28T21:28:11.980317] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-28T21:28:12.126209] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-28T21:28:12.753380] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T21:28:12.765294] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T21:28:12.780202] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-28T21:28:13.580240] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-28T21:28:14.166184] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T21:28:14.380226] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-28T21:28:14.587505] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T21:28:15.180279] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-28T21:28:15.233132] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T21:28:15.980314] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-28T21:28:16.730579] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T21:28:16.780227] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-28T21:28:17.422117] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:28:17.433298] [INFO ] [REMOTE ] TEL: Full fetch complete (73901 records). [2025-10-28T21:28:17.433494] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-28T21:28:17.582030] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-28T21:28:17.861348] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:28:17.892295] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-28T21:28:17.892427] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-28T21:28:17.894233] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-28T21:28:17.894312] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-28T21:28:17.896426] [DEBUG] [LOCAL ] TEL: Trimmed 73901 records to 51000 (keeping 200 days of data) [2025-10-28T21:28:18.247676] [DEBUG] [LOCAL ] TEL: Primary data saved (51000 records). [2025-10-28T21:28:18.247933] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-28T21:28:18.248414] [INFO ] [MAIN ] Update Progress: 2066/2366 symbols completed. TEL took 25.4s. Estimated remaining: 38m 57s. Rate: 7.7 symbols/min [2025-10-28T21:28:18.385517] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-28T21:28:18.442217] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:18.502552] [DEBUG] [LOCAL ] TEX: Loaded 43349 existing records from primary storage. [2025-10-28T21:28:18.503053] [INFO ] [MAIN ] TEX: Loaded 43349 existing records. [2025-10-28T21:28:18.730122] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:18.730539] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-28T21:28:18.730729] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-28T21:28:18.731180] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-28T21:28:18.731292] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-28T21:28:18.840564] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:28:19.149898] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:19.180246] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-28T21:28:19.218790] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T21:28:19.980248] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-28T21:28:20.713534] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T21:28:20.780226] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-28T21:28:20.825254] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T21:28:21.580328] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-28T21:28:22.380304] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-28T21:28:22.417097] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T21:28:22.443053] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T21:28:22.448904] [INFO ] [REMOTE ] TEN: Full fetch complete (43784 records). [2025-10-28T21:28:22.449008] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-28T21:28:22.824827] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-28T21:28:22.824899] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-28T21:28:22.825754] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-28T21:28:22.825814] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-28T21:28:22.826864] [DEBUG] [LOCAL ] TEN: Trimmed 43784 records to 29647 (keeping 200 days of data) [2025-10-28T21:28:22.998775] [DEBUG] [LOCAL ] TEN: Primary data saved (29647 records). [2025-10-28T21:28:22.998876] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-28T21:28:22.998953] [INFO ] [MAIN ] Update Progress: 2067/2366 symbols completed. TEN took 25.6s. Estimated remaining: 38m 49s. Rate: 7.7 symbols/min [2025-10-28T21:28:23.169733] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:23.185670] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-28T21:28:23.188118] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T21:28:23.239948] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-28T21:28:23.240280] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-28T21:28:23.416448] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:23.416629] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-28T21:28:23.416712] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-28T21:28:23.417142] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-28T21:28:23.417202] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-28T21:28:23.755151] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:23.980243] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-28T21:28:24.505150] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T21:28:24.780270] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-28T21:28:25.446378] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T21:28:25.572135] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T21:28:25.582153] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-28T21:28:26.380263] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-28T21:28:27.181813] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-28T21:28:27.188233] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T21:28:27.814170] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T21:28:27.980280] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-28T21:28:28.319955] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:28:28.780316] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-28T21:28:29.407278] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:28:29.580244] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-28T21:28:29.998052] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T21:28:30.380258] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-28T21:28:30.956449] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T21:28:31.180240] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-28T21:28:31.877744] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T21:28:31.936596] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T21:28:31.980251] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-28T21:28:32.780254] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-28T21:28:33.580288] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-28T21:28:33.618060] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T21:28:34.160174] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T21:28:34.220292] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T21:28:34.380272] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-28T21:28:35.180283] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-28T21:28:35.218547] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T21:28:35.980388] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-28T21:28:36.547378] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T21:28:36.780366] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-28T21:28:37.239324] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:28:37.580294] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-28T21:28:37.637863] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T21:28:37.643728] [INFO ] [REMOTE ] TEO: Full fetch complete (33047 records). [2025-10-28T21:28:37.643861] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-28T21:28:38.016056] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-28T21:28:38.016153] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-28T21:28:38.016853] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-28T21:28:38.016918] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-28T21:28:38.017724] [DEBUG] [LOCAL ] TEO: Trimmed 33047 records to 23229 (keeping 200 days of data) [2025-10-28T21:28:38.145136] [DEBUG] [LOCAL ] TEO: Primary data saved (23229 records). [2025-10-28T21:28:38.145251] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-28T21:28:38.145329] [INFO ] [MAIN ] Update Progress: 2068/2366 symbols completed. TEO took 34.0s. Estimated remaining: 38m 42s. Rate: 7.7 symbols/min [2025-10-28T21:28:38.323179] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:38.352539] [DEBUG] [LOCAL ] TFII: Loaded 31877 existing records from primary storage. [2025-10-28T21:28:38.352829] [INFO ] [MAIN ] TFII: Loaded 31877 existing records. [2025-10-28T21:28:38.385365] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-28T21:28:38.535909] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:38.536171] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-28T21:28:38.536227] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-28T21:28:38.536478] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-28T21:28:38.536538] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-28T21:28:38.885353] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:39.055103] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T21:28:39.180239] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-28T21:28:39.989507] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-28T21:28:40.008591] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T21:28:40.019545] [INFO ] [REMOTE ] TEVA: Full fetch complete (77779 records). [2025-10-28T21:28:40.019691] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-28T21:28:40.404792] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-28T21:28:40.404927] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-28T21:28:40.406123] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-28T21:28:40.406184] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-28T21:28:40.407524] [DEBUG] [LOCAL ] TEVA: Trimmed 77779 records to 53616 (keeping 200 days of data) [2025-10-28T21:28:40.735190] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T21:28:40.764928] [DEBUG] [LOCAL ] TEVA: Primary data saved (53616 records). [2025-10-28T21:28:40.765034] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-28T21:28:40.765113] [INFO ] [MAIN ] Update Progress: 2069/2366 symbols completed. TEVA took 34.5s. Estimated remaining: 38m 34s. Rate: 7.7 symbols/min [2025-10-28T21:28:40.785386] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-28T21:28:40.947229] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:40.968417] [DEBUG] [LOCAL ] TFIN: Loaded 23283 existing records from primary storage. [2025-10-28T21:28:40.968679] [INFO ] [MAIN ] TFIN: Loaded 23283 existing records. [2025-10-28T21:28:41.150963] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:41.151197] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-28T21:28:41.151265] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-28T21:28:41.151457] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-28T21:28:41.151521] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-28T21:28:41.452966] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T21:28:41.548032] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:41.580232] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-28T21:28:42.356674] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T21:28:42.380219] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-28T21:28:42.680255] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T21:28:43.180252] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-28T21:28:43.751923] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T21:28:43.763313] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-28T21:28:43.763500] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-28T21:28:43.989007] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-28T21:28:44.153890] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-28T21:28:44.153971] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-28T21:28:44.155304] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-28T21:28:44.155370] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-28T21:28:44.156853] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 53667 (keeping 200 days of data) [2025-10-28T21:28:44.517087] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T21:28:44.533035] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-28T21:28:44.533612] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-28T21:28:44.533876] [INFO ] [MAIN ] Update Progress: 2070/2366 symbols completed. TFC took 21.5s. Estimated remaining: 38m 25s. Rate: 7.7 symbols/min [2025-10-28T21:28:44.699938] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:44.736363] [DEBUG] [LOCAL ] TFPM: Loaded 39904 existing records from primary storage. [2025-10-28T21:28:44.736632] [INFO ] [MAIN ] TFPM: Loaded 39904 existing records. [2025-10-28T21:28:44.789867] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-28T21:28:44.914941] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:44.915162] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-28T21:28:44.915210] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-28T21:28:44.915692] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-28T21:28:44.915763] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-28T21:28:45.239530] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T21:28:45.296246] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:45.530966] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T21:28:45.580242] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-28T21:28:46.380262] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-28T21:28:46.658189] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T21:28:47.180220] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-28T21:28:47.363474] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T21:28:47.980224] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-28T21:28:48.104731] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T21:28:48.656114] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T21:28:48.780229] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-28T21:28:49.580229] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-28T21:28:49.725355] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T21:28:50.380243] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-28T21:28:50.646045] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:28:51.180219] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-28T21:28:51.289566] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T21:28:51.980246] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-28T21:28:52.481251] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T21:28:52.780302] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-28T21:28:53.206093] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T21:28:53.580336] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-28T21:28:53.920544] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T21:28:54.380263] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-28T21:28:54.482938] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T21:28:55.180266] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-28T21:28:55.406730] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T21:28:55.980248] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-28T21:28:56.403729] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T21:28:56.780255] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-28T21:28:56.873288] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T21:28:57.580266] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-28T21:28:58.012944] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T21:28:58.021875] [INFO ] [REMOTE ] TEX: Full fetch complete (64450 records). [2025-10-28T21:28:58.022022] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-28T21:28:58.393001] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-28T21:28:58.413905] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-28T21:28:58.415250] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-28T21:28:58.416476] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-28T21:28:58.416870] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-28T21:28:58.436353] [DEBUG] [LOCAL ] TEX: Trimmed 64450 records to 43319 (keeping 200 days of data) [2025-10-28T21:28:58.436185] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T21:28:58.698994] [DEBUG] [LOCAL ] TEX: Primary data saved (43319 records). [2025-10-28T21:28:58.699123] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-28T21:28:58.699509] [INFO ] [MAIN ] Update Progress: 2071/2366 symbols completed. TEX took 40.5s. Estimated remaining: 38m 18s. Rate: 7.7 symbols/min [2025-10-28T21:28:58.872365] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:28:58.909941] [DEBUG] [LOCAL ] TFX: Loaded 35192 existing records from primary storage. [2025-10-28T21:28:58.910226] [INFO ] [MAIN ] TFX: Loaded 35192 existing records. [2025-10-28T21:28:59.099742] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:28:59.100683] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-28T21:28:59.100742] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-28T21:28:59.101460] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-28T21:28:59.101518] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-28T21:28:59.185403] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-28T21:28:59.513786] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:28:59.531155] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T21:28:59.970792] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T21:28:59.980198] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-28T21:29:00.780268] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-28T21:29:01.216708] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T21:29:01.580282] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-28T21:29:01.977990] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T21:29:02.380254] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-28T21:29:02.515259] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T21:29:03.180279] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-28T21:29:03.253282] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T21:29:03.980227] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-28T21:29:04.020836] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T21:29:04.780328] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-28T21:29:04.816210] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T21:29:05.580230] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-28T21:29:05.889128] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T21:29:06.142735] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T21:29:06.380277] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-28T21:29:07.180264] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-28T21:29:07.216949] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T21:29:07.223025] [INFO ] [REMOTE ] TFII: Full fetch complete (47933 records). [2025-10-28T21:29:07.223124] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-28T21:29:07.596344] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-28T21:29:07.596446] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-28T21:29:07.597492] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-28T21:29:07.597553] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-28T21:29:07.598612] [DEBUG] [LOCAL ] TFII: Trimmed 47933 records to 31672 (keeping 200 days of data) [2025-10-28T21:29:07.789659] [DEBUG] [LOCAL ] TFII: Primary data saved (31672 records). [2025-10-28T21:29:07.789802] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-28T21:29:07.789882] [INFO ] [MAIN ] Update Progress: 2072/2366 symbols completed. TFII took 29.6s. Estimated remaining: 38m 11s. Rate: 7.7 symbols/min [2025-10-28T21:29:07.959397] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:07.970863] [DEBUG] [LOCAL ] TG: Loaded 10529 existing records from primary storage. [2025-10-28T21:29:07.971079] [INFO ] [MAIN ] TG: Loaded 10529 existing records. [2025-10-28T21:29:07.985472] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-28T21:29:08.152421] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:08.152616] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-28T21:29:08.152694] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-28T21:29:08.152885] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-28T21:29:08.152941] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-28T21:29:08.513134] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:08.538255] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T21:29:08.780229] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-28T21:29:08.836285] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T21:29:08.841970] [INFO ] [REMOTE ] TFIN: Full fetch complete (32707 records). [2025-10-28T21:29:08.842091] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-28T21:29:09.266454] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-28T21:29:09.266554] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-28T21:29:09.267543] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-28T21:29:09.267608] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-28T21:29:09.268671] [DEBUG] [LOCAL ] TFIN: Trimmed 32707 records to 23203 (keeping 200 days of data) [2025-10-28T21:29:09.413007] [DEBUG] [LOCAL ] TFIN: Primary data saved (23203 records). [2025-10-28T21:29:09.413207] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-28T21:29:09.413326] [INFO ] [MAIN ] Update Progress: 2073/2366 symbols completed. TFIN took 28.6s. Estimated remaining: 38m 2s. Rate: 7.7 symbols/min [2025-10-28T21:29:09.585366] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:09.585485] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-28T21:29:09.586013] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-28T21:29:09.586386] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-28T21:29:09.587297] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-28T21:29:09.587355] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-28T21:29:09.587404] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-28T21:29:09.587440] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-28T21:29:09.964005] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:10.078440] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T21:29:10.380275] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-28T21:29:10.903426] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:29:11.180309] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-28T21:29:11.669019] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T21:29:11.980298] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-28T21:29:12.328620] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T21:29:12.780270] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-28T21:29:13.215900] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T21:29:13.580258] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-10-28T21:29:13.743394] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:29:13.743737] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-10-28T21:29:13.743830] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:29:13.743876] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-28T21:29:13.743912] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:29:13.743947] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-28T21:29:13.744001] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-28T21:29:13.744036] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-28T21:29:13.744082] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-28T21:29:13.744127] [INFO ] [MAIN ] Update Progress: 2074/2366 symbols completed. TGE took 4.3s. Estimated remaining: 37m 54s. Rate: 7.7 symbols/min [2025-10-28T21:29:13.918253] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:13.944246] [DEBUG] [LOCAL ] TGLS: Loaded 27281 existing records from primary storage. [2025-10-28T21:29:13.944501] [INFO ] [MAIN ] TGLS: Loaded 27281 existing records. [2025-10-28T21:29:14.086616] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T21:29:14.166041] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:14.166244] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-28T21:29:14.166296] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-28T21:29:14.166625] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-28T21:29:14.166723] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-28T21:29:14.385380] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-28T21:29:14.529069] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:15.180240] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-28T21:29:15.335606] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T21:29:15.980299] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-28T21:29:16.148162] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T21:29:16.484399] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T21:29:16.780320] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-28T21:29:17.281268] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T21:29:17.580270] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-28T21:29:18.380380] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-28T21:29:18.457268] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T21:29:18.919172] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T21:29:19.180295] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-28T21:29:19.980246] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-28T21:29:20.116324] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T21:29:20.780218] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-28T21:29:21.077341] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T21:29:21.580225] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-28T21:29:21.686280] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T21:29:22.380259] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-28T21:29:23.072306] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T21:29:23.081261] [INFO ] [REMOTE ] TFPM: Full fetch complete (53340 records). [2025-10-28T21:29:23.081404] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-28T21:29:23.180897] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-28T21:29:23.459545] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-28T21:29:23.459684] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-28T21:29:23.460732] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-28T21:29:23.460807] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-28T21:29:23.462280] [DEBUG] [LOCAL ] TFPM: Trimmed 53340 records to 39874 (keeping 200 days of data) [2025-10-28T21:29:23.701361] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T21:29:23.745309] [DEBUG] [LOCAL ] TFPM: Primary data saved (39874 records). [2025-10-28T21:29:23.746081] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-28T21:29:23.746184] [INFO ] [MAIN ] Update Progress: 2075/2366 symbols completed. TFPM took 39.2s. Estimated remaining: 37m 46s. Rate: 7.7 symbols/min [2025-10-28T21:29:23.909628] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:23.954219] [DEBUG] [LOCAL ] TGNA: Loaded 48284 existing records from primary storage. [2025-10-28T21:29:23.954513] [INFO ] [MAIN ] TGNA: Loaded 48284 existing records. [2025-10-28T21:29:23.990562] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-28T21:29:24.137120] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:24.137424] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-28T21:29:24.137499] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-28T21:29:24.138130] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-28T21:29:24.138191] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-28T21:29:24.259902] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T21:29:24.520700] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:24.780272] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-28T21:29:25.017719] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T21:29:25.580243] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-28T21:29:25.828350] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T21:29:26.380308] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-28T21:29:26.622244] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T21:29:26.629309] [INFO ] [REMOTE ] TFX: Full fetch complete (54479 records). [2025-10-28T21:29:26.629454] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-28T21:29:27.011623] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-28T21:29:27.011752] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-28T21:29:27.012838] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-28T21:29:27.012900] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-28T21:29:27.014142] [DEBUG] [LOCAL ] TFX: Trimmed 54479 records to 35051 (keeping 200 days of data) [2025-10-28T21:29:27.182620] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-28T21:29:27.234496] [DEBUG] [LOCAL ] TFX: Primary data saved (35051 records). [2025-10-28T21:29:27.234591] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-28T21:29:27.234964] [INFO ] [MAIN ] Update Progress: 2076/2366 symbols completed. TFX took 28.5s. Estimated remaining: 37m 38s. Rate: 7.7 symbols/min [2025-10-28T21:29:27.404442] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:27.437059] [DEBUG] [LOCAL ] TGS: Loaded 33920 existing records from primary storage. [2025-10-28T21:29:27.438106] [INFO ] [MAIN ] TGS: Loaded 33920 existing records. [2025-10-28T21:29:27.627069] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:27.627343] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-28T21:29:27.627450] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-28T21:29:27.627985] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-28T21:29:27.628187] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-28T21:29:27.836504] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T21:29:27.981262] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-28T21:29:28.042335] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:28.078267] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T21:29:28.780312] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-28T21:29:29.303074] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T21:29:29.580215] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-28T21:29:29.835593] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T21:29:30.380260] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-28T21:29:31.164127] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T21:29:31.180207] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-28T21:29:31.271453] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T21:29:31.980322] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-28T21:29:32.449598] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T21:29:32.780277] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-28T21:29:32.936210] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T21:29:33.580239] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-28T21:29:33.767388] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T21:29:34.171182] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T21:29:34.380251] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-28T21:29:35.180248] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-28T21:29:35.560444] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T21:29:35.980229] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-28T21:29:36.077599] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T21:29:36.780246] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-28T21:29:37.351268] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T21:29:37.559105] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T21:29:37.564497] [INFO ] [REMOTE ] TGLS: Full fetch complete (40461 records). [2025-10-28T21:29:37.564582] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-28T21:29:37.585355] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-28T21:29:37.940322] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-28T21:29:37.940395] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-28T21:29:37.941196] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-28T21:29:37.941255] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-28T21:29:37.942065] [DEBUG] [LOCAL ] TGLS: Trimmed 40461 records to 27228 (keeping 200 days of data) [2025-10-28T21:29:38.113043] [DEBUG] [LOCAL ] TGLS: Primary data saved (27228 records). [2025-10-28T21:29:38.113185] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-28T21:29:38.113353] [INFO ] [MAIN ] Update Progress: 2077/2366 symbols completed. TGLS took 24.4s. Estimated remaining: 37m 31s. Rate: 7.7 symbols/min [2025-10-28T21:29:38.380302] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-28T21:29:38.873235] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T21:29:39.144733] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T21:29:39.180223] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-28T21:29:39.980295] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-28T21:29:40.398016] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T21:29:40.457063] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T21:29:40.780321] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-28T21:29:41.580258] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-28T21:29:42.215998] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:29:42.225363] [INFO ] [REMOTE ] TGNA: Full fetch complete (69898 records). [2025-10-28T21:29:42.225490] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-28T21:29:42.385387] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-28T21:29:42.649141] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-28T21:29:42.649270] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-28T21:29:42.650518] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-28T21:29:42.650602] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-28T21:29:42.669823] [DEBUG] [LOCAL ] TGNA: Trimmed 69898 records to 48233 (keeping 200 days of data) [2025-10-28T21:29:42.670558] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T21:29:42.901621] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T21:29:42.974815] [DEBUG] [LOCAL ] TGNA: Primary data saved (48233 records). [2025-10-28T21:29:42.974958] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-28T21:29:42.975520] [INFO ] [MAIN ] Update Progress: 2078/2366 symbols completed. TGNA took 19.2s. Estimated remaining: 37m 22s. Rate: 7.7 symbols/min [2025-10-28T21:29:43.180283] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-28T21:29:43.755280] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T21:29:43.980308] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-28T21:29:44.780228] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-28T21:29:44.989448] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T21:29:45.197804] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T21:29:45.580252] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-28T21:29:46.182170] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T21:29:46.185176] [INFO ] [REMOTE ] TG: Full fetch complete (15088 records). [2025-10-28T21:29:46.185250] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-28T21:29:46.397376] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-28T21:29:46.550372] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-28T21:29:46.550443] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-28T21:29:46.550798] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-28T21:29:46.550859] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-28T21:29:46.551385] [DEBUG] [LOCAL ] TG: Trimmed 15088 records to 10498 (keeping 200 days of data) [2025-10-28T21:29:46.609393] [DEBUG] [LOCAL ] TG: Primary data saved (10498 records). [2025-10-28T21:29:46.609523] [INFO ] [MAIN ] TG: Full history saved. [2025-10-28T21:29:46.609619] [INFO ] [MAIN ] Update Progress: 2079/2366 symbols completed. TG took 38.8s. Estimated remaining: 37m 14s. Rate: 7.7 symbols/min [2025-10-28T21:29:47.307945] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T21:29:47.314967] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-28T21:29:48.163697] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T21:29:48.171559] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-28T21:29:49.079223] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T21:29:49.086405] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-28T21:29:50.091389] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:29:50.098676] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-28T21:29:51.275569] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T21:29:51.285362] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-28T21:29:52.396055] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T21:29:52.403978] [INFO ] [REMOTE ] TGS: Full fetch complete (48818 records). [2025-10-28T21:29:52.404104] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-28T21:29:52.771563] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-28T21:29:52.771638] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-28T21:29:52.772609] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-28T21:29:52.772684] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-28T21:29:52.773738] [DEBUG] [LOCAL ] TGS: Trimmed 48818 records to 34021 (keeping 200 days of data) [2025-10-28T21:29:52.964186] [DEBUG] [LOCAL ] TGS: Primary data saved (34021 records). [2025-10-28T21:29:52.964308] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-28T21:29:52.964384] [INFO ] [MAIN ] Update Progress: 2080/2366 symbols completed. TGS took 25.7s. Estimated remaining: 37m 6s. Rate: 7.7 symbols/min [2025-10-28T21:29:53.599099] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:53.597891] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:53.594515] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:53.679155] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:29:53.681390] [DEBUG] [LOCAL ] THIR: Loaded 2469 existing records from primary storage. [2025-10-28T21:29:53.683096] [INFO ] [MAIN ] THIR: Loaded 2469 existing records. [2025-10-28T21:29:53.882141] [DEBUG] [LOCAL ] THG: Loaded 21171 existing records from primary storage. [2025-10-28T21:29:53.924695] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:53.925000] [INFO ] [MAIN ] THG: Loaded 21171 existing records. [2025-10-28T21:29:53.938994] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-28T21:29:53.939325] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-28T21:29:53.953944] [DEBUG] [LOCAL ] THC: Loaded 46584 existing records from primary storage. [2025-10-28T21:29:53.974441] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-28T21:29:53.983531] [INFO ] [MAIN ] THC: Loaded 46584 existing records. [2025-10-28T21:29:53.993968] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-28T21:29:53.999851] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-28T21:29:54.084017] [INFO ] [MAIN ] TGT: Loaded 53777 existing records. [2025-10-28T21:29:54.474561] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:54.521389] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-28T21:29:54.526817] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-28T21:29:54.576808] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-28T21:29:54.566123] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:54.576978] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-28T21:29:54.608018] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-28T21:29:54.661217] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-28T21:29:54.750766] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-28T21:29:54.762703] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:29:54.785047] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-28T21:29:54.831250] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-28T21:29:54.850720] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-28T21:29:54.935626] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-28T21:29:54.940939] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-28T21:29:55.439577] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:55.504843] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-28T21:29:55.849392] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:55.855028] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-28T21:29:55.993117] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:56.024408] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-28T21:29:56.063406] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:29:56.064189] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-28T21:29:56.063867] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T21:29:56.067305] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-28T21:29:56.299951] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T21:29:56.301400] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-28T21:29:56.575521] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T21:29:56.576609] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-28T21:29:56.602332] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T21:29:56.780274] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-28T21:29:56.854781] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T21:29:57.363136] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:29:57.580215] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-28T21:29:57.730365] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T21:29:57.825036] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T21:29:57.872990] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T21:29:58.380267] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-28T21:29:59.180304] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-28T21:29:59.454271] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-28T21:29:59.821431] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T21:29:59.980270] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-28T21:30:00.302876] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T21:30:00.780263] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-28T21:30:01.580257] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-28T21:30:01.922472] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T21:30:02.380296] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-28T21:30:03.180303] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-28T21:30:03.551314] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-28T21:30:03.634846] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T21:30:03.687408] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T21:30:03.980301] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-28T21:30:04.780249] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-28T21:30:05.323782] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T21:30:05.580224] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-28T21:30:06.380251] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-28T21:30:06.440520] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T21:30:06.912017] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T21:30:07.180266] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-28T21:30:07.450899] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T21:30:07.980276] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-28T21:30:08.314279] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-28T21:30:08.780247] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-28T21:30:09.176799] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T21:30:09.178387] [INFO ] [REMOTE ] THIR: Full fetch complete (3017 records). [2025-10-28T21:30:09.178473] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-28T21:30:09.514848] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-28T21:30:09.585020] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-28T21:30:09.609562] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-28T21:30:09.609678] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-28T21:30:09.609819] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-28T21:30:09.609893] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-28T21:30:09.610250] [DEBUG] [LOCAL ] THIR: Trimmed 3017 records to 2483 (keeping 200 days of data) [2025-10-28T21:30:09.624955] [DEBUG] [LOCAL ] THIR: Primary data saved (2483 records). [2025-10-28T21:30:09.625019] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-28T21:30:09.625111] [INFO ] [MAIN ] Update Progress: 2081/2366 symbols completed. THIR took 16.7s. Estimated remaining: 36m 60s. Rate: 7.7 symbols/min [2025-10-28T21:30:09.801956] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:09.805537] [DEBUG] [LOCAL ] THLV: Loaded 1464 existing records from primary storage. [2025-10-28T21:30:09.805697] [INFO ] [MAIN ] THLV: Loaded 1464 existing records. [2025-10-28T21:30:09.980195] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:30:09.980470] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-28T21:30:09.980518] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-28T21:30:09.980687] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-28T21:30:09.980744] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-28T21:30:10.348755] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:10.380249] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-28T21:30:10.826589] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T21:30:11.180300] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-28T21:30:11.664190] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T21:30:11.980269] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-28T21:30:12.780228] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-28T21:30:13.072610] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T21:30:13.333424] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (3.75 seconds). [2025-10-28T21:30:13.580247] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-28T21:30:14.172394] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-28T21:30:14.380290] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-28T21:30:15.165149] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T21:30:15.180201] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-28T21:30:15.980244] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-28T21:30:16.381085] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-28T21:30:16.583161] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T21:30:16.780289] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-28T21:30:17.394918] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T21:30:17.580244] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-28T21:30:18.380217] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-28T21:30:18.430092] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T21:30:18.473788] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T21:30:19.180318] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-28T21:30:19.914528] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T21:30:19.980317] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-28T21:30:20.723096] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T21:30:20.780233] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-28T21:30:20.822743] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T21:30:21.153076] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T21:30:21.580248] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-28T21:30:21.886748] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T21:30:22.380256] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-28T21:30:23.180277] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-28T21:30:23.839711] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T21:30:23.985320] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-28T21:30:24.002188] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T21:30:24.012796] [INFO ] [REMOTE ] TGT: Full fetch complete (77955 records). [2025-10-28T21:30:24.012898] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-28T21:30:24.413830] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-28T21:30:24.413935] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-28T21:30:24.415172] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-28T21:30:24.415238] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-28T21:30:24.416862] [DEBUG] [LOCAL ] TGT: Trimmed 77955 records to 53777 (keeping 200 days of data) [2025-10-28T21:30:24.756866] [DEBUG] [LOCAL ] TGT: Primary data saved (53777 records). [2025-10-28T21:30:24.756987] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-28T21:30:24.757060] [INFO ] [MAIN ] Update Progress: 2082/2366 symbols completed. TGT took 31.8s. Estimated remaining: 36m 53s. Rate: 7.7 symbols/min [2025-10-28T21:30:24.785429] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-28T21:30:24.954140] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:24.995731] [DEBUG] [LOCAL ] THO: Loaded 40610 existing records from primary storage. [2025-10-28T21:30:24.996020] [INFO ] [MAIN ] THO: Loaded 40610 existing records. [2025-10-28T21:30:25.193434] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:30:25.193699] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-28T21:30:25.193777] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-28T21:30:25.194450] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-28T21:30:25.194513] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-28T21:30:25.573763] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:25.580206] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-28T21:30:25.655394] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T21:30:25.701415] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T21:30:25.706129] [INFO ] [REMOTE ] THG: Full fetch complete (31544 records). [2025-10-28T21:30:25.706242] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-28T21:30:26.064996] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-28T21:30:26.065072] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-28T21:30:26.065720] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-28T21:30:26.065783] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-28T21:30:26.066467] [DEBUG] [LOCAL ] THG: Trimmed 31544 records to 21094 (keeping 200 days of data) [2025-10-28T21:30:26.196066] [DEBUG] [LOCAL ] THG: Primary data saved (21094 records). [2025-10-28T21:30:26.196201] [INFO ] [MAIN ] THG: Full history saved. [2025-10-28T21:30:26.196278] [INFO ] [MAIN ] Update Progress: 2083/2366 symbols completed. THG took 33.2s. Estimated remaining: 36m 44s. Rate: 7.7 symbols/min [2025-10-28T21:30:26.360775] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:26.384491] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-28T21:30:26.385087] [DEBUG] [LOCAL ] THQ: Loaded 25164 existing records from primary storage. [2025-10-28T21:30:26.386299] [INFO ] [MAIN ] THQ: Loaded 25164 existing records. [2025-10-28T21:30:26.566961] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:30:26.567367] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-28T21:30:26.567438] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-28T21:30:26.567855] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-28T21:30:26.567913] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-28T21:30:26.679518] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T21:30:26.768725] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:30:26.955344] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:27.180216] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-28T21:30:27.980227] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-28T21:30:28.086933] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T21:30:28.206181] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T21:30:28.780286] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-28T21:30:29.056356] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T21:30:29.580238] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-28T21:30:30.380421] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-28T21:30:30.612321] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T21:30:30.758157] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T21:30:31.180248] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-28T21:30:31.887952] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T21:30:31.980214] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-28T21:30:32.250890] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-28T21:30:32.251993] [INFO ] [REMOTE ] THLV: Full fetch complete (2497 records). [2025-10-28T21:30:32.252078] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-28T21:30:32.730965] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-28T21:30:32.731086] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-28T21:30:32.731256] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-28T21:30:32.731307] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-28T21:30:32.731836] [DEBUG] [LOCAL ] THLV: Trimmed 2497 records to 1454 (keeping 200 days of data) [2025-10-28T21:30:32.741942] [DEBUG] [LOCAL ] THLV: Primary data saved (1454 records). [2025-10-28T21:30:32.742077] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-28T21:30:32.742184] [INFO ] [MAIN ] Update Progress: 2084/2366 symbols completed. THLV took 23.1s. Estimated remaining: 36m 36s. Rate: 7.7 symbols/min [2025-10-28T21:30:32.789742] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-28T21:30:33.012456] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:33.035314] [DEBUG] [LOCAL ] THR: Loaded 19280 existing records from primary storage. [2025-10-28T21:30:33.035682] [INFO ] [MAIN ] THR: Loaded 19280 existing records. [2025-10-28T21:30:33.292136] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:30:33.292432] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-28T21:30:33.292490] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-28T21:30:33.292787] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-28T21:30:33.292846] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-28T21:30:33.580815] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-28T21:30:33.705236] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T21:30:33.773515] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:34.380313] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-28T21:30:34.820417] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T21:30:35.180243] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-28T21:30:35.732187] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T21:30:35.980261] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-28T21:30:36.013553] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T21:30:36.022253] [INFO ] [REMOTE ] THC: Full fetch complete (68636 records). [2025-10-28T21:30:36.022386] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-28T21:30:36.408356] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-28T21:30:36.408442] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-28T21:30:36.409983] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-28T21:30:36.410063] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-28T21:30:36.411490] [DEBUG] [LOCAL ] THC: Trimmed 68636 records to 46597 (keeping 200 days of data) [2025-10-28T21:30:36.701301] [DEBUG] [LOCAL ] THC: Primary data saved (46597 records). [2025-10-28T21:30:36.701470] [INFO ] [MAIN ] THC: Full history saved. [2025-10-28T21:30:36.701580] [INFO ] [MAIN ] Update Progress: 2085/2366 symbols completed. THC took 43.7s. Estimated remaining: 36m 28s. Rate: 7.7 symbols/min [2025-10-28T21:30:36.790323] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-28T21:30:36.871603] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:36.908959] [DEBUG] [LOCAL ] THS: Loaded 38419 existing records from primary storage. [2025-10-28T21:30:36.909260] [INFO ] [MAIN ] THS: Loaded 38419 existing records. [2025-10-28T21:30:37.081455] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:30:37.081736] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-28T21:30:37.081791] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-28T21:30:37.082116] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-28T21:30:37.082188] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-28T21:30:37.433226] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:37.580243] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-28T21:30:37.758098] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T21:30:38.078309] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-28T21:30:38.380232] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-28T21:30:38.455000] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T21:30:39.170119] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T21:30:39.180221] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-28T21:30:39.980243] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-28T21:30:40.127105] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T21:30:40.780278] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-28T21:30:41.327348] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:30:41.580239] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-28T21:30:41.844995] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T21:30:42.380281] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-28T21:30:42.753282] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T21:30:43.158192] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T21:30:43.180294] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-28T21:30:43.980258] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-28T21:30:44.161311] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T21:30:44.780257] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-28T21:30:45.063254] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T21:30:45.435080] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T21:30:45.580280] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-28T21:30:46.385782] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-28T21:30:46.387538] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T21:30:47.180239] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-28T21:30:47.355816] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T21:30:47.980225] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-28T21:30:48.161897] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T21:30:48.674111] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T21:30:48.780277] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-28T21:30:49.409698] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T21:30:49.580247] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-28T21:30:50.380283] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-28T21:30:50.628337] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T21:30:51.180262] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-28T21:30:51.284500] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:30:51.980232] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-28T21:30:52.181274] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:30:52.780237] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-28T21:30:52.951291] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T21:30:53.580245] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-28T21:30:53.878990] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T21:30:54.223581] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T21:30:54.380245] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-28T21:30:55.134191] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T21:30:55.180249] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-28T21:30:55.922250] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T21:30:55.927220] [INFO ] [REMOTE ] THQ: Full fetch complete (34600 records). [2025-10-28T21:30:55.927311] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-28T21:30:55.990681] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-28T21:30:56.333240] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-28T21:30:56.333313] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-28T21:30:56.334017] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-28T21:30:56.334077] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-28T21:30:56.334848] [DEBUG] [LOCAL ] THQ: Trimmed 34600 records to 25194 (keeping 200 days of data) [2025-10-28T21:30:56.481394] [DEBUG] [LOCAL ] THQ: Primary data saved (25194 records). [2025-10-28T21:30:56.481512] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-28T21:30:56.481588] [INFO ] [MAIN ] Update Progress: 2086/2366 symbols completed. THQ took 30.3s. Estimated remaining: 36m 22s. Rate: 7.7 symbols/min [2025-10-28T21:30:56.666728] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:56.688133] [DEBUG] [LOCAL ] THW: Loaded 19443 existing records from primary storage. [2025-10-28T21:30:56.688528] [INFO ] [MAIN ] THW: Loaded 19443 existing records. [2025-10-28T21:30:56.787304] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-28T21:30:56.870617] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:30:56.870929] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-28T21:30:56.870988] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-28T21:30:56.871529] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-28T21:30:56.871585] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-28T21:30:57.219951] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:57.293123] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T21:30:57.580231] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-28T21:30:57.595158] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T21:30:57.599216] [INFO ] [REMOTE ] THR: Full fetch complete (28789 records). [2025-10-28T21:30:57.599289] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-28T21:30:57.974760] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-28T21:30:57.974843] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-28T21:30:57.975482] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-28T21:30:57.975522] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-28T21:30:57.976415] [DEBUG] [LOCAL ] THR: Trimmed 28789 records to 19219 (keeping 200 days of data) [2025-10-28T21:30:58.085285] [DEBUG] [LOCAL ] THR: Primary data saved (19219 records). [2025-10-28T21:30:58.085418] [INFO ] [MAIN ] THR: Full history saved. [2025-10-28T21:30:58.085495] [INFO ] [MAIN ] Update Progress: 2087/2366 symbols completed. THR took 25.3s. Estimated remaining: 36m 13s. Rate: 7.7 symbols/min [2025-10-28T21:30:58.254695] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:30:58.254883] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-28T21:30:58.254921] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-28T21:30:58.255033] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-28T21:30:58.255074] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-28T21:30:58.255116] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-28T21:30:58.255148] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-28T21:30:58.385322] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-28T21:30:58.648382] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:30:58.670315] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T21:30:59.180221] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-28T21:30:59.218910] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T21:30:59.980245] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-28T21:31:00.422388] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T21:31:00.780280] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-10-28T21:31:00.931452] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:31:00.931736] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-10-28T21:31:00.931823] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:31:00.931875] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-28T21:31:00.931934] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:31:00.932020] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-28T21:31:00.932092] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-28T21:31:00.932129] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-28T21:31:00.932169] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-28T21:31:00.932212] [INFO ] [MAIN ] Update Progress: 2088/2366 symbols completed. TIC took 2.8s. Estimated remaining: 36m 5s. Rate: 7.7 symbols/min [2025-10-28T21:31:01.064118] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:31:01.136217] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:01.168778] [DEBUG] [LOCAL ] TIMB: Loaded 34400 existing records from primary storage. [2025-10-28T21:31:01.169065] [INFO ] [MAIN ] TIMB: Loaded 34400 existing records. [2025-10-28T21:31:01.344484] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:01.344737] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-28T21:31:01.344792] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-28T21:31:01.345063] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-28T21:31:01.345102] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-28T21:31:01.585352] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-28T21:31:01.719200] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:02.334436] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T21:31:02.380297] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-28T21:31:03.180283] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-28T21:31:03.445614] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T21:31:03.980237] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-28T21:31:04.309484] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T21:31:04.780250] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-28T21:31:04.804255] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T21:31:05.580256] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-28T21:31:05.965878] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:31:06.380234] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-28T21:31:06.761191] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:31:07.180257] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-28T21:31:07.311072] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T21:31:07.980292] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-28T21:31:08.742640] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T21:31:08.749573] [INFO ] [REMOTE ] THO: Full fetch complete (59947 records). [2025-10-28T21:31:08.749731] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-28T21:31:08.785424] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-28T21:31:09.154285] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-28T21:31:09.154395] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-28T21:31:09.155488] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-28T21:31:09.155573] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-28T21:31:09.157396] [DEBUG] [LOCAL ] THO: Trimmed 59947 records to 40379 (keeping 200 days of data) [2025-10-28T21:31:09.249021] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:31:09.447335] [DEBUG] [LOCAL ] THO: Primary data saved (40379 records). [2025-10-28T21:31:09.447476] [INFO ] [MAIN ] THO: Full history saved. [2025-10-28T21:31:09.447572] [INFO ] [MAIN ] Update Progress: 2089/2366 symbols completed. THO took 44.7s. Estimated remaining: 35m 57s. Rate: 7.7 symbols/min [2025-10-28T21:31:09.589385] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-28T21:31:09.622687] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:09.635434] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T21:31:09.643957] [DEBUG] [LOCAL ] TISI: Loaded 3125 existing records from primary storage. [2025-10-28T21:31:09.644167] [INFO ] [MAIN ] TISI: Loaded 3125 existing records. [2025-10-28T21:31:09.824862] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:09.825081] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-28T21:31:09.825131] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-28T21:31:09.825280] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-28T21:31:09.825339] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-28T21:31:10.181616] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:10.380305] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-28T21:31:10.721259] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T21:31:10.840826] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T21:31:11.180318] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-28T21:31:11.980258] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-28T21:31:12.061163] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T21:31:12.780317] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-28T21:31:12.881862] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T21:31:13.580295] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-28T21:31:13.946003] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:31:13.953593] [INFO ] [REMOTE ] THS: Full fetch complete (54554 records). [2025-10-28T21:31:13.953745] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-28T21:31:14.332276] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-28T21:31:14.332370] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-28T21:31:14.333500] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-28T21:31:14.333575] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-28T21:31:14.334746] [DEBUG] [LOCAL ] THS: Trimmed 54554 records to 38319 (keeping 200 days of data) [2025-10-28T21:31:14.381050] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-28T21:31:14.450114] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T21:31:14.575436] [DEBUG] [LOCAL ] THS: Primary data saved (38319 records). [2025-10-28T21:31:14.575559] [INFO ] [MAIN ] THS: Full history saved. [2025-10-28T21:31:14.575636] [INFO ] [MAIN ] Update Progress: 2090/2366 symbols completed. THS took 37.9s. Estimated remaining: 35m 49s. Rate: 7.7 symbols/min [2025-10-28T21:31:14.740165] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:15.180311] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-28T21:31:15.418440] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T21:31:15.524037] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T21:31:15.565412] [DEBUG] [LOCAL ] TIXT: Loaded 32397 existing records from primary storage. [2025-10-28T21:31:15.565719] [INFO ] [MAIN ] TIXT: Loaded 32397 existing records. [2025-10-28T21:31:15.738278] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:15.738508] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-28T21:31:15.738557] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-28T21:31:15.738831] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-28T21:31:15.738887] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-28T21:31:15.985499] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-28T21:31:16.098611] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:16.459295] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T21:31:16.780255] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-28T21:31:17.580234] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-28T21:31:17.657194] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T21:31:18.367769] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T21:31:18.380222] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-28T21:31:19.023987] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T21:31:19.180248] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-28T21:31:19.908798] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T21:31:19.913238] [INFO ] [REMOTE ] THW: Full fetch complete (28733 records). [2025-10-28T21:31:19.913397] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-28T21:31:19.985455] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-28T21:31:20.451766] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-28T21:31:20.451908] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-28T21:31:20.453464] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-28T21:31:20.453557] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-28T21:31:20.454786] [DEBUG] [LOCAL ] THW: Trimmed 28733 records to 19494 (keeping 200 days of data) [2025-10-28T21:31:20.638427] [DEBUG] [LOCAL ] THW: Primary data saved (19494 records). [2025-10-28T21:31:20.638605] [INFO ] [MAIN ] THW: Full history saved. [2025-10-28T21:31:20.638740] [INFO ] [MAIN ] Update Progress: 2091/2366 symbols completed. THW took 24.2s. Estimated remaining: 35m 41s. Rate: 7.7 symbols/min [2025-10-28T21:31:20.785457] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-28T21:31:20.891890] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:20.947866] [DEBUG] [LOCAL ] TJX: Loaded 53660 existing records from primary storage. [2025-10-28T21:31:20.948203] [INFO ] [MAIN ] TJX: Loaded 53660 existing records. [2025-10-28T21:31:21.150622] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:21.150931] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-28T21:31:21.150984] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-28T21:31:21.151190] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-28T21:31:21.151245] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-28T21:31:21.502336] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:21.580208] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-28T21:31:21.651010] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T21:31:21.947234] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T21:31:22.380306] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-28T21:31:22.910185] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T21:31:22.978834] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:31:23.180256] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-28T21:31:23.665538] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T21:31:23.980259] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-28T21:31:24.343201] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T21:31:24.780306] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-28T21:31:25.086032] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T21:31:25.580284] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-28T21:31:25.879089] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T21:31:26.380316] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-28T21:31:26.698948] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T21:31:27.180261] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-28T21:31:27.546390] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-28T21:31:27.547611] [INFO ] [REMOTE ] TISI: Full fetch complete (4964 records). [2025-10-28T21:31:27.547713] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-28T21:31:27.921727] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-28T21:31:27.921810] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-28T21:31:27.921980] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-28T21:31:27.922056] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-28T21:31:27.922500] [DEBUG] [LOCAL ] TISI: Trimmed 4964 records to 3108 (keeping 200 days of data) [2025-10-28T21:31:27.941182] [DEBUG] [LOCAL ] TISI: Primary data saved (3108 records). [2025-10-28T21:31:27.941306] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-28T21:31:27.941388] [INFO ] [MAIN ] Update Progress: 2092/2366 symbols completed. TISI took 18.5s. Estimated remaining: 35m 33s. Rate: 7.7 symbols/min [2025-10-28T21:31:27.985434] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-28T21:31:28.138274] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:28.175826] [DEBUG] [LOCAL ] TK: Loaded 38751 existing records from primary storage. [2025-10-28T21:31:28.176160] [INFO ] [MAIN ] TK: Loaded 38751 existing records. [2025-10-28T21:31:28.360463] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:28.360722] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-28T21:31:28.360781] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-28T21:31:28.361179] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-28T21:31:28.361247] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-28T21:31:28.720959] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:28.783593] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-28T21:31:28.787492] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T21:31:29.580299] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-28T21:31:29.798738] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T21:31:30.336800] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T21:31:30.380273] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-28T21:31:31.088419] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T21:31:31.180261] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-28T21:31:31.980293] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-28T21:31:32.303558] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T21:31:32.780228] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-28T21:31:32.906035] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T21:31:33.580284] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-28T21:31:33.693748] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T21:31:34.380255] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-28T21:31:34.678485] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T21:31:35.180343] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-28T21:31:35.635055] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T21:31:35.980291] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-28T21:31:36.073636] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T21:31:36.080123] [INFO ] [REMOTE ] TIMB: Full fetch complete (52902 records). [2025-10-28T21:31:36.080277] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-28T21:31:36.480891] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-28T21:31:36.480976] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-28T21:31:36.481971] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-28T21:31:36.482036] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-28T21:31:36.483170] [DEBUG] [LOCAL ] TIMB: Trimmed 52902 records to 34324 (keeping 200 days of data) [2025-10-28T21:31:36.691312] [DEBUG] [LOCAL ] TIMB: Primary data saved (34324 records). [2025-10-28T21:31:36.691452] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-28T21:31:36.691534] [INFO ] [MAIN ] Update Progress: 2093/2366 symbols completed. TIMB took 35.8s. Estimated remaining: 35m 25s. Rate: 7.7 symbols/min [2025-10-28T21:31:36.785454] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-28T21:31:36.888330] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:36.928895] [DEBUG] [LOCAL ] TKC: Loaded 40047 existing records from primary storage. [2025-10-28T21:31:36.929193] [INFO ] [MAIN ] TKC: Loaded 40047 existing records. [2025-10-28T21:31:37.123446] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:37.123835] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-28T21:31:37.123906] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-28T21:31:37.124277] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-28T21:31:37.124336] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-28T21:31:37.266246] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T21:31:37.555010] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:37.580246] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-28T21:31:37.730541] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T21:31:38.380252] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-28T21:31:38.534141] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T21:31:39.180276] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-28T21:31:39.980235] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-28T21:31:40.028034] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T21:31:40.154588] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T21:31:40.780248] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-28T21:31:41.257945] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T21:31:41.580249] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-28T21:31:42.338169] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T21:31:42.380288] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-28T21:31:42.630895] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T21:31:43.180267] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-28T21:31:43.400775] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T21:31:43.980261] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-28T21:31:44.687449] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T21:31:44.780249] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-28T21:31:45.076976] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T21:31:45.580256] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-28T21:31:46.380235] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-28T21:31:46.526553] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T21:31:46.721603] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T21:31:47.180313] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-28T21:31:47.483366] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T21:31:47.980276] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-28T21:31:48.173028] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T21:31:48.780250] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-28T21:31:49.028177] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T21:31:49.580319] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-28T21:31:49.706782] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T21:31:50.380252] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-28T21:31:50.795706] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T21:31:51.180264] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-28T21:31:51.422342] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T21:31:51.980257] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-28T21:31:52.150338] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T21:31:52.159068] [INFO ] [REMOTE ] TK: Full fetch complete (56168 records). [2025-10-28T21:31:52.159267] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-28T21:31:52.557470] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-28T21:31:52.557583] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-28T21:31:52.559517] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-28T21:31:52.559587] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-28T21:31:52.561219] [DEBUG] [LOCAL ] TK: Trimmed 56168 records to 38646 (keeping 200 days of data) [2025-10-28T21:31:52.795712] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-28T21:31:52.806494] [DEBUG] [LOCAL ] TK: Primary data saved (38646 records). [2025-10-28T21:31:52.807636] [INFO ] [MAIN ] TK: Full history saved. [2025-10-28T21:31:52.807785] [INFO ] [MAIN ] Update Progress: 2094/2366 symbols completed. TK took 24.9s. Estimated remaining: 35m 19s. Rate: 7.7 symbols/min [2025-10-28T21:31:52.983492] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:52.983821] [DEBUG] [LOCAL ] TKO: No existing data file found in primary storage. [2025-10-28T21:31:52.983877] [WARN ] [MAIN ] TKO: No existing data found, performing full refresh instead. [2025-10-28T21:31:52.983995] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-28T21:31:52.984036] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-28T21:31:52.984078] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-10-28T21:31:52.984111] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-28T21:31:53.371903] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:53.451095] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T21:31:53.580262] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-28T21:31:53.951949] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T21:31:54.380248] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-28T21:31:54.723250] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T21:31:55.180239] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-28T21:31:55.393302] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T21:31:55.399931] [INFO ] [REMOTE ] TIXT: Full fetch complete (45588 records). [2025-10-28T21:31:55.400012] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-28T21:31:55.769957] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-28T21:31:55.770072] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-28T21:31:55.771000] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-28T21:31:55.771061] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-28T21:31:55.772120] [DEBUG] [LOCAL ] TIXT: Trimmed 45588 records to 32240 (keeping 200 days of data) [2025-10-28T21:31:55.942582] [DEBUG] [LOCAL ] TIXT: Primary data saved (32240 records). [2025-10-28T21:31:55.942729] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-28T21:31:55.942811] [INFO ] [MAIN ] Update Progress: 2095/2366 symbols completed. TIXT took 41.4s. Estimated remaining: 35m 10s. Rate: 7.7 symbols/min [2025-10-28T21:31:55.986764] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-28T21:31:56.114803] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:31:56.149710] [DEBUG] [LOCAL ] TKR: Loaded 38886 existing records from primary storage. [2025-10-28T21:31:56.149997] [INFO ] [MAIN ] TKR: Loaded 38886 existing records. [2025-10-28T21:31:56.329017] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:31:56.329301] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-28T21:31:56.329404] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-28T21:31:56.329888] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-28T21:31:56.329962] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-28T21:31:56.485638] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T21:31:56.778259] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:31:56.780231] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-28T21:31:57.580310] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-28T21:31:57.912827] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-28T21:31:58.353443] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T21:31:58.380207] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-28T21:31:58.838235] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T21:31:59.180280] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-28T21:31:59.807295] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T21:31:59.980237] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-28T21:32:00.207342] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T21:32:00.780239] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-28T21:32:01.531473] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T21:32:01.580225] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-28T21:32:01.886877] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T21:32:02.380285] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-28T21:32:03.060959] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T21:32:03.071858] [INFO ] [REMOTE ] TJX: Full fetch complete (77830 records). [2025-10-28T21:32:03.071987] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-28T21:32:03.185353] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-28T21:32:03.463209] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-28T21:32:03.463301] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-28T21:32:03.464513] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-28T21:32:03.464578] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-28T21:32:03.466078] [DEBUG] [LOCAL ] TJX: Trimmed 77830 records to 53660 (keeping 200 days of data) [2025-10-28T21:32:03.808370] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T21:32:03.843265] [DEBUG] [LOCAL ] TJX: Primary data saved (53660 records). [2025-10-28T21:32:03.843380] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-28T21:32:03.843468] [INFO ] [MAIN ] Update Progress: 2096/2366 symbols completed. TJX took 43.2s. Estimated remaining: 35m 2s. Rate: 7.7 symbols/min [2025-10-28T21:32:03.988724] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-28T21:32:04.014552] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:04.051313] [DEBUG] [LOCAL ] TLK: Loaded 38557 existing records from primary storage. [2025-10-28T21:32:04.051577] [INFO ] [MAIN ] TLK: Loaded 38557 existing records. [2025-10-28T21:32:04.225706] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:04.226020] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-28T21:32:04.226087] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-28T21:32:04.226397] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-28T21:32:04.226466] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-28T21:32:04.593672] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:04.625953] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:32:04.780281] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-28T21:32:04.984698] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T21:32:05.580262] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-28T21:32:06.017375] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:32:06.380309] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-28T21:32:06.539982] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T21:32:07.180321] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-28T21:32:07.980348] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-28T21:32:08.091183] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T21:32:08.553685] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T21:32:08.780327] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-28T21:32:08.950598] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T21:32:09.580270] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-28T21:32:10.048120] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T21:32:10.380348] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-28T21:32:10.635240] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T21:32:11.180303] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-28T21:32:11.423150] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T21:32:11.980302] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-28T21:32:12.353827] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:32:12.364238] [INFO ] [REMOTE ] TKC: Full fetch complete (54880 records). [2025-10-28T21:32:12.364474] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-28T21:32:12.782514] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-28T21:32:12.782285] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-28T21:32:12.783697] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-28T21:32:12.784954] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-28T21:32:12.785090] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-28T21:32:12.786485] [DEBUG] [LOCAL ] TKC: Trimmed 54880 records to 40031 (keeping 200 days of data) [2025-10-28T21:32:13.050194] [DEBUG] [LOCAL ] TKC: Primary data saved (40031 records). [2025-10-28T21:32:13.050316] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-28T21:32:13.050703] [INFO ] [MAIN ] Update Progress: 2097/2366 symbols completed. TKC took 36.4s. Estimated remaining: 34m 55s. Rate: 7.7 symbols/min [2025-10-28T21:32:13.253263] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:13.255510] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T21:32:13.281025] [DEBUG] [LOCAL ] TLYS: Loaded 16493 existing records from primary storage. [2025-10-28T21:32:13.281256] [INFO ] [MAIN ] TLYS: Loaded 16493 existing records. [2025-10-28T21:32:13.464907] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:13.465084] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-28T21:32:13.465134] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-28T21:32:13.465291] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-28T21:32:13.465332] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-28T21:32:13.585325] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-28T21:32:13.826790] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:13.864115] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T21:32:14.380257] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-28T21:32:14.854587] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:32:15.180302] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-28T21:32:15.660025] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T21:32:15.980293] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-28T21:32:16.375391] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T21:32:16.780312] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-28T21:32:17.483095] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T21:32:17.580269] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-28T21:32:17.850291] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T21:32:17.858483] [INFO ] [REMOTE ] TKR: Full fetch complete (57796 records). [2025-10-28T21:32:17.858691] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-28T21:32:18.180244] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T21:32:18.304307] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-28T21:32:18.304421] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-28T21:32:18.305776] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-28T21:32:18.305839] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-28T21:32:18.307571] [DEBUG] [LOCAL ] TKR: Trimmed 57796 records to 38881 (keeping 200 days of data) [2025-10-28T21:32:18.395115] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-28T21:32:18.537982] [DEBUG] [LOCAL ] TKR: Primary data saved (38881 records). [2025-10-28T21:32:18.538108] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-28T21:32:18.538182] [INFO ] [MAIN ] Update Progress: 2098/2366 symbols completed. TKR took 22.6s. Estimated remaining: 34m 47s. Rate: 7.7 symbols/min [2025-10-28T21:32:18.708008] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:18.743091] [DEBUG] [LOCAL ] TM: Loaded 35626 existing records from primary storage. [2025-10-28T21:32:18.743405] [INFO ] [MAIN ] TM: Loaded 35626 existing records. [2025-10-28T21:32:18.920777] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:18.920962] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-28T21:32:18.921009] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-28T21:32:18.921329] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-28T21:32:18.921385] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-28T21:32:19.197248] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-28T21:32:19.256214] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:32:19.341255] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:19.980257] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-28T21:32:20.397963] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T21:32:20.445470] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T21:32:20.780269] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-28T21:32:21.580220] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-28T21:32:21.788705] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T21:32:22.380311] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-28T21:32:22.813585] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T21:32:23.180261] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-28T21:32:23.644893] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T21:32:23.655338] [INFO ] [REMOTE ] TKO: Full fetch complete (65569 records). [2025-10-28T21:32:23.655462] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-28T21:32:23.882330] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T21:32:23.985594] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-28T21:32:24.142327] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-28T21:32:24.142426] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-28T21:32:24.144750] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-28T21:32:24.144828] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-28T21:32:24.146536] [DEBUG] [LOCAL ] TKO: Trimmed 65569 records to 43297 (keeping 200 days of data) [2025-10-28T21:32:24.463581] [DEBUG] [LOCAL ] TKO: Primary data saved (43297 records). [2025-10-28T21:32:24.463730] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-28T21:32:24.463828] [INFO ] [MAIN ] Update Progress: 2099/2366 symbols completed. TKO took 31.7s. Estimated remaining: 34m 39s. Rate: 7.7 symbols/min [2025-10-28T21:32:24.637355] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:24.685130] [DEBUG] [LOCAL ] TME: Loaded 53188 existing records from primary storage. [2025-10-28T21:32:24.685450] [INFO ] [MAIN ] TME: Loaded 53188 existing records. [2025-10-28T21:32:24.785423] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-28T21:32:24.872968] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:24.873200] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-28T21:32:24.873253] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-28T21:32:24.874615] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-28T21:32:24.874706] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-28T21:32:25.228097] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:25.246207] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T21:32:25.580243] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-28T21:32:25.828462] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T21:32:26.134765] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T21:32:26.380284] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-28T21:32:27.180305] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-28T21:32:27.565994] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T21:32:27.923749] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T21:32:27.980342] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-28T21:32:28.780321] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-28T21:32:28.834386] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T21:32:29.580288] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-28T21:32:29.866886] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T21:32:30.380258] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-28T21:32:31.057879] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:32:31.137894] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T21:32:31.180248] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-28T21:32:31.980260] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-28T21:32:32.380030] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T21:32:32.532228] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T21:32:32.780284] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-28T21:32:33.515777] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T21:32:33.580242] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-28T21:32:34.037732] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:32:34.040586] [INFO ] [REMOTE ] TLYS: Full fetch complete (21091 records). [2025-10-28T21:32:34.040699] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-28T21:32:34.385445] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-28T21:32:34.430946] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-28T21:32:34.431031] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-28T21:32:34.431539] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-28T21:32:34.431600] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-28T21:32:34.432214] [DEBUG] [LOCAL ] TLYS: Trimmed 21091 records to 16473 (keeping 200 days of data) [2025-10-28T21:32:34.530478] [DEBUG] [LOCAL ] TLYS: Primary data saved (16473 records). [2025-10-28T21:32:34.530617] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-28T21:32:34.530734] [INFO ] [MAIN ] Update Progress: 2100/2366 symbols completed. TLYS took 21.5s. Estimated remaining: 34m 31s. Rate: 7.7 symbols/min [2025-10-28T21:32:34.708232] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:34.748840] [DEBUG] [LOCAL ] TMHC: Loaded 45655 existing records from primary storage. [2025-10-28T21:32:34.749157] [INFO ] [MAIN ] TMHC: Loaded 45655 existing records. [2025-10-28T21:32:34.935142] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:34.935382] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-28T21:32:34.935429] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-28T21:32:34.936326] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-28T21:32:34.936384] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-28T21:32:35.186049] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-28T21:32:35.302518] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:35.779874] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T21:32:35.980299] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-28T21:32:36.484700] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:32:36.780312] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-28T21:32:37.154612] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T21:32:37.580277] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-28T21:32:38.300433] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T21:32:38.380260] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-28T21:32:38.681346] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:32:39.180312] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-28T21:32:39.414423] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T21:32:39.980226] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-28T21:32:40.363018] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:32:40.780225] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-28T21:32:41.284847] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T21:32:41.580271] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-28T21:32:42.229488] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T21:32:42.380230] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-28T21:32:42.729970] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T21:32:42.738310] [INFO ] [REMOTE ] TLK: Full fetch complete (57649 records). [2025-10-28T21:32:42.738471] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-28T21:32:43.131745] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-28T21:32:43.131828] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-28T21:32:43.132832] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-28T21:32:43.132891] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-28T21:32:43.134021] [DEBUG] [LOCAL ] TLK: Trimmed 57649 records to 38522 (keeping 200 days of data) [2025-10-28T21:32:43.182944] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-28T21:32:43.368329] [DEBUG] [LOCAL ] TLK: Primary data saved (38522 records). [2025-10-28T21:32:43.368701] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-28T21:32:43.368797] [INFO ] [MAIN ] Update Progress: 2101/2366 symbols completed. TLK took 39.5s. Estimated remaining: 34m 24s. Rate: 7.7 symbols/min [2025-10-28T21:32:43.548259] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:43.565506] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T21:32:43.621372] [DEBUG] [LOCAL ] TMO: Loaded 52347 existing records from primary storage. [2025-10-28T21:32:43.621681] [INFO ] [MAIN ] TMO: Loaded 52347 existing records. [2025-10-28T21:32:43.800514] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:43.800803] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-28T21:32:43.800851] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-28T21:32:43.801496] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-28T21:32:43.801553] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-28T21:32:43.990569] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-28T21:32:44.189116] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:44.665346] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T21:32:44.780234] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-28T21:32:45.289917] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T21:32:45.580257] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-28T21:32:45.796961] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:32:46.380277] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-28T21:32:47.180236] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-28T21:32:47.399797] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-28T21:32:47.871685] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T21:32:47.980244] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-28T21:32:48.244871] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T21:32:48.780264] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-28T21:32:49.359269] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T21:32:49.580260] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-28T21:32:49.878214] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T21:32:49.884991] [INFO ] [REMOTE ] TM: Full fetch complete (51649 records). [2025-10-28T21:32:49.885149] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-28T21:32:50.282713] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-28T21:32:50.282793] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-28T21:32:50.283746] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-28T21:32:50.283805] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-28T21:32:50.284810] [DEBUG] [LOCAL ] TM: Trimmed 51649 records to 35490 (keeping 200 days of data) [2025-10-28T21:32:50.380247] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-28T21:32:50.512873] [DEBUG] [LOCAL ] TM: Primary data saved (35490 records). [2025-10-28T21:32:50.513009] [INFO ] [MAIN ] TM: Full history saved. [2025-10-28T21:32:50.513099] [INFO ] [MAIN ] Update Progress: 2102/2366 symbols completed. TM took 32.0s. Estimated remaining: 34m 16s. Rate: 7.7 symbols/min [2025-10-28T21:32:50.677618] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:32:50.691987] [DEBUG] [LOCAL ] TNC: Loaded 13730 existing records from primary storage. [2025-10-28T21:32:50.692194] [INFO ] [MAIN ] TNC: Loaded 13730 existing records. [2025-10-28T21:32:50.872419] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:32:50.872736] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-28T21:32:50.872792] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-28T21:32:50.872991] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-28T21:32:50.873031] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-28T21:32:51.191321] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-28T21:32:51.233098] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:32:51.261023] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T21:32:51.626839] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T21:32:51.980263] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-28T21:32:52.432377] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T21:32:52.671434] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T21:32:52.780276] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-28T21:32:53.477404] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T21:32:53.580287] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-28T21:32:54.350109] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T21:32:54.380255] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-28T21:32:55.179148] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T21:32:55.183750] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-28T21:32:55.980309] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-28T21:32:56.395991] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T21:32:56.780295] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-28T21:32:57.328460] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T21:32:57.580319] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-28T21:32:58.220382] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T21:32:58.301885] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T21:32:58.380229] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-28T21:32:59.045366] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T21:32:59.180276] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-28T21:32:59.844097] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T21:32:59.980271] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-28T21:33:00.780287] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-28T21:33:01.526404] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T21:33:01.532593] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T21:33:01.580263] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-28T21:33:02.167002] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T21:33:02.380304] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-28T21:33:02.939572] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T21:33:02.942086] [INFO ] [REMOTE ] TNC: Full fetch complete (21968 records). [2025-10-28T21:33:02.942156] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-28T21:33:03.185418] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-28T21:33:03.298852] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-28T21:33:03.298932] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-28T21:33:03.299392] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-28T21:33:03.299429] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-28T21:33:03.300003] [DEBUG] [LOCAL ] TNC: Trimmed 21968 records to 13618 (keeping 200 days of data) [2025-10-28T21:33:03.381970] [DEBUG] [LOCAL ] TNC: Primary data saved (13618 records). [2025-10-28T21:33:03.382095] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-28T21:33:03.382172] [INFO ] [MAIN ] Update Progress: 2103/2366 symbols completed. TNC took 12.9s. Estimated remaining: 34m 9s. Rate: 7.7 symbols/min [2025-10-28T21:33:03.547133] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:03.575616] [DEBUG] [LOCAL ] TNET: Loaded 28018 existing records from primary storage. [2025-10-28T21:33:03.575934] [INFO ] [MAIN ] TNET: Loaded 28018 existing records. [2025-10-28T21:33:03.769133] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:03.769362] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-28T21:33:03.769409] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-28T21:33:03.769734] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-28T21:33:03.769798] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-28T21:33:03.985469] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-28T21:33:04.193096] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:04.732581] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T21:33:04.780299] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-28T21:33:05.580260] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-28T21:33:06.024931] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-28T21:33:06.252104] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T21:33:06.380272] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-28T21:33:06.977604] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T21:33:07.180282] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-28T21:33:07.846218] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T21:33:07.856998] [INFO ] [REMOTE ] TME: Full fetch complete (77169 records). [2025-10-28T21:33:07.857120] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-28T21:33:07.982002] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-28T21:33:08.226929] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T21:33:08.298493] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-28T21:33:08.298571] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-28T21:33:08.299767] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-28T21:33:08.299832] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-28T21:33:08.301233] [DEBUG] [LOCAL ] TME: Trimmed 77169 records to 53187 (keeping 200 days of data) [2025-10-28T21:33:08.618098] [DEBUG] [LOCAL ] TME: Primary data saved (53187 records). [2025-10-28T21:33:08.618251] [INFO ] [MAIN ] TME: Full history saved. [2025-10-28T21:33:08.618334] [INFO ] [MAIN ] Update Progress: 2104/2366 symbols completed. TME took 44.2s. Estimated remaining: 34m 0s. Rate: 7.7 symbols/min [2025-10-28T21:33:08.785358] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:08.785461] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-28T21:33:08.785864] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-28T21:33:08.786852] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-28T21:33:08.786982] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-28T21:33:08.787026] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-28T21:33:08.787069] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-28T21:33:08.787102] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-28T21:33:09.141054] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:09.489326] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T21:33:09.580308] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-28T21:33:10.080074] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T21:33:10.089948] [INFO ] [REMOTE ] TMHC: Full fetch complete (66871 records). [2025-10-28T21:33:10.090078] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-28T21:33:10.385347] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-28T21:33:10.491025] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-28T21:33:10.491171] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-28T21:33:10.492519] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-28T21:33:10.492722] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-28T21:33:10.494310] [DEBUG] [LOCAL ] TMHC: Trimmed 66871 records to 45679 (keeping 200 days of data) [2025-10-28T21:33:10.599471] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T21:33:10.780483] [DEBUG] [LOCAL ] TMHC: Primary data saved (45679 records). [2025-10-28T21:33:10.780626] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-28T21:33:10.780978] [INFO ] [MAIN ] Update Progress: 2105/2366 symbols completed. TMHC took 36.3s. Estimated remaining: 33m 52s. Rate: 7.7 symbols/min [2025-10-28T21:33:10.951036] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:10.985636] [DEBUG] [LOCAL ] TNK: Loaded 35154 existing records from primary storage. [2025-10-28T21:33:10.985928] [INFO ] [MAIN ] TNK: Loaded 35154 existing records. [2025-10-28T21:33:11.164189] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:11.164408] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-28T21:33:11.164456] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-28T21:33:11.164781] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-28T21:33:11.164839] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-28T21:33:11.185468] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-10-28T21:33:11.437222] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:33:11.448159] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-10-28T21:33:11.448308] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:33:11.448376] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-28T21:33:11.448526] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:33:11.448872] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-28T21:33:11.464519] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-28T21:33:11.489156] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-28T21:33:11.504906] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-28T21:33:11.536473] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:11.532747] [INFO ] [MAIN ] Update Progress: 2106/2366 symbols completed. TNGY took 2.9s. Estimated remaining: 33m 43s. Rate: 7.7 symbols/min [2025-10-28T21:33:11.708153] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:11.747452] [DEBUG] [LOCAL ] TNL: Loaded 41603 existing records from primary storage. [2025-10-28T21:33:11.747751] [INFO ] [MAIN ] TNL: Loaded 41603 existing records. [2025-10-28T21:33:11.940767] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:11.941038] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-28T21:33:11.941124] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-28T21:33:11.941418] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-28T21:33:11.941531] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-28T21:33:11.986044] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-28T21:33:12.316711] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:12.348418] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T21:33:12.780271] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-28T21:33:13.107248] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T21:33:13.580310] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-28T21:33:13.860533] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T21:33:14.380217] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-28T21:33:14.578697] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T21:33:15.180298] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-28T21:33:15.443872] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T21:33:15.980314] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-28T21:33:16.028262] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T21:33:16.780254] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-28T21:33:17.510790] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T21:33:17.580227] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-28T21:33:17.804225] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T21:33:18.380263] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-28T21:33:19.118467] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T21:33:19.180279] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-28T21:33:19.401532] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T21:33:19.980232] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-28T21:33:20.106956] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T21:33:20.117247] [INFO ] [REMOTE ] TMO: Full fetch complete (75700 records). [2025-10-28T21:33:20.117357] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-28T21:33:20.514873] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-28T21:33:20.514955] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-28T21:33:20.516115] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-28T21:33:20.516175] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-28T21:33:20.517747] [DEBUG] [LOCAL ] TMO: Trimmed 75700 records to 52298 (keeping 200 days of data) [2025-10-28T21:33:20.794189] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-28T21:33:20.840893] [DEBUG] [LOCAL ] TMO: Primary data saved (52298 records). [2025-10-28T21:33:20.841026] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-28T21:33:20.841108] [INFO ] [MAIN ] Update Progress: 2107/2366 symbols completed. TMO took 37.5s. Estimated remaining: 33m 36s. Rate: 7.7 symbols/min [2025-10-28T21:33:21.006162] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:21.054744] [DEBUG] [LOCAL ] TOL: Loaded 50340 existing records from primary storage. [2025-10-28T21:33:21.055028] [INFO ] [MAIN ] TOL: Loaded 50340 existing records. [2025-10-28T21:33:21.232771] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:21.233167] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-28T21:33:21.233271] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-28T21:33:21.233561] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-28T21:33:21.233685] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-28T21:33:21.510881] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T21:33:21.586688] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-28T21:33:21.627553] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:22.202251] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T21:33:22.380252] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-28T21:33:22.652504] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T21:33:23.180257] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-28T21:33:23.459290] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:33:23.980237] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-28T21:33:24.080519] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T21:33:24.780294] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-28T21:33:25.532779] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T21:33:25.580266] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-28T21:33:25.814837] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-28T21:33:26.380232] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-28T21:33:27.013945] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:33:27.180254] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-28T21:33:27.602273] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:33:27.980282] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-28T21:33:28.303749] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T21:33:28.780232] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-28T21:33:28.930729] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T21:33:29.580256] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-28T21:33:29.674087] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T21:33:30.380247] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-28T21:33:30.501621] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T21:33:31.180274] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-28T21:33:31.402883] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:33:31.980695] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T21:33:31.980773] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-28T21:33:31.987845] [INFO ] [REMOTE ] TNET: Full fetch complete (42013 records). [2025-10-28T21:33:31.987957] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-28T21:33:32.411195] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-28T21:33:32.411284] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-28T21:33:32.412337] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-28T21:33:32.412406] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-28T21:33:32.413490] [DEBUG] [LOCAL ] TNET: Trimmed 42013 records to 28070 (keeping 200 days of data) [2025-10-28T21:33:32.583870] [DEBUG] [LOCAL ] TNET: Primary data saved (28070 records). [2025-10-28T21:33:32.583999] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-28T21:33:32.584076] [INFO ] [MAIN ] Update Progress: 2108/2366 symbols completed. TNET took 29.2s. Estimated remaining: 33m 28s. Rate: 7.7 symbols/min [2025-10-28T21:33:32.754282] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:32.754448] [DEBUG] [LOCAL ] TOST: No existing data file found in primary storage. [2025-10-28T21:33:32.754485] [WARN ] [MAIN ] TOST: No existing data found, performing full refresh instead. [2025-10-28T21:33:32.754598] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-28T21:33:32.754660] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-28T21:33:32.754731] [DEBUG] [LOCAL ] TOST: No primary data file found to delete. [2025-10-28T21:33:32.754767] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-28T21:33:32.786141] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-28T21:33:33.122124] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:33.143310] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T21:33:33.150529] [INFO ] [REMOTE ] TNK: Full fetch complete (51746 records). [2025-10-28T21:33:33.150753] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-28T21:33:33.538382] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-28T21:33:33.538459] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-28T21:33:33.539423] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-28T21:33:33.539483] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-28T21:33:33.540533] [DEBUG] [LOCAL ] TNK: Trimmed 51746 records to 35047 (keeping 200 days of data) [2025-10-28T21:33:33.592387] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-28T21:33:33.752483] [DEBUG] [LOCAL ] TNK: Primary data saved (35047 records). [2025-10-28T21:33:33.752623] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-28T21:33:33.752966] [INFO ] [MAIN ] Update Progress: 2109/2366 symbols completed. TNK took 23.0s. Estimated remaining: 33m 20s. Rate: 7.7 symbols/min [2025-10-28T21:33:33.921397] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:33.947928] [DEBUG] [LOCAL ] TPB: Loaded 26157 existing records from primary storage. [2025-10-28T21:33:33.948179] [INFO ] [MAIN ] TPB: Loaded 26157 existing records. [2025-10-28T21:33:34.128171] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:34.128416] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-28T21:33:34.128603] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-28T21:33:34.128894] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-28T21:33:34.128954] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-28T21:33:34.386818] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-28T21:33:34.465754] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T21:33:34.534188] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:34.910072] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T21:33:35.180263] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-28T21:33:35.723977] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:33:35.746604] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T21:33:35.980313] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-28T21:33:36.780311] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-28T21:33:37.350348] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T21:33:37.580295] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-28T21:33:38.233259] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T21:33:38.380232] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-28T21:33:39.065921] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T21:33:39.180224] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-28T21:33:39.592791] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:33:39.980294] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-28T21:33:40.552966] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T21:33:40.704415] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T21:33:40.780274] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-28T21:33:41.580289] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-28T21:33:41.608264] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T21:33:42.380268] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-28T21:33:42.940713] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T21:33:43.180280] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-28T21:33:43.761102] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T21:33:43.980283] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-28T21:33:44.078977] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T21:33:44.780258] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-28T21:33:45.034824] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T21:33:45.580244] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-28T21:33:46.327123] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T21:33:46.380251] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-28T21:33:46.480621] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T21:33:47.135858] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T21:33:47.180206] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-28T21:33:47.980215] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-28T21:33:48.081788] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T21:33:48.780251] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-28T21:33:49.580213] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-28T21:33:49.995549] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-28T21:33:50.359004] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T21:33:50.380210] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-28T21:33:50.592316] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T21:33:51.180343] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-28T21:33:51.825776] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T21:33:51.981479] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-28T21:33:51.987307] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T21:33:52.780339] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-28T21:33:53.580267] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-28T21:33:53.996909] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-28T21:33:54.040180] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:33:54.380252] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-28T21:33:55.175852] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T21:33:55.185585] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-28T21:33:55.832139] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T21:33:55.840776] [INFO ] [REMOTE ] TNL: Full fetch complete (59823 records). [2025-10-28T21:33:55.840918] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-28T21:33:55.987344] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-28T21:33:56.258349] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-28T21:33:56.260838] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-28T21:33:56.262767] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-28T21:33:56.263810] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-28T21:33:56.263710] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T21:33:56.271805] [INFO ] [REMOTE ] TPB: Full fetch complete (36204 records). [2025-10-28T21:33:56.272089] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-28T21:33:56.272512] [DEBUG] [LOCAL ] TNL: Trimmed 59823 records to 41528 (keeping 200 days of data) [2025-10-28T21:33:56.789673] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-28T21:33:56.820769] [DEBUG] [LOCAL ] TNL: Primary data saved (41528 records). [2025-10-28T21:33:56.821962] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-28T21:33:56.828352] [INFO ] [MAIN ] Update Progress: 2110/2366 symbols completed. TNL took 45.3s. Estimated remaining: 33m 14s. Rate: 7.7 symbols/min [2025-10-28T21:33:57.075493] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-28T21:33:57.082053] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-28T21:33:57.107682] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-28T21:33:57.107792] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-28T21:33:57.109270] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:57.110920] [DEBUG] [LOCAL ] TPB: Trimmed 36204 records to 26133 (keeping 200 days of data) [2025-10-28T21:33:57.302489] [DEBUG] [LOCAL ] TPB: Primary data saved (26133 records). [2025-10-28T21:33:57.302792] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-28T21:33:57.303004] [INFO ] [MAIN ] Update Progress: 2111/2366 symbols completed. TPB took 23.5s. Estimated remaining: 33m 5s. Rate: 7.7 symbols/min [2025-10-28T21:33:57.412616] [DEBUG] [LOCAL ] TPC: Loaded 38966 existing records from primary storage. [2025-10-28T21:33:57.429801] [INFO ] [MAIN ] TPC: Loaded 38966 existing records. [2025-10-28T21:33:57.639528] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:57.701418] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:57.701968] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-28T21:33:57.702059] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-28T21:33:57.702552] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-28T21:33:57.702619] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-28T21:33:57.895521] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-28T21:33:57.986094] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-28T21:33:57.994084] [DEBUG] [LOCAL ] TPH: Loaded 44729 existing records from primary storage. [2025-10-28T21:33:58.023779] [INFO ] [MAIN ] TPH: Loaded 44729 existing records. [2025-10-28T21:33:58.281540] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:58.366248] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:58.366636] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-28T21:33:58.366749] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-28T21:33:58.367120] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-28T21:33:58.367193] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-28T21:33:58.387855] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-28T21:33:58.643939] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T21:33:58.687871] [INFO ] [REMOTE ] TOL: Full fetch complete (73585 records). [2025-10-28T21:33:58.690174] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-28T21:33:58.875422] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:33:59.166662] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-28T21:33:59.166762] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-28T21:33:59.168350] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-28T21:33:59.168411] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-28T21:33:59.170089] [DEBUG] [LOCAL ] TOL: Trimmed 73585 records to 50278 (keeping 200 days of data) [2025-10-28T21:33:59.224689] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-28T21:33:59.506237] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T21:33:59.521746] [DEBUG] [LOCAL ] TOL: Primary data saved (50278 records). [2025-10-28T21:33:59.521900] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-28T21:33:59.521989] [INFO ] [MAIN ] Update Progress: 2112/2366 symbols completed. TOL took 38.7s. Estimated remaining: 32m 57s. Rate: 7.7 symbols/min [2025-10-28T21:33:59.690557] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:33:59.726444] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T21:33:59.742600] [DEBUG] [LOCAL ] TPL: Loaded 11859 existing records from primary storage. [2025-10-28T21:33:59.743105] [INFO ] [MAIN ] TPL: Loaded 11859 existing records. [2025-10-28T21:33:59.915855] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:33:59.916068] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-28T21:33:59.916119] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-28T21:33:59.916294] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-28T21:33:59.916370] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-28T21:33:59.988724] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-28T21:34:00.278280] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:00.305272] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T21:34:00.780272] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-28T21:34:01.272380] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T21:34:01.580303] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-28T21:34:02.053360] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T21:34:02.380272] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-28T21:34:03.054100] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T21:34:03.108477] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T21:34:03.180214] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-28T21:34:03.915612] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T21:34:03.980270] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-28T21:34:04.780272] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-28T21:34:05.375011] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T21:34:05.412000] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T21:34:05.580262] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-28T21:34:06.380270] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-28T21:34:07.040563] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T21:34:07.053004] [INFO ] [REMOTE ] TOST: Full fetch complete (77849 records). [2025-10-28T21:34:07.053247] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-28T21:34:07.185422] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-28T21:34:07.515598] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-28T21:34:07.515768] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-28T21:34:07.518330] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-28T21:34:07.518484] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-28T21:34:07.520839] [DEBUG] [LOCAL ] TOST: Trimmed 77849 records to 53686 (keeping 200 days of data) [2025-10-28T21:34:08.004720] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-28T21:34:08.008117] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T21:34:08.106867] [DEBUG] [LOCAL ] TOST: Primary data saved (53686 records). [2025-10-28T21:34:08.107060] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-28T21:34:08.107171] [INFO ] [MAIN ] Update Progress: 2113/2366 symbols completed. TOST took 35.5s. Estimated remaining: 32m 49s. Rate: 7.7 symbols/min [2025-10-28T21:34:08.346091] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:08.380436] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T21:34:08.456927] [DEBUG] [LOCAL ] TPR: Loaded 53347 existing records from primary storage. [2025-10-28T21:34:08.457281] [INFO ] [MAIN ] TPR: Loaded 53347 existing records. [2025-10-28T21:34:08.639338] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:08.639820] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-28T21:34:08.639879] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-28T21:34:08.640377] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-28T21:34:08.640435] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-28T21:34:08.784544] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-28T21:34:09.026779] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:09.029671] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T21:34:09.580297] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-28T21:34:10.045214] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:34:10.380298] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-28T21:34:10.901752] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T21:34:11.180266] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-28T21:34:11.836941] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T21:34:11.980236] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-28T21:34:12.294251] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T21:34:12.780249] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-28T21:34:12.872845] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T21:34:13.580325] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-28T21:34:13.840444] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T21:34:14.380246] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-28T21:34:14.933000] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T21:34:15.180251] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-28T21:34:15.505930] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:34:15.980247] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-28T21:34:16.565791] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T21:34:16.780270] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-28T21:34:16.947201] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T21:34:17.580272] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-28T21:34:17.899143] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T21:34:18.285896] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T21:34:18.380238] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-28T21:34:19.040715] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T21:34:19.180330] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-28T21:34:19.980271] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-28T21:34:20.748793] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T21:34:20.780251] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-28T21:34:21.396268] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T21:34:21.580256] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-28T21:34:21.799419] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:34:21.819180] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T21:34:22.380267] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-28T21:34:23.180254] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-28T21:34:23.743422] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:34:23.980268] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-28T21:34:24.191504] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T21:34:24.780239] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-28T21:34:25.184932] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T21:34:25.192241] [INFO ] [REMOTE ] TPC: Full fetch complete (55474 records). [2025-10-28T21:34:25.192345] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-28T21:34:25.536771] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T21:34:25.586076] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-28T21:34:25.586199] [INFO ] [REMOTE ] TPL: Full fetch complete (17366 records). [2025-10-28T21:34:25.605179] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-28T21:34:25.605310] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-28T21:34:25.605424] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-28T21:34:25.607742] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-28T21:34:25.608002] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-28T21:34:25.714440] [DEBUG] [LOCAL ] TPC: Trimmed 55474 records to 38915 (keeping 200 days of data) [2025-10-28T21:34:26.188697] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-28T21:34:26.190203] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-28T21:34:26.201153] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-28T21:34:26.201254] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-28T21:34:26.213858] [DEBUG] [LOCAL ] TPC: Primary data saved (38915 records). [2025-10-28T21:34:26.214054] [DEBUG] [LOCAL ] TPL: Trimmed 17366 records to 11820 (keeping 200 days of data) [2025-10-28T21:34:26.214145] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-28T21:34:26.214373] [INFO ] [MAIN ] Update Progress: 2114/2366 symbols completed. TPC took 29.4s. Estimated remaining: 32m 43s. Rate: 7.7 symbols/min [2025-10-28T21:34:26.392897] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-28T21:34:26.473594] [DEBUG] [LOCAL ] TPL: Primary data saved (11820 records). [2025-10-28T21:34:26.473732] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-28T21:34:26.469638] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:26.473860] [INFO ] [MAIN ] Update Progress: 2115/2366 symbols completed. TPL took 27.0s. Estimated remaining: 32m 34s. Rate: 7.7 symbols/min [2025-10-28T21:34:26.654145] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:26.663789] [DEBUG] [LOCAL ] TPVG: Loaded 26721 existing records from primary storage. [2025-10-28T21:34:26.664333] [INFO ] [MAIN ] TPVG: Loaded 26721 existing records. [2025-10-28T21:34:26.827186] [DEBUG] [LOCAL ] TPYP: Loaded 7719 existing records from primary storage. [2025-10-28T21:34:26.858038] [INFO ] [MAIN ] TPYP: Loaded 7719 existing records. [2025-10-28T21:34:26.857738] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:26.926380] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-28T21:34:26.949509] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-28T21:34:26.962501] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-28T21:34:26.973754] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-28T21:34:27.113119] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:27.122635] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-28T21:34:27.136979] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-28T21:34:27.150060] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-28T21:34:27.173756] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-28T21:34:27.555529] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-28T21:34:27.731956] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:27.740502] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-28T21:34:27.917681] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:27.980229] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-28T21:34:28.129342] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T21:34:28.610074] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:34:28.623792] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:34:28.780254] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-28T21:34:29.381261] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T21:34:29.580249] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-28T21:34:30.351002] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T21:34:30.380221] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-28T21:34:31.180346] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-28T21:34:31.289220] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T21:34:31.980303] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-28T21:34:32.622069] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T21:34:32.780270] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-28T21:34:33.161003] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T21:34:33.210870] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T21:34:33.580289] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-28T21:34:34.310693] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T21:34:34.380207] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-28T21:34:34.857154] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T21:34:35.180247] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-28T21:34:35.980253] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-28T21:34:36.572664] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T21:34:36.780246] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-28T21:34:37.083688] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T21:34:37.580284] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-28T21:34:38.048028] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T21:34:38.138409] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T21:34:38.380262] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-28T21:34:38.854179] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T21:34:39.180276] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-28T21:34:39.980300] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-28T21:34:40.419068] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T21:34:40.429566] [INFO ] [REMOTE ] TPR: Full fetch complete (77481 records). [2025-10-28T21:34:40.429739] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-28T21:34:40.540394] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T21:34:40.784707] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-28T21:34:40.831265] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-28T21:34:40.831330] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-28T21:34:40.832547] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-28T21:34:40.832608] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-28T21:34:40.834146] [DEBUG] [LOCAL ] TPR: Trimmed 77481 records to 53344 (keeping 200 days of data) [2025-10-28T21:34:41.169773] [DEBUG] [LOCAL ] TPR: Primary data saved (53344 records). [2025-10-28T21:34:41.169945] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-28T21:34:41.170525] [INFO ] [MAIN ] Update Progress: 2116/2366 symbols completed. TPR took 33.1s. Estimated remaining: 32m 27s. Rate: 7.7 symbols/min [2025-10-28T21:34:41.336985] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:41.345050] [DEBUG] [LOCAL ] TPZ: Loaded 4527 existing records from primary storage. [2025-10-28T21:34:41.345254] [INFO ] [MAIN ] TPZ: Loaded 4527 existing records. [2025-10-28T21:34:41.523144] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:41.523345] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-28T21:34:41.523409] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-28T21:34:41.523558] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-28T21:34:41.523614] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-28T21:34:41.590968] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-28T21:34:41.895819] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:41.912564] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T21:34:42.018918] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T21:34:42.380300] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-28T21:34:42.890735] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T21:34:42.892669] [INFO ] [REMOTE ] TPYP: Full fetch complete (12228 records). [2025-10-28T21:34:42.892740] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-28T21:34:43.185356] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-28T21:34:43.248077] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-28T21:34:43.248153] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-28T21:34:43.248482] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-28T21:34:43.248543] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-28T21:34:43.249029] [DEBUG] [LOCAL ] TPYP: Trimmed 12228 records to 7729 (keeping 200 days of data) [2025-10-28T21:34:43.296444] [DEBUG] [LOCAL ] TPYP: Primary data saved (7729 records). [2025-10-28T21:34:43.296556] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-28T21:34:43.296659] [INFO ] [MAIN ] Update Progress: 2117/2366 symbols completed. TPYP took 16.8s. Estimated remaining: 32m 18s. Rate: 7.7 symbols/min [2025-10-28T21:34:43.809605] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T21:34:43.980229] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-28T21:34:44.441759] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T21:34:44.780292] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-28T21:34:45.250853] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T21:34:45.580242] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-28T21:34:46.132821] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T21:34:46.380264] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-28T21:34:47.150637] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T21:34:47.180205] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-28T21:34:47.980255] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-28T21:34:48.036882] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T21:34:48.401901] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T21:34:48.780320] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-28T21:34:49.580222] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-28T21:34:49.603004] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T21:34:50.380255] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-28T21:34:50.668391] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T21:34:50.677419] [INFO ] [REMOTE ] TPH: Full fetch complete (65110 records). [2025-10-28T21:34:50.677557] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-28T21:34:51.052050] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-28T21:34:51.052125] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-28T21:34:51.053214] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-28T21:34:51.053275] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-28T21:34:51.054504] [DEBUG] [LOCAL ] TPH: Trimmed 65110 records to 44724 (keeping 200 days of data) [2025-10-28T21:34:51.212812] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-28T21:34:51.309434] [DEBUG] [LOCAL ] TPH: Primary data saved (44724 records). [2025-10-28T21:34:51.309562] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-28T21:34:51.309941] [INFO ] [MAIN ] Update Progress: 2118/2366 symbols completed. TPH took 54.0s. Estimated remaining: 32m 11s. Rate: 7.7 symbols/min [2025-10-28T21:34:51.403137] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T21:34:51.647029] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T21:34:51.980268] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-28T21:34:52.780269] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-28T21:34:52.881434] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T21:34:53.120229] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T21:34:53.580245] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-28T21:34:54.380233] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-28T21:34:54.421999] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T21:34:54.428760] [INFO ] [REMOTE ] TPVG: Full fetch complete (38946 records). [2025-10-28T21:34:54.428895] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-28T21:34:54.775944] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T21:34:54.897694] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-28T21:34:54.897804] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-28T21:34:54.898941] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-28T21:34:54.899013] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-28T21:34:54.900294] [DEBUG] [LOCAL ] TPVG: Trimmed 38946 records to 26630 (keeping 200 days of data) [2025-10-28T21:34:55.120491] [DEBUG] [LOCAL ] TPVG: Primary data saved (26630 records). [2025-10-28T21:34:55.120714] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-28T21:34:55.120869] [INFO ] [MAIN ] Update Progress: 2119/2366 symbols completed. TPVG took 28.9s. Estimated remaining: 32m 2s. Rate: 7.7 symbols/min [2025-10-28T21:34:55.180366] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-28T21:34:55.550628] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T21:34:55.980233] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-28T21:34:56.354451] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-28T21:34:56.355956] [INFO ] [REMOTE ] TPZ: Full fetch complete (8145 records). [2025-10-28T21:34:56.356070] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-28T21:34:56.742689] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-28T21:34:56.742774] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-28T21:34:56.742986] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-28T21:34:56.743026] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-28T21:34:56.743432] [DEBUG] [LOCAL ] TPZ: Trimmed 8145 records to 4477 (keeping 200 days of data) [2025-10-28T21:34:56.769760] [DEBUG] [LOCAL ] TPZ: Primary data saved (4477 records). [2025-10-28T21:34:56.769841] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-28T21:34:56.769936] [INFO ] [MAIN ] Update Progress: 2120/2366 symbols completed. TPZ took 15.6s. Estimated remaining: 31m 54s. Rate: 7.7 symbols/min [2025-10-28T21:34:57.487041] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:57.508385] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:57.507226] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:57.538602] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:34:57.553187] [DEBUG] [LOCAL ] TRAK: Loaded 9359 existing records from primary storage. [2025-10-28T21:34:57.559011] [DEBUG] [LOCAL ] TRC: Loaded 15063 existing records from primary storage. [2025-10-28T21:34:57.559386] [INFO ] [MAIN ] TRAK: Loaded 9359 existing records. [2025-10-28T21:34:57.571058] [INFO ] [MAIN ] TRC: Loaded 15063 existing records. [2025-10-28T21:34:57.738251] [DEBUG] [LOCAL ] TR: Loaded 19336 existing records from primary storage. [2025-10-28T21:34:57.788866] [INFO ] [MAIN ] TR: Loaded 19336 existing records. [2025-10-28T21:34:58.056736] [DEBUG] [LOCAL ] TREX: Loaded 49725 existing records from primary storage. [2025-10-28T21:34:58.082835] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:58.061114] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:58.083567] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-28T21:34:58.083784] [INFO ] [MAIN ] TREX: Loaded 49725 existing records. [2025-10-28T21:34:58.089401] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-28T21:34:58.099889] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-28T21:34:58.115526] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-28T21:34:58.153281] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-28T21:34:58.173032] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-28T21:34:58.193246] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-28T21:34:58.213613] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:58.250206] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-28T21:34:58.356812] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-28T21:34:58.449318] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-28T21:34:58.534117] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-28T21:34:58.539503] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-28T21:34:58.971416] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:34:59.141014] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-28T21:34:59.199982] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-28T21:34:59.309352] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-28T21:34:59.377756] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-28T21:34:59.464161] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:59.467123] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:59.526513] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-28T21:34:59.521116] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-28T21:34:59.650626] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:59.662053] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-28T21:34:59.900000] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:34:59.900288] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-28T21:35:00.160544] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:35:00.169149] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-28T21:35:00.169805] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:35:00.762882] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T21:35:00.780226] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-28T21:35:01.106516] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T21:35:01.275525] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T21:35:01.424982] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T21:35:01.580283] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-28T21:35:02.294311] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T21:35:02.380277] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-28T21:35:03.180306] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-28T21:35:03.559498] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:35:03.722101] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T21:35:03.980304] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-28T21:35:04.686190] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T21:35:04.780262] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-28T21:35:05.580267] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-28T21:35:06.015493] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T21:35:06.141501] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T21:35:06.380262] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-28T21:35:06.883766] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T21:35:07.180270] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-28T21:35:07.980256] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-28T21:35:08.472087] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T21:35:08.496080] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T21:35:08.780243] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-28T21:35:09.285482] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:35:09.580249] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-28T21:35:10.380333] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-28T21:35:10.978084] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:35:11.180289] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-28T21:35:11.312619] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T21:35:11.768500] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T21:35:11.980345] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-28T21:35:12.780264] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-28T21:35:13.267626] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T21:35:13.510571] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T21:35:13.580277] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-28T21:35:14.300913] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T21:35:14.380268] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-28T21:35:14.887776] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T21:35:15.180304] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-28T21:35:15.879424] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T21:35:15.980238] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-28T21:35:16.617527] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T21:35:16.780247] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-28T21:35:17.580246] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-28T21:35:18.215026] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:35:18.254470] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T21:35:18.380268] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-28T21:35:19.180247] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-28T21:35:19.830238] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T21:35:19.980231] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-28T21:35:20.183042] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T21:35:20.780248] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-28T21:35:21.302331] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T21:35:21.327004] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T21:35:21.580278] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-28T21:35:22.380250] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-28T21:35:22.948627] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T21:35:22.959673] [INFO ] [REMOTE ] TREX: Full fetch complete (71876 records). [2025-10-28T21:35:22.959878] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-28T21:35:23.100463] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T21:35:23.188608] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-28T21:35:23.386457] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-28T21:35:23.386564] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-28T21:35:23.387772] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-28T21:35:23.387834] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-28T21:35:23.389203] [DEBUG] [LOCAL ] TREX: Trimmed 71876 records to 49672 (keeping 200 days of data) [2025-10-28T21:35:23.672551] [DEBUG] [LOCAL ] TREX: Primary data saved (49672 records). [2025-10-28T21:35:23.672965] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-28T21:35:23.673154] [INFO ] [MAIN ] Update Progress: 2121/2366 symbols completed. TREX took 26.9s. Estimated remaining: 31m 48s. Rate: 7.7 symbols/min [2025-10-28T21:35:23.805786] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T21:35:23.872341] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:35:23.935178] [DEBUG] [LOCAL ] TRGP: Loaded 50616 existing records from primary storage. [2025-10-28T21:35:23.935620] [INFO ] [MAIN ] TRGP: Loaded 50616 existing records. [2025-10-28T21:35:23.985363] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-28T21:35:24.138990] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:35:24.139204] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-28T21:35:24.139253] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-28T21:35:24.139801] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-28T21:35:24.139860] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-28T21:35:24.516957] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:35:24.780212] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-28T21:35:24.857334] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T21:35:24.863549] [INFO ] [REMOTE ] TR: Full fetch complete (25720 records). [2025-10-28T21:35:24.863712] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-28T21:35:25.229952] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-28T21:35:25.230028] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-28T21:35:25.230608] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-28T21:35:25.230672] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-28T21:35:25.231317] [DEBUG] [LOCAL ] TR: Trimmed 25720 records to 19387 (keeping 200 days of data) [2025-10-28T21:35:25.346411] [DEBUG] [LOCAL ] TR: Primary data saved (19387 records). [2025-10-28T21:35:25.346540] [INFO ] [MAIN ] TR: Full history saved. [2025-10-28T21:35:25.346619] [INFO ] [MAIN ] Update Progress: 2122/2366 symbols completed. TR took 28.6s. Estimated remaining: 31m 40s. Rate: 7.7 symbols/min [2025-10-28T21:35:25.515435] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:35:25.548379] [DEBUG] [LOCAL ] TRN: Loaded 35831 existing records from primary storage. [2025-10-28T21:35:25.548632] [INFO ] [MAIN ] TRN: Loaded 35831 existing records. [2025-10-28T21:35:25.585379] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-28T21:35:25.726476] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:35:25.726726] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-28T21:35:25.726780] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-28T21:35:25.727102] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-28T21:35:25.727141] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-28T21:35:26.102697] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:35:26.167719] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T21:35:26.201785] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T21:35:26.380251] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-28T21:35:27.069409] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T21:35:27.072461] [INFO ] [REMOTE ] TRAK: Full fetch complete (13612 records). [2025-10-28T21:35:27.072550] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-28T21:35:27.185351] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-28T21:35:27.442291] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-28T21:35:27.442362] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-28T21:35:27.442698] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-28T21:35:27.442756] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-28T21:35:27.443206] [DEBUG] [LOCAL ] TRAK: Trimmed 13612 records to 9271 (keeping 200 days of data) [2025-10-28T21:35:27.498159] [DEBUG] [LOCAL ] TRAK: Primary data saved (9271 records). [2025-10-28T21:35:27.498266] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-28T21:35:27.498340] [INFO ] [MAIN ] Update Progress: 2123/2366 symbols completed. TRAK took 30.7s. Estimated remaining: 31m 31s. Rate: 7.7 symbols/min [2025-10-28T21:35:27.663699] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:35:27.700927] [DEBUG] [LOCAL ] TRNO: Loaded 43285 existing records from primary storage. [2025-10-28T21:35:27.701227] [INFO ] [MAIN ] TRNO: Loaded 43285 existing records. [2025-10-28T21:35:27.884084] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:35:27.884345] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-28T21:35:27.884418] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-28T21:35:27.885527] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-28T21:35:27.885613] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-28T21:35:27.985377] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-28T21:35:28.262192] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:35:28.578067] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T21:35:28.645786] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T21:35:28.780263] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-28T21:35:29.485888] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T21:35:29.580225] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-28T21:35:30.094638] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T21:35:30.097492] [INFO ] [REMOTE ] TRC: Full fetch complete (21600 records). [2025-10-28T21:35:30.097594] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-28T21:35:30.385494] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-28T21:35:30.486958] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-28T21:35:30.487033] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-28T21:35:30.487477] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-28T21:35:30.487515] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-28T21:35:30.488110] [DEBUG] [LOCAL ] TRC: Trimmed 21600 records to 14971 (keeping 200 days of data) [2025-10-28T21:35:30.573780] [DEBUG] [LOCAL ] TRC: Primary data saved (14971 records). [2025-10-28T21:35:30.573924] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-28T21:35:30.574008] [INFO ] [MAIN ] Update Progress: 2124/2366 symbols completed. TRC took 33.8s. Estimated remaining: 31m 23s. Rate: 7.7 symbols/min [2025-10-28T21:35:30.764838] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:35:30.814409] [DEBUG] [LOCAL ] TROX: Loaded 52161 existing records from primary storage. [2025-10-28T21:35:30.814767] [INFO ] [MAIN ] TROX: Loaded 52161 existing records. [2025-10-28T21:35:30.993214] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:35:30.993443] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-28T21:35:30.993489] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-28T21:35:30.994055] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-28T21:35:30.994116] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-28T21:35:31.186134] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-28T21:35:31.358338] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:35:31.610933] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T21:35:31.980287] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-28T21:35:32.346884] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T21:35:32.780262] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-28T21:35:33.297893] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T21:35:33.580233] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-28T21:35:33.795135] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T21:35:34.380250] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-28T21:35:34.514979] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T21:35:35.180254] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-28T21:35:35.760101] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T21:35:35.980253] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-28T21:35:36.548258] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T21:35:36.780284] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-28T21:35:37.111200] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:35:37.580219] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-28T21:35:37.796261] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T21:35:38.380241] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-28T21:35:38.575123] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T21:35:39.180327] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-28T21:35:39.738006] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T21:35:39.980250] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-28T21:35:40.496939] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T21:35:40.780252] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-28T21:35:41.582311] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-28T21:35:41.585696] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T21:35:41.786278] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T21:35:42.380269] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-28T21:35:42.796084] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T21:35:43.180260] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-28T21:35:43.670433] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T21:35:43.980244] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-28T21:35:44.086340] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T21:35:44.780250] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-28T21:35:45.289735] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T21:35:45.580277] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-28T21:35:45.985823] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T21:35:46.380235] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-28T21:35:46.919384] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T21:35:47.180303] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-28T21:35:47.556153] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T21:35:47.980248] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-28T21:35:48.469296] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T21:35:48.780252] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-28T21:35:49.330122] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T21:35:49.580245] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-28T21:35:49.843375] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T21:35:50.380224] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-28T21:35:50.918752] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T21:35:51.180241] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-28T21:35:51.663940] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T21:35:51.980276] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-28T21:35:52.419318] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T21:35:52.780263] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-28T21:35:53.289994] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T21:35:53.580312] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-28T21:35:53.990122] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T21:35:54.380273] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-28T21:35:54.908385] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T21:35:54.918494] [INFO ] [REMOTE ] TRGP: Full fetch complete (73576 records). [2025-10-28T21:35:54.918615] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-28T21:35:55.190376] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-28T21:35:55.324739] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-28T21:35:55.324832] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-28T21:35:55.326002] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-28T21:35:55.326067] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-28T21:35:55.327494] [DEBUG] [LOCAL ] TRGP: Trimmed 73576 records to 50599 (keeping 200 days of data) [2025-10-28T21:35:55.634889] [DEBUG] [LOCAL ] TRGP: Primary data saved (50599 records). [2025-10-28T21:35:55.635024] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-28T21:35:55.635103] [INFO ] [MAIN ] Update Progress: 2125/2366 symbols completed. TRGP took 32.0s. Estimated remaining: 31m 17s. Rate: 7.7 symbols/min [2025-10-28T21:35:55.815782] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:35:55.848126] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T21:35:55.900993] [DEBUG] [LOCAL ] TRP: Loaded 52114 existing records from primary storage. [2025-10-28T21:35:55.901322] [INFO ] [MAIN ] TRP: Loaded 52114 existing records. [2025-10-28T21:35:55.985325] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-28T21:35:56.092236] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:35:56.092474] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-28T21:35:56.092563] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-28T21:35:56.092890] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-28T21:35:56.092950] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-28T21:35:56.458225] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:35:56.482891] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T21:35:56.780310] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-28T21:35:57.384451] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:35:57.580287] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-28T21:35:58.117716] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:35:58.380253] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-28T21:35:59.050766] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T21:35:59.180278] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-28T21:35:59.570261] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T21:35:59.980287] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-28T21:36:00.197579] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:36:00.780322] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-28T21:36:01.580235] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-28T21:36:01.637952] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T21:36:01.650751] [INFO ] [REMOTE ] TRNO: Full fetch complete (62534 records). [2025-10-28T21:36:01.651049] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-28T21:36:02.120748] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-28T21:36:02.120858] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-28T21:36:02.122678] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-28T21:36:02.122801] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-28T21:36:02.124861] [DEBUG] [LOCAL ] TRNO: Trimmed 62534 records to 43159 (keeping 200 days of data) [2025-10-28T21:36:02.380412] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-28T21:36:02.450942] [DEBUG] [LOCAL ] TRNO: Primary data saved (43159 records). [2025-10-28T21:36:02.451306] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-28T21:36:02.451768] [INFO ] [MAIN ] Update Progress: 2126/2366 symbols completed. TRNO took 35.0s. Estimated remaining: 31m 9s. Rate: 7.7 symbols/min [2025-10-28T21:36:02.612765] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T21:36:02.655866] [INFO ] [REMOTE ] TROX: Full fetch complete (74239 records). [2025-10-28T21:36:02.701566] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-28T21:36:02.705567] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:03.077970] [DEBUG] [LOCAL ] TRTX: Loaded 36394 existing records from primary storage. [2025-10-28T21:36:03.118279] [INFO ] [MAIN ] TRTX: Loaded 36394 existing records. [2025-10-28T21:36:03.210220] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-28T21:36:03.210392] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-28T21:36:03.246130] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-28T21:36:03.246679] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-28T21:36:03.302390] [DEBUG] [LOCAL ] TROX: Trimmed 74239 records to 52155 (keeping 200 days of data) [2025-10-28T21:36:03.463183] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:03.481070] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-28T21:36:03.510247] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-28T21:36:03.523795] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-28T21:36:03.529984] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T21:36:03.539185] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-28T21:36:03.540158] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-28T21:36:03.553021] [INFO ] [REMOTE ] TRN: Full fetch complete (52297 records). [2025-10-28T21:36:03.553565] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-28T21:36:03.556730] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-28T21:36:04.458713] [DEBUG] [LOCAL ] TROX: Primary data saved (52155 records). [2025-10-28T21:36:04.516182] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-28T21:36:04.542224] [INFO ] [MAIN ] Update Progress: 2127/2366 symbols completed. TROX took 34.0s. Estimated remaining: 31m 1s. Rate: 7.7 symbols/min [2025-10-28T21:36:04.570130] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-28T21:36:04.580732] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-28T21:36:04.612309] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-28T21:36:04.632266] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-28T21:36:04.742956] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:04.759878] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-28T21:36:04.765944] [DEBUG] [LOCAL ] TRN: Trimmed 52297 records to 35737 (keeping 200 days of data) [2025-10-28T21:36:05.078827] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:05.285592] [DEBUG] [LOCAL ] TRN: Primary data saved (35737 records). [2025-10-28T21:36:05.285881] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-28T21:36:05.286063] [INFO ] [MAIN ] Update Progress: 2128/2366 symbols completed. TRN took 39.9s. Estimated remaining: 30m 52s. Rate: 7.7 symbols/min [2025-10-28T21:36:05.483913] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T21:36:05.481625] [DEBUG] [LOCAL ] TRU: Loaded 51446 existing records from primary storage. [2025-10-28T21:36:05.498713] [INFO ] [MAIN ] TRU: Loaded 51446 existing records. [2025-10-28T21:36:05.531933] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-28T21:36:05.586082] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:05.757988] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:05.758518] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-28T21:36:05.758590] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-28T21:36:05.774215] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-28T21:36:05.774320] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-28T21:36:05.786773] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T21:36:05.845829] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-28T21:36:05.966540] [DEBUG] [LOCAL ] TRV: Loaded 47439 existing records from primary storage. [2025-10-28T21:36:06.029743] [INFO ] [MAIN ] TRV: Loaded 47439 existing records. [2025-10-28T21:36:06.363456] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:06.360088] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:06.363663] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-28T21:36:06.363932] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-28T21:36:06.364328] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-28T21:36:06.364409] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-28T21:36:06.395016] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-28T21:36:06.713396] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:06.810082] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T21:36:07.188821] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-28T21:36:07.194376] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T21:36:07.697515] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:36:07.980299] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-28T21:36:08.758240] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T21:36:08.780218] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-28T21:36:09.011788] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T21:36:09.580267] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-28T21:36:10.308262] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T21:36:10.380218] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-28T21:36:10.775039] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T21:36:11.180259] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-28T21:36:11.918847] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:36:11.980265] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-28T21:36:12.599727] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T21:36:12.780263] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-28T21:36:13.580237] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-28T21:36:13.832938] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T21:36:14.046493] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T21:36:14.380301] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-28T21:36:15.116020] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:36:15.180243] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-28T21:36:15.728810] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T21:36:15.980383] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-28T21:36:16.444828] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T21:36:16.780294] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-28T21:36:17.188583] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T21:36:17.580227] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-28T21:36:18.326228] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T21:36:18.380241] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-28T21:36:18.890877] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T21:36:19.180284] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-28T21:36:19.908309] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T21:36:19.980304] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-28T21:36:20.749431] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T21:36:20.780277] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-28T21:36:21.585069] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-28T21:36:21.600947] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T21:36:21.728863] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T21:36:22.380313] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-28T21:36:22.657681] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:36:23.180283] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-28T21:36:23.980224] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-28T21:36:24.049459] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T21:36:24.059701] [INFO ] [REMOTE ] TRP: Full fetch complete (75797 records). [2025-10-28T21:36:24.059807] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-28T21:36:24.441382] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:36:24.494460] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-28T21:36:24.494531] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-28T21:36:24.495686] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-28T21:36:24.495752] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-28T21:36:24.497133] [DEBUG] [LOCAL ] TRP: Trimmed 75797 records to 52105 (keeping 200 days of data) [2025-10-28T21:36:24.785602] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-28T21:36:24.804590] [DEBUG] [LOCAL ] TRP: Primary data saved (52105 records). [2025-10-28T21:36:24.804694] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-28T21:36:24.805290] [INFO ] [MAIN ] Update Progress: 2129/2366 symbols completed. TRP took 29.2s. Estimated remaining: 30m 46s. Rate: 7.7 symbols/min [2025-10-28T21:36:24.989233] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:25.037733] [DEBUG] [LOCAL ] TS: Loaded 51624 existing records from primary storage. [2025-10-28T21:36:25.038053] [INFO ] [MAIN ] TS: Loaded 51624 existing records. [2025-10-28T21:36:25.215728] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:25.216078] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-28T21:36:25.216154] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-28T21:36:25.216382] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-28T21:36:25.216450] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-28T21:36:25.525100] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T21:36:25.587210] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-28T21:36:25.619445] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:26.248579] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T21:36:26.258212] [INFO ] [REMOTE ] TRV: Full fetch complete (70016 records). [2025-10-28T21:36:26.258335] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-28T21:36:26.385381] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-28T21:36:26.646108] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-28T21:36:26.646248] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-28T21:36:26.647394] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-28T21:36:26.647456] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-28T21:36:26.648789] [DEBUG] [LOCAL ] TRV: Trimmed 70016 records to 47438 (keeping 200 days of data) [2025-10-28T21:36:26.950891] [DEBUG] [LOCAL ] TRV: Primary data saved (47438 records). [2025-10-28T21:36:26.951074] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-28T21:36:26.951268] [INFO ] [MAIN ] Update Progress: 2130/2366 symbols completed. TRV took 21.7s. Estimated remaining: 30m 37s. Rate: 7.7 symbols/min [2025-10-28T21:36:27.128401] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:27.155450] [DEBUG] [LOCAL ] TSE: Loaded 27721 existing records from primary storage. [2025-10-28T21:36:27.155733] [INFO ] [MAIN ] TSE: Loaded 27721 existing records. [2025-10-28T21:36:27.192019] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-28T21:36:27.349193] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T21:36:27.405306] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:27.406703] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-28T21:36:27.406858] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-28T21:36:27.407856] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-28T21:36:27.407958] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-28T21:36:27.562129] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T21:36:27.794792] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:27.980253] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-28T21:36:28.780288] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-28T21:36:28.815528] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T21:36:29.060991] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-28T21:36:29.580265] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-28T21:36:30.380280] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-28T21:36:30.476085] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T21:36:30.502360] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T21:36:31.180219] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-28T21:36:31.373351] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T21:36:31.980262] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-28T21:36:32.104209] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T21:36:32.780264] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-28T21:36:33.121822] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T21:36:33.580267] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-28T21:36:34.044074] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T21:36:34.380257] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-28T21:36:34.791989] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:36:35.180249] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-28T21:36:35.907962] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T21:36:35.980220] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-28T21:36:36.432910] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T21:36:36.780262] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-28T21:36:37.382917] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T21:36:37.580274] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-28T21:36:37.765527] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T21:36:38.380289] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-28T21:36:38.649804] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T21:36:38.656874] [INFO ] [REMOTE ] TRTX: Full fetch complete (52962 records). [2025-10-28T21:36:38.657006] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-28T21:36:39.045502] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-28T21:36:39.045588] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-28T21:36:39.046597] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-28T21:36:39.046681] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-28T21:36:39.047823] [DEBUG] [LOCAL ] TRTX: Trimmed 52962 records to 36305 (keeping 200 days of data) [2025-10-28T21:36:39.201754] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-28T21:36:39.259938] [DEBUG] [LOCAL ] TRTX: Primary data saved (36305 records). [2025-10-28T21:36:39.260044] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-28T21:36:39.260118] [INFO ] [MAIN ] Update Progress: 2131/2366 symbols completed. TRTX took 36.8s. Estimated remaining: 30m 30s. Rate: 7.7 symbols/min [2025-10-28T21:36:39.439982] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:39.449173] [DEBUG] [LOCAL ] TSI: Loaded 7984 existing records from primary storage. [2025-10-28T21:36:39.449360] [INFO ] [MAIN ] TSI: Loaded 7984 existing records. [2025-10-28T21:36:39.647755] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:39.648007] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-28T21:36:39.648065] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-28T21:36:39.648304] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-28T21:36:39.648366] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-28T21:36:39.986684] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-28T21:36:40.055489] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:40.097486] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T21:36:40.156699] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T21:36:40.780250] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-28T21:36:41.270368] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T21:36:41.412393] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T21:36:41.422754] [INFO ] [REMOTE ] TRU: Full fetch complete (74188 records). [2025-10-28T21:36:41.422872] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-28T21:36:41.598065] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-28T21:36:41.813307] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-28T21:36:41.813421] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-28T21:36:41.814555] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-28T21:36:41.814615] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-28T21:36:41.816022] [DEBUG] [LOCAL ] TRU: Trimmed 74188 records to 51402 (keeping 200 days of data) [2025-10-28T21:36:42.116949] [DEBUG] [LOCAL ] TRU: Primary data saved (51402 records). [2025-10-28T21:36:42.117067] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-28T21:36:42.117142] [INFO ] [MAIN ] Update Progress: 2132/2366 symbols completed. TRU took 37.6s. Estimated remaining: 30m 22s. Rate: 7.7 symbols/min [2025-10-28T21:36:42.284039] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:42.317103] [DEBUG] [LOCAL ] TSLX: Loaded 35550 existing records from primary storage. [2025-10-28T21:36:42.317350] [INFO ] [MAIN ] TSLX: Loaded 35550 existing records. [2025-10-28T21:36:42.383379] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-28T21:36:42.433308] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T21:36:42.512012] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:42.512176] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-28T21:36:42.512222] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-28T21:36:42.512632] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-28T21:36:42.512720] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-28T21:36:42.856564] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:43.180271] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-28T21:36:43.770231] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T21:36:43.920120] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T21:36:43.980210] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-28T21:36:44.780221] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-28T21:36:45.043559] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T21:36:45.580217] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-28T21:36:45.683486] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T21:36:46.380300] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-28T21:36:47.024972] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T21:36:47.180204] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-28T21:36:47.458848] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T21:36:47.980258] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-28T21:36:48.367911] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:36:48.780277] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-28T21:36:48.962684] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T21:36:49.381677] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T21:36:49.580240] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-28T21:36:50.115955] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T21:36:50.380251] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-28T21:36:50.804786] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T21:36:51.180254] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-28T21:36:51.980335] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-28T21:36:52.356796] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T21:36:52.589688] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T21:36:52.780240] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-28T21:36:53.580277] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-28T21:36:54.064169] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T21:36:54.116671] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T21:36:54.127249] [INFO ] [REMOTE ] TS: Full fetch complete (74919 records). [2025-10-28T21:36:54.127444] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-28T21:36:54.385488] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-28T21:36:54.534217] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-28T21:36:54.534297] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-28T21:36:54.535605] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-28T21:36:54.535695] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-28T21:36:54.537434] [DEBUG] [LOCAL ] TS: Trimmed 74919 records to 51612 (keeping 200 days of data) [2025-10-28T21:36:54.879470] [DEBUG] [LOCAL ] TS: Primary data saved (51612 records). [2025-10-28T21:36:54.879625] [INFO ] [MAIN ] TS: Full history saved. [2025-10-28T21:36:54.880354] [INFO ] [MAIN ] Update Progress: 2133/2366 symbols completed. TS took 30.1s. Estimated remaining: 30m 15s. Rate: 7.7 symbols/min [2025-10-28T21:36:55.066405] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:36:55.120804] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-28T21:36:55.121145] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-28T21:36:55.186160] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-28T21:36:55.317562] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:36:55.317950] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-28T21:36:55.318080] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-28T21:36:55.324073] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-28T21:36:55.333786] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-28T21:36:55.368965] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T21:36:55.704618] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:36:55.980292] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-28T21:36:56.565213] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T21:36:56.780254] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-28T21:36:57.580278] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-28T21:36:57.601997] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T21:36:58.110815] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-28T21:36:58.380278] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-28T21:36:59.180305] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-28T21:36:59.280499] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T21:36:59.286697] [INFO ] [REMOTE ] TSE: Full fetch complete (41110 records). [2025-10-28T21:36:59.286800] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-28T21:36:59.664165] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-28T21:36:59.664241] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-28T21:36:59.665185] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-28T21:36:59.665247] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-28T21:36:59.666177] [DEBUG] [LOCAL ] TSE: Trimmed 41110 records to 27795 (keeping 200 days of data) [2025-10-28T21:36:59.818851] [DEBUG] [LOCAL ] TSE: Primary data saved (27795 records). [2025-10-28T21:36:59.818946] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-28T21:36:59.819026] [INFO ] [MAIN ] Update Progress: 2134/2366 symbols completed. TSE took 32.9s. Estimated remaining: 30m 7s. Rate: 7.7 symbols/min [2025-10-28T21:36:59.986313] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-28T21:37:00.042016] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:00.093371] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-28T21:37:00.093742] [INFO ] [MAIN ] TSN: Loaded 53088 existing records. [2025-10-28T21:37:00.278148] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:37:00.278544] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-28T21:37:00.278620] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-28T21:37:00.279394] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-28T21:37:00.291864] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-28T21:37:00.366121] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T21:37:00.661591] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:00.780251] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-28T21:37:00.975863] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-10-28T21:37:01.580261] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-28T21:37:02.099104] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T21:37:02.130155] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:37:02.333277] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-28T21:37:02.380256] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-28T21:37:03.180249] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-28T21:37:03.980273] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-28T21:37:04.205014] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T21:37:04.780274] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-28T21:37:05.053337] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-28T21:37:05.197299] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:37:05.313974] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T21:37:05.319837] [INFO ] [REMOTE ] TSI: Full fetch complete (13809 records). [2025-10-28T21:37:05.319923] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-28T21:37:05.585524] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-28T21:37:05.685904] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-28T21:37:05.686007] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-28T21:37:05.686529] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-28T21:37:05.686600] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-28T21:37:05.687113] [DEBUG] [LOCAL ] TSI: Trimmed 13809 records to 7963 (keeping 200 days of data) [2025-10-28T21:37:05.732185] [DEBUG] [LOCAL ] TSI: Primary data saved (7963 records). [2025-10-28T21:37:05.732315] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-28T21:37:05.732399] [INFO ] [MAIN ] Update Progress: 2135/2366 symbols completed. TSI took 26.5s. Estimated remaining: 29m 59s. Rate: 7.7 symbols/min [2025-10-28T21:37:05.904394] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:05.917197] [DEBUG] [LOCAL ] TSQ: Loaded 11751 existing records from primary storage. [2025-10-28T21:37:05.917403] [INFO ] [MAIN ] TSQ: Loaded 11751 existing records. [2025-10-28T21:37:06.098667] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:37:06.098896] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-28T21:37:06.098942] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-28T21:37:06.099131] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-28T21:37:06.099187] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-28T21:37:06.385438] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-28T21:37:06.452198] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:07.180305] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-28T21:37:07.750298] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T21:37:07.988770] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-28T21:37:07.994274] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T21:37:08.167493] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-28T21:37:08.513287] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T21:37:08.780325] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-28T21:37:09.580225] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-28T21:37:10.190427] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:37:10.380250] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-28T21:37:11.180257] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-28T21:37:11.725528] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-28T21:37:11.979724] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T21:37:11.989821] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-28T21:37:12.158738] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T21:37:12.780267] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-28T21:37:13.580262] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-28T21:37:13.845198] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T21:37:14.333984] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-28T21:37:14.380294] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-28T21:37:14.912632] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T21:37:15.084095] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T21:37:15.180283] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-28T21:37:15.980297] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-28T21:37:16.780321] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-28T21:37:17.395461] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T21:37:17.416192] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T21:37:17.480729] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-28T21:37:17.580261] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-28T21:37:18.179413] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T21:37:18.380228] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-28T21:37:19.169725] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T21:37:19.180197] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-28T21:37:19.767861] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T21:37:19.980256] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-28T21:37:20.780281] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-28T21:37:21.071574] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T21:37:21.080571] [INFO ] [REMOTE ] TSLX: Full fetch complete (51208 records). [2025-10-28T21:37:21.080766] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-28T21:37:21.479221] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-28T21:37:21.479323] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-28T21:37:21.480836] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-28T21:37:21.480901] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-28T21:37:21.482377] [DEBUG] [LOCAL ] TSLX: Trimmed 51208 records to 35543 (keeping 200 days of data) [2025-10-28T21:37:21.580287] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-28T21:37:21.724633] [DEBUG] [LOCAL ] TSLX: Primary data saved (35543 records). [2025-10-28T21:37:21.724860] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-28T21:37:21.724960] [INFO ] [MAIN ] Update Progress: 2136/2366 symbols completed. TSLX took 39.6s. Estimated remaining: 29m 52s. Rate: 7.7 symbols/min [2025-10-28T21:37:21.909872] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:21.958629] [DEBUG] [LOCAL ] TT: Loaded 46868 existing records from primary storage. [2025-10-28T21:37:21.959066] [INFO ] [MAIN ] TT: Loaded 46868 existing records. [2025-10-28T21:37:22.143738] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:37:22.144001] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-28T21:37:22.144051] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-28T21:37:22.144557] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-28T21:37:22.144597] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-28T21:37:22.394406] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-28T21:37:22.546232] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:22.579551] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T21:37:22.965283] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T21:37:23.180265] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-28T21:37:23.715763] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T21:37:23.986142] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-28T21:37:24.007273] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-28T21:37:24.780294] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-28T21:37:25.550465] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T21:37:25.580222] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-28T21:37:26.380250] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-28T21:37:26.537916] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T21:37:27.141883] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-28T21:37:27.180295] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-28T21:37:27.715494] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T21:37:27.718255] [INFO ] [REMOTE ] TSQ: Full fetch complete (16343 records). [2025-10-28T21:37:27.718340] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-28T21:37:27.982492] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-28T21:37:28.094406] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-28T21:37:28.094592] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-28T21:37:28.094996] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-28T21:37:28.095071] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-28T21:37:28.095932] [DEBUG] [LOCAL ] TSQ: Trimmed 16343 records to 11754 (keeping 200 days of data) [2025-10-28T21:37:28.165050] [DEBUG] [LOCAL ] TSQ: Primary data saved (11754 records). [2025-10-28T21:37:28.165175] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-28T21:37:28.165254] [INFO ] [MAIN ] Update Progress: 2137/2366 symbols completed. TSQ took 22.4s. Estimated remaining: 29m 44s. Rate: 7.7 symbols/min [2025-10-28T21:37:28.339688] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-28T21:37:28.374917] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:28.375048] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-28T21:37:28.375092] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-28T21:37:28.375201] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-28T21:37:28.375243] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-28T21:37:28.375286] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-28T21:37:28.375328] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-28T21:37:28.730115] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:28.780215] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-10-28T21:37:28.938883] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:37:28.939163] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-10-28T21:37:28.939252] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:37:28.939298] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-28T21:37:28.939331] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:37:28.939367] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-28T21:37:28.939420] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-28T21:37:28.939497] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-28T21:37:28.939547] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-28T21:37:28.939594] [INFO ] [MAIN ] Update Progress: 2138/2366 symbols completed. TTAM took 0.8s. Estimated remaining: 29m 35s. Rate: 7.7 symbols/min [2025-10-28T21:37:29.109879] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:29.146363] [DEBUG] [LOCAL ] TTC: Loaded 41166 existing records from primary storage. [2025-10-28T21:37:29.146661] [INFO ] [MAIN ] TTC: Loaded 41166 existing records. [2025-10-28T21:37:29.331255] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:37:29.331495] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-28T21:37:29.331543] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-28T21:37:29.331756] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-28T21:37:29.331813] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-28T21:37:29.588744] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-28T21:37:29.715959] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:29.870397] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T21:37:29.881075] [INFO ] [REMOTE ] TSN: Full fetch complete (76685 records). [2025-10-28T21:37:29.881200] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-28T21:37:30.266918] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-28T21:37:30.267004] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-28T21:37:30.268157] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-28T21:37:30.268218] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-28T21:37:30.269580] [DEBUG] [LOCAL ] TSN: Trimmed 76685 records to 53087 (keeping 200 days of data) [2025-10-28T21:37:30.387704] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-28T21:37:30.588263] [DEBUG] [LOCAL ] TSN: Primary data saved (53087 records). [2025-10-28T21:37:30.588394] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-28T21:37:30.588485] [INFO ] [MAIN ] Update Progress: 2139/2366 symbols completed. TSN took 30.8s. Estimated remaining: 29m 27s. Rate: 7.7 symbols/min [2025-10-28T21:37:30.755903] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:30.801518] [DEBUG] [LOCAL ] TTE: Loaded 51464 existing records from primary storage. [2025-10-28T21:37:30.801840] [INFO ] [MAIN ] TTE: Loaded 51464 existing records. [2025-10-28T21:37:30.994873] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:37:30.995184] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-28T21:37:30.995294] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-28T21:37:30.995541] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-28T21:37:30.995617] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-28T21:37:31.182079] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-28T21:37:31.168250] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T21:37:31.395033] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:31.980302] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-28T21:37:32.612393] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:37:32.780263] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-28T21:37:32.936376] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-28T21:37:32.947239] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-28T21:37:32.947399] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-28T21:37:33.341532] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-28T21:37:33.341614] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-28T21:37:33.342830] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-28T21:37:33.342891] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-28T21:37:33.344365] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-28T21:37:33.582609] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-28T21:37:33.713373] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-28T21:37:33.713288] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T21:37:33.713529] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-28T21:37:33.724816] [INFO ] [MAIN ] Update Progress: 2140/2366 symbols completed. TSM took 38.8s. Estimated remaining: 29m 18s. Rate: 7.7 symbols/min [2025-10-28T21:37:33.906981] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:37:33.945871] [DEBUG] [LOCAL ] TTI: Loaded 46694 existing records from primary storage. [2025-10-28T21:37:33.946200] [INFO ] [MAIN ] TTI: Loaded 46694 existing records. [2025-10-28T21:37:34.138192] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:37:34.138561] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-28T21:37:34.138673] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-28T21:37:34.139428] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-28T21:37:34.139529] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-28T21:37:34.314062] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T21:37:34.390039] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-28T21:37:34.564899] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:37:35.078097] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T21:37:35.180270] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-28T21:37:35.776126] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T21:37:35.980284] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-28T21:37:36.541372] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T21:37:36.780256] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-28T21:37:37.364336] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T21:37:37.580252] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-28T21:37:38.380248] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-28T21:37:38.442574] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T21:37:38.673275] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T21:37:39.180267] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-28T21:37:39.568114] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T21:37:39.980310] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-28T21:37:40.785348] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-28T21:37:40.824260] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T21:37:41.078335] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T21:37:41.580318] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-28T21:37:42.208382] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T21:37:42.380248] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-28T21:37:42.782834] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T21:37:43.180246] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-28T21:37:43.736589] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:37:43.980275] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-28T21:37:44.507265] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T21:37:44.780285] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-28T21:37:45.580234] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-28T21:37:45.680984] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T21:37:46.099185] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T21:37:46.380255] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-28T21:37:46.758007] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T21:37:47.180250] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-28T21:37:47.728933] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T21:37:47.980244] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-28T21:37:48.683355] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T21:37:48.780233] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-28T21:37:49.207204] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T21:37:49.580280] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-28T21:37:50.052574] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T21:37:50.380255] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-28T21:37:50.974573] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T21:37:51.180246] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-28T21:37:51.603552] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T21:37:51.980295] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-28T21:37:52.389941] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:37:52.780311] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-28T21:37:53.530060] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:37:53.580210] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-28T21:37:54.043678] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:37:54.380301] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-28T21:37:54.929564] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T21:37:55.180310] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-28T21:37:55.559274] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T21:37:55.980274] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-28T21:37:56.539803] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T21:37:56.780252] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-28T21:37:57.541242] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T21:37:57.580223] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-28T21:37:58.039707] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:37:58.380249] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-28T21:37:58.692601] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T21:37:59.180258] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-28T21:37:59.980259] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-28T21:38:00.135918] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-28T21:38:00.148665] [INFO ] [REMOTE ] TTI: Full fetch complete (66702 records). [2025-10-28T21:38:00.148938] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-28T21:38:00.639243] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-28T21:38:00.639379] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-28T21:38:00.641841] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-28T21:38:00.641928] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-28T21:38:00.643974] [DEBUG] [LOCAL ] TTI: Trimmed 66702 records to 46706 (keeping 200 days of data) [2025-10-28T21:38:00.822014] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-28T21:38:00.979888] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T21:38:00.997597] [DEBUG] [LOCAL ] TTI: Primary data saved (46706 records). [2025-10-28T21:38:00.998246] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-28T21:38:00.998870] [INFO ] [MAIN ] Update Progress: 2141/2366 symbols completed. TTI took 27.3s. Estimated remaining: 29m 13s. Rate: 7.7 symbols/min [2025-10-28T21:38:01.031532] [INFO ] [REMOTE ] TTE: Full fetch complete (74990 records). [2025-10-28T21:38:01.043928] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-28T21:38:01.303686] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:01.579033] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T21:38:01.639291] [INFO ] [REMOTE ] TTC: Full fetch complete (61598 records). [2025-10-28T21:38:01.646312] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-28T21:38:01.702564] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-28T21:38:01.745676] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-28T21:38:01.752990] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-28T21:38:01.764563] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-28T21:38:01.856700] [DEBUG] [LOCAL ] TU: Loaded 49690 existing records from primary storage. [2025-10-28T21:38:01.868005] [DEBUG] [LOCAL ] TTE: Trimmed 74990 records to 51441 (keeping 200 days of data) [2025-10-28T21:38:01.881876] [INFO ] [MAIN ] TU: Loaded 49690 existing records. [2025-10-28T21:38:02.136533] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T21:38:02.242995] [INFO ] [REMOTE ] TT: Full fetch complete (69857 records). [2025-10-28T21:38:02.277977] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-28T21:38:02.632976] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:02.678817] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-28T21:38:02.721884] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-28T21:38:02.726151] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-28T21:38:02.750957] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-28T21:38:02.731581] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-28T21:38:02.792918] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-28T21:38:02.810255] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-28T21:38:02.834664] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-28T21:38:03.095734] [DEBUG] [LOCAL ] TTC: Trimmed 61598 records to 41050 (keeping 200 days of data) [2025-10-28T21:38:03.427455] [DEBUG] [LOCAL ] TTE: Primary data saved (51441 records). [2025-10-28T21:38:03.460711] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-28T21:38:03.478953] [INFO ] [MAIN ] Update Progress: 2142/2366 symbols completed. TTE took 32.9s. Estimated remaining: 29m 4s. Rate: 7.7 symbols/min [2025-10-28T21:38:03.492471] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-28T21:38:03.537760] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-28T21:38:03.671145] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-28T21:38:03.694064] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-28T21:38:03.973273] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:03.928318] [DEBUG] [LOCAL ] TT: Trimmed 69857 records to 46798 (keeping 200 days of data) [2025-10-28T21:38:03.989944] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-28T21:38:03.995842] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:04.132628] [DEBUG] [LOCAL ] TTC: Primary data saved (41050 records). [2025-10-28T21:38:04.136483] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-28T21:38:04.140905] [INFO ] [MAIN ] Update Progress: 2143/2366 symbols completed. TTC took 35.2s. Estimated remaining: 28m 56s. Rate: 7.7 symbols/min [2025-10-28T21:38:04.454414] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:04.501349] [DEBUG] [LOCAL ] TUYA: Loaded 45538 existing records from primary storage. [2025-10-28T21:38:04.509747] [INFO ] [MAIN ] TUYA: Loaded 45538 existing records. [2025-10-28T21:38:04.684626] [DEBUG] [LOCAL ] TT: Primary data saved (46798 records). [2025-10-28T21:38:04.713809] [INFO ] [MAIN ] TT: Full history saved. [2025-10-28T21:38:04.759813] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:04.750977] [INFO ] [MAIN ] Update Progress: 2144/2366 symbols completed. TT took 43.0s. Estimated remaining: 28m 47s. Rate: 7.7 symbols/min [2025-10-28T21:38:04.760774] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-28T21:38:04.783220] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-28T21:38:04.829671] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-28T21:38:04.829589] [DEBUG] [LOCAL ] TV: Loaded 41039 existing records from primary storage. [2025-10-28T21:38:04.834985] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-28T21:38:04.840417] [INFO ] [MAIN ] TV: Loaded 41039 existing records. [2025-10-28T21:38:05.240818] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:05.380525] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:05.416780] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-28T21:38:05.445838] [DEBUG] [LOCAL ] TVC: Loaded 3032 existing records from primary storage. [2025-10-28T21:38:05.455563] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-28T21:38:05.456556] [INFO ] [MAIN ] TVC: Loaded 3032 existing records. [2025-10-28T21:38:05.467130] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-28T21:38:05.467454] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-28T21:38:05.901258] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:05.945272] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-28T21:38:05.939852] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:05.986273] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-28T21:38:05.985900] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-28T21:38:06.040479] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-28T21:38:06.082713] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-28T21:38:06.097198] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-28T21:38:06.260962] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-28T21:38:06.376292] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:06.401377] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-28T21:38:06.628961] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:06.629252] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-28T21:38:07.112958] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:38:07.113569] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T21:38:07.123033] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-28T21:38:07.121277] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-28T21:38:07.511294] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T21:38:07.512822] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-28T21:38:07.706025] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:38:07.742718] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T21:38:07.832281] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T21:38:07.980308] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-28T21:38:08.730551] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T21:38:08.780293] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-28T21:38:09.050447] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T21:38:09.580307] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-28T21:38:10.194591] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:38:10.380257] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-28T21:38:11.005374] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:38:11.180291] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-28T21:38:11.960819] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T21:38:11.980229] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-28T21:38:12.495457] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T21:38:12.780359] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-28T21:38:13.285855] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T21:38:13.580318] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-28T21:38:14.010342] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T21:38:14.117520] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:38:14.380283] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-28T21:38:15.180291] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-28T21:38:15.740702] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:38:15.762232] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T21:38:15.980258] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-28T21:38:16.388842] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T21:38:16.780266] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-28T21:38:17.580304] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-28T21:38:18.015852] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T21:38:18.380279] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-28T21:38:18.822197] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:38:18.891941] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T21:38:19.180302] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-28T21:38:19.980271] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-28T21:38:20.516564] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:38:20.780283] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-28T21:38:21.328566] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T21:38:21.580275] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-28T21:38:21.907181] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:38:22.380480] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-28T21:38:22.747558] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T21:38:23.180262] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-28T21:38:23.538953] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T21:38:23.695616] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T21:38:23.980247] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-28T21:38:24.333216] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T21:38:24.780297] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-28T21:38:25.580241] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-28T21:38:25.913421] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T21:38:26.380249] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-28T21:38:26.993296] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T21:38:27.180275] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-28T21:38:27.481216] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T21:38:27.980337] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-28T21:38:28.261735] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T21:38:28.780249] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-28T21:38:29.210280] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T21:38:29.224537] [INFO ] [REMOTE ] TUYA: Full fetch complete (67204 records). [2025-10-28T21:38:29.224933] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-28T21:38:29.585407] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-28T21:38:29.673176] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-28T21:38:29.673292] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-28T21:38:29.675463] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-28T21:38:29.675540] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-28T21:38:29.677544] [DEBUG] [LOCAL ] TUYA: Trimmed 67204 records to 45512 (keeping 200 days of data) [2025-10-28T21:38:29.961760] [DEBUG] [LOCAL ] TUYA: Primary data saved (45512 records). [2025-10-28T21:38:29.962113] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-28T21:38:29.962217] [INFO ] [MAIN ] Update Progress: 2145/2366 symbols completed. TUYA took 26.5s. Estimated remaining: 28m 41s. Rate: 7.7 symbols/min [2025-10-28T21:38:29.986830] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T21:38:30.036918] [INFO ] [REMOTE ] TVC: Full fetch complete (4969 records). [2025-10-28T21:38:30.054314] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-28T21:38:30.243962] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:30.338596] [DEBUG] [LOCAL ] TVE: Loaded 2496 existing records from primary storage. [2025-10-28T21:38:30.383772] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-28T21:38:30.364390] [INFO ] [MAIN ] TVE: Loaded 2496 existing records. [2025-10-28T21:38:30.643671] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T21:38:30.695290] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-28T21:38:30.725423] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-28T21:38:30.733805] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-28T21:38:30.740116] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-28T21:38:30.760637] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:30.760977] [DEBUG] [LOCAL ] TVC: Trimmed 4969 records to 3010 (keeping 200 days of data) [2025-10-28T21:38:30.761369] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-28T21:38:30.761564] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-28T21:38:30.768815] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-28T21:38:30.770707] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-28T21:38:30.888556] [DEBUG] [LOCAL ] TVC: Primary data saved (3010 records). [2025-10-28T21:38:30.904514] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-28T21:38:30.929944] [INFO ] [MAIN ] Update Progress: 2146/2366 symbols completed. TVC took 26.2s. Estimated remaining: 28m 33s. Rate: 7.7 symbols/min [2025-10-28T21:38:31.182880] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-28T21:38:31.499017] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:31.489494] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:31.541600] [DEBUG] [LOCAL ] TWI: Loaded 33404 existing records from primary storage. [2025-10-28T21:38:31.542065] [INFO ] [MAIN ] TWI: Loaded 33404 existing records. [2025-10-28T21:38:31.666844] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T21:38:31.835913] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:31.836179] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-28T21:38:31.836231] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-28T21:38:31.836444] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-28T21:38:31.836499] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-28T21:38:31.985329] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-28T21:38:32.230759] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:32.334797] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T21:38:32.503055] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T21:38:32.780280] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-28T21:38:33.166240] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T21:38:33.580268] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-28T21:38:34.380250] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-28T21:38:34.642804] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T21:38:34.650168] [INFO ] [REMOTE ] TV: Full fetch complete (60842 records). [2025-10-28T21:38:34.650316] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-28T21:38:34.924865] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T21:38:35.043670] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-28T21:38:35.043754] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-28T21:38:35.044796] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-28T21:38:35.044856] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-28T21:38:35.046070] [DEBUG] [LOCAL ] TV: Trimmed 60842 records to 41054 (keeping 200 days of data) [2025-10-28T21:38:35.204404] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-28T21:38:35.277866] [DEBUG] [LOCAL ] TV: Primary data saved (41054 records). [2025-10-28T21:38:35.277984] [INFO ] [MAIN ] TV: Full history saved. [2025-10-28T21:38:35.278060] [INFO ] [MAIN ] Update Progress: 2147/2366 symbols completed. TV took 31.1s. Estimated remaining: 28m 25s. Rate: 7.7 symbols/min [2025-10-28T21:38:35.443766] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:35.498388] [DEBUG] [LOCAL ] TWLO: Loaded 52754 existing records from primary storage. [2025-10-28T21:38:35.498706] [INFO ] [MAIN ] TWLO: Loaded 52754 existing records. [2025-10-28T21:38:35.673010] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:35.673227] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-28T21:38:35.673273] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-28T21:38:35.673638] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-28T21:38:35.673723] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-28T21:38:35.985395] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-28T21:38:36.020522] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:36.400164] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T21:38:36.555153] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T21:38:36.565407] [INFO ] [REMOTE ] TU: Full fetch complete (72815 records). [2025-10-28T21:38:36.565568] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-28T21:38:36.786808] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-28T21:38:36.954298] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-28T21:38:36.954379] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-28T21:38:36.955517] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-28T21:38:36.955580] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-28T21:38:36.957051] [DEBUG] [LOCAL ] TU: Trimmed 72815 records to 49672 (keeping 200 days of data) [2025-10-28T21:38:37.254799] [DEBUG] [LOCAL ] TU: Primary data saved (49672 records). [2025-10-28T21:38:37.254931] [INFO ] [MAIN ] TU: Full history saved. [2025-10-28T21:38:37.255009] [INFO ] [MAIN ] Update Progress: 2148/2366 symbols completed. TU took 36.3s. Estimated remaining: 28m 16s. Rate: 7.7 symbols/min [2025-10-28T21:38:37.418666] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:37.423731] [DEBUG] [LOCAL ] TWN: Loaded 3112 existing records from primary storage. [2025-10-28T21:38:37.423878] [INFO ] [MAIN ] TWN: Loaded 3112 existing records. [2025-10-28T21:38:37.592116] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-28T21:38:37.596802] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:37.597832] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-28T21:38:37.597882] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-28T21:38:37.598009] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-28T21:38:37.598046] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-28T21:38:37.947931] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:38.380268] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-28T21:38:38.712375] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T21:38:38.774370] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T21:38:38.778556] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:38:39.180262] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-28T21:38:39.546397] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T21:38:39.980258] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-28T21:38:40.490243] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T21:38:40.780259] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-28T21:38:41.164461] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T21:38:41.580252] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-28T21:38:42.380244] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-28T21:38:42.796523] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T21:38:43.147281] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T21:38:43.180223] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-28T21:38:43.485483] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T21:38:43.980324] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-28T21:38:44.377660] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T21:38:44.780295] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-28T21:38:45.580230] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-28T21:38:46.357904] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T21:38:46.380223] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-28T21:38:46.609266] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T21:38:47.180314] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-28T21:38:47.851532] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T21:38:47.980256] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-28T21:38:48.220586] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T21:38:48.346838] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T21:38:48.780333] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-28T21:38:49.580316] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-28T21:38:50.385361] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-28T21:38:50.409604] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T21:38:50.658127] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T21:38:50.845364] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T21:38:51.180240] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-28T21:38:51.980224] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-28T21:38:52.144489] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T21:38:52.351555] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T21:38:52.780284] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-28T21:38:53.580312] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-28T21:38:53.826310] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T21:38:53.944680] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T21:38:54.380266] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-28T21:38:55.180306] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-28T21:38:55.393121] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T21:38:55.980285] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-28T21:38:56.416828] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T21:38:56.418306] [INFO ] [REMOTE ] TWN: Full fetch complete (5104 records). [2025-10-28T21:38:56.418375] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-28T21:38:56.779135] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-28T21:38:56.779291] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-28T21:38:56.779459] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-28T21:38:56.779532] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-28T21:38:56.780084] [DEBUG] [LOCAL ] TWN: Trimmed 5104 records to 3121 (keeping 200 days of data) [2025-10-28T21:38:56.780223] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-28T21:38:56.828290] [DEBUG] [LOCAL ] TWN: Primary data saved (3121 records). [2025-10-28T21:38:56.828573] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-28T21:38:56.830142] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T21:38:56.829051] [INFO ] [MAIN ] Update Progress: 2149/2366 symbols completed. TWN took 19.6s. Estimated remaining: 28m 10s. Rate: 7.7 symbols/min [2025-10-28T21:38:57.005087] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:38:57.046929] [DEBUG] [LOCAL ] TWO: Loaded 48411 existing records from primary storage. [2025-10-28T21:38:57.047209] [INFO ] [MAIN ] TWO: Loaded 48411 existing records. [2025-10-28T21:38:57.218507] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:38:57.218699] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-28T21:38:57.218753] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-28T21:38:57.218940] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-28T21:38:57.218978] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-28T21:38:57.562762] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:38:57.580200] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-28T21:38:57.681119] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:38:58.380284] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-28T21:38:58.685317] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T21:38:58.930889] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T21:38:59.180271] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-28T21:38:59.591275] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T21:38:59.980277] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-28T21:39:00.367278] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T21:39:00.780240] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-28T21:39:01.580255] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-28T21:39:01.979478] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T21:39:01.980427] [INFO ] [REMOTE ] TVE: Full fetch complete (4185 records). [2025-10-28T21:39:01.980493] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-28T21:39:02.348842] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-28T21:39:02.349007] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-28T21:39:02.349251] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-28T21:39:02.349424] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-28T21:39:02.350101] [DEBUG] [LOCAL ] TVE: Trimmed 4185 records to 2491 (keeping 200 days of data) [2025-10-28T21:39:02.365589] [DEBUG] [LOCAL ] TVE: Primary data saved (2491 records). [2025-10-28T21:39:02.365698] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-28T21:39:02.365784] [INFO ] [MAIN ] Update Progress: 2150/2366 symbols completed. TVE took 32.4s. Estimated remaining: 28m 2s. Rate: 7.7 symbols/min [2025-10-28T21:39:02.386271] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-28T21:39:02.572538] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:02.572723] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-28T21:39:02.569094] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T21:39:02.572788] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-28T21:39:02.583359] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-28T21:39:02.583761] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-28T21:39:02.583834] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-28T21:39:02.583971] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-28T21:39:02.943379] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:03.180224] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-10-28T21:39:03.295142] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T21:39:03.370556] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:39:03.370937] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-10-28T21:39:03.371040] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:39:03.371121] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-28T21:39:03.371208] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:39:03.371290] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-28T21:39:03.371382] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-28T21:39:03.371454] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-28T21:39:03.371536] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-28T21:39:03.371631] [INFO ] [MAIN ] Update Progress: 2151/2366 symbols completed. TWOD took 1.0s. Estimated remaining: 27m 53s. Rate: 7.7 symbols/min [2025-10-28T21:39:03.549425] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:03.570803] [DEBUG] [LOCAL ] TX: Loaded 22740 existing records from primary storage. [2025-10-28T21:39:03.571055] [INFO ] [MAIN ] TX: Loaded 22740 existing records. [2025-10-28T21:39:03.753814] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:39:03.754033] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-28T21:39:03.754079] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-28T21:39:03.754252] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-28T21:39:03.754290] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-28T21:39:03.985367] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-28T21:39:04.111270] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:04.780236] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-28T21:39:04.951262] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T21:39:04.958325] [INFO ] [REMOTE ] TWI: Full fetch complete (51717 records). [2025-10-28T21:39:04.958432] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-28T21:39:05.327275] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-28T21:39:05.327351] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-28T21:39:05.328465] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-28T21:39:05.328527] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-28T21:39:05.329543] [DEBUG] [LOCAL ] TWI: Trimmed 51717 records to 33243 (keeping 200 days of data) [2025-10-28T21:39:05.513849] [DEBUG] [LOCAL ] TWI: Primary data saved (33243 records). [2025-10-28T21:39:05.513977] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-28T21:39:05.514052] [INFO ] [MAIN ] Update Progress: 2152/2366 symbols completed. TWI took 34.6s. Estimated remaining: 27m 45s. Rate: 7.7 symbols/min [2025-10-28T21:39:05.586820] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-28T21:39:05.685491] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:05.723893] [DEBUG] [LOCAL ] TXNM: Loaded 42554 existing records from primary storage. [2025-10-28T21:39:05.724210] [INFO ] [MAIN ] TXNM: Loaded 42554 existing records. [2025-10-28T21:39:05.905028] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:39:05.905345] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-28T21:39:05.905426] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-28T21:39:05.905678] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-28T21:39:05.905741] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-28T21:39:06.205828] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T21:39:06.318416] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:06.380301] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-28T21:39:07.180308] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-28T21:39:07.222939] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T21:39:07.350414] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T21:39:07.980258] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-28T21:39:08.441384] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T21:39:08.780258] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-28T21:39:09.166673] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:39:09.580332] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-28T21:39:10.131691] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:39:10.380313] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-28T21:39:10.760410] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:39:11.180347] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-28T21:39:11.980331] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-28T21:39:12.026897] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T21:39:12.734715] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T21:39:12.780240] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-28T21:39:12.965121] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T21:39:13.580299] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-28T21:39:14.057295] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T21:39:14.380301] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-28T21:39:14.502383] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T21:39:15.180259] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-28T21:39:15.784417] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T21:39:15.980198] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-28T21:39:16.078430] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T21:39:16.780330] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-28T21:39:17.433322] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T21:39:17.581367] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-28T21:39:17.583164] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T21:39:18.380249] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-28T21:39:18.906810] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T21:39:19.180277] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-28T21:39:19.855021] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T21:39:19.989800] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-28T21:39:19.995096] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T21:39:20.006056] [INFO ] [REMOTE ] TWLO: Full fetch complete (76587 records). [2025-10-28T21:39:20.006219] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-28T21:39:20.391748] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-28T21:39:20.391833] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-28T21:39:20.393014] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-28T21:39:20.393076] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-28T21:39:20.394552] [DEBUG] [LOCAL ] TWLO: Trimmed 76587 records to 52744 (keeping 200 days of data) [2025-10-28T21:39:20.703943] [DEBUG] [LOCAL ] TWLO: Primary data saved (52744 records). [2025-10-28T21:39:20.704073] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-28T21:39:20.704452] [INFO ] [MAIN ] Update Progress: 2153/2366 symbols completed. TWLO took 45.4s. Estimated remaining: 27m 38s. Rate: 7.7 symbols/min [2025-10-28T21:39:20.783722] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-28T21:39:20.875206] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:20.892582] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T21:39:20.918249] [DEBUG] [LOCAL ] TXO: Loaded 19924 existing records from primary storage. [2025-10-28T21:39:20.918490] [INFO ] [MAIN ] TXO: Loaded 19924 existing records. [2025-10-28T21:39:21.088498] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:39:21.088776] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-28T21:39:21.088828] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-28T21:39:21.089000] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-28T21:39:21.089038] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-28T21:39:21.451834] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:21.580212] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-28T21:39:22.229562] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T21:39:22.282078] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T21:39:22.380264] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-28T21:39:23.180265] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-28T21:39:23.891745] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T21:39:23.907832] [INFO ] [REMOTE ] TWO: Full fetch complete (69301 records). [2025-10-28T21:39:23.912796] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T21:39:23.912433] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-28T21:39:23.985325] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-28T21:39:24.306200] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-28T21:39:24.306288] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-28T21:39:24.307411] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-28T21:39:24.307476] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-28T21:39:24.308851] [DEBUG] [LOCAL ] TWO: Trimmed 69301 records to 48394 (keeping 200 days of data) [2025-10-28T21:39:24.602006] [DEBUG] [LOCAL ] TWO: Primary data saved (48394 records). [2025-10-28T21:39:24.602933] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T21:39:24.602573] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-28T21:39:24.606478] [INFO ] [MAIN ] Update Progress: 2154/2366 symbols completed. TWO took 27.8s. Estimated remaining: 27m 30s. Rate: 7.7 symbols/min [2025-10-28T21:39:24.771417] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:24.780299] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-28T21:39:24.816450] [DEBUG] [LOCAL ] TXT: Loaded 49510 existing records from primary storage. [2025-10-28T21:39:24.816755] [INFO ] [MAIN ] TXT: Loaded 49510 existing records. [2025-10-28T21:39:24.990176] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:39:24.990398] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-28T21:39:24.990446] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-28T21:39:24.990639] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-28T21:39:24.990723] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-28T21:39:25.339545] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:25.580233] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-28T21:39:26.140872] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T21:39:26.162066] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T21:39:26.380260] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-28T21:39:27.180294] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-28T21:39:27.791095] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T21:39:27.980267] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-28T21:39:28.395500] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T21:39:28.585683] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:39:28.780241] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-28T21:39:29.580248] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-28T21:39:29.827615] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T21:39:30.331223] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T21:39:30.380206] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-28T21:39:31.180246] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-28T21:39:31.220453] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T21:39:31.980229] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-28T21:39:32.019910] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T21:39:32.780284] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-28T21:39:33.190386] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:39:33.500128] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T21:39:33.505336] [INFO ] [REMOTE ] TX: Full fetch complete (35418 records). [2025-10-28T21:39:33.505455] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-28T21:39:33.585479] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-28T21:39:33.916913] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-28T21:39:33.916990] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-28T21:39:33.917806] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-28T21:39:33.917884] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-28T21:39:33.918735] [DEBUG] [LOCAL ] TX: Trimmed 35418 records to 22682 (keeping 200 days of data) [2025-10-28T21:39:34.057937] [DEBUG] [LOCAL ] TX: Primary data saved (22682 records). [2025-10-28T21:39:34.058062] [INFO ] [MAIN ] TX: Full history saved. [2025-10-28T21:39:34.058142] [INFO ] [MAIN ] Update Progress: 2155/2366 symbols completed. TX took 30.7s. Estimated remaining: 27m 22s. Rate: 7.7 symbols/min [2025-10-28T21:39:34.245031] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:34.254925] [DEBUG] [LOCAL ] TY: Loaded 7414 existing records from primary storage. [2025-10-28T21:39:34.255126] [INFO ] [MAIN ] TY: Loaded 7414 existing records. [2025-10-28T21:39:34.385364] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-28T21:39:34.457777] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:39:34.457976] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-28T21:39:34.458023] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-28T21:39:34.458162] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-28T21:39:34.458201] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-28T21:39:34.821196] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:34.879992] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T21:39:35.180337] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-28T21:39:35.681337] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T21:39:35.980253] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-28T21:39:36.230067] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T21:39:36.780253] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-28T21:39:37.314584] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T21:39:37.421160] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:39:37.580264] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-28T21:39:38.124664] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T21:39:38.380280] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-28T21:39:38.904288] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T21:39:39.180285] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-28T21:39:39.980310] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-28T21:39:40.524431] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:39:40.780254] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-28T21:39:41.145163] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T21:39:41.153216] [INFO ] [REMOTE ] TXNM: Full fetch complete (62641 records). [2025-10-28T21:39:41.153363] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-28T21:39:41.529531] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-28T21:39:41.529605] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-28T21:39:41.530692] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-28T21:39:41.530752] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-28T21:39:41.531930] [DEBUG] [LOCAL ] TXNM: Trimmed 62641 records to 42528 (keeping 200 days of data) [2025-10-28T21:39:41.583336] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-28T21:39:41.791169] [DEBUG] [LOCAL ] TXNM: Primary data saved (42528 records). [2025-10-28T21:39:41.791298] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-28T21:39:41.791371] [INFO ] [MAIN ] Update Progress: 2156/2366 symbols completed. TXNM took 36.3s. Estimated remaining: 27m 14s. Rate: 7.7 symbols/min [2025-10-28T21:39:41.962394] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:39:41.977791] [DEBUG] [LOCAL ] TYG: Loaded 13708 existing records from primary storage. [2025-10-28T21:39:41.978069] [INFO ] [MAIN ] TYG: Loaded 13708 existing records. [2025-10-28T21:39:42.181629] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T21:39:42.185295] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:39:42.185511] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-28T21:39:42.185577] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-28T21:39:42.195676] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-28T21:39:42.195738] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-28T21:39:42.381548] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-28T21:39:42.392597] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T21:39:42.577506] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:39:42.940447] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T21:39:43.180257] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-28T21:39:43.672800] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T21:39:43.980437] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-28T21:39:44.472845] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T21:39:44.780267] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-28T21:39:45.261077] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T21:39:45.580268] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-28T21:39:46.380218] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-28T21:39:46.440791] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T21:39:47.180305] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-28T21:39:47.628011] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T21:39:47.753549] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T21:39:47.980257] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-28T21:39:48.693519] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T21:39:48.780229] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-28T21:39:49.459601] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T21:39:49.580273] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-28T21:39:50.139601] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T21:39:50.380261] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-28T21:39:51.042158] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T21:39:51.180340] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-28T21:39:51.884639] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T21:39:51.980251] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-28T21:39:52.646840] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T21:39:52.780277] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-28T21:39:53.569348] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T21:39:53.574293] [INFO ] [REMOTE ] TXO: Full fetch complete (27337 records). [2025-10-28T21:39:53.574414] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-28T21:39:53.585721] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-28T21:39:53.995277] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-28T21:39:53.995392] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-28T21:39:53.996013] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-28T21:39:53.996078] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-28T21:39:53.996903] [DEBUG] [LOCAL ] TXO: Trimmed 27337 records to 19939 (keeping 200 days of data) [2025-10-28T21:39:54.118692] [DEBUG] [LOCAL ] TXO: Primary data saved (19939 records). [2025-10-28T21:39:54.118869] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-28T21:39:54.119075] [INFO ] [MAIN ] Update Progress: 2157/2366 symbols completed. TXO took 33.4s. Estimated remaining: 27m 7s. Rate: 7.7 symbols/min [2025-10-28T21:39:54.140298] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T21:39:54.142273] [INFO ] [REMOTE ] TY: Full fetch complete (11332 records). [2025-10-28T21:39:54.142346] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-28T21:39:54.385457] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-28T21:39:54.526239] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-28T21:39:54.526318] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-28T21:39:54.526600] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-28T21:39:54.526638] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-28T21:39:54.527106] [DEBUG] [LOCAL ] TY: Trimmed 11332 records to 7397 (keeping 200 days of data) [2025-10-28T21:39:54.569781] [DEBUG] [LOCAL ] TY: Primary data saved (7397 records). [2025-10-28T21:39:54.569873] [INFO ] [MAIN ] TY: Full history saved. [2025-10-28T21:39:54.569947] [INFO ] [MAIN ] Update Progress: 2158/2366 symbols completed. TY took 20.5s. Estimated remaining: 26m 58s. Rate: 7.7 symbols/min [2025-10-28T21:39:55.180255] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-28T21:39:55.840089] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T21:39:55.907323] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T21:39:55.980219] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-28T21:39:56.780295] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-28T21:39:57.358067] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T21:39:57.515613] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T21:39:57.580209] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-28T21:39:57.994833] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T21:39:58.380254] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-28T21:39:59.180296] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-28T21:39:59.732933] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T21:39:59.742702] [INFO ] [REMOTE ] TXT: Full fetch complete (72513 records). [2025-10-28T21:39:59.742811] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-28T21:39:59.932211] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T21:40:00.015909] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-28T21:40:00.147339] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-28T21:40:00.147427] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-28T21:40:00.148580] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-28T21:40:00.148666] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-28T21:40:00.150100] [DEBUG] [LOCAL ] TXT: Trimmed 72513 records to 49496 (keeping 200 days of data) [2025-10-28T21:40:00.456757] [DEBUG] [LOCAL ] TXT: Primary data saved (49496 records). [2025-10-28T21:40:00.456923] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-28T21:40:00.457473] [INFO ] [MAIN ] Update Progress: 2159/2366 symbols completed. TXT took 35.9s. Estimated remaining: 26m 51s. Rate: 7.7 symbols/min [2025-10-28T21:40:01.090855] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T21:40:01.094497] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-28T21:40:01.638301] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T21:40:01.643467] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-28T21:40:02.219129] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T21:40:02.222956] [INFO ] [REMOTE ] TYG: Full fetch complete (21823 records). [2025-10-28T21:40:02.223117] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-28T21:40:02.678914] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-28T21:40:02.679007] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-28T21:40:02.679474] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-28T21:40:02.679538] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-28T21:40:02.680340] [DEBUG] [LOCAL ] TYG: Trimmed 21823 records to 13650 (keeping 200 days of data) [2025-10-28T21:40:02.764580] [DEBUG] [LOCAL ] TYG: Primary data saved (13650 records). [2025-10-28T21:40:02.764756] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-28T21:40:02.764846] [INFO ] [MAIN ] Update Progress: 2160/2366 symbols completed. TYG took 21.0s. Estimated remaining: 26m 42s. Rate: 7.7 symbols/min [2025-10-28T21:40:03.426384] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:03.469817] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:03.450318] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:03.490288] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:03.516096] [DEBUG] [LOCAL ] TYL: Loaded 21800 existing records from primary storage. [2025-10-28T21:40:03.516529] [INFO ] [MAIN ] TYL: Loaded 21800 existing records. [2025-10-28T21:40:03.719708] [DEBUG] [LOCAL ] UAA: Loaded 53496 existing records from primary storage. [2025-10-28T21:40:03.794364] [DEBUG] [LOCAL ] UA: Loaded 50395 existing records from primary storage. [2025-10-28T21:40:03.760197] [INFO ] [MAIN ] UAA: Loaded 53496 existing records. [2025-10-28T21:40:03.846843] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:03.847113] [INFO ] [MAIN ] UA: Loaded 50395 existing records. [2025-10-28T21:40:03.903200] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-28T21:40:03.908507] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-28T21:40:03.919055] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-28T21:40:03.949291] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-28T21:40:03.924396] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-28T21:40:03.984734] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-28T21:40:04.329894] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:04.356037] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-28T21:40:04.377928] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-28T21:40:04.498040] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-28T21:40:04.510196] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-28T21:40:04.566291] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:04.611342] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:04.640330] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-28T21:40:04.670706] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-28T21:40:04.679754] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-28T21:40:04.693863] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-28T21:40:04.714591] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-28T21:40:04.699090] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-28T21:40:04.781754] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-28T21:40:04.845418] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-28T21:40:05.191086] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:05.246673] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-28T21:40:05.764682] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:05.770613] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-28T21:40:05.813424] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:05.824125] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-28T21:40:05.883914] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:05.884467] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-28T21:40:06.218777] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T21:40:06.223076] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-28T21:40:07.071639] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:40:07.081705] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-28T21:40:07.101067] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T21:40:07.180208] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-28T21:40:07.340309] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T21:40:07.974067] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T21:40:07.984300] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-28T21:40:08.067453] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T21:40:08.306487] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T21:40:08.780292] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-28T21:40:09.267129] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T21:40:09.580287] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-28T21:40:09.751811] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T21:40:10.380242] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-28T21:40:10.866875] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T21:40:11.180311] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-28T21:40:11.804838] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T21:40:11.980252] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-28T21:40:12.043543] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T21:40:12.780256] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-28T21:40:13.504121] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T21:40:13.580242] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-28T21:40:13.894072] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-28T21:40:14.380256] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-28T21:40:14.482135] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T21:40:15.180338] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-28T21:40:15.980282] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-28T21:40:16.055789] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T21:40:16.082958] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T21:40:16.780246] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-28T21:40:17.577502] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T21:40:17.582268] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-28T21:40:17.858923] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T21:40:18.380310] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-28T21:40:19.172042] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T21:40:19.184359] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-28T21:40:19.980276] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-28T21:40:20.213861] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-28T21:40:20.655055] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T21:40:20.780244] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-28T21:40:21.321083] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:40:21.580254] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-28T21:40:22.019844] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:40:22.380285] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-28T21:40:23.180237] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-28T21:40:23.353845] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T21:40:23.585765] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:40:23.980267] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-28T21:40:24.428253] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T21:40:24.780303] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-28T21:40:25.569111] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T21:40:25.573987] [INFO ] [REMOTE ] TYL: Full fetch complete (31669 records). [2025-10-28T21:40:25.574125] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-28T21:40:25.586017] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-28T21:40:25.945104] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-28T21:40:26.022477] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-28T21:40:26.022564] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-28T21:40:26.023357] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-28T21:40:26.023420] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-28T21:40:26.024202] [DEBUG] [LOCAL ] TYL: Trimmed 31669 records to 21703 (keeping 200 days of data) [2025-10-28T21:40:26.154207] [DEBUG] [LOCAL ] TYL: Primary data saved (21703 records). [2025-10-28T21:40:26.154337] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-28T21:40:26.154414] [INFO ] [MAIN ] Update Progress: 2161/2366 symbols completed. TYL took 23.4s. Estimated remaining: 26m 36s. Rate: 7.7 symbols/min [2025-10-28T21:40:26.333696] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:26.340768] [DEBUG] [LOCAL ] UAN: Loaded 5101 existing records from primary storage. [2025-10-28T21:40:26.340962] [INFO ] [MAIN ] UAN: Loaded 5101 existing records. [2025-10-28T21:40:26.385444] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-28T21:40:26.532084] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:26.532320] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-28T21:40:26.532377] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-28T21:40:26.532518] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-28T21:40:26.532570] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-28T21:40:26.891712] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:27.180328] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-28T21:40:27.363169] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-28T21:40:27.980322] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-28T21:40:28.063908] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T21:40:28.610913] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:40:28.780290] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-28T21:40:29.218117] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T21:40:29.580253] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-28T21:40:29.978295] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T21:40:30.220731] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-28T21:40:30.380264] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-28T21:40:31.180324] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-28T21:40:31.675196] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T21:40:31.685411] [INFO ] [REMOTE ] UA: Full fetch complete (73261 records). [2025-10-28T21:40:31.685546] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-28T21:40:31.986284] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-28T21:40:32.082787] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-28T21:40:32.082867] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-28T21:40:32.084362] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-28T21:40:32.084422] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-28T21:40:32.085820] [DEBUG] [LOCAL ] UA: Trimmed 73261 records to 50396 (keeping 200 days of data) [2025-10-28T21:40:32.359242] [DEBUG] [LOCAL ] UA: Primary data saved (50396 records). [2025-10-28T21:40:32.359371] [INFO ] [MAIN ] UA: Full history saved. [2025-10-28T21:40:32.360283] [INFO ] [MAIN ] Update Progress: 2162/2366 symbols completed. UA took 29.6s. Estimated remaining: 26m 28s. Rate: 7.7 symbols/min [2025-10-28T21:40:32.538682] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:32.539676] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T21:40:32.591717] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-28T21:40:32.592024] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-28T21:40:32.781376] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-28T21:40:32.784524] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T21:40:32.827118] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:32.827545] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-28T21:40:32.827631] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-28T21:40:32.828246] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-28T21:40:32.828886] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-28T21:40:33.199095] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:33.267519] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T21:40:33.580264] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-28T21:40:34.380251] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-28T21:40:35.180266] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-28T21:40:35.380275] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T21:40:35.643410] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T21:40:35.980290] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-28T21:40:36.064170] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T21:40:36.400402] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T21:40:36.780248] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-28T21:40:37.580236] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-28T21:40:38.380248] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-28T21:40:38.559857] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T21:40:39.180240] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-28T21:40:39.533711] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-28T21:40:39.884974] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T21:40:39.980211] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-28T21:40:40.780335] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-28T21:40:41.290176] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-28T21:40:41.300906] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-28T21:40:41.301041] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-28T21:40:41.587801] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-28T21:40:41.701479] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-28T21:40:41.702085] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-28T21:40:41.703938] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-28T21:40:41.719414] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-28T21:40:41.737820] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-28T21:40:41.750774] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 53799 (keeping 200 days of data) [2025-10-28T21:40:41.750592] [INFO ] [REMOTE ] UAA: Full fetch complete (77643 records). [2025-10-28T21:40:41.751034] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-28T21:40:42.168828] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T21:40:42.397708] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-28T21:40:42.459467] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-28T21:40:42.459808] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-28T21:40:42.468270] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-28T21:40:42.486507] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-28T21:40:42.506612] [DEBUG] [LOCAL ] UAA: Trimmed 77643 records to 53496 (keeping 200 days of data) [2025-10-28T21:40:42.516315] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-28T21:40:42.516927] [INFO ] [MAIN ] U: Full history saved. [2025-10-28T21:40:42.517407] [INFO ] [MAIN ] Update Progress: 2163/2366 symbols completed. U took 39.8s. Estimated remaining: 26m 20s. Rate: 7.7 symbols/min [2025-10-28T21:40:42.809669] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:42.954585] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-28T21:40:43.020392] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T21:40:43.085826] [DEBUG] [LOCAL ] UAA: Primary data saved (53496 records). [2025-10-28T21:40:43.086062] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-28T21:40:43.098965] [INFO ] [MAIN ] Update Progress: 2164/2366 symbols completed. UAA took 40.3s. Estimated remaining: 26m 12s. Rate: 7.7 symbols/min [2025-10-28T21:40:43.143380] [DEBUG] [LOCAL ] UBS: Loaded 52230 existing records from primary storage. [2025-10-28T21:40:43.180503] [INFO ] [MAIN ] UBS: Loaded 52230 existing records. [2025-10-28T21:40:43.180372] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-28T21:40:43.413114] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:43.454854] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:43.455136] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-28T21:40:43.455183] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-28T21:40:43.455615] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-28T21:40:43.455700] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-28T21:40:43.767982] [DEBUG] [LOCAL ] UCB: Loaded 37432 existing records from primary storage. [2025-10-28T21:40:43.780178] [INFO ] [MAIN ] UCB: Loaded 37432 existing records. [2025-10-28T21:40:43.982009] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:43.992429] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-28T21:40:44.045181] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:44.045385] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-28T21:40:44.045431] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-28T21:40:44.045638] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-28T21:40:44.045726] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-28T21:40:44.392398] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:44.442519] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T21:40:44.780284] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-28T21:40:45.317914] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-28T21:40:45.580259] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-28T21:40:45.845346] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T21:40:46.380270] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-28T21:40:46.770133] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T21:40:46.771487] [INFO ] [REMOTE ] UAN: Full fetch complete (7820 records). [2025-10-28T21:40:46.771558] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-28T21:40:47.142670] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-28T21:40:47.142765] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-28T21:40:47.143013] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-28T21:40:47.143147] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-28T21:40:47.143551] [DEBUG] [LOCAL ] UAN: Trimmed 7820 records to 5045 (keeping 200 days of data) [2025-10-28T21:40:47.181550] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-28T21:40:47.198387] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T21:40:47.213294] [DEBUG] [LOCAL ] UAN: Primary data saved (5045 records). [2025-10-28T21:40:47.213363] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-28T21:40:47.213437] [INFO ] [MAIN ] Update Progress: 2165/2366 symbols completed. UAN took 21.1s. Estimated remaining: 26m 4s. Rate: 7.7 symbols/min [2025-10-28T21:40:47.381598] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:40:47.428511] [DEBUG] [LOCAL ] UDR: Loaded 52103 existing records from primary storage. [2025-10-28T21:40:47.428875] [INFO ] [MAIN ] UDR: Loaded 52103 existing records. [2025-10-28T21:40:47.602777] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:40:47.602998] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-28T21:40:47.603045] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-28T21:40:47.603227] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-28T21:40:47.603266] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-28T21:40:47.951145] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:40:47.980232] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-28T21:40:48.780331] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-28T21:40:49.214838] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-28T21:40:49.255062] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T21:40:49.580250] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-28T21:40:50.181491] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T21:40:50.380225] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-28T21:40:51.180252] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-28T21:40:51.335239] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T21:40:51.910342] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T21:40:51.974969] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T21:40:51.984295] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-28T21:40:52.780240] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-28T21:40:53.231958] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T21:40:53.580244] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-28T21:40:54.000291] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T21:40:54.380245] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-28T21:40:54.912210] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T21:40:55.180272] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-28T21:40:55.914885] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T21:40:55.980272] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-28T21:40:56.663906] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:40:56.780289] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-28T21:40:57.262315] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T21:40:57.580275] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-28T21:40:58.094847] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T21:40:58.380296] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-28T21:40:59.148481] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T21:40:59.180206] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-28T21:40:59.980256] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-28T21:41:00.768968] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T21:41:00.780198] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-28T21:41:00.897252] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-28T21:41:00.968541] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T21:41:01.580301] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-28T21:41:02.257469] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T21:41:02.380246] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-28T21:41:02.640017] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T21:41:03.180248] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-28T21:41:03.874510] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T21:41:03.980211] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-28T21:41:04.780237] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-28T21:41:05.027978] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-28T21:41:05.320966] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T21:41:05.580260] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-28T21:41:05.987984] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T21:41:06.380307] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-28T21:41:06.927564] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T21:41:06.938394] [INFO ] [REMOTE ] UBS: Full fetch complete (75950 records). [2025-10-28T21:41:06.938524] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-28T21:41:07.186942] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-28T21:41:07.339314] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-28T21:41:07.339390] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-28T21:41:07.340532] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-28T21:41:07.340594] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-28T21:41:07.341976] [DEBUG] [LOCAL ] UBS: Trimmed 75950 records to 52223 (keeping 200 days of data) [2025-10-28T21:41:07.644817] [DEBUG] [LOCAL ] UBS: Primary data saved (52223 records). [2025-10-28T21:41:07.644954] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-28T21:41:07.645061] [INFO ] [MAIN ] Update Progress: 2166/2366 symbols completed. UBS took 25.1s. Estimated remaining: 25m 57s. Rate: 7.7 symbols/min [2025-10-28T21:41:07.819763] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:07.858383] [DEBUG] [LOCAL ] UE: Loaded 42208 existing records from primary storage. [2025-10-28T21:41:07.858676] [INFO ] [MAIN ] UE: Loaded 42208 existing records. [2025-10-28T21:41:07.985309] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-28T21:41:08.037464] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:08.037661] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-28T21:41:08.037724] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-28T21:41:08.037915] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-28T21:41:08.037971] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-28T21:41:08.408030] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:08.431295] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T21:41:08.580112] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-28T21:41:08.780238] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-28T21:41:09.488696] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T21:41:09.580240] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-28T21:41:09.825073] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T21:41:10.029207] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T21:41:10.040436] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-28T21:41:10.040598] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-28T21:41:10.385424] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-28T21:41:10.445129] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-28T21:41:10.445224] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-28T21:41:10.446572] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-28T21:41:10.446635] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-28T21:41:10.448439] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 53806 (keeping 200 days of data) [2025-10-28T21:41:10.775724] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-28T21:41:10.775821] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-28T21:41:10.775897] [INFO ] [MAIN ] Update Progress: 2167/2366 symbols completed. UBER took 38.4s. Estimated remaining: 25m 49s. Rate: 7.7 symbols/min [2025-10-28T21:41:10.954160] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:10.964132] [DEBUG] [LOCAL ] UFI: Loaded 8077 existing records from primary storage. [2025-10-28T21:41:10.964404] [INFO ] [MAIN ] UFI: Loaded 8077 existing records. [2025-10-28T21:41:11.151076] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:11.151287] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-28T21:41:11.151334] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-28T21:41:11.151473] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-28T21:41:11.151516] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-28T21:41:11.185351] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-28T21:41:11.550343] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:11.572635] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:41:11.980247] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-28T21:41:12.483185] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T21:41:12.571730] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T21:41:12.780247] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-28T21:41:13.371499] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T21:41:13.580252] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-28T21:41:14.016289] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T21:41:14.380281] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-28T21:41:14.966211] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T21:41:15.180306] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-28T21:41:15.980258] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-28T21:41:16.259726] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:41:16.780946] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-28T21:41:16.785358] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:41:17.580243] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-28T21:41:17.863525] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T21:41:18.145846] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T21:41:18.380282] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-28T21:41:19.180310] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-28T21:41:19.408630] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T21:41:19.980320] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-28T21:41:20.559158] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T21:41:20.571381] [INFO ] [REMOTE ] UDR: Full fetch complete (75154 records). [2025-10-28T21:41:20.571576] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-28T21:41:20.789541] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-28T21:41:20.979219] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-28T21:41:20.979418] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-28T21:41:20.980850] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-28T21:41:20.980942] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-28T21:41:20.982890] [DEBUG] [LOCAL ] UDR: Trimmed 75154 records to 52104 (keeping 200 days of data) [2025-10-28T21:41:21.007792] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T21:41:21.319784] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T21:41:21.341973] [DEBUG] [LOCAL ] UDR: Primary data saved (52104 records). [2025-10-28T21:41:21.345405] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-28T21:41:21.345847] [INFO ] [MAIN ] Update Progress: 2168/2366 symbols completed. UDR took 34.1s. Estimated remaining: 25m 41s. Rate: 7.7 symbols/min [2025-10-28T21:41:21.513639] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:21.558746] [DEBUG] [LOCAL ] UGI: Loaded 50326 existing records from primary storage. [2025-10-28T21:41:21.559039] [INFO ] [MAIN ] UGI: Loaded 50326 existing records. [2025-10-28T21:41:21.587502] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-28T21:41:21.735225] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:21.735445] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-28T21:41:21.735491] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-28T21:41:21.735715] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-28T21:41:21.735771] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-28T21:41:22.082696] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:22.300316] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T21:41:22.380236] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-28T21:41:22.802558] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T21:41:23.180258] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-28T21:41:23.692419] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T21:41:23.980263] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-28T21:41:24.491931] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T21:41:24.494409] [INFO ] [REMOTE ] UFI: Full fetch complete (12358 records). [2025-10-28T21:41:24.494487] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-28T21:41:24.785464] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-28T21:41:24.855945] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-28T21:41:24.856060] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-28T21:41:24.856407] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-28T21:41:24.856455] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-28T21:41:24.856979] [DEBUG] [LOCAL ] UFI: Trimmed 12358 records to 8027 (keeping 200 days of data) [2025-10-28T21:41:24.903388] [DEBUG] [LOCAL ] UFI: Primary data saved (8027 records). [2025-10-28T21:41:24.903534] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-28T21:41:24.903614] [INFO ] [MAIN ] Update Progress: 2169/2366 symbols completed. UFI took 14.1s. Estimated remaining: 25m 33s. Rate: 7.7 symbols/min [2025-10-28T21:41:25.079295] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:25.117703] [DEBUG] [LOCAL ] UGP: Loaded 43006 existing records from primary storage. [2025-10-28T21:41:25.117982] [INFO ] [MAIN ] UGP: Loaded 43006 existing records. [2025-10-28T21:41:25.303385] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:25.303582] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-28T21:41:25.303627] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-28T21:41:25.303846] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-28T21:41:25.303891] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-28T21:41:25.585494] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-28T21:41:25.651138] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:25.906958] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T21:41:25.915219] [INFO ] [REMOTE ] UCB: Full fetch complete (55011 records). [2025-10-28T21:41:25.915359] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-28T21:41:26.325774] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-28T21:41:26.325866] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-28T21:41:26.326965] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-28T21:41:26.327031] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-28T21:41:26.328337] [DEBUG] [LOCAL ] UCB: Trimmed 55011 records to 37299 (keeping 200 days of data) [2025-10-28T21:41:26.388544] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-28T21:41:26.553993] [DEBUG] [LOCAL ] UCB: Primary data saved (37299 records). [2025-10-28T21:41:26.554131] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-28T21:41:26.554209] [INFO ] [MAIN ] Update Progress: 2170/2366 symbols completed. UCB took 43.5s. Estimated remaining: 25m 25s. Rate: 7.7 symbols/min [2025-10-28T21:41:26.728243] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:26.745551] [DEBUG] [LOCAL ] UHAL: Loaded 16733 existing records from primary storage. [2025-10-28T21:41:26.745825] [INFO ] [MAIN ] UHAL: Loaded 16733 existing records. [2025-10-28T21:41:26.934998] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:26.935219] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-28T21:41:26.935268] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-28T21:41:26.935450] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-28T21:41:26.935488] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-28T21:41:27.166375] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T21:41:27.191985] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-28T21:41:27.353301] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:27.557901] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T21:41:27.980309] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-28T21:41:28.369259] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T21:41:28.660689] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T21:41:28.780241] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-28T21:41:29.580289] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-28T21:41:29.917949] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T21:41:30.152682] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T21:41:30.380272] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-28T21:41:31.180260] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-28T21:41:31.471512] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T21:41:31.980252] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-28T21:41:32.445217] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T21:41:32.780246] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-28T21:41:32.935808] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T21:41:33.450943] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T21:41:33.580257] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-28T21:41:34.307863] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T21:41:34.380252] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-28T21:41:35.030591] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T21:41:35.180260] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-28T21:41:35.952418] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T21:41:35.980213] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-28T21:41:36.645288] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T21:41:36.780253] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-28T21:41:37.580331] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-28T21:41:37.877048] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:41:38.380260] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-28T21:41:38.716961] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T21:41:39.073987] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T21:41:39.180243] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-28T21:41:39.943182] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T21:41:39.980211] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-28T21:41:40.780249] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-28T21:41:40.987993] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T21:41:40.996070] [INFO ] [REMOTE ] UE: Full fetch complete (61005 records). [2025-10-28T21:41:40.996193] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-28T21:41:41.396429] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-28T21:41:41.396566] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-28T21:41:41.397909] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-28T21:41:41.398004] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-28T21:41:41.399506] [DEBUG] [LOCAL ] UE: Trimmed 61005 records to 42209 (keeping 200 days of data) [2025-10-28T21:41:41.551161] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T21:41:41.603637] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-28T21:41:41.603882] [INFO ] [REMOTE ] UHAL: Full fetch complete (23230 records). [2025-10-28T21:41:41.639592] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-28T21:41:41.807533] [DEBUG] [LOCAL ] UE: Primary data saved (42209 records). [2025-10-28T21:41:41.817908] [INFO ] [MAIN ] UE: Full history saved. [2025-10-28T21:41:41.818036] [INFO ] [MAIN ] Update Progress: 2171/2366 symbols completed. UE took 34.2s. Estimated remaining: 25m 18s. Rate: 7.7 symbols/min [2025-10-28T21:41:42.184267] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:42.266322] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-28T21:41:42.266407] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-28T21:41:42.267002] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-28T21:41:42.267120] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-28T21:41:42.268089] [DEBUG] [LOCAL ] UHAL: Trimmed 23230 records to 16728 (keeping 200 days of data) [2025-10-28T21:41:42.378977] [DEBUG] [LOCAL ] UHAL: Primary data saved (16728 records). [2025-10-28T21:41:42.379143] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-28T21:41:42.379239] [INFO ] [MAIN ] Update Progress: 2172/2366 symbols completed. UHAL took 15.8s. Estimated remaining: 25m 9s. Rate: 7.7 symbols/min [2025-10-28T21:41:42.390384] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-28T21:41:42.521347] [DEBUG] [LOCAL ] UHS: Loaded 39489 existing records from primary storage. [2025-10-28T21:41:42.553879] [INFO ] [MAIN ] UHS: Loaded 39489 existing records. [2025-10-28T21:41:42.616096] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:41:42.766062] [DEBUG] [LOCAL ] UHT: Loaded 10135 existing records from primary storage. [2025-10-28T21:41:42.766280] [INFO ] [MAIN ] UHT: Loaded 10135 existing records. [2025-10-28T21:41:42.765753] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:42.798715] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-28T21:41:42.845713] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-28T21:41:42.893595] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-28T21:41:42.894084] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-28T21:41:43.049001] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:41:43.074042] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-28T21:41:43.098312] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-28T21:41:43.101556] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-28T21:41:43.112426] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-28T21:41:43.119508] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T21:41:43.230359] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-28T21:41:43.646034] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:43.750523] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:41:43.898373] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T21:41:43.980238] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-28T21:41:44.562398] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T21:41:44.612317] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T21:41:44.780287] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-28T21:41:45.580250] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-28T21:41:46.047603] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T21:41:46.380264] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-28T21:41:46.769846] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:41:46.912376] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T21:41:47.180312] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-28T21:41:47.654915] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T21:41:47.980252] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-28T21:41:48.780298] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-28T21:41:49.210370] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T21:41:49.580264] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-28T21:41:50.031699] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T21:41:50.380251] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-28T21:41:50.811541] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T21:41:50.930945] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T21:41:51.180253] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-28T21:41:51.689566] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:41:51.980256] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-28T21:41:52.780270] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-28T21:41:53.097941] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T21:41:53.380714] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T21:41:53.580232] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-28T21:41:54.103907] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T21:41:54.380283] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-28T21:41:55.180329] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-28T21:41:55.636799] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:41:55.839638] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T21:41:55.980240] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-28T21:41:56.780260] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-28T21:41:57.201739] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T21:41:57.580251] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-28T21:41:58.113188] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T21:41:58.130883] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:41:58.380309] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-28T21:41:59.180246] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-28T21:41:59.605613] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T21:41:59.877278] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T21:41:59.880170] [INFO ] [REMOTE ] UHT: Full fetch complete (14994 records). [2025-10-28T21:41:59.880239] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-28T21:41:59.985309] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-28T21:42:00.252201] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-28T21:42:00.252275] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-28T21:42:00.252600] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-28T21:42:00.252638] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-28T21:42:00.253149] [DEBUG] [LOCAL ] UHT: Trimmed 14994 records to 10149 (keeping 200 days of data) [2025-10-28T21:42:00.313010] [DEBUG] [LOCAL ] UHT: Primary data saved (10149 records). [2025-10-28T21:42:00.313134] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-28T21:42:00.313208] [INFO ] [MAIN ] Update Progress: 2173/2366 symbols completed. UHT took 17.9s. Estimated remaining: 25m 3s. Rate: 7.7 symbols/min [2025-10-28T21:42:00.478081] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:00.493439] [DEBUG] [LOCAL ] UI: Loaded 14183 existing records from primary storage. [2025-10-28T21:42:00.493680] [INFO ] [MAIN ] UI: Loaded 14183 existing records. [2025-10-28T21:42:00.667146] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:00.667325] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-28T21:42:00.667371] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-28T21:42:00.667537] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-28T21:42:00.667594] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-28T21:42:00.785423] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-28T21:42:01.025494] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:01.463417] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T21:42:01.580262] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-28T21:42:01.927399] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T21:42:02.248281] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T21:42:02.380217] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-28T21:42:03.041869] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T21:42:03.180294] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-28T21:42:03.980259] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-28T21:42:04.457712] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:42:04.780250] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-28T21:42:05.265684] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T21:42:05.580284] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-28T21:42:05.937052] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:42:06.154084] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T21:42:06.380310] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-28T21:42:06.987060] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T21:42:07.180308] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-28T21:42:07.980325] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-28T21:42:08.391314] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:42:08.494608] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T21:42:08.780280] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-28T21:42:09.580256] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-28T21:42:09.813310] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T21:42:10.380267] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-28T21:42:10.674492] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T21:42:10.683739] [INFO ] [REMOTE ] UGP: Full fetch complete (62263 records). [2025-10-28T21:42:10.683863] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-28T21:42:11.060724] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T21:42:11.084256] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-28T21:42:11.084615] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-28T21:42:11.086014] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-28T21:42:11.086097] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-28T21:42:11.087379] [DEBUG] [LOCAL ] UGP: Trimmed 62263 records to 43031 (keeping 200 days of data) [2025-10-28T21:42:11.185467] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-28T21:42:11.335474] [DEBUG] [LOCAL ] UGP: Primary data saved (43031 records). [2025-10-28T21:42:11.335597] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-28T21:42:11.335694] [INFO ] [MAIN ] Update Progress: 2174/2366 symbols completed. UGP took 46.4s. Estimated remaining: 24m 55s. Rate: 7.7 symbols/min [2025-10-28T21:42:11.509840] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:11.542485] [DEBUG] [LOCAL ] UIS: Loaded 36276 existing records from primary storage. [2025-10-28T21:42:11.542794] [INFO ] [MAIN ] UIS: Loaded 36276 existing records. [2025-10-28T21:42:11.716251] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:11.716423] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-28T21:42:11.716468] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-28T21:42:11.716684] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-28T21:42:11.716739] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-28T21:42:11.990008] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-28T21:42:12.065583] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T21:42:12.129874] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:12.780248] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-28T21:42:13.196403] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T21:42:13.332675] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:42:13.580268] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-28T21:42:14.380273] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-28T21:42:14.491311] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T21:42:15.180274] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-28T21:42:15.623989] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T21:42:15.980269] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-28T21:42:16.153978] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T21:42:16.780237] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-28T21:42:16.828970] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T21:42:17.580397] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-28T21:42:18.319523] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T21:42:18.330441] [INFO ] [REMOTE ] UGI: Full fetch complete (73335 records). [2025-10-28T21:42:18.330600] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-28T21:42:18.385675] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-28T21:42:18.751123] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T21:42:18.749916] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-28T21:42:18.758797] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-28T21:42:18.759991] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-28T21:42:18.760067] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-28T21:42:18.761419] [DEBUG] [LOCAL ] UGI: Trimmed 73335 records to 50293 (keeping 200 days of data) [2025-10-28T21:42:19.060380] [DEBUG] [LOCAL ] UGI: Primary data saved (50293 records). [2025-10-28T21:42:19.060545] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-28T21:42:19.060899] [INFO ] [MAIN ] Update Progress: 2175/2366 symbols completed. UGI took 57.7s. Estimated remaining: 24m 47s. Rate: 7.7 symbols/min [2025-10-28T21:42:19.183732] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-28T21:42:19.234030] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:19.245793] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:42:19.295483] [DEBUG] [LOCAL ] UL: Loaded 53061 existing records from primary storage. [2025-10-28T21:42:19.295808] [INFO ] [MAIN ] UL: Loaded 53061 existing records. [2025-10-28T21:42:19.466545] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:19.466775] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-28T21:42:19.466823] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-28T21:42:19.467005] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-28T21:42:19.467043] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-28T21:42:19.816022] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:19.980219] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-28T21:42:20.424124] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T21:42:20.780240] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-28T21:42:21.417244] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T21:42:21.580239] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-28T21:42:21.827536] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T21:42:21.834588] [INFO ] [REMOTE ] UHS: Full fetch complete (58177 records). [2025-10-28T21:42:21.834719] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-28T21:42:22.204732] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-28T21:42:22.204819] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-28T21:42:22.205863] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-28T21:42:22.205923] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-28T21:42:22.207069] [DEBUG] [LOCAL ] UHS: Trimmed 58177 records to 39503 (keeping 200 days of data) [2025-10-28T21:42:22.388194] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-28T21:42:22.448328] [DEBUG] [LOCAL ] UHS: Primary data saved (39503 records). [2025-10-28T21:42:22.448462] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-28T21:42:22.448539] [INFO ] [MAIN ] Update Progress: 2176/2366 symbols completed. UHS took 40.6s. Estimated remaining: 24m 39s. Rate: 7.7 symbols/min [2025-10-28T21:42:22.613280] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:22.647700] [DEBUG] [LOCAL ] ULS: Loaded 38114 existing records from primary storage. [2025-10-28T21:42:22.647976] [INFO ] [MAIN ] ULS: Loaded 38114 existing records. [2025-10-28T21:42:22.821929] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:22.822160] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-28T21:42:22.822209] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-28T21:42:22.822423] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-28T21:42:22.822480] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-28T21:42:23.175945] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:23.186502] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-28T21:42:23.204554] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T21:42:23.508607] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T21:42:23.513067] [INFO ] [REMOTE ] UI: Full fetch complete (20150 records). [2025-10-28T21:42:23.513141] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-28T21:42:23.985398] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-28T21:42:23.999092] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-28T21:42:23.999172] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-28T21:42:23.999663] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-28T21:42:23.999727] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-28T21:42:24.000722] [DEBUG] [LOCAL ] UI: Trimmed 20150 records to 14354 (keeping 200 days of data) [2025-10-28T21:42:24.094814] [DEBUG] [LOCAL ] UI: Primary data saved (14354 records). [2025-10-28T21:42:24.094967] [INFO ] [MAIN ] UI: Full history saved. [2025-10-28T21:42:24.095064] [INFO ] [MAIN ] Update Progress: 2177/2366 symbols completed. UI took 23.8s. Estimated remaining: 24m 31s. Rate: 7.7 symbols/min [2025-10-28T21:42:24.276482] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:24.294948] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T21:42:24.349825] [DEBUG] [LOCAL ] UMC: Loaded 52657 existing records from primary storage. [2025-10-28T21:42:24.350204] [INFO ] [MAIN ] UMC: Loaded 52657 existing records. [2025-10-28T21:42:24.535582] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:24.535853] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-28T21:42:24.535902] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-28T21:42:24.536126] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-28T21:42:24.536185] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-28T21:42:24.789722] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-28T21:42:24.899291] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:24.923203] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T21:42:25.580250] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-28T21:42:25.758511] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T21:42:26.380237] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-28T21:42:26.975349] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:42:27.180251] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-28T21:42:27.488140] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T21:42:27.980264] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-28T21:42:28.621275] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T21:42:28.780269] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-28T21:42:29.358357] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T21:42:29.580263] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-28T21:42:29.788996] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T21:42:30.380296] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-28T21:42:31.060231] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:42:31.180213] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-28T21:42:31.287634] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T21:42:31.980243] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-28T21:42:32.673834] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T21:42:32.780220] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-28T21:42:33.176601] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T21:42:33.580243] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-28T21:42:34.193584] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:42:34.380249] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-28T21:42:34.838065] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:42:35.180240] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-28T21:42:35.424911] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T21:42:35.980247] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-28T21:42:36.717583] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T21:42:36.780237] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-28T21:42:36.916675] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T21:42:36.924298] [INFO ] [REMOTE ] UIS: Full fetch complete (51976 records). [2025-10-28T21:42:36.924429] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-28T21:42:37.351105] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-28T21:42:37.351185] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-28T21:42:37.352191] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-28T21:42:37.352253] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-28T21:42:37.353331] [DEBUG] [LOCAL ] UIS: Trimmed 51976 records to 36132 (keeping 200 days of data) [2025-10-28T21:42:37.551787] [DEBUG] [LOCAL ] UIS: Primary data saved (36132 records). [2025-10-28T21:42:37.551930] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-28T21:42:37.552018] [INFO ] [MAIN ] Update Progress: 2178/2366 symbols completed. UIS took 26.2s. Estimated remaining: 24m 23s. Rate: 7.7 symbols/min [2025-10-28T21:42:37.583515] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-28T21:42:37.723676] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:37.757377] [DEBUG] [LOCAL ] UMH: Loaded 33938 existing records from primary storage. [2025-10-28T21:42:37.757684] [INFO ] [MAIN ] UMH: Loaded 33938 existing records. [2025-10-28T21:42:37.934239] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:37.934435] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-28T21:42:37.934480] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-28T21:42:37.934757] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-28T21:42:37.934819] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-28T21:42:38.302082] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:38.351314] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T21:42:38.380242] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-28T21:42:38.772020] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T21:42:39.180232] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-28T21:42:39.688018] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T21:42:39.980253] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-28T21:42:40.780296] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-28T21:42:41.197061] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T21:42:41.236767] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-28T21:42:41.580296] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-28T21:42:41.703627] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T21:42:42.380263] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-28T21:42:43.187186] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-28T21:42:43.223299] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T21:42:43.220514] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T21:42:43.980264] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-28T21:42:44.597715] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T21:42:44.780242] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-28T21:42:45.065634] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T21:42:45.580296] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-28T21:42:46.075377] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:42:46.380274] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-28T21:42:46.737543] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T21:42:47.180290] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-28T21:42:47.820599] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T21:42:47.831245] [INFO ] [REMOTE ] UL: Full fetch complete (77078 records). [2025-10-28T21:42:47.831387] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-28T21:42:47.989387] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-28T21:42:48.246007] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-28T21:42:48.246208] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-28T21:42:48.247556] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-28T21:42:48.247784] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-28T21:42:48.249478] [DEBUG] [LOCAL ] UL: Trimmed 77078 records to 53059 (keeping 200 days of data) [2025-10-28T21:42:48.389533] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:42:48.603627] [DEBUG] [LOCAL ] UL: Primary data saved (53059 records). [2025-10-28T21:42:48.603774] [INFO ] [MAIN ] UL: Full history saved. [2025-10-28T21:42:48.604076] [INFO ] [MAIN ] Update Progress: 2179/2366 symbols completed. UL took 29.5s. Estimated remaining: 24m 16s. Rate: 7.7 symbols/min [2025-10-28T21:42:48.769387] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:48.783448] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-28T21:42:48.783336] [DEBUG] [LOCAL ] UNF: Loaded 11817 existing records from primary storage. [2025-10-28T21:42:48.784877] [INFO ] [MAIN ] UNF: Loaded 11817 existing records. [2025-10-28T21:42:48.964345] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:48.964525] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-28T21:42:48.964569] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-28T21:42:48.964751] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-28T21:42:48.964806] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-28T21:42:49.318741] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:49.584126] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-28T21:42:49.587057] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T21:42:49.828746] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T21:42:49.835720] [INFO ] [REMOTE ] ULS: Full fetch complete (53709 records). [2025-10-28T21:42:49.835869] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-28T21:42:50.210325] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-28T21:42:50.210397] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-28T21:42:50.211393] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-28T21:42:50.211453] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-28T21:42:50.212448] [DEBUG] [LOCAL ] ULS: Trimmed 53709 records to 38017 (keeping 200 days of data) [2025-10-28T21:42:50.344141] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T21:42:50.393021] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-28T21:42:50.455526] [DEBUG] [LOCAL ] ULS: Primary data saved (38017 records). [2025-10-28T21:42:50.455624] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-28T21:42:50.455727] [INFO ] [MAIN ] Update Progress: 2180/2366 symbols completed. ULS took 28.0s. Estimated remaining: 24m 8s. Rate: 7.7 symbols/min [2025-10-28T21:42:50.625532] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:50.662169] [DEBUG] [LOCAL ] UNFI: Loaded 42417 existing records from primary storage. [2025-10-28T21:42:50.662459] [INFO ] [MAIN ] UNFI: Loaded 42417 existing records. [2025-10-28T21:42:50.833754] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:50.833920] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-28T21:42:50.833966] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-28T21:42:50.834156] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-28T21:42:50.834194] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-28T21:42:51.177895] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:51.180206] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-28T21:42:51.857158] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T21:42:51.980219] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-28T21:42:52.080038] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T21:42:52.780269] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-28T21:42:53.280779] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T21:42:53.429880] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T21:42:53.580243] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-28T21:42:54.380315] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-28T21:42:54.460197] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T21:42:55.180266] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-28T21:42:55.813552] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T21:42:55.980265] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-28T21:42:56.014464] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T21:42:56.025157] [INFO ] [REMOTE ] UMC: Full fetch complete (76651 records). [2025-10-28T21:42:56.025305] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-28T21:42:56.408399] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-28T21:42:56.408475] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-28T21:42:56.409660] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-28T21:42:56.409722] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-28T21:42:56.411050] [DEBUG] [LOCAL ] UMC: Trimmed 76651 records to 52655 (keeping 200 days of data) [2025-10-28T21:42:56.723000] [DEBUG] [LOCAL ] UMC: Primary data saved (52655 records). [2025-10-28T21:42:56.723211] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-28T21:42:56.724096] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T21:42:56.723755] [INFO ] [MAIN ] Update Progress: 2181/2366 symbols completed. UMC took 32.6s. Estimated remaining: 23m 60s. Rate: 7.7 symbols/min [2025-10-28T21:42:56.788779] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-28T21:42:56.896043] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:42:56.943519] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-28T21:42:56.943835] [INFO ] [MAIN ] UNH: Loaded 53819 existing records. [2025-10-28T21:42:57.117293] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:42:57.117497] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-28T21:42:57.117545] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-28T21:42:57.117783] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-28T21:42:57.117846] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-28T21:42:57.466111] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:42:57.580255] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-28T21:42:58.078876] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T21:42:58.351046] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T21:42:58.380253] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-28T21:42:59.180267] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-28T21:42:59.980282] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-28T21:43:00.132484] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T21:43:00.439956] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:43:00.737725] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T21:43:00.780274] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-28T21:43:01.580224] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-28T21:43:01.696594] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T21:43:02.380299] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-28T21:43:02.669020] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T21:43:03.180258] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-28T21:43:03.980258] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-28T21:43:04.247956] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-28T21:43:04.484134] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:43:04.780241] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-28T21:43:04.959777] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T21:43:05.394210] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T21:43:05.580257] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-28T21:43:06.380285] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-28T21:43:06.697338] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T21:43:07.180285] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-28T21:43:07.804031] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:43:07.980264] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-28T21:43:08.194330] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T21:43:08.510313] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T21:43:08.780257] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-28T21:43:09.400395] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T21:43:09.580247] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-28T21:43:10.380237] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-28T21:43:10.555546] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T21:43:11.180242] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-28T21:43:11.980214] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-28T21:43:12.114291] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T21:43:12.194184] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T21:43:12.630685] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T21:43:12.634682] [INFO ] [REMOTE ] UNF: Full fetch complete (17675 records). [2025-10-28T21:43:12.634790] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-28T21:43:12.793993] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-28T21:43:13.028718] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-28T21:43:13.028819] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-28T21:43:13.029193] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-28T21:43:13.029232] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-28T21:43:13.029767] [DEBUG] [LOCAL ] UNF: Trimmed 17675 records to 11776 (keeping 200 days of data) [2025-10-28T21:43:13.104378] [DEBUG] [LOCAL ] UNF: Primary data saved (11776 records). [2025-10-28T21:43:13.104531] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-28T21:43:13.104619] [INFO ] [MAIN ] Update Progress: 2182/2366 symbols completed. UNF took 24.5s. Estimated remaining: 23m 53s. Rate: 7.7 symbols/min [2025-10-28T21:43:13.267902] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:13.310524] [DEBUG] [LOCAL ] UNM: Loaded 47761 existing records from primary storage. [2025-10-28T21:43:13.310863] [INFO ] [MAIN ] UNM: Loaded 47761 existing records. [2025-10-28T21:43:13.482262] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:13.482463] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-28T21:43:13.482509] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-28T21:43:13.482748] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-28T21:43:13.482803] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-28T21:43:13.585391] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-28T21:43:13.831293] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:13.937031] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T21:43:14.380481] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-28T21:43:14.744386] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T21:43:15.180263] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-28T21:43:15.373574] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T21:43:15.385519] [INFO ] [REMOTE ] UMH: Full fetch complete (47465 records). [2025-10-28T21:43:15.385769] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-28T21:43:15.811774] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-28T21:43:15.811878] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-28T21:43:15.813447] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-28T21:43:15.813512] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-28T21:43:15.814638] [DEBUG] [LOCAL ] UMH: Trimmed 47465 records to 33879 (keeping 200 days of data) [2025-10-28T21:43:15.995279] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-28T21:43:16.024253] [DEBUG] [LOCAL ] UMH: Primary data saved (33879 records). [2025-10-28T21:43:16.024367] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-28T21:43:16.024472] [INFO ] [MAIN ] Update Progress: 2183/2366 symbols completed. UMH took 38.5s. Estimated remaining: 23m 45s. Rate: 7.7 symbols/min [2025-10-28T21:43:16.189794] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:16.195292] [DEBUG] [LOCAL ] UNMA: Loaded 3362 existing records from primary storage. [2025-10-28T21:43:16.195446] [INFO ] [MAIN ] UNMA: Loaded 3362 existing records. [2025-10-28T21:43:16.368930] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:16.369140] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-28T21:43:16.369206] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-28T21:43:16.369379] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-28T21:43:16.369436] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-28T21:43:16.714215] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:16.780237] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-28T21:43:17.113083] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T21:43:17.124142] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T21:43:17.158102] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:43:17.580256] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-28T21:43:18.380318] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-28T21:43:19.180303] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-28T21:43:19.571835] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T21:43:19.580611] [INFO ] [REMOTE ] UNFI: Full fetch complete (59946 records). [2025-10-28T21:43:19.580745] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-28T21:43:19.970418] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-28T21:43:19.970552] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-28T21:43:19.971876] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-28T21:43:19.972087] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-28T21:43:19.973854] [DEBUG] [LOCAL ] UNFI: Trimmed 59946 records to 42371 (keeping 200 days of data) [2025-10-28T21:43:20.021908] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-28T21:43:20.248323] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-28T21:43:20.279407] [DEBUG] [LOCAL ] UNFI: Primary data saved (42371 records). [2025-10-28T21:43:20.280488] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-28T21:43:20.280691] [INFO ] [MAIN ] Update Progress: 2184/2366 symbols completed. UNFI took 29.8s. Estimated remaining: 23m 36s. Rate: 7.7 symbols/min [2025-10-28T21:43:20.483592] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:20.484023] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T21:43:20.516906] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:43:20.569293] [DEBUG] [LOCAL ] UNP: Loaded 53359 existing records from primary storage. [2025-10-28T21:43:20.569591] [INFO ] [MAIN ] UNP: Loaded 53359 existing records. [2025-10-28T21:43:20.740590] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:20.740801] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-28T21:43:20.740849] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-28T21:43:20.741042] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-28T21:43:20.741080] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-28T21:43:20.785456] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-28T21:43:21.085030] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:21.580312] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-28T21:43:22.380327] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-28T21:43:22.834911] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-28T21:43:22.856407] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T21:43:23.111035] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T21:43:23.180215] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-28T21:43:23.980312] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-28T21:43:24.332039] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T21:43:24.546334] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T21:43:24.780276] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-28T21:43:25.580286] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-28T21:43:26.192294] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T21:43:26.380273] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-28T21:43:26.630476] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T21:43:27.180283] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-28T21:43:27.980277] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-28T21:43:28.617156] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T21:43:28.763787] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-28T21:43:28.780236] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-28T21:43:29.319067] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T21:43:29.580278] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-28T21:43:30.380283] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-28T21:43:30.732046] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T21:43:30.841498] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-28T21:43:30.969138] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T21:43:31.180274] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-28T21:43:31.980274] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-28T21:43:32.528132] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T21:43:32.780282] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-28T21:43:33.340371] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T21:43:33.580295] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-28T21:43:34.010086] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T21:43:34.385410] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-28T21:43:34.405342] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T21:43:35.180270] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-28T21:43:35.615069] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T21:43:35.980271] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-28T21:43:36.549449] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-28T21:43:36.780281] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-28T21:43:37.217326] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T21:43:37.229825] [INFO ] [REMOTE ] UNH: Full fetch complete (77962 records). [2025-10-28T21:43:37.230049] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-28T21:43:37.432468] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T21:43:37.585457] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-28T21:43:37.722302] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-28T21:43:37.722410] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-28T21:43:37.724329] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-28T21:43:37.724398] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-28T21:43:37.726566] [DEBUG] [LOCAL ] UNH: Trimmed 77962 records to 53819 (keeping 200 days of data) [2025-10-28T21:43:38.095872] [DEBUG] [LOCAL ] UNH: Primary data saved (53819 records). [2025-10-28T21:43:38.096105] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-28T21:43:38.096221] [INFO ] [MAIN ] Update Progress: 2185/2366 symbols completed. UNH took 41.4s. Estimated remaining: 23m 29s. Rate: 7.7 symbols/min [2025-10-28T21:43:38.280438] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:38.330879] [DEBUG] [LOCAL ] UP: Loaded 44705 existing records from primary storage. [2025-10-28T21:43:38.331298] [INFO ] [MAIN ] UP: Loaded 44705 existing records. [2025-10-28T21:43:38.393109] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-28T21:43:38.541393] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:38.541748] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-28T21:43:38.541806] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-28T21:43:38.542061] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-28T21:43:38.542118] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-28T21:43:38.935233] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:38.971592] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T21:43:39.180306] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-28T21:43:39.929741] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T21:43:39.980317] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-28T21:43:40.303139] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T21:43:40.345374] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T21:43:40.780270] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-28T21:43:41.580288] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-28T21:43:41.865504] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T21:43:41.914507] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:43:42.380274] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-28T21:43:42.832993] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T21:43:42.844456] [INFO ] [REMOTE ] UNP: Full fetch complete (77158 records). [2025-10-28T21:43:42.844708] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-28T21:43:43.185382] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-28T21:43:43.259480] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-28T21:43:43.259595] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-28T21:43:43.261415] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-28T21:43:43.261481] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-28T21:43:43.263560] [DEBUG] [LOCAL ] UNP: Trimmed 77158 records to 53355 (keeping 200 days of data) [2025-10-28T21:43:43.633765] [DEBUG] [LOCAL ] UNP: Primary data saved (53355 records). [2025-10-28T21:43:43.633987] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-28T21:43:43.634378] [INFO ] [MAIN ] Update Progress: 2186/2366 symbols completed. UNP took 23.4s. Estimated remaining: 23m 22s. Rate: 7.7 symbols/min [2025-10-28T21:43:43.727375] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T21:43:43.746250] [INFO ] [REMOTE ] UNMA: Full fetch complete (5352 records). [2025-10-28T21:43:43.762016] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-28T21:43:43.920472] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:43.994770] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-28T21:43:44.255771] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-28T21:43:44.255875] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-28T21:43:44.256136] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-28T21:43:44.256197] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-28T21:43:44.256670] [DEBUG] [LOCAL ] UNMA: Trimmed 5352 records to 3353 (keeping 200 days of data) [2025-10-28T21:43:44.296597] [DEBUG] [LOCAL ] UNMA: Primary data saved (3353 records). [2025-10-28T21:43:44.298078] [DEBUG] [LOCAL ] UPS: Loaded 53721 existing records from primary storage. [2025-10-28T21:43:44.298494] [INFO ] [MAIN ] UPS: Loaded 53721 existing records. [2025-10-28T21:43:44.298337] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-28T21:43:44.303802] [INFO ] [MAIN ] Update Progress: 2187/2366 symbols completed. UNMA took 28.3s. Estimated remaining: 23m 13s. Rate: 7.7 symbols/min [2025-10-28T21:43:44.636808] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:44.683692] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:44.664306] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-28T21:43:44.683869] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-28T21:43:44.684426] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-28T21:43:44.684482] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-28T21:43:44.784960] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-28T21:43:45.030332] [DEBUG] [LOCAL ] URI: Loaded 34205 existing records from primary storage. [2025-10-28T21:43:45.041504] [INFO ] [MAIN ] URI: Loaded 34205 existing records. [2025-10-28T21:43:45.203162] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:45.302233] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:45.302759] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-28T21:43:45.302844] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-28T21:43:45.303127] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-28T21:43:45.303254] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-28T21:43:45.581997] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-28T21:43:45.597840] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T21:43:45.759525] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:45.782908] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T21:43:46.380353] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-28T21:43:47.180267] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-28T21:43:47.308264] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T21:43:47.805935] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:43:47.980250] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-28T21:43:48.475280] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T21:43:48.780300] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-28T21:43:49.077820] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:43:49.580299] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-28T21:43:50.081443] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T21:43:50.380263] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-28T21:43:50.791941] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T21:43:51.180254] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-28T21:43:51.738311] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T21:43:51.980254] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-28T21:43:52.230909] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T21:43:52.780246] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-28T21:43:53.308223] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T21:43:53.580301] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-28T21:43:53.829787] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T21:43:54.380279] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-28T21:43:54.591980] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T21:43:54.601034] [INFO ] [REMOTE ] UNM: Full fetch complete (69850 records). [2025-10-28T21:43:54.601189] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-28T21:43:54.992964] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-28T21:43:54.993047] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-28T21:43:54.994193] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-28T21:43:54.994254] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-28T21:43:54.995587] [DEBUG] [LOCAL ] UNM: Trimmed 69850 records to 47710 (keeping 200 days of data) [2025-10-28T21:43:55.180257] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-28T21:43:55.291509] [DEBUG] [LOCAL ] UNM: Primary data saved (47710 records). [2025-10-28T21:43:55.291671] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-28T21:43:55.291777] [INFO ] [MAIN ] Update Progress: 2188/2366 symbols completed. UNM took 42.2s. Estimated remaining: 23m 6s. Rate: 7.7 symbols/min [2025-10-28T21:43:55.468249] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:43:55.516767] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T21:43:55.540829] [DEBUG] [LOCAL ] USA: Loaded 36172 existing records from primary storage. [2025-10-28T21:43:55.541264] [INFO ] [MAIN ] USA: Loaded 36172 existing records. [2025-10-28T21:43:55.724307] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:43:55.724565] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-28T21:43:55.724620] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-28T21:43:55.724963] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-28T21:43:55.725024] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-28T21:43:55.985914] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-28T21:43:56.109837] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:43:56.274371] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T21:43:56.780277] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-28T21:43:57.580267] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-28T21:43:57.657475] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T21:43:57.688745] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T21:43:58.380296] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-28T21:43:58.747370] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T21:43:59.180245] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-28T21:43:59.544365] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T21:43:59.980246] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-28T21:44:00.153775] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T21:44:00.780291] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-28T21:44:01.341462] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T21:44:01.580314] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-28T21:44:02.380351] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-28T21:44:02.492101] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T21:44:02.529095] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T21:44:03.180258] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-28T21:44:03.980246] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-28T21:44:04.038127] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T21:44:04.136042] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T21:44:04.780308] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-28T21:44:05.580255] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-28T21:44:05.668438] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T21:44:05.819370] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T21:44:06.380261] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-28T21:44:06.547358] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T21:44:07.180263] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-28T21:44:07.980283] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-28T21:44:08.166564] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T21:44:08.299680] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T21:44:08.780294] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-28T21:44:08.959503] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T21:44:09.580233] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-28T21:44:09.768258] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T21:44:10.380302] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-28T21:44:10.736851] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T21:44:10.744129] [INFO ] [REMOTE ] URI: Full fetch complete (52692 records). [2025-10-28T21:44:10.744347] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-28T21:44:11.171288] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-28T21:44:11.171428] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-28T21:44:11.173958] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-28T21:44:11.174103] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-28T21:44:11.187010] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-28T21:44:11.187311] [DEBUG] [LOCAL ] URI: Trimmed 52692 records to 34110 (keeping 200 days of data) [2025-10-28T21:44:11.208124] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T21:44:11.313507] [INFO ] [REMOTE ] UP: Full fetch complete (63126 records). [2025-10-28T21:44:11.315042] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-28T21:44:11.849999] [DEBUG] [LOCAL ] URI: Primary data saved (34110 records). [2025-10-28T21:44:11.857974] [INFO ] [MAIN ] URI: Full history saved. [2025-10-28T21:44:11.875298] [INFO ] [MAIN ] Update Progress: 2189/2366 symbols completed. URI took 27.5s. Estimated remaining: 22m 59s. Rate: 7.7 symbols/min [2025-10-28T21:44:11.878962] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-28T21:44:11.884423] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-28T21:44:11.929508] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-28T21:44:11.929612] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-28T21:44:11.984525] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-28T21:44:11.997570] [DEBUG] [LOCAL ] UP: Trimmed 63126 records to 44754 (keeping 200 days of data) [2025-10-28T21:44:12.128495] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:12.315373] [DEBUG] [LOCAL ] USAC: Loaded 21460 existing records from primary storage. [2025-10-28T21:44:12.330942] [INFO ] [MAIN ] USAC: Loaded 21460 existing records. [2025-10-28T21:44:12.446116] [DEBUG] [LOCAL ] UP: Primary data saved (44754 records). [2025-10-28T21:44:12.448678] [INFO ] [MAIN ] UP: Full history saved. [2025-10-28T21:44:12.455059] [INFO ] [MAIN ] Update Progress: 2190/2366 symbols completed. UP took 34.4s. Estimated remaining: 22m 50s. Rate: 7.7 symbols/min [2025-10-28T21:44:12.643504] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:12.659442] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-28T21:44:12.682800] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-28T21:44:12.714000] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:12.710930] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-28T21:44:12.714165] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-28T21:44:13.090518] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-28T21:44:13.133820] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-28T21:44:13.133351] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:13.150841] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-28T21:44:13.369464] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:13.356954] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-28T21:44:13.370076] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-28T21:44:13.408626] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-28T21:44:13.413231] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-28T21:44:13.413727] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-28T21:44:13.415538] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:44:13.606081] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-28T21:44:13.792267] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:14.007349] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T21:44:14.380321] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-28T21:44:15.180236] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-28T21:44:15.331523] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T21:44:15.721818] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T21:44:15.980230] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-28T21:44:16.043529] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T21:44:16.780296] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-28T21:44:17.379092] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T21:44:17.580237] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-28T21:44:17.719721] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T21:44:18.380234] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-28T21:44:19.180226] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-28T21:44:19.468977] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-28T21:44:19.580912] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:44:19.980322] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-28T21:44:20.120527] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T21:44:20.780328] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-28T21:44:21.580312] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-28T21:44:21.678744] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-28T21:44:22.175131] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T21:44:22.314687] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T21:44:22.380211] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-28T21:44:23.180499] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-28T21:44:23.181212] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T21:44:23.980248] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-28T21:44:24.322941] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T21:44:24.333931] [INFO ] [REMOTE ] USA: Full fetch complete (52565 records). [2025-10-28T21:44:24.334064] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-28T21:44:24.722419] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-28T21:44:24.722577] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-28T21:44:24.723607] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-28T21:44:24.723760] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-28T21:44:24.737842] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T21:44:24.743411] [DEBUG] [LOCAL ] USA: Trimmed 52565 records to 36113 (keeping 200 days of data) [2025-10-28T21:44:24.789986] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-28T21:44:24.949147] [DEBUG] [LOCAL ] USA: Primary data saved (36113 records). [2025-10-28T21:44:24.949276] [INFO ] [MAIN ] USA: Full history saved. [2025-10-28T21:44:24.949367] [INFO ] [MAIN ] Update Progress: 2191/2366 symbols completed. USA took 29.7s. Estimated remaining: 22m 43s. Rate: 7.7 symbols/min [2025-10-28T21:44:25.141379] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:25.192134] [DEBUG] [LOCAL ] USFD: Loaded 51030 existing records from primary storage. [2025-10-28T21:44:25.192580] [INFO ] [MAIN ] USFD: Loaded 51030 existing records. [2025-10-28T21:44:25.386428] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:25.386859] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-28T21:44:25.386966] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-28T21:44:25.387420] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-28T21:44:25.387487] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-28T21:44:25.580427] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-28T21:44:25.757627] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T21:44:25.810883] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:25.811369] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-28T21:44:25.811450] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-28T21:44:26.214813] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-28T21:44:26.214891] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-28T21:44:26.216285] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-28T21:44:26.216347] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-28T21:44:26.217753] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 53721 (keeping 200 days of data) [2025-10-28T21:44:26.397191] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-28T21:44:26.556273] [DEBUG] [LOCAL ] UPS: Primary data saved (53721 records). [2025-10-28T21:44:26.556412] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-28T21:44:26.556493] [INFO ] [MAIN ] Update Progress: 2192/2366 symbols completed. UPS took 42.9s. Estimated remaining: 22m 34s. Rate: 7.7 symbols/min [2025-10-28T21:44:26.741209] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:26.759681] [DEBUG] [LOCAL ] USNA: Loaded 17931 existing records from primary storage. [2025-10-28T21:44:26.759939] [INFO ] [MAIN ] USNA: Loaded 17931 existing records. [2025-10-28T21:44:26.954289] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:26.955021] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-28T21:44:26.955146] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-28T21:44:26.955520] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-28T21:44:26.955580] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-28T21:44:27.189462] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-28T21:44:27.274216] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T21:44:27.337090] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:27.378915] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-28T21:44:27.980300] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-28T21:44:28.346003] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T21:44:28.616049] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:44:28.780297] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-28T21:44:29.580266] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-28T21:44:30.117195] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:44:30.333275] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T21:44:30.380219] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-28T21:44:31.180255] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-28T21:44:31.237703] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:44:31.980298] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-28T21:44:32.491553] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T21:44:32.730511] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T21:44:32.780242] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-28T21:44:33.537385] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T21:44:33.580221] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-28T21:44:34.309889] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T21:44:34.314539] [INFO ] [REMOTE ] USAC: Full fetch complete (35521 records). [2025-10-28T21:44:34.314620] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-28T21:44:34.385439] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-28T21:44:34.687457] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-28T21:44:34.687532] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-28T21:44:34.688358] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-28T21:44:34.688423] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-28T21:44:34.689220] [DEBUG] [LOCAL ] USAC: Trimmed 35521 records to 21458 (keeping 200 days of data) [2025-10-28T21:44:34.824468] [DEBUG] [LOCAL ] USAC: Primary data saved (21458 records). [2025-10-28T21:44:34.824612] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-28T21:44:34.824741] [INFO ] [MAIN ] Update Progress: 2193/2366 symbols completed. USAC took 22.9s. Estimated remaining: 22m 27s. Rate: 7.7 symbols/min [2025-10-28T21:44:34.996079] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:35.012454] [DEBUG] [LOCAL ] USPH: Loaded 16747 existing records from primary storage. [2025-10-28T21:44:35.012720] [INFO ] [MAIN ] USPH: Loaded 16747 existing records. [2025-10-28T21:44:35.185598] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-28T21:44:35.191060] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:35.191500] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-28T21:44:35.192946] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-28T21:44:35.193419] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-28T21:44:35.193479] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-28T21:44:35.477206] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T21:44:35.572957] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:35.980317] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-28T21:44:36.544537] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T21:44:36.651429] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T21:44:36.780243] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-28T21:44:37.580269] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-28T21:44:38.098080] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T21:44:38.380255] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-28T21:44:39.029327] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T21:44:39.061299] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T21:44:39.180259] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-28T21:44:39.783156] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T21:44:39.980252] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-28T21:44:40.780243] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-28T21:44:41.415407] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T21:44:41.580226] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-28T21:44:41.658985] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T21:44:42.270068] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T21:44:42.380276] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-28T21:44:43.015148] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T21:44:43.180279] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-28T21:44:43.824315] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T21:44:43.980293] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-28T21:44:44.780288] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-28T21:44:45.360973] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T21:44:45.580264] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-28T21:44:46.139068] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T21:44:46.151608] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T21:44:46.380248] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-28T21:44:47.180310] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-28T21:44:47.331432] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T21:44:47.336350] [INFO ] [REMOTE ] USNA: Full fetch complete (27471 records). [2025-10-28T21:44:47.336437] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-28T21:44:47.703487] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-28T21:44:47.703563] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-28T21:44:47.704133] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-28T21:44:47.704197] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-28T21:44:47.704872] [DEBUG] [LOCAL ] USNA: Trimmed 27471 records to 17994 (keeping 200 days of data) [2025-10-28T21:44:47.811486] [DEBUG] [LOCAL ] USNA: Primary data saved (17994 records). [2025-10-28T21:44:47.811628] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-28T21:44:47.811750] [INFO ] [MAIN ] Update Progress: 2194/2366 symbols completed. USNA took 21.3s. Estimated remaining: 22m 19s. Rate: 7.7 symbols/min [2025-10-28T21:44:47.978952] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:47.980367] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-28T21:44:48.012011] [DEBUG] [LOCAL ] UTF: Loaded 31007 existing records from primary storage. [2025-10-28T21:44:48.012299] [INFO ] [MAIN ] UTF: Loaded 31007 existing records. [2025-10-28T21:44:48.188989] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:48.189225] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-28T21:44:48.189271] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-28T21:44:48.189571] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-28T21:44:48.189678] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-28T21:44:48.562825] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:48.604984] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T21:44:48.780274] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-28T21:44:49.411588] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T21:44:49.585444] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-28T21:44:49.602284] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T21:44:50.083803] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T21:44:50.096105] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-28T21:44:50.096331] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-28T21:44:50.385443] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-28T21:44:50.551999] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-28T21:44:50.552132] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-28T21:44:50.553867] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-28T21:44:50.553936] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-28T21:44:50.556066] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 53688 (keeping 200 days of data) [2025-10-28T21:44:50.936403] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-28T21:44:50.936612] [INFO ] [MAIN ] USB: Full history saved. [2025-10-28T21:44:50.936746] [INFO ] [MAIN ] Update Progress: 2195/2366 symbols completed. USB took 38.5s. Estimated remaining: 22m 11s. Rate: 7.7 symbols/min [2025-10-28T21:44:51.139281] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:44:51.158230] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T21:44:51.184021] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-28T21:44:51.204268] [DEBUG] [LOCAL ] UTI: Loaded 40222 existing records from primary storage. [2025-10-28T21:44:51.204689] [INFO ] [MAIN ] UTI: Loaded 40222 existing records. [2025-10-28T21:44:51.391117] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:44:51.391461] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-28T21:44:51.391522] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-28T21:44:51.391791] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-28T21:44:51.391850] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-28T21:44:51.773298] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:44:51.980250] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-28T21:44:52.093886] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T21:44:52.780311] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-28T21:44:52.984209] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T21:44:53.439736] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T21:44:53.580274] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-28T21:44:54.380255] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-28T21:44:54.702585] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T21:44:55.180889] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-28T21:44:55.639324] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T21:44:55.862704] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T21:44:55.980230] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-28T21:44:56.780327] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-28T21:44:57.220354] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T21:44:57.580269] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-28T21:44:57.772486] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:44:58.297782] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T21:44:58.380262] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-28T21:44:59.180257] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-28T21:44:59.447925] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T21:44:59.980308] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-28T21:45:00.295168] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T21:45:00.780276] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-28T21:45:01.523163] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T21:45:01.580266] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-28T21:45:01.974609] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T21:45:02.380308] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-28T21:45:02.914748] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T21:45:02.924740] [INFO ] [REMOTE ] USFD: Full fetch complete (74263 records). [2025-10-28T21:45:02.924899] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-28T21:45:03.185505] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-28T21:45:03.317311] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-28T21:45:03.317393] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-28T21:45:03.318636] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-28T21:45:03.318720] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-28T21:45:03.320122] [DEBUG] [LOCAL ] USFD: Trimmed 74263 records to 51008 (keeping 200 days of data) [2025-10-28T21:45:03.619455] [DEBUG] [LOCAL ] USFD: Primary data saved (51008 records). [2025-10-28T21:45:03.619593] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-28T21:45:03.619743] [INFO ] [MAIN ] Update Progress: 2196/2366 symbols completed. USFD took 38.7s. Estimated remaining: 22m 4s. Rate: 7.7 symbols/min [2025-10-28T21:45:03.741075] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T21:45:03.818093] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:03.830564] [DEBUG] [LOCAL ] UTL: Loaded 11797 existing records from primary storage. [2025-10-28T21:45:03.830795] [INFO ] [MAIN ] UTL: Loaded 11797 existing records. [2025-10-28T21:45:04.001000] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-28T21:45:04.006861] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:04.007710] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-28T21:45:04.007767] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-28T21:45:04.007917] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-28T21:45:04.007957] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-28T21:45:04.313168] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:45:04.382813] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:04.780279] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-28T21:45:04.816545] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T21:45:05.580316] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-28T21:45:06.124788] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:45:06.380282] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-28T21:45:06.481340] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T21:45:07.052854] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T21:45:07.180306] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-28T21:45:07.824499] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T21:45:07.828116] [INFO ] [REMOTE ] USPH: Full fetch complete (22981 records). [2025-10-28T21:45:07.828187] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-28T21:45:07.986752] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-28T21:45:08.225555] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-28T21:45:08.225635] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-28T21:45:08.226209] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-28T21:45:08.226269] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-28T21:45:08.227065] [DEBUG] [LOCAL ] USPH: Trimmed 22981 records to 16679 (keeping 200 days of data) [2025-10-28T21:45:08.328876] [DEBUG] [LOCAL ] USPH: Primary data saved (16679 records). [2025-10-28T21:45:08.329015] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-28T21:45:08.329092] [INFO ] [MAIN ] Update Progress: 2197/2366 symbols completed. USPH took 33.5s. Estimated remaining: 21m 56s. Rate: 7.7 symbols/min [2025-10-28T21:45:08.780304] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-28T21:45:09.129491] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T21:45:09.580270] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-28T21:45:09.769307] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T21:45:10.380248] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-28T21:45:10.650934] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:45:11.180256] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-28T21:45:11.433482] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T21:45:11.980254] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-28T21:45:12.314355] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T21:45:12.323402] [INFO ] [REMOTE ] UTF: Full fetch complete (44362 records). [2025-10-28T21:45:12.323517] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-28T21:45:12.446922] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T21:45:12.705400] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-28T21:45:12.705474] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-28T21:45:12.706484] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-28T21:45:12.706547] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-28T21:45:12.707536] [DEBUG] [LOCAL ] UTF: Trimmed 44362 records to 31077 (keeping 200 days of data) [2025-10-28T21:45:12.792335] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-28T21:45:12.895398] [DEBUG] [LOCAL ] UTF: Primary data saved (31077 records). [2025-10-28T21:45:12.895566] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-28T21:45:12.895683] [INFO ] [MAIN ] Update Progress: 2198/2366 symbols completed. UTF took 25.1s. Estimated remaining: 21m 48s. Rate: 7.7 symbols/min [2025-10-28T21:45:13.580259] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-28T21:45:14.085890] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T21:45:14.120318] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T21:45:14.380305] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-28T21:45:14.938927] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T21:45:15.180305] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-28T21:45:15.754273] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T21:45:15.980308] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-28T21:45:16.580143] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T21:45:16.780243] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-28T21:45:17.322104] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T21:45:17.580265] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-28T21:45:18.031534] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T21:45:18.380253] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-28T21:45:19.072058] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T21:45:19.180248] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-28T21:45:19.980251] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-28T21:45:20.376437] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:45:20.752868] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T21:45:20.780209] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-28T21:45:21.580242] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-28T21:45:21.815575] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T21:45:21.818697] [INFO ] [REMOTE ] UTL: Full fetch complete (15894 records). [2025-10-28T21:45:21.818773] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-28T21:45:22.181117] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-28T21:45:22.181189] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-28T21:45:22.181551] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-28T21:45:22.181609] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-28T21:45:22.182215] [DEBUG] [LOCAL ] UTL: Trimmed 15894 records to 11825 (keeping 200 days of data) [2025-10-28T21:45:22.251953] [DEBUG] [LOCAL ] UTL: Primary data saved (11825 records). [2025-10-28T21:45:22.252083] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-28T21:45:22.252160] [INFO ] [MAIN ] Update Progress: 2199/2366 symbols completed. UTL took 18.6s. Estimated remaining: 21m 40s. Rate: 7.7 symbols/min [2025-10-28T21:45:25.845546] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (4.27 seconds). [2025-10-28T21:45:25.853329] [INFO ] [REMOTE ] UTI: Full fetch complete (59053 records). [2025-10-28T21:45:25.853458] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-28T21:45:26.225552] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-28T21:45:26.225687] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-28T21:45:26.226764] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-28T21:45:26.226825] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-28T21:45:26.227936] [DEBUG] [LOCAL ] UTI: Trimmed 59053 records to 40099 (keeping 200 days of data) [2025-10-28T21:45:26.455058] [DEBUG] [LOCAL ] UTI: Primary data saved (40099 records). [2025-10-28T21:45:26.455177] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-28T21:45:26.455248] [INFO ] [MAIN ] Update Progress: 2200/2366 symbols completed. UTI took 35.5s. Estimated remaining: 21m 32s. Rate: 7.7 symbols/min [2025-10-28T21:45:27.018019] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:27.039795] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:27.104443] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:27.160420] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:27.190892] [DEBUG] [LOCAL ] UVV: Loaded 22553 existing records from primary storage. [2025-10-28T21:45:27.190273] [DEBUG] [LOCAL ] UVE: Loaded 21970 existing records from primary storage. [2025-10-28T21:45:27.204545] [INFO ] [MAIN ] UVV: Loaded 22553 existing records. [2025-10-28T21:45:27.210235] [INFO ] [MAIN ] UVE: Loaded 21970 existing records. [2025-10-28T21:45:27.439461] [DEBUG] [LOCAL ] UWMC: Loaded 52956 existing records from primary storage. [2025-10-28T21:45:27.473894] [INFO ] [MAIN ] UWMC: Loaded 52956 existing records. [2025-10-28T21:45:27.604843] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:27.650293] [DEBUG] [LOCAL ] UTZ: Loaded 44017 existing records from primary storage. [2025-10-28T21:45:27.655663] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-28T21:45:27.668705] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-28T21:45:27.705727] [INFO ] [MAIN ] UTZ: Loaded 44017 existing records. [2025-10-28T21:45:27.705817] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-28T21:45:27.780688] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:27.791023] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-28T21:45:27.801445] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-28T21:45:27.884766] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-28T21:45:27.954333] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:27.999560] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-28T21:45:27.999740] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-28T21:45:28.005283] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-28T21:45:28.005358] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-28T21:45:28.031365] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-28T21:45:28.015862] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-28T21:45:28.250284] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:28.324408] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-28T21:45:28.335510] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-28T21:45:28.429699] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-28T21:45:28.440697] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-28T21:45:29.030930] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:29.123871] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-28T21:45:29.439408] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:29.395509] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:29.461172] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-28T21:45:29.484813] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-28T21:45:29.583796] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:29.584068] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-28T21:45:29.989255] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:45:29.993165] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-28T21:45:30.327353] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:45:30.331378] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-28T21:45:30.698313] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T21:45:30.702161] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-28T21:45:30.820011] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:45:30.829037] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-28T21:45:30.904137] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T21:45:30.908464] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-28T21:45:31.105692] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T21:45:31.116882] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-28T21:45:31.506385] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T21:45:31.510819] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-28T21:45:31.657511] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T21:45:31.663140] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-28T21:45:31.847718] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T21:45:31.980218] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-28T21:45:32.273441] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T21:45:32.391587] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T21:45:32.419172] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T21:45:32.780251] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-28T21:45:32.988084] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T21:45:33.580292] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-28T21:45:34.256126] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T21:45:34.380232] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-28T21:45:34.399324] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T21:45:35.180322] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-28T21:45:35.980225] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-28T21:45:36.065253] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T21:45:36.383186] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T21:45:36.780288] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-28T21:45:37.521292] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T21:45:37.545810] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T21:45:37.580216] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-28T21:45:38.380265] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-28T21:45:38.439392] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T21:45:39.180321] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-28T21:45:39.642178] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T21:45:39.980268] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-28T21:45:40.091552] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T21:45:40.780233] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-28T21:45:40.820424] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T21:45:41.580284] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-28T21:45:42.052733] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T21:45:42.380313] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-28T21:45:42.651690] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T21:45:43.180227] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-28T21:45:43.626410] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T21:45:43.980265] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-28T21:45:44.155017] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T21:45:44.695283] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T21:45:44.780210] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-28T21:45:45.566933] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T21:45:45.571154] [INFO ] [REMOTE ] UVV: Full fetch complete (30230 records). [2025-10-28T21:45:45.571236] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-28T21:45:45.585358] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-28T21:45:45.944340] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-28T21:45:45.944410] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-28T21:45:45.945110] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-28T21:45:45.945170] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-28T21:45:45.945919] [DEBUG] [LOCAL ] UVV: Trimmed 30230 records to 22552 (keeping 200 days of data) [2025-10-28T21:45:46.078859] [DEBUG] [LOCAL ] UVV: Primary data saved (22552 records). [2025-10-28T21:45:46.078984] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-28T21:45:46.079060] [INFO ] [MAIN ] Update Progress: 2201/2366 symbols completed. UVV took 19.6s. Estimated remaining: 21m 25s. Rate: 7.7 symbols/min [2025-10-28T21:45:46.246676] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:46.254337] [DEBUG] [LOCAL ] UZD: Loaded 5613 existing records from primary storage. [2025-10-28T21:45:46.254528] [INFO ] [MAIN ] UZD: Loaded 5613 existing records. [2025-10-28T21:45:46.388740] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-28T21:45:46.427921] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:46.428127] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-28T21:45:46.428172] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-28T21:45:46.428315] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-28T21:45:46.428351] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-28T21:45:46.772284] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:47.110963] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T21:45:47.180263] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-28T21:45:47.720266] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T21:45:47.980288] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-28T21:45:48.596691] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T21:45:48.715119] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T21:45:48.780252] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-28T21:45:49.580261] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-28T21:45:50.353434] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T21:45:50.380228] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-28T21:45:50.532541] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T21:45:50.832293] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T21:45:51.180251] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-28T21:45:51.980251] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-28T21:45:52.331965] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T21:45:52.480927] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T21:45:52.492036] [INFO ] [REMOTE ] UWMC: Full fetch complete (75938 records). [2025-10-28T21:45:52.492214] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-28T21:45:52.785328] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-28T21:45:52.900028] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-28T21:45:52.900113] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-28T21:45:52.901294] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-28T21:45:52.901359] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-28T21:45:52.903350] [DEBUG] [LOCAL ] UWMC: Trimmed 75938 records to 52956 (keeping 200 days of data) [2025-10-28T21:45:53.235213] [DEBUG] [LOCAL ] UWMC: Primary data saved (52956 records). [2025-10-28T21:45:53.235533] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-28T21:45:53.235682] [INFO ] [MAIN ] Update Progress: 2202/2366 symbols completed. UWMC took 26.8s. Estimated remaining: 21m 17s. Rate: 7.7 symbols/min [2025-10-28T21:45:53.360167] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T21:45:53.425161] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:53.434554] [DEBUG] [LOCAL ] UZE: Loaded 6778 existing records from primary storage. [2025-10-28T21:45:53.434783] [INFO ] [MAIN ] UZE: Loaded 6778 existing records. [2025-10-28T21:45:53.590157] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-28T21:45:53.645421] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:45:53.645748] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-28T21:45:53.645852] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-28T21:45:53.646193] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-28T21:45:53.646257] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-28T21:45:54.011747] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:54.380280] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-28T21:45:54.825328] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T21:45:55.187249] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-28T21:45:55.189102] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T21:45:55.692678] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T21:45:55.980255] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-28T21:45:56.780276] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-28T21:45:56.817129] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T21:45:56.821774] [INFO ] [REMOTE ] UVE: Full fetch complete (30471 records). [2025-10-28T21:45:56.821854] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-28T21:45:57.197065] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-28T21:45:57.197165] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-28T21:45:57.197939] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-28T21:45:57.198010] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-28T21:45:57.198997] [DEBUG] [LOCAL ] UVE: Trimmed 30471 records to 21949 (keeping 200 days of data) [2025-10-28T21:45:57.344226] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T21:45:57.344337] [DEBUG] [LOCAL ] UVE: Primary data saved (21949 records). [2025-10-28T21:45:57.344726] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-28T21:45:57.347187] [INFO ] [MAIN ] Update Progress: 2203/2366 symbols completed. UVE took 30.9s. Estimated remaining: 21m 9s. Rate: 7.7 symbols/min [2025-10-28T21:45:57.523345] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:45:57.523603] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-28T21:45:57.523677] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-28T21:45:57.523799] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-28T21:45:57.523841] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-28T21:45:57.523881] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-28T21:45:57.523911] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-28T21:45:57.587551] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-28T21:45:57.894088] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:45:57.984565] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T21:45:58.380293] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-28T21:45:59.180325] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-28T21:45:59.403026] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T21:45:59.411236] [INFO ] [REMOTE ] UTZ: Full fetch complete (64334 records). [2025-10-28T21:45:59.411395] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-28T21:45:59.801989] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-28T21:45:59.802183] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-28T21:45:59.803278] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-28T21:45:59.803341] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-28T21:45:59.804635] [DEBUG] [LOCAL ] UTZ: Trimmed 64334 records to 43998 (keeping 200 days of data) [2025-10-28T21:45:59.873249] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T21:45:59.985570] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-28T21:46:00.079884] [DEBUG] [LOCAL ] UTZ: Primary data saved (43998 records). [2025-10-28T21:46:00.080015] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-28T21:46:00.080095] [INFO ] [MAIN ] Update Progress: 2204/2366 symbols completed. UTZ took 33.6s. Estimated remaining: 21m 1s. Rate: 7.7 symbols/min [2025-10-28T21:46:00.248350] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:00.298946] [DEBUG] [LOCAL ] V: Loaded 53745 existing records from primary storage. [2025-10-28T21:46:00.299260] [INFO ] [MAIN ] V: Loaded 53745 existing records. [2025-10-28T21:46:00.481090] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:00.481499] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-28T21:46:00.486032] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-28T21:46:00.486694] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-28T21:46:00.486868] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T21:46:00.488911] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-28T21:46:00.785385] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-28T21:46:00.845589] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:01.580251] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-28T21:46:01.746360] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T21:46:02.380270] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-28T21:46:02.868910] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T21:46:03.180247] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-28T21:46:03.271016] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T21:46:03.788872] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T21:46:03.980239] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-28T21:46:04.422767] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T21:46:04.780252] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-28T21:46:05.336382] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T21:46:05.580265] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-28T21:46:06.380256] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-28T21:46:06.785935] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T21:46:07.180240] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-28T21:46:07.210441] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T21:46:07.599700] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T21:46:07.980274] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-28T21:46:08.393093] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T21:46:08.780266] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-28T21:46:09.173087] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T21:46:09.580257] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-28T21:46:10.021887] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T21:46:10.380226] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-28T21:46:10.735184] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T21:46:11.180278] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-28T21:46:11.622788] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T21:46:11.980247] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-28T21:46:12.780360] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-28T21:46:13.393716] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:46:13.580244] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-28T21:46:13.925309] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T21:46:13.926968] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-28T21:46:14.380234] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-28T21:46:15.180251] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-28T21:46:15.607082] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T21:46:15.980250] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-28T21:46:16.280558] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-28T21:46:16.281606] [INFO ] [REMOTE ] UZD: Full fetch complete (8689 records). [2025-10-28T21:46:16.281714] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-28T21:46:16.693248] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-28T21:46:16.693403] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-28T21:46:16.693722] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-28T21:46:16.693833] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-28T21:46:16.695809] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-28T21:46:16.707248] [DEBUG] [LOCAL ] UZD: Trimmed 8689 records to 5591 (keeping 200 days of data) [2025-10-28T21:46:16.740996] [DEBUG] [LOCAL ] UZD: Primary data saved (5591 records). [2025-10-28T21:46:16.741087] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-28T21:46:16.741164] [INFO ] [MAIN ] Update Progress: 2205/2366 symbols completed. UZD took 30.7s. Estimated remaining: 20m 54s. Rate: 7.7 symbols/min [2025-10-28T21:46:16.785502] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-28T21:46:16.908259] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:16.939925] [DEBUG] [LOCAL ] VAC: Loaded 33412 existing records from primary storage. [2025-10-28T21:46:16.940203] [INFO ] [MAIN ] VAC: Loaded 33412 existing records. [2025-10-28T21:46:17.111817] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:17.112028] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-28T21:46:17.112074] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-28T21:46:17.112252] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-28T21:46:17.112292] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-28T21:46:17.459452] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:17.482316] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T21:46:17.580235] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-28T21:46:18.380232] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-28T21:46:18.450896] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T21:46:19.180303] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-28T21:46:19.546907] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T21:46:19.980265] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-28T21:46:20.016459] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T21:46:20.594125] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:46:20.780244] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-28T21:46:21.288384] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T21:46:21.289430] [INFO ] [REMOTE ] UZF: Full fetch complete (8171 records). [2025-10-28T21:46:21.289497] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-28T21:46:21.464512] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T21:46:21.464780] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:46:21.464849] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:46:21.464919] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-28T21:46:21.464981] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-28T21:46:21.465017] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-28T21:46:21.465056] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-28T21:46:21.465112] [INFO ] [MAIN ] Update Progress: 2206/2366 symbols completed. UZF took 24.1s. Estimated remaining: 20m 46s. Rate: 7.7 symbols/min [2025-10-28T21:46:21.585334] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-28T21:46:21.644241] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:21.688442] [DEBUG] [LOCAL ] VAL: Loaded 49768 existing records from primary storage. [2025-10-28T21:46:21.688763] [INFO ] [MAIN ] VAL: Loaded 49768 existing records. [2025-10-28T21:46:21.863451] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:21.863882] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-28T21:46:21.863939] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-28T21:46:21.864129] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-28T21:46:21.864167] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-28T21:46:22.132610] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T21:46:22.239807] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:22.380256] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-28T21:46:23.180257] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-28T21:46:23.436961] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T21:46:23.980290] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-28T21:46:24.780267] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-28T21:46:24.926407] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T21:46:25.373769] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T21:46:25.580314] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-28T21:46:26.034329] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T21:46:26.380269] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-28T21:46:26.794769] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T21:46:26.796276] [INFO ] [REMOTE ] UZE: Full fetch complete (9573 records). [2025-10-28T21:46:26.796348] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-28T21:46:27.181298] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-28T21:46:27.181038] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-28T21:46:27.181535] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-28T21:46:27.182703] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-28T21:46:27.182770] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-28T21:46:27.183420] [DEBUG] [LOCAL ] UZE: Trimmed 9573 records to 6710 (keeping 200 days of data) [2025-10-28T21:46:27.224358] [DEBUG] [LOCAL ] UZE: Primary data saved (6710 records). [2025-10-28T21:46:27.224479] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-28T21:46:27.224554] [INFO ] [MAIN ] Update Progress: 2207/2366 symbols completed. UZE took 34.0s. Estimated remaining: 20m 38s. Rate: 7.7 symbols/min [2025-10-28T21:46:27.404423] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:27.458998] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-28T21:46:27.459389] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-28T21:46:27.685945] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:27.689752] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-28T21:46:27.690044] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-28T21:46:27.692519] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-28T21:46:27.692448] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-28T21:46:27.692923] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-28T21:46:27.985827] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-28T21:46:28.069056] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:28.170460] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T21:46:28.780301] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-28T21:46:29.580267] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-28T21:46:29.614052] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T21:46:30.012678] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T21:46:30.380314] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-28T21:46:30.965097] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T21:46:31.180227] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-28T21:46:31.980222] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-28T21:46:32.057010] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T21:46:32.614902] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:46:32.780242] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-28T21:46:33.580264] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-28T21:46:33.762599] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T21:46:34.152984] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-28T21:46:34.380278] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-28T21:46:35.190793] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-28T21:46:35.196286] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T21:46:35.829974] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T21:46:35.980306] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-28T21:46:36.257256] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T21:46:36.780332] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-28T21:46:37.374556] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T21:46:37.580266] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-28T21:46:38.380284] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-28T21:46:38.513417] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T21:46:38.552747] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T21:46:38.658184] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-28T21:46:38.669349] [INFO ] [REMOTE ] V: Full fetch complete (77921 records). [2025-10-28T21:46:38.669500] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-28T21:46:39.073003] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-28T21:46:39.073129] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-28T21:46:39.074451] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-28T21:46:39.074515] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-28T21:46:39.076295] [DEBUG] [LOCAL ] V: Trimmed 77921 records to 53745 (keeping 200 days of data) [2025-10-28T21:46:39.180326] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-28T21:46:39.421796] [DEBUG] [LOCAL ] V: Primary data saved (53745 records). [2025-10-28T21:46:39.421930] [INFO ] [MAIN ] V: Full history saved. [2025-10-28T21:46:39.422912] [INFO ] [MAIN ] Update Progress: 2208/2366 symbols completed. V took 39.3s. Estimated remaining: 20m 31s. Rate: 7.7 symbols/min [2025-10-28T21:46:39.591093] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:39.599420] [DEBUG] [LOCAL ] VATE: Loaded 4965 existing records from primary storage. [2025-10-28T21:46:39.599629] [INFO ] [MAIN ] VATE: Loaded 4965 existing records. [2025-10-28T21:46:39.773970] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:39.774211] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-28T21:46:39.774257] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-28T21:46:39.774387] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-28T21:46:39.774425] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-28T21:46:39.985412] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-28T21:46:40.126721] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:40.780228] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-28T21:46:40.827163] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T21:46:41.000908] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:46:41.580255] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-28T21:46:41.612843] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T21:46:42.380304] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-28T21:46:42.881829] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:46:43.115776] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T21:46:43.180225] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-28T21:46:43.666835] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T21:46:43.980258] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-28T21:46:44.444010] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T21:46:44.780249] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-28T21:46:45.274532] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T21:46:45.580268] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-28T21:46:46.380274] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-28T21:46:47.038822] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T21:46:47.180217] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-28T21:46:47.703759] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:46:47.980301] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-28T21:46:48.780305] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-28T21:46:48.933443] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T21:46:48.937302] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T21:46:48.955281] [INFO ] [REMOTE ] VAC: Full fetch complete (48843 records). [2025-10-28T21:46:48.956167] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-28T21:46:49.376397] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-28T21:46:49.376500] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-28T21:46:49.377625] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-28T21:46:49.377709] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-28T21:46:49.378708] [DEBUG] [LOCAL ] VAC: Trimmed 48843 records to 33295 (keeping 200 days of data) [2025-10-28T21:46:49.585268] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-28T21:46:49.587068] [DEBUG] [LOCAL ] VAC: Primary data saved (33295 records). [2025-10-28T21:46:49.588092] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-28T21:46:49.588189] [INFO ] [MAIN ] Update Progress: 2209/2366 symbols completed. VAC took 32.8s. Estimated remaining: 20m 23s. Rate: 7.7 symbols/min [2025-10-28T21:46:49.758195] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:49.768260] [DEBUG] [LOCAL ] VBF: Loaded 7091 existing records from primary storage. [2025-10-28T21:46:49.768480] [INFO ] [MAIN ] VBF: Loaded 7091 existing records. [2025-10-28T21:46:49.961768] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:49.962070] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-28T21:46:49.962194] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-28T21:46:49.962497] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-28T21:46:49.962556] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-28T21:46:50.123491] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T21:46:50.380555] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-28T21:46:50.430992] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T21:46:50.565411] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:51.180306] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-28T21:46:51.569587] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T21:46:51.980266] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-28T21:46:52.428202] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-28T21:46:52.780233] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-28T21:46:53.277594] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T21:46:53.580301] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-28T21:46:54.380249] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-28T21:46:54.640551] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T21:46:54.840895] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T21:46:54.955364] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T21:46:54.965122] [INFO ] [REMOTE ] VAL: Full fetch complete (72807 records). [2025-10-28T21:46:54.965242] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-28T21:46:55.185479] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-28T21:46:55.367434] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-28T21:46:55.367509] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-28T21:46:55.368673] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-28T21:46:55.368734] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-28T21:46:55.370167] [DEBUG] [LOCAL ] VAL: Trimmed 72807 records to 49675 (keeping 200 days of data) [2025-10-28T21:46:55.654102] [DEBUG] [LOCAL ] VAL: Primary data saved (49675 records). [2025-10-28T21:46:55.654226] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-28T21:46:55.654302] [INFO ] [MAIN ] Update Progress: 2210/2366 symbols completed. VAL took 34.2s. Estimated remaining: 20m 15s. Rate: 7.7 symbols/min [2025-10-28T21:46:55.766943] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T21:46:55.831929] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:55.832069] [DEBUG] [LOCAL ] VCV: No existing data file found in primary storage. [2025-10-28T21:46:55.832106] [WARN ] [MAIN ] VCV: No existing data found, performing full refresh instead. [2025-10-28T21:46:55.832229] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-28T21:46:55.832279] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-28T21:46:55.832327] [DEBUG] [LOCAL ] VCV: No primary data file found to delete. [2025-10-28T21:46:55.832359] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-28T21:46:55.996133] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-28T21:46:56.196997] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:56.505290] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T21:46:56.507071] [INFO ] [REMOTE ] VATE: Full fetch complete (10704 records). [2025-10-28T21:46:56.507215] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-28T21:46:56.785460] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-28T21:46:56.867194] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-28T21:46:56.867264] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-28T21:46:56.867537] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-28T21:46:56.867574] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-28T21:46:56.868000] [DEBUG] [LOCAL ] VATE: Trimmed 10704 records to 4983 (keeping 200 days of data) [2025-10-28T21:46:56.894697] [DEBUG] [LOCAL ] VATE: Primary data saved (4983 records). [2025-10-28T21:46:56.894780] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-28T21:46:56.894850] [INFO ] [MAIN ] Update Progress: 2211/2366 symbols completed. VATE took 17.5s. Estimated remaining: 20m 7s. Rate: 7.7 symbols/min [2025-10-28T21:46:57.066475] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:46:57.109626] [DEBUG] [LOCAL ] VEEV: Loaded 46907 existing records from primary storage. [2025-10-28T21:46:57.109922] [INFO ] [MAIN ] VEEV: Loaded 46907 existing records. [2025-10-28T21:46:57.289903] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:46:57.290168] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-28T21:46:57.290219] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-28T21:46:57.290394] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-28T21:46:57.290431] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-28T21:46:57.409828] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T21:46:57.585363] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-28T21:46:57.661662] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:46:58.057293] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T21:46:58.380246] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-28T21:46:58.967600] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T21:46:59.180288] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-28T21:46:59.980260] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-28T21:47:00.403293] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T21:47:00.721144] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T21:47:00.780228] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-28T21:47:01.580343] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-28T21:47:02.380288] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-28T21:47:02.586210] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T21:47:02.704298] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T21:47:02.898134] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T21:47:03.180311] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-28T21:47:03.980296] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-28T21:47:04.423286] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T21:47:04.780268] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-28T21:47:04.928052] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T21:47:04.942540] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-28T21:47:04.942816] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-28T21:47:05.423829] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-28T21:47:05.423943] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-28T21:47:05.433948] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-28T21:47:05.434191] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-28T21:47:05.435419] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T21:47:05.440371] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-28T21:47:05.616488] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-28T21:47:05.775145] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-28T21:47:05.775283] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-28T21:47:05.775387] [INFO ] [MAIN ] Update Progress: 2212/2366 symbols completed. VALE took 38.6s. Estimated remaining: 19m 59s. Rate: 7.7 symbols/min [2025-10-28T21:47:05.943044] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:05.958831] [DEBUG] [LOCAL ] VEL: Loaded 11745 existing records from primary storage. [2025-10-28T21:47:05.959202] [INFO ] [MAIN ] VEL: Loaded 11745 existing records. [2025-10-28T21:47:06.167673] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:47:06.168073] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-28T21:47:06.168131] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-28T21:47:06.168291] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-28T21:47:06.168330] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-28T21:47:06.338000] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T21:47:06.386370] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-28T21:47:06.572497] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:06.905418] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T21:47:07.180278] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-28T21:47:07.980266] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-28T21:47:08.572074] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T21:47:08.574343] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T21:47:08.780248] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-28T21:47:09.282108] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T21:47:09.580280] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-28T21:47:10.102086] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T21:47:10.380271] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-28T21:47:10.867764] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T21:47:11.180293] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-28T21:47:11.865944] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T21:47:11.980226] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-28T21:47:12.534983] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T21:47:12.780267] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-28T21:47:13.414070] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T21:47:13.580285] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-28T21:47:14.380266] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-28T21:47:14.877789] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T21:47:14.880366] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T21:47:15.180356] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-28T21:47:15.980341] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-28T21:47:16.400586] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T21:47:16.623472] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T21:47:16.780245] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-28T21:47:17.459846] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T21:47:17.580268] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-28T21:47:18.219982] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T21:47:18.380295] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-28T21:47:19.044498] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T21:47:19.180277] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-28T21:47:19.758988] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T21:47:19.761143] [INFO ] [REMOTE ] VCV: Full fetch complete (18197 records). [2025-10-28T21:47:19.761212] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-28T21:47:19.985522] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-28T21:47:20.125478] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-28T21:47:20.125552] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-28T21:47:20.125976] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-28T21:47:20.126037] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-28T21:47:20.126634] [DEBUG] [LOCAL ] VCV: Trimmed 18197 records to 13088 (keeping 200 days of data) [2025-10-28T21:47:20.205541] [DEBUG] [LOCAL ] VCV: Primary data saved (13088 records). [2025-10-28T21:47:20.205701] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-28T21:47:20.205784] [INFO ] [MAIN ] Update Progress: 2213/2366 symbols completed. VCV took 24.6s. Estimated remaining: 19m 52s. Rate: 7.7 symbols/min [2025-10-28T21:47:20.372951] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:20.412219] [DEBUG] [LOCAL ] VET: Loaded 43843 existing records from primary storage. [2025-10-28T21:47:20.412540] [INFO ] [MAIN ] VET: Loaded 43843 existing records. [2025-10-28T21:47:20.574059] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T21:47:20.601186] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:47:20.601324] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-28T21:47:20.601369] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-28T21:47:20.601559] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-28T21:47:20.601597] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-28T21:47:20.790441] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-28T21:47:20.945063] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:21.580230] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-28T21:47:22.046136] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:47:22.380268] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-28T21:47:22.817603] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:47:23.180286] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-28T21:47:23.724231] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T21:47:23.765440] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T21:47:23.980273] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-28T21:47:24.780248] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-28T21:47:25.379235] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:47:25.510100] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T21:47:25.580212] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-28T21:47:26.144296] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T21:47:26.380292] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-28T21:47:27.180272] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-28T21:47:27.447300] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T21:47:27.980290] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-28T21:47:28.344426] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:47:28.780237] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-28T21:47:29.580246] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-28T21:47:29.802249] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-28T21:47:30.380259] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-28T21:47:30.505835] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T21:47:30.516156] [INFO ] [REMOTE ] VEEV: Full fetch complete (68109 records). [2025-10-28T21:47:30.516336] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-28T21:47:30.935715] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-28T21:47:30.936038] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-28T21:47:30.948982] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-28T21:47:30.967107] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-28T21:47:30.974058] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T21:47:30.977040] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T21:47:30.980025] [INFO ] [REMOTE ] VBF: Full fetch complete (10926 records). [2025-10-28T21:47:30.990401] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-28T21:47:31.076560] [DEBUG] [LOCAL ] VEEV: Trimmed 68109 records to 46787 (keeping 200 days of data) [2025-10-28T21:47:31.180439] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-28T21:47:31.513518] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-28T21:47:31.513606] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-28T21:47:31.514061] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-28T21:47:31.514174] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-28T21:47:31.514772] [DEBUG] [LOCAL ] VBF: Trimmed 10926 records to 7093 (keeping 200 days of data) [2025-10-28T21:47:31.661692] [DEBUG] [LOCAL ] VBF: Primary data saved (7093 records). [2025-10-28T21:47:31.678893] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-28T21:47:31.689776] [INFO ] [MAIN ] Update Progress: 2214/2366 symbols completed. VBF took 42.1s. Estimated remaining: 19m 44s. Rate: 7.7 symbols/min [2025-10-28T21:47:31.845800] [DEBUG] [LOCAL ] VEEV: Primary data saved (46787 records). [2025-10-28T21:47:31.856691] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-28T21:47:31.862630] [INFO ] [MAIN ] Update Progress: 2215/2366 symbols completed. VEEV took 35.0s. Estimated remaining: 19m 36s. Rate: 7.7 symbols/min [2025-10-28T21:47:32.005140] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-28T21:47:32.008853] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:32.111245] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:32.111572] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-28T21:47:32.111620] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-28T21:47:32.111760] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-28T21:47:32.111803] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-28T21:47:32.111847] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-28T21:47:32.111883] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-28T21:47:32.435204] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-10-28T21:47:32.447239] [INFO ] [MAIN ] VFC: Loaded 53610 existing records. [2025-10-28T21:47:32.610592] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:32.730259] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:47:32.733359] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-28T21:47:32.733552] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-28T21:47:32.733210] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T21:47:32.736999] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-28T21:47:32.738057] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-28T21:47:32.784565] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-28T21:47:32.932251] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T21:47:33.163941] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:33.417074] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T21:47:33.420015] [INFO ] [REMOTE ] VEL: Full fetch complete (17120 records). [2025-10-28T21:47:33.420091] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-28T21:47:33.585387] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-28T21:47:33.815265] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-28T21:47:33.815365] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-28T21:47:33.816294] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-28T21:47:33.816362] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-28T21:47:33.817058] [DEBUG] [LOCAL ] VEL: Trimmed 17120 records to 11691 (keeping 200 days of data) [2025-10-28T21:47:33.898072] [DEBUG] [LOCAL ] VEL: Primary data saved (11691 records). [2025-10-28T21:47:33.898276] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-28T21:47:33.898386] [INFO ] [MAIN ] Update Progress: 2216/2366 symbols completed. VEL took 28.1s. Estimated remaining: 19m 28s. Rate: 7.7 symbols/min [2025-10-28T21:47:34.122120] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:34.129850] [DEBUG] [LOCAL ] VGI: Loaded 5101 existing records from primary storage. [2025-10-28T21:47:34.130055] [INFO ] [MAIN ] VGI: Loaded 5101 existing records. [2025-10-28T21:47:34.316519] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:47:34.316825] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-28T21:47:34.316881] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-28T21:47:34.317071] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-28T21:47:34.317112] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-28T21:47:34.386173] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-28T21:47:34.699086] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:34.872858] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T21:47:35.180288] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-28T21:47:35.930971] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T21:47:35.980292] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-28T21:47:36.352548] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T21:47:36.492633] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T21:47:36.780263] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-28T21:47:37.235816] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T21:47:37.580341] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-28T21:47:38.380306] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-10-28T21:47:38.883121] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T21:47:39.109106] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T21:47:39.180321] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-28T21:47:39.980301] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-28T21:47:40.368551] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T21:47:40.595598] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T21:47:40.780270] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-28T21:47:41.180044] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T21:47:41.580263] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-10-28T21:47:42.380259] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-28T21:47:42.761425] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T21:47:42.916316] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T21:47:43.180247] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-10-28T21:47:43.980301] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-28T21:47:44.350625] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T21:47:44.780245] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-28T21:47:44.866400] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T21:47:45.580267] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-28T21:47:45.970292] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T21:47:46.059383] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:47:46.380340] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-28T21:47:47.180264] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-10-28T21:47:47.980267] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-28T21:47:48.018592] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T21:47:48.407899] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T21:47:48.624612] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T21:47:48.780245] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-28T21:47:49.580269] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-28T21:47:50.299014] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T21:47:50.380242] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-28T21:47:50.761836] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T21:47:50.780191] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:47:51.180264] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-28T21:47:51.980268] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-28T21:47:52.780261] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-28T21:47:52.901696] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T21:47:53.116571] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T21:47:53.125819] [INFO ] [REMOTE ] VET: Full fetch complete (64395 records). [2025-10-28T21:47:53.125931] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-28T21:47:53.216990] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T21:47:53.249719] [INFO ] [REMOTE ] VGI: Full fetch complete (7438 records). [2025-10-28T21:47:53.260921] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-28T21:47:53.584036] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-10-28T21:47:53.877728] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-28T21:47:53.887223] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-28T21:47:53.891827] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-28T21:47:53.891925] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-28T21:47:53.953354] [DEBUG] [LOCAL ] VET: Trimmed 64395 records to 43759 (keeping 200 days of data) [2025-10-28T21:47:53.978418] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-28T21:47:53.978577] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-28T21:47:53.978764] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-28T21:47:53.978833] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-28T21:47:53.979321] [DEBUG] [LOCAL ] VGI: Trimmed 7438 records to 5015 (keeping 200 days of data) [2025-10-28T21:47:54.093435] [DEBUG] [LOCAL ] VGI: Primary data saved (5015 records). [2025-10-28T21:47:54.104883] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-28T21:47:54.110237] [INFO ] [MAIN ] Update Progress: 2217/2366 symbols completed. VGI took 20.2s. Estimated remaining: 19m 21s. Rate: 7.7 symbols/min [2025-10-28T21:47:54.417023] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-28T21:47:54.420139] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:54.472972] [DEBUG] [LOCAL ] VET: Primary data saved (43759 records). [2025-10-28T21:47:54.473116] [INFO ] [MAIN ] VET: Full history saved. [2025-10-28T21:47:54.473200] [INFO ] [MAIN ] Update Progress: 2218/2366 symbols completed. VET took 34.3s. Estimated remaining: 19m 12s. Rate: 7.7 symbols/min [2025-10-28T21:47:54.588837] [DEBUG] [LOCAL ] VGM: Loaded 18374 existing records from primary storage. [2025-10-28T21:47:54.600375] [INFO ] [MAIN ] VGM: Loaded 18374 existing records. [2025-10-28T21:47:54.753444] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:47:54.833370] [DEBUG] [LOCAL ] VHI: Loaded 2587 existing records from primary storage. [2025-10-28T21:47:54.854489] [INFO ] [MAIN ] VHI: Loaded 2587 existing records. [2025-10-28T21:47:54.937119] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:47:54.959363] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-28T21:47:54.975785] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-28T21:47:54.987947] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-28T21:47:54.988578] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-28T21:47:55.152964] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:47:55.170843] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-28T21:47:55.171091] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-28T21:47:55.190637] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-28T21:47:55.190872] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-28T21:47:55.798048] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:55.827923] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-28T21:47:55.918269] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:47:55.922586] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-28T21:47:55.980213] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-10-28T21:47:56.578422] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-28T21:47:56.645258] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T21:47:56.780281] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-28T21:47:57.263335] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T21:47:57.497662] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T21:47:57.580260] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-10-28T21:47:58.380317] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-28T21:47:58.705065] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T21:47:59.095679] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T21:47:59.180203] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-10-28T21:47:59.980282] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-28T21:48:00.393025] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T21:48:00.715011] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T21:48:00.780269] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-28T21:48:01.140236] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T21:48:01.580257] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-28T21:48:02.242987] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T21:48:02.380310] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-28T21:48:03.180270] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-28T21:48:03.902920] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T21:48:03.980221] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-28T21:48:04.159292] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-28T21:48:04.624237] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T21:48:04.780259] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-28T21:48:05.580261] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-28T21:48:06.186502] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T21:48:06.380233] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-10-28T21:48:06.406891] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T21:48:07.180282] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-28T21:48:07.934577] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T21:48:07.935568] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T21:48:07.980234] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-10. [2025-10-28T21:48:08.038540] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-28T21:48:08.039104] [WARN ] [REMOTE ] VG: No data returned for month 2025-10 [2025-10-28T21:48:08.039231] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:48:08.039371] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-28T21:48:08.039490] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:48:08.039582] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-28T21:48:08.039686] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-28T21:48:08.039763] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-28T21:48:08.039857] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-28T21:48:08.039930] [INFO ] [MAIN ] Update Progress: 2219/2366 symbols completed. VG took 36.2s. Estimated remaining: 19m 5s. Rate: 7.7 symbols/min [2025-10-28T21:48:08.217731] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:08.217908] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-28T21:48:08.217945] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-28T21:48:08.218061] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-28T21:48:08.218103] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-28T21:48:08.218142] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-28T21:48:08.218174] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-28T21:48:08.572233] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:08.780214] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-10-28T21:48:09.006874] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:48:09.007166] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-10-28T21:48:09.007270] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:48:09.007362] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-28T21:48:09.007442] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:48:09.007526] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-28T21:48:09.007601] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-28T21:48:09.007673] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-28T21:48:09.007749] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-28T21:48:09.007802] [INFO ] [MAIN ] Update Progress: 2220/2366 symbols completed. VIA took 1.0s. Estimated remaining: 18m 57s. Rate: 7.7 symbols/min [2025-10-28T21:48:09.178719] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:09.228346] [DEBUG] [LOCAL ] VICI: Loaded 53650 existing records from primary storage. [2025-10-28T21:48:09.228663] [INFO ] [MAIN ] VICI: Loaded 53650 existing records. [2025-10-28T21:48:09.403615] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:09.403905] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-28T21:48:09.403955] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-28T21:48:09.404150] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-28T21:48:09.404206] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-28T21:48:09.587462] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-28T21:48:09.760271] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:10.380230] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-28T21:48:10.507281] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T21:48:10.716527] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T21:48:11.180273] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-28T21:48:11.876505] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T21:48:11.980233] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-28T21:48:12.689573] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T21:48:12.780238] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-28T21:48:13.580249] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-28T21:48:14.191306] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T21:48:14.380239] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-28T21:48:14.437145] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T21:48:14.778175] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T21:48:15.180260] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-28T21:48:15.980245] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-28T21:48:16.012541] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T21:48:16.016341] [INFO ] [REMOTE ] VGM: Full fetch complete (25670 records). [2025-10-28T21:48:16.016418] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-28T21:48:16.374835] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-28T21:48:16.374907] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-28T21:48:16.375363] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-28T21:48:16.375400] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-28T21:48:16.376055] [DEBUG] [LOCAL ] VGM: Trimmed 25670 records to 18339 (keeping 200 days of data) [2025-10-28T21:48:16.482437] [DEBUG] [LOCAL ] VGM: Primary data saved (18339 records). [2025-10-28T21:48:16.482558] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-28T21:48:16.482634] [INFO ] [MAIN ] Update Progress: 2221/2366 symbols completed. VGM took 22.4s. Estimated remaining: 18m 49s. Rate: 7.7 symbols/min [2025-10-28T21:48:16.650606] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:16.696587] [DEBUG] [LOCAL ] VIK: Loaded 52242 existing records from primary storage. [2025-10-28T21:48:16.696925] [INFO ] [MAIN ] VIK: Loaded 52242 existing records. [2025-10-28T21:48:16.788803] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-28T21:48:16.877902] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:16.878151] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-28T21:48:16.878210] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-28T21:48:16.878387] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-28T21:48:16.878424] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-28T21:48:17.228575] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:17.405133] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T21:48:17.580264] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-28T21:48:17.891545] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T21:48:18.380255] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-28T21:48:18.510284] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T21:48:18.521552] [INFO ] [REMOTE ] VFC: Full fetch complete (77753 records). [2025-10-28T21:48:18.521764] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-28T21:48:18.925483] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-28T21:48:18.925561] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-28T21:48:18.926818] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-28T21:48:18.926880] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-28T21:48:18.928325] [DEBUG] [LOCAL ] VFC: Trimmed 77753 records to 53610 (keeping 200 days of data) [2025-10-28T21:48:19.212269] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-28T21:48:19.264934] [DEBUG] [LOCAL ] VFC: Primary data saved (53610 records). [2025-10-28T21:48:19.265090] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-28T21:48:19.265218] [INFO ] [MAIN ] Update Progress: 2222/2366 symbols completed. VFC took 47.6s. Estimated remaining: 18m 41s. Rate: 7.7 symbols/min [2025-10-28T21:48:19.435099] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:19.485506] [DEBUG] [LOCAL ] VIPS: Loaded 51198 existing records from primary storage. [2025-10-28T21:48:19.485875] [INFO ] [MAIN ] VIPS: Loaded 51198 existing records. [2025-10-28T21:48:19.672192] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:19.672665] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-28T21:48:19.672793] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-28T21:48:19.673220] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-28T21:48:19.673278] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-28T21:48:19.981423] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-28T21:48:20.071890] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:20.077443] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T21:48:20.431144] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T21:48:20.484923] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T21:48:20.780251] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-28T21:48:21.580304] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-28T21:48:22.380295] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-28T21:48:22.443093] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T21:48:22.749983] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T21:48:22.778820] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T21:48:22.780068] [INFO ] [REMOTE ] VHI: Full fetch complete (4304 records). [2025-10-28T21:48:22.780139] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-28T21:48:23.156158] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-28T21:48:23.156262] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-28T21:48:23.156397] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-28T21:48:23.156435] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-28T21:48:23.156801] [DEBUG] [LOCAL ] VHI: Trimmed 4304 records to 2592 (keeping 200 days of data) [2025-10-28T21:48:23.172047] [DEBUG] [LOCAL ] VHI: Primary data saved (2592 records). [2025-10-28T21:48:23.172107] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-28T21:48:23.172181] [INFO ] [MAIN ] Update Progress: 2223/2366 symbols completed. VHI took 28.7s. Estimated remaining: 18m 33s. Rate: 7.7 symbols/min [2025-10-28T21:48:23.185455] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-28T21:48:23.345623] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:23.392369] [DEBUG] [LOCAL ] VIRT: Loaded 46273 existing records from primary storage. [2025-10-28T21:48:23.392690] [INFO ] [MAIN ] VIRT: Loaded 46273 existing records. [2025-10-28T21:48:23.573304] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:23.573514] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-28T21:48:23.573561] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-28T21:48:23.573793] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-28T21:48:23.573850] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-28T21:48:23.931561] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:23.980259] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-28T21:48:24.683831] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T21:48:24.780276] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-28T21:48:25.387188] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T21:48:25.580293] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-28T21:48:25.982234] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T21:48:26.380229] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-28T21:48:26.682873] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T21:48:27.180249] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-28T21:48:27.738442] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:48:27.980242] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-28T21:48:28.780226] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-28T21:48:28.824188] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T21:48:29.266944] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T21:48:29.580264] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-28T21:48:30.155253] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T21:48:30.380322] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-28T21:48:30.893786] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T21:48:31.180290] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-28T21:48:31.744942] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T21:48:31.980263] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-28T21:48:32.610359] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:48:32.780236] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-28T21:48:33.560940] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T21:48:33.580227] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-28T21:48:34.024735] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T21:48:34.380260] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-28T21:48:34.864242] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T21:48:35.180264] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-28T21:48:35.567257] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T21:48:35.980245] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-28T21:48:36.549300] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T21:48:36.780224] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-28T21:48:37.529903] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:48:37.580267] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-28T21:48:38.152075] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T21:48:38.380287] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-28T21:48:38.940409] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T21:48:39.180271] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-28T21:48:39.596669] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T21:48:39.980290] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-28T21:48:40.584888] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:48:40.780295] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-28T21:48:41.212288] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T21:48:41.580344] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-28T21:48:42.325738] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T21:48:42.380212] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-28T21:48:42.814917] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T21:48:43.180305] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-28T21:48:43.980247] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-28T21:48:44.155896] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T21:48:44.462270] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:48:44.780297] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-28T21:48:45.193549] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T21:48:45.204407] [INFO ] [REMOTE ] VICI: Full fetch complete (77800 records). [2025-10-28T21:48:45.204583] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-28T21:48:45.597481] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-28T21:48:45.602464] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-28T21:48:45.602570] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-28T21:48:45.603784] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-28T21:48:45.604046] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-28T21:48:45.634734] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T21:48:45.633433] [DEBUG] [LOCAL ] VICI: Trimmed 77800 records to 53650 (keeping 200 days of data) [2025-10-28T21:48:45.971577] [DEBUG] [LOCAL ] VICI: Primary data saved (53650 records). [2025-10-28T21:48:45.971740] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-28T21:48:45.971842] [INFO ] [MAIN ] Update Progress: 2224/2366 symbols completed. VICI took 37.0s. Estimated remaining: 18m 26s. Rate: 7.7 symbols/min [2025-10-28T21:48:46.138841] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:46.179730] [DEBUG] [LOCAL ] VIST: Loaded 46664 existing records from primary storage. [2025-10-28T21:48:46.180013] [INFO ] [MAIN ] VIST: Loaded 46664 existing records. [2025-10-28T21:48:46.353253] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:46.353488] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-28T21:48:46.353555] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-28T21:48:46.353767] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-28T21:48:46.353822] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-28T21:48:46.385366] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-28T21:48:46.730539] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:46.896261] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T21:48:47.180254] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-28T21:48:47.682421] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T21:48:47.697060] [INFO ] [REMOTE ] VIK: Full fetch complete (75850 records). [2025-10-28T21:48:47.697256] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-28T21:48:47.985505] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-28T21:48:48.097700] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-28T21:48:48.097799] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-28T21:48:48.098986] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-28T21:48:48.099052] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-28T21:48:48.100733] [DEBUG] [LOCAL ] VIK: Trimmed 75850 records to 52233 (keeping 200 days of data) [2025-10-28T21:48:48.403896] [DEBUG] [LOCAL ] VIK: Primary data saved (52233 records). [2025-10-28T21:48:48.404166] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-28T21:48:48.404332] [INFO ] [MAIN ] Update Progress: 2225/2366 symbols completed. VIK took 31.9s. Estimated remaining: 18m 18s. Rate: 7.7 symbols/min [2025-10-28T21:48:48.536771] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:48:48.619931] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:48.665740] [DEBUG] [LOCAL ] VIV: Loaded 44440 existing records from primary storage. [2025-10-28T21:48:48.666081] [INFO ] [MAIN ] VIV: Loaded 44440 existing records. [2025-10-28T21:48:48.785387] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-28T21:48:48.847572] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:48.847816] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-28T21:48:48.847867] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-28T21:48:48.848138] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-28T21:48:48.848196] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-28T21:48:49.201785] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:49.282892] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T21:48:49.580290] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-28T21:48:50.037765] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T21:48:50.380307] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-28T21:48:50.728768] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T21:48:50.737891] [INFO ] [REMOTE ] VIRT: Full fetch complete (67495 records). [2025-10-28T21:48:50.738031] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-28T21:48:51.118726] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-28T21:48:51.118805] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-28T21:48:51.119865] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-28T21:48:51.119948] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-28T21:48:51.121396] [DEBUG] [LOCAL ] VIRT: Trimmed 67495 records to 46227 (keeping 200 days of data) [2025-10-28T21:48:51.182443] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-28T21:48:51.399424] [DEBUG] [LOCAL ] VIRT: Primary data saved (46227 records). [2025-10-28T21:48:51.399558] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-28T21:48:51.399636] [INFO ] [MAIN ] Update Progress: 2226/2366 symbols completed. VIRT took 28.2s. Estimated remaining: 18m 10s. Rate: 7.7 symbols/min [2025-10-28T21:48:51.569189] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:51.587455] [DEBUG] [LOCAL ] VKQ: Loaded 17638 existing records from primary storage. [2025-10-28T21:48:51.587720] [INFO ] [MAIN ] VKQ: Loaded 17638 existing records. [2025-10-28T21:48:51.773254] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:51.773981] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-28T21:48:51.774112] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-28T21:48:51.774465] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-28T21:48:51.774676] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-28T21:48:51.981359] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T21:48:51.989176] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-28T21:48:52.179438] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:52.367538] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T21:48:52.780318] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-28T21:48:53.406807] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T21:48:53.580244] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-28T21:48:54.044281] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:48:54.380279] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-28T21:48:54.840039] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T21:48:54.965181] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T21:48:55.180295] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-28T21:48:55.879356] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T21:48:55.980274] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-28T21:48:56.780298] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-28T21:48:57.196089] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T21:48:57.206439] [INFO ] [REMOTE ] VIPS: Full fetch complete (74855 records). [2025-10-28T21:48:57.206565] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-28T21:48:57.591328] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-28T21:48:57.595999] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-28T21:48:57.596097] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-28T21:48:57.597398] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-28T21:48:57.597551] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-28T21:48:57.599020] [DEBUG] [LOCAL ] VIPS: Trimmed 74855 records to 51174 (keeping 200 days of data) [2025-10-28T21:48:57.902681] [DEBUG] [LOCAL ] VIPS: Primary data saved (51174 records). [2025-10-28T21:48:57.902904] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-28T21:48:57.903122] [INFO ] [MAIN ] Update Progress: 2227/2366 symbols completed. VIPS took 38.6s. Estimated remaining: 18m 2s. Rate: 7.7 symbols/min [2025-10-28T21:48:58.073059] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:48:58.104720] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T21:48:58.137726] [DEBUG] [LOCAL ] VLN: Loaded 31215 existing records from primary storage. [2025-10-28T21:48:58.138002] [INFO ] [MAIN ] VLN: Loaded 31215 existing records. [2025-10-28T21:48:58.335843] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:48:58.337732] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T21:48:58.338152] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-28T21:48:58.342453] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-28T21:48:58.343107] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-28T21:48:58.343164] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-28T21:48:58.385715] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-28T21:48:58.715718] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:48:59.180299] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-28T21:48:59.600355] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T21:48:59.980340] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-28T21:49:00.074990] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T21:49:00.780277] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-28T21:49:01.439003] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T21:49:01.580318] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-28T21:49:02.044726] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T21:49:02.380274] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-28T21:49:02.566459] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T21:49:03.180277] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-28T21:49:03.377175] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:49:03.980284] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-28T21:49:04.517198] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:49:04.711996] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T21:49:04.780297] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-28T21:49:05.580248] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-28T21:49:06.042849] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T21:49:06.208764] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T21:49:06.380252] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-28T21:49:07.078264] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T21:49:07.180274] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-28T21:49:07.825305] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T21:49:07.980270] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-28T21:49:08.780548] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-28T21:49:08.781310] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:49:09.580276] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-28T21:49:10.232867] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T21:49:10.242677] [INFO ] [REMOTE ] VIST: Full fetch complete (67636 records). [2025-10-28T21:49:10.242804] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-28T21:49:10.385408] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-28T21:49:10.629659] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-28T21:49:10.629747] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-28T21:49:10.630830] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-28T21:49:10.630889] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-28T21:49:10.632238] [DEBUG] [LOCAL ] VIST: Trimmed 67636 records to 46686 (keeping 200 days of data) [2025-10-28T21:49:10.924706] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:49:10.944861] [DEBUG] [LOCAL ] VIST: Primary data saved (46686 records). [2025-10-28T21:49:10.944993] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-28T21:49:10.945712] [INFO ] [MAIN ] Update Progress: 2228/2366 symbols completed. VIST took 25.0s. Estimated remaining: 17m 55s. Rate: 7.7 symbols/min [2025-10-28T21:49:11.118919] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:11.131736] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T21:49:11.189566] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-28T21:49:11.192514] [DEBUG] [LOCAL ] VLO: Loaded 52932 existing records from primary storage. [2025-10-28T21:49:11.192925] [INFO ] [MAIN ] VLO: Loaded 52932 existing records. [2025-10-28T21:49:11.378400] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:11.378613] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-28T21:49:11.378690] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-28T21:49:11.378909] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-28T21:49:11.378965] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-28T21:49:11.725241] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:11.980245] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-28T21:49:12.450446] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:49:12.491963] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T21:49:12.780256] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-28T21:49:13.545309] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T21:49:13.549769] [INFO ] [REMOTE ] VKQ: Full fetch complete (24371 records). [2025-10-28T21:49:13.549988] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-28T21:49:13.585445] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-28T21:49:13.932496] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-28T21:49:13.932610] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-28T21:49:13.933313] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-28T21:49:13.933385] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-28T21:49:13.934142] [DEBUG] [LOCAL ] VKQ: Trimmed 24371 records to 17621 (keeping 200 days of data) [2025-10-28T21:49:14.046021] [DEBUG] [LOCAL ] VKQ: Primary data saved (17621 records). [2025-10-28T21:49:14.046164] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-28T21:49:14.046243] [INFO ] [MAIN ] Update Progress: 2229/2366 symbols completed. VKQ took 22.6s. Estimated remaining: 17m 46s. Rate: 7.7 symbols/min [2025-10-28T21:49:14.238095] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:14.274609] [DEBUG] [LOCAL ] VLRS: Loaded 39139 existing records from primary storage. [2025-10-28T21:49:14.274931] [INFO ] [MAIN ] VLRS: Loaded 39139 existing records. [2025-10-28T21:49:14.385480] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-28T21:49:14.470372] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:14.470663] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-28T21:49:14.470743] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-28T21:49:14.471025] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-28T21:49:14.471097] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-28T21:49:14.838284] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:14.938845] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T21:49:15.182361] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-28T21:49:15.191762] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T21:49:15.980245] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-28T21:49:16.358791] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:49:16.780252] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-28T21:49:16.817889] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T21:49:17.580327] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-28T21:49:17.921809] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:49:18.283605] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T21:49:18.380213] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-28T21:49:19.179239] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T21:49:19.184473] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-28T21:49:19.980245] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-28T21:49:20.579912] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:49:20.780264] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-28T21:49:20.980018] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T21:49:21.580256] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-28T21:49:21.798097] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T21:49:22.380263] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-28T21:49:22.998595] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T21:49:23.180259] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-28T21:49:23.581293] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T21:49:23.980271] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-28T21:49:24.520080] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T21:49:24.780274] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-28T21:49:25.123468] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T21:49:25.580288] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-28T21:49:25.731961] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T21:49:26.380223] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-28T21:49:26.736326] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T21:49:27.180242] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-28T21:49:27.536730] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:49:27.980381] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-28T21:49:28.782736] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-28T21:49:28.791069] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T21:49:29.115757] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T21:49:29.123372] [INFO ] [REMOTE ] VLN: Full fetch complete (43007 records). [2025-10-28T21:49:29.123502] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-28T21:49:29.496507] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-28T21:49:29.496575] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-28T21:49:29.497424] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-28T21:49:29.497483] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-28T21:49:29.498370] [DEBUG] [LOCAL ] VLN: Trimmed 43007 records to 31227 (keeping 200 days of data) [2025-10-28T21:49:29.583709] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-28T21:49:29.672131] [DEBUG] [LOCAL ] VLN: Primary data saved (31227 records). [2025-10-28T21:49:29.672268] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-28T21:49:29.672357] [INFO ] [MAIN ] Update Progress: 2230/2366 symbols completed. VLN took 31.8s. Estimated remaining: 17m 39s. Rate: 7.7 symbols/min [2025-10-28T21:49:29.841571] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:29.848083] [DEBUG] [LOCAL ] VLT: Loaded 4125 existing records from primary storage. [2025-10-28T21:49:29.848256] [INFO ] [MAIN ] VLT: Loaded 4125 existing records. [2025-10-28T21:49:30.049182] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:30.028085] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T21:49:30.049527] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-28T21:49:30.057273] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-28T21:49:30.057484] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-28T21:49:30.057754] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-28T21:49:30.099781] [INFO ] [REMOTE ] VIV: Full fetch complete (64260 records). [2025-10-28T21:49:30.131063] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-28T21:49:30.384998] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-28T21:49:30.777351] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:30.796459] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-28T21:49:30.796509] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-28T21:49:30.797626] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-28T21:49:30.797706] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-28T21:49:30.798896] [DEBUG] [LOCAL ] VIV: Trimmed 64260 records to 44356 (keeping 200 days of data) [2025-10-28T21:49:31.062794] [DEBUG] [LOCAL ] VIV: Primary data saved (44356 records). [2025-10-28T21:49:31.062972] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-28T21:49:31.063057] [INFO ] [MAIN ] Update Progress: 2231/2366 symbols completed. VIV took 42.7s. Estimated remaining: 17m 31s. Rate: 7.7 symbols/min [2025-10-28T21:49:31.185734] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-28T21:49:31.235384] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:31.268232] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T21:49:31.313180] [DEBUG] [LOCAL ] VLTO: Loaded 45922 existing records from primary storage. [2025-10-28T21:49:31.313451] [INFO ] [MAIN ] VLTO: Loaded 45922 existing records. [2025-10-28T21:49:31.493487] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:31.493838] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-28T21:49:31.493917] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-28T21:49:31.494244] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-28T21:49:31.494385] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-28T21:49:31.621989] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:49:31.818209] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T21:49:31.883985] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:31.980214] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-28T21:49:32.780306] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-28T21:49:33.370357] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T21:49:33.580343] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-28T21:49:34.100899] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:49:34.115350] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T21:49:34.380272] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-28T21:49:34.814378] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T21:49:35.180301] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-28T21:49:35.980290] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-28T21:49:36.043520] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T21:49:36.780281] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-28T21:49:37.072616] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T21:49:37.580292] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-28T21:49:38.058338] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T21:49:38.297521] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T21:49:38.380277] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-28T21:49:39.180286] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-28T21:49:39.403905] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:49:39.482020] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T21:49:39.980474] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-28T21:49:40.780278] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-28T21:49:41.170407] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T21:49:41.396888] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T21:49:41.580255] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-28T21:49:42.380258] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-28T21:49:43.182680] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-28T21:49:43.188106] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T21:49:43.569588] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T21:49:43.646411] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T21:49:43.980301] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-28T21:49:44.404069] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T21:49:44.780253] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-28T21:49:45.136015] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T21:49:45.580321] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-28T21:49:45.886394] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T21:49:45.887756] [INFO ] [REMOTE ] VLT: Full fetch complete (7346 records). [2025-10-28T21:49:45.887823] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-28T21:49:46.239606] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-28T21:49:46.239702] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-28T21:49:46.239891] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-28T21:49:46.239929] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-28T21:49:46.240292] [DEBUG] [LOCAL ] VLT: Trimmed 7346 records to 4102 (keeping 200 days of data) [2025-10-28T21:49:46.264382] [DEBUG] [LOCAL ] VLT: Primary data saved (4102 records). [2025-10-28T21:49:46.264469] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-28T21:49:46.264539] [INFO ] [MAIN ] Update Progress: 2232/2366 symbols completed. VLT took 16.6s. Estimated remaining: 17m 24s. Rate: 7.7 symbols/min [2025-10-28T21:49:46.385457] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-28T21:49:46.434333] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:46.472883] [DEBUG] [LOCAL ] VMC: Loaded 41857 existing records from primary storage. [2025-10-28T21:49:46.473155] [INFO ] [MAIN ] VMC: Loaded 41857 existing records. [2025-10-28T21:49:46.673337] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:46.673559] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-28T21:49:46.673603] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-28T21:49:46.673815] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-28T21:49:46.673868] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-28T21:49:47.031259] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:47.180219] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-28T21:49:47.905829] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T21:49:47.980263] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-28T21:49:48.284732] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T21:49:48.780307] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-28T21:49:49.518817] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T21:49:49.580204] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-28T21:49:50.061314] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T21:49:50.071811] [INFO ] [REMOTE ] VLO: Full fetch complete (76878 records). [2025-10-28T21:49:50.071943] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-28T21:49:50.389538] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-28T21:49:50.501160] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-28T21:49:50.502953] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T21:49:50.501533] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-28T21:49:50.513294] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-28T21:49:50.513783] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-28T21:49:50.515242] [DEBUG] [LOCAL ] VLO: Trimmed 76878 records to 52916 (keeping 200 days of data) [2025-10-28T21:49:50.838432] [DEBUG] [LOCAL ] VLO: Primary data saved (52916 records). [2025-10-28T21:49:50.838636] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-28T21:49:50.839442] [INFO ] [MAIN ] Update Progress: 2233/2366 symbols completed. VLO took 39.9s. Estimated remaining: 17m 16s. Rate: 7.7 symbols/min [2025-10-28T21:49:51.008014] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:51.024588] [DEBUG] [LOCAL ] VMI: Loaded 14745 existing records from primary storage. [2025-10-28T21:49:51.024838] [INFO ] [MAIN ] VMI: Loaded 14745 existing records. [2025-10-28T21:49:51.194097] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-28T21:49:51.198629] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:51.198906] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-28T21:49:51.199773] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-28T21:49:51.199968] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-28T21:49:51.200024] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-28T21:49:51.573561] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:51.587063] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T21:49:51.594479] [INFO ] [REMOTE ] VLRS: Full fetch complete (58413 records). [2025-10-28T21:49:51.594571] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-28T21:49:51.989528] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-28T21:49:52.010460] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-28T21:49:52.010588] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-28T21:49:52.011791] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-28T21:49:52.011856] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-28T21:49:52.013020] [DEBUG] [LOCAL ] VLRS: Trimmed 58413 records to 39119 (keeping 200 days of data) [2025-10-28T21:49:52.224410] [DEBUG] [LOCAL ] VLRS: Primary data saved (39119 records). [2025-10-28T21:49:52.224540] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-28T21:49:52.224615] [INFO ] [MAIN ] Update Progress: 2234/2366 symbols completed. VLRS took 38.2s. Estimated remaining: 17m 7s. Rate: 7.7 symbols/min [2025-10-28T21:49:52.391199] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:49:52.411138] [DEBUG] [LOCAL ] VMO: Loaded 20312 existing records from primary storage. [2025-10-28T21:49:52.411368] [INFO ] [MAIN ] VMO: Loaded 20312 existing records. [2025-10-28T21:49:52.588072] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:49:52.588442] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-28T21:49:52.588569] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-28T21:49:52.588920] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-28T21:49:52.589005] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-28T21:49:52.787176] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-28T21:49:52.936900] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T21:49:52.986174] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:49:53.364407] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T21:49:53.467033] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T21:49:53.580241] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-28T21:49:54.380248] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-28T21:49:54.912131] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T21:49:55.014789] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T21:49:55.180255] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-28T21:49:55.933199] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T21:49:55.980215] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-28T21:49:56.722940] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T21:49:56.780214] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-28T21:49:57.417564] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T21:49:57.580281] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-28T21:49:58.380284] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-28T21:49:58.952405] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T21:49:59.090062] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T21:49:59.180290] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-28T21:49:59.980351] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-28T21:50:00.368315] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T21:50:00.780230] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-28T21:50:00.802292] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T21:50:01.580300] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-28T21:50:01.909097] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:50:02.380296] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-28T21:50:02.407876] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T21:50:03.180294] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-28T21:50:03.920119] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T21:50:03.939577] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T21:50:03.980209] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-28T21:50:04.747925] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T21:50:04.780221] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-28T21:50:05.580255] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-28T21:50:06.039872] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:50:06.340216] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T21:50:06.380224] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-28T21:50:07.084569] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T21:50:07.180220] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-28T21:50:07.951762] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T21:50:07.980218] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-28T21:50:08.703188] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T21:50:08.780262] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-28T21:50:09.580240] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-28T21:50:09.687506] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T21:50:10.304328] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T21:50:10.380220] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-28T21:50:10.993211] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T21:50:10.996820] [INFO ] [REMOTE ] VMI: Full fetch complete (21372 records). [2025-10-28T21:50:10.996901] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-28T21:50:11.194965] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-28T21:50:11.413020] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-28T21:50:11.413124] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-28T21:50:11.414326] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-28T21:50:11.414391] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-28T21:50:11.415129] [DEBUG] [LOCAL ] VMI: Trimmed 21372 records to 14687 (keeping 200 days of data) [2025-10-28T21:50:11.507769] [DEBUG] [LOCAL ] VMI: Primary data saved (14687 records). [2025-10-28T21:50:11.507919] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-28T21:50:11.508000] [INFO ] [MAIN ] Update Progress: 2235/2366 symbols completed. VMI took 20.7s. Estimated remaining: 17m 0s. Rate: 7.7 symbols/min [2025-10-28T21:50:11.694001] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:11.741016] [DEBUG] [LOCAL ] VNO: Loaded 48642 existing records from primary storage. [2025-10-28T21:50:11.741339] [INFO ] [MAIN ] VNO: Loaded 48642 existing records. [2025-10-28T21:50:11.914249] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:11.914477] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-28T21:50:11.914523] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-28T21:50:11.914751] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-28T21:50:11.914807] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-28T21:50:11.987212] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-28T21:50:12.261197] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:12.619375] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:50:12.780294] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-28T21:50:13.399749] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T21:50:13.580250] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-28T21:50:14.138209] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:50:14.380234] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-28T21:50:14.691141] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T21:50:15.180242] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-28T21:50:15.462150] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:50:15.918874] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T21:50:15.980222] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-28T21:50:16.780290] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-28T21:50:16.811627] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T21:50:17.204556] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T21:50:17.580300] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-28T21:50:18.236480] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T21:50:18.240609] [INFO ] [REMOTE ] VMO: Full fetch complete (30530 records). [2025-10-28T21:50:18.240768] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-28T21:50:18.387300] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-28T21:50:18.607423] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-28T21:50:18.607516] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-28T21:50:18.608176] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-28T21:50:18.608237] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-28T21:50:18.608940] [DEBUG] [LOCAL ] VMO: Trimmed 30530 records to 20252 (keeping 200 days of data) [2025-10-28T21:50:18.725691] [DEBUG] [LOCAL ] VMO: Primary data saved (20252 records). [2025-10-28T21:50:18.725810] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-28T21:50:18.725884] [INFO ] [MAIN ] Update Progress: 2236/2366 symbols completed. VMO took 26.5s. Estimated remaining: 16m 53s. Rate: 7.7 symbols/min [2025-10-28T21:50:18.893525] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:18.933501] [DEBUG] [LOCAL ] VNT: Loaded 43756 existing records from primary storage. [2025-10-28T21:50:18.933811] [INFO ] [MAIN ] VNT: Loaded 43756 existing records. [2025-10-28T21:50:19.110179] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:19.110392] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-28T21:50:19.110438] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-28T21:50:19.110621] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-28T21:50:19.110699] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-28T21:50:19.186230] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-28T21:50:19.480611] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:19.505054] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T21:50:19.654427] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T21:50:19.664294] [INFO ] [REMOTE ] VLTO: Full fetch complete (67377 records). [2025-10-28T21:50:19.664437] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-28T21:50:19.985432] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-28T21:50:20.052145] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-28T21:50:20.052233] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-28T21:50:20.053352] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-28T21:50:20.053743] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-28T21:50:20.055175] [DEBUG] [LOCAL ] VLTO: Trimmed 67377 records to 45929 (keeping 200 days of data) [2025-10-28T21:50:20.337371] [DEBUG] [LOCAL ] VLTO: Primary data saved (45929 records). [2025-10-28T21:50:20.337556] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-28T21:50:20.337685] [INFO ] [MAIN ] Update Progress: 2237/2366 symbols completed. VLTO took 49.3s. Estimated remaining: 16m 44s. Rate: 7.7 symbols/min [2025-10-28T21:50:20.780250] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-28T21:50:21.115476] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:50:21.580320] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-28T21:50:21.957927] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T21:50:21.992057] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T21:50:21.999988] [INFO ] [REMOTE ] VMC: Full fetch complete (62329 records). [2025-10-28T21:50:22.000192] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-28T21:50:22.373266] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-28T21:50:22.373346] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-28T21:50:22.374393] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-28T21:50:22.374457] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-28T21:50:22.375725] [DEBUG] [LOCAL ] VMC: Trimmed 62329 records to 41822 (keeping 200 days of data) [2025-10-28T21:50:22.429419] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-28T21:50:22.631008] [DEBUG] [LOCAL ] VMC: Primary data saved (41822 records). [2025-10-28T21:50:22.631129] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-28T21:50:22.631462] [INFO ] [MAIN ] Update Progress: 2238/2366 symbols completed. VMC took 36.4s. Estimated remaining: 16m 36s. Rate: 7.7 symbols/min [2025-10-28T21:50:23.180252] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-28T21:50:23.920044] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T21:50:23.980249] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-28T21:50:24.394686] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:50:24.780270] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-28T21:50:25.246932] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T21:50:25.580284] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-28T21:50:25.884670] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T21:50:26.380243] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-28T21:50:26.887451] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T21:50:27.180303] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-28T21:50:27.735050] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:50:27.980260] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-28T21:50:28.392278] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:50:28.780259] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-28T21:50:29.193635] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T21:50:29.580263] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-28T21:50:29.955567] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T21:50:30.380319] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-28T21:50:30.698208] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T21:50:31.180324] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-28T21:50:31.573287] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T21:50:31.980352] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-28T21:50:32.235013] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T21:50:32.780439] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-28T21:50:33.288853] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T21:50:33.298527] [INFO ] [REMOTE ] VNO: Full fetch complete (70412 records). [2025-10-28T21:50:33.298735] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-28T21:50:33.704827] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-28T21:50:33.704914] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-28T21:50:33.706161] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-28T21:50:33.706228] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-28T21:50:33.707636] [DEBUG] [LOCAL ] VNO: Trimmed 70412 records to 48605 (keeping 200 days of data) [2025-10-28T21:50:33.967396] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:50:34.019369] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-28T21:50:34.030788] [DEBUG] [LOCAL ] VNO: Primary data saved (48605 records). [2025-10-28T21:50:34.030929] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-28T21:50:34.031023] [INFO ] [MAIN ] Update Progress: 2239/2366 symbols completed. VNO took 22.5s. Estimated remaining: 16m 29s. Rate: 7.7 symbols/min [2025-10-28T21:50:35.116280] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T21:50:35.127214] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-28T21:50:36.191727] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T21:50:36.201071] [INFO ] [REMOTE ] VNT: Full fetch complete (64189 records). [2025-10-28T21:50:36.201185] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-28T21:50:36.593587] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-28T21:50:36.593927] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-28T21:50:36.595098] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-28T21:50:36.595159] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-28T21:50:36.596525] [DEBUG] [LOCAL ] VNT: Trimmed 64189 records to 43681 (keeping 200 days of data) [2025-10-28T21:50:36.863688] [DEBUG] [LOCAL ] VNT: Primary data saved (43681 records). [2025-10-28T21:50:36.863852] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-28T21:50:36.863966] [INFO ] [MAIN ] Update Progress: 2240/2366 symbols completed. VNT took 18.1s. Estimated remaining: 16m 21s. Rate: 7.7 symbols/min [2025-10-28T21:50:37.508708] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:37.638029] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:37.645282] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-28T21:50:37.646858] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-28T21:50:37.646781] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:37.649160] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-28T21:50:37.649427] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-28T21:50:37.649513] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-28T21:50:37.648493] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:37.649823] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-28T21:50:37.733136] [DEBUG] [LOCAL ] VPG: Loaded 16571 existing records from primary storage. [2025-10-28T21:50:37.748539] [INFO ] [MAIN ] VPG: Loaded 16571 existing records. [2025-10-28T21:50:37.737761] [DEBUG] [LOCAL ] VOC: Loaded 8990 existing records from primary storage. [2025-10-28T21:50:37.815385] [INFO ] [MAIN ] VOC: Loaded 8990 existing records. [2025-10-28T21:50:38.250342] [DEBUG] [LOCAL ] VOYA: Loaded 41334 existing records from primary storage. [2025-10-28T21:50:38.399374] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:38.404324] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:38.428775] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-28T21:50:38.392804] [INFO ] [MAIN ] VOYA: Loaded 41334 existing records. [2025-10-28T21:50:38.428584] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-28T21:50:38.428897] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-28T21:50:38.476023] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-28T21:50:38.470740] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-28T21:50:38.481569] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-28T21:50:38.528140] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-28T21:50:38.614751] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:38.648675] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-28T21:50:38.648571] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-10-28T21:50:39.050204] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:50:39.083958] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:39.106185] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-28T21:50:39.120425] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-10-28T21:50:39.120702] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-28T21:50:39.151884] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:50:39.195513] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-28T21:50:39.222864] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-28T21:50:39.271716] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-28T21:50:39.271847] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:50:39.307497] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-28T21:50:39.377624] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-28T21:50:39.427433] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-28T21:50:39.486215] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-28T21:50:39.486103] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:39.512919] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-28T21:50:39.549185] [INFO ] [MAIN ] Update Progress: 2241/2366 symbols completed. VOYG took 2.7s. Estimated remaining: 16m 13s. Rate: 7.7 symbols/min [2025-10-28T21:50:39.886819] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:39.917297] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-28T21:50:40.010338] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:40.093192] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:40.095177] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-28T21:50:40.106563] [DEBUG] [LOCAL ] VPV: Loaded 5024 existing records from primary storage. [2025-10-28T21:50:40.107434] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T21:50:40.110530] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-28T21:50:40.111425] [INFO ] [MAIN ] VPV: Loaded 5024 existing records. [2025-10-28T21:50:40.289695] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:40.289918] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-28T21:50:40.289965] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-28T21:50:40.290136] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-28T21:50:40.290191] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-28T21:50:40.629803] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T21:50:40.665336] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-28T21:50:40.662092] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:40.666534] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-28T21:50:40.762994] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T21:50:40.780248] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-28T21:50:41.015370] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T21:50:41.188549] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T21:50:41.209684] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T21:50:41.353833] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T21:50:41.580278] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-28T21:50:42.092504] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T21:50:42.380260] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-28T21:50:42.918453] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T21:50:43.180251] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-28T21:50:43.721213] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T21:50:43.980267] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-28T21:50:44.370360] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T21:50:44.780254] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-28T21:50:45.307819] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T21:50:45.580246] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-28T21:50:46.099358] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T21:50:46.380254] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-28T21:50:47.029554] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T21:50:47.180298] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-28T21:50:47.751379] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T21:50:47.980283] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-28T21:50:48.373272] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T21:50:48.780247] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-28T21:50:49.580212] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-28T21:50:49.829157] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T21:50:50.154091] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T21:50:50.380261] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-28T21:50:51.153277] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T21:50:51.180270] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-28T21:50:51.667759] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T21:50:51.980248] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-28T21:50:52.780254] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-28T21:50:53.231285] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T21:50:53.522160] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T21:50:53.580311] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-28T21:50:54.380251] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-28T21:50:54.762609] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T21:50:54.875478] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T21:50:54.878383] [INFO ] [REMOTE ] VOC: Full fetch complete (13413 records). [2025-10-28T21:50:54.878472] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-28T21:50:55.185529] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-28T21:50:55.285548] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-28T21:50:55.285616] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-28T21:50:55.285953] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-28T21:50:55.286013] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-28T21:50:55.286452] [DEBUG] [LOCAL ] VOC: Trimmed 13413 records to 9015 (keeping 200 days of data) [2025-10-28T21:50:55.335581] [DEBUG] [LOCAL ] VOC: Primary data saved (9015 records). [2025-10-28T21:50:55.335719] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-28T21:50:55.335804] [INFO ] [MAIN ] Update Progress: 2242/2366 symbols completed. VOC took 18.5s. Estimated remaining: 16m 5s. Rate: 7.7 symbols/min [2025-10-28T21:50:55.501450] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:50:55.534781] [DEBUG] [LOCAL ] VRE: Loaded 35022 existing records from primary storage. [2025-10-28T21:50:55.535055] [INFO ] [MAIN ] VRE: Loaded 35022 existing records. [2025-10-28T21:50:55.706729] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:50:55.706939] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-28T21:50:55.706985] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-28T21:50:55.707163] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-28T21:50:55.707200] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-28T21:50:55.985767] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-28T21:50:56.058463] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:50:56.444322] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T21:50:56.744100] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T21:50:56.780229] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-28T21:50:57.580257] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-28T21:50:57.600132] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T21:50:57.962858] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T21:50:58.380278] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-28T21:50:59.180266] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-28T21:50:59.465208] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T21:50:59.811093] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T21:50:59.980236] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-28T21:51:00.780250] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-28T21:51:01.249701] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T21:51:01.580223] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-28T21:51:01.619783] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T21:51:02.032926] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T21:51:02.380306] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-28T21:51:02.986546] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T21:51:03.180297] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-28T21:51:03.980285] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-28T21:51:04.237679] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T21:51:04.357609] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T21:51:04.780298] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-28T21:51:05.580245] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-28T21:51:05.955376] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T21:51:06.001812] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T21:51:06.380258] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-28T21:51:07.180363] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-28T21:51:07.570593] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T21:51:07.572153] [INFO ] [REMOTE ] VPV: Full fetch complete (8753 records). [2025-10-28T21:51:07.572246] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-28T21:51:07.944476] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T21:51:07.978592] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-28T21:51:07.978905] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-28T21:51:07.979227] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-28T21:51:07.979761] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-28T21:51:07.980465] [DEBUG] [LOCAL ] VPV: Trimmed 8753 records to 5028 (keeping 200 days of data) [2025-10-28T21:51:07.980291] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-28T21:51:08.012158] [DEBUG] [LOCAL ] VPV: Primary data saved (5028 records). [2025-10-28T21:51:08.012273] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-28T21:51:08.012353] [INFO ] [MAIN ] Update Progress: 2243/2366 symbols completed. VPV took 28.5s. Estimated remaining: 15m 58s. Rate: 7.7 symbols/min [2025-10-28T21:51:08.177092] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:08.228099] [DEBUG] [LOCAL ] VRT: Loaded 53754 existing records from primary storage. [2025-10-28T21:51:08.228402] [INFO ] [MAIN ] VRT: Loaded 53754 existing records. [2025-10-28T21:51:08.403021] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:08.403243] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-28T21:51:08.403291] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-28T21:51:08.403483] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-28T21:51:08.403539] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-28T21:51:08.752804] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:08.780228] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-28T21:51:09.128201] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T21:51:09.580269] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-28T21:51:10.380341] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-28T21:51:10.640783] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T21:51:10.921905] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-28T21:51:11.180281] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-28T21:51:11.435136] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T21:51:11.442900] [INFO ] [REMOTE ] VOYA: Full fetch complete (61309 records). [2025-10-28T21:51:11.442996] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-28T21:51:11.820776] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-28T21:51:11.820875] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-28T21:51:11.822014] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-28T21:51:11.822075] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-28T21:51:11.823381] [DEBUG] [LOCAL ] VOYA: Trimmed 61309 records to 41240 (keeping 200 days of data) [2025-10-28T21:51:11.994309] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-28T21:51:12.076158] [DEBUG] [LOCAL ] VOYA: Primary data saved (41240 records). [2025-10-28T21:51:12.076284] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-28T21:51:12.076360] [INFO ] [MAIN ] Update Progress: 2244/2366 symbols completed. VOYA took 35.2s. Estimated remaining: 15m 50s. Rate: 7.7 symbols/min [2025-10-28T21:51:12.274229] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:12.288619] [DEBUG] [LOCAL ] VRTS: Loaded 9395 existing records from primary storage. [2025-10-28T21:51:12.288907] [INFO ] [MAIN ] VRTS: Loaded 9395 existing records. [2025-10-28T21:51:12.568581] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:12.568883] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-28T21:51:12.568952] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-28T21:51:12.569151] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-28T21:51:12.569217] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-28T21:51:12.789783] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-28T21:51:13.135597] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:13.167758] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T21:51:13.221909] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-28T21:51:13.502273] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T21:51:13.580215] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-28T21:51:14.232236] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T21:51:14.235850] [INFO ] [REMOTE ] VPG: Full fetch complete (23297 records). [2025-10-28T21:51:14.235923] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-28T21:51:14.385330] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-28T21:51:14.604512] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-28T21:51:14.604617] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-28T21:51:14.605134] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-28T21:51:14.605195] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-28T21:51:14.605828] [DEBUG] [LOCAL ] VPG: Trimmed 23297 records to 16530 (keeping 200 days of data) [2025-10-28T21:51:14.700411] [DEBUG] [LOCAL ] VPG: Primary data saved (16530 records). [2025-10-28T21:51:14.700542] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-28T21:51:14.700618] [INFO ] [MAIN ] Update Progress: 2245/2366 symbols completed. VPG took 37.8s. Estimated remaining: 15m 42s. Rate: 7.7 symbols/min [2025-10-28T21:51:14.867946] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:14.915818] [DEBUG] [LOCAL ] VSCO: Loaded 52649 existing records from primary storage. [2025-10-28T21:51:14.916157] [INFO ] [MAIN ] VSCO: Loaded 52649 existing records. [2025-10-28T21:51:15.096805] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:15.097031] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-28T21:51:15.097077] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-28T21:51:15.097279] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-28T21:51:15.097337] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-28T21:51:15.185337] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-28T21:51:15.487735] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:15.532938] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T21:51:15.980299] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-28T21:51:16.780276] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-28T21:51:16.931107] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T21:51:17.024018] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-28T21:51:17.580251] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-28T21:51:17.912807] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:51:18.059265] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T21:51:18.380255] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-28T21:51:19.180246] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-28T21:51:19.980303] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-28T21:51:20.295420] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T21:51:20.404904] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T21:51:20.780275] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-28T21:51:21.114226] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:51:21.580295] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-28T21:51:22.003344] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T21:51:22.380254] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-28T21:51:22.845925] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T21:51:22.974075] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-28T21:51:23.180257] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-28T21:51:23.980268] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-28T21:51:24.457075] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T21:51:24.780232] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-28T21:51:25.028959] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-28T21:51:25.580267] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-28T21:51:25.807628] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T21:51:25.814767] [INFO ] [REMOTE ] VRE: Full fetch complete (48824 records). [2025-10-28T21:51:25.814871] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-28T21:51:26.192015] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-28T21:51:26.192102] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-28T21:51:26.193293] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-28T21:51:26.193356] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-28T21:51:26.194471] [DEBUG] [LOCAL ] VRE: Trimmed 48824 records to 35018 (keeping 200 days of data) [2025-10-28T21:51:26.384446] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-28T21:51:26.407636] [DEBUG] [LOCAL ] VRE: Primary data saved (35018 records). [2025-10-28T21:51:26.407815] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-28T21:51:26.407902] [INFO ] [MAIN ] Update Progress: 2246/2366 symbols completed. VRE took 31.1s. Estimated remaining: 15m 34s. Rate: 7.7 symbols/min [2025-10-28T21:51:26.573462] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:26.617559] [DEBUG] [LOCAL ] VSH: Loaded 48222 existing records from primary storage. [2025-10-28T21:51:26.617885] [INFO ] [MAIN ] VSH: Loaded 48222 existing records. [2025-10-28T21:51:26.802247] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:26.802473] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-28T21:51:26.802523] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-28T21:51:26.802729] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-28T21:51:26.802784] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-28T21:51:26.928720] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T21:51:27.167294] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:27.180216] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-28T21:51:27.514227] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-28T21:51:27.823490] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T21:51:27.980251] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-28T21:51:28.547503] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T21:51:28.780240] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-28T21:51:29.580282] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-28T21:51:30.060992] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T21:51:30.214373] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:51:30.380315] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-28T21:51:31.180256] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-28T21:51:31.980264] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-28T21:51:32.326020] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-28T21:51:32.443863] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T21:51:32.585460] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T21:51:32.780263] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-28T21:51:33.580254] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-28T21:51:34.380292] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-28T21:51:34.761507] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:51:34.837290] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-28T21:51:34.910589] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T21:51:34.912705] [INFO ] [REMOTE ] VRTS: Full fetch complete (11972 records). [2025-10-28T21:51:34.912795] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-28T21:51:35.188777] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-28T21:51:35.271732] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-28T21:51:35.271808] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-28T21:51:35.272081] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-28T21:51:35.272118] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-28T21:51:35.272573] [DEBUG] [LOCAL ] VRTS: Trimmed 11972 records to 9382 (keeping 200 days of data) [2025-10-28T21:51:35.328499] [DEBUG] [LOCAL ] VRTS: Primary data saved (9382 records). [2025-10-28T21:51:35.328611] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-28T21:51:35.328728] [INFO ] [MAIN ] Update Progress: 2247/2366 symbols completed. VRTS took 23.3s. Estimated remaining: 15m 26s. Rate: 7.7 symbols/min [2025-10-28T21:51:35.494374] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:35.545023] [DEBUG] [LOCAL ] VST: Loaded 53708 existing records from primary storage. [2025-10-28T21:51:35.545334] [INFO ] [MAIN ] VST: Loaded 53708 existing records. [2025-10-28T21:51:35.722302] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:35.722583] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-28T21:51:35.722667] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-28T21:51:35.722938] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-28T21:51:35.722999] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-28T21:51:35.985434] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-28T21:51:36.092860] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:36.780306] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-28T21:51:37.201183] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-28T21:51:37.213264] [INFO ] [REMOTE ] VRT: Full fetch complete (77933 records). [2025-10-28T21:51:37.213441] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-28T21:51:37.585482] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-28T21:51:37.679854] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-28T21:51:37.680028] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-28T21:51:37.681366] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-28T21:51:37.681450] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-28T21:51:37.712177] [DEBUG] [LOCAL ] VRT: Trimmed 77933 records to 53754 (keeping 200 days of data) [2025-10-28T21:51:37.712023] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-28T21:51:38.007576] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T21:51:38.099559] [DEBUG] [LOCAL ] VRT: Primary data saved (53754 records). [2025-10-28T21:51:38.099739] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-28T21:51:38.100533] [INFO ] [MAIN ] Update Progress: 2248/2366 symbols completed. VRT took 30.1s. Estimated remaining: 15m 18s. Rate: 7.7 symbols/min [2025-10-28T21:51:38.270744] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:38.314255] [DEBUG] [LOCAL ] VSTS: Loaded 48712 existing records from primary storage. [2025-10-28T21:51:38.314542] [INFO ] [MAIN ] VSTS: Loaded 48712 existing records. [2025-10-28T21:51:38.387211] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-28T21:51:38.492704] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:38.492933] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-28T21:51:38.492981] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-28T21:51:38.493203] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-28T21:51:38.493261] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-28T21:51:38.859720] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:39.180262] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-28T21:51:39.689914] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-28T21:51:39.874675] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T21:51:39.980213] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-28T21:51:40.539607] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:51:40.780280] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-28T21:51:41.333513] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T21:51:41.580267] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-28T21:51:41.891950] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T21:51:42.380264] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-28T21:51:43.180316] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-28T21:51:43.843314] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T21:51:43.883599] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-28T21:51:43.980256] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-28T21:51:44.288917] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T21:51:44.780320] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-28T21:51:45.580329] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-28T21:51:45.951258] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-28T21:51:46.255013] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T21:51:46.380271] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-28T21:51:46.809089] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T21:51:47.180332] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-28T21:51:47.980319] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-28T21:51:48.551413] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-28T21:51:48.686868] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T21:51:48.780328] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-28T21:51:49.376622] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T21:51:49.580258] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-28T21:51:50.380272] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-28T21:51:50.676182] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-28T21:51:50.978323] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T21:51:50.988808] [INFO ] [REMOTE ] VSCO: Full fetch complete (76419 records). [2025-10-28T21:51:50.988956] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-28T21:51:51.185416] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-28T21:51:51.374803] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-28T21:51:51.374870] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-28T21:51:51.376051] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-28T21:51:51.376116] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-28T21:51:51.377594] [DEBUG] [LOCAL ] VSCO: Trimmed 76419 records to 52630 (keeping 200 days of data) [2025-10-28T21:51:51.717428] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:51:51.719278] [DEBUG] [LOCAL ] VSCO: Primary data saved (52630 records). [2025-10-28T21:51:51.728709] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-28T21:51:51.728956] [INFO ] [MAIN ] Update Progress: 2249/2366 symbols completed. VSCO took 37.0s. Estimated remaining: 15m 11s. Rate: 7.7 symbols/min [2025-10-28T21:51:51.900184] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:51:51.936959] [DEBUG] [LOCAL ] VTEX: Loaded 42713 existing records from primary storage. [2025-10-28T21:51:51.937229] [INFO ] [MAIN ] VTEX: Loaded 42713 existing records. [2025-10-28T21:51:51.990745] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-28T21:51:52.118432] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:51:52.118598] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-28T21:51:52.118665] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-28T21:51:52.118855] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-28T21:51:52.118898] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-28T21:51:52.481583] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:51:52.722897] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T21:51:52.780274] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-28T21:51:53.580298] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-28T21:51:53.739607] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T21:51:54.072081] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T21:51:54.380289] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-28T21:51:54.616991] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T21:51:55.180316] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-28T21:51:55.434762] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T21:51:55.980299] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-28T21:51:56.488163] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T21:51:56.780251] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-28T21:51:57.086193] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T21:51:57.580249] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-28T21:51:58.380226] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-28T21:51:58.603955] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T21:51:58.643036] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T21:51:59.180303] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-28T21:51:59.560935] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T21:51:59.980297] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-28T21:52:00.277222] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T21:52:00.286820] [INFO ] [REMOTE ] VSTS: Full fetch complete (69706 records). [2025-10-28T21:52:00.286933] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-28T21:52:00.679929] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-28T21:52:00.680000] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-28T21:52:00.681102] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-28T21:52:00.681163] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-28T21:52:00.682414] [DEBUG] [LOCAL ] VSTS: Trimmed 69706 records to 48663 (keeping 200 days of data) [2025-10-28T21:52:00.780825] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-28T21:52:00.957624] [DEBUG] [LOCAL ] VSTS: Primary data saved (48663 records). [2025-10-28T21:52:00.957777] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-28T21:52:00.958427] [INFO ] [MAIN ] Update Progress: 2250/2366 symbols completed. VSTS took 22.9s. Estimated remaining: 15m 3s. Rate: 7.7 symbols/min [2025-10-28T21:52:01.127247] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:01.171743] [DEBUG] [LOCAL ] VTLE: Loaded 47226 existing records from primary storage. [2025-10-28T21:52:01.172028] [INFO ] [MAIN ] VTLE: Loaded 47226 existing records. [2025-10-28T21:52:01.368694] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:01.368976] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-28T21:52:01.369076] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-28T21:52:01.369312] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-28T21:52:01.369386] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-28T21:52:01.567662] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T21:52:01.603468] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-28T21:52:01.850569] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:02.380348] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-28T21:52:02.631482] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-28T21:52:02.802702] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T21:52:03.180303] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-28T21:52:03.526406] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:52:03.980257] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-28T21:52:04.342072] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T21:52:04.780328] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-28T21:52:05.206427] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T21:52:05.580250] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-28T21:52:05.859944] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:52:06.380285] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-28T21:52:06.643259] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T21:52:07.180296] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-28T21:52:07.695325] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T21:52:07.980309] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-28T21:52:08.780240] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-28T21:52:09.291172] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-28T21:52:09.330935] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:52:09.580246] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-28T21:52:09.923723] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T21:52:10.380244] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-28T21:52:11.051082] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T21:52:11.180251] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-28T21:52:11.569812] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T21:52:11.980273] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-28T21:52:12.425600] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T21:52:12.436915] [INFO ] [REMOTE ] VST: Full fetch complete (77887 records). [2025-10-28T21:52:12.452248] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-28T21:52:12.464340] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T21:52:12.785367] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-28T21:52:12.886416] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-28T21:52:12.886508] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-28T21:52:12.887704] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-28T21:52:12.887770] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-28T21:52:12.889235] [DEBUG] [LOCAL ] VST: Trimmed 77887 records to 53708 (keeping 200 days of data) [2025-10-28T21:52:13.228343] [DEBUG] [LOCAL ] VST: Primary data saved (53708 records). [2025-10-28T21:52:13.228518] [INFO ] [MAIN ] VST: Full history saved. [2025-10-28T21:52:13.228666] [INFO ] [MAIN ] Update Progress: 2251/2366 symbols completed. VST took 37.9s. Estimated remaining: 14m 56s. Rate: 7.7 symbols/min [2025-10-28T21:52:13.401948] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:13.419691] [DEBUG] [LOCAL ] VTMX: Loaded 17601 existing records from primary storage. [2025-10-28T21:52:13.419961] [INFO ] [MAIN ] VTMX: Loaded 17601 existing records. [2025-10-28T21:52:13.585702] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-28T21:52:13.607099] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:13.607458] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-28T21:52:13.607507] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-28T21:52:13.607706] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-28T21:52:13.607765] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-28T21:52:13.966149] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:13.989814] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:52:14.380260] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-28T21:52:14.894027] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T21:52:15.180254] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-28T21:52:15.445106] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T21:52:15.980260] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-28T21:52:16.354909] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:52:16.363327] [INFO ] [REMOTE ] VTEX: Full fetch complete (61077 records). [2025-10-28T21:52:16.363431] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-28T21:52:16.757289] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T21:52:16.772418] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-28T21:52:16.772599] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-28T21:52:16.777836] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-28T21:52:16.777940] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-28T21:52:16.779139] [DEBUG] [LOCAL ] VTEX: Trimmed 61077 records to 42681 (keeping 200 days of data) [2025-10-28T21:52:16.780238] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-28T21:52:17.016443] [DEBUG] [LOCAL ] VTEX: Primary data saved (42681 records). [2025-10-28T21:52:17.016571] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-28T21:52:17.016672] [INFO ] [MAIN ] Update Progress: 2252/2366 symbols completed. VTEX took 25.3s. Estimated remaining: 14m 48s. Rate: 7.7 symbols/min [2025-10-28T21:52:17.196022] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:17.205732] [DEBUG] [LOCAL ] VTN: Loaded 7126 existing records from primary storage. [2025-10-28T21:52:17.205934] [INFO ] [MAIN ] VTN: Loaded 7126 existing records. [2025-10-28T21:52:17.386134] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:17.386327] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-28T21:52:17.386375] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-28T21:52:17.386518] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-28T21:52:17.386559] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-28T21:52:17.586965] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-28T21:52:17.750860] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:17.762759] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T21:52:18.380275] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-28T21:52:19.029137] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T21:52:19.058900] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T21:52:19.180211] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-28T21:52:19.703578] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T21:52:19.980237] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-28T21:52:20.780226] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-28T21:52:20.830552] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T21:52:21.287346] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T21:52:21.580229] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-28T21:52:22.380258] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-28T21:52:22.830203] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T21:52:23.180306] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-28T21:52:23.540175] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T21:52:23.549972] [INFO ] [REMOTE ] VSH: Full fetch complete (71013 records). [2025-10-28T21:52:23.550102] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-28T21:52:23.941764] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-28T21:52:23.941844] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-28T21:52:23.942953] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-28T21:52:23.943015] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-28T21:52:23.944348] [DEBUG] [LOCAL ] VSH: Trimmed 71013 records to 48207 (keeping 200 days of data) [2025-10-28T21:52:23.996853] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-28T21:52:24.238261] [DEBUG] [LOCAL ] VSH: Primary data saved (48207 records). [2025-10-28T21:52:24.238384] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-28T21:52:24.238477] [INFO ] [MAIN ] Update Progress: 2253/2366 symbols completed. VSH took 57.8s. Estimated remaining: 14m 40s. Rate: 7.7 symbols/min [2025-10-28T21:52:24.420790] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:24.450873] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T21:52:24.478770] [DEBUG] [LOCAL ] VTOL: Loaded 19174 existing records from primary storage. [2025-10-28T21:52:24.479107] [INFO ] [MAIN ] VTOL: Loaded 19174 existing records. [2025-10-28T21:52:24.603447] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T21:52:24.687741] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:24.687995] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-28T21:52:24.688051] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-28T21:52:24.688269] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-28T21:52:24.688338] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-28T21:52:24.785388] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-28T21:52:25.074121] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:25.296616] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T21:52:25.580259] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-28T21:52:26.140303] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T21:52:26.380286] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-28T21:52:27.180269] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-28T21:52:27.428482] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T21:52:27.436866] [INFO ] [REMOTE ] VTLE: Full fetch complete (68071 records). [2025-10-28T21:52:27.437022] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-28T21:52:27.834873] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-28T21:52:27.834950] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-28T21:52:27.836072] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-28T21:52:27.836294] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-28T21:52:27.837598] [DEBUG] [LOCAL ] VTLE: Trimmed 68071 records to 47054 (keeping 200 days of data) [2025-10-28T21:52:27.939976] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T21:52:28.020816] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-28T21:52:28.129265] [DEBUG] [LOCAL ] VTLE: Primary data saved (47054 records). [2025-10-28T21:52:28.129409] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-28T21:52:28.129977] [INFO ] [MAIN ] Update Progress: 2254/2366 symbols completed. VTLE took 27.2s. Estimated remaining: 14m 32s. Rate: 7.7 symbols/min [2025-10-28T21:52:28.292151] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:28.340826] [DEBUG] [LOCAL ] VTR: Loaded 52638 existing records from primary storage. [2025-10-28T21:52:28.341126] [INFO ] [MAIN ] VTR: Loaded 52638 existing records. [2025-10-28T21:52:28.515425] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:28.515629] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-28T21:52:28.515709] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-28T21:52:28.515932] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-28T21:52:28.516003] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-28T21:52:28.785065] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-28T21:52:28.830122] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T21:52:28.910832] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:29.267895] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T21:52:29.580286] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-28T21:52:30.027351] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T21:52:30.380274] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-28T21:52:30.845908] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T21:52:31.180244] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-28T21:52:31.837614] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T21:52:31.980249] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-28T21:52:32.785357] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-28T21:52:32.794079] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:52:33.354255] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T21:52:33.580265] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-28T21:52:34.227361] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T21:52:34.380251] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-28T21:52:35.154619] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T21:52:35.180215] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-28T21:52:35.705198] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T21:52:35.980293] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-28T21:52:36.464286] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T21:52:36.780307] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-28T21:52:37.278896] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T21:52:37.281190] [INFO ] [REMOTE ] VTN: Full fetch complete (10970 records). [2025-10-28T21:52:37.281263] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-28T21:52:37.585395] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-28T21:52:37.660278] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-28T21:52:37.660376] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-28T21:52:37.660628] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-28T21:52:37.660701] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-28T21:52:37.661222] [DEBUG] [LOCAL ] VTN: Trimmed 10970 records to 7104 (keeping 200 days of data) [2025-10-28T21:52:37.705308] [DEBUG] [LOCAL ] VTN: Primary data saved (7104 records). [2025-10-28T21:52:37.705443] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-28T21:52:37.705526] [INFO ] [MAIN ] Update Progress: 2255/2366 symbols completed. VTN took 20.7s. Estimated remaining: 14m 24s. Rate: 7.7 symbols/min [2025-10-28T21:52:37.881581] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:37.911461] [DEBUG] [LOCAL ] VTS: Loaded 29492 existing records from primary storage. [2025-10-28T21:52:37.911760] [INFO ] [MAIN ] VTS: Loaded 29492 existing records. [2025-10-28T21:52:38.097031] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:38.097283] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-28T21:52:38.097332] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-28T21:52:38.097576] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-28T21:52:38.097635] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-28T21:52:38.382495] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-28T21:52:38.462003] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:38.981676] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T21:52:39.066041] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T21:52:39.180284] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-28T21:52:39.983734] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-28T21:52:39.985579] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T21:52:39.992954] [INFO ] [REMOTE ] VTMX: Full fetch complete (26175 records). [2025-10-28T21:52:39.993069] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-28T21:52:40.375484] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-28T21:52:40.375565] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-28T21:52:40.376154] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-28T21:52:40.376254] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-28T21:52:40.377053] [DEBUG] [LOCAL ] VTMX: Trimmed 26175 records to 17635 (keeping 200 days of data) [2025-10-28T21:52:40.483336] [DEBUG] [LOCAL ] VTMX: Primary data saved (17635 records). [2025-10-28T21:52:40.483479] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-28T21:52:40.483557] [INFO ] [MAIN ] Update Progress: 2256/2366 symbols completed. VTMX took 27.3s. Estimated remaining: 14m 16s. Rate: 7.7 symbols/min [2025-10-28T21:52:40.650243] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:52:40.678704] [DEBUG] [LOCAL ] VVR: Loaded 30814 existing records from primary storage. [2025-10-28T21:52:40.678964] [INFO ] [MAIN ] VVR: Loaded 30814 existing records. [2025-10-28T21:52:40.781482] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-28T21:52:40.862306] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:52:40.862533] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-28T21:52:40.862582] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-28T21:52:40.862826] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-28T21:52:40.862877] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-28T21:52:41.153294] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T21:52:41.232997] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:52:41.580299] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-28T21:52:42.091435] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T21:52:42.380255] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-28T21:52:42.635260] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T21:52:43.180278] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-28T21:52:43.742773] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T21:52:43.838878] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T21:52:43.980246] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-28T21:52:44.780246] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-28T21:52:44.880058] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T21:52:45.489836] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T21:52:45.580317] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-28T21:52:46.380254] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-28T21:52:46.456889] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T21:52:47.184130] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-28T21:52:47.186775] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:52:47.980210] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-28T21:52:48.179384] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T21:52:48.780238] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-28T21:52:48.832870] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T21:52:49.574697] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T21:52:49.581222] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-28T21:52:50.380280] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-28T21:52:50.553801] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T21:52:51.111688] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T21:52:51.180230] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-28T21:52:51.980368] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-28T21:52:52.068687] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T21:52:52.780325] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-28T21:52:53.464524] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T21:52:53.558233] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T21:52:53.580219] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-28T21:52:54.380265] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-28T21:52:55.088939] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T21:52:55.180208] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-28T21:52:55.228700] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T21:52:55.980242] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-28T21:52:56.421677] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:52:56.780236] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-28T21:52:56.881231] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:52:57.580225] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-28T21:52:57.681976] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T21:52:58.306336] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T21:52:58.380241] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-28T21:52:59.180240] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-28T21:52:59.358474] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T21:52:59.980255] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-28T21:53:00.497117] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:53:00.780268] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-28T21:53:00.901707] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T21:53:00.907778] [INFO ] [REMOTE ] VTS: Full fetch complete (41702 records). [2025-10-28T21:53:00.907878] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-28T21:53:01.309619] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-28T21:53:01.309728] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-28T21:53:01.310613] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-28T21:53:01.310682] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-28T21:53:01.311605] [DEBUG] [LOCAL ] VTS: Trimmed 41702 records to 29441 (keeping 200 days of data) [2025-10-28T21:53:01.497419] [DEBUG] [LOCAL ] VTS: Primary data saved (29441 records). [2025-10-28T21:53:01.497549] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-28T21:53:01.497629] [INFO ] [MAIN ] Update Progress: 2257/2366 symbols completed. VTS took 23.8s. Estimated remaining: 14m 9s. Rate: 7.7 symbols/min [2025-10-28T21:53:01.585323] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-28T21:53:01.672138] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:01.684499] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:53:01.730560] [DEBUG] [LOCAL ] VVV: Loaded 50075 existing records from primary storage. [2025-10-28T21:53:01.730925] [INFO ] [MAIN ] VVV: Loaded 50075 existing records. [2025-10-28T21:53:01.904509] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:01.904750] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-28T21:53:01.904805] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-28T21:53:01.905106] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-28T21:53:01.905162] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-28T21:53:02.263110] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:02.380234] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-28T21:53:02.982236] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:53:03.180253] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-28T21:53:03.659181] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T21:53:03.774737] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T21:53:03.980247] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-28T21:53:04.661020] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T21:53:04.664830] [INFO ] [REMOTE ] VTOL: Full fetch complete (26549 records). [2025-10-28T21:53:04.664934] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-28T21:53:04.785362] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-28T21:53:05.046433] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-28T21:53:05.046505] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-28T21:53:05.047052] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-28T21:53:05.047111] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-28T21:53:05.047752] [DEBUG] [LOCAL ] VTOL: Trimmed 26549 records to 19046 (keeping 200 days of data) [2025-10-28T21:53:05.154230] [DEBUG] [LOCAL ] VTOL: Primary data saved (19046 records). [2025-10-28T21:53:05.154362] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-28T21:53:05.154437] [INFO ] [MAIN ] Update Progress: 2258/2366 symbols completed. VTOL took 40.9s. Estimated remaining: 14m 1s. Rate: 7.7 symbols/min [2025-10-28T21:53:05.322596] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:05.344313] [DEBUG] [LOCAL ] VVX: Loaded 22918 existing records from primary storage. [2025-10-28T21:53:05.344545] [INFO ] [MAIN ] VVX: Loaded 22918 existing records. [2025-10-28T21:53:05.516307] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:05.516526] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-28T21:53:05.516572] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-28T21:53:05.516754] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-28T21:53:05.516808] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-28T21:53:05.584956] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-28T21:53:05.887589] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T21:53:05.892613] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:06.380241] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-28T21:53:07.180278] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-28T21:53:07.439894] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T21:53:07.980214] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-28T21:53:07.993949] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T21:53:08.662884] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-10-28T21:53:08.780255] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-28T21:53:08.930237] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T21:53:08.937352] [INFO ] [REMOTE ] VVR: Full fetch complete (46560 records). [2025-10-28T21:53:08.937474] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-28T21:53:09.324421] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-28T21:53:09.324505] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-28T21:53:09.325474] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-28T21:53:09.325536] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-28T21:53:09.326510] [DEBUG] [LOCAL ] VVR: Trimmed 46560 records to 30651 (keeping 200 days of data) [2025-10-28T21:53:09.447842] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T21:53:09.517166] [DEBUG] [LOCAL ] VVR: Primary data saved (30651 records). [2025-10-28T21:53:09.517312] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-28T21:53:09.517404] [INFO ] [MAIN ] Update Progress: 2259/2366 symbols completed. VVR took 29.0s. Estimated remaining: 13m 53s. Rate: 7.7 symbols/min [2025-10-28T21:53:09.585418] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-28T21:53:09.688616] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:09.730934] [DEBUG] [LOCAL ] VYX: Loaded 48119 existing records from primary storage. [2025-10-28T21:53:09.731223] [INFO ] [MAIN ] VYX: Loaded 48119 existing records. [2025-10-28T21:53:09.904508] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:09.904701] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-28T21:53:09.904757] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-28T21:53:09.904940] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-28T21:53:09.904980] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-28T21:53:10.251456] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:10.380234] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-28T21:53:10.793623] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:53:11.180268] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-28T21:53:11.557469] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:53:11.980267] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-28T21:53:12.166327] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:53:12.780247] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-28T21:53:13.407511] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T21:53:13.574234] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T21:53:13.584536] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-28T21:53:13.586246] [INFO ] [REMOTE ] VTR: Full fetch complete (76433 records). [2025-10-28T21:53:13.586340] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-28T21:53:13.990365] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-28T21:53:13.990449] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-28T21:53:13.991907] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-28T21:53:13.991968] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-28T21:53:13.993380] [DEBUG] [LOCAL ] VTR: Trimmed 76433 records to 52634 (keeping 200 days of data) [2025-10-28T21:53:14.306170] [DEBUG] [LOCAL ] VTR: Primary data saved (52634 records). [2025-10-28T21:53:14.306294] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-28T21:53:14.307110] [INFO ] [MAIN ] Update Progress: 2260/2366 symbols completed. VTR took 46.2s. Estimated remaining: 13m 45s. Rate: 7.7 symbols/min [2025-10-28T21:53:14.385476] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-28T21:53:14.472948] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:14.521589] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-28T21:53:14.521899] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-28T21:53:14.696430] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:14.696593] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-28T21:53:14.696637] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-28T21:53:14.696901] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-28T21:53:14.696955] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-28T21:53:15.094935] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:15.097045] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T21:53:15.180237] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-28T21:53:15.674386] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T21:53:15.980209] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-28T21:53:15.994200] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:53:16.780324] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-28T21:53:17.580322] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-28T21:53:18.082736] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-28T21:53:18.123712] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:53:18.380259] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-28T21:53:18.755696] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T21:53:19.180270] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-28T21:53:19.506017] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:53:19.980296] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-28T21:53:20.485260] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T21:53:20.780327] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-28T21:53:21.580270] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-28T21:53:21.741738] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-28T21:53:22.101159] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T21:53:22.380284] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-28T21:53:22.796536] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T21:53:23.180263] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-28T21:53:23.980278] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-28T21:53:23.995218] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T21:53:24.124193] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T21:53:24.780311] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-28T21:53:25.350167] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T21:53:25.580243] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-28T21:53:26.050045] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T21:53:26.380265] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-28T21:53:26.842523] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T21:53:27.180238] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-28T21:53:27.204288] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T21:53:27.980294] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-28T21:53:28.692742] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T21:53:28.780251] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-28T21:53:28.845901] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T21:53:29.580258] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-28T21:53:29.980162] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T21:53:30.380292] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-28T21:53:30.900569] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T21:53:31.180223] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-28T21:53:31.377733] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:53:31.980288] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-28T21:53:32.780331] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-28T21:53:32.996468] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-28T21:53:33.048105] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T21:53:33.580300] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-28T21:53:34.051924] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T21:53:34.061886] [INFO ] [REMOTE ] VVV: Full fetch complete (72457 records). [2025-10-28T21:53:34.062036] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-28T21:53:34.385486] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-28T21:53:34.463704] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-28T21:53:34.463796] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-28T21:53:34.465034] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-28T21:53:34.465096] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-28T21:53:34.466561] [DEBUG] [LOCAL ] VVV: Trimmed 72457 records to 50036 (keeping 200 days of data) [2025-10-28T21:53:34.753973] [DEBUG] [LOCAL ] VVV: Primary data saved (50036 records). [2025-10-28T21:53:34.754098] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-28T21:53:34.754177] [INFO ] [MAIN ] Update Progress: 2261/2366 symbols completed. VVV took 33.3s. Estimated remaining: 13m 38s. Rate: 7.7 symbols/min [2025-10-28T21:53:34.936448] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:34.987500] [DEBUG] [LOCAL ] W: Loaded 53407 existing records from primary storage. [2025-10-28T21:53:34.987855] [INFO ] [MAIN ] W: Loaded 53407 existing records. [2025-10-28T21:53:35.172197] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:35.172389] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-28T21:53:35.172435] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-28T21:53:35.172691] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-28T21:53:35.172748] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-28T21:53:35.203868] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-28T21:53:35.536188] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:35.553624] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T21:53:35.608708] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-28T21:53:35.980247] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-28T21:53:36.324024] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T21:53:36.333103] [INFO ] [REMOTE ] VYX: Full fetch complete (70095 records). [2025-10-28T21:53:36.333206] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-28T21:53:36.730952] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-28T21:53:36.731070] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-28T21:53:36.732277] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-28T21:53:36.732473] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-28T21:53:36.749622] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T21:53:36.754897] [DEBUG] [LOCAL ] VYX: Trimmed 70095 records to 48034 (keeping 200 days of data) [2025-10-28T21:53:36.756572] [INFO ] [REMOTE ] VVX: Full fetch complete (33111 records). [2025-10-28T21:53:36.756836] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-28T21:53:36.803480] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-28T21:53:37.404011] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-28T21:53:37.404747] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-28T21:53:37.406393] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-28T21:53:37.412860] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-28T21:53:37.449049] [DEBUG] [LOCAL ] VVX: Trimmed 33111 records to 22872 (keeping 200 days of data) [2025-10-28T21:53:37.580959] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-28T21:53:37.579961] [DEBUG] [LOCAL ] VYX: Primary data saved (48034 records). [2025-10-28T21:53:37.590899] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-28T21:53:37.597914] [INFO ] [MAIN ] Update Progress: 2262/2366 symbols completed. VYX took 28.1s. Estimated remaining: 13m 30s. Rate: 7.7 symbols/min [2025-10-28T21:53:37.631020] [DEBUG] [LOCAL ] VVX: Primary data saved (22872 records). [2025-10-28T21:53:37.668965] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-28T21:53:37.683723] [INFO ] [MAIN ] Update Progress: 2263/2366 symbols completed. VVX took 32.5s. Estimated remaining: 13m 22s. Rate: 7.7 symbols/min [2025-10-28T21:53:37.942333] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:37.959911] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:38.010571] [DEBUG] [LOCAL ] WAL: Loaded 45573 existing records from primary storage. [2025-10-28T21:53:38.022466] [INFO ] [MAIN ] WAL: Loaded 45573 existing records. [2025-10-28T21:53:38.092023] [DEBUG] [LOCAL ] WAB: Loaded 43665 existing records from primary storage. [2025-10-28T21:53:38.114396] [INFO ] [MAIN ] WAB: Loaded 43665 existing records. [2025-10-28T21:53:38.320872] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:38.332094] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-28T21:53:38.337590] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-28T21:53:38.379578] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-28T21:53:38.379777] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-28T21:53:38.407518] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:38.427316] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-28T21:53:38.432581] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-28T21:53:38.460361] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-28T21:53:38.465612] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-28T21:53:39.091433] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:39.131442] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-28T21:53:39.172639] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:53:39.177256] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-28T21:53:39.187301] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-28T21:53:39.906637] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-28T21:53:39.980365] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-28T21:53:40.368619] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T21:53:40.558421] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T21:53:40.780299] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-28T21:53:41.478688] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T21:53:41.580318] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-28T21:53:42.105501] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T21:53:42.380285] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-28T21:53:43.180235] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-28T21:53:43.299182] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T21:53:43.555712] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:53:43.980282] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-28T21:53:44.780237] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-28T21:53:44.920520] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T21:53:45.592267] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-28T21:53:45.599826] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T21:53:46.380269] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-28T21:53:47.032515] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:53:47.076068] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-28T21:53:47.180237] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-28T21:53:47.844604] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T21:53:47.980249] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-28T21:53:48.761203] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T21:53:48.780219] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-28T21:53:49.405350] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T21:53:49.580256] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-28T21:53:50.064300] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T21:53:50.380266] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-28T21:53:50.871234] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T21:53:51.180254] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-28T21:53:51.452997] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T21:53:51.980257] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-28T21:53:52.493223] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T21:53:52.780255] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-28T21:53:53.355258] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T21:53:53.580231] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-28T21:53:53.946831] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T21:53:54.380291] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-28T21:53:54.851304] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T21:53:55.180256] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-28T21:53:55.491143] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T21:53:55.980240] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-28T21:53:56.563768] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T21:53:56.780282] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-28T21:53:57.352235] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T21:53:57.580234] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-28T21:53:58.342204] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T21:53:58.380212] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-28T21:53:58.831019] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T21:53:58.841071] [INFO ] [REMOTE ] WAL: Full fetch complete (67300 records). [2025-10-28T21:53:58.841211] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-28T21:53:59.197815] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-28T21:53:59.219584] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-28T21:53:59.219682] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-28T21:53:59.220820] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-28T21:53:59.220880] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-28T21:53:59.222298] [DEBUG] [LOCAL ] WAL: Trimmed 67300 records to 45529 (keeping 200 days of data) [2025-10-28T21:53:59.495775] [DEBUG] [LOCAL ] WAL: Primary data saved (45529 records). [2025-10-28T21:53:59.495913] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-28T21:53:59.496029] [INFO ] [MAIN ] Update Progress: 2264/2366 symbols completed. WAL took 21.8s. Estimated remaining: 13m 15s. Rate: 7.7 symbols/min [2025-10-28T21:53:59.659529] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:53:59.691925] [DEBUG] [LOCAL ] WAT: Loaded 35383 existing records from primary storage. [2025-10-28T21:53:59.692240] [INFO ] [MAIN ] WAT: Loaded 35383 existing records. [2025-10-28T21:53:59.891380] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:53:59.891694] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-28T21:53:59.891795] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-28T21:53:59.891988] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-28T21:53:59.892028] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-28T21:53:59.982242] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-28T21:54:00.250032] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:00.280219] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T21:54:00.292023] [INFO ] [REMOTE ] W: Full fetch complete (77507 records). [2025-10-28T21:54:00.292156] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-28T21:54:00.711173] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-28T21:54:00.711271] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-28T21:54:00.712554] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-28T21:54:00.712622] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-28T21:54:00.714079] [DEBUG] [LOCAL ] W: Trimmed 77507 records to 53407 (keeping 200 days of data) [2025-10-28T21:54:00.803969] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-28T21:54:01.085116] [DEBUG] [LOCAL ] W: Primary data saved (53407 records). [2025-10-28T21:54:01.085302] [INFO ] [MAIN ] W: Full history saved. [2025-10-28T21:54:01.085419] [INFO ] [MAIN ] Update Progress: 2265/2366 symbols completed. W took 26.3s. Estimated remaining: 13m 7s. Rate: 7.7 symbols/min [2025-10-28T21:54:01.358425] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:01.358955] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-28T21:54:01.359043] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-28T21:54:01.359414] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-28T21:54:01.359524] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-28T21:54:01.359705] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-28T21:54:01.359820] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-28T21:54:01.684452] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T21:54:01.694424] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-28T21:54:01.786448] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-28T21:54:02.077005] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:02.108775] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T21:54:02.380288] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-28T21:54:02.805105] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T21:54:02.816395] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-28T21:54:02.816578] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-28T21:54:03.182301] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-28T21:54:03.224951] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-28T21:54:03.225143] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-28T21:54:03.226889] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-28T21:54:03.227327] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-28T21:54:03.229038] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 53791 (keeping 200 days of data) [2025-10-28T21:54:03.349593] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T21:54:03.589159] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-28T21:54:03.589285] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-28T21:54:03.590242] [INFO ] [MAIN ] Update Progress: 2266/2366 symbols completed. VZ took 49.3s. Estimated remaining: 12m 58s. Rate: 7.7 symbols/min [2025-10-28T21:54:03.755313] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:03.798231] [DEBUG] [LOCAL ] WBS: Loaded 48813 existing records from primary storage. [2025-10-28T21:54:03.798509] [INFO ] [MAIN ] WBS: Loaded 48813 existing records. [2025-10-28T21:54:03.971534] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:03.971752] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-28T21:54:03.971802] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-28T21:54:03.971998] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-28T21:54:03.972036] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-28T21:54:03.985400] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-28T21:54:04.348946] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:04.369916] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T21:54:04.780247] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-28T21:54:05.277514] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T21:54:05.580286] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-28T21:54:05.984467] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T21:54:06.380266] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-28T21:54:06.617494] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T21:54:06.844942] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:54:06.853893] [INFO ] [REMOTE ] WAB: Full fetch complete (64336 records). [2025-10-28T21:54:06.854015] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-28T21:54:07.185446] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-10-28T21:54:07.240618] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-28T21:54:07.240738] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-28T21:54:07.241897] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-28T21:54:07.241958] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-28T21:54:07.243256] [DEBUG] [LOCAL ] WAB: Trimmed 64336 records to 43602 (keeping 200 days of data) [2025-10-28T21:54:07.466015] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T21:54:07.468372] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-10-28T21:54:07.468852] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T21:54:07.470578] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-28T21:54:07.472189] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T21:54:07.472601] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-28T21:54:07.473539] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-28T21:54:07.473940] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-28T21:54:07.474837] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-28T21:54:07.475497] [INFO ] [MAIN ] Update Progress: 2267/2366 symbols completed. WBI took 6.4s. Estimated remaining: 12m 51s. Rate: 7.7 symbols/min [2025-10-28T21:54:07.672172] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:07.711278] [DEBUG] [LOCAL ] WAB: Primary data saved (43602 records). [2025-10-28T21:54:07.710821] [DEBUG] [LOCAL ] WBX: Loaded 9485 existing records from primary storage. [2025-10-28T21:54:07.711559] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-28T21:54:07.711867] [INFO ] [MAIN ] WBX: Loaded 9485 existing records. [2025-10-28T21:54:07.712365] [INFO ] [MAIN ] Update Progress: 2268/2366 symbols completed. WAB took 30.1s. Estimated remaining: 12m 42s. Rate: 7.7 symbols/min [2025-10-28T21:54:08.006018] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-28T21:54:08.069720] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:08.090431] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:08.091080] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-28T21:54:08.091162] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-28T21:54:08.091333] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-28T21:54:08.091390] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-28T21:54:08.399277] [DEBUG] [LOCAL ] WCC: Loaded 38119 existing records from primary storage. [2025-10-28T21:54:08.399982] [INFO ] [MAIN ] WCC: Loaded 38119 existing records. [2025-10-28T21:54:08.620660] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:08.686975] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:08.688172] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-28T21:54:08.688233] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-28T21:54:08.689027] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-28T21:54:08.689085] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-28T21:54:08.788527] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-28T21:54:09.052215] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:09.425596] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T21:54:09.580293] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-28T21:54:09.690980] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T21:54:10.380248] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-28T21:54:10.828467] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T21:54:11.180241] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-28T21:54:11.299105] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T21:54:11.980317] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-28T21:54:12.392226] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T21:54:12.780248] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-28T21:54:13.029130] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T21:54:13.580274] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-28T21:54:14.053955] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T21:54:14.380259] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-28T21:54:15.180239] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-28T21:54:15.545561] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T21:54:15.666493] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-28T21:54:15.980249] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-28T21:54:16.555377] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T21:54:16.780270] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-28T21:54:17.053582] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T21:54:17.580259] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-28T21:54:18.372175] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T21:54:18.381391] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-28T21:54:18.471335] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T21:54:19.094207] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T21:54:19.180272] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-28T21:54:19.929358] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T21:54:19.980260] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-28T21:54:20.780296] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-28T21:54:21.218996] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T21:54:21.580247] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-28T21:54:22.138431] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T21:54:22.380284] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-28T21:54:22.880045] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T21:54:23.180300] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-28T21:54:23.832268] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T21:54:23.980267] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-28T21:54:24.598847] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T21:54:24.758803] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T21:54:24.780232] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-28T21:54:25.580244] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-28T21:54:25.917145] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T21:54:26.054393] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T21:54:26.380246] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-28T21:54:27.180306] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-28T21:54:27.543110] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T21:54:27.980278] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-28T21:54:28.142386] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T21:54:28.780235] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-28T21:54:28.971902] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T21:54:29.580269] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-28T21:54:29.989269] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T21:54:30.111598] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T21:54:30.380285] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-28T21:54:31.180272] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-28T21:54:31.526232] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T21:54:31.695865] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T21:54:31.705996] [INFO ] [REMOTE ] WBS: Full fetch complete (70445 records). [2025-10-28T21:54:31.706116] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-28T21:54:31.985370] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-28T21:54:32.113115] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-28T21:54:32.113190] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-28T21:54:32.114311] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-28T21:54:32.114371] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-28T21:54:32.115625] [DEBUG] [LOCAL ] WBS: Trimmed 70445 records to 48792 (keeping 200 days of data) [2025-10-28T21:54:32.404466] [DEBUG] [LOCAL ] WBS: Primary data saved (48792 records). [2025-10-28T21:54:32.404588] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-28T21:54:32.405199] [INFO ] [MAIN ] Update Progress: 2269/2366 symbols completed. WBS took 28.8s. Estimated remaining: 12m 35s. Rate: 7.7 symbols/min [2025-10-28T21:54:32.582841] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:32.615858] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T21:54:32.618379] [INFO ] [REMOTE ] WBX: Full fetch complete (20683 records). [2025-10-28T21:54:32.618531] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-28T21:54:32.757999] [DEBUG] [LOCAL ] WCN: Loaded 47789 existing records from primary storage. [2025-10-28T21:54:32.768997] [INFO ] [MAIN ] WCN: Loaded 47789 existing records. [2025-10-28T21:54:32.800761] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-28T21:54:33.218744] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:33.219092] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-28T21:54:33.219250] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-28T21:54:33.219316] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-28T21:54:33.219355] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-28T21:54:33.219858] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-28T21:54:33.219967] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-28T21:54:33.220079] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-28T21:54:33.220133] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-28T21:54:33.320168] [DEBUG] [LOCAL ] WBX: Trimmed 20683 records to 9240 (keeping 200 days of data) [2025-10-28T21:54:33.583878] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-28T21:54:33.638753] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:33.641800] [DEBUG] [LOCAL ] WBX: Primary data saved (9240 records). [2025-10-28T21:54:33.641901] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-28T21:54:33.642021] [INFO ] [MAIN ] Update Progress: 2270/2366 symbols completed. WBX took 26.2s. Estimated remaining: 12m 27s. Rate: 7.7 symbols/min [2025-10-28T21:54:33.784540] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T21:54:33.849796] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:33.870760] [DEBUG] [LOCAL ] WD: Loaded 22168 existing records from primary storage. [2025-10-28T21:54:33.870993] [INFO ] [MAIN ] WD: Loaded 22168 existing records. [2025-10-28T21:54:34.044591] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:34.044805] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-28T21:54:34.044851] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-28T21:54:34.045028] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-28T21:54:34.045066] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-28T21:54:34.390897] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:34.386319] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-28T21:54:34.729916] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T21:54:34.770012] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T21:54:34.778463] [INFO ] [REMOTE ] WAT: Full fetch complete (50892 records). [2025-10-28T21:54:34.778597] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-28T21:54:35.163853] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-28T21:54:35.163944] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-28T21:54:35.164974] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-28T21:54:35.165037] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-28T21:54:35.166257] [DEBUG] [LOCAL ] WAT: Trimmed 50892 records to 35265 (keeping 200 days of data) [2025-10-28T21:54:35.215183] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-28T21:54:35.379791] [DEBUG] [LOCAL ] WAT: Primary data saved (35265 records). [2025-10-28T21:54:35.379939] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-28T21:54:35.380018] [INFO ] [MAIN ] Update Progress: 2271/2366 symbols completed. WAT took 35.9s. Estimated remaining: 12m 19s. Rate: 7.7 symbols/min [2025-10-28T21:54:35.550297] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:35.568462] [DEBUG] [LOCAL ] WDH: Loaded 17911 existing records from primary storage. [2025-10-28T21:54:35.568733] [INFO ] [MAIN ] WDH: Loaded 17911 existing records. [2025-10-28T21:54:35.746206] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:35.746423] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-28T21:54:35.746469] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-28T21:54:35.746682] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-28T21:54:35.746738] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-28T21:54:35.985389] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-28T21:54:36.113399] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:36.125798] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T21:54:36.780307] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-28T21:54:37.347786] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:54:37.513985] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T21:54:37.580222] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-28T21:54:38.380302] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-28T21:54:38.403822] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T21:54:39.180318] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-28T21:54:39.412768] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T21:54:39.704205] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T21:54:39.980240] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-28T21:54:40.533593] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T21:54:40.780255] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-28T21:54:41.585367] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-28T21:54:41.594107] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T21:54:42.380266] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-28T21:54:42.881416] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T21:54:43.180232] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-28T21:54:43.310925] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T21:54:43.317568] [INFO ] [REMOTE ] WCC: Full fetch complete (56973 records). [2025-10-28T21:54:43.317697] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-28T21:54:43.709059] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-28T21:54:43.709142] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-28T21:54:43.710166] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-28T21:54:43.710228] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-28T21:54:43.711363] [DEBUG] [LOCAL ] WCC: Trimmed 56973 records to 38015 (keeping 200 days of data) [2025-10-28T21:54:43.952015] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T21:54:43.967002] [DEBUG] [LOCAL ] WCC: Primary data saved (38015 records). [2025-10-28T21:54:43.967461] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-28T21:54:43.967545] [INFO ] [MAIN ] Update Progress: 2272/2366 symbols completed. WCC took 36.3s. Estimated remaining: 12m 12s. Rate: 7.7 symbols/min [2025-10-28T21:54:43.985354] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-28T21:54:44.144773] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:44.165448] [DEBUG] [LOCAL ] WDI: Loaded 20832 existing records from primary storage. [2025-10-28T21:54:44.165717] [INFO ] [MAIN ] WDI: Loaded 20832 existing records. [2025-10-28T21:54:44.346030] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:44.346277] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-28T21:54:44.346340] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-28T21:54:44.346534] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-28T21:54:44.346591] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-28T21:54:44.716708] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:44.780238] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-28T21:54:45.359234] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T21:54:45.378798] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T21:54:45.580241] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-28T21:54:46.380261] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-28T21:54:47.190922] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-28T21:54:47.197475] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T21:54:47.247076] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T21:54:47.921348] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T21:54:47.980272] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-28T21:54:48.780299] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-28T21:54:48.856188] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T21:54:49.548293] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T21:54:49.580225] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-28T21:54:50.380261] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-28T21:54:50.818868] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T21:54:51.011854] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T21:54:51.180264] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-28T21:54:51.951042] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T21:54:51.980218] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-28T21:54:52.780228] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-28T21:54:53.081102] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T21:54:53.580276] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-28T21:54:54.125740] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T21:54:54.232400] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T21:54:54.380235] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-28T21:54:55.180225] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-28T21:54:55.253154] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T21:54:55.980248] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-28T21:54:56.533110] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T21:54:56.677692] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T21:54:56.681781] [INFO ] [REMOTE ] WD: Full fetch complete (32809 records). [2025-10-28T21:54:56.681994] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-28T21:54:56.788786] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-28T21:54:57.080435] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-28T21:54:57.080546] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-28T21:54:57.081830] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-28T21:54:57.081895] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-28T21:54:57.082935] [DEBUG] [LOCAL ] WD: Trimmed 32809 records to 22021 (keeping 200 days of data) [2025-10-28T21:54:57.229113] [DEBUG] [LOCAL ] WD: Primary data saved (22021 records). [2025-10-28T21:54:57.229307] [INFO ] [MAIN ] WD: Full history saved. [2025-10-28T21:54:57.229417] [INFO ] [MAIN ] Update Progress: 2273/2366 symbols completed. WD took 23.6s. Estimated remaining: 12m 4s. Rate: 7.7 symbols/min [2025-10-28T21:54:57.408868] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:54:57.454992] [DEBUG] [LOCAL ] WDS: Loaded 42786 existing records from primary storage. [2025-10-28T21:54:57.455440] [INFO ] [MAIN ] WDS: Loaded 42786 existing records. [2025-10-28T21:54:57.580533] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-28T21:54:57.663511] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:54:57.677042] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T21:54:57.677163] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-28T21:54:57.681829] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-28T21:54:57.682435] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-28T21:54:57.682811] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-28T21:54:58.107005] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:54:58.380251] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-28T21:54:58.909053] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T21:54:58.943792] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T21:54:59.180225] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-28T21:54:59.966889] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T21:54:59.980207] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-28T21:55:00.780281] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-28T21:55:00.983622] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:55:01.580255] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-28T21:55:02.156414] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T21:55:02.191894] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T21:55:02.380306] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-28T21:55:03.114578] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T21:55:03.180261] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-28T21:55:03.980300] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-28T21:55:04.420954] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:55:04.605004] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T21:55:04.780238] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-28T21:55:05.580223] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-28T21:55:05.630727] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T21:55:06.236747] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T21:55:06.241167] [INFO ] [REMOTE ] WDI: Full fetch complete (30381 records). [2025-10-28T21:55:06.241314] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-28T21:55:06.385319] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-28T21:55:06.620355] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-28T21:55:06.620434] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-28T21:55:06.621129] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-28T21:55:06.621191] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-28T21:55:06.622008] [DEBUG] [LOCAL ] WDI: Trimmed 30381 records to 20799 (keeping 200 days of data) [2025-10-28T21:55:06.749571] [DEBUG] [LOCAL ] WDI: Primary data saved (20799 records). [2025-10-28T21:55:06.749719] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-28T21:55:06.749807] [INFO ] [MAIN ] Update Progress: 2274/2366 symbols completed. WDI took 22.8s. Estimated remaining: 11m 56s. Rate: 7.7 symbols/min [2025-10-28T21:55:06.923454] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:06.933376] [DEBUG] [LOCAL ] WEA: Loaded 7817 existing records from primary storage. [2025-10-28T21:55:06.933583] [INFO ] [MAIN ] WEA: Loaded 7817 existing records. [2025-10-28T21:55:07.109821] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:07.110081] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-28T21:55:07.110129] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-28T21:55:07.110297] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-28T21:55:07.110351] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-28T21:55:07.184488] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-28T21:55:07.304736] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T21:55:07.493055] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:07.980291] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-28T21:55:08.526122] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T21:55:08.780304] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-28T21:55:08.975271] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T21:55:09.580247] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-28T21:55:10.237543] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T21:55:10.250539] [INFO ] [REMOTE ] WCN: Full fetch complete (69478 records). [2025-10-28T21:55:10.250715] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-28T21:55:10.384505] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-28T21:55:10.561134] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T21:55:10.599153] [INFO ] [REMOTE ] WDH: Full fetch complete (24025 records). [2025-10-28T21:55:10.605041] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-28T21:55:10.801741] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-28T21:55:10.801863] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-28T21:55:10.803083] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-28T21:55:10.803164] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-28T21:55:10.854245] [DEBUG] [LOCAL ] WCN: Trimmed 69478 records to 47779 (keeping 200 days of data) [2025-10-28T21:55:11.224225] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-28T21:55:11.277576] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-28T21:55:11.277720] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-28T21:55:11.303995] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-28T21:55:11.306447] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-28T21:55:11.323485] [DEBUG] [LOCAL ] WDH: Trimmed 24025 records to 17859 (keeping 200 days of data) [2025-10-28T21:55:11.488347] [DEBUG] [LOCAL ] WCN: Primary data saved (47779 records). [2025-10-28T21:55:11.490890] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-28T21:55:11.491781] [INFO ] [MAIN ] Update Progress: 2275/2366 symbols completed. WCN took 39.1s. Estimated remaining: 11m 48s. Rate: 7.7 symbols/min [2025-10-28T21:55:11.490715] [DEBUG] [LOCAL ] WDH: Primary data saved (17859 records). [2025-10-28T21:55:11.491968] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-28T21:55:11.503639] [INFO ] [MAIN ] Update Progress: 2276/2366 symbols completed. WDH took 36.1s. Estimated remaining: 11m 40s. Rate: 7.7 symbols/min [2025-10-28T21:55:11.807056] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:11.865351] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:11.867189] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T21:55:11.934398] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T21:55:11.959397] [DEBUG] [LOCAL ] WEAV: Loaded 42190 existing records from primary storage. [2025-10-28T21:55:11.973472] [INFO ] [MAIN ] WEAV: Loaded 42190 existing records. [2025-10-28T21:55:11.994012] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-28T21:55:12.005369] [DEBUG] [LOCAL ] WEC: Loaded 52101 existing records from primary storage. [2025-10-28T21:55:12.067808] [INFO ] [MAIN ] WEC: Loaded 52101 existing records. [2025-10-28T21:55:12.276502] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:12.292111] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-28T21:55:12.305437] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-28T21:55:12.318805] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-28T21:55:12.322088] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-28T21:55:12.378217] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:12.415665] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-28T21:55:12.421427] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-28T21:55:12.437228] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-28T21:55:12.447507] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-28T21:55:12.791026] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-28T21:55:13.038497] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:13.115837] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:13.282886] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T21:55:13.438963] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T21:55:13.580304] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-28T21:55:14.380264] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-28T21:55:14.604157] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T21:55:15.180246] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-28T21:55:15.980241] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-28T21:55:16.140321] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T21:55:16.320680] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:55:16.352422] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T21:55:16.780251] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-28T21:55:17.580293] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-28T21:55:17.984312] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T21:55:18.380254] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-28T21:55:18.802280] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T21:55:18.829077] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T21:55:19.180256] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-28T21:55:19.980241] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-28T21:55:20.393153] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T21:55:20.780216] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-28T21:55:20.978919] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T21:55:21.580280] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-28T21:55:22.383826] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-28T21:55:22.389432] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T21:55:22.693162] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T21:55:22.869665] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T21:55:23.180333] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-28T21:55:23.980248] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-28T21:55:24.186116] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T21:55:24.439969] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T21:55:24.780243] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-28T21:55:25.580236] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-28T21:55:25.761788] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T21:55:26.380233] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-28T21:55:26.845972] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T21:55:26.926761] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T21:55:27.180296] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-28T21:55:27.980297] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-28T21:55:28.474242] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T21:55:28.780238] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-28T21:55:29.220279] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T21:55:29.258715] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T21:55:29.580297] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-28T21:55:30.380256] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-28T21:55:30.927023] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T21:55:31.180231] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-28T21:55:31.677425] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T21:55:31.686175] [INFO ] [REMOTE ] WDS: Full fetch complete (63980 records). [2025-10-28T21:55:31.686283] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-28T21:55:31.982840] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-28T21:55:32.074778] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-28T21:55:32.074863] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-28T21:55:32.075965] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-28T21:55:32.076026] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-28T21:55:32.077223] [DEBUG] [LOCAL ] WDS: Trimmed 63980 records to 42723 (keeping 200 days of data) [2025-10-28T21:55:32.328071] [DEBUG] [LOCAL ] WDS: Primary data saved (42723 records). [2025-10-28T21:55:32.328181] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-28T21:55:32.328252] [INFO ] [MAIN ] Update Progress: 2277/2366 symbols completed. WDS took 35.1s. Estimated remaining: 11m 33s. Rate: 7.7 symbols/min [2025-10-28T21:55:32.520745] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T21:55:32.780253] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-28T21:55:33.224364] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T21:55:33.224171] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T21:55:33.580240] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-28T21:55:33.985329] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T21:55:33.987442] [INFO ] [REMOTE ] WEA: Full fetch complete (9995 records). [2025-10-28T21:55:33.987509] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-28T21:55:34.337750] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-28T21:55:34.337828] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-28T21:55:34.338164] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-28T21:55:34.338201] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-28T21:55:34.338680] [DEBUG] [LOCAL ] WEA: Trimmed 9995 records to 7781 (keeping 200 days of data) [2025-10-28T21:55:34.384718] [DEBUG] [LOCAL ] WEA: Primary data saved (7781 records). [2025-10-28T21:55:34.384990] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-28T21:55:34.385129] [INFO ] [MAIN ] Update Progress: 2278/2366 symbols completed. WEA took 27.6s. Estimated remaining: 11m 25s. Rate: 7.7 symbols/min [2025-10-28T21:55:34.384881] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-28T21:55:35.180247] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-28T21:55:35.681248] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:55:35.980298] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-28T21:55:36.232922] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T21:55:36.780352] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-28T21:55:37.308807] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T21:55:37.580279] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-28T21:55:37.787970] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T21:55:38.380259] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-28T21:55:38.732840] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T21:55:39.180308] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-28T21:55:39.438294] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T21:55:39.447259] [INFO ] [REMOTE ] WEAV: Full fetch complete (61739 records). [2025-10-28T21:55:39.447406] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-28T21:55:39.830205] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-28T21:55:39.830288] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-28T21:55:39.831355] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-28T21:55:39.831417] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-28T21:55:39.832635] [DEBUG] [LOCAL ] WEAV: Trimmed 61739 records to 42139 (keeping 200 days of data) [2025-10-28T21:55:40.085040] [DEBUG] [LOCAL ] WEAV: Primary data saved (42139 records). [2025-10-28T21:55:40.085163] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-28T21:55:40.085241] [INFO ] [MAIN ] Update Progress: 2279/2366 symbols completed. WEAV took 28.6s. Estimated remaining: 11m 17s. Rate: 7.7 symbols/min [2025-10-28T21:55:40.407700] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T21:55:40.419288] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-28T21:55:40.935188] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T21:55:40.952421] [INFO ] [REMOTE ] WEC: Full fetch complete (75876 records). [2025-10-28T21:55:40.952639] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-28T21:55:41.479543] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-28T21:55:41.479637] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-28T21:55:41.481009] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-28T21:55:41.481075] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-28T21:55:41.482624] [DEBUG] [LOCAL ] WEC: Trimmed 75876 records to 52106 (keeping 200 days of data) [2025-10-28T21:55:41.813529] [DEBUG] [LOCAL ] WEC: Primary data saved (52106 records). [2025-10-28T21:55:41.813679] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-28T21:55:41.813775] [INFO ] [MAIN ] Update Progress: 2280/2366 symbols completed. WEC took 30.3s. Estimated remaining: 11m 9s. Rate: 7.7 symbols/min [2025-10-28T21:55:42.390129] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:42.465319] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:42.522990] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:42.543520] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:55:42.554513] [DEBUG] [LOCAL ] WF: Loaded 10521 existing records from primary storage. [2025-10-28T21:55:42.555081] [INFO ] [MAIN ] WF: Loaded 10521 existing records. [2025-10-28T21:55:42.775007] [DEBUG] [LOCAL ] WEX: Loaded 31810 existing records from primary storage. [2025-10-28T21:55:42.780928] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:42.777960] [INFO ] [MAIN ] WEX: Loaded 31810 existing records. [2025-10-28T21:55:42.781218] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-28T21:55:42.815231] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-28T21:55:42.877087] [DEBUG] [LOCAL ] WES: Loaded 48645 existing records from primary storage. [2025-10-28T21:55:42.887661] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-28T21:55:42.893924] [DEBUG] [LOCAL ] WELL: Loaded 52274 existing records from primary storage. [2025-10-28T21:55:42.899445] [INFO ] [MAIN ] WES: Loaded 48645 existing records. [2025-10-28T21:55:42.915371] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-28T21:55:42.920795] [INFO ] [MAIN ] WELL: Loaded 52274 existing records. [2025-10-28T21:55:43.345605] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:43.446487] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-28T21:55:43.532981] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-28T21:55:43.618193] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-28T21:55:43.604480] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:43.656817] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:55:43.666822] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-28T21:55:43.677283] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-28T21:55:43.666577] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-28T21:55:43.710903] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-28T21:55:43.737874] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-28T21:55:43.759906] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-28T21:55:43.768932] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-28T21:55:43.778033] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-28T21:55:43.862500] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-28T21:55:44.070060] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:44.087282] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-28T21:55:44.978719] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:45.020163] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-28T21:55:45.054698] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:45.062939] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-28T21:55:45.059191] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T21:55:45.071435] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-28T21:55:45.090804] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:55:45.093291] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-28T21:55:45.741609] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T21:55:45.744525] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-28T21:55:45.984253] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T21:55:45.991043] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-28T21:55:46.328363] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T21:55:46.345607] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T21:55:46.380228] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-28T21:55:46.558028] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T21:55:47.126504] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T21:55:47.180220] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-28T21:55:47.526661] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T21:55:47.980296] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-28T21:55:48.252868] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T21:55:48.780273] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-28T21:55:49.147952] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T21:55:49.580265] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-28T21:55:49.871004] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T21:55:50.380263] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-28T21:55:51.110814] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T21:55:51.130062] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T21:55:51.180226] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-28T21:55:51.700197] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T21:55:51.980301] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-28T21:55:52.780271] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-28T21:55:52.917506] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T21:55:53.351113] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T21:55:53.580294] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-28T21:55:54.380324] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-28T21:55:55.013175] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T21:55:55.048255] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T21:55:55.180310] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-28T21:55:55.980226] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-28T21:55:56.492228] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T21:55:56.678582] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T21:55:56.780292] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-28T21:55:57.580266] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-28T21:55:57.738627] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T21:55:58.380299] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-28T21:55:59.123600] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:55:59.180223] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-28T21:55:59.398241] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T21:55:59.980280] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-28T21:56:00.780235] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-28T21:56:00.870937] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T21:56:01.191445] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T21:56:01.285331] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T21:56:01.580254] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-28T21:56:02.380223] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-28T21:56:02.475248] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T21:56:02.919073] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T21:56:02.921469] [INFO ] [REMOTE ] WF: Full fetch complete (15860 records). [2025-10-28T21:56:02.921562] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-28T21:56:03.185476] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-28T21:56:03.299977] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-28T21:56:03.300063] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-28T21:56:03.300472] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-28T21:56:03.300531] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-28T21:56:03.301048] [DEBUG] [LOCAL ] WF: Trimmed 15860 records to 10420 (keeping 200 days of data) [2025-10-28T21:56:03.365657] [DEBUG] [LOCAL ] WF: Primary data saved (10420 records). [2025-10-28T21:56:03.365797] [INFO ] [MAIN ] WF: Full history saved. [2025-10-28T21:56:03.365880] [INFO ] [MAIN ] Update Progress: 2281/2366 symbols completed. WF took 21.5s. Estimated remaining: 11m 2s. Rate: 7.7 symbols/min [2025-10-28T21:56:03.534196] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:03.583072] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-28T21:56:03.583377] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-28T21:56:03.763145] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:03.763352] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-28T21:56:03.763399] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-28T21:56:03.763613] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-28T21:56:03.763696] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-28T21:56:03.988228] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-28T21:56:04.117763] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:04.491675] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T21:56:04.780250] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-28T21:56:05.548768] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T21:56:05.580203] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-28T21:56:06.343325] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T21:56:06.380216] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-28T21:56:06.989478] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T21:56:07.180226] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-28T21:56:07.841607] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T21:56:07.980310] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-28T21:56:08.733151] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T21:56:08.780298] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-28T21:56:08.844015] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T21:56:08.849888] [INFO ] [REMOTE ] WEX: Full fetch complete (50250 records). [2025-10-28T21:56:08.850012] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-28T21:56:09.221270] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-28T21:56:09.221390] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-28T21:56:09.222402] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-28T21:56:09.222479] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-28T21:56:09.223483] [DEBUG] [LOCAL ] WEX: Trimmed 50250 records to 31660 (keeping 200 days of data) [2025-10-28T21:56:09.411419] [DEBUG] [LOCAL ] WEX: Primary data saved (31660 records). [2025-10-28T21:56:09.411568] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-28T21:56:09.411685] [INFO ] [MAIN ] Update Progress: 2282/2366 symbols completed. WEX took 27.6s. Estimated remaining: 10m 54s. Rate: 7.7 symbols/min [2025-10-28T21:56:09.581254] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-28T21:56:09.581167] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:09.604282] [DEBUG] [LOCAL ] WFG: Loaded 24243 existing records from primary storage. [2025-10-28T21:56:09.604545] [INFO ] [MAIN ] WFG: Loaded 24243 existing records. [2025-10-28T21:56:09.779715] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:09.779891] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-28T21:56:09.779937] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-28T21:56:09.780096] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-28T21:56:09.780133] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-28T21:56:10.139587] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:10.168837] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T21:56:10.380265] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-28T21:56:11.192083] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-28T21:56:11.201403] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T21:56:11.784333] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T21:56:11.874269] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T21:56:11.980251] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-28T21:56:12.780288] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-28T21:56:12.807248] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T21:56:13.580255] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-28T21:56:13.991549] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T21:56:14.380258] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-28T21:56:14.482762] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T21:56:15.180242] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-28T21:56:15.888529] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T21:56:15.899095] [INFO ] [REMOTE ] WES: Full fetch complete (70690 records). [2025-10-28T21:56:15.899241] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-28T21:56:15.985368] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-28T21:56:16.296711] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-28T21:56:16.296809] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-28T21:56:16.297951] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-28T21:56:16.298011] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-28T21:56:16.299400] [DEBUG] [LOCAL ] WES: Trimmed 70690 records to 48613 (keeping 200 days of data) [2025-10-28T21:56:16.592100] [DEBUG] [LOCAL ] WES: Primary data saved (48613 records). [2025-10-28T21:56:16.592328] [INFO ] [MAIN ] WES: Full history saved. [2025-10-28T21:56:16.592836] [INFO ] [MAIN ] Update Progress: 2283/2366 symbols completed. WES took 34.8s. Estimated remaining: 10m 46s. Rate: 7.7 symbols/min [2025-10-28T21:56:16.764116] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:16.786006] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-28T21:56:16.799967] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T21:56:16.840770] [DEBUG] [LOCAL ] WGO: Loaded 37932 existing records from primary storage. [2025-10-28T21:56:16.841035] [INFO ] [MAIN ] WGO: Loaded 37932 existing records. [2025-10-28T21:56:17.029545] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:17.029899] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-28T21:56:17.029996] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-28T21:56:17.030339] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-28T21:56:17.030451] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-28T21:56:17.148020] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T21:56:17.412049] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:17.580254] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-28T21:56:18.380237] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-28T21:56:18.414674] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T21:56:18.685781] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-28T21:56:19.180259] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-28T21:56:19.509970] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T21:56:19.980269] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-28T21:56:20.785355] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-28T21:56:20.794946] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T21:56:20.935726] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T21:56:21.580236] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-28T21:56:22.341434] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T21:56:22.380846] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-28T21:56:22.383440] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:56:23.180277] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-28T21:56:23.924799] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T21:56:23.980244] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-28T21:56:24.263165] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T21:56:24.781122] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-28T21:56:24.785084] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T21:56:25.580247] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-28T21:56:26.380217] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-28T21:56:26.481383] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T21:56:26.673019] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-28T21:56:26.841497] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:56:26.852934] [INFO ] [REMOTE ] WELL: Full fetch complete (76023 records). [2025-10-28T21:56:26.853125] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-28T21:56:27.190227] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-28T21:56:27.249038] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-28T21:56:27.249129] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-28T21:56:27.250347] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-28T21:56:27.250411] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-28T21:56:27.251843] [DEBUG] [LOCAL ] WELL: Trimmed 76023 records to 52273 (keeping 200 days of data) [2025-10-28T21:56:27.585909] [DEBUG] [LOCAL ] WELL: Primary data saved (52273 records). [2025-10-28T21:56:27.586123] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-28T21:56:27.586252] [INFO ] [MAIN ] Update Progress: 2284/2366 symbols completed. WELL took 45.8s. Estimated remaining: 10m 39s. Rate: 7.7 symbols/min [2025-10-28T21:56:27.794178] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:27.839170] [DEBUG] [LOCAL ] WH: Loaded 45314 existing records from primary storage. [2025-10-28T21:56:27.839500] [INFO ] [MAIN ] WH: Loaded 45314 existing records. [2025-10-28T21:56:27.985627] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-28T21:56:28.156910] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T21:56:28.145437] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:28.166289] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-28T21:56:28.166432] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-28T21:56:28.166026] [INFO ] [REMOTE ] WFG: Full fetch complete (36501 records). [2025-10-28T21:56:28.166688] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-28T21:56:28.173003] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-28T21:56:28.194706] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-28T21:56:28.792485] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-28T21:56:28.995535] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-28T21:56:29.001120] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-28T21:56:29.008776] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-28T21:56:29.011935] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-28T21:56:29.032432] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:29.033265] [DEBUG] [LOCAL ] WFG: Trimmed 36501 records to 24220 (keeping 200 days of data) [2025-10-28T21:56:29.184219] [DEBUG] [LOCAL ] WFG: Primary data saved (24220 records). [2025-10-28T21:56:29.184446] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-28T21:56:29.184549] [INFO ] [MAIN ] Update Progress: 2285/2366 symbols completed. WFG took 19.8s. Estimated remaining: 10m 30s. Rate: 7.7 symbols/min [2025-10-28T21:56:29.356124] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:29.388537] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T21:56:29.428041] [DEBUG] [LOCAL ] WHD: Loaded 39696 existing records from primary storage. [2025-10-28T21:56:29.428321] [INFO ] [MAIN ] WHD: Loaded 39696 existing records. [2025-10-28T21:56:29.583133] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-28T21:56:29.606754] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:29.607024] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-28T21:56:29.607098] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-28T21:56:29.607350] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-28T21:56:29.607406] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-28T21:56:29.975275] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:30.377282] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T21:56:30.387596] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-28T21:56:31.111794] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T21:56:31.180332] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-28T21:56:31.699051] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T21:56:31.980273] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-28T21:56:32.212035] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T21:56:32.780231] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-28T21:56:33.573138] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T21:56:33.584046] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-28T21:56:33.708239] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T21:56:34.380211] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-28T21:56:34.805173] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T21:56:34.844018] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:56:34.854803] [INFO ] [REMOTE ] WFC: Full fetch complete (77927 records). [2025-10-28T21:56:34.854942] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-28T21:56:35.185431] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-28T21:56:35.255557] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-28T21:56:35.255629] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-28T21:56:35.256891] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-28T21:56:35.256952] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-28T21:56:35.258394] [DEBUG] [LOCAL ] WFC: Trimmed 77927 records to 53748 (keeping 200 days of data) [2025-10-28T21:56:35.582394] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-28T21:56:35.582502] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-28T21:56:35.582578] [INFO ] [MAIN ] Update Progress: 2286/2366 symbols completed. WFC took 32.2s. Estimated remaining: 10m 23s. Rate: 7.7 symbols/min [2025-10-28T21:56:35.753570] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:35.758740] [DEBUG] [LOCAL ] WHG: Loaded 2977 existing records from primary storage. [2025-10-28T21:56:35.758899] [INFO ] [MAIN ] WHG: Loaded 2977 existing records. [2025-10-28T21:56:35.934246] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:35.934429] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-28T21:56:35.934478] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-28T21:56:35.934603] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-28T21:56:35.934712] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-28T21:56:35.988211] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-28T21:56:36.296123] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:36.398950] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T21:56:36.780273] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-28T21:56:37.175539] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T21:56:37.290747] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T21:56:37.580258] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-28T21:56:38.380264] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-28T21:56:38.734901] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T21:56:39.180315] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-28T21:56:39.671915] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T21:56:39.900673] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T21:56:39.980259] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-28T21:56:40.410487] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T21:56:40.780270] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-28T21:56:41.580246] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-28T21:56:41.950728] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T21:56:42.121040] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T21:56:42.380256] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-28T21:56:42.786414] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T21:56:43.180280] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-28T21:56:43.980249] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-28T21:56:44.369848] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T21:56:44.780282] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-28T21:56:44.933999] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T21:56:45.580298] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-28T21:56:45.938377] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T21:56:46.380255] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-28T21:56:46.733607] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T21:56:46.774227] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T21:56:47.180297] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-28T21:56:47.980277] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-28T21:56:48.248606] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T21:56:48.349752] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-28T21:56:48.780261] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-28T21:56:49.156634] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T21:56:49.580279] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-28T21:56:50.380287] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-28T21:56:50.662797] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T21:56:50.679114] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T21:56:51.180303] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-28T21:56:51.980257] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-28T21:56:52.271994] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T21:56:52.780272] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-28T21:56:52.910594] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T21:56:53.580258] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-28T21:56:53.828193] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-28T21:56:53.829010] [INFO ] [REMOTE ] WHG: Full fetch complete (4319 records). [2025-10-28T21:56:53.829078] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-28T21:56:54.216142] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-28T21:56:54.216293] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-28T21:56:54.216486] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-28T21:56:54.216561] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-28T21:56:54.217150] [DEBUG] [LOCAL ] WHG: Trimmed 4319 records to 2977 (keeping 200 days of data) [2025-10-28T21:56:54.259415] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T21:56:54.273994] [DEBUG] [LOCAL ] WHG: Primary data saved (2977 records). [2025-10-28T21:56:54.274078] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-28T21:56:54.274149] [INFO ] [MAIN ] Update Progress: 2287/2366 symbols completed. WHG took 18.7s. Estimated remaining: 10m 15s. Rate: 7.7 symbols/min [2025-10-28T21:56:54.385485] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-28T21:56:54.443662] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:54.487740] [DEBUG] [LOCAL ] WHR: Loaded 48831 existing records from primary storage. [2025-10-28T21:56:54.488020] [INFO ] [MAIN ] WHR: Loaded 48831 existing records. [2025-10-28T21:56:54.660198] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:54.660363] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-28T21:56:54.660410] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-28T21:56:54.660593] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-28T21:56:54.660630] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-28T21:56:55.006399] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:56:55.180234] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-28T21:56:55.618439] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T21:56:55.980281] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-28T21:56:56.695128] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T21:56:56.780243] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-28T21:56:57.275593] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T21:56:57.580299] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-28T21:56:58.002352] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T21:56:58.380255] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-28T21:56:58.638255] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T21:56:58.647447] [INFO ] [REMOTE ] WH: Full fetch complete (65939 records). [2025-10-28T21:56:58.647563] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-28T21:56:59.029327] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-28T21:56:59.029402] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-28T21:56:59.030501] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-28T21:56:59.030562] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-28T21:56:59.031805] [DEBUG] [LOCAL ] WH: Trimmed 65939 records to 45328 (keeping 200 days of data) [2025-10-28T21:56:59.208574] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-28T21:56:59.312129] [DEBUG] [LOCAL ] WH: Primary data saved (45328 records). [2025-10-28T21:56:59.312257] [INFO ] [MAIN ] WH: Full history saved. [2025-10-28T21:56:59.312362] [INFO ] [MAIN ] Update Progress: 2288/2366 symbols completed. WH took 31.7s. Estimated remaining: 10m 7s. Rate: 7.7 symbols/min [2025-10-28T21:56:59.482997] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:56:59.506716] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T21:56:59.519603] [DEBUG] [LOCAL ] WIA: Loaded 4998 existing records from primary storage. [2025-10-28T21:56:59.519848] [INFO ] [MAIN ] WIA: Loaded 4998 existing records. [2025-10-28T21:56:59.694073] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:56:59.694278] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-28T21:56:59.694324] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-28T21:56:59.694467] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-28T21:56:59.694504] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-28T21:56:59.985345] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-28T21:57:00.050261] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:00.338941] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T21:57:00.346737] [INFO ] [REMOTE ] WGO: Full fetch complete (57187 records). [2025-10-28T21:57:00.346839] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-28T21:57:00.719081] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-28T21:57:00.719160] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-28T21:57:00.720163] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-28T21:57:00.720223] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-28T21:57:00.721283] [DEBUG] [LOCAL ] WGO: Trimmed 57187 records to 37836 (keeping 200 days of data) [2025-10-28T21:57:00.780846] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-28T21:57:00.945952] [DEBUG] [LOCAL ] WGO: Primary data saved (37836 records). [2025-10-28T21:57:00.946078] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-28T21:57:00.946573] [INFO ] [MAIN ] Update Progress: 2289/2366 symbols completed. WGO took 44.4s. Estimated remaining: 9m 59s. Rate: 7.7 symbols/min [2025-10-28T21:57:01.136704] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:01.152111] [DEBUG] [LOCAL ] WINN: Loaded 10950 existing records from primary storage. [2025-10-28T21:57:01.152476] [INFO ] [MAIN ] WINN: Loaded 10950 existing records. [2025-10-28T21:57:01.354023] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:01.363019] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-28T21:57:01.363103] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-28T21:57:01.364562] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T21:57:01.364627] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-28T21:57:01.364859] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-28T21:57:01.585412] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-28T21:57:01.732878] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:02.384413] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-28T21:57:02.389668] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T21:57:02.814444] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T21:57:03.094443] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T21:57:03.180206] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-28T21:57:03.765355] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T21:57:03.980279] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-28T21:57:04.780316] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-28T21:57:05.434017] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T21:57:05.580240] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-28T21:57:05.952266] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T21:57:05.960564] [INFO ] [REMOTE ] WHD: Full fetch complete (58005 records). [2025-10-28T21:57:05.960718] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-28T21:57:06.333739] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-28T21:57:06.333815] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-28T21:57:06.334778] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-28T21:57:06.334837] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-28T21:57:06.335862] [DEBUG] [LOCAL ] WHD: Trimmed 58005 records to 39651 (keeping 200 days of data) [2025-10-28T21:57:06.387396] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-28T21:57:06.573306] [DEBUG] [LOCAL ] WHD: Primary data saved (39651 records). [2025-10-28T21:57:06.573442] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-28T21:57:06.573542] [INFO ] [MAIN ] Update Progress: 2290/2366 symbols completed. WHD took 37.4s. Estimated remaining: 9m 52s. Rate: 7.7 symbols/min [2025-10-28T21:57:06.742256] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:06.789185] [DEBUG] [LOCAL ] WIT: Loaded 52538 existing records from primary storage. [2025-10-28T21:57:06.789497] [INFO ] [MAIN ] WIT: Loaded 52538 existing records. [2025-10-28T21:57:06.976682] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:06.977910] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-28T21:57:06.977703] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T21:57:06.981363] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-28T21:57:07.006204] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-28T21:57:07.006381] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-28T21:57:07.082632] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T21:57:07.189145] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-28T21:57:07.370524] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:07.817348] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T21:57:07.980225] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-28T21:57:08.780307] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-28T21:57:09.306381] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T21:57:09.363339] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T21:57:09.580261] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-28T21:57:10.121261] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T21:57:10.380239] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-28T21:57:10.800464] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T21:57:11.180250] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-28T21:57:11.980307] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-28T21:57:12.488105] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T21:57:12.516436] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:57:12.780265] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-28T21:57:13.369494] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T21:57:13.580251] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-28T21:57:14.380298] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-28T21:57:15.180236] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-28T21:57:15.277707] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T21:57:15.554312] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T21:57:15.695165] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T21:57:15.980257] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-28T21:57:16.780299] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-28T21:57:17.183095] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T21:57:17.519210] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T21:57:17.580209] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-28T21:57:18.380274] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-28T21:57:18.871496] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T21:57:19.180266] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-28T21:57:19.730139] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T21:57:19.732880] [INFO ] [REMOTE ] WINN: Full fetch complete (17338 records). [2025-10-28T21:57:19.732951] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-28T21:57:19.988804] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-28T21:57:20.119292] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T21:57:20.128364] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-28T21:57:20.139242] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-28T21:57:20.139997] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-28T21:57:20.140075] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-28T21:57:20.141301] [DEBUG] [LOCAL ] WINN: Trimmed 17338 records to 10926 (keeping 200 days of data) [2025-10-28T21:57:20.204446] [DEBUG] [LOCAL ] WINN: Primary data saved (10926 records). [2025-10-28T21:57:20.204568] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-28T21:57:20.204665] [INFO ] [MAIN ] Update Progress: 2291/2366 symbols completed. WINN took 19.3s. Estimated remaining: 9m 44s. Rate: 7.7 symbols/min [2025-10-28T21:57:20.367858] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:20.386945] [DEBUG] [LOCAL ] WIW: Loaded 20070 existing records from primary storage. [2025-10-28T21:57:20.387172] [INFO ] [MAIN ] WIW: Loaded 20070 existing records. [2025-10-28T21:57:20.561246] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:20.561455] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-28T21:57:20.561523] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-28T21:57:20.561741] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-28T21:57:20.561796] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-28T21:57:20.786012] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-28T21:57:20.908198] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:21.170597] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T21:57:21.271595] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T21:57:21.580314] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-28T21:57:22.229190] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T21:57:22.380239] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-28T21:57:23.007106] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T21:57:23.180248] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-28T21:57:23.857308] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T21:57:23.980264] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-28T21:57:24.780311] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-28T21:57:25.305119] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T21:57:25.497444] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T21:57:25.580263] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-28T21:57:26.097357] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T21:57:26.380306] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-28T21:57:26.729581] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T21:57:27.180222] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-28T21:57:27.929536] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T21:57:27.980210] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-28T21:57:28.732311] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T21:57:28.780228] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-28T21:57:29.577905] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:57:29.582716] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-28T21:57:29.982361] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T21:57:30.380303] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-28T21:57:31.173498] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T21:57:31.180202] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-28T21:57:31.980250] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-28T21:57:32.040515] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T21:57:32.780246] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-28T21:57:33.125811] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T21:57:33.500890] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T21:57:33.580212] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-28T21:57:34.380261] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-28T21:57:34.966836] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T21:57:35.180228] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-28T21:57:35.227791] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T21:57:35.231839] [INFO ] [REMOTE ] WIW: Full fetch complete (29164 records). [2025-10-28T21:57:35.231911] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-28T21:57:35.606393] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-28T21:57:35.611261] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T21:57:35.611355] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-28T21:57:35.614234] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-28T21:57:35.614296] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-28T21:57:35.614996] [DEBUG] [LOCAL ] WIW: Trimmed 29164 records to 20011 (keeping 200 days of data) [2025-10-28T21:57:35.728575] [DEBUG] [LOCAL ] WIW: Primary data saved (20011 records). [2025-10-28T21:57:35.728720] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-28T21:57:35.728805] [INFO ] [MAIN ] Update Progress: 2292/2366 symbols completed. WIW took 15.5s. Estimated remaining: 9m 36s. Rate: 7.7 symbols/min [2025-10-28T21:57:35.899254] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:35.934765] [DEBUG] [LOCAL ] WK: Loaded 36650 existing records from primary storage. [2025-10-28T21:57:35.935249] [INFO ] [MAIN ] WK: Loaded 36650 existing records. [2025-10-28T21:57:35.990132] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-28T21:57:36.179979] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:36.180237] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-28T21:57:36.180298] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-28T21:57:36.180521] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-28T21:57:36.180574] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-28T21:57:36.665571] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:36.780305] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-28T21:57:37.414137] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T21:57:37.580289] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-28T21:57:37.863485] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T21:57:37.996904] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T21:57:38.380267] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-28T21:57:38.952596] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T21:57:38.954410] [INFO ] [REMOTE ] WIA: Full fetch complete (7321 records). [2025-10-28T21:57:38.954497] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-28T21:57:39.185788] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-28T21:57:39.358434] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-28T21:57:39.358508] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-28T21:57:39.358720] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-28T21:57:39.358780] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-28T21:57:39.359160] [DEBUG] [LOCAL ] WIA: Trimmed 7321 records to 4973 (keeping 200 days of data) [2025-10-28T21:57:39.387561] [DEBUG] [LOCAL ] WIA: Primary data saved (4973 records). [2025-10-28T21:57:39.387635] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-28T21:57:39.387743] [INFO ] [MAIN ] Update Progress: 2293/2366 symbols completed. WIA took 40.1s. Estimated remaining: 9m 28s. Rate: 7.7 symbols/min [2025-10-28T21:57:39.560762] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:39.597068] [DEBUG] [LOCAL ] WKC: Loaded 34239 existing records from primary storage. [2025-10-28T21:57:39.597365] [INFO ] [MAIN ] WKC: Loaded 34239 existing records. [2025-10-28T21:57:39.787132] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:39.787341] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-28T21:57:39.787388] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-28T21:57:39.787568] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-28T21:57:39.787605] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-28T21:57:39.985851] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-28T21:57:40.144585] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:40.531194] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T21:57:40.780255] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-28T21:57:40.996877] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T21:57:41.580263] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-28T21:57:41.963631] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T21:57:41.973690] [INFO ] [REMOTE ] WHR: Full fetch complete (69902 records). [2025-10-28T21:57:41.973856] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-28T21:57:42.380268] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-28T21:57:42.426741] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-28T21:57:42.428005] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-28T21:57:42.429686] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-28T21:57:42.429957] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-28T21:57:42.431462] [DEBUG] [LOCAL ] WHR: Trimmed 69902 records to 48857 (keeping 200 days of data) [2025-10-28T21:57:42.680999] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T21:57:42.777104] [DEBUG] [LOCAL ] WHR: Primary data saved (48857 records). [2025-10-28T21:57:42.777251] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-28T21:57:42.777335] [INFO ] [MAIN ] Update Progress: 2294/2366 symbols completed. WHR took 48.5s. Estimated remaining: 9m 21s. Rate: 7.7 symbols/min [2025-10-28T21:57:42.943098] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:42.983435] [DEBUG] [LOCAL ] WLK: Loaded 45684 existing records from primary storage. [2025-10-28T21:57:42.983811] [INFO ] [MAIN ] WLK: Loaded 45684 existing records. [2025-10-28T21:57:43.165500] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:43.165737] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-28T21:57:43.165791] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-28T21:57:43.166170] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-28T21:57:43.166228] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-28T21:57:43.184236] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-28T21:57:43.560976] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:43.578630] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T21:57:43.980277] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-28T21:57:44.507438] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T21:57:44.518056] [INFO ] [REMOTE ] WIT: Full fetch complete (76028 records). [2025-10-28T21:57:44.518176] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-28T21:57:44.785374] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-28T21:57:44.930375] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-28T21:57:44.930467] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-28T21:57:44.931741] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-28T21:57:44.931820] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-28T21:57:44.933394] [DEBUG] [LOCAL ] WIT: Trimmed 76028 records to 52545 (keeping 200 days of data) [2025-10-28T21:57:45.051181] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T21:57:45.261266] [DEBUG] [LOCAL ] WIT: Primary data saved (52545 records). [2025-10-28T21:57:45.261404] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-28T21:57:45.262026] [INFO ] [MAIN ] Update Progress: 2295/2366 symbols completed. WIT took 38.7s. Estimated remaining: 9m 13s. Rate: 7.7 symbols/min [2025-10-28T21:57:45.443223] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:57:45.453428] [DEBUG] [LOCAL ] WLKP: Loaded 7160 existing records from primary storage. [2025-10-28T21:57:45.453676] [INFO ] [MAIN ] WLKP: Loaded 7160 existing records. [2025-10-28T21:57:45.594128] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-28T21:57:45.632500] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:57:45.632741] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-28T21:57:45.632795] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-28T21:57:45.632946] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-28T21:57:45.632983] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-28T21:57:45.988677] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:57:46.011131] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T21:57:46.380257] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-28T21:57:46.580695] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T21:57:46.891786] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T21:57:47.180304] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-28T21:57:47.980265] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-28T21:57:48.517089] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T21:57:48.547527] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T21:57:48.780260] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-28T21:57:49.263456] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T21:57:49.580306] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-28T21:57:50.380261] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-28T21:57:50.840084] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T21:57:50.937454] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T21:57:51.180266] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-28T21:57:51.710411] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T21:57:51.980249] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-28T21:57:52.780254] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-28T21:57:53.154033] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T21:57:53.580295] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-28T21:57:53.872735] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T21:57:54.380230] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-28T21:57:54.837509] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T21:57:54.853337] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T21:57:55.180260] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-28T21:57:55.980280] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-28T21:57:56.202266] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T21:57:56.313997] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-28T21:57:56.780307] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-28T21:57:57.580262] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-28T21:57:57.957413] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T21:57:58.380310] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-28T21:57:58.788276] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T21:57:59.180226] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-28T21:57:59.371344] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T21:57:59.980258] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-28T21:58:00.322239] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T21:58:00.458341] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T21:58:00.780243] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-28T21:58:01.262597] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T21:58:01.580262] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-28T21:58:02.380304] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-28T21:58:02.798971] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T21:58:03.180265] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-28T21:58:03.557808] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T21:58:03.980322] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-28T21:58:04.499873] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T21:58:04.502789] [INFO ] [REMOTE ] WLKP: Full fetch complete (10123 records). [2025-10-28T21:58:04.502971] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-28T21:58:04.717169] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T21:58:04.794727] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-28T21:58:04.916886] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-28T21:58:04.916957] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-28T21:58:04.917223] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-28T21:58:04.917285] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-28T21:58:04.917727] [DEBUG] [LOCAL ] WLKP: Trimmed 10123 records to 7234 (keeping 200 days of data) [2025-10-28T21:58:04.959277] [DEBUG] [LOCAL ] WLKP: Primary data saved (7234 records). [2025-10-28T21:58:04.959372] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-28T21:58:04.959445] [INFO ] [MAIN ] Update Progress: 2296/2366 symbols completed. WLKP took 19.7s. Estimated remaining: 9m 5s. Rate: 7.7 symbols/min [2025-10-28T21:58:05.132528] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:05.132732] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-28T21:58:05.132780] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-28T21:58:05.132890] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-28T21:58:05.132933] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-28T21:58:05.132976] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-28T21:58:05.133009] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-28T21:58:05.484632] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:05.580214] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-28T21:58:05.960746] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T21:58:06.045749] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T21:58:06.380299] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-28T21:58:06.627315] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-28T21:58:07.180247] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-28T21:58:07.980298] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-28T21:58:08.221885] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T21:58:08.232064] [INFO ] [REMOTE ] WK: Full fetch complete (53447 records). [2025-10-28T21:58:08.232159] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T21:58:08.232328] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-28T21:58:08.608105] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-28T21:58:08.608190] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-28T21:58:08.609288] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-28T21:58:08.609347] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-28T21:58:08.610513] [DEBUG] [LOCAL ] WK: Trimmed 53447 records to 36643 (keeping 200 days of data) [2025-10-28T21:58:08.796985] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-28T21:58:08.826885] [DEBUG] [LOCAL ] WK: Primary data saved (36643 records). [2025-10-28T21:58:08.827004] [INFO ] [MAIN ] WK: Full history saved. [2025-10-28T21:58:08.827349] [INFO ] [MAIN ] Update Progress: 2297/2366 symbols completed. WK took 33.1s. Estimated remaining: 8m 57s. Rate: 7.7 symbols/min [2025-10-28T21:58:08.999383] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:09.029825] [DEBUG] [LOCAL ] WLY: Loaded 29484 existing records from primary storage. [2025-10-28T21:58:09.030072] [INFO ] [MAIN ] WLY: Loaded 29484 existing records. [2025-10-28T21:58:09.207604] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:09.207848] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-28T21:58:09.207908] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-28T21:58:09.208084] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-28T21:58:09.208124] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-28T21:58:09.556880] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:09.580205] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-28T21:58:09.959205] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T21:58:10.380240] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-28T21:58:10.410798] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T21:58:11.180320] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-28T21:58:11.597986] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T21:58:11.607264] [INFO ] [REMOTE ] WLK: Full fetch complete (64122 records). [2025-10-28T21:58:11.607414] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-28T21:58:11.990302] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-28T21:58:11.993613] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-28T21:58:11.995361] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-28T21:58:11.997234] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-28T21:58:11.997466] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-28T21:58:11.999024] [DEBUG] [LOCAL ] WLK: Trimmed 64122 records to 45671 (keeping 200 days of data) [2025-10-28T21:58:12.257121] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T21:58:12.330255] [DEBUG] [LOCAL ] WLK: Primary data saved (45671 records). [2025-10-28T21:58:12.330382] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-28T21:58:12.330474] [INFO ] [MAIN ] Update Progress: 2298/2366 symbols completed. WLK took 29.6s. Estimated remaining: 8m 49s. Rate: 7.7 symbols/min [2025-10-28T21:58:12.500114] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:12.546037] [DEBUG] [LOCAL ] WM: Loaded 50815 existing records from primary storage. [2025-10-28T21:58:12.546500] [INFO ] [MAIN ] WM: Loaded 50815 existing records. [2025-10-28T21:58:12.732605] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:12.733121] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-28T21:58:12.733180] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-28T21:58:12.733548] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-28T21:58:12.733615] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-28T21:58:12.789929] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-28T21:58:13.119290] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:58:13.125120] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:13.580269] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-28T21:58:13.919776] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T21:58:14.380252] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-28T21:58:15.099622] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T21:58:15.180222] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-28T21:58:15.415166] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T21:58:15.980238] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-28T21:58:16.716473] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T21:58:16.780205] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-28T21:58:16.895402] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T21:58:17.580290] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-28T21:58:17.846295] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T21:58:18.144790] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T21:58:18.380251] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-28T21:58:18.612190] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T21:58:19.180255] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-28T21:58:19.415052] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-28T21:58:19.980263] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-28T21:58:20.780265] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-28T21:58:20.939816] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T21:58:21.067452] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T21:58:21.580244] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-28T21:58:22.380251] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-28T21:58:22.578779] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T21:58:23.180267] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-28T21:58:23.460724] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T21:58:23.897129] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T21:58:23.980331] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-28T21:58:24.780262] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-28T21:58:25.499175] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T21:58:25.551973] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T21:58:25.580229] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-28T21:58:26.380269] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-28T21:58:26.625572] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T21:58:26.697149] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T21:58:27.180231] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-28T21:58:27.615503] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T21:58:27.616357] [INFO ] [REMOTE ] WLTG: Full fetch complete (1658 records). [2025-10-28T21:58:27.616430] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-28T21:58:27.789864] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T21:58:27.790065] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T21:58:27.790133] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T21:58:27.790184] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-28T21:58:27.790244] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-28T21:58:27.790282] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-28T21:58:27.790324] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-28T21:58:27.790385] [INFO ] [MAIN ] Update Progress: 2299/2366 symbols completed. WLTG took 22.8s. Estimated remaining: 8m 42s. Rate: 7.7 symbols/min [2025-10-28T21:58:27.976033] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:27.980286] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-28T21:58:28.027020] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-28T21:58:28.027332] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-28T21:58:28.213311] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:28.213589] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-28T21:58:28.213665] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-28T21:58:28.213894] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-28T21:58:28.213948] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-28T21:58:28.619892] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:28.780311] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-28T21:58:29.127500] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T21:58:29.580345] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-28T21:58:30.114028] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T21:58:30.380313] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-28T21:58:31.061670] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T21:58:31.185400] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-28T21:58:31.197108] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T21:58:31.980268] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-28T21:58:32.701763] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T21:58:32.780258] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-28T21:58:32.972133] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T21:58:33.580258] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-28T21:58:34.361225] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T21:58:34.380212] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-28T21:58:34.619839] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T21:58:35.180261] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-28T21:58:35.989921] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-28T21:58:36.012321] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T21:58:36.708220] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T21:58:36.780225] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-28T21:58:37.039939] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T21:58:37.046702] [INFO ] [REMOTE ] WKC: Full fetch complete (50254 records). [2025-10-28T21:58:37.046806] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-28T21:58:37.412463] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-28T21:58:37.412540] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-28T21:58:37.413522] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-28T21:58:37.413583] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-28T21:58:37.414630] [DEBUG] [LOCAL ] WKC: Trimmed 50254 records to 34159 (keeping 200 days of data) [2025-10-28T21:58:37.593993] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-28T21:58:37.622588] [DEBUG] [LOCAL ] WKC: Primary data saved (34159 records). [2025-10-28T21:58:37.622721] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-28T21:58:37.622818] [INFO ] [MAIN ] Update Progress: 2300/2366 symbols completed. WKC took 58.2s. Estimated remaining: 8m 34s. Rate: 7.7 symbols/min [2025-10-28T21:58:37.786000] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:37.801360] [DEBUG] [LOCAL ] WMK: Loaded 14444 existing records from primary storage. [2025-10-28T21:58:37.801578] [INFO ] [MAIN ] WMK: Loaded 14444 existing records. [2025-10-28T21:58:37.975158] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:37.975381] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-28T21:58:37.975427] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-28T21:58:37.975678] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-28T21:58:37.975735] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-28T21:58:38.326953] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:38.357500] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T21:58:38.380211] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-28T21:58:38.447629] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T21:58:38.453854] [INFO ] [REMOTE ] WLY: Full fetch complete (42861 records). [2025-10-28T21:58:38.453947] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-28T21:58:38.838463] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-28T21:58:38.838567] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-28T21:58:38.839806] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-28T21:58:38.839872] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-28T21:58:38.841104] [DEBUG] [LOCAL ] WLY: Trimmed 42861 records to 29564 (keeping 200 days of data) [2025-10-28T21:58:38.992091] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T21:58:39.062810] [DEBUG] [LOCAL ] WLY: Primary data saved (29564 records). [2025-10-28T21:58:39.062952] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-28T21:58:39.063035] [INFO ] [MAIN ] Update Progress: 2301/2366 symbols completed. WLY took 30.2s. Estimated remaining: 8m 26s. Rate: 7.7 symbols/min [2025-10-28T21:58:39.185363] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-28T21:58:39.255843] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:39.297502] [DEBUG] [LOCAL ] WMS: Loaded 39264 existing records from primary storage. [2025-10-28T21:58:39.297868] [INFO ] [MAIN ] WMS: Loaded 39264 existing records. [2025-10-28T21:58:39.485195] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:39.485401] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-28T21:58:39.485451] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-28T21:58:39.485634] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-28T21:58:39.485716] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-28T21:58:39.843135] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:39.852002] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T21:58:39.980269] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-28T21:58:40.780302] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-28T21:58:41.075028] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T21:58:41.580255] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-28T21:58:42.103388] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T21:58:42.380259] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-28T21:58:43.180264] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-28T21:58:43.399100] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T21:58:43.430981] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T21:58:43.820403] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T21:58:43.980282] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-28T21:58:44.780259] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-28T21:58:45.383577] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T21:58:45.580266] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-28T21:58:45.966323] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T21:58:46.380310] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-28T21:58:46.836034] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T21:58:46.846022] [INFO ] [REMOTE ] WM: Full fetch complete (73832 records). [2025-10-28T21:58:46.846155] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-28T21:58:47.182676] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-28T21:58:47.244187] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-28T21:58:47.244348] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-28T21:58:47.245787] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-28T21:58:47.245961] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-28T21:58:47.248210] [DEBUG] [LOCAL ] WM: Trimmed 73832 records to 50814 (keeping 200 days of data) [2025-10-28T21:58:47.554378] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-28T21:58:47.603261] [DEBUG] [LOCAL ] WM: Primary data saved (50814 records). [2025-10-28T21:58:47.603375] [INFO ] [MAIN ] WM: Full history saved. [2025-10-28T21:58:47.604197] [INFO ] [MAIN ] Update Progress: 2302/2366 symbols completed. WM took 35.3s. Estimated remaining: 8m 18s. Rate: 7.7 symbols/min [2025-10-28T21:58:47.768546] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:47.819404] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-28T21:58:47.819738] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-28T21:58:47.986011] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-28T21:58:48.016214] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:48.016410] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-28T21:58:48.016456] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-28T21:58:48.016680] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-28T21:58:48.016736] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-28T21:58:48.373807] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:48.394845] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T21:58:48.780226] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-28T21:58:48.835568] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T21:58:49.580308] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-28T21:58:50.380280] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-28T21:58:50.777673] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-28T21:58:51.028080] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T21:58:51.180258] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-28T21:58:51.433146] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T21:58:51.980242] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-28T21:58:52.780292] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-28T21:58:52.845124] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T21:58:53.580309] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-28T21:58:53.769699] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T21:58:54.290318] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-28T21:58:54.311172] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T21:58:54.380257] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-28T21:58:54.898102] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T21:58:55.180251] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-28T21:58:55.772808] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T21:58:55.980245] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-28T21:58:56.654850] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T21:58:56.667005] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-28T21:58:56.667236] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-28T21:58:56.785404] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-28T21:58:57.082578] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-28T21:58:57.082736] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-28T21:58:57.084728] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-28T21:58:57.084809] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-28T21:58:57.086490] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 53672 (keeping 200 days of data) [2025-10-28T21:58:57.416681] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-28T21:58:57.416821] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-28T21:58:57.417370] [INFO ] [MAIN ] Update Progress: 2303/2366 symbols completed. WMB took 29.6s. Estimated remaining: 8m 11s. Rate: 7.7 symbols/min [2025-10-28T21:58:57.583199] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:58:57.583263] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-28T21:58:57.621892] [DEBUG] [LOCAL ] WNC: Loaded 37717 existing records from primary storage. [2025-10-28T21:58:57.622192] [INFO ] [MAIN ] WNC: Loaded 37717 existing records. [2025-10-28T21:58:57.818690] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:58:57.818991] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-28T21:58:57.819083] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-28T21:58:57.819448] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-28T21:58:57.819510] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-28T21:58:58.216550] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:58:58.211980] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T21:58:58.234340] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T21:58:58.380246] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-28T21:58:59.002220] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T21:58:59.180257] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-28T21:58:59.980252] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-28T21:59:00.277241] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T21:59:00.780257] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-28T21:59:01.098111] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T21:59:01.580290] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-28T21:59:02.380270] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-28T21:59:02.744960] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-28T21:59:02.886035] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T21:59:02.972626] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T21:59:02.975784] [INFO ] [REMOTE ] WMK: Full fetch complete (20061 records). [2025-10-28T21:59:02.975854] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-28T21:59:03.188929] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-28T21:59:03.348998] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-28T21:59:03.349087] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-28T21:59:03.349690] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-28T21:59:03.349788] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-28T21:59:03.350529] [DEBUG] [LOCAL ] WMK: Trimmed 20061 records to 14414 (keeping 200 days of data) [2025-10-28T21:59:03.438279] [DEBUG] [LOCAL ] WMK: Primary data saved (14414 records). [2025-10-28T21:59:03.438412] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-28T21:59:03.438492] [INFO ] [MAIN ] Update Progress: 2304/2366 symbols completed. WMK took 25.8s. Estimated remaining: 8m 3s. Rate: 7.7 symbols/min [2025-10-28T21:59:03.609124] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:03.657978] [DEBUG] [LOCAL ] WOLF: Loaded 52894 existing records from primary storage. [2025-10-28T21:59:03.658281] [INFO ] [MAIN ] WOLF: Loaded 52894 existing records. [2025-10-28T21:59:03.832263] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:03.832417] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-28T21:59:03.832462] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-28T21:59:03.832667] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-28T21:59:03.832723] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-28T21:59:03.985412] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-28T21:59:04.199965] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:04.320218] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T21:59:04.780261] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-28T21:59:05.308314] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T21:59:05.315867] [INFO ] [REMOTE ] WMS: Full fetch complete (56992 records). [2025-10-28T21:59:05.316029] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-28T21:59:05.585417] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-28T21:59:05.707169] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-28T21:59:05.707244] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-28T21:59:05.708403] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-28T21:59:05.708467] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-28T21:59:05.709618] [DEBUG] [LOCAL ] WMS: Trimmed 56992 records to 39116 (keeping 200 days of data) [2025-10-28T21:59:05.952855] [DEBUG] [LOCAL ] WMS: Primary data saved (39116 records). [2025-10-28T21:59:05.953003] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-28T21:59:05.953438] [INFO ] [MAIN ] Update Progress: 2305/2366 symbols completed. WMS took 26.9s. Estimated remaining: 7m 55s. Rate: 7.7 symbols/min [2025-10-28T21:59:06.124920] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:06.147437] [DEBUG] [LOCAL ] WOR: Loaded 23081 existing records from primary storage. [2025-10-28T21:59:06.147698] [INFO ] [MAIN ] WOR: Loaded 23081 existing records. [2025-10-28T21:59:06.333306] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:06.333455] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-28T21:59:06.333504] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-28T21:59:06.333692] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-28T21:59:06.333758] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-28T21:59:06.393363] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-28T21:59:06.712603] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:06.878616] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-28T21:59:06.915285] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T21:59:07.180274] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-28T21:59:07.980345] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-28T21:59:08.097635] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T21:59:08.770590] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T21:59:08.780198] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-28T21:59:09.118779] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-28T21:59:09.580232] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-28T21:59:09.630775] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T21:59:10.380245] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-28T21:59:11.180231] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-28T21:59:11.405715] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-28T21:59:11.980236] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-28T21:59:12.198594] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T21:59:12.466709] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-28T21:59:12.780243] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-28T21:59:13.192228] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T21:59:13.580260] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-28T21:59:14.380250] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-28T21:59:14.701481] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T21:59:15.189943] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-28T21:59:15.195281] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T21:59:15.371137] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T21:59:15.980256] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-28T21:59:16.780295] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-28T21:59:17.160858] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-28T21:59:17.580227] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-28T21:59:17.653050] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T21:59:17.984167] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-28T21:59:18.380256] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-28T21:59:19.180291] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-28T21:59:19.395594] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T21:59:19.966144] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T21:59:19.980208] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-28T21:59:20.201613] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-28T21:59:20.780309] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-28T21:59:20.937721] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T21:59:21.580249] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-28T21:59:22.028288] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T21:59:22.038890] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-28T21:59:22.039011] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-28T21:59:22.383740] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-28T21:59:22.470397] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-28T21:59:22.470562] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-28T21:59:22.472072] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-28T21:59:22.472184] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-28T21:59:22.473828] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-28T21:59:22.642422] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-28T21:59:22.860384] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-28T21:59:22.860513] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-28T21:59:22.860591] [INFO ] [MAIN ] Update Progress: 2306/2366 symbols completed. WMT took 35.3s. Estimated remaining: 7m 47s. Rate: 7.7 symbols/min [2025-10-28T21:59:23.043346] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:23.072061] [DEBUG] [LOCAL ] WOW: Loaded 30895 existing records from primary storage. [2025-10-28T21:59:23.072350] [INFO ] [MAIN ] WOW: Loaded 30895 existing records. [2025-10-28T21:59:23.181098] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-28T21:59:23.267030] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:23.267454] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-28T21:59:23.267559] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-28T21:59:23.278943] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-28T21:59:23.279308] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T21:59:23.279509] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-28T21:59:23.635082] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:23.980282] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-28T21:59:24.780222] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-28T21:59:24.849833] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T21:59:25.393619] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-28T21:59:25.583270] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-28T21:59:25.590336] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T21:59:26.292948] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T21:59:26.297395] [INFO ] [REMOTE ] WOR: Full fetch complete (35984 records). [2025-10-28T21:59:26.297471] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-28T21:59:26.385429] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-28T21:59:26.663390] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-28T21:59:26.663466] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-28T21:59:26.664199] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-28T21:59:26.664258] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-28T21:59:26.665097] [DEBUG] [LOCAL ] WOR: Trimmed 35984 records to 22960 (keeping 200 days of data) [2025-10-28T21:59:26.801420] [DEBUG] [LOCAL ] WOR: Primary data saved (22960 records). [2025-10-28T21:59:26.801546] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-28T21:59:26.801625] [INFO ] [MAIN ] Update Progress: 2307/2366 symbols completed. WOR took 20.8s. Estimated remaining: 7m 39s. Rate: 7.7 symbols/min [2025-10-28T21:59:26.967663] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:27.009462] [DEBUG] [LOCAL ] WPC: Loaded 47998 existing records from primary storage. [2025-10-28T21:59:27.009766] [INFO ] [MAIN ] WPC: Loaded 47998 existing records. [2025-10-28T21:59:27.183975] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-28T21:59:27.183895] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:27.184946] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-28T21:59:27.184999] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-28T21:59:27.185176] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-28T21:59:27.185212] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-28T21:59:27.543947] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:27.980231] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-28T21:59:28.059235] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T21:59:28.138079] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T21:59:28.780235] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-28T21:59:29.188635] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T21:59:29.580283] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-28T21:59:29.750069] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T21:59:30.380249] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-28T21:59:30.674270] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T21:59:31.180257] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-28T21:59:31.980378] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-28T21:59:32.396082] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-28T21:59:32.503193] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T21:59:32.780243] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-28T21:59:33.080551] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T21:59:33.580250] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-28T21:59:34.098214] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T21:59:34.380258] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-28T21:59:35.180252] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-28T21:59:35.389296] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T21:59:35.481095] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T21:59:35.491386] [INFO ] [REMOTE ] WOLF: Full fetch complete (77049 records). [2025-10-28T21:59:35.491514] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-28T21:59:35.879925] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-28T21:59:35.880027] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-28T21:59:35.881269] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-28T21:59:35.881332] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-28T21:59:35.882768] [DEBUG] [LOCAL ] WOLF: Trimmed 77049 records to 52877 (keeping 200 days of data) [2025-10-28T21:59:35.989677] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-28T21:59:36.184624] [DEBUG] [LOCAL ] WOLF: Primary data saved (52877 records). [2025-10-28T21:59:36.184775] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-28T21:59:36.184855] [INFO ] [MAIN ] Update Progress: 2308/2366 symbols completed. WOLF took 32.7s. Estimated remaining: 7m 32s. Rate: 7.7 symbols/min [2025-10-28T21:59:36.369758] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:36.391998] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T21:59:36.443807] [DEBUG] [LOCAL ] WPM: Loaded 52788 existing records from primary storage. [2025-10-28T21:59:36.444187] [INFO ] [MAIN ] WPM: Loaded 52788 existing records. [2025-10-28T21:59:36.617387] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:36.617563] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-28T21:59:36.617609] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-28T21:59:36.617836] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-28T21:59:36.617892] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-28T21:59:36.782692] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-28T21:59:36.987555] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:36.996152] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T21:59:37.580207] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-28T21:59:37.807143] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T21:59:38.345391] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T21:59:38.380221] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-28T21:59:39.179799] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T21:59:39.185696] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-28T21:59:39.980234] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-28T21:59:40.163230] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T21:59:40.170318] [INFO ] [REMOTE ] WNC: Full fetch complete (57627 records). [2025-10-28T21:59:40.170434] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-28T21:59:40.541035] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-28T21:59:40.541112] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-28T21:59:40.542118] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-28T21:59:40.542202] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-28T21:59:40.543279] [DEBUG] [LOCAL ] WNC: Trimmed 57627 records to 37547 (keeping 200 days of data) [2025-10-28T21:59:40.759786] [DEBUG] [LOCAL ] WNC: Primary data saved (37547 records). [2025-10-28T21:59:40.759909] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-28T21:59:40.759982] [INFO ] [MAIN ] Update Progress: 2309/2366 symbols completed. WNC took 43.3s. Estimated remaining: 7m 24s. Rate: 7.7 symbols/min [2025-10-28T21:59:40.789341] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-28T21:59:40.931580] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:40.963928] [DEBUG] [LOCAL ] WPP: Loaded 34034 existing records from primary storage. [2025-10-28T21:59:40.964184] [INFO ] [MAIN ] WPP: Loaded 34034 existing records. [2025-10-28T21:59:41.147465] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:41.147858] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-28T21:59:41.147914] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-28T21:59:41.148164] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-28T21:59:41.148236] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-28T21:59:41.534189] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:41.538895] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T21:59:41.580215] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-28T21:59:42.130634] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T21:59:42.380222] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-28T21:59:42.464513] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T21:59:43.180267] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-28T21:59:43.392414] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T21:59:43.980257] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-28T21:59:44.496425] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T21:59:44.780260] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-28T21:59:45.383622] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T21:59:45.503833] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T21:59:45.580244] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-28T21:59:46.380250] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-28T21:59:47.024251] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T21:59:47.180258] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-28T21:59:47.462423] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T21:59:47.980261] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-28T21:59:48.780222] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-28T21:59:48.979902] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-28T21:59:49.094116] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T21:59:49.100922] [INFO ] [REMOTE ] WOW: Full fetch complete (43199 records). [2025-10-28T21:59:49.101049] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-28T21:59:49.472366] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-28T21:59:49.472445] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-28T21:59:49.473437] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-28T21:59:49.473500] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-28T21:59:49.474516] [DEBUG] [LOCAL ] WOW: Trimmed 43199 records to 30812 (keeping 200 days of data) [2025-10-28T21:59:49.582505] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-28T21:59:49.642498] [DEBUG] [LOCAL ] WOW: Primary data saved (30812 records). [2025-10-28T21:59:49.642603] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-28T21:59:49.642739] [INFO ] [MAIN ] Update Progress: 2310/2366 symbols completed. WOW took 26.8s. Estimated remaining: 7m 16s. Rate: 7.7 symbols/min [2025-10-28T21:59:49.808704] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T21:59:49.853402] [DEBUG] [LOCAL ] WRB: Loaded 50774 existing records from primary storage. [2025-10-28T21:59:49.854342] [INFO ] [MAIN ] WRB: Loaded 50774 existing records. [2025-10-28T21:59:50.039126] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T21:59:50.039327] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-28T21:59:50.039386] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-28T21:59:50.039603] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-28T21:59:50.039754] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-28T21:59:50.383290] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-28T21:59:50.400747] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T21:59:50.439836] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T21:59:51.026159] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T21:59:51.180251] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-28T21:59:51.658901] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T21:59:51.980256] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-28T21:59:52.536496] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T21:59:52.780253] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-28T21:59:53.323521] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T21:59:53.580273] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-28T21:59:54.101633] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T21:59:54.380304] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-28T21:59:54.723438] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T21:59:55.180256] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-28T21:59:55.711963] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T21:59:55.980245] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-28T21:59:56.066210] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T21:59:56.780289] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-28T21:59:57.531798] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T21:59:57.580245] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-28T21:59:57.941033] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T21:59:58.380255] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-28T21:59:58.951807] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T21:59:59.180251] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-28T21:59:59.354456] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T21:59:59.980254] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-28T22:00:00.777321] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T22:00:00.787461] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-28T22:00:01.580254] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-28T22:00:01.771894] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-28T22:00:02.380281] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-28T22:00:02.880873] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T22:00:03.180352] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-28T22:00:03.817625] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-28T22:00:03.980313] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-28T22:00:04.206474] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-28T22:00:04.685953] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-28T22:00:04.780261] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-28T22:00:05.507780] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T22:00:05.580230] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-28T22:00:05.979584] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T22:00:06.380249] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-28T22:00:07.116046] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T22:00:07.180218] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-28T22:00:07.980302] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-28T22:00:08.397160] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-28T22:00:08.435563] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T22:00:08.780285] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-28T22:00:09.321146] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T22:00:09.330562] [INFO ] [REMOTE ] WPC: Full fetch complete (70334 records). [2025-10-28T22:00:09.330729] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-28T22:00:09.588595] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-28T22:00:09.721091] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-28T22:00:09.721174] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-28T22:00:09.722297] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-28T22:00:09.722361] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-28T22:00:09.723671] [DEBUG] [LOCAL ] WPC: Trimmed 70334 records to 47948 (keeping 200 days of data) [2025-10-28T22:00:10.012360] [DEBUG] [LOCAL ] WPC: Primary data saved (47948 records). [2025-10-28T22:00:10.012492] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-28T22:00:10.012838] [INFO ] [MAIN ] Update Progress: 2311/2366 symbols completed. WPC took 43.2s. Estimated remaining: 7m 9s. Rate: 7.7 symbols/min [2025-10-28T22:00:10.184391] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:00:10.242882] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T22:00:10.296709] [DEBUG] [LOCAL ] WRBY: Loaded 50611 existing records from primary storage. [2025-10-28T22:00:10.297007] [INFO ] [MAIN ] WRBY: Loaded 50611 existing records. [2025-10-28T22:00:10.394192] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-28T22:00:10.478536] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:00:10.478856] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-28T22:00:10.479067] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-28T22:00:10.479382] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-28T22:00:10.479449] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-28T22:00:10.819975] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T22:00:10.879548] [INFO ] [REMOTE ] WPM: Full fetch complete (76448 records). [2025-10-28T22:00:10.883043] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:00:10.883310] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-28T22:00:11.185452] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-28T22:00:11.309063] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-28T22:00:11.309135] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-28T22:00:11.310285] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-28T22:00:11.310347] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-28T22:00:11.311664] [DEBUG] [LOCAL ] WPM: Trimmed 76448 records to 52786 (keeping 200 days of data) [2025-10-28T22:00:11.625679] [DEBUG] [LOCAL ] WPM: Primary data saved (52786 records). [2025-10-28T22:00:11.625965] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-28T22:00:11.626215] [INFO ] [MAIN ] Update Progress: 2312/2366 symbols completed. WPM took 35.4s. Estimated remaining: 7m 1s. Rate: 7.7 symbols/min [2025-10-28T22:00:11.837759] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:00:11.839936] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T22:00:11.868054] [DEBUG] [LOCAL ] WS: Loaded 23168 existing records from primary storage. [2025-10-28T22:00:11.868299] [INFO ] [MAIN ] WS: Loaded 23168 existing records. [2025-10-28T22:00:11.985414] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-28T22:00:12.044145] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:00:12.044313] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-28T22:00:12.044359] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-28T22:00:12.044545] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-28T22:00:12.044600] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-28T22:00:12.392708] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:00:12.617784] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T22:00:12.703760] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T22:00:12.715977] [INFO ] [REMOTE ] WRB: Full fetch complete (73915 records). [2025-10-28T22:00:12.716256] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-28T22:00:12.785437] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-28T22:00:13.163005] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-28T22:00:13.163133] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-28T22:00:13.164983] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-28T22:00:13.165071] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-28T22:00:13.167288] [DEBUG] [LOCAL ] WRB: Trimmed 73915 records to 50772 (keeping 200 days of data) [2025-10-28T22:00:13.483843] [DEBUG] [LOCAL ] WRB: Primary data saved (50772 records). [2025-10-28T22:00:13.483976] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-28T22:00:13.484057] [INFO ] [MAIN ] Update Progress: 2313/2366 symbols completed. WRB took 23.8s. Estimated remaining: 6m 53s. Rate: 7.7 symbols/min [2025-10-28T22:00:13.584844] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-28T22:00:13.660982] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:00:13.706938] [DEBUG] [LOCAL ] WSM: Loaded 48464 existing records from primary storage. [2025-10-28T22:00:13.707284] [INFO ] [MAIN ] WSM: Loaded 48464 existing records. [2025-10-28T22:00:13.888939] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:00:13.889274] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-28T22:00:13.889372] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-28T22:00:13.889590] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-28T22:00:13.889667] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-28T22:00:14.102979] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T22:00:14.214126] [INFO ] [REMOTE ] WPP: Full fetch complete (47659 records). [2025-10-28T22:00:14.216608] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-28T22:00:14.408026] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:00:14.399924] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-28T22:00:14.677638] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-28T22:00:14.677743] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-28T22:00:14.678453] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-28T22:00:14.678492] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-28T22:00:14.679480] [DEBUG] [LOCAL ] WPP: Trimmed 47659 records to 33958 (keeping 200 days of data) [2025-10-28T22:00:14.881918] [DEBUG] [LOCAL ] WPP: Primary data saved (33958 records). [2025-10-28T22:00:14.882039] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-28T22:00:14.882114] [INFO ] [MAIN ] Update Progress: 2314/2366 symbols completed. WPP took 34.1s. Estimated remaining: 6m 45s. Rate: 7.7 symbols/min [2025-10-28T22:00:15.053095] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:00:15.079785] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T22:00:15.107720] [DEBUG] [LOCAL ] WSO: Loaded 25997 existing records from primary storage. [2025-10-28T22:00:15.107954] [INFO ] [MAIN ] WSO: Loaded 25997 existing records. [2025-10-28T22:00:15.185375] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-28T22:00:15.298612] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:00:15.298898] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-28T22:00:15.299052] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-28T22:00:15.299284] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-28T22:00:15.299377] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-28T22:00:15.454273] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T22:00:15.663514] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:00:15.980255] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-28T22:00:16.544510] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T22:00:16.654746] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T22:00:16.780239] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-28T22:00:17.580271] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-28T22:00:17.607926] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T22:00:18.380313] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-28T22:00:19.044383] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T22:00:19.180216] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-28T22:00:19.211852] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T22:00:19.980257] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-28T22:00:20.466250] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T22:00:20.764770] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T22:00:20.780217] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-28T22:00:21.549965] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T22:00:21.580210] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-28T22:00:22.303549] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T22:00:22.380219] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-28T22:00:23.180276] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-28T22:00:23.228200] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T22:00:23.980230] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-28T22:00:24.415876] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T22:00:24.780243] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-28T22:00:24.913678] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T22:00:25.580299] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-28T22:00:26.380210] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-28T22:00:26.426493] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T22:00:27.180273] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-28T22:00:27.352351] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T22:00:27.436671] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T22:00:27.980213] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-28T22:00:28.082096] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T22:00:28.770629] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T22:00:28.780211] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-28T22:00:29.580292] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-28T22:00:30.251214] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T22:00:30.380223] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-28T22:00:31.062965] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T22:00:31.180225] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-28T22:00:31.813145] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T22:00:31.980259] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-28T22:00:32.406603] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T22:00:32.780282] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-28T22:00:33.383186] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T22:00:33.580274] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-28T22:00:34.002040] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T22:00:34.380280] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-28T22:00:34.946767] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T22:00:35.180327] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-28T22:00:35.206278] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T22:00:35.949397] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T22:00:35.980251] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-28T22:00:36.778358] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T22:00:36.780381] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-28T22:00:37.580239] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-28T22:00:37.614412] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T22:00:38.380265] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-28T22:00:38.970625] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T22:00:39.180250] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-28T22:00:39.980227] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-28T22:00:40.179331] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-28T22:00:40.391997] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T22:00:40.780246] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-28T22:00:40.821554] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T22:00:40.827178] [INFO ] [REMOTE ] WS: Full fetch complete (35308 records). [2025-10-28T22:00:40.827290] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-28T22:00:41.226844] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-28T22:00:41.227011] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-28T22:00:41.227873] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-28T22:00:41.227959] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-28T22:00:41.229121] [DEBUG] [LOCAL ] WS: Trimmed 35308 records to 23025 (keeping 200 days of data) [2025-10-28T22:00:41.354282] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T22:00:41.404998] [DEBUG] [LOCAL ] WS: Primary data saved (23025 records). [2025-10-28T22:00:41.405117] [INFO ] [MAIN ] WS: Full history saved. [2025-10-28T22:00:41.405204] [INFO ] [MAIN ] Update Progress: 2315/2366 symbols completed. WS took 29.8s. Estimated remaining: 6m 37s. Rate: 7.7 symbols/min [2025-10-28T22:00:41.579924] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:00:41.580295] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-28T22:00:41.602865] [DEBUG] [LOCAL ] WSR: Loaded 22100 existing records from primary storage. [2025-10-28T22:00:41.603122] [INFO ] [MAIN ] WSR: Loaded 22100 existing records. [2025-10-28T22:00:41.780027] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:00:41.780244] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-28T22:00:41.780330] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-28T22:00:41.780580] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-28T22:00:41.780639] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-28T22:00:42.159694] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:00:42.380271] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-28T22:00:42.601606] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T22:00:43.180234] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-28T22:00:43.788486] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T22:00:43.798623] [INFO ] [REMOTE ] WSM: Full fetch complete (71126 records). [2025-10-28T22:00:43.798845] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-28T22:00:43.980585] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-28T22:00:44.148050] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T22:00:44.218757] [INFO ] [REMOTE ] WRBY: Full fetch complete (73614 records). [2025-10-28T22:00:44.252006] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-28T22:00:44.384718] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-28T22:00:44.390006] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-28T22:00:44.402294] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-28T22:00:44.409256] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-28T22:00:44.488071] [DEBUG] [LOCAL ] WSM: Trimmed 71126 records to 48417 (keeping 200 days of data) [2025-10-28T22:00:44.781689] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-28T22:00:44.987101] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-28T22:00:45.023887] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-28T22:00:45.030462] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-28T22:00:45.035707] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-28T22:00:45.109830] [DEBUG] [LOCAL ] WRBY: Trimmed 73614 records to 50593 (keeping 200 days of data) [2025-10-28T22:00:45.124522] [DEBUG] [LOCAL ] WSM: Primary data saved (48417 records). [2025-10-28T22:00:45.125230] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-28T22:00:45.126327] [INFO ] [MAIN ] Update Progress: 2316/2366 symbols completed. WSM took 31.6s. Estimated remaining: 6m 30s. Rate: 7.7 symbols/min [2025-10-28T22:00:45.315384] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T22:00:45.361840] [INFO ] [REMOTE ] WSO: Full fetch complete (36338 records). [2025-10-28T22:00:45.367418] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-28T22:00:45.556893] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:00:45.987474] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T22:00:46.030920] [DEBUG] [LOCAL ] WST: Loaded 36589 existing records from primary storage. [2025-10-28T22:00:46.029270] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-28T22:00:46.036155] [DEBUG] [LOCAL ] WRBY: Primary data saved (50593 records). [2025-10-28T22:00:46.053325] [INFO ] [MAIN ] WST: Loaded 36589 existing records. [2025-10-28T22:00:46.067715] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-28T22:00:46.144874] [INFO ] [MAIN ] Update Progress: 2317/2366 symbols completed. WRBY took 36.1s. Estimated remaining: 6m 22s. Rate: 7.7 symbols/min [2025-10-28T22:00:46.205687] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-28T22:00:46.214444] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-28T22:00:46.215392] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-28T22:00:46.243449] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-28T22:00:46.290127] [DEBUG] [LOCAL ] WSO: Trimmed 36338 records to 26119 (keeping 200 days of data) [2025-10-28T22:00:46.328961] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:00:46.394807] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-28T22:00:46.394905] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-28T22:00:46.422205] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-28T22:00:46.422905] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-28T22:00:46.859879] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:00:46.864069] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-28T22:00:46.873824] [DEBUG] [LOCAL ] WSO: Primary data saved (26119 records). [2025-10-28T22:00:46.874859] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-28T22:00:46.874982] [INFO ] [MAIN ] Update Progress: 2318/2366 symbols completed. WSO took 32.0s. Estimated remaining: 6m 14s. Rate: 7.7 symbols/min [2025-10-28T22:00:46.886870] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T22:00:47.180316] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-28T22:00:47.874718] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T22:00:47.980222] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-28T22:00:48.021065] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T22:00:48.780308] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-28T22:00:49.148799] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T22:00:49.443903] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T22:00:49.580243] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-28T22:00:50.380352] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-28T22:00:50.948553] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T22:00:51.180293] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-28T22:00:51.324154] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T22:00:51.980326] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-28T22:00:52.622473] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T22:00:52.770623] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T22:00:52.780208] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-28T22:00:53.580276] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-28T22:00:53.659228] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T22:00:54.380279] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-28T22:00:54.802936] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T22:00:55.119729] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T22:00:55.180217] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-28T22:00:55.974754] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T22:00:55.980201] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-28T22:00:56.780236] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-28T22:00:56.802747] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T22:00:56.809365] [INFO ] [REMOTE ] WSR: Full fetch complete (32580 records). [2025-10-28T22:00:56.809477] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-28T22:00:57.182489] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-28T22:00:57.182617] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-28T22:00:57.183306] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-28T22:00:57.183357] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-28T22:00:57.184097] [DEBUG] [LOCAL ] WSR: Trimmed 32580 records to 22015 (keeping 200 days of data) [2025-10-28T22:00:57.313244] [DEBUG] [LOCAL ] WSR: Primary data saved (22015 records). [2025-10-28T22:00:57.313365] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-28T22:00:57.313440] [INFO ] [MAIN ] Update Progress: 2319/2366 symbols completed. WSR took 15.9s. Estimated remaining: 6m 6s. Rate: 7.7 symbols/min [2025-10-28T22:00:57.929567] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T22:00:57.937389] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-28T22:00:59.154343] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T22:00:59.162822] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-28T22:01:00.316180] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T22:01:00.323426] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-28T22:01:02.114295] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T22:01:02.121765] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-28T22:01:02.551445] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T22:01:02.559220] [INFO ] [REMOTE ] WST: Full fetch complete (54698 records). [2025-10-28T22:01:02.559362] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-28T22:01:02.958066] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-28T22:01:02.958150] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-28T22:01:02.959154] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-28T22:01:02.959215] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-28T22:01:02.960259] [DEBUG] [LOCAL ] WST: Trimmed 54698 records to 36472 (keeping 200 days of data) [2025-10-28T22:01:03.178699] [DEBUG] [LOCAL ] WST: Primary data saved (36472 records). [2025-10-28T22:01:03.178827] [INFO ] [MAIN ] WST: Full history saved. [2025-10-28T22:01:03.179586] [INFO ] [MAIN ] Update Progress: 2320/2366 symbols completed. WST took 18.1s. Estimated remaining: 5m 58s. Rate: 7.7 symbols/min [2025-10-28T22:01:03.741794] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:03.885321] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:03.943375] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:03.942439] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:03.944204] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-28T22:01:03.944274] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-28T22:01:03.944422] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-28T22:01:03.944545] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-28T22:01:03.944629] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-28T22:01:03.944802] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-28T22:01:04.277240] [DEBUG] [LOCAL ] WT: Loaded 48144 existing records from primary storage. [2025-10-28T22:01:04.313717] [DEBUG] [LOCAL ] WTI: Loaded 44692 existing records from primary storage. [2025-10-28T22:01:04.313010] [INFO ] [MAIN ] WT: Loaded 48144 existing records. [2025-10-28T22:01:04.347528] [DEBUG] [LOCAL ] WTRG: Loaded 50865 existing records from primary storage. [2025-10-28T22:01:04.399718] [INFO ] [MAIN ] WTRG: Loaded 50865 existing records. [2025-10-28T22:01:04.352835] [INFO ] [MAIN ] WTI: Loaded 44692 existing records. [2025-10-28T22:01:04.544301] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:04.565872] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-28T22:01:04.907670] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:04.912268] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:04.954437] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:04.954751] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-28T22:01:04.954868] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-28T22:01:04.955138] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-28T22:01:04.955077] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-28T22:01:04.955343] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-28T22:01:04.955273] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-28T22:01:04.955699] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-28T22:01:04.955677] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-28T22:01:04.955817] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-28T22:01:04.955868] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-28T22:01:04.956054] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-28T22:01:04.985990] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-28T22:01:05.035382] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T22:01:05.073010] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-28T22:01:05.665371] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T22:01:05.726737] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-28T22:01:05.912256] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:05.952046] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-28T22:01:06.093428] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:06.117227] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-28T22:01:06.157447] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:06.157986] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-28T22:01:06.284511] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T22:01:06.285801] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-28T22:01:06.624235] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T22:01:06.625530] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-28T22:01:06.898729] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T22:01:07.180275] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-28T22:01:07.307208] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T22:01:07.423100] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T22:01:07.493688] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T22:01:07.583540] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T22:01:07.980248] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-28T22:01:08.780318] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-28T22:01:08.944859] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T22:01:09.580303] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-28T22:01:10.093137] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T22:01:10.380281] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-28T22:01:10.681784] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T22:01:11.180279] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-28T22:01:11.570563] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T22:01:11.980281] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-28T22:01:12.530845] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T22:01:12.780255] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-28T22:01:13.151894] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T22:01:13.580261] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-28T22:01:14.093100] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T22:01:14.380247] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-28T22:01:14.754703] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T22:01:14.817700] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T22:01:15.180247] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-28T22:01:15.980288] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-28T22:01:16.474092] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T22:01:16.780231] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-28T22:01:17.371720] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T22:01:17.580306] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-28T22:01:17.937161] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T22:01:18.003385] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T22:01:18.380269] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-28T22:01:18.775668] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T22:01:19.180252] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-28T22:01:19.980270] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-28T22:01:20.431048] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T22:01:20.433398] [INFO ] [REMOTE ] WTM: Full fetch complete (2825 records). [2025-10-28T22:01:20.433481] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-28T22:01:20.622775] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T22:01:20.623075] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T22:01:20.623229] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T22:01:20.623681] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-28T22:01:20.623838] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-28T22:01:20.623992] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-28T22:01:20.624105] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-28T22:01:20.624207] [INFO ] [MAIN ] Update Progress: 2321/2366 symbols completed. WTM took 17.4s. Estimated remaining: 5m 50s. Rate: 7.7 symbols/min [2025-10-28T22:01:20.785175] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-28T22:01:20.785100] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T22:01:20.852848] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:20.871823] [DEBUG] [LOCAL ] WTS: Loaded 16949 existing records from primary storage. [2025-10-28T22:01:20.872058] [INFO ] [MAIN ] WTS: Loaded 16949 existing records. [2025-10-28T22:01:21.046117] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:21.046360] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-28T22:01:21.046410] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-28T22:01:21.046637] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-28T22:01:21.046732] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-28T22:01:21.394928] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:21.580247] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-28T22:01:22.230736] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T22:01:22.320851] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T22:01:22.380253] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-28T22:01:23.172918] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T22:01:23.180205] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-28T22:01:23.980225] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-28T22:01:24.008857] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T22:01:24.780296] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-28T22:01:25.219460] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T22:01:25.580232] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-28T22:01:25.999482] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T22:01:26.380358] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-28T22:01:26.780829] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T22:01:27.180335] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-28T22:01:27.512011] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T22:01:27.886758] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T22:01:27.980281] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-28T22:01:28.737347] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T22:01:28.780230] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-28T22:01:29.415541] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T22:01:29.580252] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-28T22:01:30.380250] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-28T22:01:31.180223] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-28T22:01:31.237841] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T22:01:31.437098] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T22:01:31.980268] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-28T22:01:32.513855] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T22:01:32.780312] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-28T22:01:33.176452] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T22:01:33.186670] [INFO ] [REMOTE ] WTRG: Full fetch complete (73905 records). [2025-10-28T22:01:33.186797] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-28T22:01:33.578695] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-28T22:01:33.578801] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-28T22:01:33.579984] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-28T22:01:33.580044] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-28T22:01:33.580242] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-28T22:01:33.582298] [DEBUG] [LOCAL ] WTRG: Trimmed 73905 records to 50870 (keeping 200 days of data) [2025-10-28T22:01:33.880907] [DEBUG] [LOCAL ] WTRG: Primary data saved (50870 records). [2025-10-28T22:01:33.881030] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-28T22:01:33.881848] [INFO ] [MAIN ] Update Progress: 2322/2366 symbols completed. WTRG took 30.7s. Estimated remaining: 5m 43s. Rate: 7.7 symbols/min [2025-10-28T22:01:34.059197] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:34.101353] [DEBUG] [LOCAL ] WTTR: Loaded 44314 existing records from primary storage. [2025-10-28T22:01:34.101635] [INFO ] [MAIN ] WTTR: Loaded 44314 existing records. [2025-10-28T22:01:34.316690] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T22:01:34.315197] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:34.325950] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-28T22:01:34.326420] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-28T22:01:34.326718] [INFO ] [REMOTE ] WTI: Full fetch complete (63838 records). [2025-10-28T22:01:34.326850] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-28T22:01:34.326809] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-28T22:01:34.326992] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-28T22:01:34.383872] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-28T22:01:34.832121] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T22:01:35.072228] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:35.143781] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-28T22:01:35.143884] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-28T22:01:35.145031] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-28T22:01:35.145094] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-28T22:01:35.146491] [DEBUG] [LOCAL ] WTI: Trimmed 63838 records to 44676 (keeping 200 days of data) [2025-10-28T22:01:35.194078] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-28T22:01:35.403398] [DEBUG] [LOCAL ] WTI: Primary data saved (44676 records). [2025-10-28T22:01:35.403545] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-28T22:01:35.403634] [INFO ] [MAIN ] Update Progress: 2323/2366 symbols completed. WTI took 32.2s. Estimated remaining: 5m 35s. Rate: 7.7 symbols/min [2025-10-28T22:01:35.577515] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:35.626232] [DEBUG] [LOCAL ] WU: Loaded 53487 existing records from primary storage. [2025-10-28T22:01:35.626689] [INFO ] [MAIN ] WU: Loaded 53487 existing records. [2025-10-28T22:01:35.801698] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T22:01:35.841093] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:35.841768] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-28T22:01:35.842011] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-28T22:01:35.842402] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-28T22:01:35.842460] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-28T22:01:35.985328] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-28T22:01:36.205710] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:36.263099] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T22:01:36.715485] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T22:01:36.780219] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-28T22:01:37.330430] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T22:01:37.333370] [INFO ] [REMOTE ] WTS: Full fetch complete (25586 records). [2025-10-28T22:01:37.333446] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-28T22:01:37.585434] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-28T22:01:37.710299] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-28T22:01:37.710371] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-28T22:01:37.710978] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-28T22:01:37.711039] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-28T22:01:37.711707] [DEBUG] [LOCAL ] WTS: Trimmed 25586 records to 16854 (keeping 200 days of data) [2025-10-28T22:01:37.812592] [DEBUG] [LOCAL ] WTS: Primary data saved (16854 records). [2025-10-28T22:01:37.812751] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-28T22:01:37.812834] [INFO ] [MAIN ] Update Progress: 2324/2366 symbols completed. WTS took 17.2s. Estimated remaining: 5m 27s. Rate: 7.7 symbols/min [2025-10-28T22:01:37.980316] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:38.023443] [DEBUG] [LOCAL ] WWW: Loaded 49169 existing records from primary storage. [2025-10-28T22:01:38.023819] [INFO ] [MAIN ] WWW: Loaded 49169 existing records. [2025-10-28T22:01:38.214222] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:38.214427] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-28T22:01:38.214473] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-28T22:01:38.214709] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-28T22:01:38.214766] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-28T22:01:38.385756] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-28T22:01:38.570866] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:39.180324] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-28T22:01:39.269380] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T22:01:39.688812] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T22:01:39.980253] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-28T22:01:40.415914] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T22:01:40.780276] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-28T22:01:41.297505] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T22:01:41.580317] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-28T22:01:41.865728] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T22:01:42.380306] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-28T22:01:42.818594] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T22:01:43.180255] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-28T22:01:43.804500] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T22:01:43.980228] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-28T22:01:44.532303] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T22:01:44.780265] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-28T22:01:45.577071] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T22:01:45.587122] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-28T22:01:46.191105] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T22:01:46.380251] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-28T22:01:46.860495] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T22:01:47.180328] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-28T22:01:47.825745] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T22:01:47.980289] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-28T22:01:48.355951] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T22:01:48.780317] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-28T22:01:49.321166] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T22:01:49.580257] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-28T22:01:50.255960] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T22:01:50.380258] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-28T22:01:51.023525] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T22:01:51.180279] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-28T22:01:51.866332] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T22:01:51.980249] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-28T22:01:52.275788] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T22:01:52.780323] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-28T22:01:53.471431] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T22:01:53.580251] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-28T22:01:53.931105] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T22:01:54.380290] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-28T22:01:54.908331] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T22:01:55.180292] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-28T22:01:55.829187] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T22:01:55.840495] [INFO ] [REMOTE ] WT: Full fetch complete (69816 records). [2025-10-28T22:01:55.840765] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-28T22:01:55.989150] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-28T22:01:56.274337] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-28T22:01:56.274451] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-28T22:01:56.275774] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-28T22:01:56.275839] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-28T22:01:56.277240] [DEBUG] [LOCAL ] WT: Trimmed 69816 records to 48131 (keeping 200 days of data) [2025-10-28T22:01:56.569443] [DEBUG] [LOCAL ] WT: Primary data saved (48131 records). [2025-10-28T22:01:56.569638] [INFO ] [MAIN ] WT: Full history saved. [2025-10-28T22:01:56.569900] [INFO ] [MAIN ] Update Progress: 2325/2366 symbols completed. WT took 53.4s. Estimated remaining: 5m 19s. Rate: 7.7 symbols/min [2025-10-28T22:01:56.741373] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T22:01:56.810689] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:01:56.811038] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-28T22:01:56.864771] [DEBUG] [LOCAL ] WY: Loaded 53202 existing records from primary storage. [2025-10-28T22:01:56.865086] [INFO ] [MAIN ] WY: Loaded 53202 existing records. [2025-10-28T22:01:57.056862] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:01:57.057064] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-28T22:01:57.057113] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-28T22:01:57.057848] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-28T22:01:57.057906] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-28T22:01:57.432702] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:01:57.517787] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T22:01:57.580270] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-28T22:01:58.372354] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T22:01:58.382838] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-28T22:01:59.070633] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T22:01:59.180315] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-28T22:01:59.685034] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T22:01:59.980283] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-28T22:02:00.558141] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T22:02:00.780253] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-28T22:02:01.580270] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-28T22:02:01.867829] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T22:02:01.879571] [INFO ] [REMOTE ] WU: Full fetch complete (77530 records). [2025-10-28T22:02:01.879813] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-28T22:02:02.326369] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-28T22:02:02.326544] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-28T22:02:02.328252] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-28T22:02:02.328424] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-28T22:02:02.330150] [DEBUG] [LOCAL ] WU: Trimmed 77530 records to 53487 (keeping 200 days of data) [2025-10-28T22:02:02.386876] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-28T22:02:02.595437] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T22:02:02.734107] [DEBUG] [LOCAL ] WU: Primary data saved (53487 records). [2025-10-28T22:02:02.734333] [INFO ] [MAIN ] WU: Full history saved. [2025-10-28T22:02:02.735101] [INFO ] [MAIN ] Update Progress: 2326/2366 symbols completed. WU took 27.3s. Estimated remaining: 5m 12s. Rate: 7.7 symbols/min [2025-10-28T22:02:02.943330] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:02.971171] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T22:02:03.009694] [DEBUG] [LOCAL ] XFLT: Loaded 29571 existing records from primary storage. [2025-10-28T22:02:03.009980] [INFO ] [MAIN ] XFLT: Loaded 29571 existing records. [2025-10-28T22:02:03.190721] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-28T22:02:03.217023] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:03.217935] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-28T22:02:03.217994] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-28T22:02:03.218485] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-28T22:02:03.218638] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-28T22:02:03.561194] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:03.871490] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T22:02:03.980226] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-28T22:02:04.588736] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T22:02:04.780265] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-28T22:02:05.046170] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T22:02:05.580253] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-28T22:02:05.974948] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T22:02:05.984502] [INFO ] [REMOTE ] WTTR: Full fetch complete (65437 records). [2025-10-28T22:02:05.984692] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-28T22:02:06.386634] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-28T22:02:06.408769] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-28T22:02:06.408832] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-28T22:02:06.410132] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-28T22:02:06.410215] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-28T22:02:06.411563] [DEBUG] [LOCAL ] WTTR: Trimmed 65437 records to 44193 (keeping 200 days of data) [2025-10-28T22:02:06.687378] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T22:02:06.700068] [DEBUG] [LOCAL ] WTTR: Primary data saved (44193 records). [2025-10-28T22:02:06.700146] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-28T22:02:06.700225] [INFO ] [MAIN ] Update Progress: 2327/2366 symbols completed. WTTR took 32.8s. Estimated remaining: 5m 4s. Rate: 7.7 symbols/min [2025-10-28T22:02:06.866604] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:06.905539] [DEBUG] [LOCAL ] XHR: Loaded 43013 existing records from primary storage. [2025-10-28T22:02:06.905838] [INFO ] [MAIN ] XHR: Loaded 43013 existing records. [2025-10-28T22:02:07.084672] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:07.084837] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-28T22:02:07.084885] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-28T22:02:07.085469] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-28T22:02:07.085526] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-28T22:02:07.185404] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-28T22:02:07.439418] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:07.793927] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T22:02:07.980254] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-28T22:02:08.779390] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T22:02:08.789678] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-28T22:02:09.498262] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T22:02:09.580237] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-28T22:02:09.700407] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T22:02:10.380240] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-28T22:02:10.826467] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T22:02:10.836393] [INFO ] [REMOTE ] WWW: Full fetch complete (70727 records). [2025-10-28T22:02:10.836558] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-28T22:02:11.185368] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-28T22:02:11.244004] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-28T22:02:11.244201] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-28T22:02:11.246130] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-28T22:02:11.246215] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-28T22:02:11.247818] [DEBUG] [LOCAL ] WWW: Trimmed 70727 records to 49139 (keeping 200 days of data) [2025-10-28T22:02:11.508366] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T22:02:11.604909] [DEBUG] [LOCAL ] WWW: Primary data saved (49139 records). [2025-10-28T22:02:11.605053] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-28T22:02:11.605136] [INFO ] [MAIN ] Update Progress: 2328/2366 symbols completed. WWW took 33.8s. Estimated remaining: 4m 56s. Rate: 7.7 symbols/min [2025-10-28T22:02:11.792832] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:11.793052] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-28T22:02:11.793104] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-28T22:02:11.793230] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-28T22:02:11.793290] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-28T22:02:11.793333] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-28T22:02:11.793365] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-28T22:02:11.984715] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-28T22:02:12.198959] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:12.661082] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T22:02:12.780293] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-10-28T22:02:12.949696] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T22:02:12.950058] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-10-28T22:02:12.950176] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T22:02:12.950222] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-28T22:02:12.950425] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T22:02:12.950497] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-28T22:02:12.950573] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-28T22:02:12.950628] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-28T22:02:12.950713] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-28T22:02:12.950770] [INFO ] [MAIN ] Update Progress: 2329/2366 symbols completed. XIFR took 1.3s. Estimated remaining: 4m 48s. Rate: 7.7 symbols/min [2025-10-28T22:02:13.115614] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:13.168679] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-28T22:02:13.169046] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-28T22:02:13.351178] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:13.351507] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-28T22:02:13.351713] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-28T22:02:13.353108] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-28T22:02:13.353170] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-28T22:02:13.533795] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T22:02:13.585342] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-28T22:02:13.751987] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:14.380269] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-28T22:02:15.180240] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-28T22:02:15.294578] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T22:02:15.980267] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-28T22:02:16.273693] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T22:02:16.510967] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-28T22:02:16.780258] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-28T22:02:17.262036] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T22:02:17.580305] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-28T22:02:17.946057] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T22:02:18.380287] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-28T22:02:19.180284] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-28T22:02:19.272183] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T22:02:19.980247] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-28T22:02:20.071562] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-28T22:02:20.267743] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T22:02:20.780304] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-28T22:02:21.358208] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T22:02:21.580312] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-28T22:02:22.380223] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-28T22:02:22.553089] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T22:02:22.975445] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-28T22:02:23.180261] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-28T22:02:23.560970] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T22:02:23.629587] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T22:02:23.980235] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-28T22:02:24.780290] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-28T22:02:25.261798] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T22:02:25.580436] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-28T22:02:26.012707] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T22:02:26.047736] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T22:02:26.058582] [INFO ] [REMOTE ] WY: Full fetch complete (77048 records). [2025-10-28T22:02:26.058745] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-28T22:02:26.395055] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-28T22:02:26.453890] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-28T22:02:26.453970] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-28T22:02:26.455207] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-28T22:02:26.455269] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-28T22:02:26.456950] [DEBUG] [LOCAL ] WY: Trimmed 77048 records to 53202 (keeping 200 days of data) [2025-10-28T22:02:26.808957] [DEBUG] [LOCAL ] WY: Primary data saved (53202 records). [2025-10-28T22:02:26.809122] [INFO ] [MAIN ] WY: Full history saved. [2025-10-28T22:02:26.809918] [INFO ] [MAIN ] Update Progress: 2330/2366 symbols completed. WY took 30.2s. Estimated remaining: 4m 40s. Rate: 7.7 symbols/min [2025-10-28T22:02:26.981428] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:27.012302] [DEBUG] [LOCAL ] XPER: Loaded 30387 existing records from primary storage. [2025-10-28T22:02:27.012544] [INFO ] [MAIN ] XPER: Loaded 30387 existing records. [2025-10-28T22:02:27.186772] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-28T22:02:27.191297] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:27.192180] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-28T22:02:27.192234] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-28T22:02:27.192691] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-28T22:02:27.192750] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-28T22:02:27.546703] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:27.587237] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T22:02:27.980260] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-28T22:02:28.780289] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-28T22:02:29.402924] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-28T22:02:29.580227] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-28T22:02:30.011068] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T22:02:30.380261] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-28T22:02:30.805236] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-28T22:02:31.180220] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-28T22:02:31.676821] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T22:02:31.941188] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-28T22:02:31.980245] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-28T22:02:32.760759] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T22:02:32.780240] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-28T22:02:33.064640] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T22:02:33.070980] [INFO ] [REMOTE ] XFLT: Full fetch complete (43881 records). [2025-10-28T22:02:33.071090] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-28T22:02:33.455502] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-28T22:02:33.455578] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-28T22:02:33.456596] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-28T22:02:33.456816] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-28T22:02:33.457827] [DEBUG] [LOCAL ] XFLT: Trimmed 43881 records to 29526 (keeping 200 days of data) [2025-10-28T22:02:33.595228] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-28T22:02:33.631130] [DEBUG] [LOCAL ] XFLT: Primary data saved (29526 records). [2025-10-28T22:02:33.631233] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-28T22:02:33.631307] [INFO ] [MAIN ] Update Progress: 2331/2366 symbols completed. XFLT took 30.9s. Estimated remaining: 4m 33s. Rate: 7.7 symbols/min [2025-10-28T22:02:33.809667] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:33.831268] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T22:02:33.839540] [INFO ] [REMOTE ] XHR: Full fetch complete (61877 records). [2025-10-28T22:02:33.839701] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-28T22:02:34.186630] [DEBUG] [LOCAL ] XPEV: Loaded 53614 existing records from primary storage. [2025-10-28T22:02:34.189404] [INFO ] [MAIN ] XPEV: Loaded 53614 existing records. [2025-10-28T22:02:34.381041] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-28T22:02:34.427343] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-28T22:02:34.437762] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-28T22:02:34.474335] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-28T22:02:34.472523] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:34.475245] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-28T22:02:34.475189] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-28T22:02:34.475311] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-28T22:02:34.476197] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-28T22:02:34.476321] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-28T22:02:34.557762] [DEBUG] [LOCAL ] XHR: Trimmed 61877 records to 42865 (keeping 200 days of data) [2025-10-28T22:02:35.050327] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:35.129355] [DEBUG] [LOCAL ] XHR: Primary data saved (42865 records). [2025-10-28T22:02:35.129501] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-28T22:02:35.129618] [INFO ] [MAIN ] Update Progress: 2332/2366 symbols completed. XHR took 28.4s. Estimated remaining: 4m 25s. Rate: 7.7 symbols/min [2025-10-28T22:02:35.189256] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-28T22:02:35.322636] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:35.339597] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T22:02:35.389474] [DEBUG] [LOCAL ] XPO: Loaded 47324 existing records from primary storage. [2025-10-28T22:02:35.389805] [INFO ] [MAIN ] XPO: Loaded 47324 existing records. [2025-10-28T22:02:35.584226] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:35.584635] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-28T22:02:35.584898] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-28T22:02:35.586188] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-28T22:02:35.586258] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-28T22:02:35.987285] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-28T22:02:35.990391] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:35.996435] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-28T22:02:36.780210] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-28T22:02:36.818049] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T22:02:36.906738] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T22:02:37.580291] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-28T22:02:38.264227] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T22:02:38.380236] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-28T22:02:38.670404] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T22:02:39.180295] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-28T22:02:39.980250] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-28T22:02:40.118486] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T22:02:40.566358] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-28T22:02:40.780253] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-28T22:02:41.249508] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T22:02:41.580244] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-28T22:02:42.018829] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T22:02:42.380266] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-28T22:02:42.976388] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T22:02:43.180268] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-28T22:02:43.985336] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-28T22:02:43.999048] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T22:02:44.594631] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-28T22:02:44.780262] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-28T22:02:45.350736] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T22:02:45.580293] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-28T22:02:46.380286] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-28T22:02:47.180351] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-28T22:02:47.393100] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T22:02:47.505365] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-28T22:02:47.686423] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T22:02:47.931442] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T22:02:47.980275] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-28T22:02:48.780287] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-28T22:02:49.580312] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-28T22:02:49.795385] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-28T22:02:49.962748] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T22:02:50.380293] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-28T22:02:50.704909] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T22:02:51.180364] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-28T22:02:51.329395] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T22:02:51.980356] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-28T22:02:52.785536] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-28T22:02:52.815433] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T22:02:53.580345] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-28T22:02:54.203663] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-28T22:02:54.330154] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T22:02:54.380263] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-28T22:02:55.048867] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T22:02:55.180285] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-28T22:02:55.473028] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T22:02:55.485289] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-28T22:02:55.485487] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-28T22:02:55.950260] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-28T22:02:55.950383] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-28T22:02:55.952177] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-28T22:02:55.952283] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-28T22:02:55.954829] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 53793 (keeping 200 days of data) [2025-10-28T22:02:56.017597] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-28T22:02:56.367573] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-28T22:02:56.367822] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-28T22:02:56.368396] [INFO ] [MAIN ] Update Progress: 2333/2366 symbols completed. XOM took 43.4s. Estimated remaining: 4m 17s. Rate: 7.7 symbols/min [2025-10-28T22:02:56.577356] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:56.619882] [DEBUG] [LOCAL ] XPOF: Loaded 36549 existing records from primary storage. [2025-10-28T22:02:56.620568] [INFO ] [MAIN ] XPOF: Loaded 36549 existing records. [2025-10-28T22:02:56.767422] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T22:02:56.783507] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-28T22:02:56.861941] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:56.862192] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-28T22:02:56.862245] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-28T22:02:56.862749] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-28T22:02:56.862809] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-28T22:02:57.255178] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:02:57.580380] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-28T22:02:58.010258] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-28T22:02:58.154402] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T22:02:58.161622] [INFO ] [REMOTE ] XPER: Full fetch complete (43579 records). [2025-10-28T22:02:58.161768] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-28T22:02:58.386714] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-28T22:02:58.573985] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-28T22:02:58.574122] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-28T22:02:58.575964] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-28T22:02:58.576036] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-28T22:02:58.577513] [DEBUG] [LOCAL ] XPER: Trimmed 43579 records to 30362 (keeping 200 days of data) [2025-10-28T22:02:58.758215] [DEBUG] [LOCAL ] XPER: Primary data saved (30362 records). [2025-10-28T22:02:58.758456] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-28T22:02:58.758584] [INFO ] [MAIN ] Update Progress: 2334/2366 symbols completed. XPER took 31.9s. Estimated remaining: 4m 9s. Rate: 7.7 symbols/min [2025-10-28T22:02:58.936872] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:02:58.974266] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T22:02:58.989166] [INFO ] [REMOTE ] XPO: Full fetch complete (69549 records). [2025-10-28T22:02:58.989611] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-28T22:02:59.163118] [DEBUG] [LOCAL ] XPRO: Loaded 45635 existing records from primary storage. [2025-10-28T22:02:59.188729] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-28T22:02:59.210224] [INFO ] [MAIN ] XPRO: Loaded 45635 existing records. [2025-10-28T22:02:59.650528] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-28T22:02:59.628825] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:02:59.650956] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-28T22:02:59.652501] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-28T22:02:59.652591] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-28T22:02:59.669623] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-28T22:02:59.672162] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-28T22:02:59.674476] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-28T22:02:59.674232] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T22:02:59.674424] [DEBUG] [LOCAL ] XPO: Trimmed 69549 records to 47298 (keeping 200 days of data) [2025-10-28T22:02:59.674763] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-28T22:03:00.002702] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-28T22:03:00.301778] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:00.372216] [DEBUG] [LOCAL ] XPO: Primary data saved (47298 records). [2025-10-28T22:03:00.372372] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-28T22:03:00.372467] [INFO ] [MAIN ] Update Progress: 2335/2366 symbols completed. XPO took 25.2s. Estimated remaining: 4m 1s. Rate: 7.7 symbols/min [2025-10-28T22:03:00.540991] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:00.567832] [DEBUG] [LOCAL ] XYF: Loaded 27009 existing records from primary storage. [2025-10-28T22:03:00.568155] [INFO ] [MAIN ] XYF: Loaded 27009 existing records. [2025-10-28T22:03:00.743993] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:03:00.744191] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-28T22:03:00.744237] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-28T22:03:00.744772] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-28T22:03:00.744833] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-28T22:03:00.786769] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-28T22:03:01.093488] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:01.540509] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-28T22:03:01.578449] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T22:03:01.586837] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-28T22:03:01.977312] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T22:03:02.380232] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-28T22:03:03.180248] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-28T22:03:03.583811] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T22:03:03.941222] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-28T22:03:03.939848] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T22:03:03.980204] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-28T22:03:04.646636] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T22:03:04.780254] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-28T22:03:05.580245] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-28T22:03:05.675726] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T22:03:06.380254] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-28T22:03:07.180244] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-28T22:03:07.454907] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T22:03:07.515372] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-28T22:03:07.945862] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T22:03:07.980290] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-28T22:03:08.780277] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-28T22:03:09.580269] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-28T22:03:10.079914] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T22:03:10.134487] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-28T22:03:10.147536] [INFO ] [REMOTE ] XPEV: Full fetch complete (77773 records). [2025-10-28T22:03:10.147854] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-28T22:03:10.386693] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-28T22:03:10.591682] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-28T22:03:10.591801] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-28T22:03:10.593136] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-28T22:03:10.593286] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-28T22:03:10.610052] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T22:03:10.615628] [DEBUG] [LOCAL ] XPEV: Trimmed 77773 records to 53614 (keeping 200 days of data) [2025-10-28T22:03:10.934989] [DEBUG] [LOCAL ] XPEV: Primary data saved (53614 records). [2025-10-28T22:03:10.935123] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-28T22:03:10.935844] [INFO ] [MAIN ] Update Progress: 2336/2366 symbols completed. XPEV took 37.3s. Estimated remaining: 3m 54s. Rate: 7.7 symbols/min [2025-10-28T22:03:11.101330] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:11.149681] [DEBUG] [LOCAL ] XYL: Loaded 47440 existing records from primary storage. [2025-10-28T22:03:11.149971] [INFO ] [MAIN ] XYL: Loaded 47440 existing records. [2025-10-28T22:03:11.185427] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-28T22:03:11.329834] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:03:11.330246] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-28T22:03:11.330312] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-28T22:03:11.331044] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-28T22:03:11.331101] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-28T22:03:11.692159] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:11.717044] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T22:03:11.980243] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-28T22:03:12.199525] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T22:03:12.780262] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-28T22:03:13.331507] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T22:03:13.580337] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-28T22:03:13.924523] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T22:03:14.380230] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-28T22:03:14.816986] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T22:03:15.180228] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-28T22:03:15.250436] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T22:03:15.980333] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-28T22:03:16.212611] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T22:03:16.780266] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-28T22:03:17.102704] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T22:03:17.580256] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-28T22:03:17.891846] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T22:03:18.380275] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-28T22:03:18.689426] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T22:03:19.180281] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-28T22:03:19.733975] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T22:03:19.980266] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-28T22:03:20.297355] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T22:03:20.780288] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-28T22:03:20.959836] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T22:03:21.580316] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-28T22:03:22.113912] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T22:03:22.380315] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-28T22:03:22.606953] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T22:03:22.613839] [INFO ] [REMOTE ] XPOF: Full fetch complete (52893 records). [2025-10-28T22:03:22.613973] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-28T22:03:23.023996] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-28T22:03:23.024107] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-28T22:03:23.025147] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-28T22:03:23.025209] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-28T22:03:23.026469] [DEBUG] [LOCAL ] XPOF: Trimmed 52893 records to 36466 (keeping 200 days of data) [2025-10-28T22:03:23.182768] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-28T22:03:23.231853] [DEBUG] [LOCAL ] XPOF: Primary data saved (36466 records). [2025-10-28T22:03:23.231989] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-28T22:03:23.232070] [INFO ] [MAIN ] Update Progress: 2337/2366 symbols completed. XPOF took 26.9s. Estimated remaining: 3m 46s. Rate: 7.7 symbols/min [2025-10-28T22:03:23.409555] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:23.409815] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-28T22:03:23.409881] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-28T22:03:23.410079] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-28T22:03:23.410200] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-28T22:03:23.410276] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-28T22:03:23.410320] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-28T22:03:23.645619] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T22:03:23.824862] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:23.980228] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-10-28T22:03:24.588246] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T22:03:24.780250] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-28T22:03:25.069629] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T22:03:25.580261] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-28T22:03:25.943559] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T22:03:26.380226] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-28T22:03:26.425515] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T22:03:27.180262] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-10-28T22:03:27.650406] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T22:03:27.980271] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-28T22:03:28.780279] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-28T22:03:28.883945] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T22:03:29.189932] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T22:03:29.580291] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-28T22:03:30.115392] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T22:03:30.257724] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T22:03:30.262256] [INFO ] [REMOTE ] XYF: Full fetch complete (34175 records). [2025-10-28T22:03:30.262332] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-28T22:03:30.385382] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-28T22:03:30.633720] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-28T22:03:30.633799] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-28T22:03:30.634480] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-28T22:03:30.634541] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-28T22:03:30.635287] [DEBUG] [LOCAL ] XYF: Trimmed 34175 records to 27113 (keeping 200 days of data) [2025-10-28T22:03:30.792793] [DEBUG] [LOCAL ] XYF: Primary data saved (27113 records). [2025-10-28T22:03:30.792917] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-28T22:03:30.792993] [INFO ] [MAIN ] Update Progress: 2338/2366 symbols completed. XYF took 30.4s. Estimated remaining: 3m 38s. Rate: 7.7 symbols/min [2025-10-28T22:03:30.957872] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:30.989609] [DEBUG] [LOCAL ] YALA: Loaded 35827 existing records from primary storage. [2025-10-28T22:03:30.989895] [INFO ] [MAIN ] YALA: Loaded 35827 existing records. [2025-10-28T22:03:31.161688] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:03:31.161895] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-28T22:03:31.161940] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-28T22:03:31.162200] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-28T22:03:31.162272] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-28T22:03:31.185446] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-10-28T22:03:31.512399] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:31.681020] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T22:03:31.980301] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-28T22:03:32.780220] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-28T22:03:32.969131] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-28T22:03:33.404749] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T22:03:33.535491] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T22:03:33.580201] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-28T22:03:34.270250] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T22:03:34.380252] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-28T22:03:35.180298] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-10-28T22:03:35.752879] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T22:03:35.980272] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-28T22:03:36.780264] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-28T22:03:36.831465] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T22:03:37.377276] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T22:03:37.580337] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-28T22:03:37.941349] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T22:03:37.950909] [INFO ] [REMOTE ] XPRO: Full fetch complete (66436 records). [2025-10-28T22:03:37.951024] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-28T22:03:38.386313] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-10-28T22:03:38.460572] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T22:03:38.481344] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-28T22:03:38.482175] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-28T22:03:38.484830] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-28T22:03:38.485149] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-28T22:03:38.485488] [INFO ] [REMOTE ] XYL: Full fetch complete (70093 records). [2025-10-28T22:03:38.485595] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-28T22:03:38.548280] [DEBUG] [LOCAL ] XPRO: Trimmed 66436 records to 45612 (keeping 200 days of data) [2025-10-28T22:03:39.183832] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-28T22:03:39.415835] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-28T22:03:39.441683] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-28T22:03:39.445850] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-28T22:03:39.446615] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-28T22:03:39.485290] [DEBUG] [LOCAL ] XYL: Trimmed 70093 records to 47437 (keeping 200 days of data) [2025-10-28T22:03:39.485368] [DEBUG] [LOCAL ] XPRO: Primary data saved (45612 records). [2025-10-28T22:03:39.485604] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-28T22:03:39.486304] [INFO ] [MAIN ] Update Progress: 2339/2366 symbols completed. XPRO took 40.7s. Estimated remaining: 3m 30s. Rate: 7.7 symbols/min [2025-10-28T22:03:39.760467] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:39.813264] [DEBUG] [LOCAL ] YELP: Loaded 44920 existing records from primary storage. [2025-10-28T22:03:39.814237] [INFO ] [MAIN ] YELP: Loaded 44920 existing records. [2025-10-28T22:03:40.090176] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:03:40.092158] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-28T22:03:40.092803] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-28T22:03:40.093896] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-28T22:03:40.095150] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-28T22:03:40.398728] [DEBUG] [LOCAL ] XYL: Primary data saved (47437 records). [2025-10-28T22:03:40.413077] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-28T22:03:40.422569] [INFO ] [MAIN ] Update Progress: 2340/2366 symbols completed. XYL took 29.5s. Estimated remaining: 3m 22s. Rate: 7.7 symbols/min [2025-10-28T22:03:40.591372] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T22:03:40.669520] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-28T22:03:40.658980] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:40.784184] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-28T22:03:40.789113] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-28T22:03:40.791417] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:40.853667] [DEBUG] [LOCAL ] YETI: Loaded 52451 existing records from primary storage. [2025-10-28T22:03:40.853969] [INFO ] [MAIN ] YETI: Loaded 52451 existing records. [2025-10-28T22:03:41.031367] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:03:41.031578] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-28T22:03:41.031681] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-28T22:03:41.032254] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-28T22:03:41.032310] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-28T22:03:41.377243] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:41.580238] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-28T22:03:41.825189] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T22:03:42.080131] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T22:03:42.380321] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-10-28T22:03:42.756189] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T22:03:43.180254] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-28T22:03:43.980239] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-28T22:03:44.602687] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-28T22:03:44.780236] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-28T22:03:44.920515] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-28T22:03:45.041308] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T22:03:45.580245] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-28T22:03:46.111442] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T22:03:46.380257] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-28T22:03:46.888254] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T22:03:47.180288] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-28T22:03:47.651384] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T22:03:47.980238] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-28T22:03:48.257230] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T22:03:48.780273] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-10-28T22:03:49.178022] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T22:03:49.580290] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-28T22:03:50.380220] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-28T22:03:50.543400] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T22:03:50.887674] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-28T22:03:51.180357] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-28T22:03:51.711741] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T22:03:51.980244] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-28T22:03:52.280305] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T22:03:52.780288] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-28T22:03:53.361294] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T22:03:53.580267] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-28T22:03:53.706021] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T22:03:54.380299] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-28T22:03:55.180232] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-28T22:03:55.312546] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-28T22:03:55.711139] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T22:03:55.980238] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-28T22:03:56.029522] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T22:03:56.035227] [INFO ] [REMOTE ] YALA: Full fetch complete (47189 records). [2025-10-28T22:03:56.035357] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-28T22:03:56.407094] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-28T22:03:56.407191] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-28T22:03:56.408099] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-28T22:03:56.408159] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-28T22:03:56.409198] [DEBUG] [LOCAL ] YALA: Trimmed 47189 records to 35715 (keeping 200 days of data) [2025-10-28T22:03:56.608511] [DEBUG] [LOCAL ] YALA: Primary data saved (35715 records). [2025-10-28T22:03:56.608670] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-28T22:03:56.608793] [INFO ] [MAIN ] Update Progress: 2341/2366 symbols completed. YALA took 25.8s. Estimated remaining: 3m 15s. Rate: 7.7 symbols/min [2025-10-28T22:03:56.786911] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:03:56.785355] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-28T22:03:56.825789] [DEBUG] [LOCAL ] YEXT: Loaded 42731 existing records from primary storage. [2025-10-28T22:03:56.826109] [INFO ] [MAIN ] YEXT: Loaded 42731 existing records. [2025-10-28T22:03:57.007487] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:03:57.007742] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-28T22:03:57.007817] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-28T22:03:57.008324] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-28T22:03:57.008398] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-28T22:03:57.368766] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:03:57.474431] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T22:03:57.580252] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-28T22:03:57.976769] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T22:03:58.380254] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-28T22:03:58.620498] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T22:03:59.180264] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-28T22:03:59.651189] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T22:03:59.980231] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-28T22:04:00.443112] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T22:04:00.780256] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-28T22:04:01.207473] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T22:04:01.580260] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-28T22:04:02.106615] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T22:04:02.380289] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-10-28T22:04:02.569683] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T22:04:03.180259] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-28T22:04:03.980281] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-28T22:04:04.057962] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T22:04:04.425727] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T22:04:04.780263] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-28T22:04:05.390564] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T22:04:05.580255] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-28T22:04:06.282940] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T22:04:06.380302] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-28T22:04:06.886594] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T22:04:06.896802] [INFO ] [REMOTE ] YETI: Full fetch complete (75476 records). [2025-10-28T22:04:06.896926] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-28T22:04:07.185417] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-10-28T22:04:07.296717] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-28T22:04:07.296840] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-28T22:04:07.298240] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-28T22:04:07.298306] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-28T22:04:07.299763] [DEBUG] [LOCAL ] YETI: Trimmed 75476 records to 52423 (keeping 200 days of data) [2025-10-28T22:04:07.438307] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T22:04:07.633827] [DEBUG] [LOCAL ] YETI: Primary data saved (52423 records). [2025-10-28T22:04:07.633969] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-28T22:04:07.634049] [INFO ] [MAIN ] Update Progress: 2342/2366 symbols completed. YETI took 27.2s. Estimated remaining: 3m 7s. Rate: 7.7 symbols/min [2025-10-28T22:04:07.801810] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:07.852036] [DEBUG] [LOCAL ] YMM: Loaded 52573 existing records from primary storage. [2025-10-28T22:04:07.852325] [INFO ] [MAIN ] YMM: Loaded 52573 existing records. [2025-10-28T22:04:07.985433] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-28T22:04:08.046242] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:08.046593] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-28T22:04:08.046672] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-28T22:04:08.047275] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-28T22:04:08.047316] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-28T22:04:08.434102] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:08.780258] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-28T22:04:09.125312] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-28T22:04:09.207036] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T22:04:09.580255] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-28T22:04:09.876074] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T22:04:10.380410] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-28T22:04:10.467774] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T22:04:11.180310] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-28T22:04:11.771484] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T22:04:11.980275] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-28T22:04:12.593972] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T22:04:12.602938] [INFO ] [REMOTE ] YELP: Full fetch complete (64720 records). [2025-10-28T22:04:12.603077] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-28T22:04:12.790229] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-10. [2025-10-28T22:04:12.995380] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-28T22:04:12.995457] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-28T22:04:12.996665] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-28T22:04:12.996730] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-28T22:04:12.998081] [DEBUG] [LOCAL ] YELP: Trimmed 64720 records to 44850 (keeping 200 days of data) [2025-10-28T22:04:13.265303] [DEBUG] [LOCAL ] YELP: Primary data saved (44850 records). [2025-10-28T22:04:13.265559] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-28T22:04:13.266002] [INFO ] [MAIN ] Update Progress: 2343/2366 symbols completed. YELP took 33.8s. Estimated remaining: 2m 59s. Rate: 7.7 symbols/min [2025-10-28T22:04:13.452450] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:13.487902] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T22:04:13.529388] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T22:04:13.540707] [INFO ] [REMOTE ] XYZ: Full fetch complete (75973 records). [2025-10-28T22:04:13.540833] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-10-28T22:04:13.585383] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-28T22:04:13.701830] [DEBUG] [LOCAL ] YOU: Loaded 49363 existing records from primary storage. [2025-10-28T22:04:13.725410] [INFO ] [MAIN ] YOU: Loaded 49363 existing records. [2025-10-28T22:04:13.880539] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T22:04:13.885851] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-28T22:04:13.897261] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-28T22:04:13.907834] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-28T22:04:13.963108] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-28T22:04:13.968303] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-28T22:04:13.968122] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:13.968479] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-28T22:04:13.968702] [INFO ] [MAIN ] Update Progress: 2344/2366 symbols completed. XYZ took 50.7s. Estimated remaining: 2m 51s. Rate: 7.7 symbols/min [2025-10-28T22:04:13.968879] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-28T22:04:13.969042] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-28T22:04:14.044101] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-28T22:04:14.059847] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-28T22:04:14.274073] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:14.392763] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-28T22:04:14.539176] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:14.555875] [DEBUG] [LOCAL ] YPF: Loaded 50749 existing records from primary storage. [2025-10-28T22:04:14.556230] [INFO ] [MAIN ] YPF: Loaded 50749 existing records. [2025-10-28T22:04:14.730090] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:14.730313] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-28T22:04:14.730360] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-28T22:04:14.730728] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-28T22:04:14.730786] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-28T22:04:15.124014] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:15.154568] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T22:04:15.180213] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-28T22:04:15.773215] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T22:04:15.980282] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-28T22:04:16.756197] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T22:04:16.780204] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-28T22:04:17.181681] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T22:04:17.580301] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-28T22:04:18.101703] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T22:04:18.380248] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-28T22:04:18.584423] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T22:04:18.593129] [INFO ] [REMOTE ] YEXT: Full fetch complete (62703 records). [2025-10-28T22:04:18.593288] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-28T22:04:19.011269] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-28T22:04:19.011348] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-28T22:04:19.012547] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-28T22:04:19.012610] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-28T22:04:19.013851] [DEBUG] [LOCAL ] YEXT: Trimmed 62703 records to 42599 (keeping 200 days of data) [2025-10-28T22:04:19.181101] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-28T22:04:19.258940] [DEBUG] [LOCAL ] YEXT: Primary data saved (42599 records). [2025-10-28T22:04:19.259077] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-28T22:04:19.259181] [INFO ] [MAIN ] Update Progress: 2345/2366 symbols completed. YEXT took 22.7s. Estimated remaining: 2m 43s. Rate: 7.7 symbols/min [2025-10-28T22:04:19.461259] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:19.474035] [DEBUG] [LOCAL ] YRD: Loaded 10814 existing records from primary storage. [2025-10-28T22:04:19.474251] [INFO ] [MAIN ] YRD: Loaded 10814 existing records. [2025-10-28T22:04:19.667250] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:19.667677] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-28T22:04:19.667828] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-28T22:04:19.668211] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-28T22:04:19.668412] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-28T22:04:19.981962] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-28T22:04:19.988439] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T22:04:20.078661] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:20.456531] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T22:04:20.780285] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-28T22:04:21.457334] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T22:04:21.580220] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-28T22:04:22.190880] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T22:04:22.380247] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-28T22:04:22.867485] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T22:04:23.180286] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-28T22:04:23.729487] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T22:04:23.980269] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-28T22:04:24.407255] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T22:04:24.780265] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-28T22:04:25.331300] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T22:04:25.580284] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-28T22:04:26.176113] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T22:04:26.238942] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T22:04:26.380288] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-28T22:04:27.180252] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-28T22:04:27.653262] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T22:04:27.664306] [INFO ] [REMOTE ] YMM: Full fetch complete (76472 records). [2025-10-28T22:04:27.664427] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-28T22:04:27.983065] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-28T22:04:28.083487] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-28T22:04:28.083565] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-28T22:04:28.084893] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-28T22:04:28.084956] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-28T22:04:28.086447] [DEBUG] [LOCAL ] YMM: Trimmed 76472 records to 52564 (keeping 200 days of data) [2025-10-28T22:04:28.400451] [DEBUG] [LOCAL ] YMM: Primary data saved (52564 records). [2025-10-28T22:04:28.400578] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-28T22:04:28.401207] [INFO ] [MAIN ] Update Progress: 2346/2366 symbols completed. YMM took 20.8s. Estimated remaining: 2m 36s. Rate: 7.7 symbols/min [2025-10-28T22:04:28.569967] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:28.595932] [DEBUG] [LOCAL ] YSG: Loaded 25638 existing records from primary storage. [2025-10-28T22:04:28.596244] [INFO ] [MAIN ] YSG: Loaded 25638 existing records. [2025-10-28T22:04:28.778083] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:28.778481] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-28T22:04:28.778622] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-28T22:04:28.779041] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-28T22:04:28.779100] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-28T22:04:28.809695] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-28T22:04:29.060461] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-28T22:04:29.181327] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:29.547858] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T22:04:29.585792] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-28T22:04:29.590716] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T22:04:30.380244] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-28T22:04:30.940686] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T22:04:31.080024] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T22:04:31.180221] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-28T22:04:31.980258] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-28T22:04:32.326073] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T22:04:32.506397] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T22:04:32.780293] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-28T22:04:33.580298] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-28T22:04:34.121373] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T22:04:34.387740] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-28T22:04:34.388887] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T22:04:35.180248] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-28T22:04:35.787184] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T22:04:35.849970] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T22:04:35.980242] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-28T22:04:36.780254] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-28T22:04:37.313510] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T22:04:37.580255] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-28T22:04:38.380272] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-28T22:04:38.418502] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T22:04:38.752603] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T22:04:38.920111] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T22:04:39.180269] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-28T22:04:39.980284] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-28T22:04:40.527024] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T22:04:40.737099] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T22:04:40.780259] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-28T22:04:41.450154] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T22:04:41.580259] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-28T22:04:42.330306] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T22:04:42.380253] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-28T22:04:43.180271] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-28T22:04:43.769395] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T22:04:43.980241] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-28T22:04:44.304751] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T22:04:44.780293] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-28T22:04:45.308796] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T22:04:45.319431] [INFO ] [REMOTE ] YOU: Full fetch complete (72289 records). [2025-10-28T22:04:45.319559] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-28T22:04:45.586143] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-28T22:04:45.720375] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-28T22:04:45.720463] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-28T22:04:45.721733] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-28T22:04:45.721796] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-28T22:04:45.723254] [DEBUG] [LOCAL ] YOU: Trimmed 72289 records to 49295 (keeping 200 days of data) [2025-10-28T22:04:46.021976] [DEBUG] [LOCAL ] YOU: Primary data saved (49295 records). [2025-10-28T22:04:46.022127] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-28T22:04:46.022518] [INFO ] [MAIN ] Update Progress: 2347/2366 symbols completed. YOU took 32.8s. Estimated remaining: 2m 28s. Rate: 7.7 symbols/min [2025-10-28T22:04:46.198789] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:46.256419] [DEBUG] [LOCAL ] YUM: Loaded 51032 existing records from primary storage. [2025-10-28T22:04:46.283732] [INFO ] [MAIN ] YUM: Loaded 51032 existing records. [2025-10-28T22:04:46.359355] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T22:04:46.381822] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-28T22:04:46.496924] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:46.497346] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-28T22:04:46.497411] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-28T22:04:46.498208] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-28T22:04:46.498268] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-28T22:04:46.872052] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T22:04:47.032680] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T22:04:47.136059] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:47.180371] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-28T22:04:47.940584] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T22:04:47.980282] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-28T22:04:48.521722] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T22:04:48.780275] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-28T22:04:49.580212] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-28T22:04:49.740913] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T22:04:50.118689] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T22:04:50.380255] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-28T22:04:51.180287] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-28T22:04:51.209797] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T22:04:51.716164] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T22:04:51.718924] [INFO ] [REMOTE ] YRD: Full fetch complete (18760 records). [2025-10-28T22:04:51.719049] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-28T22:04:51.985433] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-28T22:04:52.084845] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-28T22:04:52.084943] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-28T22:04:52.085331] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-28T22:04:52.085370] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-28T22:04:52.085931] [DEBUG] [LOCAL ] YRD: Trimmed 18760 records to 10806 (keeping 200 days of data) [2025-10-28T22:04:52.146723] [DEBUG] [LOCAL ] YRD: Primary data saved (10806 records). [2025-10-28T22:04:52.146846] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-28T22:04:52.146924] [INFO ] [MAIN ] Update Progress: 2348/2366 symbols completed. YRD took 32.9s. Estimated remaining: 2m 20s. Rate: 7.7 symbols/min [2025-10-28T22:04:52.312730] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:52.359560] [DEBUG] [LOCAL ] YUMC: Loaded 52547 existing records from primary storage. [2025-10-28T22:04:52.359912] [INFO ] [MAIN ] YUMC: Loaded 52547 existing records. [2025-10-28T22:04:52.536155] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:52.536365] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-28T22:04:52.536414] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-28T22:04:52.536982] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-28T22:04:52.537038] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-28T22:04:52.780578] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-28T22:04:52.892013] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:52.906901] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T22:04:52.912261] [INFO ] [REMOTE ] YSG: Full fetch complete (32731 records). [2025-10-28T22:04:52.912343] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-28T22:04:53.290065] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-28T22:04:53.290141] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-28T22:04:53.290889] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-28T22:04:53.290951] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-28T22:04:53.291724] [DEBUG] [LOCAL ] YSG: Trimmed 32731 records to 25659 (keeping 200 days of data) [2025-10-28T22:04:53.433281] [DEBUG] [LOCAL ] YSG: Primary data saved (25659 records). [2025-10-28T22:04:53.433439] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-28T22:04:53.433551] [INFO ] [MAIN ] Update Progress: 2349/2366 symbols completed. YSG took 25.0s. Estimated remaining: 2m 12s. Rate: 7.7 symbols/min [2025-10-28T22:04:53.585353] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-28T22:04:53.615445] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:53.670378] [DEBUG] [LOCAL ] ZBH: Loaded 50575 existing records from primary storage. [2025-10-28T22:04:53.670902] [INFO ] [MAIN ] ZBH: Loaded 50575 existing records. [2025-10-28T22:04:53.852530] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:53.852772] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-28T22:04:53.852820] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-28T22:04:53.853314] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-28T22:04:53.853370] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-28T22:04:54.234127] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:54.267866] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T22:04:54.279624] [INFO ] [REMOTE ] YPF: Full fetch complete (73886 records). [2025-10-28T22:04:54.279810] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-28T22:04:54.385338] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-28T22:04:54.685495] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-28T22:04:54.685571] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-28T22:04:54.686788] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-28T22:04:54.686849] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-28T22:04:54.688324] [DEBUG] [LOCAL ] YPF: Trimmed 73886 records to 50752 (keeping 200 days of data) [2025-10-28T22:04:54.998922] [DEBUG] [LOCAL ] YPF: Primary data saved (50752 records). [2025-10-28T22:04:54.999262] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-28T22:04:54.999410] [INFO ] [MAIN ] Update Progress: 2350/2366 symbols completed. YPF took 41.0s. Estimated remaining: 2m 5s. Rate: 7.7 symbols/min [2025-10-28T22:04:55.177922] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:04:55.188779] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-28T22:04:55.208716] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T22:04:55.234207] [DEBUG] [LOCAL ] ZEPP: Loaded 20120 existing records from primary storage. [2025-10-28T22:04:55.234451] [INFO ] [MAIN ] ZEPP: Loaded 20120 existing records. [2025-10-28T22:04:55.411287] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:04:55.411525] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-28T22:04:55.411572] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-28T22:04:55.411770] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-28T22:04:55.411826] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-28T22:04:55.760119] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:04:55.814345] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T22:04:55.980250] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-28T22:04:56.312508] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-28T22:04:56.524349] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T22:04:56.780258] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-28T22:04:57.170417] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T22:04:57.580260] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-28T22:04:58.380307] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-28T22:04:58.910404] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T22:04:59.180262] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-28T22:04:59.631136] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T22:04:59.793050] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T22:04:59.980258] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-28T22:05:00.409912] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T22:05:00.780258] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-28T22:05:01.580267] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-28T22:05:02.380256] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-28T22:05:02.481990] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T22:05:03.180244] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-28T22:05:03.980242] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-28T22:05:04.410907] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T22:05:04.780306] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-28T22:05:05.024434] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (3.44 seconds). [2025-10-28T22:05:05.163561] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T22:05:05.580279] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-28T22:05:06.380219] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-28T22:05:06.619601] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (4.24 seconds). [2025-10-28T22:05:07.067277] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T22:05:07.180203] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-28T22:05:07.412017] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T22:05:07.917472] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (4.74 seconds). [2025-10-28T22:05:07.980220] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-28T22:05:08.538590] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T22:05:08.780249] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-28T22:05:09.400808] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T22:05:09.580237] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-28T22:05:10.371818] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T22:05:10.381553] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-28T22:05:10.848774] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T22:05:11.180251] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-28T22:05:11.645738] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T22:05:11.980241] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-28T22:05:12.724788] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T22:05:12.780250] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-28T22:05:13.043481] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T22:05:13.580262] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-28T22:05:14.148734] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T22:05:14.380243] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-28T22:05:14.906874] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T22:05:15.180225] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-28T22:05:15.245026] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T22:05:15.250064] [INFO ] [REMOTE ] ZEPP: Full fetch complete (21857 records). [2025-10-28T22:05:15.250168] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-28T22:05:15.625054] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-28T22:05:15.625144] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-28T22:05:15.625659] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-28T22:05:15.625724] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-28T22:05:15.626338] [DEBUG] [LOCAL ] ZEPP: Trimmed 21857 records to 20203 (keeping 200 days of data) [2025-10-28T22:05:15.738820] [DEBUG] [LOCAL ] ZEPP: Primary data saved (20203 records). [2025-10-28T22:05:15.738946] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-28T22:05:15.739020] [INFO ] [MAIN ] Update Progress: 2351/2366 symbols completed. ZEPP took 20.7s. Estimated remaining: 1m 57s. Rate: 7.7 symbols/min [2025-10-28T22:05:15.906221] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:05:15.957393] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-28T22:05:15.957732] [INFO ] [MAIN ] ZETA: Loaded 53618 existing records. [2025-10-28T22:05:15.988363] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-28T22:05:16.144691] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:05:16.144949] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-28T22:05:16.145004] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-28T22:05:16.145597] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-28T22:05:16.145697] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-28T22:05:16.502399] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:05:16.542555] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T22:05:16.780294] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-28T22:05:17.236162] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T22:05:17.580260] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-28T22:05:18.389433] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-28T22:05:18.408602] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T22:05:19.013882] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T22:05:19.180296] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-28T22:05:19.743126] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T22:05:19.980250] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-28T22:05:20.780248] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-28T22:05:20.897616] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T22:05:21.542255] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T22:05:21.580243] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-28T22:05:22.380243] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-28T22:05:22.520630] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T22:05:23.181609] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T22:05:23.181746] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-28T22:05:23.787767] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T22:05:23.980232] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-28T22:05:24.785452] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-28T22:05:24.802209] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T22:05:25.478834] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T22:05:25.580241] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-28T22:05:26.031100] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T22:05:26.041392] [INFO ] [REMOTE ] YUM: Full fetch complete (74583 records). [2025-10-28T22:05:26.041529] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-28T22:05:26.395491] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-28T22:05:26.445949] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-28T22:05:26.446086] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-28T22:05:26.447442] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-28T22:05:26.447539] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-28T22:05:26.449940] [DEBUG] [LOCAL ] YUM: Trimmed 74583 records to 51007 (keeping 200 days of data) [2025-10-28T22:05:26.576586] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T22:05:26.812429] [DEBUG] [LOCAL ] YUM: Primary data saved (51007 records). [2025-10-28T22:05:26.812569] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-28T22:05:26.813030] [INFO ] [MAIN ] Update Progress: 2352/2366 symbols completed. YUM took 40.8s. Estimated remaining: 1m 49s. Rate: 7.7 symbols/min [2025-10-28T22:05:26.988112] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:05:27.027389] [DEBUG] [LOCAL ] ZGN: Loaded 40668 existing records from primary storage. [2025-10-28T22:05:27.027742] [INFO ] [MAIN ] ZGN: Loaded 40668 existing records. [2025-10-28T22:05:27.180721] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-28T22:05:27.209269] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:05:27.209511] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-28T22:05:27.209567] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-28T22:05:27.210173] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-28T22:05:27.210231] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-28T22:05:27.557817] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:05:27.980298] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-28T22:05:28.107773] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T22:05:28.780300] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-28T22:05:28.949973] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T22:05:29.151890] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T22:05:29.486998] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T22:05:29.496471] [INFO ] [REMOTE ] ZBH: Full fetch complete (73807 records). [2025-10-28T22:05:29.496598] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-28T22:05:29.585483] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-28T22:05:29.881373] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-28T22:05:29.881451] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-28T22:05:29.882686] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-28T22:05:29.882749] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-28T22:05:29.884166] [DEBUG] [LOCAL ] ZBH: Trimmed 73807 records to 50545 (keeping 200 days of data) [2025-10-28T22:05:30.192177] [DEBUG] [LOCAL ] ZBH: Primary data saved (50545 records). [2025-10-28T22:05:30.192321] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-28T22:05:30.192435] [INFO ] [MAIN ] Update Progress: 2353/2366 symbols completed. ZBH took 36.8s. Estimated remaining: 1m 41s. Rate: 7.7 symbols/min [2025-10-28T22:05:30.359626] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:05:30.380687] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-28T22:05:30.383006] [DEBUG] [LOCAL ] ZH: Loaded 24122 existing records from primary storage. [2025-10-28T22:05:30.383255] [INFO ] [MAIN ] ZH: Loaded 24122 existing records. [2025-10-28T22:05:30.565413] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:05:30.565798] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-28T22:05:30.565942] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-28T22:05:30.566474] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-28T22:05:30.566540] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-28T22:05:30.698314] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T22:05:30.949889] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:05:31.180257] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-28T22:05:31.787299] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T22:05:31.798764] [INFO ] [REMOTE ] YUMC: Full fetch complete (76429 records). [2025-10-28T22:05:31.798920] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-28T22:05:31.929507] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T22:05:31.980232] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-28T22:05:32.215000] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-28T22:05:32.215081] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-28T22:05:32.216284] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-28T22:05:32.216346] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-28T22:05:32.217770] [DEBUG] [LOCAL ] YUMC: Trimmed 76429 records to 52538 (keeping 200 days of data) [2025-10-28T22:05:32.548703] [DEBUG] [LOCAL ] YUMC: Primary data saved (52538 records). [2025-10-28T22:05:32.548838] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-28T22:05:32.548918] [INFO ] [MAIN ] Update Progress: 2354/2366 symbols completed. YUMC took 40.4s. Estimated remaining: 1m 33s. Rate: 7.7 symbols/min [2025-10-28T22:05:32.722992] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:05:32.773745] [DEBUG] [LOCAL ] ZIM: Loaded 53434 existing records from primary storage. [2025-10-28T22:05:32.774031] [INFO ] [MAIN ] ZIM: Loaded 53434 existing records. [2025-10-28T22:05:32.786676] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-28T22:05:32.963608] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:05:32.963823] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-28T22:05:32.963872] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-28T22:05:32.964392] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-28T22:05:32.964434] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-28T22:05:33.319827] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:05:33.580281] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-28T22:05:33.698902] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-28T22:05:33.806255] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T22:05:34.380303] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-28T22:05:35.185586] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-28T22:05:35.201507] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T22:05:35.492071] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T22:05:35.980251] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-28T22:05:36.438904] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T22:05:36.780288] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-28T22:05:37.277724] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T22:05:37.580256] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-28T22:05:38.380251] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-28T22:05:39.001173] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-28T22:05:39.042045] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T22:05:39.089329] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T22:05:39.180237] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-28T22:05:39.980236] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-28T22:05:40.634995] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T22:05:40.745889] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T22:05:40.780211] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-28T22:05:41.580223] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-28T22:05:41.772228] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T22:05:42.380243] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-28T22:05:43.180227] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-28T22:05:43.258992] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T22:05:43.944881] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-28T22:05:43.980240] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-28T22:05:44.780229] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-28T22:05:44.848525] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T22:05:45.061585] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-28T22:05:45.580250] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-28T22:05:45.791528] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T22:05:46.380338] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-28T22:05:47.180227] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-28T22:05:47.235705] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T22:05:47.716711] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-28T22:05:47.980304] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-28T22:05:48.640850] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T22:05:48.645044] [INFO ] [REMOTE ] ZH: Full fetch complete (39472 records). [2025-10-28T22:05:48.645141] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-28T22:05:48.793249] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-28T22:05:49.045083] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-28T22:05:49.045206] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-28T22:05:49.046301] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-28T22:05:49.046438] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-28T22:05:49.047812] [DEBUG] [LOCAL ] ZH: Trimmed 39472 records to 23903 (keeping 200 days of data) [2025-10-28T22:05:49.173394] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-28T22:05:49.227109] [DEBUG] [LOCAL ] ZH: Primary data saved (23903 records). [2025-10-28T22:05:49.227240] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-28T22:05:49.227349] [INFO ] [MAIN ] Update Progress: 2355/2366 symbols completed. ZH took 19.0s. Estimated remaining: 1m 26s. Rate: 7.7 symbols/min [2025-10-28T22:05:49.395341] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:05:49.432692] [DEBUG] [LOCAL ] ZIP: Loaded 43222 existing records from primary storage. [2025-10-28T22:05:49.432995] [INFO ] [MAIN ] ZIP: Loaded 43222 existing records. [2025-10-28T22:05:49.604453] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-28T22:05:49.610366] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:05:49.610576] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-28T22:05:49.611381] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-28T22:05:49.611578] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-28T22:05:49.611621] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-28T22:05:49.971947] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:05:50.380296] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-28T22:05:50.682867] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T22:05:50.739058] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T22:05:50.749795] [INFO ] [REMOTE ] ZETA: Full fetch complete (77737 records). [2025-10-28T22:05:50.749924] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-28T22:05:51.138220] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-28T22:05:51.138294] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-28T22:05:51.139492] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-28T22:05:51.139553] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-28T22:05:51.140910] [DEBUG] [LOCAL ] ZETA: Trimmed 77737 records to 53618 (keeping 200 days of data) [2025-10-28T22:05:51.188784] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-28T22:05:51.459123] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T22:05:51.481441] [DEBUG] [LOCAL ] ZETA: Primary data saved (53618 records). [2025-10-28T22:05:51.481549] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-28T22:05:51.481627] [INFO ] [MAIN ] Update Progress: 2356/2366 symbols completed. ZETA took 35.7s. Estimated remaining: 1m 18s. Rate: 7.7 symbols/min [2025-10-28T22:05:51.647397] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:05:51.682572] [DEBUG] [LOCAL ] ZK: Loaded 38664 existing records from primary storage. [2025-10-28T22:05:51.682876] [INFO ] [MAIN ] ZK: Loaded 38664 existing records. [2025-10-28T22:05:51.865756] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:05:51.865999] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-28T22:05:51.866054] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-28T22:05:51.866433] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-28T22:05:51.866491] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-28T22:05:51.985432] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-28T22:05:52.239977] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:05:52.780231] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-28T22:05:52.958158] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T22:05:53.112343] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-28T22:05:53.580266] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-28T22:05:53.732030] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T22:05:54.380297] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-28T22:05:55.105535] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T22:05:55.180256] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-28T22:05:55.980233] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-28T22:05:56.225586] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-28T22:05:56.444498] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T22:05:56.780250] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-28T22:05:56.844020] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T22:05:57.580277] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-28T22:05:58.380250] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-28T22:05:58.952031] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T22:05:59.180230] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-28T22:05:59.394093] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-28T22:05:59.600605] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T22:05:59.980412] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-28T22:06:00.351962] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T22:06:00.780328] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-28T22:06:01.580229] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-28T22:06:01.621724] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T22:06:02.060046] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T22:06:02.380249] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-28T22:06:03.192409] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-28T22:06:03.200783] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T22:06:03.543193] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T22:06:03.980237] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-28T22:06:04.125793] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T22:06:04.780227] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-28T22:06:04.995377] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T22:06:05.580276] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-28T22:06:06.246449] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T22:06:06.380240] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-28T22:06:07.180328] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-28T22:06:07.452308] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T22:06:07.491032] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T22:06:07.489908] [INFO ] [REMOTE ] ZIM: Full fetch complete (77556 records). [2025-10-28T22:06:07.498274] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-28T22:06:07.929918] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-28T22:06:07.930246] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-28T22:06:07.931508] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-28T22:06:07.931732] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-28T22:06:07.933298] [DEBUG] [LOCAL ] ZIM: Trimmed 77556 records to 53434 (keeping 200 days of data) [2025-10-28T22:06:07.987099] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-28T22:06:08.259781] [DEBUG] [LOCAL ] ZIM: Primary data saved (53434 records). [2025-10-28T22:06:08.259976] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-28T22:06:08.260094] [INFO ] [MAIN ] Update Progress: 2357/2366 symbols completed. ZIM took 35.7s. Estimated remaining: 1m 10s. Rate: 7.7 symbols/min [2025-10-28T22:06:08.285793] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T22:06:08.295255] [INFO ] [REMOTE ] ZGN: Full fetch complete (58722 records). [2025-10-28T22:06:08.295385] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-28T22:06:08.685590] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-28T22:06:08.685704] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-28T22:06:08.686885] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-28T22:06:08.686947] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-28T22:06:08.688193] [DEBUG] [LOCAL ] ZGN: Trimmed 58722 records to 40510 (keeping 200 days of data) [2025-10-28T22:06:08.782119] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-28T22:06:08.923467] [DEBUG] [LOCAL ] ZGN: Primary data saved (40510 records). [2025-10-28T22:06:08.923584] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-28T22:06:08.924056] [INFO ] [MAIN ] Update Progress: 2358/2366 symbols completed. ZGN took 42.1s. Estimated remaining: 1m 2s. Rate: 7.7 symbols/min [2025-10-28T22:06:09.533596] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T22:06:09.580244] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-28T22:06:09.761973] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T22:06:10.380263] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-28T22:06:10.614155] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T22:06:11.180356] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-28T22:06:11.451089] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T22:06:11.980297] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-28T22:06:12.200668] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T22:06:12.209301] [INFO ] [REMOTE ] ZIP: Full fetch complete (61001 records). [2025-10-28T22:06:12.209433] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-28T22:06:12.594137] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-28T22:06:12.594221] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-28T22:06:12.595339] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-28T22:06:12.595401] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-28T22:06:12.596752] [DEBUG] [LOCAL ] ZIP: Trimmed 61001 records to 43145 (keeping 200 days of data) [2025-10-28T22:06:12.833200] [DEBUG] [LOCAL ] ZIP: Primary data saved (43145 records). [2025-10-28T22:06:12.833329] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-28T22:06:12.833407] [INFO ] [MAIN ] Update Progress: 2359/2366 symbols completed. ZIP took 23.6s. Estimated remaining: 54.5s. Rate: 7.7 symbols/min [2025-10-28T22:06:13.050407] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T22:06:13.059683] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-28T22:06:14.099287] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T22:06:14.107106] [INFO ] [REMOTE ] ZK: Full fetch complete (57022 records). [2025-10-28T22:06:14.107240] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-28T22:06:14.516342] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-28T22:06:14.516420] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-28T22:06:14.517988] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-28T22:06:14.518049] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-28T22:06:14.519232] [DEBUG] [LOCAL ] ZK: Trimmed 57022 records to 38439 (keeping 200 days of data) [2025-10-28T22:06:14.735124] [DEBUG] [LOCAL ] ZK: Primary data saved (38439 records). [2025-10-28T22:06:14.735257] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-28T22:06:14.735333] [INFO ] [MAIN ] Update Progress: 2360/2366 symbols completed. ZK took 23.3s. Estimated remaining: 46.7s. Rate: 7.7 symbols/min [2025-10-28T22:06:15.366031] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:06:15.371497] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:06:15.391593] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:06:15.470846] [DEBUG] [LOCAL ] ZKH: Loaded 7200 existing records from primary storage. [2025-10-28T22:06:15.475461] [INFO ] [MAIN ] ZKH: Loaded 7200 existing records. [2025-10-28T22:06:15.479594] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:06:15.571249] [DEBUG] [LOCAL ] ZTR: Loaded 16304 existing records from primary storage. [2025-10-28T22:06:15.592804] [INFO ] [MAIN ] ZTR: Loaded 16304 existing records. [2025-10-28T22:06:15.808234] [DEBUG] [LOCAL ] ZTO: Loaded 48934 existing records from primary storage. [2025-10-28T22:06:15.820673] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:06:15.825785] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-28T22:06:15.826252] [INFO ] [MAIN ] ZTO: Loaded 48934 existing records. [2025-10-28T22:06:15.881265] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-28T22:06:15.945978] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-28T22:06:16.016495] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-28T22:06:16.016313] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:06:16.044370] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-28T22:06:16.090119] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-28T22:06:16.130684] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-28T22:06:16.185751] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-28T22:06:16.203294] [DEBUG] [LOCAL ] ZTS: Loaded 53087 existing records from primary storage. [2025-10-28T22:06:16.234357] [INFO ] [MAIN ] ZTS: Loaded 53087 existing records. [2025-10-28T22:06:16.237793] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:06:16.400694] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-28T22:06:16.547927] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-28T22:06:16.589960] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-28T22:06:16.623711] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-28T22:06:16.892200] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:06:17.035586] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-28T22:06:17.073701] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-28T22:06:17.052870] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:06:17.116637] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-28T22:06:17.117003] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-28T22:06:17.117185] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-28T22:06:17.445682] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:06:17.477137] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-28T22:06:17.728792] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T22:06:17.761520] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:06:17.772094] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-28T22:06:17.776146] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-28T22:06:17.858230] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:06:17.858509] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-28T22:06:18.333625] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T22:06:18.336756] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-28T22:06:18.370053] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T22:06:18.380202] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-28T22:06:18.855985] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T22:06:19.101494] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T22:06:19.126861] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T22:06:19.180215] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-28T22:06:19.229967] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T22:06:19.980251] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-28T22:06:20.464252] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T22:06:20.550558] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T22:06:20.780270] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-28T22:06:21.168503] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T22:06:21.580306] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-28T22:06:22.275951] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T22:06:22.380291] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-28T22:06:23.180275] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-28T22:06:23.703568] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T22:06:23.833412] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T22:06:23.980227] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-28T22:06:24.780239] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-28T22:06:25.279443] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T22:06:25.297416] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T22:06:25.580296] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-28T22:06:26.331801] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T22:06:26.380343] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-28T22:06:26.769909] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T22:06:27.180287] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-28T22:06:27.980254] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-28T22:06:28.780329] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-28T22:06:28.874262] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T22:06:29.069910] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T22:06:29.580306] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-28T22:06:30.284427] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T22:06:30.380252] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-28T22:06:30.832854] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T22:06:31.180248] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-28T22:06:31.780113] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T22:06:31.903869] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T22:06:31.980224] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-28T22:06:32.450242] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T22:06:32.780295] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-28T22:06:33.525669] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T22:06:33.580280] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-28T22:06:34.210521] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T22:06:34.380264] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-28T22:06:35.180256] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-28T22:06:35.683435] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T22:06:35.919519] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T22:06:35.925159] [INFO ] [REMOTE ] ZTR: Full fetch complete (26938 records). [2025-10-28T22:06:35.925248] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-28T22:06:35.985451] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-28T22:06:36.309069] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-28T22:06:36.309142] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-28T22:06:36.309698] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-28T22:06:36.309759] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-28T22:06:36.310355] [DEBUG] [LOCAL ] ZTR: Trimmed 26938 records to 16249 (keeping 200 days of data) [2025-10-28T22:06:36.405147] [DEBUG] [LOCAL ] ZTR: Primary data saved (16249 records). [2025-10-28T22:06:36.405295] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-28T22:06:36.405385] [INFO ] [MAIN ] Update Progress: 2361/2366 symbols completed. ZTR took 21.7s. Estimated remaining: 39.0s. Rate: 7.7 symbols/min [2025-10-28T22:06:36.572435] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:06:36.605103] [DEBUG] [LOCAL ] ZVIA: Loaded 35788 existing records from primary storage. [2025-10-28T22:06:36.605381] [INFO ] [MAIN ] ZVIA: Loaded 35788 existing records. [2025-10-28T22:06:36.783988] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-28T22:06:36.787935] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:06:36.788177] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-28T22:06:36.788977] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-28T22:06:36.789179] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-28T22:06:36.789221] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-28T22:06:37.151914] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:06:37.580293] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-28T22:06:37.651438] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T22:06:38.380217] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-28T22:06:38.667178] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-28T22:06:38.789415] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T22:06:39.180251] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-28T22:06:39.980242] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-28T22:06:40.076348] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T22:06:40.582747] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T22:06:40.635422] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T22:06:40.780211] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-28T22:06:41.580274] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-28T22:06:41.927690] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T22:06:41.936838] [INFO ] [REMOTE ] ZTO: Full fetch complete (72433 records). [2025-10-28T22:06:41.936959] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-28T22:06:42.312373] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-28T22:06:42.312452] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-28T22:06:42.313594] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-28T22:06:42.313682] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-28T22:06:42.315058] [DEBUG] [LOCAL ] ZTO: Trimmed 72433 records to 48890 (keeping 200 days of data) [2025-10-28T22:06:42.400423] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-28T22:06:42.613465] [DEBUG] [LOCAL ] ZTO: Primary data saved (48890 records). [2025-10-28T22:06:42.613601] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-28T22:06:42.613705] [INFO ] [MAIN ] Update Progress: 2362/2366 symbols completed. ZTO took 27.9s. Estimated remaining: 31.2s. Rate: 7.7 symbols/min [2025-10-28T22:06:42.784519] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T22:06:42.822164] [DEBUG] [LOCAL ] ZWS: Loaded 41904 existing records from primary storage. [2025-10-28T22:06:42.822436] [INFO ] [MAIN ] ZWS: Loaded 41904 existing records. [2025-10-28T22:06:43.002408] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T22:06:43.002777] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-28T22:06:43.002893] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-28T22:06:43.003342] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-28T22:06:43.003479] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-28T22:06:43.184548] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-28T22:06:43.405840] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T22:06:43.407897] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-28T22:06:43.438149] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T22:06:43.665375] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T22:06:43.666799] [INFO ] [REMOTE ] ZKH: Full fetch complete (11747 records). [2025-10-28T22:06:43.666868] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-28T22:06:43.985446] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-28T22:06:44.045171] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-28T22:06:44.045256] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-28T22:06:44.045560] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-28T22:06:44.045600] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-28T22:06:44.046127] [DEBUG] [LOCAL ] ZKH: Trimmed 11747 records to 7202 (keeping 200 days of data) [2025-10-28T22:06:44.088488] [DEBUG] [LOCAL ] ZKH: Primary data saved (7202 records). [2025-10-28T22:06:44.088689] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-28T22:06:44.088816] [INFO ] [MAIN ] Update Progress: 2363/2366 symbols completed. ZKH took 29.4s. Estimated remaining: 23.4s. Rate: 7.7 symbols/min [2025-10-28T22:06:44.780307] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-28T22:06:45.581192] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-28T22:06:45.586471] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T22:06:45.864532] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T22:06:46.380256] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-28T22:06:46.891250] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T22:06:47.180272] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-28T22:06:47.355776] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T22:06:47.980260] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-28T22:06:48.780034] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T22:06:48.780259] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-28T22:06:49.125011] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T22:06:49.580252] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-28T22:06:49.925619] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T22:06:50.380300] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-28T22:06:50.625999] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T22:06:51.180250] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-28T22:06:51.592366] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T22:06:51.980242] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-28T22:06:52.141882] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T22:06:52.780267] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-28T22:06:53.362739] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T22:06:53.580245] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-28T22:06:54.181422] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T22:06:54.380258] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-28T22:06:54.650160] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T22:06:55.180221] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-28T22:06:55.394796] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T22:06:55.980271] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-28T22:06:56.167333] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T22:06:56.780216] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-28T22:06:56.946776] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T22:06:57.580261] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-28T22:06:57.792271] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T22:06:58.380250] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-28T22:06:58.863131] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T22:06:58.870823] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52387 records). [2025-10-28T22:06:58.870964] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-28T22:06:59.191302] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-28T22:06:59.246568] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-28T22:06:59.246685] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-28T22:06:59.247832] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-28T22:06:59.247896] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-28T22:06:59.249074] [DEBUG] [LOCAL ] ZVIA: Trimmed 52387 records to 35817 (keeping 200 days of data) [2025-10-28T22:06:59.447510] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35817 records). [2025-10-28T22:06:59.447667] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-28T22:06:59.447765] [INFO ] [MAIN ] Update Progress: 2364/2366 symbols completed. ZVIA took 23.0s. Estimated remaining: 15.6s. Rate: 7.7 symbols/min [2025-10-28T22:06:59.611440] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T22:06:59.655232] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T22:06:59.665750] [INFO ] [REMOTE ] ZTS: Full fetch complete (76849 records). [2025-10-28T22:06:59.665872] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-28T22:06:59.985496] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-28T22:07:00.053695] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-28T22:07:00.053773] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-28T22:07:00.054952] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-28T22:07:00.055013] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-28T22:07:00.056450] [DEBUG] [LOCAL ] ZTS: Trimmed 76849 records to 53082 (keeping 200 days of data) [2025-10-28T22:07:00.370828] [DEBUG] [LOCAL ] ZTS: Primary data saved (53082 records). [2025-10-28T22:07:00.370951] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-28T22:07:00.371391] [INFO ] [MAIN ] Update Progress: 2365/2366 symbols completed. ZTS took 45.6s. Estimated remaining: 7.8s. Rate: 7.7 symbols/min [2025-10-28T22:07:01.555584] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T22:07:01.565097] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-28T22:07:02.755587] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T22:07:02.764586] [INFO ] [REMOTE ] ZWS: Full fetch complete (62029 records). [2025-10-28T22:07:02.764731] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-28T22:07:03.196363] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-28T22:07:03.196453] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-28T22:07:03.197929] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-28T22:07:03.198012] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-28T22:07:03.199352] [DEBUG] [LOCAL ] ZWS: Trimmed 62029 records to 41897 (keeping 200 days of data) [2025-10-28T22:07:03.468070] [DEBUG] [LOCAL ] ZWS: Primary data saved (41897 records). [2025-10-28T22:07:03.468219] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-28T22:07:03.468600] [INFO ] [MAIN ] Update Progress: 2366/2366 symbols completed. ZWS took 20.9s. Estimated remaining: 0.0s. Rate: 7.7 symbols/min [2025-10-28T22:07:03.469400] [INFO ] [MAIN ] Parallel update completed in 5h 7m 0s [2025-10-28T22:07:03.469480] [WARN ] [MAIN ] Failed symbols (320): AAM, AAUC, AA, AB, ABCB, ABG, ABM, ACA, ACI, ACM... [2025-10-28T22:07:03.469555] [INFO ] [MAIN ] Update success rate: 86.5% (2046/2366 symbols) [2025-10-28T22:07:08.676881] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2046/2366 @ 86.48%)' [2025-10-28T22:07:08.677310] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-28T22:07:08.677377] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-28T22:07:08.677413] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-28T22:07:08.677501] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-28T22:07:08.677537] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-28T22:07:10.231888] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-28T22:07:10.232018] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-28T22:07:10.232212] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-28T22:07:10.234043] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-28T22:07:10.234165] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-28T22:07:10.234204] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-28T22:07:10.234291] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-28T22:07:10.234355] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-28T22:07:10.234391] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-28T22:07:10.234772] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-28T22:07:10.234823] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-28T22:07:10.234996] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-28T22:07:10.235030] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-28T22:07:10.235061] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-28T22:07:10.235093] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-28T22:07:10.261202] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-28T22:07:10.283754] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-28T22:07:10.283934] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-28T22:07:10.283972] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-28T22:07:10.284002] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-28T22:07:10.284057] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-28T22:07:10.284089] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-28T22:07:10.284125] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-28T22:07:10.285934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-28T22:07:10.286176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-28T22:07:10.286349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-28T22:07:10.286535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-10-28T22:07:10.286711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-28T22:07:10.286807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-28T22:07:10.286891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-28T22:07:10.287022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-28T22:07:10.287134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-28T22:07:10.287243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-28T22:07:10.287338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-28T22:07:10.287440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-28T22:07:10.287546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-28T22:07:10.287663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-28T22:07:10.287761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-28T22:07:10.287830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-28T22:07:10.287896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-28T22:07:10.287961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-28T22:07:10.288022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-28T22:07:10.288087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-28T22:07:10.288152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-28T22:07:10.288228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-28T22:07:10.288294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-28T22:07:10.288356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-28T22:07:10.288455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-28T22:07:10.288575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-28T22:07:10.288690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-28T22:07:10.288790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-28T22:07:10.288877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-28T22:07:10.288993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-28T22:07:10.289080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-28T22:07:10.289174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-28T22:07:10.289240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-28T22:07:10.289323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-28T22:07:10.289407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-28T22:07:10.289471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-28T22:07:10.289537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-28T22:07:10.289600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-28T22:07:10.289689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-28T22:07:10.289799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-28T22:07:10.289888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-28T22:07:10.289977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-28T22:07:10.290064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-28T22:07:10.290139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-28T22:07:10.290205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-28T22:07:10.290269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-28T22:07:10.290345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-28T22:07:10.290423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-28T22:07:10.290514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-28T22:07:10.290596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-28T22:07:10.290725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-28T22:07:10.290812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-28T22:07:10.290877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-28T22:07:10.290938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-28T22:07:10.290999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-28T22:07:10.291060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-28T22:07:10.291140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-28T22:07:10.291254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-28T22:07:10.291348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-28T22:07:10.291438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-28T22:07:10.291528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-28T22:07:10.291632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-28T22:07:10.291767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-28T22:07:10.291852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-28T22:07:10.291920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-28T22:07:10.291999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-28T22:07:10.292092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-28T22:07:10.292159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-28T22:07:10.292222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-28T22:07:10.292626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-28T22:07:10.292747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-28T22:07:10.292816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-28T22:07:10.292880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-28T22:07:10.292960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-28T22:07:10.293049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-28T22:07:10.293128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-28T22:07:10.293228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-28T22:07:10.293316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-28T22:07:10.293381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-28T22:07:10.293442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-28T22:07:10.293503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-10-28T22:07:10.293562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-28T22:07:10.293639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-28T22:07:10.293753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-28T22:07:10.293825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-28T22:07:10.293887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-28T22:07:10.293946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-28T22:07:10.294019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-28T22:07:10.294108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-28T22:07:10.294181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-28T22:07:10.294263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-28T22:07:10.294348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-28T22:07:10.294410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-28T22:07:10.294473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-28T22:07:10.294532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-28T22:07:10.294590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-28T22:07:10.294687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-28T22:07:10.294774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-28T22:07:10.294837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-28T22:07:10.294897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-28T22:07:10.295005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-28T22:07:10.295095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-28T22:07:10.295181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-28T22:07:10.295247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-28T22:07:10.295312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-28T22:07:10.295375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-28T22:07:10.295435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-28T22:07:10.295497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-28T22:07:10.295560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-28T22:07:10.295626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-28T22:07:10.295768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-28T22:07:10.295848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-28T22:07:10.295948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-28T22:07:10.296038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-28T22:07:10.296118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-28T22:07:10.296207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-28T22:07:10.296276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-28T22:07:10.296337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-28T22:07:10.296402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-28T22:07:10.296466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-28T22:07:10.296532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-28T22:07:10.296600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-28T22:07:10.296706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-28T22:07:10.296791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-28T22:07:10.296858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-28T22:07:10.296920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-28T22:07:10.296982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-28T22:07:10.297060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-28T22:07:10.297150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-28T22:07:10.297217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-28T22:07:10.297282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-28T22:07:10.297347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-28T22:07:10.297412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-28T22:07:10.297482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-28T22:07:10.297547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-28T22:07:10.297609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-28T22:07:10.297749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-28T22:07:10.297840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-28T22:07:10.297907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-28T22:07:10.297970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-28T22:07:10.298032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-28T22:07:10.298092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-28T22:07:10.298154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-28T22:07:10.298213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-28T22:07:10.298273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-28T22:07:10.298334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-28T22:07:10.298394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-28T22:07:10.298455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-28T22:07:10.298517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-28T22:07:10.298576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-28T22:07:10.298636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-28T22:07:10.298766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-28T22:07:10.298835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-28T22:07:10.298899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-28T22:07:10.298959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-28T22:07:10.299044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-28T22:07:10.299156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-28T22:07:10.299245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-28T22:07:10.299310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-28T22:07:10.299420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-28T22:07:10.299516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-28T22:07:10.299583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-28T22:07:10.299670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-28T22:07:10.299761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-28T22:07:10.299827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-28T22:07:10.299892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-28T22:07:10.299954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-28T22:07:10.300016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-28T22:07:10.300101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-28T22:07:10.300166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-28T22:07:10.300227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-28T22:07:10.300343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-28T22:07:10.300415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-28T22:07:10.300482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-28T22:07:10.300543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-28T22:07:10.300606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-28T22:07:10.300702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-28T22:07:10.300789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-28T22:07:10.300873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-28T22:07:10.300976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-28T22:07:10.301062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-28T22:07:10.301125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-28T22:07:10.301185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-28T22:07:10.301245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-28T22:07:10.301307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-28T22:07:10.301368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-28T22:07:10.301426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-28T22:07:10.301487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-28T22:07:10.301547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-28T22:07:10.301606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-28T22:07:10.301692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-10-28T22:07:10.301803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-28T22:07:10.301908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-28T22:07:10.302003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-28T22:07:10.302089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-28T22:07:10.302155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-10-28T22:07:10.302235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-28T22:07:10.302322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-28T22:07:10.302385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-28T22:07:10.302461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-28T22:07:10.302525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-28T22:07:10.302587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-28T22:07:10.302690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-28T22:07:10.302788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-28T22:07:10.302861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-28T22:07:10.302928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-28T22:07:10.302993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-28T22:07:10.303070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-28T22:07:10.303159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-28T22:07:10.303227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-28T22:07:10.303295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-28T22:07:10.303363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-28T22:07:10.303425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-28T22:07:10.303489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-28T22:07:10.303555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-28T22:07:10.303634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-28T22:07:10.303824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-28T22:07:10.303894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-28T22:07:10.303964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-28T22:07:10.304029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-28T22:07:10.304096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-28T22:07:10.304157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-28T22:07:10.304243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-28T22:07:10.304340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-28T22:07:10.304409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-28T22:07:10.304479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-28T22:07:10.304542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-28T22:07:10.304605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-28T22:07:10.304841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-28T22:07:10.304937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-28T22:07:10.305012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-28T22:07:10.305080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-28T22:07:10.305150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-28T22:07:10.305220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-28T22:07:10.305284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-28T22:07:10.305363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-28T22:07:10.305467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-28T22:07:10.305560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-28T22:07:10.305624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-28T22:07:10.305729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-28T22:07:10.305804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-28T22:07:10.305870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-28T22:07:10.306013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-28T22:07:10.306109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-28T22:07:10.306179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-28T22:07:10.306248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-28T22:07:10.306314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-28T22:07:10.306378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-28T22:07:10.306445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-28T22:07:10.306512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-28T22:07:10.306581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-28T22:07:10.306683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-28T22:07:10.306792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-28T22:07:10.306900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-28T22:07:10.306985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-28T22:07:10.307056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-28T22:07:10.307121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-28T22:07:10.307190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-28T22:07:10.307255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-28T22:07:10.307324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-28T22:07:10.307390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-28T22:07:10.307455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-28T22:07:10.307517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-28T22:07:10.307582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-28T22:07:10.307672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-28T22:07:10.307770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-28T22:07:10.307838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-28T22:07:10.307904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-28T22:07:10.307968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-28T22:07:10.308031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-28T22:07:10.308095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-28T22:07:10.308155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-28T22:07:10.308215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-28T22:07:10.308277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-28T22:07:10.308361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-28T22:07:10.308458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-28T22:07:10.308546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-28T22:07:10.308671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-28T22:07:10.308765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-28T22:07:10.308833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-28T22:07:10.308897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-28T22:07:10.308961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-28T22:07:10.309022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-28T22:07:10.309088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-28T22:07:10.309149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-28T22:07:10.309210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-28T22:07:10.309268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-28T22:07:10.309332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-28T22:07:10.309397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-28T22:07:10.309458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-28T22:07:10.309518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-28T22:07:10.309577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-28T22:07:10.309662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-28T22:07:10.309759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-28T22:07:10.309825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-28T22:07:10.309889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-28T22:07:10.309952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-28T22:07:10.310035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-28T22:07:10.310123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-28T22:07:10.310188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-28T22:07:10.310252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-28T22:07:10.310314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-28T22:07:10.310378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-28T22:07:10.310444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-28T22:07:10.310505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-28T22:07:10.310567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-28T22:07:10.310628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-28T22:07:10.310749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-28T22:07:10.310823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-28T22:07:10.310890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-28T22:07:10.310954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-28T22:07:10.311016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-28T22:07:10.311076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-28T22:07:10.311193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-28T22:07:10.311268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-28T22:07:10.311335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-28T22:07:10.311400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-28T22:07:10.311466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-28T22:07:10.311532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-28T22:07:10.311596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-28T22:07:10.311759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-28T22:07:10.311848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-28T22:07:10.311944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-28T22:07:10.312049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-28T22:07:10.312126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-28T22:07:10.312191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-28T22:07:10.312254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-28T22:07:10.312317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-28T22:07:10.312381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-28T22:07:10.312443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-28T22:07:10.312509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-28T22:07:10.312572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-28T22:07:10.312814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-28T22:07:10.312911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-28T22:07:10.312979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-10-28T22:07:10.313043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-28T22:07:10.313104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-28T22:07:10.313165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-28T22:07:10.313229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-28T22:07:10.313293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-28T22:07:10.313354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-28T22:07:10.313416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-28T22:07:10.313476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-28T22:07:10.313535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-28T22:07:10.313594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-28T22:07:10.313691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-28T22:07:10.313779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-28T22:07:10.313847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-28T22:07:10.313915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-28T22:07:10.313976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-28T22:07:10.314036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-28T22:07:10.314104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-28T22:07:10.314167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-28T22:07:10.314228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-28T22:07:10.314286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-28T22:07:10.314344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-28T22:07:10.314404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-28T22:07:10.314466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-28T22:07:10.314528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-28T22:07:10.314588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-28T22:07:10.314849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-28T22:07:10.314959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-28T22:07:10.315045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-28T22:07:10.315109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-28T22:07:10.315170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-28T22:07:10.315236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-28T22:07:10.315345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-28T22:07:10.315422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-28T22:07:10.315484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-28T22:07:10.315546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-28T22:07:10.315613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-28T22:07:10.315710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-28T22:07:10.315793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-28T22:07:10.315858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-28T22:07:10.315942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-28T22:07:10.316029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-28T22:07:10.316093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-28T22:07:10.316158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-28T22:07:10.316218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-28T22:07:10.316278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-28T22:07:10.316338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-28T22:07:10.316400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-28T22:07:10.316460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-28T22:07:10.316520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-28T22:07:10.316631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-28T22:07:10.316748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-28T22:07:10.316818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-28T22:07:10.316881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-28T22:07:10.316942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-28T22:07:10.317003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-28T22:07:10.317086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-28T22:07:10.317178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-28T22:07:10.317242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-28T22:07:10.317305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-28T22:07:10.317365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-28T22:07:10.317444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-10-28T22:07:10.317531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-28T22:07:10.317598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-28T22:07:10.317697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-28T22:07:10.317788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-28T22:07:10.317854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-28T22:07:10.317922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-28T22:07:10.317987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-28T22:07:10.318047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-28T22:07:10.318111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-28T22:07:10.318177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-28T22:07:10.318239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-28T22:07:10.318305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-28T22:07:10.318365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-28T22:07:10.318429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-28T22:07:10.318490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-28T22:07:10.318550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-28T22:07:10.318614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-28T22:07:10.318868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-28T22:07:10.318954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-28T22:07:10.319020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-28T22:07:10.319085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-28T22:07:10.319149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-28T22:07:10.319215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-28T22:07:10.319280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-10-28T22:07:10.319345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-28T22:07:10.319406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-28T22:07:10.319473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-28T22:07:10.319538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-28T22:07:10.319634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-28T22:07:10.319748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-28T22:07:10.319819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-28T22:07:10.319884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-28T22:07:10.319953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-28T22:07:10.320017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-28T22:07:10.320081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-28T22:07:10.320144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-28T22:07:10.320207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-28T22:07:10.320270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-28T22:07:10.320332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-28T22:07:10.320409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-28T22:07:10.320517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-28T22:07:10.320607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-28T22:07:10.320738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-28T22:07:10.320822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-28T22:07:10.320890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-28T22:07:10.320954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-28T22:07:10.321017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-28T22:07:10.321081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-28T22:07:10.321145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-28T22:07:10.321208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-28T22:07:10.321270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-28T22:07:10.321333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-28T22:07:10.321394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-28T22:07:10.321457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-28T22:07:10.321518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-28T22:07:10.321615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-28T22:07:10.321726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-28T22:07:10.321805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-28T22:07:10.321870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-28T22:07:10.321980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-28T22:07:10.322075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-28T22:07:10.322182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-28T22:07:10.322256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-28T22:07:10.322325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-28T22:07:10.322391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-28T22:07:10.322454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-28T22:07:10.322517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-28T22:07:10.322580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-28T22:07:10.322730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-28T22:07:10.322826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-28T22:07:10.322898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-28T22:07:10.322965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-28T22:07:10.323028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-28T22:07:10.323090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-28T22:07:10.323151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-28T22:07:10.323212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-28T22:07:10.323274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-28T22:07:10.323337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-28T22:07:10.323404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-28T22:07:10.323469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-28T22:07:10.323533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-28T22:07:10.323596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-28T22:07:10.323686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-28T22:07:10.323773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-28T22:07:10.323839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-28T22:07:10.323900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-28T22:07:10.323961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-28T22:07:10.324042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-28T22:07:10.324126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-28T22:07:10.324192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-28T22:07:10.324254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-28T22:07:10.324317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-28T22:07:10.324379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-28T22:07:10.324441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-28T22:07:10.324501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-28T22:07:10.324561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-28T22:07:10.324720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-28T22:07:10.324811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-28T22:07:10.324874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-28T22:07:10.324936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-28T22:07:10.324996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-28T22:07:10.325057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-28T22:07:10.325116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-28T22:07:10.325176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-28T22:07:10.325234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-28T22:07:10.325294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-28T22:07:10.325364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-28T22:07:10.325492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-28T22:07:10.325586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-28T22:07:10.325677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-28T22:07:10.325766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-28T22:07:10.325830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-28T22:07:10.325891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-28T22:07:10.326007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-28T22:07:10.326077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-28T22:07:10.326137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-28T22:07:10.326198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-28T22:07:10.326257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-28T22:07:10.326319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-28T22:07:10.326379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-28T22:07:10.326442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-10-28T22:07:10.326554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-28T22:07:10.326636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-28T22:07:10.326751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-28T22:07:10.326817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-28T22:07:10.326884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-28T22:07:10.326950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-28T22:07:10.327012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-28T22:07:10.327075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-28T22:07:10.327136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-28T22:07:10.327261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-28T22:07:10.327351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-28T22:07:10.327418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-28T22:07:10.327485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-28T22:07:10.327548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-28T22:07:10.327610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-28T22:07:10.327708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-28T22:07:10.327796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-28T22:07:10.327886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-28T22:07:10.327978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-28T22:07:10.328051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-28T22:07:10.328119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-28T22:07:10.328204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-28T22:07:10.328296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-28T22:07:10.328365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-28T22:07:10.328429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-28T22:07:10.328500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-28T22:07:10.328562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-28T22:07:10.328628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-28T22:07:10.328754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-28T22:07:10.328831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-28T22:07:10.328897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-28T22:07:10.328962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-28T22:07:10.329024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-28T22:07:10.329089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-28T22:07:10.329153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-28T22:07:10.329219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-28T22:07:10.329282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-28T22:07:10.329343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-28T22:07:10.329405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-28T22:07:10.329467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-28T22:07:10.329527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-28T22:07:10.329590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-28T22:07:10.329688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-28T22:07:10.329778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-28T22:07:10.329845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-28T22:07:10.329909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-28T22:07:10.329970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-28T22:07:10.330032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-28T22:07:10.330090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-28T22:07:10.330152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-28T22:07:10.330214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-28T22:07:10.330275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-28T22:07:10.330338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-28T22:07:10.330399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-28T22:07:10.330461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-28T22:07:10.330520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-28T22:07:10.330579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-28T22:07:10.330674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-28T22:07:10.330767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-28T22:07:10.330832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-28T22:07:10.330895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-28T22:07:10.330957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-28T22:07:10.331017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-28T22:07:10.331078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-28T22:07:10.331147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-28T22:07:10.331210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-28T22:07:10.331270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-28T22:07:10.331331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-28T22:07:10.331393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-10-28T22:07:10.331455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-28T22:07:10.331516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-28T22:07:10.331577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-28T22:07:10.331639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-28T22:07:10.331757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-28T22:07:10.331824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-28T22:07:10.331887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-28T22:07:10.331950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-28T22:07:10.332013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-28T22:07:10.332076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-28T22:07:10.332140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-28T22:07:10.332272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-28T22:07:10.332347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-28T22:07:10.332428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-28T22:07:10.332518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-28T22:07:10.332584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-28T22:07:10.332705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-28T22:07:10.332797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-28T22:07:10.332862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-28T22:07:10.332925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-28T22:07:10.332987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-28T22:07:10.333048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-28T22:07:10.333111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-28T22:07:10.333172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-28T22:07:10.333234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-28T22:07:10.333294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-28T22:07:10.333355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-28T22:07:10.333417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-28T22:07:10.333477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-28T22:07:10.333539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-28T22:07:10.333601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-28T22:07:10.333702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-28T22:07:10.333809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-28T22:07:10.333901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-28T22:07:10.333967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-28T22:07:10.334029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-28T22:07:10.334088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-28T22:07:10.334177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-28T22:07:10.334292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-28T22:07:10.334391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-28T22:07:10.334463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-28T22:07:10.334525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-28T22:07:10.334591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-28T22:07:10.334771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-28T22:07:10.334861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-28T22:07:10.334922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-28T22:07:10.334983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-28T22:07:10.335044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-28T22:07:10.335104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-28T22:07:10.335166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-28T22:07:10.335227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-28T22:07:10.335292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-28T22:07:10.335356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-28T22:07:10.335422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-28T22:07:10.335486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-28T22:07:10.335547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-28T22:07:10.335611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-28T22:07:10.335708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-28T22:07:10.335793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-28T22:07:10.335862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-28T22:07:10.335962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-28T22:07:10.336050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-28T22:07:10.336118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-28T22:07:10.336178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAMI.csv [2025-10-28T22:07:10.336244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-28T22:07:10.336327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-28T22:07:10.336414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-28T22:07:10.336482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-28T22:07:10.336543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-28T22:07:10.336606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-28T22:07:10.336704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-28T22:07:10.336805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-28T22:07:10.336874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-28T22:07:10.336940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-28T22:07:10.337041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-28T22:07:10.337134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-28T22:07:10.337214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-28T22:07:10.337322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-28T22:07:10.337399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-28T22:07:10.337462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-28T22:07:10.337526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-28T22:07:10.337590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-28T22:07:10.337784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-28T22:07:10.337867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-28T22:07:10.337931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-28T22:07:10.337994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-28T22:07:10.338060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-28T22:07:10.338123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-10-28T22:07:10.338188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-28T22:07:10.338269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-28T22:07:10.338357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-28T22:07:10.338422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-28T22:07:10.338484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-28T22:07:10.338547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-28T22:07:10.338610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-28T22:07:10.338701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-28T22:07:10.338787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-28T22:07:10.338851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-28T22:07:10.338917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-28T22:07:10.338979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-28T22:07:10.339040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-28T22:07:10.339099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-28T22:07:10.339160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-28T22:07:10.339223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-28T22:07:10.339323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-28T22:07:10.339398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-28T22:07:10.339465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-28T22:07:10.339527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-28T22:07:10.339591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-28T22:07:10.339703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-28T22:07:10.339792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-28T22:07:10.339859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-28T22:07:10.339924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-28T22:07:10.339987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-28T22:07:10.340049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-28T22:07:10.340111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-28T22:07:10.340173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-28T22:07:10.340232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-28T22:07:10.340294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-28T22:07:10.340357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-28T22:07:10.340421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-28T22:07:10.340484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-28T22:07:10.340546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-28T22:07:10.340613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-28T22:07:10.340720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-28T22:07:10.340803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-28T22:07:10.340869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-28T22:07:10.340932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-28T22:07:10.340999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-28T22:07:10.341063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-28T22:07:10.341123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-28T22:07:10.341185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-28T22:07:10.341248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-28T22:07:10.341309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-28T22:07:10.341368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-28T22:07:10.341427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-28T22:07:10.341488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-28T22:07:10.341548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-28T22:07:10.341610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-28T22:07:10.341703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-28T22:07:10.341786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-28T22:07:10.341849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-28T22:07:10.341911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-28T22:07:10.341974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-28T22:07:10.342036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-28T22:07:10.342098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-28T22:07:10.342160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-28T22:07:10.342228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-28T22:07:10.342336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-28T22:07:10.342423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-28T22:07:10.342488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-28T22:07:10.342549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-28T22:07:10.342609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-28T22:07:10.342746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-28T22:07:10.342819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-28T22:07:10.342881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-28T22:07:10.342942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-28T22:07:10.343002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-28T22:07:10.343061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-28T22:07:10.343120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-28T22:07:10.343178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-28T22:07:10.343237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-28T22:07:10.343296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-28T22:07:10.343355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-28T22:07:10.343419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-28T22:07:10.343484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-28T22:07:10.343545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-28T22:07:10.343611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-28T22:07:10.343704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-28T22:07:10.343787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-28T22:07:10.343849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-28T22:07:10.343917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-28T22:07:10.343977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-28T22:07:10.344038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-28T22:07:10.344103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-28T22:07:10.344162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-28T22:07:10.344222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-28T22:07:10.344282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-28T22:07:10.344341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-28T22:07:10.344403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-28T22:07:10.344484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-28T22:07:10.344575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-28T22:07:10.344639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-28T22:07:10.344818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-28T22:07:10.344885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-28T22:07:10.344946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-28T22:07:10.345016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-28T22:07:10.345081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-28T22:07:10.345144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-28T22:07:10.345203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-28T22:07:10.345262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-28T22:07:10.345324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-28T22:07:10.345387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-28T22:07:10.345448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-28T22:07:10.345527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-28T22:07:10.345610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-28T22:07:10.345720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-28T22:07:10.345804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-28T22:07:10.345868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-28T22:07:10.345965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-28T22:07:10.346050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-28T22:07:10.346115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-28T22:07:10.346179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-28T22:07:10.346242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-28T22:07:10.346308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-28T22:07:10.346369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-28T22:07:10.346450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-28T22:07:10.346538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-28T22:07:10.346607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-28T22:07:10.346701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-28T22:07:10.346787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-28T22:07:10.346852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-28T22:07:10.346915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-28T22:07:10.346977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-28T22:07:10.347038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-28T22:07:10.347100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-28T22:07:10.347163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-28T22:07:10.347225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-28T22:07:10.347287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-28T22:07:10.347347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-28T22:07:10.347410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-28T22:07:10.347473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-28T22:07:10.347533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-28T22:07:10.347594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-28T22:07:10.347741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-28T22:07:10.347819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-28T22:07:10.347886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-28T22:07:10.347949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-28T22:07:10.348010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-28T22:07:10.348071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-28T22:07:10.348132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-28T22:07:10.348191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-28T22:07:10.348252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-28T22:07:10.348312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-28T22:07:10.348372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-28T22:07:10.348431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-28T22:07:10.348493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-28T22:07:10.348552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-28T22:07:10.348615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-28T22:07:10.348716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-28T22:07:10.348796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-28T22:07:10.348860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-28T22:07:10.348924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-28T22:07:10.348987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-28T22:07:10.349049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-28T22:07:10.349107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-28T22:07:10.349168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-28T22:07:10.349228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-28T22:07:10.349287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-28T22:07:10.349347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-28T22:07:10.349407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-28T22:07:10.349469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-28T22:07:10.349528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-28T22:07:10.349589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-28T22:07:10.349684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-28T22:07:10.349773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-28T22:07:10.349838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-28T22:07:10.349900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-28T22:07:10.349960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-28T22:07:10.350020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-28T22:07:10.350079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-28T22:07:10.350138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-28T22:07:10.350205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-28T22:07:10.350266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-28T22:07:10.350325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-28T22:07:10.350385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-28T22:07:10.350442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-28T22:07:10.350502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-28T22:07:10.350561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-28T22:07:10.350621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-28T22:07:10.350723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-28T22:07:10.350798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-28T22:07:10.350860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-28T22:07:10.350920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-28T22:07:10.350979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-28T22:07:10.351038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-28T22:07:10.351098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-28T22:07:10.351157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-28T22:07:10.351217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-28T22:07:10.351275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-28T22:07:10.351334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-28T22:07:10.351395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-28T22:07:10.351452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-28T22:07:10.351512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-28T22:07:10.351571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-28T22:07:10.351635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-28T22:07:10.351775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-28T22:07:10.351867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-28T22:07:10.351935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-28T22:07:10.351997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-28T22:07:10.352058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-28T22:07:10.352121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-28T22:07:10.352204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-28T22:07:10.352292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-28T22:07:10.352359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-28T22:07:10.352486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-28T22:07:10.352560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-28T22:07:10.352629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-28T22:07:10.352742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-28T22:07:10.352818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-28T22:07:10.352888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-28T22:07:10.352951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-28T22:07:10.353013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-28T22:07:10.353075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-28T22:07:10.353138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-28T22:07:10.353199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-28T22:07:10.353261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-28T22:07:10.353325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-28T22:07:10.353387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-28T22:07:10.353447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-28T22:07:10.353509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-28T22:07:10.353573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-28T22:07:10.353636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-28T22:07:10.353831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-28T22:07:10.353931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-28T22:07:10.353999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-28T22:07:10.354063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-28T22:07:10.354137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-28T22:07:10.354202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-28T22:07:10.354267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-28T22:07:10.354336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-28T22:07:10.354401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-28T22:07:10.354463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-28T22:07:10.354540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-28T22:07:10.354604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-28T22:07:10.354701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-28T22:07:10.354791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-28T22:07:10.354856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-28T22:07:10.354918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-28T22:07:10.354980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-28T22:07:10.355042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-28T22:07:10.355106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-28T22:07:10.355168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-28T22:07:10.355231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-28T22:07:10.355295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-28T22:07:10.355358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-28T22:07:10.355420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-28T22:07:10.355480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-28T22:07:10.355549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-28T22:07:10.355611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-28T22:07:10.355712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-28T22:07:10.355792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-28T22:07:10.355857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-28T22:07:10.355941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-28T22:07:10.356027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-28T22:07:10.356092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-28T22:07:10.356156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-28T22:07:10.356219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-28T22:07:10.356280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-28T22:07:10.356340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-28T22:07:10.356402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-28T22:07:10.356462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-28T22:07:10.356524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-28T22:07:10.356586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-28T22:07:10.356747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-28T22:07:10.356840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-28T22:07:10.356904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-28T22:07:10.356966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-28T22:07:10.357029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-28T22:07:10.357093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-28T22:07:10.357155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-28T22:07:10.357216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-28T22:07:10.357276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-28T22:07:10.357337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-28T22:07:10.357398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-28T22:07:10.357459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-28T22:07:10.357566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-28T22:07:10.357637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-28T22:07:10.357751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-28T22:07:10.357817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-28T22:07:10.357879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-28T22:07:10.357942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-28T22:07:10.358021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-28T22:07:10.358108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-28T22:07:10.358173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-28T22:07:10.358233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-28T22:07:10.358294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-28T22:07:10.358363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-28T22:07:10.358425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-28T22:07:10.358486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-28T22:07:10.358546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-28T22:07:10.358609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-28T22:07:10.358701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-28T22:07:10.358785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-28T22:07:10.358850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-28T22:07:10.358911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-28T22:07:10.358971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-28T22:07:10.359031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-28T22:07:10.359091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-28T22:07:10.359151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-28T22:07:10.359212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-28T22:07:10.359271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-28T22:07:10.359332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-28T22:07:10.359398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-28T22:07:10.359461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-28T22:07:10.359524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-28T22:07:10.359583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-28T22:07:10.359691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-28T22:07:10.359788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-28T22:07:10.359857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-28T22:07:10.359919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-28T22:07:10.359981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-28T22:07:10.360041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-28T22:07:10.360101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-28T22:07:10.360165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-28T22:07:10.360231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-28T22:07:10.360290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-28T22:07:10.360350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-28T22:07:10.360412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-28T22:07:10.360482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-28T22:07:10.360543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-28T22:07:10.360604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-28T22:07:10.360823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-28T22:07:10.360916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-28T22:07:10.360983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-28T22:07:10.361054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-28T22:07:10.361119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-28T22:07:10.361180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-28T22:07:10.361242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-28T22:07:10.361302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-28T22:07:10.361361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-28T22:07:10.361423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-28T22:07:10.361484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-28T22:07:10.361544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-28T22:07:10.361604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-28T22:07:10.361693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-28T22:07:10.361780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-28T22:07:10.361845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-28T22:07:10.361906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-28T22:07:10.361986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-28T22:07:10.362072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-28T22:07:10.362138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-28T22:07:10.362201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-28T22:07:10.362262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-28T22:07:10.362323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-28T22:07:10.362385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-28T22:07:10.362447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-28T22:07:10.362577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-28T22:07:10.362679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-28T22:07:10.362770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-28T22:07:10.362836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-28T22:07:10.362900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-28T22:07:10.362962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-28T22:07:10.363024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-10-28T22:07:10.363085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-28T22:07:10.363146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-28T22:07:10.363232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-28T22:07:10.363340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-28T22:07:10.363420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-28T22:07:10.363487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-28T22:07:10.363549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-28T22:07:10.363610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-28T22:07:10.363714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-28T22:07:10.363806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-28T22:07:10.363871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-28T22:07:10.363934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-28T22:07:10.363995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-28T22:07:10.364060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-28T22:07:10.364122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-28T22:07:10.364185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-28T22:07:10.364247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-28T22:07:10.364309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-28T22:07:10.364370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-28T22:07:10.364429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-28T22:07:10.364488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-28T22:07:10.364547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-28T22:07:10.364607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-28T22:07:10.364703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-28T22:07:10.364791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-28T22:07:10.364855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-28T22:07:10.364915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-28T22:07:10.364975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-28T22:07:10.365036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-28T22:07:10.365097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-28T22:07:10.365164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-28T22:07:10.365227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-28T22:07:10.365287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-28T22:07:10.365347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-28T22:07:10.365406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-28T22:07:10.365465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-28T22:07:10.365525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-28T22:07:10.365589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-28T22:07:10.365674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-28T22:07:10.365777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-28T22:07:10.365879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-28T22:07:10.365999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-28T22:07:10.366078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-28T22:07:10.366140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-28T22:07:10.366200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-28T22:07:10.366289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-28T22:07:10.366389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-28T22:07:10.366467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-28T22:07:10.366529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-28T22:07:10.366591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-28T22:07:10.366679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-28T22:07:10.366768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-28T22:07:10.366831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-28T22:07:10.366891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-28T22:07:10.366952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-28T22:07:10.367010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-28T22:07:10.367069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-28T22:07:10.367129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-28T22:07:10.367188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-28T22:07:10.367248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-28T22:07:10.367308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-10-28T22:07:10.367368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-28T22:07:10.367427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-28T22:07:10.367486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-28T22:07:10.367596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-28T22:07:10.367701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-28T22:07:10.367791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-28T22:07:10.367859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-28T22:07:10.367921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-28T22:07:10.367983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-28T22:07:10.368048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-28T22:07:10.368116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-28T22:07:10.368178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-28T22:07:10.368241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-28T22:07:10.368308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-28T22:07:10.368371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-28T22:07:10.368432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-28T22:07:10.368494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-28T22:07:10.368556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-28T22:07:10.368618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-28T22:07:10.368775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-28T22:07:10.368856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-28T22:07:10.368925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-28T22:07:10.368987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-28T22:07:10.369051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-28T22:07:10.369113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-28T22:07:10.369183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-28T22:07:10.369248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-28T22:07:10.369310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-28T22:07:10.369372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-28T22:07:10.369431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-28T22:07:10.369494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-28T22:07:10.369556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-28T22:07:10.369619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-28T22:07:10.369727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-28T22:07:10.369807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-28T22:07:10.369874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-28T22:07:10.369937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-28T22:07:10.370000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-28T22:07:10.370063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-28T22:07:10.370122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-28T22:07:10.370182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-28T22:07:10.370244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-28T22:07:10.370304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-28T22:07:10.370366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-28T22:07:10.370426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-28T22:07:10.370486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-28T22:07:10.370549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-28T22:07:10.370610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-28T22:07:10.370702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-28T22:07:10.370791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-28T22:07:10.370857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-28T22:07:10.370918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-28T22:07:10.370979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-28T22:07:10.371038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-28T22:07:10.371100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-28T22:07:10.371160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-28T22:07:10.371222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-28T22:07:10.371284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-28T22:07:10.371345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-28T22:07:10.371405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-28T22:07:10.371466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-10-28T22:07:10.371527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-28T22:07:10.371587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-28T22:07:10.371696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-28T22:07:10.371785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-28T22:07:10.371848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-28T22:07:10.371911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-28T22:07:10.371974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-28T22:07:10.372033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-28T22:07:10.372094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-28T22:07:10.372154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-28T22:07:10.372213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-28T22:07:10.372274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-28T22:07:10.372331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-28T22:07:10.372439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-28T22:07:10.372509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-28T22:07:10.372595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-28T22:07:10.372722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-28T22:07:10.372805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-28T22:07:10.372871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-28T22:07:10.372935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-28T22:07:10.372998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-28T22:07:10.373061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-28T22:07:10.373124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-28T22:07:10.373187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-28T22:07:10.373249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-28T22:07:10.373311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-28T22:07:10.373373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-28T22:07:10.373435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-28T22:07:10.373498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-28T22:07:10.373560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-28T22:07:10.373623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-28T22:07:10.373728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-28T22:07:10.373805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-28T22:07:10.373873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-28T22:07:10.373938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-28T22:07:10.374000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-28T22:07:10.374063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-28T22:07:10.374125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-28T22:07:10.374187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-28T22:07:10.374248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-28T22:07:10.374317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-28T22:07:10.374380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-28T22:07:10.374441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-28T22:07:10.374512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-28T22:07:10.374574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-28T22:07:10.374636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-28T22:07:10.374755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-28T22:07:10.374825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-28T22:07:10.374887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-28T22:07:10.374948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-28T22:07:10.375007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-28T22:07:10.375070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-28T22:07:10.375129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-28T22:07:10.375189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-28T22:07:10.375247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-28T22:07:10.375306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-28T22:07:10.375365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-28T22:07:10.375426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-28T22:07:10.375486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-28T22:07:10.375546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-28T22:07:10.375611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-28T22:07:10.375706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-28T22:07:10.375787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-28T22:07:10.375853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-28T22:07:10.375941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-28T22:07:10.376027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-28T22:07:10.376095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-28T22:07:10.376161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-28T22:07:10.376225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-28T22:07:10.376287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-28T22:07:10.376347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-28T22:07:10.376410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-28T22:07:10.376469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-28T22:07:10.376537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-28T22:07:10.376757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-28T22:07:10.376853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-28T22:07:10.376920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-28T22:07:10.376982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-28T22:07:10.377052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-28T22:07:10.377118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-28T22:07:10.377180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-28T22:07:10.377240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-28T22:07:10.377304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-28T22:07:10.377367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-28T22:07:10.377475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-28T22:07:10.377549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-28T22:07:10.377615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-28T22:07:10.377717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-28T22:07:10.377802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-28T22:07:10.377876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-28T22:07:10.377944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-28T22:07:10.378007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-28T22:07:10.378069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-28T22:07:10.378128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-28T22:07:10.378187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-28T22:07:10.378250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-28T22:07:10.378313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-28T22:07:10.378375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-28T22:07:10.378438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-28T22:07:10.378503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-28T22:07:10.378564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-28T22:07:10.378633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-28T22:07:10.378744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-28T22:07:10.378819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-28T22:07:10.378886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-28T22:07:10.378950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-28T22:07:10.379013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-28T22:07:10.379076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-28T22:07:10.379139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-28T22:07:10.379204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-28T22:07:10.379264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-28T22:07:10.379326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-28T22:07:10.379390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-28T22:07:10.379454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-28T22:07:10.379516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-28T22:07:10.379579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-28T22:07:10.379685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-28T22:07:10.379778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-28T22:07:10.379844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-28T22:07:10.379908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-28T22:07:10.379971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-28T22:07:10.380031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-28T22:07:10.380094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-28T22:07:10.380158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-28T22:07:10.380223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-28T22:07:10.380285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-28T22:07:10.380346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-28T22:07:10.380409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-28T22:07:10.380469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-28T22:07:10.380531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-28T22:07:10.380600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-28T22:07:10.380818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-28T22:07:10.380928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-28T22:07:10.381014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-28T22:07:10.381079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-28T22:07:10.381142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-28T22:07:10.381204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-28T22:07:10.381267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-28T22:07:10.381331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-28T22:07:10.381393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-28T22:07:10.381452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-28T22:07:10.381512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-28T22:07:10.381571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-28T22:07:10.381634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-28T22:07:10.381746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-28T22:07:10.381816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-28T22:07:10.381885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-28T22:07:10.381948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-28T22:07:10.382011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-28T22:07:10.382071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-28T22:07:10.382130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-28T22:07:10.382190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-28T22:07:10.382251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-28T22:07:10.382308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-28T22:07:10.382366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-28T22:07:10.382479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-28T22:07:10.382549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-28T22:07:10.382612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-28T22:07:10.382727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-28T22:07:10.382817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-28T22:07:10.382882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-28T22:07:10.382945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-28T22:07:10.383008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-28T22:07:10.383069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-28T22:07:10.383129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-28T22:07:10.383188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-28T22:07:10.383251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-28T22:07:10.383311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-28T22:07:10.383373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-28T22:07:10.383432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-28T22:07:10.383492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-28T22:07:10.383554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-28T22:07:10.383615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-28T22:07:10.383731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-28T22:07:10.383811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-28T22:07:10.383875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-28T22:07:10.383936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-28T22:07:10.383997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-28T22:07:10.384058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-28T22:07:10.384118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-28T22:07:10.384179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-28T22:07:10.384239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-28T22:07:10.384298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-28T22:07:10.384358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-10-28T22:07:10.384417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-28T22:07:10.384479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-28T22:07:10.384537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-28T22:07:10.384598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-28T22:07:10.384823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-28T22:07:10.384914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-28T22:07:10.384977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-28T22:07:10.385041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-28T22:07:10.385104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-28T22:07:10.385175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-28T22:07:10.385243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-28T22:07:10.385306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-28T22:07:10.385367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-28T22:07:10.385430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-28T22:07:10.385491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-28T22:07:10.385549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-28T22:07:10.385610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-28T22:07:10.385710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-28T22:07:10.385794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-28T22:07:10.385860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-28T22:07:10.385949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-28T22:07:10.386033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-28T22:07:10.386097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-28T22:07:10.386157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-28T22:07:10.386220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-28T22:07:10.386279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-28T22:07:10.386370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-28T22:07:10.386433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-28T22:07:10.386495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-28T22:07:10.386556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-28T22:07:10.386616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-28T22:07:10.386714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-28T22:07:10.386796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-28T22:07:10.386861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-28T22:07:10.386923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-28T22:07:10.386987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-28T22:07:10.387053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-28T22:07:10.387116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-28T22:07:10.387177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-28T22:07:10.387240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-28T22:07:10.387297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-28T22:07:10.387358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-28T22:07:10.387466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-28T22:07:10.387544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-28T22:07:10.387616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-28T22:07:10.387718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-28T22:07:10.387799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-28T22:07:10.387871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-28T22:07:10.387936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-28T22:07:10.388001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-28T22:07:10.388062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-28T22:07:10.388123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-28T22:07:10.388183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-28T22:07:10.388243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-28T22:07:10.388305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-28T22:07:10.388369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-28T22:07:10.388483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-28T22:07:10.388569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-28T22:07:10.388635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-28T22:07:10.388749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-28T22:07:10.388819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-28T22:07:10.388883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-28T22:07:10.388947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-28T22:07:10.389007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-28T22:07:10.389069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-28T22:07:10.389129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-28T22:07:10.389189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-28T22:07:10.389251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-28T22:07:10.389316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-28T22:07:10.389380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-28T22:07:10.389442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-28T22:07:10.389503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-28T22:07:10.389565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-28T22:07:10.389625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-28T22:07:10.389731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-28T22:07:10.389803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-28T22:07:10.389865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-28T22:07:10.389927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-28T22:07:10.389990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-28T22:07:10.390052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-28T22:07:10.390115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-28T22:07:10.390177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-28T22:07:10.390239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-28T22:07:10.390300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-28T22:07:10.390362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-28T22:07:10.390430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-28T22:07:10.390491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-28T22:07:10.390552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-28T22:07:10.390619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-28T22:07:10.390719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-28T22:07:10.390797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-28T22:07:10.390860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-28T22:07:10.390921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-28T22:07:10.390982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-28T22:07:10.391043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-28T22:07:10.391103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-28T22:07:10.391166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-28T22:07:10.391230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-28T22:07:10.391335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-28T22:07:10.391409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-28T22:07:10.391471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-28T22:07:10.391530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-28T22:07:10.391589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-28T22:07:10.391691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-28T22:07:10.391784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-28T22:07:10.391851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-28T22:07:10.391921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-28T22:07:10.391984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-28T22:07:10.392042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-28T22:07:10.392103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-28T22:07:10.392166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-28T22:07:10.392228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-28T22:07:10.392289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-28T22:07:10.392400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-28T22:07:10.392470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-28T22:07:10.392535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-28T22:07:10.392601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-28T22:07:10.392773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-28T22:07:10.392884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-28T22:07:10.392957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-28T22:07:10.393018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-28T22:07:10.393077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-28T22:07:10.393136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-28T22:07:10.393206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-28T22:07:10.393277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-28T22:07:10.393339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-28T22:07:10.393402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-28T22:07:10.393462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-28T22:07:10.393523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-28T22:07:10.393590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-28T22:07:10.393679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-28T22:07:10.393783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-28T22:07:10.393872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-28T22:07:10.393939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-28T22:07:10.394000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-28T22:07:10.394062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-28T22:07:10.394122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-28T22:07:10.394184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-28T22:07:10.394243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-28T22:07:10.394302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-28T22:07:10.394364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-28T22:07:10.394423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-28T22:07:10.394484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-28T22:07:10.394545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-28T22:07:10.394609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-28T22:07:10.394711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-28T22:07:10.394794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-28T22:07:10.394857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-28T22:07:10.394917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-28T22:07:10.394979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-28T22:07:10.395039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-28T22:07:10.395100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-28T22:07:10.395160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-28T22:07:10.395219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-28T22:07:10.395277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-28T22:07:10.395357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-28T22:07:10.395441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-28T22:07:10.395504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-28T22:07:10.395564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-28T22:07:10.395623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-28T22:07:10.395727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-28T22:07:10.395800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-28T22:07:10.395870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-28T22:07:10.395991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-28T22:07:10.396071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-28T22:07:10.396135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-28T22:07:10.396197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-28T22:07:10.396259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-28T22:07:10.396318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-28T22:07:10.396379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-28T22:07:10.396439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-28T22:07:10.396500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-28T22:07:10.396560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-28T22:07:10.396618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-28T22:07:10.396782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-28T22:07:10.396861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-28T22:07:10.396926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-28T22:07:10.396988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-28T22:07:10.397047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-28T22:07:10.397107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-28T22:07:10.397167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-28T22:07:10.397228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-28T22:07:10.397288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-28T22:07:10.397347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-28T22:07:10.397453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-28T22:07:10.397523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-28T22:07:10.397586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-28T22:07:10.397671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-28T22:07:10.397762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-28T22:07:10.397842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-28T22:07:10.397906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-28T22:07:10.397968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-28T22:07:10.398028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-28T22:07:10.398090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-28T22:07:10.398150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-28T22:07:10.398211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-28T22:07:10.398271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-28T22:07:10.398331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-28T22:07:10.398391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-28T22:07:10.398452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-28T22:07:10.398520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-28T22:07:10.398581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-28T22:07:10.398667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-28T22:07:10.398759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-28T22:07:10.398824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-28T22:07:10.398888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-28T22:07:10.398949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-28T22:07:10.399009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-28T22:07:10.399075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-28T22:07:10.399137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-28T22:07:10.399197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-28T22:07:10.399257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-28T22:07:10.399317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-28T22:07:10.399378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-28T22:07:10.399446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-28T22:07:10.399511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-10-28T22:07:10.399577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-28T22:07:10.399675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-28T22:07:10.399770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-28T22:07:10.399834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-28T22:07:10.399894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-28T22:07:10.399956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-28T22:07:10.400016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-28T22:07:10.400076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-28T22:07:10.400136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-28T22:07:10.400197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-28T22:07:10.400260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-28T22:07:10.400322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-28T22:07:10.400384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-28T22:07:10.400446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-28T22:07:10.400504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-28T22:07:10.400564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-28T22:07:10.400626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-28T22:07:10.400902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-28T22:07:10.400978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-28T22:07:10.401040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-28T22:07:10.401102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-10-28T22:07:10.401165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-28T22:07:10.401236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-28T22:07:10.401297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-28T22:07:10.401357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-28T22:07:10.401418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-28T22:07:10.401478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-28T22:07:10.401538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-28T22:07:10.401600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-28T22:07:10.401687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-28T22:07:10.401775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-28T22:07:10.401839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-28T22:07:10.401904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-28T22:07:10.401967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-28T22:07:10.402029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-28T22:07:10.402088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-28T22:07:10.402148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-28T22:07:10.402209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-28T22:07:10.402269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-28T22:07:10.402377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-28T22:07:10.402451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-28T22:07:10.402515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-28T22:07:10.402578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-28T22:07:10.402664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-28T22:07:10.402758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-28T22:07:10.402823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-28T22:07:10.402914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-28T22:07:10.403004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-28T22:07:10.403070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-28T22:07:10.403131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-28T22:07:10.403192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-28T22:07:10.403252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-28T22:07:10.403311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-28T22:07:10.403373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-28T22:07:10.403434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-28T22:07:10.403494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-28T22:07:10.403553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-28T22:07:10.403611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-28T22:07:10.403704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-28T22:07:10.403788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-28T22:07:10.403858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-28T22:07:10.403920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-28T22:07:10.403981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-28T22:07:10.404041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-28T22:07:10.404101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-28T22:07:10.404161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-28T22:07:10.404219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-28T22:07:10.404278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-28T22:07:10.404339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-28T22:07:10.404397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-28T22:07:10.404456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-28T22:07:10.404513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-28T22:07:10.404571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-28T22:07:10.404630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-28T22:07:10.404800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-28T22:07:10.404873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-28T22:07:10.404933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-28T22:07:10.404993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-28T22:07:10.405052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-28T22:07:10.405111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-28T22:07:10.405170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-28T22:07:10.405229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-28T22:07:10.405286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-28T22:07:10.405345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-28T22:07:10.405404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-28T22:07:10.405463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-28T22:07:10.405522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-28T22:07:10.405580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-28T22:07:10.405659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-28T22:07:10.405752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-28T22:07:10.405815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-28T22:07:10.405878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-28T22:07:10.405975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-28T22:07:10.406051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-28T22:07:10.406115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-28T22:07:10.406178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-28T22:07:10.406239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-28T22:07:10.406300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-28T22:07:10.406369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-28T22:07:10.406431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-28T22:07:10.406492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-28T22:07:10.406554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-28T22:07:10.406624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-28T22:07:10.406728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-28T22:07:10.406805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-28T22:07:10.406869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-28T22:07:10.406930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-28T22:07:10.406992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-28T22:07:10.407056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-28T22:07:10.407119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-28T22:07:10.407229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-28T22:07:10.407304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-28T22:07:10.407369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-28T22:07:10.407432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-28T22:07:10.407498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-28T22:07:10.407562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-28T22:07:10.407626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-28T22:07:10.407739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-28T22:07:10.407813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-28T22:07:10.407878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-28T22:07:10.407954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-28T22:07:10.408019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-28T22:07:10.408084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-28T22:07:10.408147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-28T22:07:10.408211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-28T22:07:10.408276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-28T22:07:10.408339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-28T22:07:10.408406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-28T22:07:10.408471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-28T22:07:10.408533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-28T22:07:10.408598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-28T22:07:10.408699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-28T22:07:10.408790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-28T22:07:10.408856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-28T22:07:10.408925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-28T22:07:10.408991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-10-28T22:07:10.409056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-28T22:07:10.409126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-28T22:07:10.409190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-28T22:07:10.409251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-28T22:07:10.409317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-28T22:07:10.409382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-28T22:07:10.409448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-28T22:07:10.409515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-28T22:07:10.409577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-28T22:07:10.409639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-28T22:07:10.409767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-28T22:07:10.409831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-28T22:07:10.409895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-28T22:07:10.409955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-28T22:07:10.410015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-28T22:07:10.410102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-28T22:07:10.410189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-28T22:07:10.410272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-28T22:07:10.410356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-28T22:07:10.410422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-28T22:07:10.410484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-28T22:07:10.410544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-28T22:07:10.410603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-28T22:07:10.410698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-28T22:07:10.410783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-28T22:07:10.410849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-28T22:07:10.410912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-28T22:07:10.410972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-28T22:07:10.411031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-28T22:07:10.411090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-28T22:07:10.411151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-28T22:07:10.411210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-28T22:07:10.411268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-28T22:07:10.411330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-28T22:07:10.411389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-28T22:07:10.411449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-28T22:07:10.411510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-28T22:07:10.411569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-28T22:07:10.411633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-28T22:07:10.411759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-28T22:07:10.411832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-28T22:07:10.411892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-28T22:07:10.411951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-28T22:07:10.412011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-28T22:07:10.412071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-28T22:07:10.412176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-28T22:07:10.412248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-28T22:07:10.412310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-28T22:07:10.412373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-28T22:07:10.412434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-28T22:07:10.412493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-28T22:07:10.412553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-28T22:07:10.412614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-28T22:07:10.412815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-28T22:07:10.412897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-28T22:07:10.412964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-28T22:07:10.413073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-28T22:07:10.413152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-28T22:07:10.413216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-28T22:07:10.413279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-28T22:07:10.413340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-28T22:07:10.413402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-28T22:07:10.413463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-28T22:07:10.413523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-28T22:07:10.413583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-28T22:07:10.413668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-28T22:07:10.413759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-28T22:07:10.413823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-28T22:07:10.413884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-28T22:07:10.413943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-28T22:07:10.414059] [INFO ] [LOCAL ] Deleted 1758 derivative data files. [2025-10-28T22:07:10.414092] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-28T22:07:10.416209] [INFO ] [LOCAL ] Found 2046 symbols with primary data. [2025-10-28T22:07:10.416476] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2046 symbols [2025-10-28T22:07:10.417057] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:10.418573] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:10.417676] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:10.460360] [DEBUG] [LOCAL ] AAMI: Loaded 23756 existing records from primary storage. [2025-10-28T22:07:10.460633] [INFO ] [MAIN ] AAMI: Loaded 23756 primary data records. [2025-10-28T22:07:10.580240] [DEBUG] [LOCAL ] AAP: Loaded 51543 existing records from primary storage. [2025-10-28T22:07:10.594723] [INFO ] [MAIN ] AAP: Loaded 51543 primary data records. [2025-10-28T22:07:10.787375] [DEBUG] [LOCAL ] A: Loaded 50460 existing records from primary storage. [2025-10-28T22:07:10.953018] [INFO ] [MAIN ] A: Loaded 50460 primary data records. [2025-10-28T22:07:11.532112] [DEBUG] [MAIN ] AAMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:11.576314] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:11.609316] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:11.680061] [INFO ] [MAIN ] AAMI: Generated 138 derivative records from 23756 primary records. [2025-10-28T22:07:11.684541] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-28T22:07:11.704744] [DEBUG] [LOCAL ] AAMI: Derivative data saved (138 records). [2025-10-28T22:07:11.705175] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-10-28T22:07:11.702148] [INFO ] [MAIN ] A: Generated 138 derivative records from 50460 primary records. [2025-10-28T22:07:11.706765] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-28T22:07:11.709616] [INFO ] [MAIN ] Derivative Progress: 1/2046 symbols completed. AAMI took 1.3s. Estimated remaining: 44m 5s. Rate: 46.4 symbols/min [2025-10-28T22:07:11.723423] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:11.725738] [INFO ] [MAIN ] AAP: Generated 138 derivative records from 51543 primary records. [2025-10-28T22:07:11.726541] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-28T22:07:11.725412] [DEBUG] [LOCAL ] A: Derivative data saved (138 records). [2025-10-28T22:07:11.726904] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-28T22:07:11.730339] [INFO ] [MAIN ] Derivative Progress: 2/2046 symbols completed. A took 1.3s. Estimated remaining: 22m 23s. Rate: 91.3 symbols/min [2025-10-28T22:07:11.731146] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:11.744129] [DEBUG] [LOCAL ] AAP: Derivative data saved (138 records). [2025-10-28T22:07:11.744218] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-28T22:07:11.746581] [INFO ] [MAIN ] Derivative Progress: 3/2046 symbols completed. AAP took 1.3s. Estimated remaining: 15m 6s. Rate: 135.3 symbols/min [2025-10-28T22:07:11.746967] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:11.794056] [DEBUG] [LOCAL ] AAT: Loaded 29902 existing records from primary storage. [2025-10-28T22:07:11.810546] [INFO ] [MAIN ] AAT: Loaded 29902 primary data records. [2025-10-28T22:07:11.927163] [DEBUG] [LOCAL ] ABBV: Loaded 53674 existing records from primary storage. [2025-10-28T22:07:11.967475] [INFO ] [MAIN ] ABBV: Loaded 53674 primary data records. [2025-10-28T22:07:11.974301] [DEBUG] [LOCAL ] ABEV: Loaded 53276 existing records from primary storage. [2025-10-28T22:07:12.051326] [INFO ] [MAIN ] ABEV: Loaded 53276 primary data records. [2025-10-28T22:07:12.881998] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:12.934860] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:12.981596] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:12.986609] [INFO ] [MAIN ] AAT: Generated 138 derivative records from 29902 primary records. [2025-10-28T22:07:12.999571] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-28T22:07:13.018991] [DEBUG] [LOCAL ] AAT: Derivative data saved (138 records). [2025-10-28T22:07:13.024225] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-28T22:07:13.026774] [INFO ] [MAIN ] Derivative Progress: 4/2046 symbols completed. AAT took 1.3s. Estimated remaining: 22m 13s. Rate: 91.9 symbols/min [2025-10-28T22:07:13.027402] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:13.063152] [INFO ] [MAIN ] ABBV: Generated 138 derivative records from 53674 primary records. [2025-10-28T22:07:13.065353] [INFO ] [MAIN ] ABEV: Generated 138 derivative records from 53276 primary records. [2025-10-28T22:07:13.065677] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-28T22:07:13.065814] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-28T22:07:13.108557] [DEBUG] [LOCAL ] ABEV: Derivative data saved (138 records). [2025-10-28T22:07:13.106820] [DEBUG] [LOCAL ] ABBV: Derivative data saved (138 records). [2025-10-28T22:07:13.108817] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-28T22:07:13.109021] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-28T22:07:13.111022] [INFO ] [MAIN ] Derivative Progress: 5/2046 symbols completed. ABEV took 1.4s. Estimated remaining: 18m 20s. Rate: 111.3 symbols/min [2025-10-28T22:07:13.114629] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:13.114794] [INFO ] [MAIN ] Derivative Progress: 6/2046 symbols completed. ABBV took 1.4s. Estimated remaining: 15m 17s. Rate: 133.4 symbols/min [2025-10-28T22:07:13.115052] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:13.135408] [DEBUG] [LOCAL ] ABR: Loaded 51778 existing records from primary storage. [2025-10-28T22:07:13.135874] [INFO ] [MAIN ] ABR: Loaded 51778 primary data records. [2025-10-28T22:07:13.495628] [DEBUG] [LOCAL ] ACCO: Loaded 36225 existing records from primary storage. [2025-10-28T22:07:13.495884] [INFO ] [MAIN ] ACCO: Loaded 36225 primary data records. [2025-10-28T22:07:13.629173] [DEBUG] [LOCAL ] ABT: Loaded 53625 existing records from primary storage. [2025-10-28T22:07:13.640028] [INFO ] [MAIN ] ABT: Loaded 53625 primary data records. [2025-10-28T22:07:14.192848] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:14.452672] [INFO ] [MAIN ] ABR: Generated 138 derivative records from 51778 primary records. [2025-10-28T22:07:14.453100] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-28T22:07:14.467924] [DEBUG] [LOCAL ] ABR: Derivative data saved (138 records). [2025-10-28T22:07:14.468323] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-28T22:07:14.470246] [INFO ] [MAIN ] Derivative Progress: 7/2046 symbols completed. ABR took 1.4s. Estimated remaining: 19m 41s. Rate: 103.6 symbols/min [2025-10-28T22:07:14.470588] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:14.494973] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:14.520018] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:14.572514] [DEBUG] [LOCAL ] ACEL: Loaded 25609 existing records from primary storage. [2025-10-28T22:07:14.574253] [INFO ] [MAIN ] ACEL: Loaded 25609 primary data records. [2025-10-28T22:07:14.749135] [INFO ] [MAIN ] ACCO: Generated 138 derivative records from 36225 primary records. [2025-10-28T22:07:14.779506] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-28T22:07:14.912104] [DEBUG] [LOCAL ] ACCO: Derivative data saved (138 records). [2025-10-28T22:07:14.913436] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-28T22:07:14.915221] [INFO ] [MAIN ] Derivative Progress: 8/2046 symbols completed. ACCO took 1.8s. Estimated remaining: 19m 6s. Rate: 106.7 symbols/min [2025-10-28T22:07:14.916897] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:14.920602] [INFO ] [MAIN ] ABT: Generated 138 derivative records from 53625 primary records. [2025-10-28T22:07:14.920866] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-28T22:07:14.934680] [DEBUG] [LOCAL ] ABT: Derivative data saved (138 records). [2025-10-28T22:07:14.934969] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-28T22:07:14.937066] [INFO ] [MAIN ] Derivative Progress: 9/2046 symbols completed. ABT took 1.8s. Estimated remaining: 17m 3s. Rate: 119.4 symbols/min [2025-10-28T22:07:14.937461] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:14.954977] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:15.023564] [DEBUG] [LOCAL ] ACP: Loaded 30672 existing records from primary storage. [2025-10-28T22:07:15.038453] [INFO ] [MAIN ] ACP: Loaded 30672 primary data records. [2025-10-28T22:07:15.041347] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-28T22:07:15.046700] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-28T22:07:15.076269] [INFO ] [MAIN ] ACEL: Generated 138 derivative records from 25609 primary records. [2025-10-28T22:07:15.160286] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-28T22:07:15.274112] [DEBUG] [LOCAL ] ACEL: Derivative data saved (138 records). [2025-10-28T22:07:15.289627] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-28T22:07:15.312778] [INFO ] [MAIN ] Derivative Progress: 10/2046 symbols completed. ACEL took 0.8s. Estimated remaining: 16m 37s. Rate: 122.5 symbols/min [2025-10-28T22:07:15.359036] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:15.715197] [DEBUG] [LOCAL ] ACR: Loaded 5179 existing records from primary storage. [2025-10-28T22:07:15.715796] [INFO ] [MAIN ] ACR: Loaded 5179 primary data records. [2025-10-28T22:07:16.053763] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:16.054178] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:16.122587] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:16.150585] [INFO ] [MAIN ] ACHR: Generated 138 derivative records from 53818 primary records. [2025-10-28T22:07:16.154207] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-28T22:07:16.170634] [DEBUG] [LOCAL ] ACHR: Derivative data saved (138 records). [2025-10-28T22:07:16.172982] [INFO ] [MAIN ] ACP: Generated 138 derivative records from 30672 primary records. [2025-10-28T22:07:16.172790] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-28T22:07:16.174852] [INFO ] [MAIN ] Derivative Progress: 11/2046 symbols completed. ACHR took 1.3s. Estimated remaining: 17m 45s. Rate: 114.6 symbols/min [2025-10-28T22:07:16.174982] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-28T22:07:16.178204] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:16.193983] [DEBUG] [LOCAL ] ACP: Derivative data saved (138 records). [2025-10-28T22:07:16.194242] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-28T22:07:16.196276] [INFO ] [MAIN ] Derivative Progress: 12/2046 symbols completed. ACP took 1.3s. Estimated remaining: 16m 20s. Rate: 124.6 symbols/min [2025-10-28T22:07:16.197719] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:16.207941] [INFO ] [MAIN ] ACR: Generated 138 derivative records from 5179 primary records. [2025-10-28T22:07:16.208116] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-28T22:07:16.219982] [DEBUG] [LOCAL ] ACV: Loaded 7282 existing records from primary storage. [2025-10-28T22:07:16.220291] [INFO ] [MAIN ] ACV: Loaded 7282 primary data records. [2025-10-28T22:07:16.281206] [DEBUG] [LOCAL ] ACRE: Loaded 32581 existing records from primary storage. [2025-10-28T22:07:16.303015] [INFO ] [MAIN ] ACRE: Loaded 32581 primary data records. [2025-10-28T22:07:16.452112] [DEBUG] [LOCAL ] ACR: Derivative data saved (138 records). [2025-10-28T22:07:16.482868] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-28T22:07:16.504173] [INFO ] [MAIN ] Derivative Progress: 13/2046 symbols completed. ACR took 1.1s. Estimated remaining: 15m 52s. Rate: 128.1 symbols/min [2025-10-28T22:07:16.871338] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:16.918386] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:16.930629] [INFO ] [MAIN ] ACV: Generated 138 derivative records from 7282 primary records. [2025-10-28T22:07:16.931473] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-28T22:07:16.946097] [DEBUG] [LOCAL ] ACV: Derivative data saved (138 records). [2025-10-28T22:07:16.948181] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-28T22:07:16.950247] [INFO ] [MAIN ] Derivative Progress: 14/2046 symbols completed. ACV took 0.8s. Estimated remaining: 15m 48s. Rate: 128.6 symbols/min [2025-10-28T22:07:16.960517] [INFO ] [MAIN ] ACRE: Generated 138 derivative records from 32581 primary records. [2025-10-28T22:07:16.960638] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-28T22:07:16.974274] [DEBUG] [LOCAL ] ACRE: Derivative data saved (138 records). [2025-10-28T22:07:16.974332] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-28T22:07:16.976386] [INFO ] [MAIN ] Derivative Progress: 15/2046 symbols completed. ACRE took 0.8s. Estimated remaining: 14m 48s. Rate: 137.2 symbols/min [2025-10-28T22:07:16.976808] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:16.977480] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:16.976970] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:17.035054] [DEBUG] [LOCAL ] ADCT: Loaded 35678 existing records from primary storage. [2025-10-28T22:07:17.035339] [INFO ] [MAIN ] ADCT: Loaded 35678 primary data records. [2025-10-28T22:07:17.115115] [DEBUG] [LOCAL ] ADC: Loaded 46262 existing records from primary storage. [2025-10-28T22:07:17.120625] [INFO ] [MAIN ] ADC: Loaded 46262 primary data records. [2025-10-28T22:07:17.251560] [DEBUG] [LOCAL ] ACVA: Loaded 49057 existing records from primary storage. [2025-10-28T22:07:17.262189] [INFO ] [MAIN ] ACVA: Loaded 49057 primary data records. [2025-10-28T22:07:18.049558] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:18.074866] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:18.110346] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:18.162944] [INFO ] [MAIN ] ADCT: Generated 138 derivative records from 35678 primary records. [2025-10-28T22:07:18.167433] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-28T22:07:18.169118] [INFO ] [MAIN ] ADC: Generated 138 derivative records from 46262 primary records. [2025-10-28T22:07:18.169770] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-28T22:07:18.194954] [DEBUG] [LOCAL ] ADC: Derivative data saved (138 records). [2025-10-28T22:07:18.192527] [DEBUG] [LOCAL ] ADCT: Derivative data saved (138 records). [2025-10-28T22:07:18.195265] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-28T22:07:18.195526] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-28T22:07:18.197322] [INFO ] [MAIN ] Derivative Progress: 16/2046 symbols completed. ADCT took 1.2s. Estimated remaining: 16m 27s. Rate: 123.4 symbols/min [2025-10-28T22:07:18.197461] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:18.201562] [INFO ] [MAIN ] Derivative Progress: 17/2046 symbols completed. ADC took 1.2s. Estimated remaining: 15m 29s. Rate: 131.0 symbols/min [2025-10-28T22:07:18.204029] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:18.207450] [INFO ] [MAIN ] ACVA: Generated 138 derivative records from 49057 primary records. [2025-10-28T22:07:18.207552] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-28T22:07:18.220003] [DEBUG] [LOCAL ] ACVA: Derivative data saved (138 records). [2025-10-28T22:07:18.220199] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-28T22:07:18.222292] [INFO ] [MAIN ] Derivative Progress: 18/2046 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 39s. Rate: 138.4 symbols/min [2025-10-28T22:07:18.222452] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:18.284708] [DEBUG] [LOCAL ] ADM: Loaded 53377 existing records from primary storage. [2025-10-28T22:07:18.297940] [INFO ] [MAIN ] ADM: Loaded 53377 primary data records. [2025-10-28T22:07:18.320107] [DEBUG] [LOCAL ] ADNT: Loaded 45939 existing records from primary storage. [2025-10-28T22:07:18.392770] [INFO ] [MAIN ] ADNT: Loaded 45939 primary data records. [2025-10-28T22:07:18.438539] [DEBUG] [LOCAL ] AEE: Loaded 49871 existing records from primary storage. [2025-10-28T22:07:18.478119] [INFO ] [MAIN ] AEE: Loaded 49871 primary data records. [2025-10-28T22:07:19.262723] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:19.317920] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:19.319451] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:19.379033] [INFO ] [MAIN ] ADM: Generated 138 derivative records from 53377 primary records. [2025-10-28T22:07:19.383371] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-28T22:07:19.407666] [DEBUG] [LOCAL ] ADM: Derivative data saved (138 records). [2025-10-28T22:07:19.408193] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-28T22:07:19.410330] [INFO ] [MAIN ] Derivative Progress: 19/2046 symbols completed. ADM took 1.2s. Estimated remaining: 15m 60s. Rate: 126.8 symbols/min [2025-10-28T22:07:19.412966] [INFO ] [MAIN ] ADNT: Generated 138 derivative records from 45939 primary records. [2025-10-28T22:07:19.412795] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:19.415059] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-28T22:07:19.432457] [DEBUG] [LOCAL ] ADNT: Derivative data saved (138 records). [2025-10-28T22:07:19.432693] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-28T22:07:19.434722] [INFO ] [MAIN ] Derivative Progress: 20/2046 symbols completed. ADNT took 1.2s. Estimated remaining: 15m 14s. Rate: 133.1 symbols/min [2025-10-28T22:07:19.436782] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:19.439973] [INFO ] [MAIN ] AEE: Generated 138 derivative records from 49871 primary records. [2025-10-28T22:07:19.443220] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-28T22:07:19.443524] [DEBUG] [LOCAL ] AEFC: Loaded 7433 existing records from primary storage. [2025-10-28T22:07:19.443703] [INFO ] [MAIN ] AEFC: Loaded 7433 primary data records. [2025-10-28T22:07:19.499123] [DEBUG] [LOCAL ] AEE: Derivative data saved (138 records). [2025-10-28T22:07:19.531545] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-28T22:07:19.562843] [INFO ] [MAIN ] Derivative Progress: 21/2046 symbols completed. AEE took 1.3s. Estimated remaining: 14m 42s. Rate: 137.8 symbols/min [2025-10-28T22:07:19.603101] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:19.809123] [DEBUG] [LOCAL ] AEG: Loaded 49393 existing records from primary storage. [2025-10-28T22:07:19.809791] [INFO ] [MAIN ] AEG: Loaded 49393 primary data records. [2025-10-28T22:07:20.136633] [DEBUG] [LOCAL ] AEM: Loaded 53472 existing records from primary storage. [2025-10-28T22:07:20.136981] [INFO ] [MAIN ] AEM: Loaded 53472 primary data records. [2025-10-28T22:07:20.256259] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:20.509282] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:20.530263] [INFO ] [MAIN ] AEFC: Generated 138 derivative records from 7433 primary records. [2025-10-28T22:07:20.530558] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-28T22:07:20.546509] [DEBUG] [LOCAL ] AEFC: Derivative data saved (138 records). [2025-10-28T22:07:20.547571] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-28T22:07:20.549796] [INFO ] [MAIN ] Derivative Progress: 22/2046 symbols completed. AEFC took 1.1s. Estimated remaining: 15m 32s. Rate: 130.3 symbols/min [2025-10-28T22:07:20.550230] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:20.575084] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:20.599735] [INFO ] [MAIN ] AEG: Generated 138 derivative records from 49393 primary records. [2025-10-28T22:07:20.601174] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-28T22:07:20.617969] [DEBUG] [LOCAL ] AEG: Derivative data saved (138 records). [2025-10-28T22:07:20.618311] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-28T22:07:20.620864] [INFO ] [MAIN ] Derivative Progress: 23/2046 symbols completed. AEG took 1.2s. Estimated remaining: 14m 58s. Rate: 135.2 symbols/min [2025-10-28T22:07:20.634238] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:20.643388] [INFO ] [MAIN ] AEM: Generated 138 derivative records from 53472 primary records. [2025-10-28T22:07:20.643593] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-28T22:07:20.671037] [DEBUG] [LOCAL ] AEM: Derivative data saved (138 records). [2025-10-28T22:07:20.671179] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-28T22:07:20.673547] [INFO ] [MAIN ] Derivative Progress: 24/2046 symbols completed. AEM took 1.1s. Estimated remaining: 14m 24s. Rate: 140.4 symbols/min [2025-10-28T22:07:20.673857] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:20.674823] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-28T22:07:20.675493] [INFO ] [MAIN ] AEO: Loaded 53563 primary data records. [2025-10-28T22:07:21.000084] [DEBUG] [LOCAL ] AER: Loaded 47659 existing records from primary storage. [2025-10-28T22:07:21.000491] [INFO ] [MAIN ] AER: Loaded 47659 primary data records. [2025-10-28T22:07:21.179139] [DEBUG] [LOCAL ] AES: Loaded 53663 existing records from primary storage. [2025-10-28T22:07:21.185512] [INFO ] [MAIN ] AES: Loaded 53663 primary data records. [2025-10-28T22:07:21.694498] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:21.747842] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:21.780352] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:21.799032] [INFO ] [MAIN ] AEO: Generated 138 derivative records from 53563 primary records. [2025-10-28T22:07:21.799433] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-28T22:07:21.821758] [DEBUG] [LOCAL ] AEO: Derivative data saved (138 records). [2025-10-28T22:07:21.822461] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-28T22:07:21.829916] [INFO ] [MAIN ] Derivative Progress: 25/2046 symbols completed. AEO took 1.3s. Estimated remaining: 15m 23s. Rate: 131.4 symbols/min [2025-10-28T22:07:21.832383] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:21.852287] [INFO ] [MAIN ] AES: Generated 138 derivative records from 53663 primary records. [2025-10-28T22:07:21.854419] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-28T22:07:21.854361] [INFO ] [MAIN ] AER: Generated 138 derivative records from 47659 primary records. [2025-10-28T22:07:21.854519] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-28T22:07:21.879800] [DEBUG] [LOCAL ] AER: Derivative data saved (138 records). [2025-10-28T22:07:21.879914] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-28T22:07:21.882497] [INFO ] [MAIN ] Derivative Progress: 26/2046 symbols completed. AER took 1.2s. Estimated remaining: 14m 51s. Rate: 136.1 symbols/min [2025-10-28T22:07:21.879373] [DEBUG] [LOCAL ] AES: Derivative data saved (138 records). [2025-10-28T22:07:21.882780] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:21.883253] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-28T22:07:21.885724] [INFO ] [MAIN ] Derivative Progress: 27/2046 symbols completed. AES took 1.2s. Estimated remaining: 14m 18s. Rate: 141.2 symbols/min [2025-10-28T22:07:21.886022] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:21.907574] [DEBUG] [LOCAL ] AFB: Loaded 10993 existing records from primary storage. [2025-10-28T22:07:21.907729] [INFO ] [MAIN ] AFB: Loaded 10993 primary data records. [2025-10-28T22:07:22.036829] [DEBUG] [LOCAL ] AESI: Loaded 49737 existing records from primary storage. [2025-10-28T22:07:22.070484] [INFO ] [MAIN ] AESI: Loaded 49737 primary data records. [2025-10-28T22:07:22.355198] [DEBUG] [LOCAL ] AFG: Loaded 31464 existing records from primary storage. [2025-10-28T22:07:22.355556] [INFO ] [MAIN ] AFG: Loaded 31464 primary data records. [2025-10-28T22:07:22.942017] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:22.977827] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:23.030671] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:23.067861] [INFO ] [MAIN ] AFB: Generated 138 derivative records from 10993 primary records. [2025-10-28T22:07:23.068354] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-28T22:07:23.086102] [DEBUG] [LOCAL ] AFB: Derivative data saved (138 records). [2025-10-28T22:07:23.086780] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-28T22:07:23.086687] [INFO ] [MAIN ] AESI: Generated 138 derivative records from 49737 primary records. [2025-10-28T22:07:23.091570] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-28T22:07:23.091106] [INFO ] [MAIN ] Derivative Progress: 28/2046 symbols completed. AFB took 1.2s. Estimated remaining: 15m 13s. Rate: 132.5 symbols/min [2025-10-28T22:07:23.112031] [DEBUG] [LOCAL ] AESI: Derivative data saved (138 records). [2025-10-28T22:07:23.114553] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-28T22:07:23.116843] [INFO ] [MAIN ] Derivative Progress: 29/2046 symbols completed. AESI took 1.3s. Estimated remaining: 14m 43s. Rate: 137.0 symbols/min [2025-10-28T22:07:23.122094] [INFO ] [MAIN ] AFG: Generated 138 derivative records from 31464 primary records. [2025-10-28T22:07:23.122171] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-28T22:07:23.134095] [DEBUG] [LOCAL ] AFG: Derivative data saved (138 records). [2025-10-28T22:07:23.134150] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-28T22:07:23.136445] [INFO ] [MAIN ] Derivative Progress: 30/2046 symbols completed. AFG took 1.3s. Estimated remaining: 14m 15s. Rate: 141.5 symbols/min [2025-10-28T22:07:23.137009] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:23.137109] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:23.137537] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:23.143491] [DEBUG] [LOCAL ] AFGE: Loaded 2204 existing records from primary storage. [2025-10-28T22:07:23.143670] [INFO ] [MAIN ] AFGE: Loaded 2204 primary data records. [2025-10-28T22:07:23.166254] [DEBUG] [LOCAL ] AFGB: Loaded 2112 existing records from primary storage. [2025-10-28T22:07:23.211126] [INFO ] [MAIN ] AFGB: Loaded 2112 primary data records. [2025-10-28T22:07:23.178824] [DEBUG] [LOCAL ] AFGC: Loaded 2560 existing records from primary storage. [2025-10-28T22:07:23.233590] [INFO ] [MAIN ] AFGC: Loaded 2560 primary data records. [2025-10-28T22:07:24.193727] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:24.194071] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-28T22:07:24.240859] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:24.313278] [INFO ] [MAIN ] AFGE: Generated 138 derivative records from 2204 primary records. [2025-10-28T22:07:24.313689] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-28T22:07:24.330085] [DEBUG] [LOCAL ] AFGE: Derivative data saved (138 records). [2025-10-28T22:07:24.330394] [INFO ] [MAIN ] AFGB: Generated 138 derivative records from 2112 primary records. [2025-10-28T22:07:24.330208] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-28T22:07:24.328812] [INFO ] [MAIN ] AFGC: Generated 138 derivative records from 2560 primary records. [2025-10-28T22:07:24.332552] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-28T22:07:24.332695] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-28T22:07:24.332364] [INFO ] [MAIN ] Derivative Progress: 31/2046 symbols completed. AFGE took 1.2s. Estimated remaining: 15m 5s. Rate: 133.7 symbols/min [2025-10-28T22:07:24.334179] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:24.353053] [DEBUG] [LOCAL ] AFGB: Derivative data saved (138 records). [2025-10-28T22:07:24.355490] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-28T22:07:24.357506] [INFO ] [MAIN ] Derivative Progress: 32/2046 symbols completed. AFGB took 1.2s. Estimated remaining: 14m 37s. Rate: 137.7 symbols/min [2025-10-28T22:07:24.355301] [DEBUG] [LOCAL ] AFGC: Derivative data saved (138 records). [2025-10-28T22:07:24.357806] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:24.358185] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-28T22:07:24.360761] [INFO ] [MAIN ] Derivative Progress: 33/2046 symbols completed. AFGC took 1.2s. Estimated remaining: 14m 11s. Rate: 142.0 symbols/min [2025-10-28T22:07:24.361078] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:24.421528] [DEBUG] [LOCAL ] AGCO: Loaded 41768 existing records from primary storage. [2025-10-28T22:07:24.422343] [INFO ] [MAIN ] AGCO: Loaded 41768 primary data records. [2025-10-28T22:07:24.543106] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-28T22:07:24.537075] [DEBUG] [LOCAL ] AFL: Loaded 53148 existing records from primary storage. [2025-10-28T22:07:24.550623] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-10-28T22:07:24.553944] [INFO ] [MAIN ] AFL: Loaded 53148 primary data records. [2025-10-28T22:07:25.384481] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:25.433059] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:25.445197] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:25.502953] [INFO ] [MAIN ] AGCO: Generated 138 derivative records from 41768 primary records. [2025-10-28T22:07:25.505670] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-28T22:07:25.526086] [DEBUG] [LOCAL ] AGCO: Derivative data saved (138 records). [2025-10-28T22:07:25.526277] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-28T22:07:25.529181] [INFO ] [MAIN ] Derivative Progress: 34/2046 symbols completed. AGCO took 1.2s. Estimated remaining: 14m 54s. Rate: 135.0 symbols/min [2025-10-28T22:07:25.531047] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:25.536901] [INFO ] [MAIN ] AG: Generated 138 derivative records from 53643 primary records. [2025-10-28T22:07:25.537479] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-28T22:07:25.549694] [INFO ] [MAIN ] AFL: Generated 138 derivative records from 53148 primary records. [2025-10-28T22:07:25.554625] [DEBUG] [LOCAL ] AG: Derivative data saved (138 records). [2025-10-28T22:07:25.559089] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-28T22:07:25.559187] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-28T22:07:25.562504] [INFO ] [MAIN ] Derivative Progress: 35/2046 symbols completed. AG took 1.2s. Estimated remaining: 14m 30s. Rate: 138.6 symbols/min [2025-10-28T22:07:25.562786] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:25.584105] [DEBUG] [LOCAL ] AFL: Derivative data saved (138 records). [2025-10-28T22:07:25.584339] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-28T22:07:25.583304] [DEBUG] [LOCAL ] AGD: Loaded 19061 existing records from primary storage. [2025-10-28T22:07:25.584528] [INFO ] [MAIN ] AGD: Loaded 19061 primary data records. [2025-10-28T22:07:25.586547] [INFO ] [MAIN ] Derivative Progress: 36/2046 symbols completed. AFL took 1.3s. Estimated remaining: 14m 7s. Rate: 142.4 symbols/min [2025-10-28T22:07:25.586974] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:25.968059] [DEBUG] [LOCAL ] AGI: Loaded 53421 existing records from primary storage. [2025-10-28T22:07:25.970587] [INFO ] [MAIN ] AGI: Loaded 53421 primary data records. [2025-10-28T22:07:25.970335] [DEBUG] [LOCAL ] AGL: Loaded 52573 existing records from primary storage. [2025-10-28T22:07:25.970833] [INFO ] [MAIN ] AGL: Loaded 52573 primary data records. [2025-10-28T22:07:26.592117] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:26.663526] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:26.682916] [INFO ] [MAIN ] AGD: Generated 138 derivative records from 19061 primary records. [2025-10-28T22:07:26.683327] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:26.686622] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-28T22:07:26.718053] [DEBUG] [LOCAL ] AGD: Derivative data saved (138 records). [2025-10-28T22:07:26.728594] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-28T22:07:26.732376] [INFO ] [MAIN ] Derivative Progress: 37/2046 symbols completed. AGD took 1.2s. Estimated remaining: 14m 46s. Rate: 136.1 symbols/min [2025-10-28T22:07:26.739734] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:26.766362] [INFO ] [MAIN ] AGI: Generated 138 derivative records from 53421 primary records. [2025-10-28T22:07:26.767627] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-28T22:07:26.772982] [DEBUG] [LOCAL ] AGM: Loaded 10454 existing records from primary storage. [2025-10-28T22:07:26.774067] [INFO ] [MAIN ] AGM: Loaded 10454 primary data records. [2025-10-28T22:07:26.793784] [DEBUG] [LOCAL ] AGI: Derivative data saved (138 records). [2025-10-28T22:07:26.794323] [INFO ] [MAIN ] AGL: Generated 138 derivative records from 52573 primary records. [2025-10-28T22:07:26.826945] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-28T22:07:26.842455] [INFO ] [MAIN ] Derivative Progress: 38/2046 symbols completed. AGI took 1.3s. Estimated remaining: 14m 28s. Rate: 138.8 symbols/min [2025-10-28T22:07:26.859561] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:26.859791] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-28T22:07:26.996497] [DEBUG] [LOCAL ] AGL: Derivative data saved (138 records). [2025-10-28T22:07:27.104676] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-28T22:07:27.120993] [INFO ] [MAIN ] Derivative Progress: 39/2046 symbols completed. AGL took 1.5s. Estimated remaining: 14m 20s. Rate: 140.1 symbols/min [2025-10-28T22:07:27.122003] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:27.133439] [DEBUG] [LOCAL ] AGO: Loaded 27199 existing records from primary storage. [2025-10-28T22:07:27.134331] [INFO ] [MAIN ] AGO: Loaded 27199 primary data records. [2025-10-28T22:07:27.472962] [DEBUG] [LOCAL ] AGRO: Loaded 32033 existing records from primary storage. [2025-10-28T22:07:27.474704] [INFO ] [MAIN ] AGRO: Loaded 32033 primary data records. [2025-10-28T22:07:27.624841] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:27.920954] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:27.963905] [INFO ] [MAIN ] AGM: Generated 138 derivative records from 10454 primary records. [2025-10-28T22:07:27.966772] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-28T22:07:28.002464] [DEBUG] [LOCAL ] AGM: Derivative data saved (138 records). [2025-10-28T22:07:28.003124] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-28T22:07:28.005343] [INFO ] [MAIN ] Derivative Progress: 40/2046 symbols completed. AGM took 1.3s. Estimated remaining: 14m 42s. Rate: 136.4 symbols/min [2025-10-28T22:07:28.005716] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:27.998999] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:28.025443] [INFO ] [MAIN ] AGO: Generated 138 derivative records from 27199 primary records. [2025-10-28T22:07:28.029605] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-28T22:07:28.046239] [DEBUG] [LOCAL ] AGO: Derivative data saved (138 records). [2025-10-28T22:07:28.046590] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-28T22:07:28.050362] [INFO ] [MAIN ] Derivative Progress: 41/2046 symbols completed. AGO took 1.2s. Estimated remaining: 14m 22s. Rate: 139.5 symbols/min [2025-10-28T22:07:28.050873] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:28.075144] [INFO ] [MAIN ] AGRO: Generated 138 derivative records from 32033 primary records. [2025-10-28T22:07:28.075281] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-28T22:07:28.102446] [DEBUG] [LOCAL ] AGRO: Derivative data saved (138 records). [2025-10-28T22:07:28.103866] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-28T22:07:28.104347] [DEBUG] [LOCAL ] AGX: Loaded 32137 existing records from primary storage. [2025-10-28T22:07:28.107355] [INFO ] [MAIN ] Derivative Progress: 42/2046 symbols completed. AGRO took 1.0s. Estimated remaining: 14m 4s. Rate: 142.4 symbols/min [2025-10-28T22:07:28.107489] [INFO ] [MAIN ] AGX: Loaded 32137 primary data records. [2025-10-28T22:07:28.108037] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:28.273619] [DEBUG] [LOCAL ] AHH: Loaded 39694 existing records from primary storage. [2025-10-28T22:07:28.295018] [INFO ] [MAIN ] AHH: Loaded 39694 primary data records. [2025-10-28T22:07:28.294897] [DEBUG] [LOCAL ] AHT: Loaded 6372 existing records from primary storage. [2025-10-28T22:07:28.366058] [INFO ] [MAIN ] AHT: Loaded 6372 primary data records. [2025-10-28T22:07:29.099905] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:29.141548] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:29.165593] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:07:29.207423] [INFO ] [MAIN ] AGX: Generated 138 derivative records from 32137 primary records. [2025-10-28T22:07:29.211395] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-28T22:07:29.229764] [DEBUG] [LOCAL ] AGX: Derivative data saved (138 records). [2025-10-28T22:07:29.233272] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-28T22:07:29.235241] [INFO ] [MAIN ] Derivative Progress: 43/2046 symbols completed. AGX took 1.2s. Estimated remaining: 14m 37s. Rate: 137.1 symbols/min [2025-10-28T22:07:29.248022] [INFO ] [MAIN ] AHH: Generated 138 derivative records from 39694 primary records. [2025-10-28T22:07:29.248170] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-28T22:07:29.258058] [INFO ] [MAIN ] AHT: Generated 138 derivative records from 6372 primary records. [2025-10-28T22:07:29.259596] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-28T22:07:29.262526] [DEBUG] [LOCAL ] AHH: Derivative data saved (138 records). [2025-10-28T22:07:29.262600] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-28T22:07:29.264626] [INFO ] [MAIN ] Derivative Progress: 44/2046 symbols completed. AHH took 1.2s. Estimated remaining: 14m 18s. Rate: 140.1 symbols/min [2025-10-28T22:07:29.277213] [DEBUG] [LOCAL ] AHT: Derivative data saved (138 records). [2025-10-28T22:07:29.277275] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-28T22:07:29.279515] [INFO ] [MAIN ] Derivative Progress: 45/2046 symbols completed. AHT took 1.2s. Estimated remaining: 13m 59s. Rate: 143.1 symbols/min [2025-10-28T22:07:29.279879] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:29.279986] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:29.280085] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:29.308891] [DEBUG] [LOCAL ] AIN: Loaded 24147 existing records from primary storage. [2025-10-28T22:07:29.309369] [INFO ] [MAIN ] AIN: Loaded 24147 primary data records. [2025-10-28T22:07:29.475397] [DEBUG] [LOCAL ] AIG: Loaded 53447 existing records from primary storage. [2025-10-28T22:07:29.498868] [INFO ] [MAIN ] AIG: Loaded 53447 primary data records. [2025-10-28T22:07:29.541856] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-28T22:07:29.573068] [INFO ] [MAIN ] AI: Loaded 53764 primary data records. [2025-10-28T22:07:30.338014] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:30.369221] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:30.397576] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:30.450231] [INFO ] [MAIN ] AIN: Generated 138 derivative records from 24147 primary records. [2025-10-28T22:07:30.452936] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-28T22:07:30.469927] [DEBUG] [LOCAL ] AIN: Derivative data saved (138 records). [2025-10-28T22:07:30.471572] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-28T22:07:30.471784] [INFO ] [MAIN ] AI: Generated 138 derivative records from 53764 primary records. [2025-10-28T22:07:30.474920] [INFO ] [MAIN ] Derivative Progress: 46/2046 symbols completed. AIN took 1.2s. Estimated remaining: 14m 32s. Rate: 137.6 symbols/min [2025-10-28T22:07:30.471882] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-28T22:07:30.475318] [INFO ] [MAIN ] AIG: Generated 138 derivative records from 53447 primary records. [2025-10-28T22:07:30.475955] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-28T22:07:30.476045] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:30.503396] [DEBUG] [LOCAL ] AI: Derivative data saved (138 records). [2025-10-28T22:07:30.502924] [DEBUG] [LOCAL ] AIG: Derivative data saved (138 records). [2025-10-28T22:07:30.503703] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-28T22:07:30.503518] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-28T22:07:30.505855] [INFO ] [MAIN ] Derivative Progress: 47/2046 symbols completed. AI took 1.2s. Estimated remaining: 14m 14s. Rate: 140.4 symbols/min [2025-10-28T22:07:30.507977] [INFO ] [MAIN ] Derivative Progress: 48/2046 symbols completed. AIG took 1.2s. Estimated remaining: 13m 56s. Rate: 143.3 symbols/min [2025-10-28T22:07:30.508167] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:30.506067] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:30.513409] [DEBUG] [LOCAL ] AIO: Loaded 12744 existing records from primary storage. [2025-10-28T22:07:30.513695] [INFO ] [MAIN ] AIO: Loaded 12744 primary data records. [2025-10-28T22:07:30.830120] [DEBUG] [LOCAL ] AIR: Loaded 28331 existing records from primary storage. [2025-10-28T22:07:30.830299] [INFO ] [MAIN ] AIR: Loaded 28331 primary data records. [2025-10-28T22:07:30.830730] [DEBUG] [LOCAL ] AIT: Loaded 26110 existing records from primary storage. [2025-10-28T22:07:30.831426] [INFO ] [MAIN ] AIT: Loaded 26110 primary data records. [2025-10-28T22:07:31.437467] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:31.503759] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:31.524851] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:31.525162] [INFO ] [MAIN ] AIO: Generated 138 derivative records from 12744 primary records. [2025-10-28T22:07:31.537952] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-28T22:07:31.557137] [DEBUG] [LOCAL ] AIO: Derivative data saved (138 records). [2025-10-28T22:07:31.557230] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-28T22:07:31.559404] [INFO ] [MAIN ] Derivative Progress: 49/2046 symbols completed. AIO took 1.1s. Estimated remaining: 14m 22s. Rate: 139.1 symbols/min [2025-10-28T22:07:31.564304] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:31.609735] [INFO ] [MAIN ] AIT: Generated 138 derivative records from 26110 primary records. [2025-10-28T22:07:31.607943] [INFO ] [MAIN ] AIR: Generated 138 derivative records from 28331 primary records. [2025-10-28T22:07:31.609933] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-28T22:07:31.609878] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-28T22:07:31.630795] [DEBUG] [LOCAL ] AIR: Derivative data saved (138 records). [2025-10-28T22:07:31.634399] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-28T22:07:31.633766] [DEBUG] [LOCAL ] AIT: Derivative data saved (138 records). [2025-10-28T22:07:31.636631] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-28T22:07:31.636551] [INFO ] [MAIN ] Derivative Progress: 50/2046 symbols completed. AIR took 1.1s. Estimated remaining: 14m 7s. Rate: 141.4 symbols/min [2025-10-28T22:07:31.650572] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:31.650658] [INFO ] [MAIN ] Derivative Progress: 51/2046 symbols completed. AIT took 1.1s. Estimated remaining: 13m 51s. Rate: 144.1 symbols/min [2025-10-28T22:07:31.651105] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:31.652517] [DEBUG] [LOCAL ] AIV: Loaded 41743 existing records from primary storage. [2025-10-28T22:07:31.652835] [INFO ] [MAIN ] AIV: Loaded 41743 primary data records. [2025-10-28T22:07:31.754228] [DEBUG] [LOCAL ] AIZN: Loaded 3629 existing records from primary storage. [2025-10-28T22:07:31.754435] [INFO ] [MAIN ] AIZN: Loaded 3629 primary data records. [2025-10-28T22:07:32.229975] [DEBUG] [LOCAL ] AIZ: Loaded 28784 existing records from primary storage. [2025-10-28T22:07:32.329680] [INFO ] [MAIN ] AIZ: Loaded 28784 primary data records. [2025-10-28T22:07:32.690090] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:32.718919] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:32.768084] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:32.809196] [INFO ] [MAIN ] AIV: Generated 138 derivative records from 41743 primary records. [2025-10-28T22:07:32.811293] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-28T22:07:32.814781] [INFO ] [MAIN ] AIZN: Generated 138 derivative records from 3629 primary records. [2025-10-28T22:07:32.815683] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-28T22:07:32.830300] [DEBUG] [LOCAL ] AIV: Derivative data saved (138 records). [2025-10-28T22:07:32.836580] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-28T22:07:32.842349] [DEBUG] [LOCAL ] AIZN: Derivative data saved (138 records). [2025-10-28T22:07:32.840619] [INFO ] [MAIN ] Derivative Progress: 52/2046 symbols completed. AIV took 1.3s. Estimated remaining: 14m 20s. Rate: 139.1 symbols/min [2025-10-28T22:07:32.842590] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:32.842455] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-28T22:07:32.846433] [INFO ] [MAIN ] Derivative Progress: 53/2046 symbols completed. AIZN took 1.2s. Estimated remaining: 14m 3s. Rate: 141.8 symbols/min [2025-10-28T22:07:32.847872] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:32.852346] [INFO ] [MAIN ] AIZ: Generated 138 derivative records from 28784 primary records. [2025-10-28T22:07:32.852471] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-28T22:07:32.864761] [DEBUG] [LOCAL ] AIZ: Derivative data saved (138 records). [2025-10-28T22:07:32.864967] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-28T22:07:32.867134] [INFO ] [MAIN ] Derivative Progress: 54/2046 symbols completed. AIZ took 1.2s. Estimated remaining: 13m 48s. Rate: 144.3 symbols/min [2025-10-28T22:07:32.867374] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:32.918618] [DEBUG] [LOCAL ] AJG: Loaded 46201 existing records from primary storage. [2025-10-28T22:07:32.918840] [INFO ] [MAIN ] AJG: Loaded 46201 primary data records. [2025-10-28T22:07:33.014814] [DEBUG] [LOCAL ] AL: Loaded 44696 existing records from primary storage. [2025-10-28T22:07:33.039957] [INFO ] [MAIN ] AL: Loaded 44696 primary data records. [2025-10-28T22:07:33.055033] [DEBUG] [LOCAL ] AKR: Loaded 45895 existing records from primary storage. [2025-10-28T22:07:33.101271] [INFO ] [MAIN ] AKR: Loaded 45895 primary data records. [2025-10-28T22:07:33.889257] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:33.919019] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:33.956021] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:34.013429] [INFO ] [MAIN ] AJG: Generated 138 derivative records from 46201 primary records. [2025-10-28T22:07:34.018906] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-28T22:07:34.036972] [INFO ] [MAIN ] AKR: Generated 138 derivative records from 45895 primary records. [2025-10-28T22:07:34.036725] [DEBUG] [LOCAL ] AJG: Derivative data saved (138 records). [2025-10-28T22:07:34.038878] [INFO ] [MAIN ] AL: Generated 138 derivative records from 44696 primary records. [2025-10-28T22:07:34.038500] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-28T22:07:34.038726] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-28T22:07:34.039073] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-28T22:07:34.041300] [INFO ] [MAIN ] Derivative Progress: 55/2046 symbols completed. AJG took 1.2s. Estimated remaining: 14m 15s. Rate: 139.7 symbols/min [2025-10-28T22:07:34.042004] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:34.065674] [DEBUG] [LOCAL ] AL: Derivative data saved (138 records). [2025-10-28T22:07:34.065569] [DEBUG] [LOCAL ] AKR: Derivative data saved (138 records). [2025-10-28T22:07:34.065884] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-28T22:07:34.068620] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-28T22:07:34.068506] [INFO ] [MAIN ] Derivative Progress: 56/2046 symbols completed. AL took 1.2s. Estimated remaining: 14m 0s. Rate: 142.1 symbols/min [2025-10-28T22:07:34.068786] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:34.071225] [INFO ] [MAIN ] Derivative Progress: 57/2046 symbols completed. AKR took 1.2s. Estimated remaining: 13m 45s. Rate: 144.6 symbols/min [2025-10-28T22:07:34.071480] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:34.140605] [DEBUG] [LOCAL ] ALE: Loaded 31763 existing records from primary storage. [2025-10-28T22:07:34.140909] [INFO ] [MAIN ] ALE: Loaded 31763 primary data records. [2025-10-28T22:07:34.154953] [DEBUG] [LOCAL ] ALB: Loaded 53356 existing records from primary storage. [2025-10-28T22:07:34.174971] [INFO ] [MAIN ] ALB: Loaded 53356 primary data records. [2025-10-28T22:07:34.284050] [DEBUG] [LOCAL ] ALEX: Loaded 30222 existing records from primary storage. [2025-10-28T22:07:34.291583] [INFO ] [MAIN ] ALEX: Loaded 30222 primary data records. [2025-10-28T22:07:35.145595] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:35.194582] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:35.197155] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:35.273596] [INFO ] [MAIN ] ALB: Generated 138 derivative records from 53356 primary records. [2025-10-28T22:07:35.277361] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-28T22:07:35.291174] [DEBUG] [LOCAL ] ALB: Derivative data saved (138 records). [2025-10-28T22:07:35.295138] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-28T22:07:35.300014] [INFO ] [MAIN ] Derivative Progress: 58/2046 symbols completed. ALB took 1.3s. Estimated remaining: 14m 13s. Rate: 139.9 symbols/min [2025-10-28T22:07:35.295418] [INFO ] [MAIN ] ALE: Generated 138 derivative records from 31763 primary records. [2025-10-28T22:07:35.300720] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-28T22:07:35.316392] [DEBUG] [LOCAL ] ALE: Derivative data saved (138 records). [2025-10-28T22:07:35.316704] [INFO ] [MAIN ] ALEX: Generated 138 derivative records from 30222 primary records. [2025-10-28T22:07:35.317020] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-28T22:07:35.318727] [INFO ] [MAIN ] Derivative Progress: 59/2046 symbols completed. ALE took 1.2s. Estimated remaining: 13m 59s. Rate: 142.2 symbols/min [2025-10-28T22:07:35.316945] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-28T22:07:35.331115] [DEBUG] [LOCAL ] ALEX: Derivative data saved (138 records). [2025-10-28T22:07:35.331183] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-28T22:07:35.333354] [INFO ] [MAIN ] Derivative Progress: 60/2046 symbols completed. ALEX took 1.3s. Estimated remaining: 13m 45s. Rate: 144.5 symbols/min [2025-10-28T22:07:35.333785] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:35.334180] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:35.334246] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:35.345447] [DEBUG] [LOCAL ] ALG: Loaded 9482 existing records from primary storage. [2025-10-28T22:07:35.345637] [INFO ] [MAIN ] ALG: Loaded 9482 primary data records. [2025-10-28T22:07:35.692111] [DEBUG] [LOCAL ] ALIT: Loaded 52756 existing records from primary storage. [2025-10-28T22:07:35.707618] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-28T22:07:35.707898] [INFO ] [MAIN ] ALK: Loaded 53087 primary data records. [2025-10-28T22:07:35.706741] [INFO ] [MAIN ] ALIT: Loaded 52756 primary data records. [2025-10-28T22:07:36.375554] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:36.422386] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:36.464676] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:36.499471] [INFO ] [MAIN ] ALG: Generated 138 derivative records from 9482 primary records. [2025-10-28T22:07:36.500269] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-28T22:07:36.520745] [DEBUG] [LOCAL ] ALG: Derivative data saved (138 records). [2025-10-28T22:07:36.523603] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-28T22:07:36.529447] [INFO ] [MAIN ] Derivative Progress: 61/2046 symbols completed. ALG took 1.2s. Estimated remaining: 14m 10s. Rate: 140.2 symbols/min [2025-10-28T22:07:36.529862] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:36.533626] [INFO ] [MAIN ] ALK: Generated 138 derivative records from 53087 primary records. [2025-10-28T22:07:36.533865] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-28T22:07:36.550975] [DEBUG] [LOCAL ] ALK: Derivative data saved (138 records). [2025-10-28T22:07:36.552301] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-28T22:07:36.554398] [INFO ] [MAIN ] Derivative Progress: 62/2046 symbols completed. ALK took 1.2s. Estimated remaining: 13m 56s. Rate: 142.3 symbols/min [2025-10-28T22:07:36.554804] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:36.557867] [INFO ] [MAIN ] ALIT: Generated 138 derivative records from 52756 primary records. [2025-10-28T22:07:36.558018] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-28T22:07:36.571252] [DEBUG] [LOCAL ] ALIT: Derivative data saved (138 records). [2025-10-28T22:07:36.571483] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-28T22:07:36.573925] [INFO ] [MAIN ] Derivative Progress: 63/2046 symbols completed. ALIT took 1.2s. Estimated remaining: 13m 43s. Rate: 144.5 symbols/min [2025-10-28T22:07:36.574299] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:36.636091] [DEBUG] [LOCAL ] ALLY: Loaded 53200 existing records from primary storage. [2025-10-28T22:07:36.649085] [INFO ] [MAIN ] ALLY: Loaded 53200 primary data records. [2025-10-28T22:07:36.672194] [DEBUG] [LOCAL ] ALL: Loaded 49407 existing records from primary storage. [2025-10-28T22:07:36.706079] [INFO ] [MAIN ] ALL: Loaded 49407 primary data records. [2025-10-28T22:07:36.768508] [DEBUG] [LOCAL ] ALSN: Loaded 42985 existing records from primary storage. [2025-10-28T22:07:36.795760] [INFO ] [MAIN ] ALSN: Loaded 42985 primary data records. [2025-10-28T22:07:37.568447] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:37.594691] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:37.635004] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:37.688215] [INFO ] [MAIN ] ALLY: Generated 138 derivative records from 53200 primary records. [2025-10-28T22:07:37.688623] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-28T22:07:37.703690] [INFO ] [MAIN ] ALL: Generated 138 derivative records from 49407 primary records. [2025-10-28T22:07:37.705373] [DEBUG] [LOCAL ] ALLY: Derivative data saved (138 records). [2025-10-28T22:07:37.705593] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-28T22:07:37.707283] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-28T22:07:37.709625] [INFO ] [MAIN ] Derivative Progress: 64/2046 symbols completed. ALLY took 1.2s. Estimated remaining: 14m 5s. Rate: 140.7 symbols/min [2025-10-28T22:07:37.710224] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:37.724834] [DEBUG] [LOCAL ] ALL: Derivative data saved (138 records). [2025-10-28T22:07:37.725263] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-28T22:07:37.727260] [INFO ] [MAIN ] Derivative Progress: 65/2046 symbols completed. ALL took 1.2s. Estimated remaining: 13m 52s. Rate: 142.8 symbols/min [2025-10-28T22:07:37.728859] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:37.730943] [INFO ] [MAIN ] ALSN: Generated 138 derivative records from 42985 primary records. [2025-10-28T22:07:37.731427] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-28T22:07:37.743767] [DEBUG] [LOCAL ] ALSN: Derivative data saved (138 records). [2025-10-28T22:07:37.743907] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-28T22:07:37.746378] [INFO ] [MAIN ] Derivative Progress: 66/2046 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 40s. Rate: 144.9 symbols/min [2025-10-28T22:07:37.748910] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:37.759226] [DEBUG] [LOCAL ] ALUR: Loaded 9120 existing records from primary storage. [2025-10-28T22:07:37.759489] [INFO ] [MAIN ] ALUR: Loaded 9120 primary data records. [2025-10-28T22:07:37.820900] [DEBUG] [LOCAL ] ALTG: Loaded 22694 existing records from primary storage. [2025-10-28T22:07:37.846436] [INFO ] [MAIN ] ALTG: Loaded 22694 primary data records. [2025-10-28T22:07:38.255967] [DEBUG] [LOCAL ] ALV: Loaded 42070 existing records from primary storage. [2025-10-28T22:07:38.387677] [INFO ] [MAIN ] ALV: Loaded 42070 primary data records. [2025-10-28T22:07:38.725347] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:38.763732] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:38.822501] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:38.857409] [INFO ] [MAIN ] ALUR: Generated 138 derivative records from 9120 primary records. [2025-10-28T22:07:38.860892] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-28T22:07:38.876981] [DEBUG] [LOCAL ] ALUR: Derivative data saved (138 records). [2025-10-28T22:07:38.877213] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-28T22:07:38.879263] [INFO ] [MAIN ] Derivative Progress: 67/2046 symbols completed. ALUR took 1.2s. Estimated remaining: 14m 1s. Rate: 141.2 symbols/min [2025-10-28T22:07:38.879681] [INFO ] [MAIN ] ALTG: Generated 138 derivative records from 22694 primary records. [2025-10-28T22:07:38.880216] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:38.883466] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-28T22:07:38.903976] [DEBUG] [LOCAL ] ALTG: Derivative data saved (138 records). [2025-10-28T22:07:38.904485] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-28T22:07:38.907731] [INFO ] [MAIN ] Derivative Progress: 68/2046 symbols completed. ALTG took 1.2s. Estimated remaining: 13m 49s. Rate: 143.2 symbols/min [2025-10-28T22:07:38.911498] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:38.915455] [DEBUG] [LOCAL ] ALX: Loaded 7568 existing records from primary storage. [2025-10-28T22:07:38.915775] [INFO ] [MAIN ] ALX: Loaded 7568 primary data records. [2025-10-28T22:07:38.973298] [INFO ] [MAIN ] ALV: Generated 138 derivative records from 42070 primary records. [2025-10-28T22:07:38.999076] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-28T22:07:39.059394] [DEBUG] [LOCAL ] ALV: Derivative data saved (138 records). [2025-10-28T22:07:39.059687] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-28T22:07:39.072747] [INFO ] [MAIN ] Derivative Progress: 69/2046 symbols completed. ALV took 1.3s. Estimated remaining: 13m 41s. Rate: 144.5 symbols/min [2025-10-28T22:07:39.079037] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:39.259022] [DEBUG] [LOCAL ] AMBC: Loaded 35400 existing records from primary storage. [2025-10-28T22:07:39.259883] [INFO ] [MAIN ] AMBC: Loaded 35400 primary data records. [2025-10-28T22:07:39.580773] [DEBUG] [LOCAL ] AMBP: Loaded 44285 existing records from primary storage. [2025-10-28T22:07:39.581301] [INFO ] [MAIN ] AMBP: Loaded 44285 primary data records. [2025-10-28T22:07:39.757838] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:07:39.945678] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:39.987502] [INFO ] [MAIN ] ALX: Generated 138 derivative records from 7568 primary records. [2025-10-28T22:07:39.988193] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-28T22:07:40.012555] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:40.039842] [DEBUG] [LOCAL ] ALX: Derivative data saved (138 records). [2025-10-28T22:07:40.040476] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-28T22:07:40.043556] [INFO ] [MAIN ] Derivative Progress: 70/2046 symbols completed. ALX took 1.2s. Estimated remaining: 13m 56s. Rate: 141.8 symbols/min [2025-10-28T22:07:40.044297] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:40.060068] [INFO ] [MAIN ] AMBC: Generated 138 derivative records from 35400 primary records. [2025-10-28T22:07:40.060600] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-28T22:07:40.076863] [DEBUG] [LOCAL ] AMBC: Derivative data saved (138 records). [2025-10-28T22:07:40.078388] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-28T22:07:40.081908] [INFO ] [MAIN ] Derivative Progress: 71/2046 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 45s. Rate: 143.6 symbols/min [2025-10-28T22:07:40.085073] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:40.088710] [INFO ] [MAIN ] AMBP: Generated 138 derivative records from 44285 primary records. [2025-10-28T22:07:40.088899] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-28T22:07:40.114151] [DEBUG] [LOCAL ] AMBP: Derivative data saved (138 records). [2025-10-28T22:07:40.114388] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-28T22:07:40.116874] [INFO ] [MAIN ] Derivative Progress: 72/2046 symbols completed. AMBP took 1.0s. Estimated remaining: 13m 34s. Rate: 145.5 symbols/min [2025-10-28T22:07:40.117163] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:40.137872] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-28T22:07:40.150460] [INFO ] [MAIN ] AMC: Loaded 53766 primary data records. [2025-10-28T22:07:40.315894] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-28T22:07:40.371276] [INFO ] [MAIN ] AMCR: Loaded 53670 primary data records. [2025-10-28T22:07:40.530218] [DEBUG] [LOCAL ] AME: Loaded 48323 existing records from primary storage. [2025-10-28T22:07:40.560560] [INFO ] [MAIN ] AME: Loaded 48323 primary data records. [2025-10-28T22:07:41.135955] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:41.175328] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:41.199185] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:41.239759] [INFO ] [MAIN ] AMC: Generated 138 derivative records from 53766 primary records. [2025-10-28T22:07:41.240018] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-28T22:07:41.254540] [DEBUG] [LOCAL ] AMC: Derivative data saved (138 records). [2025-10-28T22:07:41.256750] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-28T22:07:41.262900] [INFO ] [MAIN ] Derivative Progress: 73/2046 symbols completed. AMC took 1.2s. Estimated remaining: 13m 54s. Rate: 142.0 symbols/min [2025-10-28T22:07:41.273252] [INFO ] [MAIN ] AMCR: Generated 138 derivative records from 53670 primary records. [2025-10-28T22:07:41.273334] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-28T22:07:41.274843] [INFO ] [MAIN ] AME: Generated 138 derivative records from 48323 primary records. [2025-10-28T22:07:41.275350] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-28T22:07:41.297045] [DEBUG] [LOCAL ] AMCR: Derivative data saved (138 records). [2025-10-28T22:07:41.298431] [DEBUG] [LOCAL ] AME: Derivative data saved (138 records). [2025-10-28T22:07:41.298497] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-28T22:07:41.298579] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-28T22:07:41.300697] [INFO ] [MAIN ] Derivative Progress: 74/2046 symbols completed. AMCR took 1.2s. Estimated remaining: 13m 43s. Rate: 143.8 symbols/min [2025-10-28T22:07:41.303361] [INFO ] [MAIN ] Derivative Progress: 75/2046 symbols completed. AME took 1.2s. Estimated remaining: 13m 32s. Rate: 145.7 symbols/min [2025-10-28T22:07:41.303917] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:41.303988] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:41.304094] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:41.326106] [DEBUG] [LOCAL ] AMG: Loaded 19679 existing records from primary storage. [2025-10-28T22:07:41.326245] [INFO ] [MAIN ] AMG: Loaded 19679 primary data records. [2025-10-28T22:07:41.659631] [DEBUG] [LOCAL ] AMN: Loaded 41432 existing records from primary storage. [2025-10-28T22:07:41.660397] [DEBUG] [LOCAL ] AMH: Loaded 51788 existing records from primary storage. [2025-10-28T22:07:41.660485] [INFO ] [MAIN ] AMN: Loaded 41432 primary data records. [2025-10-28T22:07:41.660676] [INFO ] [MAIN ] AMH: Loaded 51788 primary data records. [2025-10-28T22:07:42.307967] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:42.356449] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:42.380366] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:42.407230] [INFO ] [MAIN ] AMG: Generated 138 derivative records from 19679 primary records. [2025-10-28T22:07:42.407474] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-28T22:07:42.426873] [DEBUG] [LOCAL ] AMG: Derivative data saved (138 records). [2025-10-28T22:07:42.426972] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-28T22:07:42.429714] [INFO ] [MAIN ] Derivative Progress: 76/2046 symbols completed. AMG took 1.1s. Estimated remaining: 13m 50s. Rate: 142.4 symbols/min [2025-10-28T22:07:42.429862] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:42.453602] [INFO ] [MAIN ] AMH: Generated 138 derivative records from 51788 primary records. [2025-10-28T22:07:42.463158] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-28T22:07:42.463093] [INFO ] [MAIN ] AMN: Generated 138 derivative records from 41432 primary records. [2025-10-28T22:07:42.463814] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-28T22:07:42.495061] [DEBUG] [LOCAL ] AMN: Derivative data saved (138 records). [2025-10-28T22:07:42.496072] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-28T22:07:42.497804] [INFO ] [MAIN ] Derivative Progress: 77/2046 symbols completed. AMN took 1.2s. Estimated remaining: 13m 40s. Rate: 144.0 symbols/min [2025-10-28T22:07:42.495948] [DEBUG] [LOCAL ] AMH: Derivative data saved (138 records). [2025-10-28T22:07:42.498070] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-28T22:07:42.498005] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:42.500417] [INFO ] [MAIN ] Derivative Progress: 78/2046 symbols completed. AMH took 1.2s. Estimated remaining: 13m 30s. Rate: 145.9 symbols/min [2025-10-28T22:07:42.501502] [DEBUG] [LOCAL ] AMP: Loaded 31273 existing records from primary storage. [2025-10-28T22:07:42.501910] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:42.502141] [INFO ] [MAIN ] AMP: Loaded 31273 primary data records. [2025-10-28T22:07:42.815188] [DEBUG] [LOCAL ] AMR: Loaded 28338 existing records from primary storage. [2025-10-28T22:07:42.815686] [INFO ] [MAIN ] AMR: Loaded 28338 primary data records. [2025-10-28T22:07:42.863402] [DEBUG] [LOCAL ] AMRC: Loaded 38167 existing records from primary storage. [2025-10-28T22:07:42.892452] [INFO ] [MAIN ] AMRC: Loaded 38167 primary data records. [2025-10-28T22:07:43.502549] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:07:43.563830] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:43.575877] [INFO ] [MAIN ] AMP: Generated 138 derivative records from 31273 primary records. [2025-10-28T22:07:43.579113] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-28T22:07:43.604860] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:43.620504] [DEBUG] [LOCAL ] AMP: Derivative data saved (138 records). [2025-10-28T22:07:43.621550] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-28T22:07:43.627780] [INFO ] [MAIN ] Derivative Progress: 79/2046 symbols completed. AMP took 1.2s. Estimated remaining: 13m 47s. Rate: 142.7 symbols/min [2025-10-28T22:07:43.627955] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:43.659914] [INFO ] [MAIN ] AMR: Generated 138 derivative records from 28338 primary records. [2025-10-28T22:07:43.661661] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-28T22:07:43.691404] [DEBUG] [LOCAL ] AMR: Derivative data saved (138 records). [2025-10-28T22:07:43.691491] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-28T22:07:43.694550] [INFO ] [MAIN ] Derivative Progress: 80/2046 symbols completed. AMR took 1.2s. Estimated remaining: 13m 38s. Rate: 144.2 symbols/min [2025-10-28T22:07:43.695208] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:43.697577] [INFO ] [MAIN ] AMRC: Generated 138 derivative records from 38167 primary records. [2025-10-28T22:07:43.698115] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-28T22:07:43.711583] [DEBUG] [LOCAL ] AMRC: Derivative data saved (138 records). [2025-10-28T22:07:43.725789] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-28T22:07:43.726561] [DEBUG] [LOCAL ] AMT: Loaded 52408 existing records from primary storage. [2025-10-28T22:07:43.729201] [INFO ] [MAIN ] AMT: Loaded 52408 primary data records. [2025-10-28T22:07:43.728954] [INFO ] [MAIN ] Derivative Progress: 81/2046 symbols completed. AMRC took 1.2s. Estimated remaining: 13m 28s. Rate: 145.9 symbols/min [2025-10-28T22:07:43.729440] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:43.845058] [DEBUG] [LOCAL ] AMTB: Loaded 20507 existing records from primary storage. [2025-10-28T22:07:43.844569] [DEBUG] [LOCAL ] AMTD: Loaded 3803 existing records from primary storage. [2025-10-28T22:07:43.848735] [INFO ] [MAIN ] AMTB: Loaded 20507 primary data records. [2025-10-28T22:07:43.848881] [INFO ] [MAIN ] AMTD: Loaded 3803 primary data records. [2025-10-28T22:07:44.748110] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:44.787201] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:44.818131] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:44.898396] [INFO ] [MAIN ] AMT: Generated 138 derivative records from 52408 primary records. [2025-10-28T22:07:44.898991] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-28T22:07:44.902767] [INFO ] [MAIN ] AMTB: Generated 138 derivative records from 20507 primary records. [2025-10-28T22:07:44.903512] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-28T22:07:44.916948] [DEBUG] [LOCAL ] AMT: Derivative data saved (138 records). [2025-10-28T22:07:44.917153] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-28T22:07:44.919345] [INFO ] [MAIN ] Derivative Progress: 82/2046 symbols completed. AMT took 1.3s. Estimated remaining: 13m 46s. Rate: 142.6 symbols/min [2025-10-28T22:07:44.927423] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:44.932683] [DEBUG] [LOCAL ] AMTB: Derivative data saved (138 records). [2025-10-28T22:07:44.935530] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-28T22:07:44.938021] [INFO ] [MAIN ] Derivative Progress: 83/2046 symbols completed. AMTB took 1.2s. Estimated remaining: 13m 36s. Rate: 144.3 symbols/min [2025-10-28T22:07:44.938302] [INFO ] [MAIN ] AMTD: Generated 138 derivative records from 3803 primary records. [2025-10-28T22:07:44.938607] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:44.938903] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-28T22:07:44.953745] [DEBUG] [LOCAL ] AMTD: Derivative data saved (138 records). [2025-10-28T22:07:44.953975] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-28T22:07:44.957097] [INFO ] [MAIN ] Derivative Progress: 84/2046 symbols completed. AMTD took 1.2s. Estimated remaining: 13m 27s. Rate: 145.9 symbols/min [2025-10-28T22:07:44.957373] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:44.962745] [DEBUG] [LOCAL ] AMWL: Loaded 9959 existing records from primary storage. [2025-10-28T22:07:44.962979] [INFO ] [MAIN ] AMWL: Loaded 9959 primary data records. [2025-10-28T22:07:45.179226] [DEBUG] [LOCAL ] AMTM: Loaded 50074 existing records from primary storage. [2025-10-28T22:07:45.192798] [INFO ] [MAIN ] AMTM: Loaded 50074 primary data records. [2025-10-28T22:07:45.432533] [DEBUG] [LOCAL ] AMX: Loaded 49047 existing records from primary storage. [2025-10-28T22:07:45.459368] [INFO ] [MAIN ] AMX: Loaded 49047 primary data records. [2025-10-28T22:07:45.971898] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:46.021761] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:46.069734] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:46.100436] [INFO ] [MAIN ] AMWL: Generated 138 derivative records from 9959 primary records. [2025-10-28T22:07:46.100751] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-28T22:07:46.122920] [DEBUG] [LOCAL ] AMWL: Derivative data saved (138 records). [2025-10-28T22:07:46.123311] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-28T22:07:46.127857] [INFO ] [MAIN ] Derivative Progress: 85/2046 symbols completed. AMWL took 1.2s. Estimated remaining: 13m 44s. Rate: 142.8 symbols/min [2025-10-28T22:07:46.128113] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:46.158011] [INFO ] [MAIN ] AMTM: Generated 138 derivative records from 50074 primary records. [2025-10-28T22:07:46.168821] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-28T22:07:46.184450] [DEBUG] [LOCAL ] AMTM: Derivative data saved (138 records). [2025-10-28T22:07:46.184615] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-28T22:07:46.172765] [INFO ] [MAIN ] AMX: Generated 138 derivative records from 49047 primary records. [2025-10-28T22:07:46.187563] [INFO ] [MAIN ] Derivative Progress: 86/2046 symbols completed. AMTM took 1.3s. Estimated remaining: 13m 35s. Rate: 144.2 symbols/min [2025-10-28T22:07:46.187736] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:46.187838] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-28T22:07:46.216414] [DEBUG] [LOCAL ] AMX: Derivative data saved (138 records). [2025-10-28T22:07:46.216707] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-28T22:07:46.218975] [INFO ] [MAIN ] Derivative Progress: 87/2046 symbols completed. AMX took 1.3s. Estimated remaining: 13m 26s. Rate: 145.8 symbols/min [2025-10-28T22:07:46.219172] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:46.221723] [DEBUG] [LOCAL ] AN: Loaded 30898 existing records from primary storage. [2025-10-28T22:07:46.222126] [INFO ] [MAIN ] AN: Loaded 30898 primary data records. [2025-10-28T22:07:46.640666] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-28T22:07:46.642359] [DEBUG] [LOCAL ] ANF: Loaded 51983 existing records from primary storage. [2025-10-28T22:07:46.643772] [INFO ] [MAIN ] ANF: Loaded 51983 primary data records. [2025-10-28T22:07:46.643906] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-28T22:07:47.313442] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:47.378880] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:47.379742] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:47.447007] [INFO ] [MAIN ] AN: Generated 138 derivative records from 30898 primary records. [2025-10-28T22:07:47.450824] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-28T22:07:47.468875] [DEBUG] [LOCAL ] AN: Derivative data saved (138 records). [2025-10-28T22:07:47.470851] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-28T22:07:47.474813] [INFO ] [MAIN ] Derivative Progress: 88/2046 symbols completed. AN took 1.3s. Estimated remaining: 13m 45s. Rate: 142.5 symbols/min [2025-10-28T22:07:47.490408] [INFO ] [MAIN ] ANET: Generated 138 derivative records from 53766 primary records. [2025-10-28T22:07:47.490614] [INFO ] [MAIN ] ANF: Generated 138 derivative records from 51983 primary records. [2025-10-28T22:07:47.490806] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-28T22:07:47.491180] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-28T22:07:47.514426] [DEBUG] [LOCAL ] ANF: Derivative data saved (138 records). [2025-10-28T22:07:47.515739] [DEBUG] [LOCAL ] ANET: Derivative data saved (138 records). [2025-10-28T22:07:47.515944] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-28T22:07:47.518088] [INFO ] [MAIN ] Derivative Progress: 89/2046 symbols completed. ANET took 1.3s. Estimated remaining: 13m 36s. Rate: 143.9 symbols/min [2025-10-28T22:07:47.518214] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-28T22:07:47.520637] [INFO ] [MAIN ] Derivative Progress: 90/2046 symbols completed. ANF took 1.3s. Estimated remaining: 13m 26s. Rate: 145.5 symbols/min [2025-10-28T22:07:47.521367] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:47.521232] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:47.521500] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:47.557386] [DEBUG] [LOCAL ] ANRO: Loaded 19705 existing records from primary storage. [2025-10-28T22:07:47.557741] [INFO ] [MAIN ] ANRO: Loaded 19705 primary data records. [2025-10-28T22:07:47.626007] [DEBUG] [LOCAL ] ANVS: Loaded 24020 existing records from primary storage. [2025-10-28T22:07:47.647771] [INFO ] [MAIN ] ANVS: Loaded 24020 primary data records. [2025-10-28T22:07:47.683102] [DEBUG] [LOCAL ] AOD: Loaded 30529 existing records from primary storage. [2025-10-28T22:07:47.727422] [INFO ] [MAIN ] AOD: Loaded 30529 primary data records. [2025-10-28T22:07:48.552016] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:48.569950] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:48.598882] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:48.683087] [INFO ] [MAIN ] ANVS: Generated 138 derivative records from 24020 primary records. [2025-10-28T22:07:48.683798] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-28T22:07:48.691742] [INFO ] [MAIN ] ANRO: Generated 138 derivative records from 19705 primary records. [2025-10-28T22:07:48.691512] [INFO ] [MAIN ] AOD: Generated 138 derivative records from 30529 primary records. [2025-10-28T22:07:48.701524] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-28T22:07:48.699070] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-28T22:07:48.704609] [DEBUG] [LOCAL ] ANVS: Derivative data saved (138 records). [2025-10-28T22:07:48.706083] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-28T22:07:48.709768] [INFO ] [MAIN ] Derivative Progress: 91/2046 symbols completed. ANVS took 1.2s. Estimated remaining: 13m 43s. Rate: 142.6 symbols/min [2025-10-28T22:07:48.719765] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:48.736569] [DEBUG] [LOCAL ] ANRO: Derivative data saved (138 records). [2025-10-28T22:07:48.732994] [DEBUG] [LOCAL ] AOD: Derivative data saved (138 records). [2025-10-28T22:07:48.737153] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-28T22:07:48.737269] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-28T22:07:48.739186] [INFO ] [MAIN ] Derivative Progress: 92/2046 symbols completed. ANRO took 1.2s. Estimated remaining: 13m 34s. Rate: 144.0 symbols/min [2025-10-28T22:07:48.742834] [INFO ] [MAIN ] Derivative Progress: 93/2046 symbols completed. AOD took 1.2s. Estimated remaining: 13m 25s. Rate: 145.6 symbols/min [2025-10-28T22:07:48.742767] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:48.743144] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:48.762234] [DEBUG] [LOCAL ] AOMR: Loaded 16020 existing records from primary storage. [2025-10-28T22:07:48.762526] [INFO ] [MAIN ] AOMR: Loaded 16020 primary data records. [2025-10-28T22:07:48.939362] [DEBUG] [LOCAL ] AORT: Loaded 28553 existing records from primary storage. [2025-10-28T22:07:48.948336] [INFO ] [MAIN ] AORT: Loaded 28553 primary data records. [2025-10-28T22:07:49.076246] [DEBUG] [LOCAL ] AON: Loaded 44821 existing records from primary storage. [2025-10-28T22:07:49.132942] [INFO ] [MAIN ] AON: Loaded 44821 primary data records. [2025-10-28T22:07:49.816044] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:49.816695] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:49.874954] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:49.946131] [INFO ] [MAIN ] AORT: Generated 138 derivative records from 28553 primary records. [2025-10-28T22:07:49.950929] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-28T22:07:49.951225] [INFO ] [MAIN ] AOMR: Generated 138 derivative records from 16020 primary records. [2025-10-28T22:07:49.965055] [DEBUG] [LOCAL ] AORT: Derivative data saved (138 records). [2025-10-28T22:07:49.960087] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-28T22:07:49.966516] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-28T22:07:49.969080] [INFO ] [MAIN ] Derivative Progress: 94/2046 symbols completed. AORT took 1.2s. Estimated remaining: 13m 41s. Rate: 142.6 symbols/min [2025-10-28T22:07:49.970309] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:49.986674] [DEBUG] [LOCAL ] AOMR: Derivative data saved (138 records). [2025-10-28T22:07:49.988029] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-28T22:07:49.991250] [INFO ] [MAIN ] Derivative Progress: 95/2046 symbols completed. AOMR took 1.3s. Estimated remaining: 13m 33s. Rate: 144.0 symbols/min [2025-10-28T22:07:49.993595] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:49.994542] [INFO ] [MAIN ] AON: Generated 138 derivative records from 44821 primary records. [2025-10-28T22:07:49.994762] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-28T22:07:50.010410] [DEBUG] [LOCAL ] AON: Derivative data saved (138 records). [2025-10-28T22:07:50.010666] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-28T22:07:50.013020] [INFO ] [MAIN ] Derivative Progress: 96/2046 symbols completed. AON took 1.3s. Estimated remaining: 13m 24s. Rate: 145.5 symbols/min [2025-10-28T22:07:50.013402] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:50.018541] [DEBUG] [LOCAL ] AP: Loaded 7489 existing records from primary storage. [2025-10-28T22:07:50.018987] [INFO ] [MAIN ] AP: Loaded 7489 primary data records. [2025-10-28T22:07:50.250067] [DEBUG] [LOCAL ] AOS: Loaded 48563 existing records from primary storage. [2025-10-28T22:07:50.393227] [INFO ] [MAIN ] AOS: Loaded 48563 primary data records. [2025-10-28T22:07:50.427168] [DEBUG] [LOCAL ] APAM: Loaded 35260 existing records from primary storage. [2025-10-28T22:07:50.432694] [INFO ] [MAIN ] APAM: Loaded 35260 primary data records. [2025-10-28T22:07:51.082028] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:51.126434] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:51.167215] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:51.229827] [INFO ] [MAIN ] AP: Generated 138 derivative records from 7489 primary records. [2025-10-28T22:07:51.236811] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-28T22:07:51.252679] [DEBUG] [LOCAL ] AP: Derivative data saved (138 records). [2025-10-28T22:07:51.257294] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-28T22:07:51.257456] [INFO ] [MAIN ] AOS: Generated 138 derivative records from 48563 primary records. [2025-10-28T22:07:51.260138] [INFO ] [MAIN ] Derivative Progress: 97/2046 symbols completed. AP took 1.3s. Estimated remaining: 13m 41s. Rate: 142.5 symbols/min [2025-10-28T22:07:51.257718] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-28T22:07:51.261335] [INFO ] [MAIN ] APAM: Generated 138 derivative records from 35260 primary records. [2025-10-28T22:07:51.260329] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:51.262180] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-28T22:07:51.290498] [DEBUG] [LOCAL ] AOS: Derivative data saved (138 records). [2025-10-28T22:07:51.290630] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-28T22:07:51.290346] [DEBUG] [LOCAL ] APAM: Derivative data saved (138 records). [2025-10-28T22:07:51.292728] [INFO ] [MAIN ] Derivative Progress: 98/2046 symbols completed. AOS took 1.3s. Estimated remaining: 13m 33s. Rate: 143.8 symbols/min [2025-10-28T22:07:51.293184] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:51.293010] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-28T22:07:51.296207] [INFO ] [MAIN ] Derivative Progress: 99/2046 symbols completed. APAM took 1.3s. Estimated remaining: 13m 24s. Rate: 145.3 symbols/min [2025-10-28T22:07:51.296519] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:51.344919] [DEBUG] [LOCAL ] APD: Loaded 45249 existing records from primary storage. [2025-10-28T22:07:51.345115] [INFO ] [MAIN ] APD: Loaded 45249 primary data records. [2025-10-28T22:07:51.500170] [DEBUG] [LOCAL ] APG: Loaded 50596 existing records from primary storage. [2025-10-28T22:07:51.511533] [INFO ] [MAIN ] APG: Loaded 50596 primary data records. [2025-10-28T22:07:51.588314] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-28T22:07:51.588498] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-28T22:07:52.328668] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:52.374114] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:52.408625] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:52.433302] [INFO ] [MAIN ] APD: Generated 138 derivative records from 45249 primary records. [2025-10-28T22:07:52.433730] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-28T22:07:52.454313] [DEBUG] [LOCAL ] APD: Derivative data saved (138 records). [2025-10-28T22:07:52.455412] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-28T22:07:52.458245] [INFO ] [MAIN ] Derivative Progress: 100/2046 symbols completed. APD took 1.2s. Estimated remaining: 13m 38s. Rate: 142.7 symbols/min [2025-10-28T22:07:52.463046] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:52.488126] [INFO ] [MAIN ] APH: Generated 138 derivative records from 53691 primary records. [2025-10-28T22:07:52.490395] [INFO ] [MAIN ] APG: Generated 138 derivative records from 50596 primary records. [2025-10-28T22:07:52.490095] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-28T22:07:52.490527] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-28T22:07:52.511621] [DEBUG] [LOCAL ] APH: Derivative data saved (138 records). [2025-10-28T22:07:52.513301] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-28T22:07:52.518796] [DEBUG] [LOCAL ] APG: Derivative data saved (138 records). [2025-10-28T22:07:52.518709] [INFO ] [MAIN ] Derivative Progress: 101/2046 symbols completed. APH took 1.2s. Estimated remaining: 13m 31s. Rate: 143.9 symbols/min [2025-10-28T22:07:52.519246] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-28T22:07:52.519091] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:52.522137] [INFO ] [MAIN ] Derivative Progress: 102/2046 symbols completed. APG took 1.2s. Estimated remaining: 13m 22s. Rate: 145.3 symbols/min [2025-10-28T22:07:52.522825] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:52.546428] [DEBUG] [LOCAL ] APOS: Loaded 6792 existing records from primary storage. [2025-10-28T22:07:52.546666] [INFO ] [MAIN ] APOS: Loaded 6792 primary data records. [2025-10-28T22:07:52.674485] [DEBUG] [LOCAL ] APLE: Loaded 51897 existing records from primary storage. [2025-10-28T22:07:52.685670] [INFO ] [MAIN ] APLE: Loaded 51897 primary data records. [2025-10-28T22:07:53.014891] [DEBUG] [LOCAL ] APO: Loaded 53369 existing records from primary storage. [2025-10-28T22:07:53.026726] [INFO ] [MAIN ] APO: Loaded 53369 primary data records. [2025-10-28T22:07:53.559828] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:53.622011] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:53.622398] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:53.657735] [INFO ] [MAIN ] APOS: Generated 138 derivative records from 6792 primary records. [2025-10-28T22:07:53.658826] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-28T22:07:53.676750] [DEBUG] [LOCAL ] APOS: Derivative data saved (138 records). [2025-10-28T22:07:53.680097] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-28T22:07:53.682874] [INFO ] [MAIN ] Derivative Progress: 103/2046 symbols completed. APOS took 1.2s. Estimated remaining: 13m 36s. Rate: 142.8 symbols/min [2025-10-28T22:07:53.707587] [INFO ] [MAIN ] APLE: Generated 138 derivative records from 51897 primary records. [2025-10-28T22:07:53.708767] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-28T22:07:53.711249] [INFO ] [MAIN ] APO: Generated 138 derivative records from 53369 primary records. [2025-10-28T22:07:53.711331] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-28T22:07:53.738934] [DEBUG] [LOCAL ] APO: Derivative data saved (138 records). [2025-10-28T22:07:53.740375] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-28T22:07:53.743263] [INFO ] [MAIN ] Derivative Progress: 104/2046 symbols completed. APO took 1.2s. Estimated remaining: 13m 29s. Rate: 144.0 symbols/min [2025-10-28T22:07:53.743367] [DEBUG] [LOCAL ] APLE: Derivative data saved (138 records). [2025-10-28T22:07:53.743576] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-28T22:07:53.746138] [INFO ] [MAIN ] Derivative Progress: 105/2046 symbols completed. APLE took 1.3s. Estimated remaining: 13m 21s. Rate: 145.4 symbols/min [2025-10-28T22:07:53.746550] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:53.746959] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:53.746659] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:53.755697] [DEBUG] [LOCAL ] AQNB: Loaded 3742 existing records from primary storage. [2025-10-28T22:07:53.755933] [INFO ] [MAIN ] AQNB: Loaded 3742 primary data records. [2025-10-28T22:07:54.128142] [DEBUG] [LOCAL ] APTV: Loaded 51726 existing records from primary storage. [2025-10-28T22:07:54.129823] [INFO ] [MAIN ] APTV: Loaded 51726 primary data records. [2025-10-28T22:07:54.129732] [DEBUG] [LOCAL ] AQN: Loaded 51564 existing records from primary storage. [2025-10-28T22:07:54.135345] [INFO ] [MAIN ] AQN: Loaded 51564 primary data records. [2025-10-28T22:07:54.740001] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:54.790420] [INFO ] [MAIN ] AQNB: Generated 138 derivative records from 3742 primary records. [2025-10-28T22:07:54.816144] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-28T22:07:54.815884] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:54.816463] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:54.854738] [DEBUG] [LOCAL ] AQNB: Derivative data saved (138 records). [2025-10-28T22:07:54.855158] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-28T22:07:54.862274] [INFO ] [MAIN ] Derivative Progress: 106/2046 symbols completed. AQNB took 1.1s. Estimated remaining: 13m 33s. Rate: 143.1 symbols/min [2025-10-28T22:07:54.867889] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:54.894980] [INFO ] [MAIN ] AQN: Generated 138 derivative records from 51564 primary records. [2025-10-28T22:07:54.895443] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-28T22:07:54.920469] [DEBUG] [LOCAL ] AQN: Derivative data saved (138 records). [2025-10-28T22:07:54.920709] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-28T22:07:54.923234] [INFO ] [MAIN ] Derivative Progress: 107/2046 symbols completed. AQN took 1.2s. Estimated remaining: 13m 27s. Rate: 144.2 symbols/min [2025-10-28T22:07:54.925390] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:54.940378] [INFO ] [MAIN ] APTV: Generated 138 derivative records from 51726 primary records. [2025-10-28T22:07:54.940626] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-28T22:07:54.942028] [DEBUG] [LOCAL ] ARCO: Loaded 43944 existing records from primary storage. [2025-10-28T22:07:54.949469] [INFO ] [MAIN ] ARCO: Loaded 43944 primary data records. [2025-10-28T22:07:54.990210] [DEBUG] [LOCAL ] APTV: Derivative data saved (138 records). [2025-10-28T22:07:55.014772] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-28T22:07:55.025978] [INFO ] [MAIN ] Derivative Progress: 108/2046 symbols completed. APTV took 1.3s. Estimated remaining: 13m 20s. Rate: 145.3 symbols/min [2025-10-28T22:07:55.043103] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:55.043490] [DEBUG] [LOCAL ] ARDC: Loaded 14875 existing records from primary storage. [2025-10-28T22:07:55.054373] [INFO ] [MAIN ] ARDC: Loaded 14875 primary data records. [2025-10-28T22:07:55.618920] [DEBUG] [LOCAL ] ARES: Loaded 49590 existing records from primary storage. [2025-10-28T22:07:55.619534] [INFO ] [MAIN ] ARES: Loaded 49590 primary data records. [2025-10-28T22:07:55.758885] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:55.843081] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:56.023486] [INFO ] [MAIN ] ARCO: Generated 138 derivative records from 43944 primary records. [2025-10-28T22:07:56.024980] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-28T22:07:56.041746] [DEBUG] [LOCAL ] ARCO: Derivative data saved (138 records). [2025-10-28T22:07:56.043390] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-28T22:07:56.045252] [INFO ] [MAIN ] Derivative Progress: 109/2046 symbols completed. ARCO took 1.2s. Estimated remaining: 13m 31s. Rate: 143.3 symbols/min [2025-10-28T22:07:56.045555] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:56.061465] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:56.061140] [INFO ] [MAIN ] ARDC: Generated 138 derivative records from 14875 primary records. [2025-10-28T22:07:56.061741] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-28T22:07:56.097362] [DEBUG] [LOCAL ] ARDC: Derivative data saved (138 records). [2025-10-28T22:07:56.097838] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-28T22:07:56.100321] [INFO ] [MAIN ] Derivative Progress: 110/2046 symbols completed. ARDC took 1.2s. Estimated remaining: 13m 24s. Rate: 144.5 symbols/min [2025-10-28T22:07:56.102539] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:56.136892] [INFO ] [MAIN ] ARES: Generated 138 derivative records from 49590 primary records. [2025-10-28T22:07:56.137055] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-28T22:07:56.169626] [DEBUG] [LOCAL ] ARES: Derivative data saved (138 records). [2025-10-28T22:07:56.169922] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-28T22:07:56.172148] [INFO ] [MAIN ] Derivative Progress: 111/2046 symbols completed. ARES took 1.1s. Estimated remaining: 13m 18s. Rate: 145.6 symbols/min [2025-10-28T22:07:56.180876] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:56.182882] [DEBUG] [LOCAL ] ARI: Loaded 43095 existing records from primary storage. [2025-10-28T22:07:56.183155] [INFO ] [MAIN ] ARI: Loaded 43095 primary data records. [2025-10-28T22:07:56.308595] [DEBUG] [LOCAL ] ARLO: Loaded 43466 existing records from primary storage. [2025-10-28T22:07:56.324604] [INFO ] [MAIN ] ARLO: Loaded 43466 primary data records. [2025-10-28T22:07:56.638511] [DEBUG] [LOCAL ] ARMK: Loaded 50219 existing records from primary storage. [2025-10-28T22:07:56.654828] [INFO ] [MAIN ] ARMK: Loaded 50219 primary data records. [2025-10-28T22:07:57.191240] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:57.233683] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:57.275405] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:57.309888] [INFO ] [MAIN ] ARI: Generated 138 derivative records from 43095 primary records. [2025-10-28T22:07:57.312686] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-28T22:07:57.330981] [DEBUG] [LOCAL ] ARI: Derivative data saved (138 records). [2025-10-28T22:07:57.333311] [INFO ] [MAIN ] ARLO: Generated 138 derivative records from 43466 primary records. [2025-10-28T22:07:57.333147] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-28T22:07:57.335369] [INFO ] [MAIN ] Derivative Progress: 112/2046 symbols completed. ARI took 1.3s. Estimated remaining: 13m 30s. Rate: 143.2 symbols/min [2025-10-28T22:07:57.333476] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-28T22:07:57.335625] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:57.351479] [DEBUG] [LOCAL ] ARLO: Derivative data saved (138 records). [2025-10-28T22:07:57.351778] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-28T22:07:57.357239] [INFO ] [MAIN ] Derivative Progress: 113/2046 symbols completed. ARLO took 1.3s. Estimated remaining: 13m 23s. Rate: 144.4 symbols/min [2025-10-28T22:07:57.357619] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:57.365587] [INFO ] [MAIN ] ARMK: Generated 138 derivative records from 50219 primary records. [2025-10-28T22:07:57.365843] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-28T22:07:57.378333] [DEBUG] [LOCAL ] ARMK: Derivative data saved (138 records). [2025-10-28T22:07:57.378437] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-28T22:07:57.380948] [INFO ] [MAIN ] Derivative Progress: 114/2046 symbols completed. ARMK took 1.2s. Estimated remaining: 13m 16s. Rate: 145.6 symbols/min [2025-10-28T22:07:57.381195] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:57.432051] [DEBUG] [LOCAL ] ARW: Loaded 32848 existing records from primary storage. [2025-10-28T22:07:57.431498] [DEBUG] [LOCAL ] AROC: Loaded 48992 existing records from primary storage. [2025-10-28T22:07:57.432437] [INFO ] [MAIN ] ARW: Loaded 32848 primary data records. [2025-10-28T22:07:57.432522] [INFO ] [MAIN ] AROC: Loaded 48992 primary data records. [2025-10-28T22:07:57.955711] [DEBUG] [LOCAL ] AS: Loaded 53194 existing records from primary storage. [2025-10-28T22:07:58.083852] [INFO ] [MAIN ] AS: Loaded 53194 primary data records. [2025-10-28T22:07:58.424491] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:58.455809] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:58.498349] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:58.547997] [INFO ] [MAIN ] ARW: Generated 138 derivative records from 32848 primary records. [2025-10-28T22:07:58.546172] [INFO ] [MAIN ] AROC: Generated 138 derivative records from 48992 primary records. [2025-10-28T22:07:58.548312] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-28T22:07:58.548442] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-28T22:07:58.563932] [DEBUG] [LOCAL ] ARW: Derivative data saved (138 records). [2025-10-28T22:07:58.564139] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-28T22:07:58.573703] [INFO ] [MAIN ] Derivative Progress: 115/2046 symbols completed. ARW took 1.2s. Estimated remaining: 13m 29s. Rate: 143.3 symbols/min [2025-10-28T22:07:58.578313] [DEBUG] [LOCAL ] AROC: Derivative data saved (138 records). [2025-10-28T22:07:58.579523] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:58.579450] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-28T22:07:58.582111] [INFO ] [MAIN ] Derivative Progress: 116/2046 symbols completed. AROC took 1.2s. Estimated remaining: 13m 21s. Rate: 144.5 symbols/min [2025-10-28T22:07:58.582824] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:58.590405] [INFO ] [MAIN ] AS: Generated 138 derivative records from 53194 primary records. [2025-10-28T22:07:58.590711] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-28T22:07:58.608557] [DEBUG] [LOCAL ] AS: Derivative data saved (138 records). [2025-10-28T22:07:58.608696] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-28T22:07:58.611033] [INFO ] [MAIN ] Derivative Progress: 117/2046 symbols completed. AS took 1.2s. Estimated remaining: 13m 15s. Rate: 145.7 symbols/min [2025-10-28T22:07:58.611375] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:58.618291] [DEBUG] [LOCAL ] ASA: Loaded 15914 existing records from primary storage. [2025-10-28T22:07:58.618842] [INFO ] [MAIN ] ASA: Loaded 15914 primary data records. [2025-10-28T22:07:58.955188] [DEBUG] [LOCAL ] ASAN: Loaded 52705 existing records from primary storage. [2025-10-28T22:07:58.955575] [INFO ] [MAIN ] ASAN: Loaded 52705 primary data records. [2025-10-28T22:07:59.076129] [DEBUG] [LOCAL ] ASB: Loaded 49640 existing records from primary storage. [2025-10-28T22:07:59.076746] [INFO ] [MAIN ] ASB: Loaded 49640 primary data records. [2025-10-28T22:07:59.617685] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:59.662584] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:59.701555] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:07:59.723896] [INFO ] [MAIN ] ASA: Generated 138 derivative records from 15914 primary records. [2025-10-28T22:07:59.725756] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-28T22:07:59.745924] [DEBUG] [LOCAL ] ASA: Derivative data saved (138 records). [2025-10-28T22:07:59.749329] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-28T22:07:59.752516] [INFO ] [MAIN ] Derivative Progress: 118/2046 symbols completed. ASA took 1.2s. Estimated remaining: 13m 26s. Rate: 143.5 symbols/min [2025-10-28T22:07:59.767732] [INFO ] [MAIN ] ASAN: Generated 138 derivative records from 52705 primary records. [2025-10-28T22:07:59.769761] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-28T22:07:59.783045] [INFO ] [MAIN ] ASB: Generated 138 derivative records from 49640 primary records. [2025-10-28T22:07:59.783472] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-28T22:07:59.785344] [DEBUG] [LOCAL ] ASAN: Derivative data saved (138 records). [2025-10-28T22:07:59.785549] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-28T22:07:59.787263] [INFO ] [MAIN ] Derivative Progress: 119/2046 symbols completed. ASAN took 1.2s. Estimated remaining: 13m 19s. Rate: 144.6 symbols/min [2025-10-28T22:07:59.798786] [DEBUG] [LOCAL ] ASB: Derivative data saved (138 records). [2025-10-28T22:07:59.798843] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-28T22:07:59.801954] [INFO ] [MAIN ] Derivative Progress: 120/2046 symbols completed. ASB took 1.2s. Estimated remaining: 13m 13s. Rate: 145.8 symbols/min [2025-10-28T22:07:59.802324] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:59.802810] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:59.802617] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:07:59.808559] [DEBUG] [LOCAL ] ASBA: Loaded 3412 existing records from primary storage. [2025-10-28T22:07:59.808807] [INFO ] [MAIN ] ASBA: Loaded 3412 primary data records. [2025-10-28T22:07:59.944178] [DEBUG] [LOCAL ] ASG: Loaded 19022 existing records from primary storage. [2025-10-28T22:07:59.972766] [INFO ] [MAIN ] ASG: Loaded 19022 primary data records. [2025-10-28T22:08:00.231080] [DEBUG] [LOCAL ] ASC: Loaded 36901 existing records from primary storage. [2025-10-28T22:08:00.248671] [INFO ] [MAIN ] ASC: Loaded 36901 primary data records. [2025-10-28T22:08:00.763072] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-28T22:08:00.796927] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:00.848239] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:00.877506] [INFO ] [MAIN ] ASBA: Generated 138 derivative records from 3412 primary records. [2025-10-28T22:08:00.878823] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-28T22:08:00.899116] [DEBUG] [LOCAL ] ASBA: Derivative data saved (138 records). [2025-10-28T22:08:00.899350] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-28T22:08:00.902297] [INFO ] [MAIN ] Derivative Progress: 121/2046 symbols completed. ASBA took 1.1s. Estimated remaining: 13m 23s. Rate: 143.8 symbols/min [2025-10-28T22:08:00.903863] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:00.904891] [INFO ] [MAIN ] ASG: Generated 138 derivative records from 19022 primary records. [2025-10-28T22:08:00.906849] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-28T22:08:00.926246] [DEBUG] [LOCAL ] ASG: Derivative data saved (138 records). [2025-10-28T22:08:00.926716] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-28T22:08:00.929199] [INFO ] [MAIN ] Derivative Progress: 122/2046 symbols completed. ASG took 1.1s. Estimated remaining: 13m 17s. Rate: 144.9 symbols/min [2025-10-28T22:08:00.931409] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:00.945060] [INFO ] [MAIN ] ASC: Generated 138 derivative records from 36901 primary records. [2025-10-28T22:08:00.945542] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-28T22:08:00.964125] [DEBUG] [LOCAL ] ASGI: Loaded 22642 existing records from primary storage. [2025-10-28T22:08:00.966067] [DEBUG] [LOCAL ] ASC: Derivative data saved (138 records). [2025-10-28T22:08:00.966243] [INFO ] [MAIN ] ASGI: Loaded 22642 primary data records. [2025-10-28T22:08:00.966366] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-28T22:08:00.968800] [INFO ] [MAIN ] Derivative Progress: 123/2046 symbols completed. ASC took 1.2s. Estimated remaining: 13m 10s. Rate: 146.0 symbols/min [2025-10-28T22:08:00.968941] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:01.092316] [DEBUG] [LOCAL ] ASGN: Loaded 36761 existing records from primary storage. [2025-10-28T22:08:01.098677] [INFO ] [MAIN ] ASGN: Loaded 36761 primary data records. [2025-10-28T22:08:01.367922] [DEBUG] [LOCAL ] ASH: Loaded 37028 existing records from primary storage. [2025-10-28T22:08:01.377473] [INFO ] [MAIN ] ASH: Loaded 37028 primary data records. [2025-10-28T22:08:01.968210] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:02.028727] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:02.036289] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:02.073108] [INFO ] [MAIN ] ASGI: Generated 138 derivative records from 22642 primary records. [2025-10-28T22:08:02.074167] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-28T22:08:02.093513] [DEBUG] [LOCAL ] ASGI: Derivative data saved (138 records). [2025-10-28T22:08:02.093762] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-28T22:08:02.096302] [INFO ] [MAIN ] Derivative Progress: 124/2046 symbols completed. ASGI took 1.2s. Estimated remaining: 13m 21s. Rate: 144.0 symbols/min [2025-10-28T22:08:02.098935] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:02.142171] [INFO ] [MAIN ] ASH: Generated 138 derivative records from 37028 primary records. [2025-10-28T22:08:02.142728] [DEBUG] [LOCAL ] ASIX: Loaded 22656 existing records from primary storage. [2025-10-28T22:08:02.142970] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-28T22:08:02.145066] [INFO ] [MAIN ] ASIX: Loaded 22656 primary data records. [2025-10-28T22:08:02.145353] [INFO ] [MAIN ] ASGN: Generated 138 derivative records from 36761 primary records. [2025-10-28T22:08:02.177111] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-28T22:08:02.243581] [DEBUG] [LOCAL ] ASH: Derivative data saved (138 records). [2025-10-28T22:08:02.251696] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-28T22:08:02.256926] [DEBUG] [LOCAL ] ASGN: Derivative data saved (138 records). [2025-10-28T22:08:02.265430] [INFO ] [MAIN ] Derivative Progress: 125/2046 symbols completed. ASH took 1.3s. Estimated remaining: 13m 17s. Rate: 144.7 symbols/min [2025-10-28T22:08:02.273387] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-28T22:08:02.279960] [INFO ] [MAIN ] Derivative Progress: 126/2046 symbols completed. ASGN took 1.3s. Estimated remaining: 13m 10s. Rate: 145.8 symbols/min [2025-10-28T22:08:02.276266] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:02.280666] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:02.540536] [DEBUG] [LOCAL ] ASPN: Loaded 49760 existing records from primary storage. [2025-10-28T22:08:02.553439] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:02.553177] [INFO ] [MAIN ] ASPN: Loaded 49760 primary data records. [2025-10-28T22:08:02.686565] [DEBUG] [LOCAL ] ASX: Loaded 52851 existing records from primary storage. [2025-10-28T22:08:02.693483] [INFO ] [MAIN ] ASX: Loaded 52851 primary data records. [2025-10-28T22:08:03.206619] [INFO ] [MAIN ] ASIX: Generated 138 derivative records from 22656 primary records. [2025-10-28T22:08:03.207273] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-28T22:08:03.220989] [DEBUG] [LOCAL ] ASIX: Derivative data saved (138 records). [2025-10-28T22:08:03.221183] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-28T22:08:03.223503] [INFO ] [MAIN ] Derivative Progress: 127/2046 symbols completed. ASIX took 1.1s. Estimated remaining: 13m 18s. Rate: 144.3 symbols/min [2025-10-28T22:08:03.224957] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:03.240592] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:03.274842] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:03.330103] [DEBUG] [LOCAL ] ATEN: Loaded 37208 existing records from primary storage. [2025-10-28T22:08:03.336414] [INFO ] [MAIN ] ATEN: Loaded 37208 primary data records. [2025-10-28T22:08:03.336743] [INFO ] [MAIN ] ASPN: Generated 138 derivative records from 49760 primary records. [2025-10-28T22:08:03.383911] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-28T22:08:03.456188] [DEBUG] [LOCAL ] ASPN: Derivative data saved (138 records). [2025-10-28T22:08:03.467073] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-28T22:08:03.476307] [INFO ] [MAIN ] Derivative Progress: 128/2046 symbols completed. ASPN took 1.2s. Estimated remaining: 13m 15s. Rate: 144.7 symbols/min [2025-10-28T22:08:03.481821] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:03.690267] [INFO ] [MAIN ] ASX: Generated 138 derivative records from 52851 primary records. [2025-10-28T22:08:03.690618] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-28T22:08:03.711452] [DEBUG] [LOCAL ] ASX: Derivative data saved (138 records). [2025-10-28T22:08:03.712763] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-28T22:08:03.715265] [INFO ] [MAIN ] Derivative Progress: 129/2046 symbols completed. ASX took 1.4s. Estimated remaining: 13m 12s. Rate: 145.2 symbols/min [2025-10-28T22:08:03.715759] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:03.730371] [DEBUG] [LOCAL ] ATGE: Loaded 29751 existing records from primary storage. [2025-10-28T22:08:03.730757] [INFO ] [MAIN ] ATGE: Loaded 29751 primary data records. [2025-10-28T22:08:03.860603] [DEBUG] [LOCAL ] ATHM: Loaded 30483 existing records from primary storage. [2025-10-28T22:08:03.894075] [INFO ] [MAIN ] ATHM: Loaded 30483 primary data records. [2025-10-28T22:08:03.899808] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:04.418430] [INFO ] [MAIN ] ATEN: Generated 138 derivative records from 37208 primary records. [2025-10-28T22:08:04.418787] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-28T22:08:04.432355] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:04.456382] [DEBUG] [LOCAL ] ATEN: Derivative data saved (138 records). [2025-10-28T22:08:04.458256] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-28T22:08:04.462177] [INFO ] [MAIN ] Derivative Progress: 130/2046 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 17s. Rate: 144.3 symbols/min [2025-10-28T22:08:04.462554] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:04.488424] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:04.508729] [DEBUG] [LOCAL ] ATHS: Loaded 6279 existing records from primary storage. [2025-10-28T22:08:04.511669] [INFO ] [MAIN ] ATHS: Loaded 6279 primary data records. [2025-10-28T22:08:04.654459] [INFO ] [MAIN ] ATGE: Generated 138 derivative records from 29751 primary records. [2025-10-28T22:08:04.682966] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-28T22:08:04.854303] [DEBUG] [LOCAL ] ATGE: Derivative data saved (138 records). [2025-10-28T22:08:04.854790] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-28T22:08:04.856825] [INFO ] [MAIN ] Derivative Progress: 131/2046 symbols completed. ATGE took 1.4s. Estimated remaining: 13m 16s. Rate: 144.4 symbols/min [2025-10-28T22:08:04.858563] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:04.869849] [INFO ] [MAIN ] ATHM: Generated 138 derivative records from 30483 primary records. [2025-10-28T22:08:04.870244] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-28T22:08:04.884291] [DEBUG] [LOCAL ] ATHM: Derivative data saved (138 records). [2025-10-28T22:08:04.884674] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-28T22:08:04.887098] [INFO ] [MAIN ] Derivative Progress: 132/2046 symbols completed. ATHM took 1.2s. Estimated remaining: 13m 10s. Rate: 145.4 symbols/min [2025-10-28T22:08:04.887440] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:04.918410] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:04.949616] [DEBUG] [LOCAL ] ATI: Loaded 51276 existing records from primary storage. [2025-10-28T22:08:04.950301] [INFO ] [MAIN ] ATI: Loaded 51276 primary data records. [2025-10-28T22:08:05.065304] [DEBUG] [LOCAL ] ATKR: Loaded 34337 existing records from primary storage. [2025-10-28T22:08:05.079276] [INFO ] [MAIN ] ATKR: Loaded 34337 primary data records. [2025-10-28T22:08:05.623550] [INFO ] [MAIN ] ATHS: Generated 138 derivative records from 6279 primary records. [2025-10-28T22:08:05.623754] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-28T22:08:05.637743] [DEBUG] [LOCAL ] ATHS: Derivative data saved (138 records). [2025-10-28T22:08:05.638965] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-28T22:08:05.641064] [INFO ] [MAIN ] Derivative Progress: 133/2046 symbols completed. ATHS took 1.2s. Estimated remaining: 13m 14s. Rate: 144.5 symbols/min [2025-10-28T22:08:05.662131] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:05.707414] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:05.748474] [INFO ] [MAIN ] ATI: Generated 138 derivative records from 51276 primary records. [2025-10-28T22:08:05.748891] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-28T22:08:05.764961] [DEBUG] [LOCAL ] ATI: Derivative data saved (138 records). [2025-10-28T22:08:05.766088] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-28T22:08:05.768598] [INFO ] [MAIN ] Derivative Progress: 134/2046 symbols completed. ATI took 0.9s. Estimated remaining: 13m 10s. Rate: 145.3 symbols/min [2025-10-28T22:08:05.776099] [INFO ] [MAIN ] ATKR: Generated 138 derivative records from 34337 primary records. [2025-10-28T22:08:05.776283] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-28T22:08:05.788283] [DEBUG] [LOCAL ] ATKR: Derivative data saved (138 records). [2025-10-28T22:08:05.788340] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-28T22:08:05.791424] [INFO ] [MAIN ] Derivative Progress: 135/2046 symbols completed. ATKR took 0.9s. Estimated remaining: 13m 4s. Rate: 146.3 symbols/min [2025-10-28T22:08:05.791929] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:05.791868] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:05.792026] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:05.863524] [DEBUG] [LOCAL ] ATR: Loaded 30316 existing records from primary storage. [2025-10-28T22:08:05.864285] [INFO ] [MAIN ] ATR: Loaded 30316 primary data records. [2025-10-28T22:08:05.864976] [DEBUG] [LOCAL ] ATO: Loaded 41194 existing records from primary storage. [2025-10-28T22:08:05.864151] [DEBUG] [LOCAL ] ATMU: Loaded 38125 existing records from primary storage. [2025-10-28T22:08:05.885936] [INFO ] [MAIN ] ATMU: Loaded 38125 primary data records. [2025-10-28T22:08:05.896300] [INFO ] [MAIN ] ATO: Loaded 41194 primary data records. [2025-10-28T22:08:06.811127] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:06.812234] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:06.853708] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:06.930353] [INFO ] [MAIN ] ATMU: Generated 138 derivative records from 38125 primary records. [2025-10-28T22:08:06.931025] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-28T22:08:06.935080] [INFO ] [MAIN ] ATO: Generated 138 derivative records from 41194 primary records. [2025-10-28T22:08:06.947045] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-28T22:08:06.947760] [DEBUG] [LOCAL ] ATMU: Derivative data saved (138 records). [2025-10-28T22:08:06.949717] [INFO ] [MAIN ] ATR: Generated 138 derivative records from 30316 primary records. [2025-10-28T22:08:06.950540] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-28T22:08:06.950903] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-28T22:08:06.964063] [INFO ] [MAIN ] Derivative Progress: 136/2046 symbols completed. ATMU took 1.2s. Estimated remaining: 13m 14s. Rate: 144.3 symbols/min [2025-10-28T22:08:06.965558] [DEBUG] [LOCAL ] ATO: Derivative data saved (138 records). [2025-10-28T22:08:06.966032] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:06.965926] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-28T22:08:06.980498] [DEBUG] [LOCAL ] ATR: Derivative data saved (138 records). [2025-10-28T22:08:06.977381] [INFO ] [MAIN ] Derivative Progress: 137/2046 symbols completed. ATO took 1.2s. Estimated remaining: 13m 8s. Rate: 145.3 symbols/min [2025-10-28T22:08:06.980731] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:06.981204] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-28T22:08:06.983435] [INFO ] [MAIN ] Derivative Progress: 138/2046 symbols completed. ATR took 1.2s. Estimated remaining: 13m 2s. Rate: 146.4 symbols/min [2025-10-28T22:08:06.983813] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:06.998397] [DEBUG] [LOCAL ] ATS: Loaded 16453 existing records from primary storage. [2025-10-28T22:08:06.998529] [INFO ] [MAIN ] ATS: Loaded 16453 primary data records. [2025-10-28T22:08:07.339713] [DEBUG] [LOCAL ] ATUS: Loaded 49952 existing records from primary storage. [2025-10-28T22:08:07.340531] [INFO ] [MAIN ] ATUS: Loaded 49952 primary data records. [2025-10-28T22:08:07.421195] [DEBUG] [LOCAL ] AU: Loaded 53074 existing records from primary storage. [2025-10-28T22:08:07.460619] [INFO ] [MAIN ] AU: Loaded 53074 primary data records. [2025-10-28T22:08:08.027911] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:08.067846] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:08.108476] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:08.144518] [INFO ] [MAIN ] ATS: Generated 138 derivative records from 16453 primary records. [2025-10-28T22:08:08.146796] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-28T22:08:08.162146] [DEBUG] [LOCAL ] ATS: Derivative data saved (138 records). [2025-10-28T22:08:08.164725] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-28T22:08:08.168887] [INFO ] [MAIN ] Derivative Progress: 139/2046 symbols completed. ATS took 1.2s. Estimated remaining: 13m 12s. Rate: 144.4 symbols/min [2025-10-28T22:08:08.169478] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:08.182466] [INFO ] [MAIN ] ATUS: Generated 138 derivative records from 49952 primary records. [2025-10-28T22:08:08.185041] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-28T22:08:08.201237] [DEBUG] [LOCAL ] ATUS: Derivative data saved (138 records). [2025-10-28T22:08:08.201410] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-28T22:08:08.201599] [INFO ] [MAIN ] AU: Generated 138 derivative records from 53074 primary records. [2025-10-28T22:08:08.203595] [INFO ] [MAIN ] Derivative Progress: 140/2046 symbols completed. ATUS took 1.2s. Estimated remaining: 13m 7s. Rate: 145.4 symbols/min [2025-10-28T22:08:08.203891] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:08.204118] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-28T22:08:08.227041] [DEBUG] [LOCAL ] AU: Derivative data saved (138 records). [2025-10-28T22:08:08.227326] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-28T22:08:08.229412] [INFO ] [MAIN ] Derivative Progress: 141/2046 symbols completed. AU took 1.2s. Estimated remaining: 13m 1s. Rate: 146.3 symbols/min [2025-10-28T22:08:08.229598] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:08.246460] [DEBUG] [LOCAL ] AUB: Loaded 45626 existing records from primary storage. [2025-10-28T22:08:08.246682] [INFO ] [MAIN ] AUB: Loaded 45626 primary data records. [2025-10-28T22:08:08.271846] [DEBUG] [LOCAL ] AVAL: Loaded 8308 existing records from primary storage. [2025-10-28T22:08:08.287596] [INFO ] [MAIN ] AVAL: Loaded 8308 primary data records. [2025-10-28T22:08:08.481781] [DEBUG] [LOCAL ] AVA: Loaded 37896 existing records from primary storage. [2025-10-28T22:08:08.487545] [INFO ] [MAIN ] AVA: Loaded 37896 primary data records. [2025-10-28T22:08:09.246111] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:09.271629] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:09.322592] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:09.369985] [INFO ] [MAIN ] AUB: Generated 138 derivative records from 45626 primary records. [2025-10-28T22:08:09.373410] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-28T22:08:09.373875] [INFO ] [MAIN ] AVAL: Generated 138 derivative records from 8308 primary records. [2025-10-28T22:08:09.374545] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-28T22:08:09.389791] [DEBUG] [LOCAL ] AUB: Derivative data saved (138 records). [2025-10-28T22:08:09.399380] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-28T22:08:09.406389] [INFO ] [MAIN ] Derivative Progress: 142/2046 symbols completed. AUB took 1.2s. Estimated remaining: 13m 11s. Rate: 144.4 symbols/min [2025-10-28T22:08:09.407053] [DEBUG] [LOCAL ] AVAL: Derivative data saved (138 records). [2025-10-28T22:08:09.407273] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-28T22:08:09.407492] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:09.409461] [INFO ] [MAIN ] Derivative Progress: 143/2046 symbols completed. AVAL took 1.2s. Estimated remaining: 13m 5s. Rate: 145.4 symbols/min [2025-10-28T22:08:09.409833] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:09.413880] [INFO ] [MAIN ] AVA: Generated 138 derivative records from 37896 primary records. [2025-10-28T22:08:09.413998] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-28T22:08:09.426260] [DEBUG] [LOCAL ] AVA: Derivative data saved (138 records). [2025-10-28T22:08:09.426412] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-28T22:08:09.434485] [INFO ] [MAIN ] Derivative Progress: 144/2046 symbols completed. AVA took 1.2s. Estimated remaining: 12m 60s. Rate: 146.4 symbols/min [2025-10-28T22:08:09.434736] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:09.444950] [DEBUG] [LOCAL ] AVD: Loaded 20832 existing records from primary storage. [2025-10-28T22:08:09.445164] [INFO ] [MAIN ] AVD: Loaded 20832 primary data records. [2025-10-28T22:08:09.560597] [DEBUG] [LOCAL ] AVK: Loaded 18344 existing records from primary storage. [2025-10-28T22:08:09.571602] [INFO ] [MAIN ] AVK: Loaded 18344 primary data records. [2025-10-28T22:08:09.765778] [DEBUG] [LOCAL ] AVB: Loaded 41829 existing records from primary storage. [2025-10-28T22:08:09.776591] [INFO ] [MAIN ] AVB: Loaded 41829 primary data records. [2025-10-28T22:08:10.434779] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:10.469390] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:10.513534] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:10.550938] [INFO ] [MAIN ] AVD: Generated 138 derivative records from 20832 primary records. [2025-10-28T22:08:10.552716] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-28T22:08:10.571812] [DEBUG] [LOCAL ] AVD: Derivative data saved (138 records). [2025-10-28T22:08:10.572015] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-28T22:08:10.574060] [INFO ] [MAIN ] Derivative Progress: 145/2046 symbols completed. AVD took 1.2s. Estimated remaining: 13m 9s. Rate: 144.6 symbols/min [2025-10-28T22:08:10.574249] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:10.584357] [INFO ] [MAIN ] AVK: Generated 138 derivative records from 18344 primary records. [2025-10-28T22:08:10.584880] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-28T22:08:10.602169] [DEBUG] [LOCAL ] AVK: Derivative data saved (138 records). [2025-10-28T22:08:10.604810] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-28T22:08:10.604692] [INFO ] [MAIN ] AVB: Generated 138 derivative records from 41829 primary records. [2025-10-28T22:08:10.608174] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-28T22:08:10.608070] [INFO ] [MAIN ] Derivative Progress: 146/2046 symbols completed. AVK took 1.2s. Estimated remaining: 13m 3s. Rate: 145.5 symbols/min [2025-10-28T22:08:10.616981] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:10.629414] [DEBUG] [LOCAL ] AVB: Derivative data saved (138 records). [2025-10-28T22:08:10.629490] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-28T22:08:10.631731] [INFO ] [MAIN ] Derivative Progress: 147/2046 symbols completed. AVB took 1.2s. Estimated remaining: 12m 58s. Rate: 146.5 symbols/min [2025-10-28T22:08:10.631894] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:10.643557] [DEBUG] [LOCAL ] AVNS: Loaded 33233 existing records from primary storage. [2025-10-28T22:08:10.643841] [INFO ] [MAIN ] AVNS: Loaded 33233 primary data records. [2025-10-28T22:08:10.787443] [DEBUG] [LOCAL ] AWF: Loaded 23902 existing records from primary storage. [2025-10-28T22:08:10.808860] [DEBUG] [LOCAL ] AVNT: Loaded 38109 existing records from primary storage. [2025-10-28T22:08:10.814127] [INFO ] [MAIN ] AVNT: Loaded 38109 primary data records. [2025-10-28T22:08:10.814071] [INFO ] [MAIN ] AWF: Loaded 23902 primary data records. [2025-10-28T22:08:11.587709] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:11.639078] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:11.650288] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:11.714241] [INFO ] [MAIN ] AVNS: Generated 138 derivative records from 33233 primary records. [2025-10-28T22:08:11.717003] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-28T22:08:11.719741] [INFO ] [MAIN ] AWF: Generated 138 derivative records from 23902 primary records. [2025-10-28T22:08:11.720005] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-28T22:08:11.732823] [DEBUG] [LOCAL ] AVNS: Derivative data saved (138 records). [2025-10-28T22:08:11.733038] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-28T22:08:11.747614] [INFO ] [MAIN ] AVNT: Generated 138 derivative records from 38109 primary records. [2025-10-28T22:08:11.747334] [INFO ] [MAIN ] Derivative Progress: 148/2046 symbols completed. AVNS took 1.2s. Estimated remaining: 13m 7s. Rate: 144.8 symbols/min [2025-10-28T22:08:11.750698] [DEBUG] [LOCAL ] AWF: Derivative data saved (138 records). [2025-10-28T22:08:11.750967] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-28T22:08:11.751064] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-28T22:08:11.754236] [INFO ] [MAIN ] Derivative Progress: 149/2046 symbols completed. AWF took 1.1s. Estimated remaining: 13m 1s. Rate: 145.7 symbols/min [2025-10-28T22:08:11.766151] [DEBUG] [LOCAL ] AVNT: Derivative data saved (138 records). [2025-10-28T22:08:11.766253] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-28T22:08:11.768910] [INFO ] [MAIN ] Derivative Progress: 150/2046 symbols completed. AVNT took 1.2s. Estimated remaining: 12m 55s. Rate: 146.7 symbols/min [2025-10-28T22:08:11.769505] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:11.769457] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:11.769558] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:11.803586] [DEBUG] [LOCAL ] AWI: Loaded 24954 existing records from primary storage. [2025-10-28T22:08:11.803230] [DEBUG] [LOCAL ] AWP: Loaded 21301 existing records from primary storage. [2025-10-28T22:08:11.803837] [INFO ] [MAIN ] AWP: Loaded 21301 primary data records. [2025-10-28T22:08:11.803895] [INFO ] [MAIN ] AWI: Loaded 24954 primary data records. [2025-10-28T22:08:12.181199] [DEBUG] [LOCAL ] AWK: Loaded 48235 existing records from primary storage. [2025-10-28T22:08:12.203480] [INFO ] [MAIN ] AWK: Loaded 48235 primary data records. [2025-10-28T22:08:12.791179] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:12.790929] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:12.856738] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:12.892729] [INFO ] [MAIN ] AWP: Generated 138 derivative records from 21301 primary records. [2025-10-28T22:08:12.893581] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-28T22:08:12.896956] [INFO ] [MAIN ] AWI: Generated 138 derivative records from 24954 primary records. [2025-10-28T22:08:12.899279] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-28T22:08:12.911363] [DEBUG] [LOCAL ] AWP: Derivative data saved (138 records). [2025-10-28T22:08:12.911674] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-28T22:08:12.921457] [INFO ] [MAIN ] Derivative Progress: 151/2046 symbols completed. AWP took 1.2s. Estimated remaining: 13m 4s. Rate: 144.9 symbols/min [2025-10-28T22:08:12.923212] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:12.926409] [DEBUG] [LOCAL ] AWI: Derivative data saved (138 records). [2025-10-28T22:08:12.927128] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-28T22:08:12.932469] [INFO ] [MAIN ] Derivative Progress: 152/2046 symbols completed. AWI took 1.2s. Estimated remaining: 12m 59s. Rate: 145.9 symbols/min [2025-10-28T22:08:12.934270] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:12.940597] [INFO ] [MAIN ] AWK: Generated 138 derivative records from 48235 primary records. [2025-10-28T22:08:12.940741] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-28T22:08:12.958073] [DEBUG] [LOCAL ] AWK: Derivative data saved (138 records). [2025-10-28T22:08:12.958253] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-28T22:08:12.961041] [INFO ] [MAIN ] Derivative Progress: 153/2046 symbols completed. AWK took 1.2s. Estimated remaining: 12m 54s. Rate: 146.8 symbols/min [2025-10-28T22:08:12.961614] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:12.976184] [DEBUG] [LOCAL ] AWR: Loaded 22474 existing records from primary storage. [2025-10-28T22:08:12.976435] [INFO ] [MAIN ] AWR: Loaded 22474 primary data records. [2025-10-28T22:08:13.054712] [DEBUG] [LOCAL ] AX: Loaded 27197 existing records from primary storage. [2025-10-28T22:08:13.066194] [INFO ] [MAIN ] AX: Loaded 27197 primary data records. [2025-10-28T22:08:13.490112] [DEBUG] [LOCAL ] AXL: Loaded 50491 existing records from primary storage. [2025-10-28T22:08:13.589180] [INFO ] [MAIN ] AXL: Loaded 50491 primary data records. [2025-10-28T22:08:13.976881] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:13.999885] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:14.043386] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:14.093474] [INFO ] [MAIN ] AWR: Generated 138 derivative records from 22474 primary records. [2025-10-28T22:08:14.094916] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-28T22:08:14.097629] [INFO ] [MAIN ] AX: Generated 138 derivative records from 27197 primary records. [2025-10-28T22:08:14.106213] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-28T22:08:14.111171] [DEBUG] [LOCAL ] AWR: Derivative data saved (138 records). [2025-10-28T22:08:14.111479] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-28T22:08:14.123055] [INFO ] [MAIN ] Derivative Progress: 154/2046 symbols completed. AWR took 1.2s. Estimated remaining: 13m 3s. Rate: 145.0 symbols/min [2025-10-28T22:08:14.125423] [DEBUG] [LOCAL ] AX: Derivative data saved (138 records). [2025-10-28T22:08:14.128097] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:14.128432] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-28T22:08:14.132486] [INFO ] [MAIN ] Derivative Progress: 155/2046 symbols completed. AX took 1.2s. Estimated remaining: 12m 57s. Rate: 146.0 symbols/min [2025-10-28T22:08:14.134205] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:14.134982] [INFO ] [MAIN ] AXL: Generated 138 derivative records from 50491 primary records. [2025-10-28T22:08:14.135215] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-28T22:08:14.148964] [DEBUG] [LOCAL ] AXR: Loaded 2773 existing records from primary storage. [2025-10-28T22:08:14.152502] [DEBUG] [LOCAL ] AXL: Derivative data saved (138 records). [2025-10-28T22:08:14.152841] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-28T22:08:14.152795] [INFO ] [MAIN ] AXR: Loaded 2773 primary data records. [2025-10-28T22:08:14.155381] [INFO ] [MAIN ] Derivative Progress: 156/2046 symbols completed. AXL took 1.2s. Estimated remaining: 12m 52s. Rate: 146.8 symbols/min [2025-10-28T22:08:14.176525] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:14.495575] [DEBUG] [LOCAL ] AXP: Loaded 53107 existing records from primary storage. [2025-10-28T22:08:14.496263] [INFO ] [MAIN ] AXP: Loaded 53107 primary data records. [2025-10-28T22:08:14.594751] [DEBUG] [LOCAL ] AXS: Loaded 38711 existing records from primary storage. [2025-10-28T22:08:14.601058] [INFO ] [MAIN ] AXS: Loaded 38711 primary data records. [2025-10-28T22:08:15.137087] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:15.178508] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:15.218022] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:15.238801] [INFO ] [MAIN ] AXR: Generated 138 derivative records from 2773 primary records. [2025-10-28T22:08:15.242725] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-28T22:08:15.256725] [DEBUG] [LOCAL ] AXR: Derivative data saved (138 records). [2025-10-28T22:08:15.257553] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-28T22:08:15.259858] [INFO ] [MAIN ] Derivative Progress: 157/2046 symbols completed. AXR took 1.1s. Estimated remaining: 13m 0s. Rate: 145.3 symbols/min [2025-10-28T22:08:15.260098] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:15.278507] [INFO ] [MAIN ] AXP: Generated 138 derivative records from 53107 primary records. [2025-10-28T22:08:15.281319] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-28T22:08:15.294907] [INFO ] [MAIN ] AXS: Generated 138 derivative records from 38711 primary records. [2025-10-28T22:08:15.296604] [DEBUG] [LOCAL ] AXP: Derivative data saved (138 records). [2025-10-28T22:08:15.296726] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-28T22:08:15.296862] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-28T22:08:15.311892] [INFO ] [MAIN ] Derivative Progress: 158/2046 symbols completed. AXP took 1.2s. Estimated remaining: 12m 55s. Rate: 146.1 symbols/min [2025-10-28T22:08:15.312483] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:15.324599] [DEBUG] [LOCAL ] AXS: Derivative data saved (138 records). [2025-10-28T22:08:15.325517] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-28T22:08:15.328187] [INFO ] [MAIN ] Derivative Progress: 159/2046 symbols completed. AXS took 1.2s. Estimated remaining: 12m 50s. Rate: 147.0 symbols/min [2025-10-28T22:08:15.341469] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:15.343917] [DEBUG] [LOCAL ] AXTA: Loaded 52296 existing records from primary storage. [2025-10-28T22:08:15.344170] [INFO ] [MAIN ] AXTA: Loaded 52296 primary data records. [2025-10-28T22:08:15.464833] [DEBUG] [LOCAL ] AZO: Loaded 10576 existing records from primary storage. [2025-10-28T22:08:15.464565] [DEBUG] [LOCAL ] AYI: Loaded 23511 existing records from primary storage. [2025-10-28T22:08:15.465272] [INFO ] [MAIN ] AYI: Loaded 23511 primary data records. [2025-10-28T22:08:15.465419] [INFO ] [MAIN ] AZO: Loaded 10576 primary data records. [2025-10-28T22:08:16.313458] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:16.348322] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:16.371183] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:16.432700] [INFO ] [MAIN ] AXTA: Generated 138 derivative records from 52296 primary records. [2025-10-28T22:08:16.435250] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-28T22:08:16.449589] [INFO ] [MAIN ] AZO: Generated 138 derivative records from 10576 primary records. [2025-10-28T22:08:16.454303] [DEBUG] [LOCAL ] AXTA: Derivative data saved (138 records). [2025-10-28T22:08:16.454784] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-28T22:08:16.454926] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-28T22:08:16.457290] [INFO ] [MAIN ] Derivative Progress: 160/2046 symbols completed. AXTA took 1.2s. Estimated remaining: 12m 58s. Rate: 145.4 symbols/min [2025-10-28T22:08:16.457451] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:16.470763] [INFO ] [MAIN ] AYI: Generated 138 derivative records from 23511 primary records. [2025-10-28T22:08:16.470924] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-28T22:08:16.472912] [DEBUG] [LOCAL ] AZO: Derivative data saved (138 records). [2025-10-28T22:08:16.473195] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-28T22:08:16.475667] [INFO ] [MAIN ] Derivative Progress: 161/2046 symbols completed. AZO took 1.1s. Estimated remaining: 12m 53s. Rate: 146.2 symbols/min [2025-10-28T22:08:16.475840] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:16.487931] [DEBUG] [LOCAL ] AYI: Derivative data saved (138 records). [2025-10-28T22:08:16.492845] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-28T22:08:16.495081] [INFO ] [MAIN ] Derivative Progress: 162/2046 symbols completed. AYI took 1.2s. Estimated remaining: 12m 48s. Rate: 147.1 symbols/min [2025-10-28T22:08:16.495306] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:16.505557] [DEBUG] [LOCAL ] AZZ: Loaded 22835 existing records from primary storage. [2025-10-28T22:08:16.505706] [INFO ] [MAIN ] AZZ: Loaded 22835 primary data records. [2025-10-28T22:08:16.839828] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-28T22:08:16.841702] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-28T22:08:16.921494] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-28T22:08:16.943751] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-28T22:08:17.467012] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:17.520840] [INFO ] [MAIN ] AZZ: Generated 138 derivative records from 22835 primary records. [2025-10-28T22:08:17.533117] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:17.533220] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-28T22:08:17.543903] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:17.572020] [DEBUG] [LOCAL ] AZZ: Derivative data saved (138 records). [2025-10-28T22:08:17.573240] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-28T22:08:17.575745] [INFO ] [MAIN ] Derivative Progress: 163/2046 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 56s. Rate: 145.6 symbols/min [2025-10-28T22:08:17.605437] [INFO ] [MAIN ] BA: Generated 138 derivative records from 53790 primary records. [2025-10-28T22:08:17.606736] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-28T22:08:17.608719] [INFO ] [MAIN ] BABA: Generated 138 derivative records from 53820 primary records. [2025-10-28T22:08:17.608952] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-28T22:08:17.631315] [DEBUG] [LOCAL ] BABA: Derivative data saved (138 records). [2025-10-28T22:08:17.632397] [DEBUG] [LOCAL ] BA: Derivative data saved (138 records). [2025-10-28T22:08:17.632494] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-28T22:08:17.632574] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-28T22:08:17.634365] [INFO ] [MAIN ] Derivative Progress: 164/2046 symbols completed. BA took 1.2s. Estimated remaining: 12m 51s. Rate: 146.4 symbols/min [2025-10-28T22:08:17.636768] [INFO ] [MAIN ] Derivative Progress: 165/2046 symbols completed. BABA took 1.1s. Estimated remaining: 12m 46s. Rate: 147.3 symbols/min [2025-10-28T22:08:17.637192] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:17.637277] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:17.637131] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:17.695319] [DEBUG] [LOCAL ] BAK: Loaded 39107 existing records from primary storage. [2025-10-28T22:08:17.695489] [INFO ] [MAIN ] BAK: Loaded 39107 primary data records. [2025-10-28T22:08:17.825491] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-28T22:08:17.824857] [DEBUG] [LOCAL ] BAH: Loaded 51644 existing records from primary storage. [2025-10-28T22:08:17.825730] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-28T22:08:17.826086] [INFO ] [MAIN ] BAH: Loaded 51644 primary data records. [2025-10-28T22:08:18.667573] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:18.702077] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:18.737189] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:18.790515] [INFO ] [MAIN ] BAK: Generated 138 derivative records from 39107 primary records. [2025-10-28T22:08:18.792937] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-28T22:08:18.810177] [DEBUG] [LOCAL ] BAK: Derivative data saved (138 records). [2025-10-28T22:08:18.810520] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-28T22:08:18.812799] [INFO ] [MAIN ] Derivative Progress: 166/2046 symbols completed. BAK took 1.2s. Estimated remaining: 12m 55s. Rate: 145.6 symbols/min [2025-10-28T22:08:18.814793] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:18.815197] [INFO ] [MAIN ] BAH: Generated 138 derivative records from 51644 primary records. [2025-10-28T22:08:18.816765] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-28T22:08:18.817304] [INFO ] [MAIN ] BAC: Generated 138 derivative records from 53808 primary records. [2025-10-28T22:08:18.818077] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-28T22:08:18.838804] [DEBUG] [LOCAL ] BAH: Derivative data saved (138 records). [2025-10-28T22:08:18.840290] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-28T22:08:18.844754] [INFO ] [MAIN ] Derivative Progress: 167/2046 symbols completed. BAH took 1.2s. Estimated remaining: 12m 50s. Rate: 146.4 symbols/min [2025-10-28T22:08:18.845404] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:18.845315] [DEBUG] [LOCAL ] BAC: Derivative data saved (138 records). [2025-10-28T22:08:18.845748] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-28T22:08:18.849496] [INFO ] [MAIN ] Derivative Progress: 168/2046 symbols completed. BAC took 1.2s. Estimated remaining: 12m 45s. Rate: 147.3 symbols/min [2025-10-28T22:08:18.849695] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:18.889494] [DEBUG] [LOCAL ] BAP: Loaded 24953 existing records from primary storage. [2025-10-28T22:08:18.901586] [INFO ] [MAIN ] BAP: Loaded 24953 primary data records. [2025-10-28T22:08:18.922246] [DEBUG] [LOCAL ] BALL: Loaded 51894 existing records from primary storage. [2025-10-28T22:08:18.939542] [INFO ] [MAIN ] BALL: Loaded 51894 primary data records. [2025-10-28T22:08:19.139229] [DEBUG] [LOCAL ] BANC: Loaded 51376 existing records from primary storage. [2025-10-28T22:08:19.160690] [INFO ] [MAIN ] BANC: Loaded 51376 primary data records. [2025-10-28T22:08:19.878758] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:19.905000] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:19.937601] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:19.991809] [INFO ] [MAIN ] BALL: Generated 138 derivative records from 51894 primary records. [2025-10-28T22:08:19.993835] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-28T22:08:19.994188] [INFO ] [MAIN ] BAP: Generated 138 derivative records from 24953 primary records. [2025-10-28T22:08:19.994285] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-28T22:08:20.016955] [DEBUG] [LOCAL ] BALL: Derivative data saved (138 records). [2025-10-28T22:08:20.018345] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-28T22:08:20.023096] [INFO ] [MAIN ] Derivative Progress: 169/2046 symbols completed. BALL took 1.2s. Estimated remaining: 12m 53s. Rate: 145.7 symbols/min [2025-10-28T22:08:20.021305] [DEBUG] [LOCAL ] BAP: Derivative data saved (138 records). [2025-10-28T22:08:20.023243] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-28T22:08:20.023413] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:20.025721] [INFO ] [MAIN ] Derivative Progress: 170/2046 symbols completed. BAP took 1.2s. Estimated remaining: 12m 48s. Rate: 146.5 symbols/min [2025-10-28T22:08:20.026537] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:20.030550] [INFO ] [MAIN ] BANC: Generated 138 derivative records from 51376 primary records. [2025-10-28T22:08:20.030719] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-28T22:08:20.043637] [DEBUG] [LOCAL ] BANC: Derivative data saved (138 records). [2025-10-28T22:08:20.043836] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-28T22:08:20.046221] [INFO ] [MAIN ] Derivative Progress: 171/2046 symbols completed. BANC took 1.2s. Estimated remaining: 12m 43s. Rate: 147.4 symbols/min [2025-10-28T22:08:20.046394] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:20.087723] [DEBUG] [LOCAL ] BARK: Loaded 38013 existing records from primary storage. [2025-10-28T22:08:20.087878] [INFO ] [MAIN ] BARK: Loaded 38013 primary data records. [2025-10-28T22:08:20.238526] [DEBUG] [LOCAL ] BAX: Loaded 53536 existing records from primary storage. [2025-10-28T22:08:20.272457] [INFO ] [MAIN ] BAX: Loaded 53536 primary data records. [2025-10-28T22:08:20.299128] [DEBUG] [LOCAL ] BB: Loaded 52857 existing records from primary storage. [2025-10-28T22:08:20.471849] [INFO ] [MAIN ] BB: Loaded 52857 primary data records. [2025-10-28T22:08:21.036156] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:21.075017] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:21.113761] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:21.154588] [INFO ] [MAIN ] BARK: Generated 138 derivative records from 38013 primary records. [2025-10-28T22:08:21.158061] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-28T22:08:21.175727] [DEBUG] [LOCAL ] BARK: Derivative data saved (138 records). [2025-10-28T22:08:21.176896] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-28T22:08:21.179019] [INFO ] [MAIN ] Derivative Progress: 172/2046 symbols completed. BARK took 1.2s. Estimated remaining: 12m 51s. Rate: 145.8 symbols/min [2025-10-28T22:08:21.180323] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:21.182390] [INFO ] [MAIN ] BAX: Generated 138 derivative records from 53536 primary records. [2025-10-28T22:08:21.182550] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-28T22:08:21.198091] [DEBUG] [LOCAL ] BAX: Derivative data saved (138 records). [2025-10-28T22:08:21.198265] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-28T22:08:21.201737] [INFO ] [MAIN ] Derivative Progress: 173/2046 symbols completed. BAX took 1.2s. Estimated remaining: 12m 46s. Rate: 146.6 symbols/min [2025-10-28T22:08:21.201890] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:21.204508] [INFO ] [MAIN ] BB: Generated 138 derivative records from 52857 primary records. [2025-10-28T22:08:21.204575] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-28T22:08:21.216546] [DEBUG] [LOCAL ] BB: Derivative data saved (138 records). [2025-10-28T22:08:21.217126] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-28T22:08:21.219815] [INFO ] [MAIN ] Derivative Progress: 174/2046 symbols completed. BB took 1.2s. Estimated remaining: 12m 42s. Rate: 147.5 symbols/min [2025-10-28T22:08:21.220076] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:21.290475] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-28T22:08:21.291379] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-28T22:08:21.291272] [DEBUG] [LOCAL ] BBAR: Loaded 42680 existing records from primary storage. [2025-10-28T22:08:21.291736] [INFO ] [MAIN ] BBAR: Loaded 42680 primary data records. [2025-10-28T22:08:21.513788] [DEBUG] [LOCAL ] BBD: Loaded 53278 existing records from primary storage. [2025-10-28T22:08:21.529768] [INFO ] [MAIN ] BBD: Loaded 53278 primary data records. [2025-10-28T22:08:22.488872] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:22.530806] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:22.610544] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:22.654555] [INFO ] [MAIN ] BBAR: Generated 138 derivative records from 42680 primary records. [2025-10-28T22:08:22.655224] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-28T22:08:22.681513] [INFO ] [MAIN ] BBAI: Generated 138 derivative records from 53820 primary records. [2025-10-28T22:08:22.682581] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-28T22:08:22.699862] [DEBUG] [LOCAL ] BBAR: Derivative data saved (138 records). [2025-10-28T22:08:22.705330] [DEBUG] [LOCAL ] BBAI: Derivative data saved (138 records). [2025-10-28T22:08:22.706488] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-28T22:08:22.706014] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-28T22:08:22.709885] [INFO ] [MAIN ] Derivative Progress: 175/2046 symbols completed. BBAI took 1.5s. Estimated remaining: 12m 53s. Rate: 145.2 symbols/min [2025-10-28T22:08:22.715957] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:22.716271] [INFO ] [MAIN ] Derivative Progress: 176/2046 symbols completed. BBAR took 1.5s. Estimated remaining: 12m 48s. Rate: 146.1 symbols/min [2025-10-28T22:08:22.717926] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:22.728583] [INFO ] [MAIN ] BBD: Generated 138 derivative records from 53278 primary records. [2025-10-28T22:08:22.728822] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-28T22:08:22.732945] [DEBUG] [LOCAL ] BBDO: Loaded 4822 existing records from primary storage. [2025-10-28T22:08:22.743822] [INFO ] [MAIN ] BBDO: Loaded 4822 primary data records. [2025-10-28T22:08:22.767589] [DEBUG] [LOCAL ] BBD: Derivative data saved (138 records). [2025-10-28T22:08:22.785582] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-28T22:08:22.819853] [INFO ] [MAIN ] Derivative Progress: 177/2046 symbols completed. BBD took 1.6s. Estimated remaining: 12m 45s. Rate: 146.7 symbols/min [2025-10-28T22:08:22.879443] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:22.916348] [DEBUG] [LOCAL ] BBDC: Loaded 32318 existing records from primary storage. [2025-10-28T22:08:22.951942] [INFO ] [MAIN ] BBDC: Loaded 32318 primary data records. [2025-10-28T22:08:23.202046] [DEBUG] [LOCAL ] BBN: Loaded 17318 existing records from primary storage. [2025-10-28T22:08:23.213192] [INFO ] [MAIN ] BBN: Loaded 17318 primary data records. [2025-10-28T22:08:23.700114] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:23.739691] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:23.770432] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:23.812401] [INFO ] [MAIN ] BBDO: Generated 138 derivative records from 4822 primary records. [2025-10-28T22:08:23.812517] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-28T22:08:23.826783] [DEBUG] [LOCAL ] BBDO: Derivative data saved (138 records). [2025-10-28T22:08:23.827159] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-28T22:08:23.831210] [INFO ] [MAIN ] Derivative Progress: 178/2046 symbols completed. BBDO took 1.1s. Estimated remaining: 12m 50s. Rate: 145.5 symbols/min [2025-10-28T22:08:23.834746] [INFO ] [MAIN ] BBDC: Generated 138 derivative records from 32318 primary records. [2025-10-28T22:08:23.835955] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-28T22:08:23.851366] [INFO ] [MAIN ] BBN: Generated 138 derivative records from 17318 primary records. [2025-10-28T22:08:23.852484] [DEBUG] [LOCAL ] BBDC: Derivative data saved (138 records). [2025-10-28T22:08:23.852620] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-28T22:08:23.852560] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-28T22:08:23.854879] [INFO ] [MAIN ] Derivative Progress: 179/2046 symbols completed. BBDC took 1.1s. Estimated remaining: 12m 46s. Rate: 146.2 symbols/min [2025-10-28T22:08:23.866249] [DEBUG] [LOCAL ] BBN: Derivative data saved (138 records). [2025-10-28T22:08:23.866303] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-28T22:08:23.868685] [INFO ] [MAIN ] Derivative Progress: 180/2046 symbols completed. BBN took 1.0s. Estimated remaining: 12m 41s. Rate: 147.0 symbols/min [2025-10-28T22:08:23.868999] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:23.869142] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:23.869069] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:23.876464] [DEBUG] [LOCAL ] BBU: Loaded 5867 existing records from primary storage. [2025-10-28T22:08:23.876705] [INFO ] [MAIN ] BBU: Loaded 5867 primary data records. [2025-10-28T22:08:23.971453] [DEBUG] [LOCAL ] BBUC: Loaded 13766 existing records from primary storage. [2025-10-28T22:08:23.989842] [INFO ] [MAIN ] BBUC: Loaded 13766 primary data records. [2025-10-28T22:08:24.158236] [DEBUG] [LOCAL ] BBW: Loaded 26874 existing records from primary storage. [2025-10-28T22:08:24.291357] [INFO ] [MAIN ] BBW: Loaded 26874 primary data records. [2025-10-28T22:08:24.827414] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:24.867446] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:24.899921] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:24.926907] [INFO ] [MAIN ] BBU: Generated 138 derivative records from 5867 primary records. [2025-10-28T22:08:24.927743] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-28T22:08:24.943705] [DEBUG] [LOCAL ] BBU: Derivative data saved (138 records). [2025-10-28T22:08:24.943962] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-28T22:08:24.950236] [INFO ] [MAIN ] Derivative Progress: 181/2046 symbols completed. BBU took 1.1s. Estimated remaining: 12m 48s. Rate: 145.7 symbols/min [2025-10-28T22:08:24.952051] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:24.966727] [INFO ] [MAIN ] BBUC: Generated 138 derivative records from 13766 primary records. [2025-10-28T22:08:24.966879] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-28T22:08:24.983049] [DEBUG] [LOCAL ] BBUC: Derivative data saved (138 records). [2025-10-28T22:08:24.980197] [INFO ] [MAIN ] BBW: Generated 138 derivative records from 26874 primary records. [2025-10-28T22:08:24.983162] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-28T22:08:24.985544] [INFO ] [MAIN ] Derivative Progress: 182/2046 symbols completed. BBUC took 1.1s. Estimated remaining: 12m 44s. Rate: 146.4 symbols/min [2025-10-28T22:08:24.983267] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-28T22:08:24.986166] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:24.998386] [DEBUG] [LOCAL ] BBW: Derivative data saved (138 records). [2025-10-28T22:08:24.998611] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-28T22:08:25.001075] [INFO ] [MAIN ] Derivative Progress: 183/2046 symbols completed. BBW took 1.1s. Estimated remaining: 12m 39s. Rate: 147.2 symbols/min [2025-10-28T22:08:25.001222] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:25.036773] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-28T22:08:25.036993] [INFO ] [MAIN ] BBWI: Loaded 53591 primary data records. [2025-10-28T22:08:25.192830] [DEBUG] [LOCAL ] BC: Loaded 43774 existing records from primary storage. [2025-10-28T22:08:25.198286] [INFO ] [MAIN ] BC: Loaded 43774 primary data records. [2025-10-28T22:08:25.307545] [DEBUG] [LOCAL ] BBY: Loaded 53427 existing records from primary storage. [2025-10-28T22:08:25.333730] [INFO ] [MAIN ] BBY: Loaded 53427 primary data records. [2025-10-28T22:08:26.003466] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:26.039222] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:26.070501] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:26.105686] [INFO ] [MAIN ] BBWI: Generated 138 derivative records from 53591 primary records. [2025-10-28T22:08:26.106179] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-28T22:08:26.125852] [DEBUG] [LOCAL ] BBWI: Derivative data saved (138 records). [2025-10-28T22:08:26.126158] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-28T22:08:26.129968] [INFO ] [MAIN ] Derivative Progress: 184/2046 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 46s. Rate: 145.8 symbols/min [2025-10-28T22:08:26.130133] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:26.137932] [INFO ] [MAIN ] BC: Generated 138 derivative records from 43774 primary records. [2025-10-28T22:08:26.138248] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-28T22:08:26.151627] [DEBUG] [LOCAL ] BC: Derivative data saved (138 records). [2025-10-28T22:08:26.154691] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-28T22:08:26.157363] [INFO ] [MAIN ] Derivative Progress: 185/2046 symbols completed. BC took 1.2s. Estimated remaining: 12m 42s. Rate: 146.6 symbols/min [2025-10-28T22:08:26.157506] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:26.169196] [INFO ] [MAIN ] BBY: Generated 138 derivative records from 53427 primary records. [2025-10-28T22:08:26.169321] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-28T22:08:26.181179] [DEBUG] [LOCAL ] BBY: Derivative data saved (138 records). [2025-10-28T22:08:26.181320] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-28T22:08:26.183870] [INFO ] [MAIN ] Derivative Progress: 186/2046 symbols completed. BBY took 1.2s. Estimated remaining: 12m 38s. Rate: 147.3 symbols/min [2025-10-28T22:08:26.184168] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:26.202825] [DEBUG] [LOCAL ] BCAT: Loaded 33937 existing records from primary storage. [2025-10-28T22:08:26.203104] [INFO ] [MAIN ] BCAT: Loaded 33937 primary data records. [2025-10-28T22:08:26.333971] [DEBUG] [LOCAL ] BCC: Loaded 28455 existing records from primary storage. [2025-10-28T22:08:26.345021] [INFO ] [MAIN ] BCC: Loaded 28455 primary data records. [2025-10-28T22:08:26.431313] [DEBUG] [LOCAL ] BCH: Loaded 29555 existing records from primary storage. [2025-10-28T22:08:26.633782] [INFO ] [MAIN ] BCH: Loaded 29555 primary data records. [2025-10-28T22:08:27.157245] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:27.189917] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:27.236937] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:27.269531] [INFO ] [MAIN ] BCAT: Generated 138 derivative records from 33937 primary records. [2025-10-28T22:08:27.269732] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-28T22:08:27.288459] [INFO ] [MAIN ] BCC: Generated 138 derivative records from 28455 primary records. [2025-10-28T22:08:27.288553] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-28T22:08:27.288857] [DEBUG] [LOCAL ] BCAT: Derivative data saved (138 records). [2025-10-28T22:08:27.289338] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-28T22:08:27.291336] [INFO ] [MAIN ] Derivative Progress: 187/2046 symbols completed. BCAT took 1.2s. Estimated remaining: 12m 44s. Rate: 146.0 symbols/min [2025-10-28T22:08:27.293814] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:27.306290] [DEBUG] [LOCAL ] BCC: Derivative data saved (138 records). [2025-10-28T22:08:27.307736] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-28T22:08:27.312741] [INFO ] [MAIN ] Derivative Progress: 188/2046 symbols completed. BCC took 1.2s. Estimated remaining: 12m 40s. Rate: 146.7 symbols/min [2025-10-28T22:08:27.312982] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:27.322232] [INFO ] [MAIN ] BCH: Generated 138 derivative records from 29555 primary records. [2025-10-28T22:08:27.322422] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-28T22:08:27.334578] [DEBUG] [LOCAL ] BCH: Derivative data saved (138 records). [2025-10-28T22:08:27.341377] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-28T22:08:27.344119] [INFO ] [MAIN ] Derivative Progress: 189/2046 symbols completed. BCH took 1.2s. Estimated remaining: 12m 36s. Rate: 147.4 symbols/min [2025-10-28T22:08:27.345469] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:27.346473] [DEBUG] [LOCAL ] BCO: Loaded 24272 existing records from primary storage. [2025-10-28T22:08:27.346750] [INFO ] [MAIN ] BCO: Loaded 24272 primary data records. [2025-10-28T22:08:27.678721] [DEBUG] [LOCAL ] BCS: Loaded 53436 existing records from primary storage. [2025-10-28T22:08:27.678099] [DEBUG] [LOCAL ] BCSF: Loaded 27752 existing records from primary storage. [2025-10-28T22:08:27.678929] [INFO ] [MAIN ] BCSF: Loaded 27752 primary data records. [2025-10-28T22:08:27.678882] [INFO ] [MAIN ] BCS: Loaded 53436 primary data records. [2025-10-28T22:08:28.322688] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:28.363918] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:28.399132] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:28.424185] [INFO ] [MAIN ] BCO: Generated 138 derivative records from 24272 primary records. [2025-10-28T22:08:28.426824] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-28T22:08:28.439976] [DEBUG] [LOCAL ] BCO: Derivative data saved (138 records). [2025-10-28T22:08:28.443919] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-28T22:08:28.446365] [INFO ] [MAIN ] Derivative Progress: 190/2046 symbols completed. BCO took 1.2s. Estimated remaining: 12m 42s. Rate: 146.1 symbols/min [2025-10-28T22:08:28.448809] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:28.461539] [INFO ] [MAIN ] BCS: Generated 138 derivative records from 53436 primary records. [2025-10-28T22:08:28.474981] [INFO ] [MAIN ] BCSF: Generated 138 derivative records from 27752 primary records. [2025-10-28T22:08:28.475148] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-28T22:08:28.475684] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-28T22:08:28.503983] [DEBUG] [LOCAL ] BCSF: Derivative data saved (138 records). [2025-10-28T22:08:28.504110] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-28T22:08:28.507773] [INFO ] [MAIN ] Derivative Progress: 191/2046 symbols completed. BCSF took 1.2s. Estimated remaining: 12m 38s. Rate: 146.8 symbols/min [2025-10-28T22:08:28.510217] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:28.510868] [DEBUG] [LOCAL ] BCX: Loaded 21667 existing records from primary storage. [2025-10-28T22:08:28.511851] [DEBUG] [LOCAL ] BCS: Derivative data saved (138 records). [2025-10-28T22:08:28.511084] [INFO ] [MAIN ] BCX: Loaded 21667 primary data records. [2025-10-28T22:08:28.512198] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-28T22:08:28.515068] [INFO ] [MAIN ] Derivative Progress: 192/2046 symbols completed. BCS took 1.2s. Estimated remaining: 12m 34s. Rate: 147.5 symbols/min [2025-10-28T22:08:28.515476] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:28.715860] [DEBUG] [LOCAL ] BDC: Loaded 23420 existing records from primary storage. [2025-10-28T22:08:28.834918] [INFO ] [MAIN ] BDC: Loaded 23420 primary data records. [2025-10-28T22:08:28.933946] [DEBUG] [LOCAL ] BDJ: Loaded 28805 existing records from primary storage. [2025-10-28T22:08:28.945234] [INFO ] [MAIN ] BDJ: Loaded 28805 primary data records. [2025-10-28T22:08:29.457531] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:29.498121] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:29.536861] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:29.555523] [INFO ] [MAIN ] BCX: Generated 138 derivative records from 21667 primary records. [2025-10-28T22:08:29.556128] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-28T22:08:29.575847] [DEBUG] [LOCAL ] BCX: Derivative data saved (138 records). [2025-10-28T22:08:29.578367] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-28T22:08:29.581734] [INFO ] [MAIN ] Derivative Progress: 193/2046 symbols completed. BCX took 1.1s. Estimated remaining: 12m 40s. Rate: 146.3 symbols/min [2025-10-28T22:08:29.595558] [INFO ] [MAIN ] BDC: Generated 138 derivative records from 23420 primary records. [2025-10-28T22:08:29.597905] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-28T22:08:29.610909] [INFO ] [MAIN ] BDJ: Generated 138 derivative records from 28805 primary records. [2025-10-28T22:08:29.612436] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-28T22:08:29.613213] [DEBUG] [LOCAL ] BDC: Derivative data saved (138 records). [2025-10-28T22:08:29.613422] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-28T22:08:29.622675] [INFO ] [MAIN ] Derivative Progress: 194/2046 symbols completed. BDC took 1.1s. Estimated remaining: 12m 36s. Rate: 147.0 symbols/min [2025-10-28T22:08:29.626947] [DEBUG] [LOCAL ] BDJ: Derivative data saved (138 records). [2025-10-28T22:08:29.627003] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-28T22:08:29.629399] [INFO ] [MAIN ] Derivative Progress: 195/2046 symbols completed. BDJ took 1.1s. Estimated remaining: 12m 32s. Rate: 147.7 symbols/min [2025-10-28T22:08:29.629720] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:29.629865] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:29.629772] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:29.716516] [DEBUG] [LOCAL ] BDX: Loaded 52015 existing records from primary storage. [2025-10-28T22:08:29.730236] [INFO ] [MAIN ] BDX: Loaded 52015 primary data records. [2025-10-28T22:08:29.730986] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-28T22:08:29.751252] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-28T22:08:29.773933] [DEBUG] [LOCAL ] BEKE: Loaded 53169 existing records from primary storage. [2025-10-28T22:08:29.814394] [INFO ] [MAIN ] BEKE: Loaded 53169 primary data records. [2025-10-28T22:08:30.671615] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:30.697302] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:30.728074] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:30.792495] [INFO ] [MAIN ] BDX: Generated 138 derivative records from 52015 primary records. [2025-10-28T22:08:30.795700] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-28T22:08:30.796510] [INFO ] [MAIN ] BE: Generated 138 derivative records from 53661 primary records. [2025-10-28T22:08:30.796883] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-28T22:08:30.812689] [DEBUG] [LOCAL ] BDX: Derivative data saved (138 records). [2025-10-28T22:08:30.822135] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-28T22:08:30.825025] [INFO ] [MAIN ] Derivative Progress: 196/2046 symbols completed. BDX took 1.2s. Estimated remaining: 12m 39s. Rate: 146.3 symbols/min [2025-10-28T22:08:30.828229] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:30.829007] [INFO ] [MAIN ] BEKE: Generated 138 derivative records from 53169 primary records. [2025-10-28T22:08:30.829694] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-28T22:08:30.839350] [DEBUG] [LOCAL ] BE: Derivative data saved (138 records). [2025-10-28T22:08:30.840947] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-28T22:08:30.844750] [INFO ] [MAIN ] Derivative Progress: 197/2046 symbols completed. BE took 1.2s. Estimated remaining: 12m 35s. Rate: 147.0 symbols/min [2025-10-28T22:08:30.845259] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:30.847285] [DEBUG] [LOCAL ] BEKE: Derivative data saved (138 records). [2025-10-28T22:08:30.847384] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-28T22:08:30.850728] [INFO ] [MAIN ] Derivative Progress: 198/2046 symbols completed. BEKE took 1.2s. Estimated remaining: 12m 31s. Rate: 147.7 symbols/min [2025-10-28T22:08:30.851079] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:30.858350] [DEBUG] [LOCAL ] BEPH: Loaded 4778 existing records from primary storage. [2025-10-28T22:08:30.858544] [INFO ] [MAIN ] BEPH: Loaded 4778 primary data records. [2025-10-28T22:08:31.221974] [DEBUG] [LOCAL ] BEN: Loaded 53093 existing records from primary storage. [2025-10-28T22:08:31.220865] [DEBUG] [LOCAL ] BEP: Loaded 38735 existing records from primary storage. [2025-10-28T22:08:31.222221] [INFO ] [MAIN ] BEP: Loaded 38735 primary data records. [2025-10-28T22:08:31.222297] [INFO ] [MAIN ] BEN: Loaded 53093 primary data records. [2025-10-28T22:08:31.844906] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:31.901688] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:31.937277] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:31.969009] [INFO ] [MAIN ] BEPH: Generated 138 derivative records from 4778 primary records. [2025-10-28T22:08:31.969735] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-28T22:08:31.989558] [DEBUG] [LOCAL ] BEPH: Derivative data saved (138 records). [2025-10-28T22:08:31.994694] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-28T22:08:31.997433] [INFO ] [MAIN ] Derivative Progress: 199/2046 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 37s. Rate: 146.4 symbols/min [2025-10-28T22:08:31.997584] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:32.008606] [DEBUG] [LOCAL ] BEPI: Loaded 3456 existing records from primary storage. [2025-10-28T22:08:32.015361] [INFO ] [MAIN ] BEPI: Loaded 3456 primary data records. [2025-10-28T22:08:32.149556] [INFO ] [MAIN ] BEN: Generated 138 derivative records from 53093 primary records. [2025-10-28T22:08:32.193513] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-28T22:08:32.405698] [DEBUG] [LOCAL ] BEN: Derivative data saved (138 records). [2025-10-28T22:08:32.407702] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-28T22:08:32.410338] [INFO ] [MAIN ] Derivative Progress: 200/2046 symbols completed. BEN took 1.6s. Estimated remaining: 12m 37s. Rate: 146.4 symbols/min [2025-10-28T22:08:32.410927] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:32.412471] [INFO ] [MAIN ] BEP: Generated 138 derivative records from 38735 primary records. [2025-10-28T22:08:32.413396] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-28T22:08:32.433044] [DEBUG] [LOCAL ] BEPJ: Loaded 3060 existing records from primary storage. [2025-10-28T22:08:32.432859] [DEBUG] [LOCAL ] BEP: Derivative data saved (138 records). [2025-10-28T22:08:32.433342] [INFO ] [MAIN ] BEPJ: Loaded 3060 primary data records. [2025-10-28T22:08:32.433265] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-28T22:08:32.441605] [INFO ] [MAIN ] Derivative Progress: 201/2046 symbols completed. BEP took 1.6s. Estimated remaining: 12m 33s. Rate: 147.0 symbols/min [2025-10-28T22:08:32.449466] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:32.817048] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:32.849799] [DEBUG] [LOCAL ] BFAM: Loaded 33747 existing records from primary storage. [2025-10-28T22:08:32.854238] [INFO ] [MAIN ] BFAM: Loaded 33747 primary data records. [2025-10-28T22:08:33.187180] [INFO ] [MAIN ] BEPI: Generated 138 derivative records from 3456 primary records. [2025-10-28T22:08:33.188061] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-28T22:08:33.210519] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:33.227839] [DEBUG] [LOCAL ] BEPI: Derivative data saved (138 records). [2025-10-28T22:08:33.229499] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-28T22:08:33.232997] [INFO ] [MAIN ] Derivative Progress: 202/2046 symbols completed. BEPI took 1.2s. Estimated remaining: 12m 36s. Rate: 146.3 symbols/min [2025-10-28T22:08:33.235086] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:33.279879] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:33.303041] [INFO ] [MAIN ] BEPJ: Generated 138 derivative records from 3060 primary records. [2025-10-28T22:08:33.304227] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-28T22:08:33.332865] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (138 records). [2025-10-28T22:08:33.333052] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-28T22:08:33.335543] [INFO ] [MAIN ] Derivative Progress: 203/2046 symbols completed. BEPJ took 0.9s. Estimated remaining: 12m 33s. Rate: 146.9 symbols/min [2025-10-28T22:08:33.337482] [DEBUG] [LOCAL ] BFH: Loaded 41132 existing records from primary storage. [2025-10-28T22:08:33.337967] [INFO ] [MAIN ] BFH: Loaded 41132 primary data records. [2025-10-28T22:08:33.337683] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:33.501033] [DEBUG] [LOCAL ] BFK: Loaded 13780 existing records from primary storage. [2025-10-28T22:08:33.548353] [INFO ] [MAIN ] BFK: Loaded 13780 primary data records. [2025-10-28T22:08:33.756895] [INFO ] [MAIN ] BFAM: Generated 138 derivative records from 33747 primary records. [2025-10-28T22:08:33.777185] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-28T22:08:33.853354] [DEBUG] [LOCAL ] BFAM: Derivative data saved (138 records). [2025-10-28T22:08:33.867481] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-28T22:08:33.872261] [INFO ] [MAIN ] Derivative Progress: 204/2046 symbols completed. BFAM took 1.4s. Estimated remaining: 12m 34s. Rate: 146.7 symbols/min [2025-10-28T22:08:33.877486] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:34.019689] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:34.074001] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:34.118637] [DEBUG] [LOCAL ] BFLY: Loaded 51850 existing records from primary storage. [2025-10-28T22:08:34.119294] [INFO ] [MAIN ] BFLY: Loaded 51850 primary data records. [2025-10-28T22:08:34.295790] [INFO ] [MAIN ] BFH: Generated 138 derivative records from 41132 primary records. [2025-10-28T22:08:34.334372] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-28T22:08:34.520316] [DEBUG] [LOCAL ] BFH: Derivative data saved (138 records). [2025-10-28T22:08:34.522107] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-28T22:08:34.529814] [INFO ] [MAIN ] Derivative Progress: 205/2046 symbols completed. BFH took 1.3s. Estimated remaining: 12m 35s. Rate: 146.2 symbols/min [2025-10-28T22:08:34.530222] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:34.534930] [INFO ] [MAIN ] BFK: Generated 138 derivative records from 13780 primary records. [2025-10-28T22:08:34.535266] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-28T22:08:34.553526] [DEBUG] [LOCAL ] BFK: Derivative data saved (138 records). [2025-10-28T22:08:34.554037] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-28T22:08:34.557704] [INFO ] [MAIN ] Derivative Progress: 206/2046 symbols completed. BFK took 1.2s. Estimated remaining: 12m 32s. Rate: 146.9 symbols/min [2025-10-28T22:08:34.558160] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:34.564554] [DEBUG] [LOCAL ] BFS: Loaded 9454 existing records from primary storage. [2025-10-28T22:08:34.564912] [INFO ] [MAIN ] BFS: Loaded 9454 primary data records. [2025-10-28T22:08:34.736955] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:34.947925] [DEBUG] [LOCAL ] BG: Loaded 50357 existing records from primary storage. [2025-10-28T22:08:34.949417] [INFO ] [MAIN ] BG: Loaded 50357 primary data records. [2025-10-28T22:08:35.034330] [INFO ] [MAIN ] BFLY: Generated 138 derivative records from 51850 primary records. [2025-10-28T22:08:35.045284] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-28T22:08:35.121774] [DEBUG] [LOCAL ] BFLY: Derivative data saved (138 records). [2025-10-28T22:08:35.124843] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-28T22:08:35.127505] [INFO ] [MAIN ] Derivative Progress: 207/2046 symbols completed. BFLY took 1.3s. Estimated remaining: 12m 33s. Rate: 146.6 symbols/min [2025-10-28T22:08:35.131722] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:35.274833] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:35.301958] [DEBUG] [LOCAL ] BGH: Loaded 16819 existing records from primary storage. [2025-10-28T22:08:35.304923] [INFO ] [MAIN ] BGH: Loaded 16819 primary data records. [2025-10-28T22:08:35.510891] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:35.640927] [INFO ] [MAIN ] BFS: Generated 138 derivative records from 9454 primary records. [2025-10-28T22:08:35.642965] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-28T22:08:35.658010] [DEBUG] [LOCAL ] BFS: Derivative data saved (138 records). [2025-10-28T22:08:35.658268] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-28T22:08:35.660560] [INFO ] [MAIN ] Derivative Progress: 208/2046 symbols completed. BFS took 1.1s. Estimated remaining: 12m 33s. Rate: 146.4 symbols/min [2025-10-28T22:08:35.673716] [INFO ] [MAIN ] BG: Generated 138 derivative records from 50357 primary records. [2025-10-28T22:08:35.673931] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-28T22:08:35.685997] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:35.710464] [DEBUG] [LOCAL ] BG: Derivative data saved (138 records). [2025-10-28T22:08:35.710627] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-28T22:08:35.712999] [INFO ] [MAIN ] Derivative Progress: 209/2046 symbols completed. BG took 1.2s. Estimated remaining: 12m 30s. Rate: 147.0 symbols/min [2025-10-28T22:08:35.725943] [INFO ] [MAIN ] BGH: Generated 138 derivative records from 16819 primary records. [2025-10-28T22:08:35.726025] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-28T22:08:35.737058] [DEBUG] [LOCAL ] BGH: Derivative data saved (138 records). [2025-10-28T22:08:35.737111] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-28T22:08:35.739518] [INFO ] [MAIN ] Derivative Progress: 210/2046 symbols completed. BGH took 0.6s. Estimated remaining: 12m 26s. Rate: 147.7 symbols/min [2025-10-28T22:08:35.739878] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:35.739930] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:35.740028] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:35.758795] [DEBUG] [LOCAL ] BGX: Loaded 10865 existing records from primary storage. [2025-10-28T22:08:35.768521] [INFO ] [MAIN ] BGX: Loaded 10865 primary data records. [2025-10-28T22:08:35.768425] [DEBUG] [LOCAL ] BGT: Loaded 15761 existing records from primary storage. [2025-10-28T22:08:35.768150] [DEBUG] [LOCAL ] BGR: Loaded 13033 existing records from primary storage. [2025-10-28T22:08:35.788721] [INFO ] [MAIN ] BGT: Loaded 15761 primary data records. [2025-10-28T22:08:35.822268] [INFO ] [MAIN ] BGR: Loaded 13033 primary data records. [2025-10-28T22:08:36.695882] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:36.727772] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:36.751620] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:36.811546] [INFO ] [MAIN ] BGX: Generated 138 derivative records from 10865 primary records. [2025-10-28T22:08:36.814275] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-28T22:08:36.827051] [INFO ] [MAIN ] BGT: Generated 138 derivative records from 15761 primary records. [2025-10-28T22:08:36.827390] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-28T22:08:36.830434] [DEBUG] [LOCAL ] BGX: Derivative data saved (138 records). [2025-10-28T22:08:36.839193] [INFO ] [MAIN ] BGR: Generated 138 derivative records from 13033 primary records. [2025-10-28T22:08:36.839295] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-28T22:08:36.839348] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-28T22:08:36.843217] [INFO ] [MAIN ] Derivative Progress: 211/2046 symbols completed. BGX took 1.1s. Estimated remaining: 12m 32s. Rate: 146.5 symbols/min [2025-10-28T22:08:36.843566] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:36.857800] [DEBUG] [LOCAL ] BGT: Derivative data saved (138 records). [2025-10-28T22:08:36.857978] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-28T22:08:36.858048] [DEBUG] [LOCAL ] BGR: Derivative data saved (138 records). [2025-10-28T22:08:36.860425] [INFO ] [MAIN ] Derivative Progress: 212/2046 symbols completed. BGT took 1.1s. Estimated remaining: 12m 28s. Rate: 147.1 symbols/min [2025-10-28T22:08:36.858127] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-28T22:08:36.863375] [INFO ] [MAIN ] Derivative Progress: 213/2046 symbols completed. BGR took 1.1s. Estimated remaining: 12m 24s. Rate: 147.8 symbols/min [2025-10-28T22:08:36.863520] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:36.863225] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:36.883162] [DEBUG] [LOCAL ] BGY: Loaded 21157 existing records from primary storage. [2025-10-28T22:08:36.887680] [INFO ] [MAIN ] BGY: Loaded 21157 primary data records. [2025-10-28T22:08:37.001721] [DEBUG] [LOCAL ] BHE: Loaded 23133 existing records from primary storage. [2025-10-28T22:08:36.990601] [DEBUG] [LOCAL ] BH: Loaded 16681 existing records from primary storage. [2025-10-28T22:08:37.001887] [INFO ] [MAIN ] BHE: Loaded 23133 primary data records. [2025-10-28T22:08:37.002037] [INFO ] [MAIN ] BH: Loaded 16681 primary data records. [2025-10-28T22:08:37.796903] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:37.843136] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:37.851012] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:37.911116] [INFO ] [MAIN ] BGY: Generated 138 derivative records from 21157 primary records. [2025-10-28T22:08:37.915093] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-28T22:08:37.933892] [DEBUG] [LOCAL ] BGY: Derivative data saved (138 records). [2025-10-28T22:08:37.934235] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-28T22:08:37.937077] [INFO ] [MAIN ] Derivative Progress: 214/2046 symbols completed. BGY took 1.1s. Estimated remaining: 12m 29s. Rate: 146.7 symbols/min [2025-10-28T22:08:37.937252] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:37.944808] [INFO ] [MAIN ] BH: Generated 138 derivative records from 16681 primary records. [2025-10-28T22:08:37.945017] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-28T22:08:37.959752] [DEBUG] [LOCAL ] BH: Derivative data saved (138 records). [2025-10-28T22:08:37.965547] [INFO ] [MAIN ] BHE: Generated 138 derivative records from 23133 primary records. [2025-10-28T22:08:37.965315] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-28T22:08:37.965702] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-28T22:08:37.968833] [INFO ] [MAIN ] Derivative Progress: 215/2046 symbols completed. BH took 1.1s. Estimated remaining: 12m 26s. Rate: 147.3 symbols/min [2025-10-28T22:08:37.969007] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:37.990908] [DEBUG] [LOCAL ] BHK: Loaded 24002 existing records from primary storage. [2025-10-28T22:08:37.991455] [INFO ] [MAIN ] BHK: Loaded 24002 primary data records. [2025-10-28T22:08:37.993054] [DEBUG] [LOCAL ] BHE: Derivative data saved (138 records). [2025-10-28T22:08:38.013899] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-28T22:08:38.049758] [INFO ] [MAIN ] Derivative Progress: 216/2046 symbols completed. BHE took 1.2s. Estimated remaining: 12m 22s. Rate: 147.9 symbols/min [2025-10-28T22:08:38.058530] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:38.326402] [DEBUG] [LOCAL ] BHP: Loaded 53359 existing records from primary storage. [2025-10-28T22:08:38.326577] [INFO ] [MAIN ] BHP: Loaded 53359 primary data records. [2025-10-28T22:08:38.450669] [DEBUG] [LOCAL ] BHVN: Loaded 50589 existing records from primary storage. [2025-10-28T22:08:38.487719] [INFO ] [MAIN ] BHVN: Loaded 50589 primary data records. [2025-10-28T22:08:38.967832] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:39.015834] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:39.037246] [INFO ] [MAIN ] BHK: Generated 138 derivative records from 24002 primary records. [2025-10-28T22:08:39.050694] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-28T22:08:39.051754] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:39.078636] [DEBUG] [LOCAL ] BHK: Derivative data saved (138 records). [2025-10-28T22:08:39.078760] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-28T22:08:39.082634] [INFO ] [MAIN ] Derivative Progress: 217/2046 symbols completed. BHK took 1.1s. Estimated remaining: 12m 27s. Rate: 146.8 symbols/min [2025-10-28T22:08:39.083157] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:39.108369] [INFO ] [MAIN ] BHP: Generated 138 derivative records from 53359 primary records. [2025-10-28T22:08:39.111116] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-28T22:08:39.127023] [DEBUG] [LOCAL ] BHP: Derivative data saved (138 records). [2025-10-28T22:08:39.139912] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-28T22:08:39.143385] [INFO ] [MAIN ] Derivative Progress: 218/2046 symbols completed. BHP took 1.2s. Estimated remaining: 12m 24s. Rate: 147.4 symbols/min [2025-10-28T22:08:39.145482] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:39.146327] [INFO ] [MAIN ] BHVN: Generated 138 derivative records from 50589 primary records. [2025-10-28T22:08:39.146485] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-28T22:08:39.158473] [DEBUG] [LOCAL ] BHVN: Derivative data saved (138 records). [2025-10-28T22:08:39.158682] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-28T22:08:39.161927] [INFO ] [MAIN ] Derivative Progress: 219/2046 symbols completed. BHVN took 1.1s. Estimated remaining: 12m 20s. Rate: 148.1 symbols/min [2025-10-28T22:08:39.162720] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:39.177976] [DEBUG] [LOCAL ] BILL: Loaded 52480 existing records from primary storage. [2025-10-28T22:08:39.178762] [INFO ] [MAIN ] BILL: Loaded 52480 primary data records. [2025-10-28T22:08:39.201422] [DEBUG] [LOCAL ] BIPH: Loaded 2221 existing records from primary storage. [2025-10-28T22:08:39.243830] [INFO ] [MAIN ] BIPH: Loaded 2221 primary data records. [2025-10-28T22:08:39.473570] [DEBUG] [LOCAL ] BIP: Loaded 38427 existing records from primary storage. [2025-10-28T22:08:39.479722] [INFO ] [MAIN ] BIP: Loaded 38427 primary data records. [2025-10-28T22:08:40.109573] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:40.149387] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:40.181000] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:40.232786] [INFO ] [MAIN ] BILL: Generated 138 derivative records from 52480 primary records. [2025-10-28T22:08:40.233768] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-28T22:08:40.248770] [DEBUG] [LOCAL ] BILL: Derivative data saved (138 records). [2025-10-28T22:08:40.254590] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-28T22:08:40.257404] [INFO ] [MAIN ] Derivative Progress: 220/2046 symbols completed. BILL took 1.2s. Estimated remaining: 12m 26s. Rate: 146.9 symbols/min [2025-10-28T22:08:40.259498] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:40.267883] [INFO ] [MAIN ] BIPH: Generated 138 derivative records from 2221 primary records. [2025-10-28T22:08:40.272348] [DEBUG] [LOCAL ] BIPI: Loaded 2702 existing records from primary storage. [2025-10-28T22:08:40.272455] [INFO ] [MAIN ] BIPI: Loaded 2702 primary data records. [2025-10-28T22:08:40.270460] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-28T22:08:40.270404] [INFO ] [MAIN ] BIP: Generated 138 derivative records from 38427 primary records. [2025-10-28T22:08:40.293299] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-28T22:08:40.336433] [DEBUG] [LOCAL ] BIPH: Derivative data saved (138 records). [2025-10-28T22:08:40.345445] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-28T22:08:40.377769] [INFO ] [MAIN ] Derivative Progress: 221/2046 symbols completed. BIPH took 1.2s. Estimated remaining: 12m 23s. Rate: 147.4 symbols/min [2025-10-28T22:08:40.393525] [DEBUG] [LOCAL ] BIP: Derivative data saved (138 records). [2025-10-28T22:08:40.383600] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:40.397248] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-28T22:08:40.400474] [INFO ] [MAIN ] Derivative Progress: 222/2046 symbols completed. BIP took 1.3s. Estimated remaining: 12m 19s. Rate: 148.0 symbols/min [2025-10-28T22:08:40.471313] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:40.615032] [DEBUG] [LOCAL ] BIPJ: Loaded 3000 existing records from primary storage. [2025-10-28T22:08:40.615172] [INFO ] [MAIN ] BIPJ: Loaded 3000 primary data records. [2025-10-28T22:08:40.958671] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:40.959639] [DEBUG] [LOCAL ] BIRK: Loaded 51067 existing records from primary storage. [2025-10-28T22:08:40.973393] [INFO ] [MAIN ] BIRK: Loaded 51067 primary data records. [2025-10-28T22:08:41.099567] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:41.333637] [INFO ] [MAIN ] BIPI: Generated 138 derivative records from 2702 primary records. [2025-10-28T22:08:41.334344] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-28T22:08:41.352551] [DEBUG] [LOCAL ] BIPI: Derivative data saved (138 records). [2025-10-28T22:08:41.352983] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-28T22:08:41.355148] [INFO ] [MAIN ] Derivative Progress: 223/2046 symbols completed. BIPI took 1.1s. Estimated remaining: 12m 23s. Rate: 147.1 symbols/min [2025-10-28T22:08:41.357478] [INFO ] [MAIN ] BIPJ: Generated 138 derivative records from 3000 primary records. [2025-10-28T22:08:41.359392] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-28T22:08:41.381004] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:41.394443] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (138 records). [2025-10-28T22:08:41.396185] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-28T22:08:41.398631] [INFO ] [MAIN ] Derivative Progress: 224/2046 symbols completed. BIPJ took 1.0s. Estimated remaining: 12m 20s. Rate: 147.7 symbols/min [2025-10-28T22:08:41.411794] [INFO ] [MAIN ] BIRK: Generated 138 derivative records from 51067 primary records. [2025-10-28T22:08:41.411862] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-28T22:08:41.423064] [DEBUG] [LOCAL ] BIRK: Derivative data saved (138 records). [2025-10-28T22:08:41.423118] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-28T22:08:41.425590] [INFO ] [MAIN ] Derivative Progress: 225/2046 symbols completed. BIRK took 1.0s. Estimated remaining: 12m 17s. Rate: 148.3 symbols/min [2025-10-28T22:08:41.426170] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:41.426289] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:41.426064] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:41.490375] [DEBUG] [LOCAL ] BKD: Loaded 50272 existing records from primary storage. [2025-10-28T22:08:41.491182] [INFO ] [MAIN ] BKD: Loaded 50272 primary data records. [2025-10-28T22:08:41.574519] [DEBUG] [LOCAL ] BJ: Loaded 51394 existing records from primary storage. [2025-10-28T22:08:41.606862] [INFO ] [MAIN ] BJ: Loaded 51394 primary data records. [2025-10-28T22:08:41.697423] [DEBUG] [LOCAL ] BK: Loaded 53534 existing records from primary storage. [2025-10-28T22:08:41.900354] [INFO ] [MAIN ] BK: Loaded 53534 primary data records. [2025-10-28T22:08:42.456482] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:42.495130] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:42.536717] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:42.557840] [INFO ] [MAIN ] BKD: Generated 138 derivative records from 50272 primary records. [2025-10-28T22:08:42.559258] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-28T22:08:42.576326] [DEBUG] [LOCAL ] BKD: Derivative data saved (138 records). [2025-10-28T22:08:42.577504] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-28T22:08:42.580673] [INFO ] [MAIN ] Derivative Progress: 226/2046 symbols completed. BKD took 1.2s. Estimated remaining: 12m 22s. Rate: 147.1 symbols/min [2025-10-28T22:08:42.581062] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:42.593564] [INFO ] [MAIN ] BJ: Generated 138 derivative records from 51394 primary records. [2025-10-28T22:08:42.595133] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-28T22:08:42.621103] [INFO ] [MAIN ] BK: Generated 138 derivative records from 53534 primary records. [2025-10-28T22:08:42.618973] [DEBUG] [LOCAL ] BJ: Derivative data saved (138 records). [2025-10-28T22:08:42.621230] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-28T22:08:42.621311] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-28T22:08:42.623744] [INFO ] [MAIN ] Derivative Progress: 227/2046 symbols completed. BJ took 1.2s. Estimated remaining: 12m 19s. Rate: 147.7 symbols/min [2025-10-28T22:08:42.624153] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:42.636855] [DEBUG] [LOCAL ] BK: Derivative data saved (138 records). [2025-10-28T22:08:42.646073] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-28T22:08:42.648769] [INFO ] [MAIN ] Derivative Progress: 228/2046 symbols completed. BK took 1.2s. Estimated remaining: 12m 15s. Rate: 148.3 symbols/min [2025-10-28T22:08:42.648985] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:42.649889] [DEBUG] [LOCAL ] BKE: Loaded 33084 existing records from primary storage. [2025-10-28T22:08:42.650374] [INFO ] [MAIN ] BKE: Loaded 33084 primary data records. [2025-10-28T22:08:42.967669] [DEBUG] [LOCAL ] BKH: Loaded 37298 existing records from primary storage. [2025-10-28T22:08:42.967918] [INFO ] [MAIN ] BKH: Loaded 37298 primary data records. [2025-10-28T22:08:43.085629] [DEBUG] [LOCAL ] BKKT: Loaded 37975 existing records from primary storage. [2025-10-28T22:08:43.086417] [INFO ] [MAIN ] BKKT: Loaded 37975 primary data records. [2025-10-28T22:08:43.615776] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:43.663611] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:43.695541] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:43.714703] [INFO ] [MAIN ] BKE: Generated 138 derivative records from 33084 primary records. [2025-10-28T22:08:43.714821] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-28T22:08:43.730483] [DEBUG] [LOCAL ] BKE: Derivative data saved (138 records). [2025-10-28T22:08:43.732985] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-28T22:08:43.735501] [INFO ] [MAIN ] Derivative Progress: 229/2046 symbols completed. BKE took 1.2s. Estimated remaining: 12m 20s. Rate: 147.2 symbols/min [2025-10-28T22:08:43.735673] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:43.755501] [DEBUG] [LOCAL ] BKN: Loaded 7211 existing records from primary storage. [2025-10-28T22:08:43.759385] [INFO ] [MAIN ] BKN: Loaded 7211 primary data records. [2025-10-28T22:08:43.871059] [INFO ] [MAIN ] BKH: Generated 138 derivative records from 37298 primary records. [2025-10-28T22:08:43.884736] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-28T22:08:43.962509] [DEBUG] [LOCAL ] BKH: Derivative data saved (138 records). [2025-10-28T22:08:44.061430] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-28T22:08:44.076220] [INFO ] [MAIN ] Derivative Progress: 230/2046 symbols completed. BKH took 1.5s. Estimated remaining: 12m 20s. Rate: 147.3 symbols/min [2025-10-28T22:08:44.077925] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:44.081705] [INFO ] [MAIN ] BKKT: Generated 138 derivative records from 37975 primary records. [2025-10-28T22:08:44.082060] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-28T22:08:44.100131] [DEBUG] [LOCAL ] BKKT: Derivative data saved (138 records). [2025-10-28T22:08:44.100320] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-28T22:08:44.103081] [INFO ] [MAIN ] Derivative Progress: 231/2046 symbols completed. BKKT took 1.5s. Estimated remaining: 12m 16s. Rate: 147.9 symbols/min [2025-10-28T22:08:44.103594] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:44.118919] [DEBUG] [LOCAL ] BKT: Loaded 12704 existing records from primary storage. [2025-10-28T22:08:44.119175] [INFO ] [MAIN ] BKT: Loaded 12704 primary data records. [2025-10-28T22:08:44.336325] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:44.337864] [DEBUG] [LOCAL ] BKSY: Loaded 48927 existing records from primary storage. [2025-10-28T22:08:44.338258] [INFO ] [MAIN ] BKSY: Loaded 48927 primary data records. [2025-10-28T22:08:44.848289] [INFO ] [MAIN ] BKN: Generated 138 derivative records from 7211 primary records. [2025-10-28T22:08:44.849224] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-28T22:08:44.849113] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:44.874940] [DEBUG] [LOCAL ] BKN: Derivative data saved (138 records). [2025-10-28T22:08:44.875115] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-28T22:08:44.877591] [INFO ] [MAIN ] Derivative Progress: 232/2046 symbols completed. BKN took 1.1s. Estimated remaining: 12m 19s. Rate: 147.4 symbols/min [2025-10-28T22:08:44.878205] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:44.923866] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:44.925791] [INFO ] [MAIN ] BKT: Generated 138 derivative records from 12704 primary records. [2025-10-28T22:08:44.936785] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-28T22:08:44.954083] [DEBUG] [LOCAL ] BKT: Derivative data saved (138 records). [2025-10-28T22:08:44.964939] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-28T22:08:44.967979] [INFO ] [MAIN ] Derivative Progress: 233/2046 symbols completed. BKT took 0.9s. Estimated remaining: 12m 16s. Rate: 147.9 symbols/min [2025-10-28T22:08:44.968516] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:44.973304] [DEBUG] [LOCAL ] BKU: Loaded 42090 existing records from primary storage. [2025-10-28T22:08:44.974026] [INFO ] [MAIN ] BKU: Loaded 42090 primary data records. [2025-10-28T22:08:45.244319] [DEBUG] [LOCAL ] BKV: Loaded 28974 existing records from primary storage. [2025-10-28T22:08:45.303182] [INFO ] [MAIN ] BKV: Loaded 28974 primary data records. [2025-10-28T22:08:45.350862] [INFO ] [MAIN ] BKSY: Generated 138 derivative records from 48927 primary records. [2025-10-28T22:08:45.377506] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-28T22:08:45.472531] [DEBUG] [LOCAL ] BKSY: Derivative data saved (138 records). [2025-10-28T22:08:45.598996] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-28T22:08:45.615199] [INFO ] [MAIN ] Derivative Progress: 234/2046 symbols completed. BKSY took 1.5s. Estimated remaining: 12m 17s. Rate: 147.5 symbols/min [2025-10-28T22:08:45.615537] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:45.637533] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:45.679540] [DEBUG] [LOCAL ] BLCO: Loaded 34377 existing records from primary storage. [2025-10-28T22:08:45.681618] [INFO ] [MAIN ] BLCO: Loaded 34377 primary data records. [2025-10-28T22:08:45.728996] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:46.015429] [INFO ] [MAIN ] BKU: Generated 138 derivative records from 42090 primary records. [2025-10-28T22:08:46.015614] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-28T22:08:46.032927] [DEBUG] [LOCAL ] BKU: Derivative data saved (138 records). [2025-10-28T22:08:46.033576] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-28T22:08:46.035801] [INFO ] [MAIN ] Derivative Progress: 235/2046 symbols completed. BKU took 1.2s. Estimated remaining: 12m 17s. Rate: 147.5 symbols/min [2025-10-28T22:08:46.036246] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:46.051522] [INFO ] [MAIN ] BKV: Generated 138 derivative records from 28974 primary records. [2025-10-28T22:08:46.051687] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-28T22:08:46.071156] [DEBUG] [LOCAL ] BKV: Derivative data saved (138 records). [2025-10-28T22:08:46.071471] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-28T22:08:46.074476] [INFO ] [MAIN ] Derivative Progress: 236/2046 symbols completed. BKV took 1.1s. Estimated remaining: 12m 14s. Rate: 148.0 symbols/min [2025-10-28T22:08:46.083499] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:46.085187] [DEBUG] [LOCAL ] BLD: Loaded 26517 existing records from primary storage. [2025-10-28T22:08:46.085377] [INFO ] [MAIN ] BLD: Loaded 26517 primary data records. [2025-10-28T22:08:46.134744] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:46.496973] [DEBUG] [LOCAL ] BLDR: Loaded 51799 existing records from primary storage. [2025-10-28T22:08:46.496199] [INFO ] [MAIN ] BLCO: Generated 138 derivative records from 34377 primary records. [2025-10-28T22:08:46.497125] [INFO ] [MAIN ] BLDR: Loaded 51799 primary data records. [2025-10-28T22:08:46.497361] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-28T22:08:46.613896] [DEBUG] [LOCAL ] BLCO: Derivative data saved (138 records). [2025-10-28T22:08:46.614090] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-28T22:08:46.617264] [INFO ] [MAIN ] Derivative Progress: 237/2046 symbols completed. BLCO took 1.0s. Estimated remaining: 12m 14s. Rate: 147.8 symbols/min [2025-10-28T22:08:46.617402] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:46.710468] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:08:46.841299] [DEBUG] [LOCAL ] BLE: Loaded 13409 existing records from primary storage. [2025-10-28T22:08:46.843129] [INFO ] [MAIN ] BLE: Loaded 13409 primary data records. [2025-10-28T22:08:47.185488] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:47.206463] [INFO ] [MAIN ] BLD: Generated 138 derivative records from 26517 primary records. [2025-10-28T22:08:47.206872] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-28T22:08:47.222467] [DEBUG] [LOCAL ] BLD: Derivative data saved (138 records). [2025-10-28T22:08:47.222586] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-28T22:08:47.224749] [INFO ] [MAIN ] Derivative Progress: 238/2046 symbols completed. BLD took 1.2s. Estimated remaining: 12m 15s. Rate: 147.5 symbols/min [2025-10-28T22:08:47.241934] [INFO ] [MAIN ] BLDR: Generated 138 derivative records from 51799 primary records. [2025-10-28T22:08:47.242146] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-28T22:08:47.254431] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:47.279339] [DEBUG] [LOCAL ] BLDR: Derivative data saved (138 records). [2025-10-28T22:08:47.279509] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-28T22:08:47.282684] [INFO ] [MAIN ] Derivative Progress: 239/2046 symbols completed. BLDR took 1.2s. Estimated remaining: 12m 12s. Rate: 148.0 symbols/min [2025-10-28T22:08:47.294613] [INFO ] [MAIN ] BLE: Generated 138 derivative records from 13409 primary records. [2025-10-28T22:08:47.294703] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-28T22:08:47.305711] [DEBUG] [LOCAL ] BLE: Derivative data saved (138 records). [2025-10-28T22:08:47.305766] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-28T22:08:47.308023] [INFO ] [MAIN ] Derivative Progress: 240/2046 symbols completed. BLE took 0.7s. Estimated remaining: 12m 9s. Rate: 148.6 symbols/min [2025-10-28T22:08:47.308409] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:47.308359] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:47.308903] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:47.323425] [DEBUG] [LOCAL ] BLW: Loaded 12656 existing records from primary storage. [2025-10-28T22:08:47.323688] [INFO ] [MAIN ] BLW: Loaded 12656 primary data records. [2025-10-28T22:08:47.481378] [DEBUG] [LOCAL ] BLK: Loaded 33493 existing records from primary storage. [2025-10-28T22:08:47.503185] [INFO ] [MAIN ] BLK: Loaded 33493 primary data records. [2025-10-28T22:08:47.728052] [DEBUG] [LOCAL ] BLND: Loaded 49182 existing records from primary storage. [2025-10-28T22:08:47.745769] [INFO ] [MAIN ] BLND: Loaded 49182 primary data records. [2025-10-28T22:08:48.274804] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:48.313318] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:48.348498] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:48.443945] [INFO ] [MAIN ] BLW: Generated 138 derivative records from 12656 primary records. [2025-10-28T22:08:48.450994] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-28T22:08:48.465225] [DEBUG] [LOCAL ] BLW: Derivative data saved (138 records). [2025-10-28T22:08:48.465668] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-28T22:08:48.468350] [INFO ] [MAIN ] Derivative Progress: 241/2046 symbols completed. BLW took 1.2s. Estimated remaining: 12m 14s. Rate: 147.5 symbols/min [2025-10-28T22:08:48.468592] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:48.474155] [INFO ] [MAIN ] BLK: Generated 138 derivative records from 33493 primary records. [2025-10-28T22:08:48.474424] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-28T22:08:48.491059] [DEBUG] [LOCAL ] BLK: Derivative data saved (138 records). [2025-10-28T22:08:48.491213] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-28T22:08:48.494125] [INFO ] [MAIN ] Derivative Progress: 242/2046 symbols completed. BLK took 1.2s. Estimated remaining: 12m 11s. Rate: 148.0 symbols/min [2025-10-28T22:08:48.498436] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:48.502077] [INFO ] [MAIN ] BLND: Generated 138 derivative records from 49182 primary records. [2025-10-28T22:08:48.502227] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-28T22:08:48.519922] [DEBUG] [LOCAL ] BLND: Derivative data saved (138 records). [2025-10-28T22:08:48.520103] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-28T22:08:48.523037] [INFO ] [MAIN ] Derivative Progress: 243/2046 symbols completed. BLND took 1.2s. Estimated remaining: 12m 8s. Rate: 148.6 symbols/min [2025-10-28T22:08:48.520431] [DEBUG] [LOCAL ] BLX: Loaded 14892 existing records from primary storage. [2025-10-28T22:08:48.523269] [INFO ] [MAIN ] BLX: Loaded 14892 primary data records. [2025-10-28T22:08:48.523486] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:48.642424] [DEBUG] [LOCAL ] BME: Loaded 11003 existing records from primary storage. [2025-10-28T22:08:48.653489] [INFO ] [MAIN ] BME: Loaded 11003 primary data records. [2025-10-28T22:08:48.794131] [DEBUG] [LOCAL ] BMA: Loaded 36732 existing records from primary storage. [2025-10-28T22:08:48.921496] [INFO ] [MAIN ] BMA: Loaded 36732 primary data records. [2025-10-28T22:08:49.461880] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:49.494636] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:49.533802] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:08:49.574022] [INFO ] [MAIN ] BLX: Generated 138 derivative records from 14892 primary records. [2025-10-28T22:08:49.575189] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-28T22:08:49.577489] [INFO ] [MAIN ] BME: Generated 138 derivative records from 11003 primary records. [2025-10-28T22:08:49.577759] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-28T22:08:49.591839] [DEBUG] [LOCAL ] BLX: Derivative data saved (138 records). [2025-10-28T22:08:49.592117] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-28T22:08:49.602166] [INFO ] [MAIN ] Derivative Progress: 244/2046 symbols completed. BLX took 1.1s. Estimated remaining: 12m 13s. Rate: 147.6 symbols/min [2025-10-28T22:08:49.602310] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:49.612950] [DEBUG] [LOCAL ] BME: Derivative data saved (138 records). [2025-10-28T22:08:49.613216] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-28T22:08:49.615577] [INFO ] [MAIN ] Derivative Progress: 245/2046 symbols completed. BME took 1.1s. Estimated remaining: 12m 9s. Rate: 148.2 symbols/min [2025-10-28T22:08:49.626499] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:49.631075] [INFO ] [MAIN ] BMA: Generated 138 derivative records from 36732 primary records. [2025-10-28T22:08:49.631332] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-28T22:08:49.648242] [DEBUG] [LOCAL ] BMEZ: Loaded 24568 existing records from primary storage. [2025-10-28T22:08:49.650872] [DEBUG] [LOCAL ] BMA: Derivative data saved (138 records). [2025-10-28T22:08:49.651095] [INFO ] [MAIN ] BMEZ: Loaded 24568 primary data records. [2025-10-28T22:08:49.650966] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-28T22:08:49.653621] [INFO ] [MAIN ] Derivative Progress: 246/2046 symbols completed. BMA took 1.2s. Estimated remaining: 12m 6s. Rate: 148.7 symbols/min [2025-10-28T22:08:49.674391] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:49.799844] [DEBUG] [LOCAL ] BMN: Loaded 2634 existing records from primary storage. [2025-10-28T22:08:49.829523] [INFO ] [MAIN ] BMN: Loaded 2634 primary data records. [2025-10-28T22:08:49.963319] [DEBUG] [LOCAL ] BMI: Loaded 24547 existing records from primary storage. [2025-10-28T22:08:50.011582] [INFO ] [MAIN ] BMI: Loaded 24547 primary data records. [2025-10-28T22:08:50.641139] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:50.693387] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:08:50.728528] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:50.755731] [INFO ] [MAIN ] BMEZ: Generated 138 derivative records from 24568 primary records. [2025-10-28T22:08:50.759722] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-28T22:08:50.779766] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (138 records). [2025-10-28T22:08:50.783402] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-28T22:08:50.786032] [INFO ] [MAIN ] Derivative Progress: 247/2046 symbols completed. BMEZ took 1.2s. Estimated remaining: 12m 11s. Rate: 147.7 symbols/min [2025-10-28T22:08:50.788866] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:50.814060] [INFO ] [MAIN ] BMI: Generated 138 derivative records from 24547 primary records. [2025-10-28T22:08:50.816696] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-28T22:08:50.816579] [INFO ] [MAIN ] BMN: Generated 138 derivative records from 2634 primary records. [2025-10-28T22:08:50.817712] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-28T22:08:50.839555] [DEBUG] [LOCAL ] BMI: Derivative data saved (138 records). [2025-10-28T22:08:50.840084] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-28T22:08:50.853991] [DEBUG] [LOCAL ] BMN: Derivative data saved (138 records). [2025-10-28T22:08:50.848598] [INFO ] [MAIN ] Derivative Progress: 248/2046 symbols completed. BMI took 1.2s. Estimated remaining: 12m 8s. Rate: 148.2 symbols/min [2025-10-28T22:08:50.855040] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:50.854762] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-28T22:08:50.858764] [INFO ] [MAIN ] Derivative Progress: 249/2046 symbols completed. BMN took 1.2s. Estimated remaining: 12m 5s. Rate: 148.7 symbols/min [2025-10-28T22:08:50.870611] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:50.872774] [DEBUG] [LOCAL ] BMO: Loaded 40411 existing records from primary storage. [2025-10-28T22:08:50.873150] [INFO ] [MAIN ] BMO: Loaded 40411 primary data records. [2025-10-28T22:08:51.224049] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-28T22:08:51.225198] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-28T22:08:51.330031] [DEBUG] [LOCAL ] BN: Loaded 52969 existing records from primary storage. [2025-10-28T22:08:51.355233] [INFO ] [MAIN ] BN: Loaded 52969 primary data records. [2025-10-28T22:08:51.508936] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:51.927882] [INFO ] [MAIN ] BMO: Generated 138 derivative records from 40411 primary records. [2025-10-28T22:08:51.928450] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:51.939724] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-28T22:08:51.958178] [DEBUG] [LOCAL ] BMO: Derivative data saved (138 records). [2025-10-28T22:08:51.958780] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-28T22:08:51.961699] [INFO ] [MAIN ] Derivative Progress: 250/2046 symbols completed. BMO took 1.2s. Estimated remaining: 12m 10s. Rate: 147.7 symbols/min [2025-10-28T22:08:51.964491] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:51.987151] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:52.036218] [INFO ] [MAIN ] BMY: Generated 138 derivative records from 53757 primary records. [2025-10-28T22:08:52.036877] [DEBUG] [LOCAL ] BNED: Loaded 27781 existing records from primary storage. [2025-10-28T22:08:52.037217] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-28T22:08:52.040833] [INFO ] [MAIN ] BNED: Loaded 27781 primary data records. [2025-10-28T22:08:52.081002] [DEBUG] [LOCAL ] BMY: Derivative data saved (138 records). [2025-10-28T22:08:52.110855] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-28T22:08:52.113262] [INFO ] [MAIN ] Derivative Progress: 251/2046 symbols completed. BMY took 1.3s. Estimated remaining: 12m 7s. Rate: 148.1 symbols/min [2025-10-28T22:08:52.157061] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:52.267354] [DEBUG] [LOCAL ] BNH: Loaded 4480 existing records from primary storage. [2025-10-28T22:08:52.401385] [INFO ] [MAIN ] BNH: Loaded 4480 primary data records. [2025-10-28T22:08:52.403602] [INFO ] [MAIN ] BN: Generated 138 derivative records from 52969 primary records. [2025-10-28T22:08:52.424100] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-28T22:08:52.492130] [DEBUG] [LOCAL ] BN: Derivative data saved (138 records). [2025-10-28T22:08:52.515957] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-28T22:08:52.522077] [INFO ] [MAIN ] Derivative Progress: 252/2046 symbols completed. BN took 1.7s. Estimated remaining: 12m 7s. Rate: 148.1 symbols/min [2025-10-28T22:08:52.543295] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:52.764704] [DEBUG] [LOCAL ] BNJ: Loaded 2411 existing records from primary storage. [2025-10-28T22:08:52.765044] [INFO ] [MAIN ] BNJ: Loaded 2411 primary data records. [2025-10-28T22:08:52.915050] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:53.135178] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:53.188440] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:53.189105] [INFO ] [MAIN ] BNED: Generated 138 derivative records from 27781 primary records. [2025-10-28T22:08:53.199595] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-28T22:08:53.215280] [DEBUG] [LOCAL ] BNED: Derivative data saved (138 records). [2025-10-28T22:08:53.215590] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-28T22:08:53.217800] [INFO ] [MAIN ] Derivative Progress: 253/2046 symbols completed. BNED took 1.3s. Estimated remaining: 12m 9s. Rate: 147.7 symbols/min [2025-10-28T22:08:53.228804] [INFO ] [MAIN ] BNH: Generated 138 derivative records from 4480 primary records. [2025-10-28T22:08:53.230981] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-28T22:08:53.243393] [DEBUG] [LOCAL ] BNH: Derivative data saved (138 records). [2025-10-28T22:08:53.246078] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-28T22:08:53.249303] [INFO ] [MAIN ] Derivative Progress: 254/2046 symbols completed. BNH took 1.1s. Estimated remaining: 12m 5s. Rate: 148.2 symbols/min [2025-10-28T22:08:53.253982] [INFO ] [MAIN ] BNJ: Generated 138 derivative records from 2411 primary records. [2025-10-28T22:08:53.254058] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-28T22:08:53.263888] [DEBUG] [LOCAL ] BNJ: Derivative data saved (138 records). [2025-10-28T22:08:53.263964] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-28T22:08:53.266687] [INFO ] [MAIN ] Derivative Progress: 255/2046 symbols completed. BNJ took 0.7s. Estimated remaining: 12m 2s. Rate: 148.8 symbols/min [2025-10-28T22:08:53.267040] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:53.267465] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:53.267524] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:53.273931] [DEBUG] [LOCAL ] BNT: Loaded 3298 existing records from primary storage. [2025-10-28T22:08:53.274226] [INFO ] [MAIN ] BNT: Loaded 3298 primary data records. [2025-10-28T22:08:53.635445] [DEBUG] [LOCAL ] BNL: Loaded 46779 existing records from primary storage. [2025-10-28T22:08:53.648844] [INFO ] [MAIN ] BNL: Loaded 46779 primary data records. [2025-10-28T22:08:53.682619] [DEBUG] [LOCAL ] BNS: Loaded 51279 existing records from primary storage. [2025-10-28T22:08:53.694913] [INFO ] [MAIN ] BNS: Loaded 51279 primary data records. [2025-10-28T22:08:54.277753] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:08:54.337847] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:54.343433] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:54.391716] [INFO ] [MAIN ] BNT: Generated 138 derivative records from 3298 primary records. [2025-10-28T22:08:54.395352] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-28T22:08:54.414021] [DEBUG] [LOCAL ] BNT: Derivative data saved (138 records). [2025-10-28T22:08:54.414236] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-28T22:08:54.416902] [INFO ] [MAIN ] Derivative Progress: 256/2046 symbols completed. BNT took 1.1s. Estimated remaining: 12m 7s. Rate: 147.7 symbols/min [2025-10-28T22:08:54.420211] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:54.442054] [DEBUG] [LOCAL ] BNY: Loaded 7132 existing records from primary storage. [2025-10-28T22:08:54.444225] [INFO ] [MAIN ] BNY: Loaded 7132 primary data records. [2025-10-28T22:08:54.451070] [INFO ] [MAIN ] BNL: Generated 138 derivative records from 46779 primary records. [2025-10-28T22:08:54.474311] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-28T22:08:54.516124] [INFO ] [MAIN ] BNS: Generated 138 derivative records from 51279 primary records. [2025-10-28T22:08:54.570997] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-28T22:08:54.589121] [DEBUG] [LOCAL ] BNL: Derivative data saved (138 records). [2025-10-28T22:08:54.607276] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-28T22:08:54.609711] [INFO ] [MAIN ] Derivative Progress: 257/2046 symbols completed. BNL took 1.3s. Estimated remaining: 12m 5s. Rate: 148.0 symbols/min [2025-10-28T22:08:54.622540] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:54.635779] [DEBUG] [LOCAL ] BNS: Derivative data saved (138 records). [2025-10-28T22:08:54.658026] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-28T22:08:54.667840] [INFO ] [MAIN ] Derivative Progress: 258/2046 symbols completed. BNS took 1.4s. Estimated remaining: 12m 2s. Rate: 148.5 symbols/min [2025-10-28T22:08:54.692502] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:54.868571] [DEBUG] [LOCAL ] BOC: Loaded 17761 existing records from primary storage. [2025-10-28T22:08:54.868814] [INFO ] [MAIN ] BOC: Loaded 17761 primary data records. [2025-10-28T22:08:54.996541] [DEBUG] [LOCAL ] BOH: Loaded 30444 existing records from primary storage. [2025-10-28T22:08:55.008009] [INFO ] [MAIN ] BOH: Loaded 30444 primary data records. [2025-10-28T22:08:55.323214] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:55.557377] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:55.558250] [INFO ] [MAIN ] BNY: Generated 138 derivative records from 7132 primary records. [2025-10-28T22:08:55.570946] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-28T22:08:55.594854] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:55.614978] [DEBUG] [LOCAL ] BNY: Derivative data saved (138 records). [2025-10-28T22:08:55.616307] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-28T22:08:55.622093] [INFO ] [MAIN ] Derivative Progress: 259/2046 symbols completed. BNY took 1.2s. Estimated remaining: 12m 6s. Rate: 147.7 symbols/min [2025-10-28T22:08:55.622938] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:55.666625] [INFO ] [MAIN ] BOC: Generated 138 derivative records from 17761 primary records. [2025-10-28T22:08:55.666906] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-28T22:08:55.679828] [DEBUG] [LOCAL ] BOC: Derivative data saved (138 records). [2025-10-28T22:08:55.680370] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-28T22:08:55.693943] [INFO ] [MAIN ] Derivative Progress: 260/2046 symbols completed. BOC took 1.1s. Estimated remaining: 12m 3s. Rate: 148.2 symbols/min [2025-10-28T22:08:55.696127] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:55.696607] [INFO ] [MAIN ] BOH: Generated 138 derivative records from 30444 primary records. [2025-10-28T22:08:55.698168] [DEBUG] [LOCAL ] BOOT: Loaded 39014 existing records from primary storage. [2025-10-28T22:08:55.698386] [INFO ] [MAIN ] BOOT: Loaded 39014 primary data records. [2025-10-28T22:08:55.698492] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-28T22:08:55.766787] [DEBUG] [LOCAL ] BOH: Derivative data saved (138 records). [2025-10-28T22:08:55.799279] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-28T22:08:55.807612] [INFO ] [MAIN ] Derivative Progress: 261/2046 symbols completed. BOH took 1.1s. Estimated remaining: 12m 1s. Rate: 148.6 symbols/min [2025-10-28T22:08:55.821613] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:56.065925] [DEBUG] [LOCAL ] BORR: Loaded 51050 existing records from primary storage. [2025-10-28T22:08:56.066228] [INFO ] [MAIN ] BORR: Loaded 51050 primary data records. [2025-10-28T22:08:56.162122] [DEBUG] [LOCAL ] BOW: Loaded 22520 existing records from primary storage. [2025-10-28T22:08:56.178598] [INFO ] [MAIN ] BOW: Loaded 22520 primary data records. [2025-10-28T22:08:56.766841] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:56.815330] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:56.857141] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:56.875271] [INFO ] [MAIN ] BOOT: Generated 138 derivative records from 39014 primary records. [2025-10-28T22:08:56.878361] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-28T22:08:56.893434] [DEBUG] [LOCAL ] BOOT: Derivative data saved (138 records). [2025-10-28T22:08:56.896024] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-28T22:08:56.898218] [INFO ] [MAIN ] Derivative Progress: 262/2046 symbols completed. BOOT took 1.3s. Estimated remaining: 12m 5s. Rate: 147.6 symbols/min [2025-10-28T22:08:56.898904] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:56.915846] [INFO ] [MAIN ] BORR: Generated 138 derivative records from 51050 primary records. [2025-10-28T22:08:56.917825] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-28T22:08:56.934932] [DEBUG] [LOCAL ] BORR: Derivative data saved (138 records). [2025-10-28T22:08:56.945263] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-28T22:08:56.947506] [INFO ] [MAIN ] Derivative Progress: 263/2046 symbols completed. BORR took 1.3s. Estimated remaining: 12m 2s. Rate: 148.1 symbols/min [2025-10-28T22:08:56.950120] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:56.954485] [INFO ] [MAIN ] BOW: Generated 138 derivative records from 22520 primary records. [2025-10-28T22:08:56.954675] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-28T22:08:56.969469] [DEBUG] [LOCAL ] BOW: Derivative data saved (138 records). [2025-10-28T22:08:56.969600] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-28T22:08:56.972811] [INFO ] [MAIN ] Derivative Progress: 264/2046 symbols completed. BOW took 1.2s. Estimated remaining: 11m 59s. Rate: 148.7 symbols/min [2025-10-28T22:08:56.986213] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:56.989024] [DEBUG] [LOCAL ] BOX: Loaded 49960 existing records from primary storage. [2025-10-28T22:08:56.989369] [INFO ] [MAIN ] BOX: Loaded 49960 primary data records. [2025-10-28T22:08:57.312921] [DEBUG] [LOCAL ] BP: Loaded 53705 existing records from primary storage. [2025-10-28T22:08:57.326409] [INFO ] [MAIN ] BP: Loaded 53705 primary data records. [2025-10-28T22:08:57.405118] [DEBUG] [LOCAL ] BR: Loaded 34189 existing records from primary storage. [2025-10-28T22:08:57.428603] [INFO ] [MAIN ] BR: Loaded 34189 primary data records. [2025-10-28T22:08:57.950497] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:57.991631] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:58.036184] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:58.054630] [INFO ] [MAIN ] BOX: Generated 138 derivative records from 49960 primary records. [2025-10-28T22:08:58.058104] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-28T22:08:58.074379] [DEBUG] [LOCAL ] BOX: Derivative data saved (138 records). [2025-10-28T22:08:58.074687] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-28T22:08:58.077385] [INFO ] [MAIN ] Derivative Progress: 265/2046 symbols completed. BOX took 1.2s. Estimated remaining: 12m 4s. Rate: 147.7 symbols/min [2025-10-28T22:08:58.077832] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:58.093597] [INFO ] [MAIN ] BP: Generated 138 derivative records from 53705 primary records. [2025-10-28T22:08:58.094896] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-28T22:08:58.114365] [DEBUG] [LOCAL ] BP: Derivative data saved (138 records). [2025-10-28T22:08:58.117753] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-28T22:08:58.119772] [INFO ] [MAIN ] Derivative Progress: 266/2046 symbols completed. BP took 1.2s. Estimated remaining: 12m 1s. Rate: 148.2 symbols/min [2025-10-28T22:08:58.120090] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:58.124511] [INFO ] [MAIN ] BR: Generated 138 derivative records from 34189 primary records. [2025-10-28T22:08:58.124779] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-28T22:08:58.141945] [DEBUG] [LOCAL ] BR: Derivative data saved (138 records). [2025-10-28T22:08:58.154059] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-28T22:08:58.157435] [INFO ] [MAIN ] Derivative Progress: 267/2046 symbols completed. BR took 1.2s. Estimated remaining: 11m 58s. Rate: 148.7 symbols/min [2025-10-28T22:08:58.163912] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:58.164675] [DEBUG] [LOCAL ] BRC: Loaded 17861 existing records from primary storage. [2025-10-28T22:08:58.164766] [INFO ] [MAIN ] BRC: Loaded 17861 primary data records. [2025-10-28T22:08:58.298845] [DEBUG] [LOCAL ] BRBR: Loaded 51854 existing records from primary storage. [2025-10-28T22:08:58.335780] [INFO ] [MAIN ] BRBR: Loaded 51854 primary data records. [2025-10-28T22:08:58.605586] [DEBUG] [LOCAL ] BRCC: Loaded 39997 existing records from primary storage. [2025-10-28T22:08:58.616551] [INFO ] [MAIN ] BRCC: Loaded 39997 primary data records. [2025-10-28T22:08:59.047992] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:59.225406] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:59.251940] [INFO ] [MAIN ] BRC: Generated 138 derivative records from 17861 primary records. [2025-10-28T22:08:59.253284] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-28T22:08:59.283684] [DEBUG] [LOCAL ] BRC: Derivative data saved (138 records). [2025-10-28T22:08:59.285998] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-28T22:08:59.284496] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:08:59.288251] [INFO ] [MAIN ] Derivative Progress: 268/2046 symbols completed. BRC took 1.2s. Estimated remaining: 12m 2s. Rate: 147.7 symbols/min [2025-10-28T22:08:59.321047] [INFO ] [MAIN ] BRBR: Generated 138 derivative records from 51854 primary records. [2025-10-28T22:08:59.323511] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-28T22:08:59.341198] [DEBUG] [LOCAL ] BRBR: Derivative data saved (138 records). [2025-10-28T22:08:59.342500] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-28T22:08:59.345274] [INFO ] [MAIN ] Derivative Progress: 269/2046 symbols completed. BRBR took 1.3s. Estimated remaining: 11m 60s. Rate: 148.2 symbols/min [2025-10-28T22:08:59.350489] [INFO ] [MAIN ] BRCC: Generated 138 derivative records from 39997 primary records. [2025-10-28T22:08:59.350558] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-28T22:08:59.361914] [DEBUG] [LOCAL ] BRCC: Derivative data saved (138 records). [2025-10-28T22:08:59.361968] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-28T22:08:59.364334] [INFO ] [MAIN ] Derivative Progress: 270/2046 symbols completed. BRCC took 1.2s. Estimated remaining: 11m 57s. Rate: 148.7 symbols/min [2025-10-28T22:08:59.364711] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:59.364824] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:59.364871] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:08:59.444603] [DEBUG] [LOCAL ] BRO: Loaded 52100 existing records from primary storage. [2025-10-28T22:08:59.444907] [INFO ] [MAIN ] BRO: Loaded 52100 primary data records. [2025-10-28T22:08:59.466779] [DEBUG] [LOCAL ] BRSP: Loaded 35933 existing records from primary storage. [2025-10-28T22:08:59.477188] [INFO ] [MAIN ] BRSP: Loaded 35933 primary data records. [2025-10-28T22:08:59.605362] [DEBUG] [LOCAL ] BROS: Loaded 53295 existing records from primary storage. [2025-10-28T22:08:59.664884] [INFO ] [MAIN ] BROS: Loaded 53295 primary data records. [2025-10-28T22:09:00.381889] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:00.416327] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:00.443919] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:00.508694] [INFO ] [MAIN ] BRO: Generated 138 derivative records from 52100 primary records. [2025-10-28T22:09:00.508939] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-28T22:09:00.530378] [DEBUG] [LOCAL ] BRO: Derivative data saved (138 records). [2025-10-28T22:09:00.532966] [INFO ] [MAIN ] BRSP: Generated 138 derivative records from 35933 primary records. [2025-10-28T22:09:00.531170] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-28T22:09:00.533080] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-28T22:09:00.535270] [INFO ] [MAIN ] Derivative Progress: 271/2046 symbols completed. BRO took 1.2s. Estimated remaining: 12m 1s. Rate: 147.7 symbols/min [2025-10-28T22:09:00.540448] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:00.540768] [INFO ] [MAIN ] BROS: Generated 138 derivative records from 53295 primary records. [2025-10-28T22:09:00.550826] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-28T22:09:00.553202] [DEBUG] [LOCAL ] BRSP: Derivative data saved (138 records). [2025-10-28T22:09:00.554876] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-28T22:09:00.564431] [INFO ] [MAIN ] Derivative Progress: 272/2046 symbols completed. BRSP took 1.2s. Estimated remaining: 11m 58s. Rate: 148.2 symbols/min [2025-10-28T22:09:00.564606] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:00.569551] [DEBUG] [LOCAL ] BROS: Derivative data saved (138 records). [2025-10-28T22:09:00.569801] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-28T22:09:00.572447] [INFO ] [MAIN ] Derivative Progress: 273/2046 symbols completed. BROS took 1.2s. Estimated remaining: 11m 55s. Rate: 148.7 symbols/min [2025-10-28T22:09:00.572680] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:00.576288] [DEBUG] [LOCAL ] BRT: Loaded 5156 existing records from primary storage. [2025-10-28T22:09:00.576463] [INFO ] [MAIN ] BRT: Loaded 5156 primary data records. [2025-10-28T22:09:00.710942] [DEBUG] [LOCAL ] BRW: Loaded 20781 existing records from primary storage. [2025-10-28T22:09:00.730618] [INFO ] [MAIN ] BRW: Loaded 20781 primary data records. [2025-10-28T22:09:01.234126] [DEBUG] [LOCAL ] BRX: Loaded 51800 existing records from primary storage. [2025-10-28T22:09:01.234354] [INFO ] [MAIN ] BRX: Loaded 51800 primary data records. [2025-10-28T22:09:01.563100] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:01.603696] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:01.664701] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:01.685618] [INFO ] [MAIN ] BRT: Generated 138 derivative records from 5156 primary records. [2025-10-28T22:09:01.688903] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-28T22:09:01.714088] [DEBUG] [LOCAL ] BRT: Derivative data saved (138 records). [2025-10-28T22:09:01.720100] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-28T22:09:01.722739] [INFO ] [MAIN ] Derivative Progress: 274/2046 symbols completed. BRT took 1.2s. Estimated remaining: 11m 60s. Rate: 147.7 symbols/min [2025-10-28T22:09:01.723540] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:01.731025] [INFO ] [MAIN ] BRW: Generated 138 derivative records from 20781 primary records. [2025-10-28T22:09:01.732402] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-28T22:09:01.747807] [DEBUG] [LOCAL ] BRW: Derivative data saved (138 records). [2025-10-28T22:09:01.748918] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-28T22:09:01.751411] [INFO ] [MAIN ] Derivative Progress: 275/2046 symbols completed. BRW took 1.2s. Estimated remaining: 11m 57s. Rate: 148.2 symbols/min [2025-10-28T22:09:01.752062] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:01.768844] [INFO ] [MAIN ] BRX: Generated 138 derivative records from 51800 primary records. [2025-10-28T22:09:01.769044] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-28T22:09:01.792755] [DEBUG] [LOCAL ] BRX: Derivative data saved (138 records). [2025-10-28T22:09:01.794182] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-28T22:09:01.794042] [DEBUG] [LOCAL ] BSAC: Loaded 32305 existing records from primary storage. [2025-10-28T22:09:01.796896] [INFO ] [MAIN ] Derivative Progress: 276/2046 symbols completed. BRX took 1.2s. Estimated remaining: 11m 54s. Rate: 148.7 symbols/min [2025-10-28T22:09:01.797073] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:01.797443] [INFO ] [MAIN ] BSAC: Loaded 32305 primary data records. [2025-10-28T22:09:01.911077] [DEBUG] [LOCAL ] BSL: Loaded 7990 existing records from primary storage. [2025-10-28T22:09:01.939558] [INFO ] [MAIN ] BSL: Loaded 7990 primary data records. [2025-10-28T22:09:01.988882] [DEBUG] [LOCAL ] BSBR: Loaded 35513 existing records from primary storage. [2025-10-28T22:09:02.004480] [INFO ] [MAIN ] BSBR: Loaded 35513 primary data records. [2025-10-28T22:09:02.806933] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:02.857155] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:02.863080] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:02.928168] [INFO ] [MAIN ] BSAC: Generated 138 derivative records from 32305 primary records. [2025-10-28T22:09:02.930237] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-28T22:09:02.956824] [DEBUG] [LOCAL ] BSAC: Derivative data saved (138 records). [2025-10-28T22:09:02.957942] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-28T22:09:02.960054] [INFO ] [MAIN ] Derivative Progress: 277/2046 symbols completed. BSAC took 1.2s. Estimated remaining: 11m 59s. Rate: 147.7 symbols/min [2025-10-28T22:09:02.961519] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:02.969106] [INFO ] [MAIN ] BSL: Generated 138 derivative records from 7990 primary records. [2025-10-28T22:09:02.969685] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-28T22:09:02.985222] [DEBUG] [LOCAL ] BSL: Derivative data saved (138 records). [2025-10-28T22:09:02.985445] [INFO ] [MAIN ] BSBR: Generated 138 derivative records from 35513 primary records. [2025-10-28T22:09:02.985723] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-28T22:09:02.985812] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-28T22:09:02.987979] [INFO ] [MAIN ] Derivative Progress: 278/2046 symbols completed. BSL took 1.2s. Estimated remaining: 11m 56s. Rate: 148.2 symbols/min [2025-10-28T22:09:02.988289] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:03.002518] [DEBUG] [LOCAL ] BSBR: Derivative data saved (138 records). [2025-10-28T22:09:03.011028] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-28T22:09:03.013864] [INFO ] [MAIN ] Derivative Progress: 279/2046 symbols completed. BSBR took 1.3s. Estimated remaining: 11m 53s. Rate: 148.7 symbols/min [2025-10-28T22:09:03.014083] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:03.041163] [DEBUG] [LOCAL ] BSM: Loaded 31800 existing records from primary storage. [2025-10-28T22:09:03.041575] [DEBUG] [LOCAL ] BSTZ: Loaded 24145 existing records from primary storage. [2025-10-28T22:09:03.041702] [INFO ] [MAIN ] BSM: Loaded 31800 primary data records. [2025-10-28T22:09:03.041782] [INFO ] [MAIN ] BSTZ: Loaded 24145 primary data records. [2025-10-28T22:09:03.648608] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-28T22:09:03.693074] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-28T22:09:04.035150] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:04.065303] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:04.108620] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:04.153499] [INFO ] [MAIN ] BSTZ: Generated 138 derivative records from 24145 primary records. [2025-10-28T22:09:04.156759] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-28T22:09:04.173366] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (138 records). [2025-10-28T22:09:04.174002] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-28T22:09:04.179432] [INFO ] [MAIN ] Derivative Progress: 280/2046 symbols completed. BSTZ took 1.2s. Estimated remaining: 11m 58s. Rate: 147.7 symbols/min [2025-10-28T22:09:04.180281] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:04.186819] [INFO ] [MAIN ] BSM: Generated 138 derivative records from 31800 primary records. [2025-10-28T22:09:04.187263] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-28T22:09:04.202617] [DEBUG] [LOCAL ] BSM: Derivative data saved (138 records). [2025-10-28T22:09:04.207411] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-28T22:09:04.207633] [INFO ] [MAIN ] BSX: Generated 138 derivative records from 53688 primary records. [2025-10-28T22:09:04.210020] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-28T22:09:04.207077] [DEBUG] [LOCAL ] BTA: Loaded 5643 existing records from primary storage. [2025-10-28T22:09:04.209909] [INFO ] [MAIN ] Derivative Progress: 281/2046 symbols completed. BSM took 1.2s. Estimated remaining: 11m 55s. Rate: 148.2 symbols/min [2025-10-28T22:09:04.210208] [INFO ] [MAIN ] BTA: Loaded 5643 primary data records. [2025-10-28T22:09:04.210408] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:04.309856] [DEBUG] [LOCAL ] BSX: Derivative data saved (138 records). [2025-10-28T22:09:04.322132] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-28T22:09:04.324864] [INFO ] [MAIN ] Derivative Progress: 282/2046 symbols completed. BSX took 1.3s. Estimated remaining: 11m 53s. Rate: 148.5 symbols/min [2025-10-28T22:09:04.344742] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:04.601597] [DEBUG] [LOCAL ] BTE: Loaded 52665 existing records from primary storage. [2025-10-28T22:09:04.601948] [INFO ] [MAIN ] BTE: Loaded 52665 primary data records. [2025-10-28T22:09:04.750053] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:04.790090] [DEBUG] [LOCAL ] BTI: Loaded 53583 existing records from primary storage. [2025-10-28T22:09:04.829483] [INFO ] [MAIN ] BTI: Loaded 53583 primary data records. [2025-10-28T22:09:05.307907] [INFO ] [MAIN ] BTA: Generated 138 derivative records from 5643 primary records. [2025-10-28T22:09:05.308970] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-28T22:09:05.334190] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:05.334966] [DEBUG] [LOCAL ] BTA: Derivative data saved (138 records). [2025-10-28T22:09:05.345857] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-28T22:09:05.348566] [INFO ] [MAIN ] Derivative Progress: 283/2046 symbols completed. BTA took 1.2s. Estimated remaining: 11m 56s. Rate: 147.7 symbols/min [2025-10-28T22:09:05.372925] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:05.402061] [INFO ] [MAIN ] BTE: Generated 138 derivative records from 52665 primary records. [2025-10-28T22:09:05.402262] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-28T22:09:05.420846] [DEBUG] [LOCAL ] BTE: Derivative data saved (138 records). [2025-10-28T22:09:05.421169] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-28T22:09:05.422992] [INFO ] [MAIN ] Derivative Progress: 284/2046 symbols completed. BTE took 1.2s. Estimated remaining: 11m 54s. Rate: 148.2 symbols/min [2025-10-28T22:09:05.425443] [INFO ] [MAIN ] BTI: Generated 138 derivative records from 53583 primary records. [2025-10-28T22:09:05.425563] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-28T22:09:05.437040] [DEBUG] [LOCAL ] BTI: Derivative data saved (138 records). [2025-10-28T22:09:05.437094] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-28T22:09:05.439728] [INFO ] [MAIN ] Derivative Progress: 285/2046 symbols completed. BTI took 1.1s. Estimated remaining: 11m 51s. Rate: 148.7 symbols/min [2025-10-28T22:09:05.440092] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:05.440379] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:05.440736] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:05.453575] [DEBUG] [LOCAL ] BTO: Loaded 8608 existing records from primary storage. [2025-10-28T22:09:05.453838] [INFO ] [MAIN ] BTO: Loaded 8608 primary data records. [2025-10-28T22:09:05.514499] [DEBUG] [LOCAL ] BTT: Loaded 15008 existing records from primary storage. [2025-10-28T22:09:05.534919] [INFO ] [MAIN ] BTT: Loaded 15008 primary data records. [2025-10-28T22:09:05.953539] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-28T22:09:05.958811] [INFO ] [MAIN ] BTU: Loaded 53318 primary data records. [2025-10-28T22:09:06.399326] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:06.424039] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:06.471279] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:06.518362] [INFO ] [MAIN ] BTT: Generated 138 derivative records from 15008 primary records. [2025-10-28T22:09:06.516016] [INFO ] [MAIN ] BTO: Generated 138 derivative records from 8608 primary records. [2025-10-28T22:09:06.518964] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-28T22:09:06.519005] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-28T22:09:06.545722] [DEBUG] [LOCAL ] BTO: Derivative data saved (138 records). [2025-10-28T22:09:06.545827] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-28T22:09:06.546230] [DEBUG] [LOCAL ] BTT: Derivative data saved (138 records). [2025-10-28T22:09:06.548704] [INFO ] [MAIN ] Derivative Progress: 286/2046 symbols completed. BTO took 1.1s. Estimated remaining: 11m 55s. Rate: 147.8 symbols/min [2025-10-28T22:09:06.548818] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-28T22:09:06.552224] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:06.552314] [INFO ] [MAIN ] Derivative Progress: 287/2046 symbols completed. BTT took 1.1s. Estimated remaining: 11m 52s. Rate: 148.3 symbols/min [2025-10-28T22:09:06.552511] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:06.555384] [INFO ] [MAIN ] BTU: Generated 138 derivative records from 53318 primary records. [2025-10-28T22:09:06.555706] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-28T22:09:06.568526] [DEBUG] [LOCAL ] BTU: Derivative data saved (138 records). [2025-10-28T22:09:06.568598] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-28T22:09:06.570745] [INFO ] [MAIN ] Derivative Progress: 288/2046 symbols completed. BTU took 1.1s. Estimated remaining: 11m 49s. Rate: 148.8 symbols/min [2025-10-28T22:09:06.571075] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:06.594714] [DEBUG] [LOCAL ] BTZ: Loaded 21866 existing records from primary storage. [2025-10-28T22:09:06.594309] [DEBUG] [LOCAL ] BUI: Loaded 11546 existing records from primary storage. [2025-10-28T22:09:06.594917] [INFO ] [MAIN ] BUI: Loaded 11546 primary data records. [2025-10-28T22:09:06.594858] [INFO ] [MAIN ] BTZ: Loaded 21866 primary data records. [2025-10-28T22:09:06.889209] [DEBUG] [LOCAL ] BUD: Loaded 52576 existing records from primary storage. [2025-10-28T22:09:07.085950] [INFO ] [MAIN ] BUD: Loaded 52576 primary data records. [2025-10-28T22:09:07.580521] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:07.609706] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:07.646545] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:07.702744] [INFO ] [MAIN ] BTZ: Generated 138 derivative records from 21866 primary records. [2025-10-28T22:09:07.705485] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-28T22:09:07.721663] [DEBUG] [LOCAL ] BTZ: Derivative data saved (138 records). [2025-10-28T22:09:07.722094] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-28T22:09:07.721967] [INFO ] [MAIN ] BUI: Generated 138 derivative records from 11546 primary records. [2025-10-28T22:09:07.724462] [INFO ] [MAIN ] Derivative Progress: 289/2046 symbols completed. BTZ took 1.2s. Estimated remaining: 11m 53s. Rate: 147.8 symbols/min [2025-10-28T22:09:07.727869] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-28T22:09:07.728017] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:07.745493] [DEBUG] [LOCAL ] BUI: Derivative data saved (138 records). [2025-10-28T22:09:07.744607] [INFO ] [MAIN ] BUD: Generated 138 derivative records from 52576 primary records. [2025-10-28T22:09:07.745708] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-28T22:09:07.747929] [INFO ] [MAIN ] Derivative Progress: 290/2046 symbols completed. BUI took 1.2s. Estimated remaining: 11m 50s. Rate: 148.3 symbols/min [2025-10-28T22:09:07.748106] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:07.748579] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-28T22:09:07.762196] [DEBUG] [LOCAL ] BUD: Derivative data saved (138 records). [2025-10-28T22:09:07.762494] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-28T22:09:07.764897] [INFO ] [MAIN ] Derivative Progress: 291/2046 symbols completed. BUD took 1.2s. Estimated remaining: 11m 48s. Rate: 148.8 symbols/min [2025-10-28T22:09:07.765119] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:07.798981] [DEBUG] [LOCAL ] BUXX: Loaded 15150 existing records from primary storage. [2025-10-28T22:09:07.810713] [INFO ] [MAIN ] BUXX: Loaded 15150 primary data records. [2025-10-28T22:09:07.835035] [DEBUG] [LOCAL ] BUR: Loaded 45403 existing records from primary storage. [2025-10-28T22:09:07.851726] [INFO ] [MAIN ] BUR: Loaded 45403 primary data records. [2025-10-28T22:09:08.003132] [DEBUG] [LOCAL ] BURL: Loaded 45055 existing records from primary storage. [2025-10-28T22:09:08.042797] [INFO ] [MAIN ] BURL: Loaded 45055 primary data records. [2025-10-28T22:09:08.792953] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:08.809438] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:08.844781] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:08.913334] [INFO ] [MAIN ] BUXX: Generated 138 derivative records from 15150 primary records. [2025-10-28T22:09:08.914757] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-28T22:09:08.921421] [INFO ] [MAIN ] BUR: Generated 138 derivative records from 45403 primary records. [2025-10-28T22:09:08.931218] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-28T22:09:08.950424] [DEBUG] [LOCAL ] BUR: Derivative data saved (138 records). [2025-10-28T22:09:08.950545] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-28T22:09:08.952988] [INFO ] [MAIN ] Derivative Progress: 292/2046 symbols completed. BUR took 1.2s. Estimated remaining: 11m 52s. Rate: 147.8 symbols/min [2025-10-28T22:09:08.937603] [DEBUG] [LOCAL ] BUXX: Derivative data saved (138 records). [2025-10-28T22:09:08.953455] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-28T22:09:08.953233] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:08.956333] [INFO ] [MAIN ] Derivative Progress: 293/2046 symbols completed. BUXX took 1.2s. Estimated remaining: 11m 49s. Rate: 148.3 symbols/min [2025-10-28T22:09:08.958436] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:08.961532] [INFO ] [MAIN ] BURL: Generated 138 derivative records from 45055 primary records. [2025-10-28T22:09:08.961734] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-28T22:09:08.976404] [DEBUG] [LOCAL ] BURL: Derivative data saved (138 records). [2025-10-28T22:09:08.976639] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-28T22:09:08.979854] [INFO ] [MAIN ] Derivative Progress: 294/2046 symbols completed. BURL took 1.2s. Estimated remaining: 11m 47s. Rate: 148.8 symbols/min [2025-10-28T22:09:08.980340] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:09.022006] [DEBUG] [LOCAL ] BV: Loaded 38278 existing records from primary storage. [2025-10-28T22:09:09.022433] [INFO ] [MAIN ] BV: Loaded 38278 primary data records. [2025-10-28T22:09:09.190938] [DEBUG] [LOCAL ] BVN: Loaded 44573 existing records from primary storage. [2025-10-28T22:09:09.190128] [DEBUG] [LOCAL ] BW: Loaded 40394 existing records from primary storage. [2025-10-28T22:09:09.215718] [INFO ] [MAIN ] BVN: Loaded 44573 primary data records. [2025-10-28T22:09:09.215423] [INFO ] [MAIN ] BW: Loaded 40394 primary data records. [2025-10-28T22:09:10.344615] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:10.388438] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:10.415461] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:10.469801] [INFO ] [MAIN ] BV: Generated 138 derivative records from 38278 primary records. [2025-10-28T22:09:10.474799] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-28T22:09:10.498620] [DEBUG] [LOCAL ] BV: Derivative data saved (138 records). [2025-10-28T22:09:10.500980] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-28T22:09:10.500811] [INFO ] [MAIN ] BW: Generated 138 derivative records from 40394 primary records. [2025-10-28T22:09:10.505689] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-28T22:09:10.505604] [INFO ] [MAIN ] Derivative Progress: 295/2046 symbols completed. BV took 1.6s. Estimated remaining: 11m 53s. Rate: 147.4 symbols/min [2025-10-28T22:09:10.507199] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:10.521491] [INFO ] [MAIN ] BVN: Generated 138 derivative records from 44573 primary records. [2025-10-28T22:09:10.523231] [DEBUG] [LOCAL ] BW: Derivative data saved (138 records). [2025-10-28T22:09:10.523420] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-28T22:09:10.524247] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-28T22:09:10.526901] [INFO ] [MAIN ] Derivative Progress: 296/2046 symbols completed. BW took 1.5s. Estimated remaining: 11m 50s. Rate: 147.9 symbols/min [2025-10-28T22:09:10.527186] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:10.540461] [DEBUG] [LOCAL ] BVN: Derivative data saved (138 records). [2025-10-28T22:09:10.540686] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-28T22:09:10.543009] [INFO ] [MAIN ] Derivative Progress: 297/2046 symbols completed. BVN took 1.6s. Estimated remaining: 11m 47s. Rate: 148.3 symbols/min [2025-10-28T22:09:10.543289] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:10.553572] [DEBUG] [LOCAL ] BWG: Loaded 12358 existing records from primary storage. [2025-10-28T22:09:10.553815] [INFO ] [MAIN ] BWG: Loaded 12358 primary data records. [2025-10-28T22:09:10.796115] [DEBUG] [LOCAL ] BWA: Loaded 52002 existing records from primary storage. [2025-10-28T22:09:10.794832] [DEBUG] [LOCAL ] BWLP: Loaded 31688 existing records from primary storage. [2025-10-28T22:09:10.901347] [INFO ] [MAIN ] BWLP: Loaded 31688 primary data records. [2025-10-28T22:09:10.914423] [INFO ] [MAIN ] BWA: Loaded 52002 primary data records. [2025-10-28T22:09:11.596124] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:11.661633] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:11.663244] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:11.699603] [INFO ] [MAIN ] BWG: Generated 138 derivative records from 12358 primary records. [2025-10-28T22:09:11.702165] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-28T22:09:11.718266] [DEBUG] [LOCAL ] BWG: Derivative data saved (138 records). [2025-10-28T22:09:11.718367] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-28T22:09:11.720772] [INFO ] [MAIN ] Derivative Progress: 298/2046 symbols completed. BWG took 1.2s. Estimated remaining: 11m 52s. Rate: 147.4 symbols/min [2025-10-28T22:09:11.747801] [INFO ] [MAIN ] BWA: Generated 138 derivative records from 52002 primary records. [2025-10-28T22:09:11.749796] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-28T22:09:11.749705] [INFO ] [MAIN ] BWLP: Generated 138 derivative records from 31688 primary records. [2025-10-28T22:09:11.750490] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-28T22:09:11.774601] [DEBUG] [LOCAL ] BWA: Derivative data saved (138 records). [2025-10-28T22:09:11.775830] [DEBUG] [LOCAL ] BWLP: Derivative data saved (138 records). [2025-10-28T22:09:11.775918] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-28T22:09:11.778306] [INFO ] [MAIN ] Derivative Progress: 299/2046 symbols completed. BWA took 1.3s. Estimated remaining: 11m 49s. Rate: 147.8 symbols/min [2025-10-28T22:09:11.778410] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-28T22:09:11.780803] [INFO ] [MAIN ] Derivative Progress: 300/2046 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 46s. Rate: 148.3 symbols/min [2025-10-28T22:09:11.781180] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:11.781285] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:11.781797] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:11.789990] [DEBUG] [LOCAL ] BWNB: Loaded 4035 existing records from primary storage. [2025-10-28T22:09:11.793995] [INFO ] [MAIN ] BWNB: Loaded 4035 primary data records. [2025-10-28T22:09:11.794210] [DEBUG] [LOCAL ] BWMX: Loaded 8027 existing records from primary storage. [2025-10-28T22:09:11.830464] [INFO ] [MAIN ] BWMX: Loaded 8027 primary data records. [2025-10-28T22:09:12.227573] [DEBUG] [LOCAL ] BWXT: Loaded 47089 existing records from primary storage. [2025-10-28T22:09:12.402917] [INFO ] [MAIN ] BWXT: Loaded 47089 primary data records. [2025-10-28T22:09:12.761835] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:12.762407] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:12.830393] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:12.874064] [INFO ] [MAIN ] BWMX: Generated 138 derivative records from 8027 primary records. [2025-10-28T22:09:12.870086] [INFO ] [MAIN ] BWNB: Generated 138 derivative records from 4035 primary records. [2025-10-28T22:09:12.875069] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-28T22:09:12.875315] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-28T22:09:12.900283] [DEBUG] [LOCAL ] BWNB: Derivative data saved (138 records). [2025-10-28T22:09:12.901607] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-28T22:09:12.901433] [DEBUG] [LOCAL ] BWMX: Derivative data saved (138 records). [2025-10-28T22:09:12.903560] [INFO ] [MAIN ] Derivative Progress: 301/2046 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 50s. Rate: 147.4 symbols/min [2025-10-28T22:09:12.903697] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-28T22:09:12.907676] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:12.907924] [INFO ] [MAIN ] Derivative Progress: 302/2046 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 47s. Rate: 147.9 symbols/min [2025-10-28T22:09:12.908793] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:12.915665] [INFO ] [MAIN ] BWXT: Generated 138 derivative records from 47089 primary records. [2025-10-28T22:09:12.915860] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-28T22:09:12.932317] [DEBUG] [LOCAL ] BWXT: Derivative data saved (138 records). [2025-10-28T22:09:12.937450] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-28T22:09:12.940037] [INFO ] [MAIN ] Derivative Progress: 303/2046 symbols completed. BWXT took 1.2s. Estimated remaining: 11m 45s. Rate: 148.4 symbols/min [2025-10-28T22:09:12.940277] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:12.937366] [DEBUG] [LOCAL ] BXC: Loaded 13065 existing records from primary storage. [2025-10-28T22:09:12.941011] [INFO ] [MAIN ] BXC: Loaded 13065 primary data records. [2025-10-28T22:09:13.121499] [DEBUG] [LOCAL ] BXMX: Loaded 18686 existing records from primary storage. [2025-10-28T22:09:13.156419] [INFO ] [MAIN ] BXMX: Loaded 18686 primary data records. [2025-10-28T22:09:13.174258] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-28T22:09:13.310935] [INFO ] [MAIN ] BX: Loaded 53483 primary data records. [2025-10-28T22:09:13.978340] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:14.024521] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:14.050000] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:14.080520] [INFO ] [MAIN ] BXC: Generated 138 derivative records from 13065 primary records. [2025-10-28T22:09:14.083929] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-28T22:09:14.102656] [DEBUG] [LOCAL ] BXC: Derivative data saved (138 records). [2025-10-28T22:09:14.102857] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-28T22:09:14.106624] [INFO ] [MAIN ] Derivative Progress: 304/2046 symbols completed. BXC took 1.2s. Estimated remaining: 11m 49s. Rate: 147.5 symbols/min [2025-10-28T22:09:14.110111] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:14.118464] [INFO ] [MAIN ] BX: Generated 138 derivative records from 53483 primary records. [2025-10-28T22:09:14.118611] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-28T22:09:14.134972] [DEBUG] [LOCAL ] BX: Derivative data saved (138 records). [2025-10-28T22:09:14.137008] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-28T22:09:14.136914] [INFO ] [MAIN ] BXMX: Generated 138 derivative records from 18686 primary records. [2025-10-28T22:09:14.140099] [INFO ] [MAIN ] Derivative Progress: 305/2046 symbols completed. BX took 1.2s. Estimated remaining: 11m 46s. Rate: 147.9 symbols/min [2025-10-28T22:09:14.140344] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-28T22:09:14.140267] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:14.153450] [DEBUG] [LOCAL ] BXMX: Derivative data saved (138 records). [2025-10-28T22:09:14.153760] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-28T22:09:14.156452] [INFO ] [MAIN ] Derivative Progress: 306/2046 symbols completed. BXMX took 1.2s. Estimated remaining: 11m 44s. Rate: 148.4 symbols/min [2025-10-28T22:09:14.156774] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:14.182951] [DEBUG] [LOCAL ] BY: Loaded 21442 existing records from primary storage. [2025-10-28T22:09:14.183718] [INFO ] [MAIN ] BY: Loaded 21442 primary data records. [2025-10-28T22:09:14.288061] [DEBUG] [LOCAL ] BXP: Loaded 49707 existing records from primary storage. [2025-10-28T22:09:14.312667] [INFO ] [MAIN ] BXP: Loaded 49707 primary data records. [2025-10-28T22:09:14.596030] [DEBUG] [LOCAL ] BYD: Loaded 44940 existing records from primary storage. [2025-10-28T22:09:14.613296] [INFO ] [MAIN ] BYD: Loaded 44940 primary data records. [2025-10-28T22:09:15.138118] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:15.169049] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:15.205136] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:15.261329] [INFO ] [MAIN ] BY: Generated 138 derivative records from 21442 primary records. [2025-10-28T22:09:15.263858] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-28T22:09:15.279885] [DEBUG] [LOCAL ] BY: Derivative data saved (138 records). [2025-10-28T22:09:15.282184] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-28T22:09:15.284667] [INFO ] [MAIN ] Derivative Progress: 307/2046 symbols completed. BY took 1.1s. Estimated remaining: 11m 47s. Rate: 147.5 symbols/min [2025-10-28T22:09:15.282121] [INFO ] [MAIN ] BXP: Generated 138 derivative records from 49707 primary records. [2025-10-28T22:09:15.286168] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-28T22:09:15.286904] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:15.299034] [INFO ] [MAIN ] BYD: Generated 138 derivative records from 44940 primary records. [2025-10-28T22:09:15.299209] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-28T22:09:15.305228] [DEBUG] [LOCAL ] BXP: Derivative data saved (138 records). [2025-10-28T22:09:15.312318] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-28T22:09:15.314449] [INFO ] [MAIN ] Derivative Progress: 308/2046 symbols completed. BXP took 1.2s. Estimated remaining: 11m 45s. Rate: 148.0 symbols/min [2025-10-28T22:09:15.318688] [DEBUG] [LOCAL ] BYD: Derivative data saved (138 records). [2025-10-28T22:09:15.318807] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:15.323216] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-28T22:09:15.325769] [INFO ] [MAIN ] Derivative Progress: 309/2046 symbols completed. BYD took 1.2s. Estimated remaining: 11m 42s. Rate: 148.4 symbols/min [2025-10-28T22:09:15.326126] [DEBUG] [LOCAL ] BYM: Loaded 11239 existing records from primary storage. [2025-10-28T22:09:15.326427] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:15.326536] [INFO ] [MAIN ] BYM: Loaded 11239 primary data records. [2025-10-28T22:09:15.686677] [DEBUG] [LOCAL ] BZH: Loaded 31574 existing records from primary storage. [2025-10-28T22:09:15.687625] [INFO ] [MAIN ] BZH: Loaded 31574 primary data records. [2025-10-28T22:09:15.846291] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-28T22:09:15.866422] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-10-28T22:09:16.381964] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:16.428328] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:16.468702] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:16.489234] [INFO ] [MAIN ] BYM: Generated 138 derivative records from 11239 primary records. [2025-10-28T22:09:16.490213] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-28T22:09:16.510154] [DEBUG] [LOCAL ] BYM: Derivative data saved (138 records). [2025-10-28T22:09:16.510579] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-28T22:09:16.515360] [INFO ] [MAIN ] Derivative Progress: 310/2046 symbols completed. BYM took 1.2s. Estimated remaining: 11m 46s. Rate: 147.5 symbols/min [2025-10-28T22:09:16.518573] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:16.537931] [INFO ] [MAIN ] BZH: Generated 138 derivative records from 31574 primary records. [2025-10-28T22:09:16.538261] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-28T22:09:16.558601] [DEBUG] [LOCAL ] BZH: Derivative data saved (138 records). [2025-10-28T22:09:16.559087] [DEBUG] [LOCAL ] CAAP: Loaded 19752 existing records from primary storage. [2025-10-28T22:09:16.559511] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-28T22:09:16.561742] [INFO ] [MAIN ] Derivative Progress: 311/2046 symbols completed. BZH took 1.2s. Estimated remaining: 11m 44s. Rate: 147.9 symbols/min [2025-10-28T22:09:16.559723] [INFO ] [MAIN ] CAAP: Loaded 19752 primary data records. [2025-10-28T22:09:16.564839] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:16.647247] [INFO ] [MAIN ] C: Generated 138 derivative records from 53741 primary records. [2025-10-28T22:09:16.670416] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-28T22:09:16.679356] [DEBUG] [LOCAL ] CABO: Loaded 16475 existing records from primary storage. [2025-10-28T22:09:16.684987] [INFO ] [MAIN ] CABO: Loaded 16475 primary data records. [2025-10-28T22:09:16.939681] [DEBUG] [LOCAL ] C: Derivative data saved (138 records). [2025-10-28T22:09:16.988542] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-28T22:09:17.010601] [INFO ] [MAIN ] Derivative Progress: 312/2046 symbols completed. C took 1.7s. Estimated remaining: 11m 44s. Rate: 147.9 symbols/min [2025-10-28T22:09:17.014591] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:17.239261] [DEBUG] [LOCAL ] CACI: Loaded 21921 existing records from primary storage. [2025-10-28T22:09:17.239794] [INFO ] [MAIN ] CACI: Loaded 21921 primary data records. [2025-10-28T22:09:17.441717] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:17.606268] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:17.642920] [INFO ] [MAIN ] CAAP: Generated 138 derivative records from 19752 primary records. [2025-10-28T22:09:17.644570] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-28T22:09:17.673404] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:09:17.673118] [DEBUG] [LOCAL ] CAAP: Derivative data saved (138 records). [2025-10-28T22:09:17.691911] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-28T22:09:17.694582] [INFO ] [MAIN ] Derivative Progress: 313/2046 symbols completed. CAAP took 1.2s. Estimated remaining: 11m 45s. Rate: 147.6 symbols/min [2025-10-28T22:09:17.710800] [INFO ] [MAIN ] CABO: Generated 138 derivative records from 16475 primary records. [2025-10-28T22:09:17.712981] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-28T22:09:17.729525] [DEBUG] [LOCAL ] CABO: Derivative data saved (138 records). [2025-10-28T22:09:17.730831] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-28T22:09:17.733308] [INFO ] [MAIN ] Derivative Progress: 314/2046 symbols completed. CABO took 1.2s. Estimated remaining: 11m 42s. Rate: 148.0 symbols/min [2025-10-28T22:09:17.735228] [INFO ] [MAIN ] CACI: Generated 138 derivative records from 21921 primary records. [2025-10-28T22:09:17.735298] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-28T22:09:17.746972] [DEBUG] [LOCAL ] CACI: Derivative data saved (138 records). [2025-10-28T22:09:17.747035] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-28T22:09:17.749534] [INFO ] [MAIN ] Derivative Progress: 315/2046 symbols completed. CACI took 0.7s. Estimated remaining: 11m 40s. Rate: 148.4 symbols/min [2025-10-28T22:09:17.749967] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:17.750435] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:17.750250] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:17.756954] [DEBUG] [LOCAL ] CAF: Loaded 3372 existing records from primary storage. [2025-10-28T22:09:17.757317] [INFO ] [MAIN ] CAF: Loaded 3372 primary data records. [2025-10-28T22:09:18.120793] [DEBUG] [LOCAL ] CAE: Loaded 38660 existing records from primary storage. [2025-10-28T22:09:18.135037] [INFO ] [MAIN ] CAE: Loaded 38660 primary data records. [2025-10-28T22:09:18.147771] [DEBUG] [LOCAL ] CADE: Loaded 49726 existing records from primary storage. [2025-10-28T22:09:18.168704] [INFO ] [MAIN ] CADE: Loaded 49726 primary data records. [2025-10-28T22:09:18.796111] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:18.845089] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:18.888821] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:18.889355] [INFO ] [MAIN ] CAF: Generated 138 derivative records from 3372 primary records. [2025-10-28T22:09:18.904996] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-28T22:09:18.925630] [DEBUG] [LOCAL ] CAF: Derivative data saved (138 records). [2025-10-28T22:09:18.926160] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-28T22:09:18.928890] [INFO ] [MAIN ] Derivative Progress: 316/2046 symbols completed. CAF took 1.2s. Estimated remaining: 11m 44s. Rate: 147.5 symbols/min [2025-10-28T22:09:18.930736] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:18.950021] [INFO ] [MAIN ] CAE: Generated 138 derivative records from 38660 primary records. [2025-10-28T22:09:18.953584] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-28T22:09:18.968601] [DEBUG] [LOCAL ] CAE: Derivative data saved (138 records). [2025-10-28T22:09:18.970741] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-28T22:09:18.970637] [INFO ] [MAIN ] CADE: Generated 138 derivative records from 49726 primary records. [2025-10-28T22:09:18.972861] [INFO ] [MAIN ] Derivative Progress: 317/2046 symbols completed. CAE took 1.2s. Estimated remaining: 11m 41s. Rate: 148.0 symbols/min [2025-10-28T22:09:18.973276] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-28T22:09:18.973422] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:18.999787] [DEBUG] [LOCAL ] CADE: Derivative data saved (138 records). [2025-10-28T22:09:18.999943] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-28T22:09:19.002550] [INFO ] [MAIN ] Derivative Progress: 318/2046 symbols completed. CADE took 1.3s. Estimated remaining: 11m 39s. Rate: 148.4 symbols/min [2025-10-28T22:09:19.002825] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:19.022914] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-28T22:09:19.023159] [INFO ] [MAIN ] CAG: Loaded 53666 primary data records. [2025-10-28T22:09:19.406390] [DEBUG] [LOCAL ] CAH: Loaded 51348 existing records from primary storage. [2025-10-28T22:09:19.408071] [INFO ] [MAIN ] CAH: Loaded 51348 primary data records. [2025-10-28T22:09:19.407311] [DEBUG] [LOCAL ] CAL: Loaded 42431 existing records from primary storage. [2025-10-28T22:09:19.408388] [INFO ] [MAIN ] CAL: Loaded 42431 primary data records. [2025-10-28T22:09:20.065632] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:20.127335] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:20.127868] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:20.178067] [INFO ] [MAIN ] CAG: Generated 138 derivative records from 53666 primary records. [2025-10-28T22:09:20.181260] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-28T22:09:20.196937] [DEBUG] [LOCAL ] CAG: Derivative data saved (138 records). [2025-10-28T22:09:20.199826] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-28T22:09:20.204886] [INFO ] [MAIN ] Derivative Progress: 319/2046 symbols completed. CAG took 1.3s. Estimated remaining: 11m 43s. Rate: 147.5 symbols/min [2025-10-28T22:09:20.205780] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:20.221759] [INFO ] [MAIN ] CAL: Generated 138 derivative records from 42431 primary records. [2025-10-28T22:09:20.219975] [INFO ] [MAIN ] CAH: Generated 138 derivative records from 51348 primary records. [2025-10-28T22:09:20.222343] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-28T22:09:20.222412] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-28T22:09:20.247356] [DEBUG] [LOCAL ] CAL: Derivative data saved (138 records). [2025-10-28T22:09:20.256468] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-28T22:09:20.247043] [DEBUG] [LOCAL ] CAH: Derivative data saved (138 records). [2025-10-28T22:09:20.258618] [INFO ] [MAIN ] Derivative Progress: 320/2046 symbols completed. CAL took 1.3s. Estimated remaining: 11m 40s. Rate: 147.9 symbols/min [2025-10-28T22:09:20.258976] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:20.259109] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-28T22:09:20.262760] [INFO ] [MAIN ] Derivative Progress: 321/2046 symbols completed. CAH took 1.3s. Estimated remaining: 11m 38s. Rate: 148.3 symbols/min [2025-10-28T22:09:20.263262] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:20.278592] [DEBUG] [LOCAL ] CALX: Loaded 36838 existing records from primary storage. [2025-10-28T22:09:20.278800] [INFO ] [MAIN ] CALX: Loaded 36838 primary data records. [2025-10-28T22:09:20.326257] [DEBUG] [LOCAL ] CAPL: Loaded 5245 existing records from primary storage. [2025-10-28T22:09:20.366419] [INFO ] [MAIN ] CAPL: Loaded 5245 primary data records. [2025-10-28T22:09:20.440118] [DEBUG] [LOCAL ] CANG: Loaded 27056 existing records from primary storage. [2025-10-28T22:09:20.495393] [INFO ] [MAIN ] CANG: Loaded 27056 primary data records. [2025-10-28T22:09:21.214880] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:21.242892] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:21.278011] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:21.337773] [INFO ] [MAIN ] CAPL: Generated 138 derivative records from 5245 primary records. [2025-10-28T22:09:21.341964] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-28T22:09:21.355225] [INFO ] [MAIN ] CALX: Generated 138 derivative records from 36838 primary records. [2025-10-28T22:09:21.355484] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-28T22:09:21.358131] [DEBUG] [LOCAL ] CAPL: Derivative data saved (138 records). [2025-10-28T22:09:21.358898] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-28T22:09:21.361321] [INFO ] [MAIN ] Derivative Progress: 322/2046 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 41s. Rate: 147.5 symbols/min [2025-10-28T22:09:21.368725] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:21.377137] [DEBUG] [LOCAL ] CALX: Derivative data saved (138 records). [2025-10-28T22:09:21.377367] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-28T22:09:21.380293] [INFO ] [MAIN ] Derivative Progress: 323/2046 symbols completed. CALX took 1.2s. Estimated remaining: 11m 39s. Rate: 148.0 symbols/min [2025-10-28T22:09:21.382058] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:21.385361] [INFO ] [MAIN ] CANG: Generated 138 derivative records from 27056 primary records. [2025-10-28T22:09:21.385599] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-28T22:09:21.398551] [DEBUG] [LOCAL ] CANG: Derivative data saved (138 records). [2025-10-28T22:09:21.398771] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-28T22:09:21.401128] [INFO ] [MAIN ] Derivative Progress: 324/2046 symbols completed. CANG took 1.1s. Estimated remaining: 11m 36s. Rate: 148.4 symbols/min [2025-10-28T22:09:21.401306] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:21.443758] [DEBUG] [LOCAL ] CARS: Loaded 39539 existing records from primary storage. [2025-10-28T22:09:21.443920] [INFO ] [MAIN ] CARS: Loaded 39539 primary data records. [2025-10-28T22:09:21.596252] [DEBUG] [LOCAL ] CARR: Loaded 53601 existing records from primary storage. [2025-10-28T22:09:21.619667] [INFO ] [MAIN ] CARR: Loaded 53601 primary data records. [2025-10-28T22:09:21.900624] [DEBUG] [LOCAL ] CAT: Loaded 52900 existing records from primary storage. [2025-10-28T22:09:21.911671] [INFO ] [MAIN ] CAT: Loaded 52900 primary data records. [2025-10-28T22:09:22.471172] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:22.506372] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:22.559334] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:22.586402] [INFO ] [MAIN ] CARS: Generated 138 derivative records from 39539 primary records. [2025-10-28T22:09:22.588698] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-28T22:09:22.607135] [DEBUG] [LOCAL ] CARS: Derivative data saved (138 records). [2025-10-28T22:09:22.609451] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-28T22:09:22.612102] [INFO ] [MAIN ] Derivative Progress: 325/2046 symbols completed. CARS took 1.2s. Estimated remaining: 11m 40s. Rate: 147.5 symbols/min [2025-10-28T22:09:22.612522] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:22.614983] [INFO ] [MAIN ] CARR: Generated 138 derivative records from 53601 primary records. [2025-10-28T22:09:22.617804] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-28T22:09:22.631545] [DEBUG] [LOCAL ] CARR: Derivative data saved (138 records). [2025-10-28T22:09:22.633922] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-28T22:09:22.638710] [INFO ] [MAIN ] Derivative Progress: 326/2046 symbols completed. CARR took 1.3s. Estimated remaining: 11m 38s. Rate: 147.9 symbols/min [2025-10-28T22:09:22.638930] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:22.645395] [DEBUG] [LOCAL ] CATO: Loaded 6662 existing records from primary storage. [2025-10-28T22:09:22.645616] [INFO ] [MAIN ] CATO: Loaded 6662 primary data records. [2025-10-28T22:09:22.743417] [INFO ] [MAIN ] CAT: Generated 138 derivative records from 52900 primary records. [2025-10-28T22:09:22.754121] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-28T22:09:22.788440] [DEBUG] [LOCAL ] CAT: Derivative data saved (138 records). [2025-10-28T22:09:22.823758] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-28T22:09:22.842026] [INFO ] [MAIN ] Derivative Progress: 327/2046 symbols completed. CAT took 1.4s. Estimated remaining: 11m 36s. Rate: 148.2 symbols/min [2025-10-28T22:09:22.973948] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:22.998702] [DEBUG] [LOCAL ] CAVA: Loaded 53531 existing records from primary storage. [2025-10-28T22:09:22.999169] [INFO ] [MAIN ] CAVA: Loaded 53531 primary data records. [2025-10-28T22:09:23.154907] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:23.385185] [DEBUG] [LOCAL ] CB: Loaded 49912 existing records from primary storage. [2025-10-28T22:09:23.387266] [INFO ] [MAIN ] CB: Loaded 49912 primary data records. [2025-10-28T22:09:23.708782] [INFO ] [MAIN ] CATO: Generated 138 derivative records from 6662 primary records. [2025-10-28T22:09:23.709123] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-28T22:09:23.728630] [DEBUG] [LOCAL ] CATO: Derivative data saved (138 records). [2025-10-28T22:09:23.734485] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-28T22:09:23.734780] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:23.737130] [INFO ] [MAIN ] Derivative Progress: 328/2046 symbols completed. CATO took 1.1s. Estimated remaining: 11m 38s. Rate: 147.6 symbols/min [2025-10-28T22:09:23.775667] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:23.802767] [INFO ] [MAIN ] CAVA: Generated 138 derivative records from 53531 primary records. [2025-10-28T22:09:23.804974] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-28T22:09:23.822674] [DEBUG] [LOCAL ] CAVA: Derivative data saved (138 records). [2025-10-28T22:09:23.822857] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-28T22:09:23.825472] [INFO ] [MAIN ] Derivative Progress: 329/2046 symbols completed. CAVA took 1.2s. Estimated remaining: 11m 36s. Rate: 148.0 symbols/min [2025-10-28T22:09:23.830262] [INFO ] [MAIN ] CB: Generated 138 derivative records from 49912 primary records. [2025-10-28T22:09:23.830330] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-28T22:09:23.842087] [DEBUG] [LOCAL ] CB: Derivative data saved (138 records). [2025-10-28T22:09:23.842153] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-28T22:09:23.844509] [INFO ] [MAIN ] Derivative Progress: 330/2046 symbols completed. CB took 0.9s. Estimated remaining: 11m 34s. Rate: 148.4 symbols/min [2025-10-28T22:09:23.845057] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:23.845185] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:23.845449] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:23.853069] [DEBUG] [LOCAL ] CBNA: Loaded 2806 existing records from primary storage. [2025-10-28T22:09:23.853300] [INFO ] [MAIN ] CBNA: Loaded 2806 primary data records. [2025-10-28T22:09:23.941249] [DEBUG] [LOCAL ] CBL: Loaded 15582 existing records from primary storage. [2025-10-28T22:09:23.941485] [DEBUG] [LOCAL ] CBAN: Loaded 10006 existing records from primary storage. [2025-10-28T22:09:23.952032] [INFO ] [MAIN ] CBL: Loaded 15582 primary data records. [2025-10-28T22:09:23.951930] [INFO ] [MAIN ] CBAN: Loaded 10006 primary data records. [2025-10-28T22:09:24.799888] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:24.830239] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:24.862302] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:24.916949] [INFO ] [MAIN ] CBNA: Generated 138 derivative records from 2806 primary records. [2025-10-28T22:09:24.917486] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-28T22:09:24.919771] [INFO ] [MAIN ] CBAN: Generated 138 derivative records from 10006 primary records. [2025-10-28T22:09:24.920796] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-28T22:09:24.930522] [DEBUG] [LOCAL ] CBNA: Derivative data saved (138 records). [2025-10-28T22:09:24.937506] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-28T22:09:24.945783] [INFO ] [MAIN ] Derivative Progress: 331/2046 symbols completed. CBNA took 1.1s. Estimated remaining: 11m 37s. Rate: 147.6 symbols/min [2025-10-28T22:09:24.945966] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:24.943572] [DEBUG] [LOCAL ] CBAN: Derivative data saved (138 records). [2025-10-28T22:09:24.946456] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-28T22:09:24.950730] [INFO ] [MAIN ] Derivative Progress: 332/2046 symbols completed. CBAN took 1.1s. Estimated remaining: 11m 35s. Rate: 148.1 symbols/min [2025-10-28T22:09:24.950922] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:24.953222] [INFO ] [MAIN ] CBL: Generated 138 derivative records from 15582 primary records. [2025-10-28T22:09:24.953513] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-28T22:09:24.965897] [DEBUG] [LOCAL ] CBL: Derivative data saved (138 records). [2025-10-28T22:09:24.966074] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-28T22:09:24.968993] [INFO ] [MAIN ] Derivative Progress: 333/2046 symbols completed. CBL took 1.1s. Estimated remaining: 11m 32s. Rate: 148.5 symbols/min [2025-10-28T22:09:24.969295] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:25.014188] [DEBUG] [LOCAL ] CBU: Loaded 22252 existing records from primary storage. [2025-10-28T22:09:25.014970] [DEBUG] [LOCAL ] CBT: Loaded 30466 existing records from primary storage. [2025-10-28T22:09:25.015127] [INFO ] [MAIN ] CBT: Loaded 30466 primary data records. [2025-10-28T22:09:25.015218] [INFO ] [MAIN ] CBU: Loaded 22252 primary data records. [2025-10-28T22:09:25.220069] [DEBUG] [LOCAL ] CBRE: Loaded 50235 existing records from primary storage. [2025-10-28T22:09:25.231070] [INFO ] [MAIN ] CBRE: Loaded 50235 primary data records. [2025-10-28T22:09:26.001476] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:26.026160] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:26.069017] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:26.126130] [INFO ] [MAIN ] CBU: Generated 138 derivative records from 22252 primary records. [2025-10-28T22:09:26.126361] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-28T22:09:26.140349] [INFO ] [MAIN ] CBT: Generated 138 derivative records from 30466 primary records. [2025-10-28T22:09:26.141765] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-28T22:09:26.143856] [DEBUG] [LOCAL ] CBU: Derivative data saved (138 records). [2025-10-28T22:09:26.144109] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-28T22:09:26.153738] [INFO ] [MAIN ] Derivative Progress: 334/2046 symbols completed. CBU took 1.2s. Estimated remaining: 11m 36s. Rate: 147.6 symbols/min [2025-10-28T22:09:26.157040] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:26.161524] [DEBUG] [LOCAL ] CBT: Derivative data saved (138 records). [2025-10-28T22:09:26.161979] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-28T22:09:26.164146] [INFO ] [MAIN ] Derivative Progress: 335/2046 symbols completed. CBT took 1.2s. Estimated remaining: 11m 33s. Rate: 148.1 symbols/min [2025-10-28T22:09:26.165919] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:26.169212] [INFO ] [MAIN ] CBRE: Generated 138 derivative records from 50235 primary records. [2025-10-28T22:09:26.169411] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-28T22:09:26.182315] [DEBUG] [LOCAL ] CBRE: Derivative data saved (138 records). [2025-10-28T22:09:26.182549] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-28T22:09:26.185523] [INFO ] [MAIN ] Derivative Progress: 336/2046 symbols completed. CBRE took 1.2s. Estimated remaining: 11m 31s. Rate: 148.5 symbols/min [2025-10-28T22:09:26.185929] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:26.228401] [DEBUG] [LOCAL ] CBZ: Loaded 34214 existing records from primary storage. [2025-10-28T22:09:26.228563] [INFO ] [MAIN ] CBZ: Loaded 34214 primary data records. [2025-10-28T22:09:26.372588] [DEBUG] [LOCAL ] CC: Loaded 52964 existing records from primary storage. [2025-10-28T22:09:26.372814] [INFO ] [MAIN ] CC: Loaded 52964 primary data records. [2025-10-28T22:09:26.656093] [DEBUG] [LOCAL ] CCI: Loaded 53098 existing records from primary storage. [2025-10-28T22:09:26.686681] [INFO ] [MAIN ] CCI: Loaded 53098 primary data records. [2025-10-28T22:09:27.240895] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:27.267727] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:27.315469] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:27.380859] [INFO ] [MAIN ] CBZ: Generated 138 derivative records from 34214 primary records. [2025-10-28T22:09:27.382911] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-28T22:09:27.402134] [DEBUG] [LOCAL ] CBZ: Derivative data saved (138 records). [2025-10-28T22:09:27.402830] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-28T22:09:27.407071] [INFO ] [MAIN ] Derivative Progress: 337/2046 symbols completed. CBZ took 1.3s. Estimated remaining: 11m 35s. Rate: 147.6 symbols/min [2025-10-28T22:09:27.408070] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:27.412794] [INFO ] [MAIN ] CCI: Generated 138 derivative records from 53098 primary records. [2025-10-28T22:09:27.413397] [INFO ] [MAIN ] CC: Generated 138 derivative records from 52964 primary records. [2025-10-28T22:09:27.413694] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-28T22:09:27.413803] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-28T22:09:27.438576] [DEBUG] [LOCAL ] CCI: Derivative data saved (138 records). [2025-10-28T22:09:27.438816] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-28T22:09:27.439173] [DEBUG] [LOCAL ] CC: Derivative data saved (138 records). [2025-10-28T22:09:27.447410] [INFO ] [MAIN ] Derivative Progress: 338/2046 symbols completed. CCI took 1.3s. Estimated remaining: 11m 32s. Rate: 148.0 symbols/min [2025-10-28T22:09:27.447626] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:27.448205] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-28T22:09:27.450861] [INFO ] [MAIN ] Derivative Progress: 339/2046 symbols completed. CC took 1.3s. Estimated remaining: 11m 30s. Rate: 148.4 symbols/min [2025-10-28T22:09:27.451120] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:27.457674] [DEBUG] [LOCAL ] CCIF: Loaded 15075 existing records from primary storage. [2025-10-28T22:09:27.458163] [INFO ] [MAIN ] CCIF: Loaded 15075 primary data records. [2025-10-28T22:09:27.789020] [DEBUG] [LOCAL ] CCK: Loaded 46444 existing records from primary storage. [2025-10-28T22:09:27.789987] [INFO ] [MAIN ] CCK: Loaded 46444 primary data records. [2025-10-28T22:09:27.907740] [DEBUG] [LOCAL ] CCJ: Loaded 53691 existing records from primary storage. [2025-10-28T22:09:27.908077] [INFO ] [MAIN ] CCJ: Loaded 53691 primary data records. [2025-10-28T22:09:28.470167] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:28.523787] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:28.555335] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:28.558525] [INFO ] [MAIN ] CCIF: Generated 138 derivative records from 15075 primary records. [2025-10-28T22:09:28.558637] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-28T22:09:28.585027] [DEBUG] [LOCAL ] CCIF: Derivative data saved (138 records). [2025-10-28T22:09:28.585449] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-28T22:09:28.590788] [INFO ] [MAIN ] Derivative Progress: 340/2046 symbols completed. CCIF took 1.2s. Estimated remaining: 11m 33s. Rate: 147.6 symbols/min [2025-10-28T22:09:28.591049] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:28.628460] [INFO ] [MAIN ] CCK: Generated 138 derivative records from 46444 primary records. [2025-10-28T22:09:28.642064] [INFO ] [MAIN ] CCJ: Generated 138 derivative records from 53691 primary records. [2025-10-28T22:09:28.642465] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-28T22:09:28.642395] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-28T22:09:28.664765] [DEBUG] [LOCAL ] CCJ: Derivative data saved (138 records). [2025-10-28T22:09:28.666888] [DEBUG] [LOCAL ] CCK: Derivative data saved (138 records). [2025-10-28T22:09:28.667083] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-28T22:09:28.669236] [INFO ] [MAIN ] Derivative Progress: 341/2046 symbols completed. CCK took 1.2s. Estimated remaining: 11m 31s. Rate: 148.0 symbols/min [2025-10-28T22:09:28.666960] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-28T22:09:28.672923] [INFO ] [MAIN ] Derivative Progress: 342/2046 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 29s. Rate: 148.4 symbols/min [2025-10-28T22:09:28.672800] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:28.673154] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:28.689671] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-28T22:09:28.689997] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-28T22:09:28.796591] [DEBUG] [LOCAL ] CCRD: Loaded 9635 existing records from primary storage. [2025-10-28T22:09:28.796837] [INFO ] [MAIN ] CCRD: Loaded 9635 primary data records. [2025-10-28T22:09:29.316557] [DEBUG] [LOCAL ] CCO: Loaded 48719 existing records from primary storage. [2025-10-28T22:09:29.316940] [INFO ] [MAIN ] CCO: Loaded 48719 primary data records. [2025-10-28T22:09:29.637819] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:29.675404] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:29.727563] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:29.749353] [INFO ] [MAIN ] CCL: Generated 138 derivative records from 53800 primary records. [2025-10-28T22:09:29.751075] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-28T22:09:29.767874] [DEBUG] [LOCAL ] CCL: Derivative data saved (138 records). [2025-10-28T22:09:29.768498] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-28T22:09:29.770773] [INFO ] [MAIN ] Derivative Progress: 343/2046 symbols completed. CCL took 1.2s. Estimated remaining: 11m 32s. Rate: 147.7 symbols/min [2025-10-28T22:09:29.780953] [INFO ] [MAIN ] CCRD: Generated 138 derivative records from 9635 primary records. [2025-10-28T22:09:29.783239] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-28T22:09:29.798576] [DEBUG] [LOCAL ] CCRD: Derivative data saved (138 records). [2025-10-28T22:09:29.801292] [INFO ] [MAIN ] CCO: Generated 138 derivative records from 48719 primary records. [2025-10-28T22:09:29.801372] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-28T22:09:29.803897] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-28T22:09:29.803836] [INFO ] [MAIN ] Derivative Progress: 344/2046 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 30s. Rate: 148.1 symbols/min [2025-10-28T22:09:29.815828] [DEBUG] [LOCAL ] CCO: Derivative data saved (138 records). [2025-10-28T22:09:29.815888] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-28T22:09:29.818222] [INFO ] [MAIN ] Derivative Progress: 345/2046 symbols completed. CCO took 1.1s. Estimated remaining: 11m 27s. Rate: 148.5 symbols/min [2025-10-28T22:09:29.818722] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:29.818588] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:29.818820] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:29.845835] [DEBUG] [LOCAL ] CCU: Loaded 20968 existing records from primary storage. [2025-10-28T22:09:29.846026] [INFO ] [MAIN ] CCU: Loaded 20968 primary data records. [2025-10-28T22:09:29.955761] [DEBUG] [LOCAL ] CCS: Loaded 29790 existing records from primary storage. [2025-10-28T22:09:29.974905] [INFO ] [MAIN ] CCS: Loaded 29790 primary data records. [2025-10-28T22:09:30.172385] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-28T22:09:30.178130] [INFO ] [MAIN ] CDE: Loaded 53644 primary data records. [2025-10-28T22:09:30.868149] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:30.910405] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:30.916032] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:31.016851] [INFO ] [MAIN ] CCU: Generated 138 derivative records from 20968 primary records. [2025-10-28T22:09:31.023967] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-28T22:09:31.026465] [INFO ] [MAIN ] CDE: Generated 138 derivative records from 53644 primary records. [2025-10-28T22:09:31.029340] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-28T22:09:31.051618] [DEBUG] [LOCAL ] CCU: Derivative data saved (138 records). [2025-10-28T22:09:31.054544] [DEBUG] [LOCAL ] CDE: Derivative data saved (138 records). [2025-10-28T22:09:31.052744] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-28T22:09:31.055252] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-28T22:09:31.057310] [INFO ] [MAIN ] Derivative Progress: 346/2046 symbols completed. CCU took 1.2s. Estimated remaining: 11m 31s. Rate: 147.6 symbols/min [2025-10-28T22:09:31.057593] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:31.060015] [INFO ] [MAIN ] Derivative Progress: 347/2046 symbols completed. CDE took 1.2s. Estimated remaining: 11m 29s. Rate: 148.0 symbols/min [2025-10-28T22:09:31.060842] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:31.063700] [INFO ] [MAIN ] CCS: Generated 138 derivative records from 29790 primary records. [2025-10-28T22:09:31.063917] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-28T22:09:31.076856] [DEBUG] [LOCAL ] CCS: Derivative data saved (138 records). [2025-10-28T22:09:31.077033] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-28T22:09:31.079686] [INFO ] [MAIN ] Derivative Progress: 348/2046 symbols completed. CCS took 1.3s. Estimated remaining: 11m 26s. Rate: 148.4 symbols/min [2025-10-28T22:09:31.079918] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:31.087062] [DEBUG] [LOCAL ] CEE: Loaded 4853 existing records from primary storage. [2025-10-28T22:09:31.087368] [INFO ] [MAIN ] CEE: Loaded 4853 primary data records. [2025-10-28T22:09:31.318853] [DEBUG] [LOCAL ] CDP: Loaded 42091 existing records from primary storage. [2025-10-28T22:09:31.437450] [INFO ] [MAIN ] CDP: Loaded 42091 primary data records. [2025-10-28T22:09:31.437305] [DEBUG] [LOCAL ] CE: Loaded 51149 existing records from primary storage. [2025-10-28T22:09:31.438058] [INFO ] [MAIN ] CE: Loaded 51149 primary data records. [2025-10-28T22:09:32.099099] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:32.151173] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:32.189532] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:32.227100] [INFO ] [MAIN ] CEE: Generated 138 derivative records from 4853 primary records. [2025-10-28T22:09:32.230566] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-28T22:09:32.246604] [DEBUG] [LOCAL ] CEE: Derivative data saved (138 records). [2025-10-28T22:09:32.247917] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-28T22:09:32.256783] [INFO ] [MAIN ] Derivative Progress: 349/2046 symbols completed. CEE took 1.2s. Estimated remaining: 11m 30s. Rate: 147.6 symbols/min [2025-10-28T22:09:32.260301] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:32.288890] [INFO ] [MAIN ] CDP: Generated 138 derivative records from 42091 primary records. [2025-10-28T22:09:32.289299] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-28T22:09:32.292583] [INFO ] [MAIN ] CE: Generated 138 derivative records from 51149 primary records. [2025-10-28T22:09:32.293413] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-28T22:09:32.327663] [DEBUG] [LOCAL ] CDP: Derivative data saved (138 records). [2025-10-28T22:09:32.331310] [DEBUG] [LOCAL ] CE: Derivative data saved (138 records). [2025-10-28T22:09:32.329209] [DEBUG] [LOCAL ] CEPU: Loaded 27302 existing records from primary storage. [2025-10-28T22:09:32.331822] [INFO ] [MAIN ] CEPU: Loaded 27302 primary data records. [2025-10-28T22:09:32.331528] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-28T22:09:32.331946] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-28T22:09:32.335341] [INFO ] [MAIN ] Derivative Progress: 350/2046 symbols completed. CDP took 1.3s. Estimated remaining: 11m 28s. Rate: 148.0 symbols/min [2025-10-28T22:09:32.340394] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:32.353980] [INFO ] [MAIN ] Derivative Progress: 351/2046 symbols completed. CE took 1.3s. Estimated remaining: 11m 25s. Rate: 148.4 symbols/min [2025-10-28T22:09:32.365217] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:32.723866] [DEBUG] [LOCAL ] CF: Loaded 52048 existing records from primary storage. [2025-10-28T22:09:32.724756] [INFO ] [MAIN ] CF: Loaded 52048 primary data records. [2025-10-28T22:09:32.821398] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-28T22:09:32.832627] [INFO ] [MAIN ] CFG: Loaded 53622 primary data records. [2025-10-28T22:09:33.402202] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:33.451227] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:33.500569] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:33.524233] [INFO ] [MAIN ] CEPU: Generated 138 derivative records from 27302 primary records. [2025-10-28T22:09:33.526331] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-28T22:09:33.546387] [DEBUG] [LOCAL ] CEPU: Derivative data saved (138 records). [2025-10-28T22:09:33.546714] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-28T22:09:33.550367] [INFO ] [MAIN ] Derivative Progress: 352/2046 symbols completed. CEPU took 1.3s. Estimated remaining: 11m 29s. Rate: 147.6 symbols/min [2025-10-28T22:09:33.553004] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:33.579190] [INFO ] [MAIN ] CF: Generated 138 derivative records from 52048 primary records. [2025-10-28T22:09:33.579580] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-28T22:09:33.605099] [DEBUG] [LOCAL ] CF: Derivative data saved (138 records). [2025-10-28T22:09:33.605708] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-28T22:09:33.607683] [INFO ] [MAIN ] Derivative Progress: 353/2046 symbols completed. CF took 1.3s. Estimated remaining: 11m 27s. Rate: 147.9 symbols/min [2025-10-28T22:09:33.605566] [INFO ] [MAIN ] CFG: Generated 138 derivative records from 53622 primary records. [2025-10-28T22:09:33.608104] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:33.608316] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-28T22:09:33.621976] [DEBUG] [LOCAL ] CFG: Derivative data saved (138 records). [2025-10-28T22:09:33.633010] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-28T22:09:33.635744] [INFO ] [MAIN ] Derivative Progress: 354/2046 symbols completed. CFG took 1.3s. Estimated remaining: 11m 25s. Rate: 148.3 symbols/min [2025-10-28T22:09:33.635953] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:33.637682] [DEBUG] [LOCAL ] CFR: Loaded 32148 existing records from primary storage. [2025-10-28T22:09:33.638016] [INFO ] [MAIN ] CFR: Loaded 32148 primary data records. [2025-10-28T22:09:33.669886] [DEBUG] [LOCAL ] CGV: Loaded 1299 existing records from primary storage. [2025-10-28T22:09:33.684226] [INFO ] [MAIN ] CGV: Loaded 1299 primary data records. [2025-10-28T22:09:33.964471] [DEBUG] [LOCAL ] CGAU: Loaded 43880 existing records from primary storage. [2025-10-28T22:09:34.039449] [INFO ] [MAIN ] CGAU: Loaded 43880 primary data records. [2025-10-28T22:09:34.723919] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:34.724567] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:09:34.784138] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:34.844034] [INFO ] [MAIN ] CGV: Generated 138 derivative records from 1299 primary records. [2025-10-28T22:09:34.846991] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-28T22:09:34.852847] [INFO ] [MAIN ] CFR: Generated 138 derivative records from 32148 primary records. [2025-10-28T22:09:34.864009] [DEBUG] [LOCAL ] CGV: Derivative data saved (138 records). [2025-10-28T22:09:34.864456] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-28T22:09:34.864158] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-28T22:09:34.866867] [INFO ] [MAIN ] Derivative Progress: 355/2046 symbols completed. CGV took 1.2s. Estimated remaining: 11m 28s. Rate: 147.5 symbols/min [2025-10-28T22:09:34.869455] [INFO ] [MAIN ] CGAU: Generated 138 derivative records from 43880 primary records. [2025-10-28T22:09:34.869578] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:34.869867] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-28T22:09:34.891502] [DEBUG] [LOCAL ] CFR: Derivative data saved (138 records). [2025-10-28T22:09:34.895018] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-28T22:09:34.898575] [DEBUG] [LOCAL ] CGAU: Derivative data saved (138 records). [2025-10-28T22:09:34.897684] [INFO ] [MAIN ] Derivative Progress: 356/2046 symbols completed. CFR took 1.3s. Estimated remaining: 11m 26s. Rate: 147.8 symbols/min [2025-10-28T22:09:34.898834] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-28T22:09:34.898922] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:34.902406] [INFO ] [MAIN ] Derivative Progress: 357/2046 symbols completed. CGAU took 1.3s. Estimated remaining: 11m 24s. Rate: 148.2 symbols/min [2025-10-28T22:09:34.902637] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:34.937715] [DEBUG] [LOCAL ] CHE: Loaded 15358 existing records from primary storage. [2025-10-28T22:09:34.937909] [INFO ] [MAIN ] CHE: Loaded 15358 primary data records. [2025-10-28T22:09:34.938766] [DEBUG] [LOCAL ] CHCT: Loaded 23917 existing records from primary storage. [2025-10-28T22:09:34.951137] [INFO ] [MAIN ] CHCT: Loaded 23917 primary data records. [2025-10-28T22:09:35.243342] [DEBUG] [LOCAL ] CHD: Loaded 52297 existing records from primary storage. [2025-10-28T22:09:35.291546] [INFO ] [MAIN ] CHD: Loaded 52297 primary data records. [2025-10-28T22:09:35.924060] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:35.949698] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:35.998807] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:36.056502] [INFO ] [MAIN ] CHCT: Generated 138 derivative records from 23917 primary records. [2025-10-28T22:09:36.061562] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-28T22:09:36.065615] [INFO ] [MAIN ] CHE: Generated 138 derivative records from 15358 primary records. [2025-10-28T22:09:36.075196] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-28T22:09:36.095413] [DEBUG] [LOCAL ] CHE: Derivative data saved (138 records). [2025-10-28T22:09:36.095536] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-28T22:09:36.092997] [DEBUG] [LOCAL ] CHCT: Derivative data saved (138 records). [2025-10-28T22:09:36.098191] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-28T22:09:36.098053] [INFO ] [MAIN ] Derivative Progress: 358/2046 symbols completed. CHE took 1.2s. Estimated remaining: 11m 27s. Rate: 147.4 symbols/min [2025-10-28T22:09:36.101430] [INFO ] [MAIN ] Derivative Progress: 359/2046 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 25s. Rate: 147.9 symbols/min [2025-10-28T22:09:36.103526] [INFO ] [MAIN ] CHD: Generated 138 derivative records from 52297 primary records. [2025-10-28T22:09:36.103610] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-28T22:09:36.116862] [DEBUG] [LOCAL ] CHD: Derivative data saved (138 records). [2025-10-28T22:09:36.116920] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-28T22:09:36.119172] [INFO ] [MAIN ] Derivative Progress: 360/2046 symbols completed. CHD took 1.2s. Estimated remaining: 11m 22s. Rate: 148.2 symbols/min [2025-10-28T22:09:36.119673] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:36.119597] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:36.120296] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:36.128356] [DEBUG] [LOCAL ] CHN: Loaded 4981 existing records from primary storage. [2025-10-28T22:09:36.133554] [INFO ] [MAIN ] CHN: Loaded 4981 primary data records. [2025-10-28T22:09:36.251528] [DEBUG] [LOCAL ] CHMI: Loaded 20680 existing records from primary storage. [2025-10-28T22:09:36.270904] [INFO ] [MAIN ] CHMI: Loaded 20680 primary data records. [2025-10-28T22:09:36.357902] [DEBUG] [LOCAL ] CHH: Loaded 32029 existing records from primary storage. [2025-10-28T22:09:36.529808] [INFO ] [MAIN ] CHH: Loaded 32029 primary data records. [2025-10-28T22:09:37.156744] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:37.197350] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:37.239679] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:37.270708] [INFO ] [MAIN ] CHN: Generated 138 derivative records from 4981 primary records. [2025-10-28T22:09:37.273161] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-28T22:09:37.289868] [DEBUG] [LOCAL ] CHN: Derivative data saved (138 records). [2025-10-28T22:09:37.291323] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-28T22:09:37.297311] [INFO ] [MAIN ] Derivative Progress: 361/2046 symbols completed. CHN took 1.2s. Estimated remaining: 11m 26s. Rate: 147.5 symbols/min [2025-10-28T22:09:37.300757] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:37.309153] [INFO ] [MAIN ] CHMI: Generated 138 derivative records from 20680 primary records. [2025-10-28T22:09:37.309813] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-28T22:09:37.326453] [DEBUG] [LOCAL ] CHMI: Derivative data saved (138 records). [2025-10-28T22:09:37.328786] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-28T22:09:37.331241] [INFO ] [MAIN ] Derivative Progress: 362/2046 symbols completed. CHMI took 1.2s. Estimated remaining: 11m 23s. Rate: 147.8 symbols/min [2025-10-28T22:09:37.331898] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:37.334422] [INFO ] [MAIN ] CHH: Generated 138 derivative records from 32029 primary records. [2025-10-28T22:09:37.334762] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-28T22:09:37.358731] [DEBUG] [LOCAL ] CHH: Derivative data saved (138 records). [2025-10-28T22:09:37.358985] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-28T22:09:37.362451] [INFO ] [MAIN ] Derivative Progress: 363/2046 symbols completed. CHH took 1.2s. Estimated remaining: 11m 21s. Rate: 148.2 symbols/min [2025-10-28T22:09:37.362874] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:37.383852] [DEBUG] [LOCAL ] CHPT: Loaded 46294 existing records from primary storage. [2025-10-28T22:09:37.384216] [INFO ] [MAIN ] CHPT: Loaded 46294 primary data records. [2025-10-28T22:09:37.601747] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-28T22:09:37.624237] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-10-28T22:09:37.823344] [DEBUG] [LOCAL ] CI: Loaded 49430 existing records from primary storage. [2025-10-28T22:09:37.836539] [INFO ] [MAIN ] CI: Loaded 49430 primary data records. [2025-10-28T22:09:38.406706] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:38.451566] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:38.493280] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:38.538007] [INFO ] [MAIN ] CHPT: Generated 138 derivative records from 46294 primary records. [2025-10-28T22:09:38.541697] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-28T22:09:38.560868] [DEBUG] [LOCAL ] CHPT: Derivative data saved (138 records). [2025-10-28T22:09:38.561286] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-28T22:09:38.567332] [INFO ] [MAIN ] Derivative Progress: 364/2046 symbols completed. CHPT took 1.3s. Estimated remaining: 11m 25s. Rate: 147.4 symbols/min [2025-10-28T22:09:38.567503] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:38.573017] [INFO ] [MAIN ] CHWY: Generated 138 derivative records from 53654 primary records. [2025-10-28T22:09:38.574780] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-28T22:09:38.596434] [DEBUG] [LOCAL ] CHWY: Derivative data saved (138 records). [2025-10-28T22:09:38.596576] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-28T22:09:38.600442] [INFO ] [MAIN ] Derivative Progress: 365/2046 symbols completed. CHWY took 1.3s. Estimated remaining: 11m 22s. Rate: 147.8 symbols/min [2025-10-28T22:09:38.601134] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:38.600959] [INFO ] [MAIN ] CI: Generated 138 derivative records from 49430 primary records. [2025-10-28T22:09:38.607059] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-28T22:09:38.608504] [DEBUG] [LOCAL ] CIA: Loaded 16202 existing records from primary storage. [2025-10-28T22:09:38.609699] [INFO ] [MAIN ] CIA: Loaded 16202 primary data records. [2025-10-28T22:09:38.633881] [DEBUG] [LOCAL ] CI: Derivative data saved (138 records). [2025-10-28T22:09:38.644493] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-28T22:09:38.664855] [INFO ] [MAIN ] Derivative Progress: 366/2046 symbols completed. CI took 1.3s. Estimated remaining: 11m 20s. Rate: 148.1 symbols/min [2025-10-28T22:09:38.665079] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:38.985517] [DEBUG] [LOCAL ] CIB: Loaded 29643 existing records from primary storage. [2025-10-28T22:09:39.000368] [INFO ] [MAIN ] CIB: Loaded 29643 primary data records. [2025-10-28T22:09:39.224947] [DEBUG] [LOCAL ] CIEN: Loaded 52075 existing records from primary storage. [2025-10-28T22:09:39.342327] [INFO ] [MAIN ] CIEN: Loaded 52075 primary data records. [2025-10-28T22:09:39.472981] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:39.744916] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:39.775440] [INFO ] [MAIN ] CIA: Generated 138 derivative records from 16202 primary records. [2025-10-28T22:09:39.776506] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-28T22:09:39.806336] [DEBUG] [LOCAL ] CIA: Derivative data saved (138 records). [2025-10-28T22:09:39.806685] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-28T22:09:39.806247] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:39.826555] [INFO ] [MAIN ] Derivative Progress: 367/2046 symbols completed. CIA took 1.3s. Estimated remaining: 11m 24s. Rate: 147.4 symbols/min [2025-10-28T22:09:39.827308] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:39.844242] [DEBUG] [LOCAL ] CIF: Loaded 3832 existing records from primary storage. [2025-10-28T22:09:39.847736] [INFO ] [MAIN ] CIF: Loaded 3832 primary data records. [2025-10-28T22:09:39.861700] [INFO ] [MAIN ] CIB: Generated 138 derivative records from 29643 primary records. [2025-10-28T22:09:39.871517] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-28T22:09:39.970593] [DEBUG] [LOCAL ] CIB: Derivative data saved (138 records). [2025-10-28T22:09:39.972820] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-28T22:09:39.975406] [INFO ] [MAIN ] Derivative Progress: 368/2046 symbols completed. CIB took 1.4s. Estimated remaining: 11m 22s. Rate: 147.6 symbols/min [2025-10-28T22:09:39.976026] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:40.057519] [INFO ] [MAIN ] CIEN: Generated 138 derivative records from 52075 primary records. [2025-10-28T22:09:40.165536] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-28T22:09:40.188533] [DEBUG] [LOCAL ] CIEN: Derivative data saved (138 records). [2025-10-28T22:09:40.189400] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-28T22:09:40.192027] [INFO ] [MAIN ] Derivative Progress: 369/2046 symbols completed. CIEN took 1.5s. Estimated remaining: 11m 21s. Rate: 147.8 symbols/min [2025-10-28T22:09:40.192512] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:40.223990] [DEBUG] [LOCAL ] CII: Loaded 14584 existing records from primary storage. [2025-10-28T22:09:40.250032] [INFO ] [MAIN ] CII: Loaded 14584 primary data records. [2025-10-28T22:09:40.251900] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:40.285301] [DEBUG] [LOCAL ] CIG: Loaded 44535 existing records from primary storage. [2025-10-28T22:09:40.348189] [INFO ] [MAIN ] CIG: Loaded 44535 primary data records. [2025-10-28T22:09:40.981274] [INFO ] [MAIN ] CIF: Generated 138 derivative records from 3832 primary records. [2025-10-28T22:09:40.981400] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-28T22:09:40.994999] [DEBUG] [LOCAL ] CIF: Derivative data saved (138 records). [2025-10-28T22:09:40.995784] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-28T22:09:40.999147] [INFO ] [MAIN ] Derivative Progress: 370/2046 symbols completed. CIF took 1.2s. Estimated remaining: 11m 22s. Rate: 147.4 symbols/min [2025-10-28T22:09:40.999415] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:41.018693] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:41.069119] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:41.113463] [DEBUG] [LOCAL ] CIM: Loaded 36901 existing records from primary storage. [2025-10-28T22:09:41.115725] [INFO ] [MAIN ] CIM: Loaded 36901 primary data records. [2025-10-28T22:09:41.139234] [INFO ] [MAIN ] CII: Generated 138 derivative records from 14584 primary records. [2025-10-28T22:09:41.155098] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-28T22:09:41.274681] [DEBUG] [LOCAL ] CII: Derivative data saved (138 records). [2025-10-28T22:09:41.330061] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-28T22:09:41.449470] [INFO ] [MAIN ] Derivative Progress: 371/2046 symbols completed. CII took 1.3s. Estimated remaining: 11m 22s. Rate: 147.4 symbols/min [2025-10-28T22:09:41.450476] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:41.462752] [DEBUG] [LOCAL ] CIMN: Loaded 2662 existing records from primary storage. [2025-10-28T22:09:41.462547] [INFO ] [MAIN ] CIG: Generated 138 derivative records from 44535 primary records. [2025-10-28T22:09:41.463393] [INFO ] [MAIN ] CIMN: Loaded 2662 primary data records. [2025-10-28T22:09:41.463731] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-28T22:09:41.551693] [DEBUG] [LOCAL ] CIG: Derivative data saved (138 records). [2025-10-28T22:09:41.564822] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-28T22:09:41.594388] [INFO ] [MAIN ] Derivative Progress: 372/2046 symbols completed. CIG took 1.6s. Estimated remaining: 11m 20s. Rate: 147.6 symbols/min [2025-10-28T22:09:41.595074] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:41.811523] [DEBUG] [LOCAL ] CINT: Loaded 20423 existing records from primary storage. [2025-10-28T22:09:41.813145] [INFO ] [MAIN ] CINT: Loaded 20423 primary data records. [2025-10-28T22:09:41.917255] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:42.180304] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-28T22:09:42.212713] [INFO ] [MAIN ] CIM: Generated 138 derivative records from 36901 primary records. [2025-10-28T22:09:42.216004] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-28T22:09:42.232157] [DEBUG] [LOCAL ] CIM: Derivative data saved (138 records). [2025-10-28T22:09:42.235032] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-28T22:09:42.246337] [INFO ] [MAIN ] Derivative Progress: 373/2046 symbols completed. CIM took 1.2s. Estimated remaining: 11m 21s. Rate: 147.4 symbols/min [2025-10-28T22:09:42.251868] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:42.272396] [INFO ] [MAIN ] CIMN: Generated 138 derivative records from 2662 primary records. [2025-10-28T22:09:42.274991] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-28T22:09:42.287582] [DEBUG] [LOCAL ] CIMN: Derivative data saved (138 records). [2025-10-28T22:09:42.290153] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-28T22:09:42.293013] [INFO ] [MAIN ] Derivative Progress: 374/2046 symbols completed. CIMN took 0.8s. Estimated remaining: 11m 19s. Rate: 147.8 symbols/min [2025-10-28T22:09:42.300981] [INFO ] [MAIN ] CINT: Generated 138 derivative records from 20423 primary records. [2025-10-28T22:09:42.301058] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-28T22:09:42.311757] [DEBUG] [LOCAL ] CINT: Derivative data saved (138 records). [2025-10-28T22:09:42.311819] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-28T22:09:42.314273] [INFO ] [MAIN ] Derivative Progress: 375/2046 symbols completed. CINT took 0.7s. Estimated remaining: 11m 17s. Rate: 148.1 symbols/min [2025-10-28T22:09:42.314734] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:42.314848] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:42.314630] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:42.334513] [DEBUG] [LOCAL ] CIO: Loaded 21194 existing records from primary storage. [2025-10-28T22:09:42.334847] [INFO ] [MAIN ] CIO: Loaded 21194 primary data records. [2025-10-28T22:09:42.457792] [DEBUG] [LOCAL ] CION: Loaded 27286 existing records from primary storage. [2025-10-28T22:09:42.470045] [INFO ] [MAIN ] CION: Loaded 27286 primary data records. [2025-10-28T22:09:42.796119] [DEBUG] [LOCAL ] CIVI: Loaded 52642 existing records from primary storage. [2025-10-28T22:09:42.797181] [INFO ] [MAIN ] CIVI: Loaded 52642 primary data records. [2025-10-28T22:09:43.354386] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:43.388029] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:43.422329] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:43.466190] [INFO ] [MAIN ] CIO: Generated 138 derivative records from 21194 primary records. [2025-10-28T22:09:43.467666] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-28T22:09:43.484980] [DEBUG] [LOCAL ] CIO: Derivative data saved (138 records). [2025-10-28T22:09:43.485213] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-28T22:09:43.487627] [INFO ] [MAIN ] Derivative Progress: 376/2046 symbols completed. CIO took 1.2s. Estimated remaining: 11m 20s. Rate: 147.4 symbols/min [2025-10-28T22:09:43.488193] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:43.495046] [INFO ] [MAIN ] CION: Generated 138 derivative records from 27286 primary records. [2025-10-28T22:09:43.496270] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-28T22:09:43.498592] [INFO ] [MAIN ] CIVI: Generated 138 derivative records from 52642 primary records. [2025-10-28T22:09:43.498760] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-28T22:09:43.520148] [DEBUG] [LOCAL ] CIVI: Derivative data saved (138 records). [2025-10-28T22:09:43.522740] [DEBUG] [LOCAL ] CION: Derivative data saved (138 records). [2025-10-28T22:09:43.521833] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-28T22:09:43.522843] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-28T22:09:43.525599] [INFO ] [MAIN ] Derivative Progress: 377/2046 symbols completed. CIVI took 1.2s. Estimated remaining: 11m 18s. Rate: 147.7 symbols/min [2025-10-28T22:09:43.528050] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:43.528553] [INFO ] [MAIN ] Derivative Progress: 378/2046 symbols completed. CION took 1.2s. Estimated remaining: 11m 16s. Rate: 148.1 symbols/min [2025-10-28T22:09:43.528739] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:43.554282] [DEBUG] [LOCAL ] CLCO: Loaded 12886 existing records from primary storage. [2025-10-28T22:09:43.554436] [INFO ] [MAIN ] CLCO: Loaded 12886 primary data records. [2025-10-28T22:09:43.708759] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-28T22:09:43.715734] [INFO ] [MAIN ] CL: Loaded 53649 primary data records. [2025-10-28T22:09:43.742499] [DEBUG] [LOCAL ] CLB: Loaded 33443 existing records from primary storage. [2025-10-28T22:09:43.835969] [INFO ] [MAIN ] CLB: Loaded 33443 primary data records. [2025-10-28T22:09:44.639716] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:44.677507] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:44.719797] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:44.746790] [INFO ] [MAIN ] CLCO: Generated 138 derivative records from 12886 primary records. [2025-10-28T22:09:44.747583] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-28T22:09:44.764912] [DEBUG] [LOCAL ] CLCO: Derivative data saved (138 records). [2025-10-28T22:09:44.765406] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-28T22:09:44.769247] [INFO ] [MAIN ] Derivative Progress: 379/2046 symbols completed. CLCO took 1.2s. Estimated remaining: 11m 19s. Rate: 147.3 symbols/min [2025-10-28T22:09:44.770242] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:44.795450] [INFO ] [MAIN ] CL: Generated 138 derivative records from 53649 primary records. [2025-10-28T22:09:44.798126] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-28T22:09:44.808785] [INFO ] [MAIN ] CLB: Generated 138 derivative records from 33443 primary records. [2025-10-28T22:09:44.809992] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-28T22:09:44.818241] [DEBUG] [LOCAL ] CLDT: Loaded 24678 existing records from primary storage. [2025-10-28T22:09:44.833858] [INFO ] [MAIN ] CLDT: Loaded 24678 primary data records. [2025-10-28T22:09:44.837404] [DEBUG] [LOCAL ] CLB: Derivative data saved (138 records). [2025-10-28T22:09:44.835990] [DEBUG] [LOCAL ] CL: Derivative data saved (138 records). [2025-10-28T22:09:44.858608] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-28T22:09:44.877140] [INFO ] [MAIN ] Derivative Progress: 380/2046 symbols completed. CLB took 1.3s. Estimated remaining: 11m 17s. Rate: 147.6 symbols/min [2025-10-28T22:09:44.884346] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:44.884058] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-28T22:09:44.928082] [INFO ] [MAIN ] Derivative Progress: 381/2046 symbols completed. CL took 1.4s. Estimated remaining: 11m 15s. Rate: 147.9 symbols/min [2025-10-28T22:09:44.948389] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:45.192476] [DEBUG] [LOCAL ] CLH: Loaded 27313 existing records from primary storage. [2025-10-28T22:09:45.193612] [INFO ] [MAIN ] CLH: Loaded 27313 primary data records. [2025-10-28T22:09:45.247022] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-28T22:09:45.254015] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-28T22:09:45.806785] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:45.999314] [INFO ] [MAIN ] CLDT: Generated 138 derivative records from 24678 primary records. [2025-10-28T22:09:46.008492] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:46.006826] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-28T22:09:46.050891] [DEBUG] [LOCAL ] CLDT: Derivative data saved (138 records). [2025-10-28T22:09:46.053038] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-28T22:09:46.053542] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:46.055839] [INFO ] [MAIN ] Derivative Progress: 382/2046 symbols completed. CLDT took 1.3s. Estimated remaining: 11m 18s. Rate: 147.3 symbols/min [2025-10-28T22:09:46.069412] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:46.091254] [DEBUG] [LOCAL ] CLPR: Loaded 9592 existing records from primary storage. [2025-10-28T22:09:46.093543] [INFO ] [MAIN ] CLPR: Loaded 9592 primary data records. [2025-10-28T22:09:46.423953] [INFO ] [MAIN ] CLH: Generated 138 derivative records from 27313 primary records. [2025-10-28T22:09:46.424618] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-28T22:09:46.427767] [INFO ] [MAIN ] CLF: Generated 138 derivative records from 53741 primary records. [2025-10-28T22:09:46.434962] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-28T22:09:46.455297] [DEBUG] [LOCAL ] CLF: Derivative data saved (138 records). [2025-10-28T22:09:46.456798] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-28T22:09:46.456534] [DEBUG] [LOCAL ] CLH: Derivative data saved (138 records). [2025-10-28T22:09:46.460023] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-28T22:09:46.459565] [INFO ] [MAIN ] Derivative Progress: 383/2046 symbols completed. CLF took 1.6s. Estimated remaining: 11m 18s. Rate: 147.3 symbols/min [2025-10-28T22:09:46.463521] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:46.464400] [INFO ] [MAIN ] Derivative Progress: 384/2046 symbols completed. CLH took 1.5s. Estimated remaining: 11m 15s. Rate: 147.6 symbols/min [2025-10-28T22:09:46.464862] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:46.481913] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:46.543962] [INFO ] [MAIN ] CLPR: Generated 138 derivative records from 9592 primary records. [2025-10-28T22:09:46.544122] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-28T22:09:46.557824] [DEBUG] [LOCAL ] CLPR: Derivative data saved (138 records). [2025-10-28T22:09:46.558021] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-28T22:09:46.561009] [INFO ] [MAIN ] Derivative Progress: 385/2046 symbols completed. CLPR took 0.5s. Estimated remaining: 11m 14s. Rate: 147.9 symbols/min [2025-10-28T22:09:46.576149] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:46.594444] [DEBUG] [LOCAL ] CLS: Loaded 53546 existing records from primary storage. [2025-10-28T22:09:46.596539] [DEBUG] [LOCAL ] CLVT: Loaded 51857 existing records from primary storage. [2025-10-28T22:09:46.596800] [INFO ] [MAIN ] CLS: Loaded 53546 primary data records. [2025-10-28T22:09:46.597223] [INFO ] [MAIN ] CLVT: Loaded 51857 primary data records. [2025-10-28T22:09:46.855133] [DEBUG] [LOCAL ] CLW: Loaded 20961 existing records from primary storage. [2025-10-28T22:09:46.881341] [INFO ] [MAIN ] CLW: Loaded 20961 primary data records. [2025-10-28T22:09:47.731989] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:47.772423] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:47.828805] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:47.899219] [INFO ] [MAIN ] CLS: Generated 138 derivative records from 53546 primary records. [2025-10-28T22:09:47.900892] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-28T22:09:47.920064] [DEBUG] [LOCAL ] CLS: Derivative data saved (138 records). [2025-10-28T22:09:47.924539] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-28T22:09:47.927679] [INFO ] [MAIN ] Derivative Progress: 386/2046 symbols completed. CLS took 1.5s. Estimated remaining: 11m 17s. Rate: 147.0 symbols/min [2025-10-28T22:09:47.925260] [INFO ] [MAIN ] CLVT: Generated 138 derivative records from 51857 primary records. [2025-10-28T22:09:47.928254] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-28T22:09:47.929161] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:47.949720] [INFO ] [MAIN ] CLW: Generated 138 derivative records from 20961 primary records. [2025-10-28T22:09:47.950433] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-28T22:09:47.965379] [DEBUG] [LOCAL ] CLW: Derivative data saved (138 records). [2025-10-28T22:09:47.965571] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-28T22:09:47.969381] [INFO ] [MAIN ] Derivative Progress: 387/2046 symbols completed. CLW took 1.4s. Estimated remaining: 11m 15s. Rate: 147.4 symbols/min [2025-10-28T22:09:47.969833] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:47.971782] [DEBUG] [LOCAL ] CLVT: Derivative data saved (138 records). [2025-10-28T22:09:47.972051] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-28T22:09:47.974765] [INFO ] [MAIN ] Derivative Progress: 388/2046 symbols completed. CLVT took 1.5s. Estimated remaining: 11m 13s. Rate: 147.8 symbols/min [2025-10-28T22:09:48.023170] [DEBUG] [LOCAL ] CLX: Loaded 51838 existing records from primary storage. [2025-10-28T22:09:48.023396] [INFO ] [MAIN ] CLX: Loaded 51838 primary data records. [2025-10-28T22:09:48.138419] [DEBUG] [LOCAL ] CM: Loaded 48051 existing records from primary storage. [2025-10-28T22:09:48.164597] [INFO ] [MAIN ] CM: Loaded 48051 primary data records. [2025-10-28T22:09:48.686855] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:48.736375] [INFO ] [MAIN ] CLX: Generated 138 derivative records from 51838 primary records. [2025-10-28T22:09:48.736811] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-28T22:09:48.749462] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:48.780043] [DEBUG] [LOCAL ] CLX: Derivative data saved (138 records). [2025-10-28T22:09:48.780307] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-28T22:09:48.783929] [INFO ] [MAIN ] Derivative Progress: 389/2046 symbols completed. CLX took 0.9s. Estimated remaining: 11m 15s. Rate: 147.4 symbols/min [2025-10-28T22:09:48.797058] [INFO ] [MAIN ] CM: Generated 138 derivative records from 48051 primary records. [2025-10-28T22:09:48.797313] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-28T22:09:48.809384] [DEBUG] [LOCAL ] CM: Derivative data saved (138 records). [2025-10-28T22:09:48.809445] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-28T22:09:48.811693] [INFO ] [MAIN ] Derivative Progress: 390/2046 symbols completed. CM took 0.8s. Estimated remaining: 11m 13s. Rate: 147.7 symbols/min [2025-10-28T22:09:48.812276] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:48.812159] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:48.812470] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:48.821277] [DEBUG] [LOCAL ] CMCM: Loaded 4794 existing records from primary storage. [2025-10-28T22:09:48.821404] [INFO ] [MAIN ] CMCM: Loaded 4794 primary data records. [2025-10-28T22:09:48.934739] [DEBUG] [LOCAL ] CMBT: Loaded 28622 existing records from primary storage. [2025-10-28T22:09:48.945759] [INFO ] [MAIN ] CMBT: Loaded 28622 primary data records. [2025-10-28T22:09:49.328353] [DEBUG] [LOCAL ] CMA: Loaded 50115 existing records from primary storage. [2025-10-28T22:09:49.354394] [INFO ] [MAIN ] CMA: Loaded 50115 primary data records. [2025-10-28T22:09:49.855058] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:49.890824] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:49.939894] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:49.991374] [INFO ] [MAIN ] CMCM: Generated 138 derivative records from 4794 primary records. [2025-10-28T22:09:49.994608] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-28T22:09:50.010498] [INFO ] [MAIN ] CMBT: Generated 138 derivative records from 28622 primary records. [2025-10-28T22:09:50.014478] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-28T22:09:50.013106] [DEBUG] [LOCAL ] CMCM: Derivative data saved (138 records). [2025-10-28T22:09:50.015172] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-28T22:09:50.019027] [INFO ] [MAIN ] Derivative Progress: 391/2046 symbols completed. CMCM took 1.2s. Estimated remaining: 11m 16s. Rate: 147.0 symbols/min [2025-10-28T22:09:50.021971] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:50.034730] [DEBUG] [LOCAL ] CMBT: Derivative data saved (138 records). [2025-10-28T22:09:50.034926] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-28T22:09:50.037174] [INFO ] [MAIN ] Derivative Progress: 392/2046 symbols completed. CMBT took 1.2s. Estimated remaining: 11m 14s. Rate: 147.3 symbols/min [2025-10-28T22:09:50.038996] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:50.041925] [INFO ] [MAIN ] CMA: Generated 138 derivative records from 50115 primary records. [2025-10-28T22:09:50.042118] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-28T22:09:50.056795] [DEBUG] [LOCAL ] CMA: Derivative data saved (138 records). [2025-10-28T22:09:50.057149] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-28T22:09:50.060782] [INFO ] [MAIN ] Derivative Progress: 393/2046 symbols completed. CMA took 1.2s. Estimated remaining: 11m 11s. Rate: 147.7 symbols/min [2025-10-28T22:09:50.061050] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:50.104070] [DEBUG] [LOCAL ] CMP: Loaded 35190 existing records from primary storage. [2025-10-28T22:09:50.112299] [INFO ] [MAIN ] CMP: Loaded 35190 primary data records. [2025-10-28T22:09:50.232077] [DEBUG] [LOCAL ] CMI: Loaded 41254 existing records from primary storage. [2025-10-28T22:09:50.249060] [INFO ] [MAIN ] CMI: Loaded 41254 primary data records. [2025-10-28T22:09:50.298997] [DEBUG] [LOCAL ] CMPO: Loaded 37862 existing records from primary storage. [2025-10-28T22:09:50.337997] [INFO ] [MAIN ] CMPO: Loaded 37862 primary data records. [2025-10-28T22:09:51.145790] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:51.183423] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:51.216829] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:51.270714] [INFO ] [MAIN ] CMP: Generated 138 derivative records from 35190 primary records. [2025-10-28T22:09:51.271341] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-28T22:09:51.295539] [DEBUG] [LOCAL ] CMP: Derivative data saved (138 records). [2025-10-28T22:09:51.297972] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-28T22:09:51.303104] [INFO ] [MAIN ] CMI: Generated 138 derivative records from 41254 primary records. [2025-10-28T22:09:51.300590] [INFO ] [MAIN ] Derivative Progress: 394/2046 symbols completed. CMP took 1.3s. Estimated remaining: 11m 15s. Rate: 146.9 symbols/min [2025-10-28T22:09:51.303286] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:51.304084] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-28T22:09:51.304004] [INFO ] [MAIN ] CMPO: Generated 138 derivative records from 37862 primary records. [2025-10-28T22:09:51.312436] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-28T22:09:51.317541] [DEBUG] [LOCAL ] CMI: Derivative data saved (138 records). [2025-10-28T22:09:51.318020] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-28T22:09:51.321527] [INFO ] [MAIN ] Derivative Progress: 395/2046 symbols completed. CMI took 1.3s. Estimated remaining: 11m 13s. Rate: 147.3 symbols/min [2025-10-28T22:09:51.333458] [DEBUG] [LOCAL ] CMPO: Derivative data saved (138 records). [2025-10-28T22:09:51.333683] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:51.333909] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-28T22:09:51.336846] [INFO ] [MAIN ] Derivative Progress: 396/2046 symbols completed. CMPO took 1.3s. Estimated remaining: 11m 11s. Rate: 147.7 symbols/min [2025-10-28T22:09:51.337067] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:51.353291] [DEBUG] [LOCAL ] CMSA: Loaded 3430 existing records from primary storage. [2025-10-28T22:09:51.357235] [DEBUG] [LOCAL ] CMSD: Loaded 7410 existing records from primary storage. [2025-10-28T22:09:51.357453] [INFO ] [MAIN ] CMSA: Loaded 3430 primary data records. [2025-10-28T22:09:51.368870] [INFO ] [MAIN ] CMSD: Loaded 7410 primary data records. [2025-10-28T22:09:51.558126] [DEBUG] [LOCAL ] CMRE: Loaded 35169 existing records from primary storage. [2025-10-28T22:09:51.582823] [INFO ] [MAIN ] CMRE: Loaded 35169 primary data records. [2025-10-28T22:09:52.360070] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:52.359823] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:52.413403] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:52.459981] [INFO ] [MAIN ] CMSA: Generated 138 derivative records from 3430 primary records. [2025-10-28T22:09:52.459849] [INFO ] [MAIN ] CMSD: Generated 138 derivative records from 7410 primary records. [2025-10-28T22:09:52.460181] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-28T22:09:52.460276] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-28T22:09:52.479377] [DEBUG] [LOCAL ] CMSD: Derivative data saved (138 records). [2025-10-28T22:09:52.483214] [DEBUG] [LOCAL ] CMSA: Derivative data saved (138 records). [2025-10-28T22:09:52.485575] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-28T22:09:52.487512] [INFO ] [MAIN ] Derivative Progress: 397/2046 symbols completed. CMSA took 1.2s. Estimated remaining: 11m 13s. Rate: 147.0 symbols/min [2025-10-28T22:09:52.487951] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-28T22:09:52.488036] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:52.490615] [INFO ] [MAIN ] Derivative Progress: 398/2046 symbols completed. CMSD took 1.2s. Estimated remaining: 11m 11s. Rate: 147.3 symbols/min [2025-10-28T22:09:52.492822] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:52.501732] [INFO ] [MAIN ] CMRE: Generated 138 derivative records from 35169 primary records. [2025-10-28T22:09:52.502007] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-28T22:09:52.516858] [DEBUG] [LOCAL ] CNF: Loaded 10607 existing records from primary storage. [2025-10-28T22:09:52.519526] [DEBUG] [LOCAL ] CMRE: Derivative data saved (138 records). [2025-10-28T22:09:52.519739] [INFO ] [MAIN ] CNF: Loaded 10607 primary data records. [2025-10-28T22:09:52.519950] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-28T22:09:52.533415] [INFO ] [MAIN ] Derivative Progress: 399/2046 symbols completed. CMRE took 1.2s. Estimated remaining: 11m 9s. Rate: 147.7 symbols/min [2025-10-28T22:09:52.543097] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:52.843858] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-28T22:09:52.844149] [INFO ] [MAIN ] CNC: Loaded 53779 primary data records. [2025-10-28T22:09:53.024207] [DEBUG] [LOCAL ] CNH: Loaded 53539 existing records from primary storage. [2025-10-28T22:09:53.158139] [INFO ] [MAIN ] CNH: Loaded 53539 primary data records. [2025-10-28T22:09:53.487887] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:09:53.535239] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:53.577431] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:53.593394] [INFO ] [MAIN ] CNF: Generated 138 derivative records from 10607 primary records. [2025-10-28T22:09:53.595857] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-28T22:09:53.617123] [DEBUG] [LOCAL ] CNF: Derivative data saved (138 records). [2025-10-28T22:09:53.619735] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-28T22:09:53.622587] [INFO ] [MAIN ] Derivative Progress: 400/2046 symbols completed. CNF took 1.1s. Estimated remaining: 11m 12s. Rate: 147.1 symbols/min [2025-10-28T22:09:53.625089] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:53.632563] [INFO ] [MAIN ] CNC: Generated 138 derivative records from 53779 primary records. [2025-10-28T22:09:53.632854] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-28T22:09:53.648959] [DEBUG] [LOCAL ] CNC: Derivative data saved (138 records). [2025-10-28T22:09:53.649123] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-28T22:09:53.652099] [INFO ] [MAIN ] Derivative Progress: 401/2046 symbols completed. CNC took 1.2s. Estimated remaining: 11m 10s. Rate: 147.4 symbols/min [2025-10-28T22:09:53.653713] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:53.656829] [INFO ] [MAIN ] CNH: Generated 138 derivative records from 53539 primary records. [2025-10-28T22:09:53.656994] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-28T22:09:53.670015] [DEBUG] [LOCAL ] CNH: Derivative data saved (138 records). [2025-10-28T22:09:53.682373] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-28T22:09:53.685008] [INFO ] [MAIN ] Derivative Progress: 402/2046 symbols completed. CNH took 1.1s. Estimated remaining: 11m 8s. Rate: 147.7 symbols/min [2025-10-28T22:09:53.685364] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:53.706070] [DEBUG] [LOCAL ] CNI: Loaded 51538 existing records from primary storage. [2025-10-28T22:09:53.706461] [INFO ] [MAIN ] CNI: Loaded 51538 primary data records. [2025-10-28T22:09:53.842896] [DEBUG] [LOCAL ] CNO: Loaded 39874 existing records from primary storage. [2025-10-28T22:09:53.848817] [INFO ] [MAIN ] CNO: Loaded 39874 primary data records. [2025-10-28T22:09:54.194034] [DEBUG] [LOCAL ] CNP: Loaded 53474 existing records from primary storage. [2025-10-28T22:09:54.204669] [INFO ] [MAIN ] CNP: Loaded 53474 primary data records. [2025-10-28T22:09:54.706894] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:54.746997] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:54.779778] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:54.819240] [INFO ] [MAIN ] CNI: Generated 138 derivative records from 51538 primary records. [2025-10-28T22:09:54.820788] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-28T22:09:54.844736] [DEBUG] [LOCAL ] CNI: Derivative data saved (138 records). [2025-10-28T22:09:54.847402] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-28T22:09:54.854214] [INFO ] [MAIN ] Derivative Progress: 403/2046 symbols completed. CNI took 1.2s. Estimated remaining: 11m 10s. Rate: 147.0 symbols/min [2025-10-28T22:09:54.857375] [INFO ] [MAIN ] CNO: Generated 138 derivative records from 39874 primary records. [2025-10-28T22:09:54.858857] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-28T22:09:54.861014] [INFO ] [MAIN ] CNP: Generated 138 derivative records from 53474 primary records. [2025-10-28T22:09:54.861376] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-28T22:09:54.883854] [DEBUG] [LOCAL ] CNP: Derivative data saved (138 records). [2025-10-28T22:09:54.885215] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-28T22:09:54.885299] [DEBUG] [LOCAL ] CNO: Derivative data saved (138 records). [2025-10-28T22:09:54.887987] [INFO ] [MAIN ] Derivative Progress: 404/2046 symbols completed. CNP took 1.2s. Estimated remaining: 11m 8s. Rate: 147.4 symbols/min [2025-10-28T22:09:54.888102] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-28T22:09:54.890411] [INFO ] [MAIN ] Derivative Progress: 405/2046 symbols completed. CNO took 1.2s. Estimated remaining: 11m 6s. Rate: 147.7 symbols/min [2025-10-28T22:09:54.890828] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:54.891006] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:54.890930] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:54.960538] [DEBUG] [LOCAL ] CNX: Loaded 51279 existing records from primary storage. [2025-10-28T22:09:54.974904] [INFO ] [MAIN ] CNX: Loaded 51279 primary data records. [2025-10-28T22:09:55.006083] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-28T22:09:55.018001] [INFO ] [MAIN ] COF: Loaded 53625 primary data records. [2025-10-28T22:09:55.088775] [DEBUG] [LOCAL ] CNQ: Loaded 53578 existing records from primary storage. [2025-10-28T22:09:55.112786] [INFO ] [MAIN ] CNQ: Loaded 53578 primary data records. [2025-10-28T22:09:55.974323] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:56.008186] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:56.043447] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:56.114284] [INFO ] [MAIN ] CNX: Generated 138 derivative records from 51279 primary records. [2025-10-28T22:09:56.118351] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-28T22:09:56.131818] [INFO ] [MAIN ] COF: Generated 138 derivative records from 53625 primary records. [2025-10-28T22:09:56.132013] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-28T22:09:56.124477] [INFO ] [MAIN ] CNQ: Generated 138 derivative records from 53578 primary records. [2025-10-28T22:09:56.135448] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-28T22:09:56.158816] [DEBUG] [LOCAL ] CNQ: Derivative data saved (138 records). [2025-10-28T22:09:56.154604] [DEBUG] [LOCAL ] CNX: Derivative data saved (138 records). [2025-10-28T22:09:56.161814] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-28T22:09:56.166312] [INFO ] [MAIN ] Derivative Progress: 406/2046 symbols completed. CNQ took 1.3s. Estimated remaining: 11m 10s. Rate: 147.0 symbols/min [2025-10-28T22:09:56.166462] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:56.166879] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-28T22:09:56.168313] [DEBUG] [LOCAL ] COF: Derivative data saved (138 records). [2025-10-28T22:09:56.168699] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-28T22:09:56.170392] [INFO ] [MAIN ] Derivative Progress: 407/2046 symbols completed. CNX took 1.3s. Estimated remaining: 11m 7s. Rate: 147.3 symbols/min [2025-10-28T22:09:56.170567] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:56.174026] [INFO ] [MAIN ] Derivative Progress: 408/2046 symbols completed. COF took 1.3s. Estimated remaining: 11m 5s. Rate: 147.7 symbols/min [2025-10-28T22:09:56.174717] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:56.202135] [DEBUG] [LOCAL ] COOK: Loaded 24632 existing records from primary storage. [2025-10-28T22:09:56.217158] [INFO ] [MAIN ] COOK: Loaded 24632 primary data records. [2025-10-28T22:09:56.387275] [DEBUG] [LOCAL ] COMP: Loaded 53398 existing records from primary storage. [2025-10-28T22:09:56.389431] [INFO ] [MAIN ] COMP: Loaded 53398 primary data records. [2025-10-28T22:09:56.400800] [DEBUG] [LOCAL ] COHR: Loaded 53375 existing records from primary storage. [2025-10-28T22:09:56.411481] [INFO ] [MAIN ] COHR: Loaded 53375 primary data records. [2025-10-28T22:09:57.209135] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:57.244164] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:57.284608] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:57.315623] [INFO ] [MAIN ] COOK: Generated 138 derivative records from 24632 primary records. [2025-10-28T22:09:57.316019] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-28T22:09:57.335502] [DEBUG] [LOCAL ] COOK: Derivative data saved (138 records). [2025-10-28T22:09:57.336520] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-28T22:09:57.341149] [INFO ] [MAIN ] Derivative Progress: 409/2046 symbols completed. COOK took 1.2s. Estimated remaining: 11m 8s. Rate: 147.0 symbols/min [2025-10-28T22:09:57.341819] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:57.351839] [INFO ] [MAIN ] COMP: Generated 138 derivative records from 53398 primary records. [2025-10-28T22:09:57.353557] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-28T22:09:57.369522] [DEBUG] [LOCAL ] COMP: Derivative data saved (138 records). [2025-10-28T22:09:57.370121] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-28T22:09:57.374408] [INFO ] [MAIN ] COHR: Generated 138 derivative records from 53375 primary records. [2025-10-28T22:09:57.372839] [INFO ] [MAIN ] Derivative Progress: 410/2046 symbols completed. COMP took 1.2s. Estimated remaining: 11m 6s. Rate: 147.3 symbols/min [2025-10-28T22:09:57.374876] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:57.374770] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-28T22:09:57.400904] [DEBUG] [LOCAL ] COHR: Derivative data saved (138 records). [2025-10-28T22:09:57.400985] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-28T22:09:57.403525] [INFO ] [MAIN ] Derivative Progress: 411/2046 symbols completed. COHR took 1.2s. Estimated remaining: 11m 4s. Rate: 147.7 symbols/min [2025-10-28T22:09:57.403774] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:57.434458] [DEBUG] [LOCAL ] COTY: Loaded 53246 existing records from primary storage. [2025-10-28T22:09:57.434978] [INFO ] [MAIN ] COTY: Loaded 53246 primary data records. [2025-10-28T22:09:57.440580] [DEBUG] [LOCAL ] CPF: Loaded 14819 existing records from primary storage. [2025-10-28T22:09:57.461436] [INFO ] [MAIN ] CPF: Loaded 14819 primary data records. [2025-10-28T22:09:57.590082] [DEBUG] [LOCAL ] CPAY: Loaded 29462 existing records from primary storage. [2025-10-28T22:09:57.626352] [INFO ] [MAIN ] CPAY: Loaded 29462 primary data records. [2025-10-28T22:09:58.394223] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:58.431112] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:58.458316] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:58.504517] [INFO ] [MAIN ] COTY: Generated 138 derivative records from 53246 primary records. [2025-10-28T22:09:58.505933] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-28T22:09:58.524663] [DEBUG] [LOCAL ] COTY: Derivative data saved (138 records). [2025-10-28T22:09:58.525044] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-28T22:09:58.528785] [INFO ] [MAIN ] Derivative Progress: 412/2046 symbols completed. COTY took 1.2s. Estimated remaining: 11m 7s. Rate: 147.0 symbols/min [2025-10-28T22:09:58.532263] [INFO ] [MAIN ] CPF: Generated 138 derivative records from 14819 primary records. [2025-10-28T22:09:58.532459] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:58.534156] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-28T22:09:58.537227] [INFO ] [MAIN ] CPAY: Generated 138 derivative records from 29462 primary records. [2025-10-28T22:09:58.537393] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-28T22:09:58.548994] [DEBUG] [LOCAL ] CPF: Derivative data saved (138 records). [2025-10-28T22:09:58.549236] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-28T22:09:58.551408] [INFO ] [MAIN ] Derivative Progress: 413/2046 symbols completed. CPF took 1.1s. Estimated remaining: 11m 5s. Rate: 147.4 symbols/min [2025-10-28T22:09:58.551594] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:58.563858] [DEBUG] [LOCAL ] CPAY: Derivative data saved (138 records). [2025-10-28T22:09:58.564041] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-28T22:09:58.566773] [INFO ] [MAIN ] Derivative Progress: 414/2046 symbols completed. CPAY took 1.2s. Estimated remaining: 11m 3s. Rate: 147.7 symbols/min [2025-10-28T22:09:58.567173] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:58.599847] [DEBUG] [LOCAL ] CPS: Loaded 24213 existing records from primary storage. [2025-10-28T22:09:58.600020] [INFO ] [MAIN ] CPS: Loaded 24213 primary data records. [2025-10-28T22:09:58.727313] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-28T22:09:58.753731] [INFO ] [MAIN ] CPNG: Loaded 53679 primary data records. [2025-10-28T22:09:59.001104] [DEBUG] [LOCAL ] CPT: Loaded 44251 existing records from primary storage. [2025-10-28T22:09:59.031412] [INFO ] [MAIN ] CPT: Loaded 44251 primary data records. [2025-10-28T22:09:59.545497] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:59.583936] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:59.621899] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:09:59.661159] [INFO ] [MAIN ] CPS: Generated 138 derivative records from 24213 primary records. [2025-10-28T22:09:59.664398] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-28T22:09:59.683318] [DEBUG] [LOCAL ] CPS: Derivative data saved (138 records). [2025-10-28T22:09:59.684192] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-28T22:09:59.686957] [INFO ] [MAIN ] Derivative Progress: 415/2046 symbols completed. CPS took 1.1s. Estimated remaining: 11m 5s. Rate: 147.1 symbols/min [2025-10-28T22:09:59.691157] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:59.698819] [INFO ] [MAIN ] CPT: Generated 138 derivative records from 44251 primary records. [2025-10-28T22:09:59.699116] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-28T22:09:59.700750] [INFO ] [MAIN ] CPNG: Generated 138 derivative records from 53679 primary records. [2025-10-28T22:09:59.701196] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-28T22:09:59.729349] [DEBUG] [LOCAL ] CPT: Derivative data saved (138 records). [2025-10-28T22:09:59.728279] [DEBUG] [LOCAL ] CPNG: Derivative data saved (138 records). [2025-10-28T22:09:59.735181] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-28T22:09:59.738630] [INFO ] [MAIN ] Derivative Progress: 416/2046 symbols completed. CPT took 1.2s. Estimated remaining: 11m 3s. Rate: 147.4 symbols/min [2025-10-28T22:09:59.738827] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-28T22:09:59.741923] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:59.741743] [DEBUG] [LOCAL ] CQP: Loaded 18615 existing records from primary storage. [2025-10-28T22:09:59.742109] [INFO ] [MAIN ] Derivative Progress: 417/2046 symbols completed. CPNG took 1.2s. Estimated remaining: 11m 1s. Rate: 147.8 symbols/min [2025-10-28T22:09:59.742798] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:09:59.742513] [INFO ] [MAIN ] CQP: Loaded 18615 primary data records. [2025-10-28T22:09:59.845586] [DEBUG] [LOCAL ] CRBD: Loaded 8602 existing records from primary storage. [2025-10-28T22:09:59.860759] [INFO ] [MAIN ] CRBD: Loaded 8602 primary data records. [2025-10-28T22:10:00.004004] [DEBUG] [LOCAL ] CR: Loaded 23923 existing records from primary storage. [2025-10-28T22:10:00.014964] [INFO ] [MAIN ] CR: Loaded 23923 primary data records. [2025-10-28T22:10:00.755267] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:00.783751] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:00.831912] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:00.876991] [INFO ] [MAIN ] CRBD: Generated 138 derivative records from 8602 primary records. [2025-10-28T22:10:00.882164] [INFO ] [MAIN ] CQP: Generated 138 derivative records from 18615 primary records. [2025-10-28T22:10:00.882009] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-28T22:10:00.882264] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-28T22:10:00.895755] [DEBUG] [LOCAL ] CRBD: Derivative data saved (138 records). [2025-10-28T22:10:00.902864] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-28T22:10:00.905525] [INFO ] [MAIN ] Derivative Progress: 418/2046 symbols completed. CRBD took 1.2s. Estimated remaining: 11m 4s. Rate: 147.1 symbols/min [2025-10-28T22:10:00.912980] [DEBUG] [LOCAL ] CQP: Derivative data saved (138 records). [2025-10-28T22:10:00.913071] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-28T22:10:00.915252] [INFO ] [MAIN ] Derivative Progress: 419/2046 symbols completed. CQP took 1.2s. Estimated remaining: 11m 2s. Rate: 147.4 symbols/min [2025-10-28T22:10:00.920245] [INFO ] [MAIN ] CR: Generated 138 derivative records from 23923 primary records. [2025-10-28T22:10:00.920397] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-28T22:10:00.932189] [DEBUG] [LOCAL ] CR: Derivative data saved (138 records). [2025-10-28T22:10:00.932244] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-28T22:10:00.934700] [INFO ] [MAIN ] Derivative Progress: 420/2046 symbols completed. CR took 1.2s. Estimated remaining: 11m 0s. Rate: 147.8 symbols/min [2025-10-28T22:10:00.935349] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:00.935752] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:00.935977] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:00.974695] [DEBUG] [LOCAL ] CRC: Loaded 43708 existing records from primary storage. [2025-10-28T22:10:00.998936] [INFO ] [MAIN ] CRC: Loaded 43708 primary data records. [2025-10-28T22:10:01.153447] [DEBUG] [LOCAL ] CRGY: Loaded 52484 existing records from primary storage. [2025-10-28T22:10:01.160082] [DEBUG] [LOCAL ] CRBG: Loaded 52565 existing records from primary storage. [2025-10-28T22:10:01.175847] [INFO ] [MAIN ] CRGY: Loaded 52484 primary data records. [2025-10-28T22:10:01.187295] [INFO ] [MAIN ] CRBG: Loaded 52565 primary data records. [2025-10-28T22:10:01.916256] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:02.396425] [INFO ] [MAIN ] CRC: Generated 138 derivative records from 43708 primary records. [2025-10-28T22:10:02.397937] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-28T22:10:02.414709] [DEBUG] [LOCAL ] CRC: Derivative data saved (138 records). [2025-10-28T22:10:02.430721] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-28T22:10:02.434303] [INFO ] [MAIN ] Derivative Progress: 421/2046 symbols completed. CRC took 1.5s. Estimated remaining: 11m 4s. Rate: 146.8 symbols/min [2025-10-28T22:10:02.434848] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:02.436004] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:02.474809] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:02.553942] [INFO ] [MAIN ] CRGY: Generated 138 derivative records from 52484 primary records. [2025-10-28T22:10:02.560768] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-28T22:10:02.598732] [INFO ] [MAIN ] CRBG: Generated 138 derivative records from 52565 primary records. [2025-10-28T22:10:02.598312] [DEBUG] [LOCAL ] CRH: Loaded 53383 existing records from primary storage. [2025-10-28T22:10:02.602798] [INFO ] [MAIN ] CRH: Loaded 53383 primary data records. [2025-10-28T22:10:02.603549] [DEBUG] [LOCAL ] CRGY: Derivative data saved (138 records). [2025-10-28T22:10:02.602925] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-28T22:10:02.603960] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-28T22:10:02.629069] [INFO ] [MAIN ] Derivative Progress: 422/2046 symbols completed. CRGY took 1.7s. Estimated remaining: 11m 3s. Rate: 147.0 symbols/min [2025-10-28T22:10:02.678893] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:02.760210] [DEBUG] [LOCAL ] CRBG: Derivative data saved (138 records). [2025-10-28T22:10:02.791190] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-28T22:10:02.819114] [INFO ] [MAIN ] Derivative Progress: 423/2046 symbols completed. CRBG took 1.9s. Estimated remaining: 11m 1s. Rate: 147.2 symbols/min [2025-10-28T22:10:02.946231] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:02.992802] [DEBUG] [LOCAL ] CRI: Loaded 49467 existing records from primary storage. [2025-10-28T22:10:02.993611] [INFO ] [MAIN ] CRI: Loaded 49467 primary data records. [2025-10-28T22:10:03.109315] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:03.160949] [DEBUG] [LOCAL ] CRL: Loaded 42469 existing records from primary storage. [2025-10-28T22:10:03.186924] [INFO ] [MAIN ] CRL: Loaded 42469 primary data records. [2025-10-28T22:10:03.690196] [INFO ] [MAIN ] CRH: Generated 138 derivative records from 53383 primary records. [2025-10-28T22:10:03.690844] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-28T22:10:03.719230] [DEBUG] [LOCAL ] CRH: Derivative data saved (138 records). [2025-10-28T22:10:03.719666] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-28T22:10:03.719533] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:03.721526] [INFO ] [MAIN ] Derivative Progress: 424/2046 symbols completed. CRH took 1.3s. Estimated remaining: 11m 3s. Rate: 146.8 symbols/min [2025-10-28T22:10:03.721836] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:03.765329] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:03.803251] [INFO ] [MAIN ] CRI: Generated 138 derivative records from 49467 primary records. [2025-10-28T22:10:03.805069] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-28T22:10:03.822689] [DEBUG] [LOCAL ] CRI: Derivative data saved (138 records). [2025-10-28T22:10:03.823591] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-28T22:10:03.827538] [INFO ] [MAIN ] Derivative Progress: 425/2046 symbols completed. CRI took 1.1s. Estimated remaining: 11m 1s. Rate: 147.0 symbols/min [2025-10-28T22:10:03.830400] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:03.851399] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-28T22:10:03.851814] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-28T22:10:03.899811] [INFO ] [MAIN ] CRL: Generated 138 derivative records from 42469 primary records. [2025-10-28T22:10:03.912509] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-28T22:10:03.965303] [DEBUG] [LOCAL ] CRL: Derivative data saved (138 records). [2025-10-28T22:10:03.976512] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-28T22:10:03.979155] [INFO ] [MAIN ] Derivative Progress: 426/2046 symbols completed. CRL took 1.0s. Estimated remaining: 11m 0s. Rate: 147.3 symbols/min [2025-10-28T22:10:04.004689] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:04.193071] [DEBUG] [LOCAL ] CRS: Loaded 43073 existing records from primary storage. [2025-10-28T22:10:04.193343] [INFO ] [MAIN ] CRS: Loaded 43073 primary data records. [2025-10-28T22:10:04.218680] [DEBUG] [LOCAL ] CRT: Loaded 4820 existing records from primary storage. [2025-10-28T22:10:04.242329] [INFO ] [MAIN ] CRT: Loaded 4820 primary data records. [2025-10-28T22:10:04.870003] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:04.938965] [INFO ] [MAIN ] CRM: Generated 138 derivative records from 53770 primary records. [2025-10-28T22:10:04.951277] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:04.967289] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:04.951529] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-28T22:10:04.996976] [DEBUG] [LOCAL ] CRM: Derivative data saved (138 records). [2025-10-28T22:10:04.999203] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-28T22:10:05.001948] [INFO ] [MAIN ] Derivative Progress: 427/2046 symbols completed. CRM took 1.3s. Estimated remaining: 11m 2s. Rate: 146.7 symbols/min [2025-10-28T22:10:05.002384] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:05.053537] [INFO ] [MAIN ] CRT: Generated 138 derivative records from 4820 primary records. [2025-10-28T22:10:05.054669] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-28T22:10:05.079348] [DEBUG] [LOCAL ] CRT: Derivative data saved (138 records). [2025-10-28T22:10:05.080454] [DEBUG] [LOCAL ] CSAN: Loaded 41980 existing records from primary storage. [2025-10-28T22:10:05.082582] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-28T22:10:05.085049] [INFO ] [MAIN ] Derivative Progress: 428/2046 symbols completed. CRT took 1.1s. Estimated remaining: 11m 0s. Rate: 147.0 symbols/min [2025-10-28T22:10:05.085198] [INFO ] [MAIN ] CSAN: Loaded 41980 primary data records. [2025-10-28T22:10:05.082763] [INFO ] [MAIN ] CRS: Generated 138 derivative records from 43073 primary records. [2025-10-28T22:10:05.085341] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-28T22:10:05.085457] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:05.197402] [DEBUG] [LOCAL ] CRS: Derivative data saved (138 records). [2025-10-28T22:10:05.209813] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-28T22:10:05.223374] [INFO ] [MAIN ] Derivative Progress: 429/2046 symbols completed. CRS took 1.4s. Estimated remaining: 10m 59s. Rate: 147.2 symbols/min [2025-10-28T22:10:05.233839] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:05.429887] [DEBUG] [LOCAL ] CSV: Loaded 11936 existing records from primary storage. [2025-10-28T22:10:05.430092] [INFO ] [MAIN ] CSV: Loaded 11936 primary data records. [2025-10-28T22:10:05.573536] [DEBUG] [LOCAL ] CSTM: Loaded 47316 existing records from primary storage. [2025-10-28T22:10:05.600181] [INFO ] [MAIN ] CSTM: Loaded 47316 primary data records. [2025-10-28T22:10:06.058842] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:06.098483] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:06.147506] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:06.184088] [INFO ] [MAIN ] CSAN: Generated 138 derivative records from 41980 primary records. [2025-10-28T22:10:06.187579] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-28T22:10:06.203791] [INFO ] [MAIN ] CSV: Generated 138 derivative records from 11936 primary records. [2025-10-28T22:10:06.207592] [DEBUG] [LOCAL ] CSAN: Derivative data saved (138 records). [2025-10-28T22:10:06.207775] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-28T22:10:06.207724] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-28T22:10:06.211122] [INFO ] [MAIN ] Derivative Progress: 430/2046 symbols completed. CSAN took 1.2s. Estimated remaining: 11m 1s. Rate: 146.8 symbols/min [2025-10-28T22:10:06.212582] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:06.228123] [DEBUG] [LOCAL ] CSV: Derivative data saved (138 records). [2025-10-28T22:10:06.228333] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-28T22:10:06.230833] [INFO ] [MAIN ] Derivative Progress: 431/2046 symbols completed. CSV took 1.0s. Estimated remaining: 10m 59s. Rate: 147.1 symbols/min [2025-10-28T22:10:06.232622] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:06.238202] [DEBUG] [LOCAL ] CTBB: Loaded 6178 existing records from primary storage. [2025-10-28T22:10:06.241836] [INFO ] [MAIN ] CTBB: Loaded 6178 primary data records. [2025-10-28T22:10:06.241746] [INFO ] [MAIN ] CSTM: Generated 138 derivative records from 47316 primary records. [2025-10-28T22:10:06.262542] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-28T22:10:06.299065] [DEBUG] [LOCAL ] CTDD: Loaded 4993 existing records from primary storage. [2025-10-28T22:10:06.337868] [INFO ] [MAIN ] CTDD: Loaded 4993 primary data records. [2025-10-28T22:10:06.417239] [DEBUG] [LOCAL ] CSTM: Derivative data saved (138 records). [2025-10-28T22:10:06.454039] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-28T22:10:06.486064] [INFO ] [MAIN ] Derivative Progress: 432/2046 symbols completed. CSTM took 1.4s. Estimated remaining: 10m 58s. Rate: 147.2 symbols/min [2025-10-28T22:10:06.641198] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:06.905401] [DEBUG] [LOCAL ] CTO: Loaded 27014 existing records from primary storage. [2025-10-28T22:10:06.905810] [INFO ] [MAIN ] CTO: Loaded 27014 primary data records. [2025-10-28T22:10:06.995055] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:07.256054] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:07.304606] [INFO ] [MAIN ] CTBB: Generated 138 derivative records from 6178 primary records. [2025-10-28T22:10:07.307270] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-28T22:10:07.336369] [DEBUG] [LOCAL ] CTBB: Derivative data saved (138 records). [2025-10-28T22:10:07.336718] [INFO ] [MAIN ] CTDD: Generated 138 derivative records from 4993 primary records. [2025-10-28T22:10:07.337125] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-28T22:10:07.336968] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-28T22:10:07.339859] [INFO ] [MAIN ] Derivative Progress: 433/2046 symbols completed. CTBB took 1.1s. Estimated remaining: 10m 59s. Rate: 146.8 symbols/min [2025-10-28T22:10:07.337709] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:07.363714] [DEBUG] [LOCAL ] CTDD: Derivative data saved (138 records). [2025-10-28T22:10:07.364806] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-28T22:10:07.367688] [INFO ] [MAIN ] Derivative Progress: 434/2046 symbols completed. CTDD took 1.1s. Estimated remaining: 10m 57s. Rate: 147.2 symbols/min [2025-10-28T22:10:07.380048] [INFO ] [MAIN ] CTO: Generated 138 derivative records from 27014 primary records. [2025-10-28T22:10:07.380123] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-28T22:10:07.391679] [DEBUG] [LOCAL ] CTO: Derivative data saved (138 records). [2025-10-28T22:10:07.391758] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-28T22:10:07.393978] [INFO ] [MAIN ] Derivative Progress: 435/2046 symbols completed. CTO took 0.8s. Estimated remaining: 10m 55s. Rate: 147.5 symbols/min [2025-10-28T22:10:07.394396] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:07.394464] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:07.394333] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:07.443757] [DEBUG] [LOCAL ] CTRE: Loaded 49394 existing records from primary storage. [2025-10-28T22:10:07.443942] [INFO ] [MAIN ] CTRE: Loaded 49394 primary data records. [2025-10-28T22:10:07.572434] [DEBUG] [LOCAL ] CTOS: Loaded 37111 existing records from primary storage. [2025-10-28T22:10:07.644849] [INFO ] [MAIN ] CTOS: Loaded 37111 primary data records. [2025-10-28T22:10:07.644742] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-28T22:10:07.808366] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-28T22:10:08.386003] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:08.434225] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:08.457885] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:08.492178] [INFO ] [MAIN ] CTRE: Generated 138 derivative records from 49394 primary records. [2025-10-28T22:10:08.492595] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-28T22:10:08.509204] [DEBUG] [LOCAL ] CTRE: Derivative data saved (138 records). [2025-10-28T22:10:08.509360] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-28T22:10:08.512810] [INFO ] [MAIN ] Derivative Progress: 436/2046 symbols completed. CTRE took 1.1s. Estimated remaining: 10m 58s. Rate: 146.9 symbols/min [2025-10-28T22:10:08.515545] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:08.536109] [INFO ] [MAIN ] CTRA: Generated 138 derivative records from 53647 primary records. [2025-10-28T22:10:08.537455] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-28T22:10:08.540207] [INFO ] [MAIN ] CTOS: Generated 138 derivative records from 37111 primary records. [2025-10-28T22:10:08.549218] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-28T22:10:08.561499] [DEBUG] [LOCAL ] CTRA: Derivative data saved (138 records). [2025-10-28T22:10:08.569741] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-28T22:10:08.576967] [INFO ] [MAIN ] Derivative Progress: 437/2046 symbols completed. CTRA took 1.2s. Estimated remaining: 10m 56s. Rate: 147.2 symbols/min [2025-10-28T22:10:08.577122] [DEBUG] [LOCAL ] CTOS: Derivative data saved (138 records). [2025-10-28T22:10:08.577561] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:08.589087] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-28T22:10:08.591816] [INFO ] [MAIN ] Derivative Progress: 438/2046 symbols completed. CTOS took 1.2s. Estimated remaining: 10m 54s. Rate: 147.5 symbols/min [2025-10-28T22:10:08.592006] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:08.593135] [DEBUG] [LOCAL ] CTRI: Loaded 41153 existing records from primary storage. [2025-10-28T22:10:08.593427] [INFO ] [MAIN ] CTRI: Loaded 41153 primary data records. [2025-10-28T22:10:08.746317] [DEBUG] [LOCAL ] CTS: Loaded 19303 existing records from primary storage. [2025-10-28T22:10:08.778416] [INFO ] [MAIN ] CTS: Loaded 19303 primary data records. [2025-10-28T22:10:09.141001] [DEBUG] [LOCAL ] CTVA: Loaded 53299 existing records from primary storage. [2025-10-28T22:10:09.249461] [INFO ] [MAIN ] CTVA: Loaded 53299 primary data records. [2025-10-28T22:10:09.579761] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:09.628601] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:09.676957] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:09.677195] [INFO ] [MAIN ] CTRI: Generated 138 derivative records from 41153 primary records. [2025-10-28T22:10:09.680635] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-28T22:10:09.715346] [DEBUG] [LOCAL ] CTRI: Derivative data saved (138 records). [2025-10-28T22:10:09.715837] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-28T22:10:09.718034] [INFO ] [MAIN ] Derivative Progress: 439/2046 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 56s. Rate: 146.9 symbols/min [2025-10-28T22:10:09.718469] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:09.733058] [INFO ] [MAIN ] CTS: Generated 138 derivative records from 19303 primary records. [2025-10-28T22:10:09.734526] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-28T22:10:09.757476] [DEBUG] [LOCAL ] CTS: Derivative data saved (138 records). [2025-10-28T22:10:09.759286] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-28T22:10:09.761982] [INFO ] [MAIN ] Derivative Progress: 440/2046 symbols completed. CTS took 1.2s. Estimated remaining: 10m 55s. Rate: 147.2 symbols/min [2025-10-28T22:10:09.765463] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:09.777726] [DEBUG] [LOCAL ] CUBI: Loaded 26775 existing records from primary storage. [2025-10-28T22:10:09.780495] [INFO ] [MAIN ] CTVA: Generated 138 derivative records from 53299 primary records. [2025-10-28T22:10:09.780698] [INFO ] [MAIN ] CUBI: Loaded 26775 primary data records. [2025-10-28T22:10:09.780799] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-28T22:10:09.877679] [DEBUG] [LOCAL ] CTVA: Derivative data saved (138 records). [2025-10-28T22:10:09.900727] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-28T22:10:09.903835] [INFO ] [MAIN ] Derivative Progress: 441/2046 symbols completed. CTVA took 1.3s. Estimated remaining: 10m 53s. Rate: 147.4 symbols/min [2025-10-28T22:10:09.914566] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:10.114079] [DEBUG] [LOCAL ] CULP: Loaded 2753 existing records from primary storage. [2025-10-28T22:10:10.115027] [INFO ] [MAIN ] CULP: Loaded 2753 primary data records. [2025-10-28T22:10:10.226088] [DEBUG] [LOCAL ] CUK: Loaded 51034 existing records from primary storage. [2025-10-28T22:10:10.246541] [INFO ] [MAIN ] CUK: Loaded 51034 primary data records. [2025-10-28T22:10:10.812179] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:10.861565] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:10.897388] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:10.930344] [INFO ] [MAIN ] CUBI: Generated 138 derivative records from 26775 primary records. [2025-10-28T22:10:10.934925] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-28T22:10:10.956607] [DEBUG] [LOCAL ] CUBI: Derivative data saved (138 records). [2025-10-28T22:10:10.957152] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-28T22:10:10.962136] [INFO ] [MAIN ] Derivative Progress: 442/2046 symbols completed. CUBI took 1.2s. Estimated remaining: 10m 55s. Rate: 146.9 symbols/min [2025-10-28T22:10:10.964096] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:10.968452] [INFO ] [MAIN ] CULP: Generated 138 derivative records from 2753 primary records. [2025-10-28T22:10:10.971150] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-28T22:10:10.983199] [DEBUG] [LOCAL ] CULP: Derivative data saved (138 records). [2025-10-28T22:10:10.983480] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-28T22:10:10.988880] [INFO ] [MAIN ] Derivative Progress: 443/2046 symbols completed. CULP took 1.1s. Estimated remaining: 10m 53s. Rate: 147.2 symbols/min [2025-10-28T22:10:10.989352] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:10.994963] [INFO ] [MAIN ] CUK: Generated 138 derivative records from 51034 primary records. [2025-10-28T22:10:11.003620] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-28T22:10:11.022921] [DEBUG] [LOCAL ] CUK: Derivative data saved (138 records). [2025-10-28T22:10:11.029383] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-28T22:10:11.032609] [INFO ] [MAIN ] Derivative Progress: 444/2046 symbols completed. CUK took 1.3s. Estimated remaining: 10m 52s. Rate: 147.5 symbols/min [2025-10-28T22:10:11.043002] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:11.044392] [DEBUG] [LOCAL ] CURB: Loaded 32676 existing records from primary storage. [2025-10-28T22:10:11.044680] [INFO ] [MAIN ] CURB: Loaded 32676 primary data records. [2025-10-28T22:10:11.153421] [DEBUG] [LOCAL ] CURV: Loaded 27484 existing records from primary storage. [2025-10-28T22:10:11.157256] [INFO ] [MAIN ] CURV: Loaded 27484 primary data records. [2025-10-28T22:10:11.635428] [DEBUG] [LOCAL ] CUZ: Loaded 49295 existing records from primary storage. [2025-10-28T22:10:11.690511] [INFO ] [MAIN ] CUZ: Loaded 49295 primary data records. [2025-10-28T22:10:12.023374] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:12.063318] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:12.110022] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:12.129920] [INFO ] [MAIN ] CURB: Generated 138 derivative records from 32676 primary records. [2025-10-28T22:10:12.132212] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-28T22:10:12.145124] [DEBUG] [LOCAL ] CURB: Derivative data saved (138 records). [2025-10-28T22:10:12.145222] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-28T22:10:12.149922] [INFO ] [MAIN ] Derivative Progress: 445/2046 symbols completed. CURB took 1.2s. Estimated remaining: 10m 54s. Rate: 146.9 symbols/min [2025-10-28T22:10:12.152768] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:12.165667] [INFO ] [MAIN ] CURV: Generated 138 derivative records from 27484 primary records. [2025-10-28T22:10:12.168411] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-28T22:10:12.181845] [DEBUG] [LOCAL ] CURV: Derivative data saved (138 records). [2025-10-28T22:10:12.184763] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-28T22:10:12.187347] [INFO ] [MAIN ] Derivative Progress: 446/2046 symbols completed. CURV took 1.2s. Estimated remaining: 10m 52s. Rate: 147.2 symbols/min [2025-10-28T22:10:12.187623] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:12.191336] [INFO ] [MAIN ] CUZ: Generated 138 derivative records from 49295 primary records. [2025-10-28T22:10:12.191484] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-28T22:10:12.217189] [DEBUG] [LOCAL ] CUZ: Derivative data saved (138 records). [2025-10-28T22:10:12.217466] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-28T22:10:12.219936] [INFO ] [MAIN ] Derivative Progress: 447/2046 symbols completed. CUZ took 1.2s. Estimated remaining: 10m 50s. Rate: 147.5 symbols/min [2025-10-28T22:10:12.223356] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:12.230695] [DEBUG] [LOCAL ] CVEO: Loaded 15047 existing records from primary storage. [2025-10-28T22:10:12.230830] [INFO ] [MAIN ] CVEO: Loaded 15047 primary data records. [2025-10-28T22:10:12.321421] [DEBUG] [LOCAL ] CVLG: Loaded 15144 existing records from primary storage. [2025-10-28T22:10:12.341041] [INFO ] [MAIN ] CVLG: Loaded 15144 primary data records. [2025-10-28T22:10:12.370006] [DEBUG] [LOCAL ] CVE: Loaded 53558 existing records from primary storage. [2025-10-28T22:10:12.423571] [INFO ] [MAIN ] CVE: Loaded 53558 primary data records. [2025-10-28T22:10:13.214341] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:13.248045] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:13.287054] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:13.322006] [INFO ] [MAIN ] CVEO: Generated 138 derivative records from 15047 primary records. [2025-10-28T22:10:13.323264] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-28T22:10:13.341000] [DEBUG] [LOCAL ] CVEO: Derivative data saved (138 records). [2025-10-28T22:10:13.341551] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-28T22:10:13.343891] [INFO ] [MAIN ] Derivative Progress: 448/2046 symbols completed. CVEO took 1.2s. Estimated remaining: 10m 52s. Rate: 146.9 symbols/min [2025-10-28T22:10:13.350513] [INFO ] [MAIN ] CVLG: Generated 138 derivative records from 15144 primary records. [2025-10-28T22:10:13.350766] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-28T22:10:13.363383] [INFO ] [MAIN ] CVE: Generated 138 derivative records from 53558 primary records. [2025-10-28T22:10:13.367607] [DEBUG] [LOCAL ] CVLG: Derivative data saved (138 records). [2025-10-28T22:10:13.364981] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-28T22:10:13.368094] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-28T22:10:13.370494] [INFO ] [MAIN ] Derivative Progress: 449/2046 symbols completed. CVLG took 1.1s. Estimated remaining: 10m 51s. Rate: 147.2 symbols/min [2025-10-28T22:10:13.381639] [DEBUG] [LOCAL ] CVE: Derivative data saved (138 records). [2025-10-28T22:10:13.381721] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-28T22:10:13.384211] [INFO ] [MAIN ] Derivative Progress: 450/2046 symbols completed. CVE took 1.2s. Estimated remaining: 10m 49s. Rate: 147.6 symbols/min [2025-10-28T22:10:13.384558] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:13.384611] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:13.384712] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:13.471350] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-28T22:10:13.470732] [DEBUG] [LOCAL ] CVNA: Loaded 52804 existing records from primary storage. [2025-10-28T22:10:13.471607] [INFO ] [MAIN ] CVNA: Loaded 52804 primary data records. [2025-10-28T22:10:13.484514] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-28T22:10:13.550626] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-28T22:10:13.595362] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-28T22:10:14.415624] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:14.447623] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:14.471792] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:14.530691] [INFO ] [MAIN ] CVNA: Generated 138 derivative records from 52804 primary records. [2025-10-28T22:10:14.536317] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-28T22:10:14.552377] [DEBUG] [LOCAL ] CVNA: Derivative data saved (138 records). [2025-10-28T22:10:14.552927] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-28T22:10:14.557519] [INFO ] [MAIN ] Derivative Progress: 451/2046 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 51s. Rate: 147.0 symbols/min [2025-10-28T22:10:14.555267] [INFO ] [MAIN ] CVS: Generated 138 derivative records from 53694 primary records. [2025-10-28T22:10:14.560872] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:14.561298] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-28T22:10:14.579251] [INFO ] [MAIN ] CVX: Generated 138 derivative records from 53760 primary records. [2025-10-28T22:10:14.579414] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-28T22:10:14.578958] [DEBUG] [LOCAL ] CVS: Derivative data saved (138 records). [2025-10-28T22:10:14.580349] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-28T22:10:14.582696] [INFO ] [MAIN ] Derivative Progress: 452/2046 symbols completed. CVS took 1.2s. Estimated remaining: 10m 49s. Rate: 147.3 symbols/min [2025-10-28T22:10:14.583034] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:14.603221] [DEBUG] [LOCAL ] CVX: Derivative data saved (138 records). [2025-10-28T22:10:14.603396] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-28T22:10:14.606317] [INFO ] [MAIN ] Derivative Progress: 453/2046 symbols completed. CVX took 1.2s. Estimated remaining: 10m 48s. Rate: 147.6 symbols/min [2025-10-28T22:10:14.606715] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:14.616007] [DEBUG] [LOCAL ] CW: Loaded 21599 existing records from primary storage. [2025-10-28T22:10:14.616302] [INFO ] [MAIN ] CW: Loaded 21599 primary data records. [2025-10-28T22:10:14.976084] [DEBUG] [LOCAL ] CWEN: Loaded 45068 existing records from primary storage. [2025-10-28T22:10:14.977956] [INFO ] [MAIN ] CWEN: Loaded 45068 primary data records. [2025-10-28T22:10:14.977290] [DEBUG] [LOCAL ] CWAN: Loaded 52664 existing records from primary storage. [2025-10-28T22:10:14.978056] [INFO ] [MAIN ] CWAN: Loaded 52664 primary data records. [2025-10-28T22:10:15.642330] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:15.709273] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:15.709923] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:15.742576] [INFO ] [MAIN ] CW: Generated 138 derivative records from 21599 primary records. [2025-10-28T22:10:15.745500] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-28T22:10:15.761099] [DEBUG] [LOCAL ] CW: Derivative data saved (138 records). [2025-10-28T22:10:15.761300] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-28T22:10:15.766744] [INFO ] [MAIN ] Derivative Progress: 454/2046 symbols completed. CW took 1.2s. Estimated remaining: 10m 50s. Rate: 147.0 symbols/min [2025-10-28T22:10:15.767166] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:15.790627] [INFO ] [MAIN ] CWEN: Generated 138 derivative records from 45068 primary records. [2025-10-28T22:10:15.791212] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-28T22:10:15.805196] [DEBUG] [LOCAL ] CWEN: Derivative data saved (138 records). [2025-10-28T22:10:15.805361] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-28T22:10:15.808806] [INFO ] [MAIN ] Derivative Progress: 455/2046 symbols completed. CWEN took 1.2s. Estimated remaining: 10m 48s. Rate: 147.3 symbols/min [2025-10-28T22:10:15.812218] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:15.830477] [INFO ] [MAIN ] CWAN: Generated 138 derivative records from 52664 primary records. [2025-10-28T22:10:15.830728] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-28T22:10:15.844441] [DEBUG] [LOCAL ] CWAN: Derivative data saved (138 records). [2025-10-28T22:10:15.845820] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-28T22:10:15.848595] [INFO ] [MAIN ] Derivative Progress: 456/2046 symbols completed. CWAN took 1.3s. Estimated remaining: 10m 47s. Rate: 147.5 symbols/min [2025-10-28T22:10:15.856022] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:15.873227] [DEBUG] [LOCAL ] CWH: Loaded 51203 existing records from primary storage. [2025-10-28T22:10:15.882611] [DEBUG] [LOCAL ] CWT: Loaded 27707 existing records from primary storage. [2025-10-28T22:10:15.882687] [INFO ] [MAIN ] CWH: Loaded 51203 primary data records. [2025-10-28T22:10:15.882826] [INFO ] [MAIN ] CWT: Loaded 27707 primary data records. [2025-10-28T22:10:16.518574] [DEBUG] [LOCAL ] CX: Loaded 52770 existing records from primary storage. [2025-10-28T22:10:16.519389] [INFO ] [MAIN ] CX: Loaded 52770 primary data records. [2025-10-28T22:10:16.859064] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:16.854105] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:16.923794] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:16.951749] [INFO ] [MAIN ] CWH: Generated 138 derivative records from 51203 primary records. [2025-10-28T22:10:16.954242] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-28T22:10:16.968998] [DEBUG] [LOCAL ] CWH: Derivative data saved (138 records). [2025-10-28T22:10:16.971629] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-28T22:10:16.975200] [INFO ] [MAIN ] Derivative Progress: 457/2046 symbols completed. CWH took 1.2s. Estimated remaining: 10m 49s. Rate: 147.0 symbols/min [2025-10-28T22:10:16.975448] [INFO ] [MAIN ] CWT: Generated 138 derivative records from 27707 primary records. [2025-10-28T22:10:16.975677] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:16.975558] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-28T22:10:16.993624] [DEBUG] [LOCAL ] CWT: Derivative data saved (138 records). [2025-10-28T22:10:16.994605] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-28T22:10:16.997246] [INFO ] [MAIN ] Derivative Progress: 458/2046 symbols completed. CWT took 1.2s. Estimated remaining: 10m 47s. Rate: 147.3 symbols/min [2025-10-28T22:10:16.997385] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:17.006238] [DEBUG] [LOCAL ] CXE: Loaded 6302 existing records from primary storage. [2025-10-28T22:10:17.006461] [INFO ] [MAIN ] CXE: Loaded 6302 primary data records. [2025-10-28T22:10:17.022147] [INFO ] [MAIN ] CX: Generated 138 derivative records from 52770 primary records. [2025-10-28T22:10:17.021883] [DEBUG] [LOCAL ] CXH: Loaded 4335 existing records from primary storage. [2025-10-28T22:10:17.046660] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-28T22:10:17.041469] [INFO ] [MAIN ] CXH: Loaded 4335 primary data records. [2025-10-28T22:10:17.132438] [DEBUG] [LOCAL ] CX: Derivative data saved (138 records). [2025-10-28T22:10:17.161289] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-28T22:10:17.204965] [INFO ] [MAIN ] Derivative Progress: 459/2046 symbols completed. CX took 1.3s. Estimated remaining: 10m 46s. Rate: 147.4 symbols/min [2025-10-28T22:10:17.252246] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:17.708387] [DEBUG] [LOCAL ] CXM: Loaded 47019 existing records from primary storage. [2025-10-28T22:10:17.709890] [INFO ] [MAIN ] CXM: Loaded 47019 primary data records. [2025-10-28T22:10:17.710490] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:17.831016] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:18.076337] [INFO ] [MAIN ] CXE: Generated 138 derivative records from 6302 primary records. [2025-10-28T22:10:18.077639] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-28T22:10:18.091351] [DEBUG] [LOCAL ] CXE: Derivative data saved (138 records). [2025-10-28T22:10:18.091515] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-28T22:10:18.094875] [INFO ] [MAIN ] Derivative Progress: 460/2046 symbols completed. CXE took 1.1s. Estimated remaining: 10m 47s. Rate: 147.1 symbols/min [2025-10-28T22:10:18.097095] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:18.112204] [INFO ] [MAIN ] CXH: Generated 138 derivative records from 4335 primary records. [2025-10-28T22:10:18.112902] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-28T22:10:18.113224] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:18.138933] [DEBUG] [LOCAL ] CXH: Derivative data saved (138 records). [2025-10-28T22:10:18.139189] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-28T22:10:18.142006] [INFO ] [MAIN ] Derivative Progress: 461/2046 symbols completed. CXH took 1.1s. Estimated remaining: 10m 45s. Rate: 147.3 symbols/min [2025-10-28T22:10:18.144401] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:18.175529] [DEBUG] [LOCAL ] CXT: Loaded 30366 existing records from primary storage. [2025-10-28T22:10:18.177515] [INFO ] [MAIN ] CXM: Generated 138 derivative records from 47019 primary records. [2025-10-28T22:10:18.177614] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-28T22:10:18.177378] [INFO ] [MAIN ] CXT: Loaded 30366 primary data records. [2025-10-28T22:10:18.220307] [DEBUG] [LOCAL ] CXM: Derivative data saved (138 records). [2025-10-28T22:10:18.225676] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-28T22:10:18.300802] [INFO ] [MAIN ] Derivative Progress: 462/2046 symbols completed. CXM took 1.0s. Estimated remaining: 10m 44s. Rate: 147.5 symbols/min [2025-10-28T22:10:18.305350] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:18.382936] [DEBUG] [LOCAL ] CXW: Loaded 43420 existing records from primary storage. [2025-10-28T22:10:18.388472] [INFO ] [MAIN ] CXW: Loaded 43420 primary data records. [2025-10-28T22:10:18.876396] [DEBUG] [LOCAL ] CYH: Loaded 47632 existing records from primary storage. [2025-10-28T22:10:18.876984] [INFO ] [MAIN ] CYH: Loaded 47632 primary data records. [2025-10-28T22:10:19.246326] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:19.283220] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:19.341822] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:19.359101] [INFO ] [MAIN ] CXT: Generated 138 derivative records from 30366 primary records. [2025-10-28T22:10:19.362259] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-28T22:10:19.378930] [DEBUG] [LOCAL ] CXT: Derivative data saved (138 records). [2025-10-28T22:10:19.379359] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-28T22:10:19.384535] [INFO ] [MAIN ] Derivative Progress: 463/2046 symbols completed. CXT took 1.3s. Estimated remaining: 10m 46s. Rate: 147.0 symbols/min [2025-10-28T22:10:19.391584] [INFO ] [MAIN ] CXW: Generated 138 derivative records from 43420 primary records. [2025-10-28T22:10:19.393119] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-28T22:10:19.414214] [DEBUG] [LOCAL ] CXW: Derivative data saved (138 records). [2025-10-28T22:10:19.414352] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-28T22:10:19.417973] [INFO ] [MAIN ] Derivative Progress: 464/2046 symbols completed. CXW took 1.3s. Estimated remaining: 10m 44s. Rate: 147.3 symbols/min [2025-10-28T22:10:19.419780] [INFO ] [MAIN ] CYH: Generated 138 derivative records from 47632 primary records. [2025-10-28T22:10:19.419858] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-28T22:10:19.431451] [DEBUG] [LOCAL ] CYH: Derivative data saved (138 records). [2025-10-28T22:10:19.431507] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-28T22:10:19.433911] [INFO ] [MAIN ] Derivative Progress: 465/2046 symbols completed. CYH took 1.1s. Estimated remaining: 10m 43s. Rate: 147.6 symbols/min [2025-10-28T22:10:19.434230] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:19.434326] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:19.434440] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:19.446547] [DEBUG] [LOCAL ] DAC: Loaded 11883 existing records from primary storage. [2025-10-28T22:10:19.446768] [INFO ] [MAIN ] DAC: Loaded 11883 primary data records. [2025-10-28T22:10:19.799792] [DEBUG] [LOCAL ] D: Loaded 53648 existing records from primary storage. [2025-10-28T22:10:19.801579] [INFO ] [MAIN ] D: Loaded 53648 primary data records. [2025-10-28T22:10:19.802586] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-28T22:10:19.823415] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-28T22:10:20.414745] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:20.459998] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:20.492994] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:20.510092] [INFO ] [MAIN ] DAC: Generated 138 derivative records from 11883 primary records. [2025-10-28T22:10:20.513218] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-28T22:10:20.531460] [DEBUG] [LOCAL ] DAC: Derivative data saved (138 records). [2025-10-28T22:10:20.532423] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-28T22:10:20.537171] [INFO ] [MAIN ] Derivative Progress: 466/2046 symbols completed. DAC took 1.1s. Estimated remaining: 10m 45s. Rate: 147.1 symbols/min [2025-10-28T22:10:20.537419] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:20.561551] [INFO ] [MAIN ] D: Generated 138 derivative records from 53648 primary records. [2025-10-28T22:10:20.561760] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-28T22:10:20.570273] [DEBUG] [LOCAL ] DAO: Loaded 19584 existing records from primary storage. [2025-10-28T22:10:20.570722] [INFO ] [MAIN ] DAO: Loaded 19584 primary data records. [2025-10-28T22:10:20.584075] [DEBUG] [LOCAL ] D: Derivative data saved (138 records). [2025-10-28T22:10:20.605088] [INFO ] [MAIN ] DAL: Generated 138 derivative records from 53753 primary records. [2025-10-28T22:10:20.605194] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-28T22:10:20.615421] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-28T22:10:20.641821] [INFO ] [MAIN ] Derivative Progress: 467/2046 symbols completed. D took 1.2s. Estimated remaining: 10m 43s. Rate: 147.3 symbols/min [2025-10-28T22:10:20.671259] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:20.691457] [DEBUG] [LOCAL ] DAL: Derivative data saved (138 records). [2025-10-28T22:10:20.702964] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-28T22:10:20.705347] [INFO ] [MAIN ] Derivative Progress: 468/2046 symbols completed. DAL took 1.3s. Estimated remaining: 10m 42s. Rate: 147.6 symbols/min [2025-10-28T22:10:20.705923] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:20.959274] [DEBUG] [LOCAL ] DAVA: Loaded 41936 existing records from primary storage. [2025-10-28T22:10:20.959782] [INFO ] [MAIN ] DAVA: Loaded 41936 primary data records. [2025-10-28T22:10:20.960378] [DEBUG] [LOCAL ] DAR: Loaded 51973 existing records from primary storage. [2025-10-28T22:10:20.960572] [INFO ] [MAIN ] DAR: Loaded 51973 primary data records. [2025-10-28T22:10:21.189666] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:21.668877] [INFO ] [MAIN ] DAO: Generated 138 derivative records from 19584 primary records. [2025-10-28T22:10:21.669855] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-28T22:10:21.670160] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:21.709504] [DEBUG] [LOCAL ] DAO: Derivative data saved (138 records). [2025-10-28T22:10:21.710075] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:21.720859] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-28T22:10:21.722848] [INFO ] [MAIN ] Derivative Progress: 469/2046 symbols completed. DAO took 1.2s. Estimated remaining: 10m 43s. Rate: 147.1 symbols/min [2025-10-28T22:10:21.726057] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:21.777712] [INFO ] [MAIN ] DAR: Generated 138 derivative records from 51973 primary records. [2025-10-28T22:10:21.781323] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-28T22:10:21.782134] [INFO ] [MAIN ] DAVA: Generated 138 derivative records from 41936 primary records. [2025-10-28T22:10:21.782560] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-28T22:10:21.807575] [DEBUG] [LOCAL ] DAR: Derivative data saved (138 records). [2025-10-28T22:10:21.808807] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-28T22:10:21.823128] [DEBUG] [LOCAL ] DAVA: Derivative data saved (138 records). [2025-10-28T22:10:21.818551] [INFO ] [MAIN ] Derivative Progress: 470/2046 symbols completed. DAR took 1.1s. Estimated remaining: 10m 42s. Rate: 147.3 symbols/min [2025-10-28T22:10:21.824107] [DEBUG] [LOCAL ] DAY: Loaded 49049 existing records from primary storage. [2025-10-28T22:10:21.824385] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-28T22:10:21.824329] [INFO ] [MAIN ] DAY: Loaded 49049 primary data records. [2025-10-28T22:10:21.827324] [INFO ] [MAIN ] Derivative Progress: 471/2046 symbols completed. DAVA took 1.1s. Estimated remaining: 10m 40s. Rate: 147.6 symbols/min [2025-10-28T22:10:21.838763] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:21.827189] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:22.154105] [DEBUG] [LOCAL ] DBI: Loaded 42870 existing records from primary storage. [2025-10-28T22:10:22.155179] [INFO ] [MAIN ] DBI: Loaded 42870 primary data records. [2025-10-28T22:10:22.273214] [DEBUG] [LOCAL ] DB: Loaded 52388 existing records from primary storage. [2025-10-28T22:10:22.284296] [INFO ] [MAIN ] DB: Loaded 52388 primary data records. [2025-10-28T22:10:22.760958] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:22.813454] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:22.851884] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:22.872211] [INFO ] [MAIN ] DAY: Generated 138 derivative records from 49049 primary records. [2025-10-28T22:10:22.874680] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-28T22:10:22.893150] [DEBUG] [LOCAL ] DAY: Derivative data saved (138 records). [2025-10-28T22:10:22.897240] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-28T22:10:22.899401] [INFO ] [MAIN ] Derivative Progress: 472/2046 symbols completed. DAY took 1.2s. Estimated remaining: 10m 42s. Rate: 147.1 symbols/min [2025-10-28T22:10:22.904545] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:22.924759] [INFO ] [MAIN ] DBI: Generated 138 derivative records from 42870 primary records. [2025-10-28T22:10:22.924912] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-28T22:10:22.924103] [DEBUG] [LOCAL ] DBL: Loaded 9211 existing records from primary storage. [2025-10-28T22:10:22.925671] [INFO ] [MAIN ] DBL: Loaded 9211 primary data records. [2025-10-28T22:10:22.969894] [DEBUG] [LOCAL ] DBI: Derivative data saved (138 records). [2025-10-28T22:10:22.982669] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-28T22:10:23.012708] [INFO ] [MAIN ] DB: Generated 138 derivative records from 52388 primary records. [2025-10-28T22:10:23.007328] [INFO ] [MAIN ] Derivative Progress: 473/2046 symbols completed. DBI took 1.2s. Estimated remaining: 10m 40s. Rate: 147.4 symbols/min [2025-10-28T22:10:23.043660] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-28T22:10:23.043772] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:23.081697] [DEBUG] [LOCAL ] DB: Derivative data saved (138 records). [2025-10-28T22:10:23.099526] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-28T22:10:23.135995] [INFO ] [MAIN ] Derivative Progress: 474/2046 symbols completed. DB took 1.3s. Estimated remaining: 10m 39s. Rate: 147.6 symbols/min [2025-10-28T22:10:23.137552] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:23.330104] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:23.360055] [DEBUG] [LOCAL ] DBRG: Loaded 49956 existing records from primary storage. [2025-10-28T22:10:23.362191] [INFO ] [MAIN ] DBRG: Loaded 49956 primary data records. [2025-10-28T22:10:23.452506] [DEBUG] [LOCAL ] DD: Loaded 52906 existing records from primary storage. [2025-10-28T22:10:23.479715] [INFO ] [MAIN ] DD: Loaded 52906 primary data records. [2025-10-28T22:10:23.910598] [INFO ] [MAIN ] DBL: Generated 138 derivative records from 9211 primary records. [2025-10-28T22:10:24.052771] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-28T22:10:24.067419] [DEBUG] [LOCAL ] DBL: Derivative data saved (138 records). [2025-10-28T22:10:24.067700] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-28T22:10:24.070416] [INFO ] [MAIN ] Derivative Progress: 475/2046 symbols completed. DBL took 1.2s. Estimated remaining: 10m 40s. Rate: 147.2 symbols/min [2025-10-28T22:10:24.071038] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:24.090458] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:24.156820] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:24.191331] [DEBUG] [LOCAL ] DDD: Loaded 50922 existing records from primary storage. [2025-10-28T22:10:24.193762] [INFO ] [MAIN ] DBRG: Generated 138 derivative records from 49956 primary records. [2025-10-28T22:10:24.194059] [INFO ] [MAIN ] DDD: Loaded 50922 primary data records. [2025-10-28T22:10:24.194219] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-28T22:10:24.282866] [DEBUG] [LOCAL ] DBRG: Derivative data saved (138 records). [2025-10-28T22:10:24.314508] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-28T22:10:24.328349] [INFO ] [MAIN ] Derivative Progress: 476/2046 symbols completed. DBRG took 1.3s. Estimated remaining: 10m 40s. Rate: 147.3 symbols/min [2025-10-28T22:10:24.328752] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:24.553925] [INFO ] [MAIN ] DD: Generated 138 derivative records from 52906 primary records. [2025-10-28T22:10:24.564305] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-28T22:10:24.565869] [DEBUG] [LOCAL ] DDL: Loaded 37084 existing records from primary storage. [2025-10-28T22:10:24.574686] [INFO ] [MAIN ] DDL: Loaded 37084 primary data records. [2025-10-28T22:10:24.588639] [DEBUG] [LOCAL ] DD: Derivative data saved (138 records). [2025-10-28T22:10:24.588891] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-28T22:10:24.600873] [INFO ] [MAIN ] Derivative Progress: 477/2046 symbols completed. DD took 1.5s. Estimated remaining: 10m 39s. Rate: 147.4 symbols/min [2025-10-28T22:10:24.601188] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:24.753458] [DEBUG] [LOCAL ] DDS: Loaded 11887 existing records from primary storage. [2025-10-28T22:10:24.778811] [INFO ] [MAIN ] DDS: Loaded 11887 primary data records. [2025-10-28T22:10:24.918601] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:25.324599] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:25.345001] [INFO ] [MAIN ] DDD: Generated 138 derivative records from 50922 primary records. [2025-10-28T22:10:25.347549] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-28T22:10:25.367482] [DEBUG] [LOCAL ] DDD: Derivative data saved (138 records). [2025-10-28T22:10:25.383737] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:25.383236] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-28T22:10:25.386963] [INFO ] [MAIN ] Derivative Progress: 478/2046 symbols completed. DDD took 1.3s. Estimated remaining: 10m 40s. Rate: 147.1 symbols/min [2025-10-28T22:10:25.420741] [INFO ] [MAIN ] DDL: Generated 138 derivative records from 37084 primary records. [2025-10-28T22:10:25.422063] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-28T22:10:25.442865] [DEBUG] [LOCAL ] DDL: Derivative data saved (138 records). [2025-10-28T22:10:25.442253] [INFO ] [MAIN ] DDS: Generated 138 derivative records from 11887 primary records. [2025-10-28T22:10:25.442981] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-28T22:10:25.443038] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-28T22:10:25.445242] [INFO ] [MAIN ] Derivative Progress: 479/2046 symbols completed. DDL took 1.1s. Estimated remaining: 10m 38s. Rate: 147.4 symbols/min [2025-10-28T22:10:25.457001] [DEBUG] [LOCAL ] DDS: Derivative data saved (138 records). [2025-10-28T22:10:25.457060] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-28T22:10:25.459133] [INFO ] [MAIN ] Derivative Progress: 480/2046 symbols completed. DDS took 0.9s. Estimated remaining: 10m 36s. Rate: 147.7 symbols/min [2025-10-28T22:10:25.459472] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:25.459760] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:25.459614] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:25.464837] [DEBUG] [LOCAL ] DDT: Loaded 1781 existing records from primary storage. [2025-10-28T22:10:25.464998] [INFO ] [MAIN ] DDT: Loaded 1781 primary data records. [2025-10-28T22:10:25.797489] [DEBUG] [LOCAL ] DEA: Loaded 39679 existing records from primary storage. [2025-10-28T22:10:25.797752] [INFO ] [MAIN ] DEA: Loaded 39679 primary data records. [2025-10-28T22:10:25.928777] [DEBUG] [LOCAL ] DE: Loaded 47337 existing records from primary storage. [2025-10-28T22:10:25.933280] [INFO ] [MAIN ] DE: Loaded 47337 primary data records. [2025-10-28T22:10:26.497975] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:26.560859] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:26.598999] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:26.601964] [INFO ] [MAIN ] DDT: Generated 138 derivative records from 1781 primary records. [2025-10-28T22:10:26.618383] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-28T22:10:26.636427] [DEBUG] [LOCAL ] DDT: Derivative data saved (138 records). [2025-10-28T22:10:26.636806] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-28T22:10:26.645116] [INFO ] [MAIN ] Derivative Progress: 481/2046 symbols completed. DDT took 1.2s. Estimated remaining: 10m 38s. Rate: 147.1 symbols/min [2025-10-28T22:10:26.646445] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:26.670684] [INFO ] [MAIN ] DEA: Generated 138 derivative records from 39679 primary records. [2025-10-28T22:10:26.671188] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-28T22:10:26.691370] [DEBUG] [LOCAL ] DEA: Derivative data saved (138 records). [2025-10-28T22:10:26.691638] [INFO ] [MAIN ] DE: Generated 138 derivative records from 47337 primary records. [2025-10-28T22:10:26.691923] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-28T22:10:26.694082] [INFO ] [MAIN ] Derivative Progress: 482/2046 symbols completed. DEA took 1.2s. Estimated remaining: 10m 37s. Rate: 147.3 symbols/min [2025-10-28T22:10:26.694303] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:26.694576] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-28T22:10:26.721528] [DEBUG] [LOCAL ] DE: Derivative data saved (138 records). [2025-10-28T22:10:26.721790] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-28T22:10:26.724156] [INFO ] [MAIN ] Derivative Progress: 483/2046 symbols completed. DE took 1.3s. Estimated remaining: 10m 35s. Rate: 147.6 symbols/min [2025-10-28T22:10:26.724521] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:26.745064] [DEBUG] [LOCAL ] DECK: Loaded 53302 existing records from primary storage. [2025-10-28T22:10:26.745414] [INFO ] [MAIN ] DECK: Loaded 53302 primary data records. [2025-10-28T22:10:26.935187] [DEBUG] [LOCAL ] DEI: Loaded 48147 existing records from primary storage. [2025-10-28T22:10:26.944690] [INFO ] [MAIN ] DEI: Loaded 48147 primary data records. [2025-10-28T22:10:27.171113] [DEBUG] [LOCAL ] DEO: Loaded 49131 existing records from primary storage. [2025-10-28T22:10:27.198260] [INFO ] [MAIN ] DEO: Loaded 49131 primary data records. [2025-10-28T22:10:27.770466] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:27.810997] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:27.847347] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:27.889744] [INFO ] [MAIN ] DECK: Generated 138 derivative records from 53302 primary records. [2025-10-28T22:10:27.890109] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-28T22:10:27.915092] [DEBUG] [LOCAL ] DECK: Derivative data saved (138 records). [2025-10-28T22:10:27.915552] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-28T22:10:27.920570] [INFO ] [MAIN ] Derivative Progress: 484/2046 symbols completed. DECK took 1.3s. Estimated remaining: 10m 37s. Rate: 147.0 symbols/min [2025-10-28T22:10:27.922315] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:27.925447] [INFO ] [MAIN ] DEI: Generated 138 derivative records from 48147 primary records. [2025-10-28T22:10:27.925843] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-28T22:10:27.945638] [DEBUG] [LOCAL ] DEI: Derivative data saved (138 records). [2025-10-28T22:10:27.945823] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-28T22:10:27.950287] [INFO ] [MAIN ] Derivative Progress: 485/2046 symbols completed. DEI took 1.3s. Estimated remaining: 10m 36s. Rate: 147.3 symbols/min [2025-10-28T22:10:27.950573] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:27.950811] [INFO ] [MAIN ] DEO: Generated 138 derivative records from 49131 primary records. [2025-10-28T22:10:27.951625] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-28T22:10:27.972873] [DEBUG] [LOCAL ] DEO: Derivative data saved (138 records). [2025-10-28T22:10:27.975842] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-28T22:10:27.978459] [INFO ] [MAIN ] Derivative Progress: 486/2046 symbols completed. DEO took 1.3s. Estimated remaining: 10m 34s. Rate: 147.6 symbols/min [2025-10-28T22:10:27.978808] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:27.984444] [DEBUG] [LOCAL ] DFP: Loaded 10701 existing records from primary storage. [2025-10-28T22:10:27.984699] [INFO ] [MAIN ] DFP: Loaded 10701 primary data records. [2025-10-28T22:10:28.094410] [DEBUG] [LOCAL ] DFH: Loaded 31085 existing records from primary storage. [2025-10-28T22:10:28.112718] [INFO ] [MAIN ] DFH: Loaded 31085 primary data records. [2025-10-28T22:10:28.653363] [DEBUG] [LOCAL ] DG: Loaded 53192 existing records from primary storage. [2025-10-28T22:10:28.653869] [INFO ] [MAIN ] DG: Loaded 53192 primary data records. [2025-10-28T22:10:28.982053] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:29.016332] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:29.074381] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:29.107030] [INFO ] [MAIN ] DFP: Generated 138 derivative records from 10701 primary records. [2025-10-28T22:10:29.110151] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-28T22:10:29.113997] [INFO ] [MAIN ] DFH: Generated 138 derivative records from 31085 primary records. [2025-10-28T22:10:29.114505] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-28T22:10:29.136346] [DEBUG] [LOCAL ] DFP: Derivative data saved (138 records). [2025-10-28T22:10:29.140845] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-28T22:10:29.140776] [DEBUG] [LOCAL ] DFH: Derivative data saved (138 records). [2025-10-28T22:10:29.143012] [INFO ] [MAIN ] Derivative Progress: 487/2046 symbols completed. DFP took 1.2s. Estimated remaining: 10m 36s. Rate: 147.0 symbols/min [2025-10-28T22:10:29.143153] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-28T22:10:29.143280] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:29.145859] [INFO ] [MAIN ] Derivative Progress: 488/2046 symbols completed. DFH took 1.2s. Estimated remaining: 10m 34s. Rate: 147.3 symbols/min [2025-10-28T22:10:29.146468] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:29.158523] [INFO ] [MAIN ] DG: Generated 138 derivative records from 53192 primary records. [2025-10-28T22:10:29.158751] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-28T22:10:29.171674] [DEBUG] [LOCAL ] DG: Derivative data saved (138 records). [2025-10-28T22:10:29.171891] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-28T22:10:29.174188] [INFO ] [MAIN ] Derivative Progress: 489/2046 symbols completed. DG took 1.2s. Estimated remaining: 10m 33s. Rate: 147.6 symbols/min [2025-10-28T22:10:29.174322] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:29.242154] [DEBUG] [LOCAL ] DHI: Loaded 53348 existing records from primary storage. [2025-10-28T22:10:29.253780] [INFO ] [MAIN ] DHI: Loaded 53348 primary data records. [2025-10-28T22:10:29.253698] [DEBUG] [LOCAL ] DHR: Loaded 53365 existing records from primary storage. [2025-10-28T22:10:29.253887] [INFO ] [MAIN ] DHR: Loaded 53365 primary data records. [2025-10-28T22:10:29.480455] [DEBUG] [LOCAL ] DHT: Loaded 47743 existing records from primary storage. [2025-10-28T22:10:29.543689] [INFO ] [MAIN ] DHT: Loaded 47743 primary data records. [2025-10-28T22:10:30.262765] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:30.275374] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:30.326331] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:30.373985] [INFO ] [MAIN ] DHR: Generated 138 derivative records from 53365 primary records. [2025-10-28T22:10:30.375260] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-28T22:10:30.373488] [INFO ] [MAIN ] DHI: Generated 138 derivative records from 53348 primary records. [2025-10-28T22:10:30.376081] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-28T22:10:30.397386] [DEBUG] [LOCAL ] DHR: Derivative data saved (138 records). [2025-10-28T22:10:30.399447] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-28T22:10:30.401284] [INFO ] [MAIN ] Derivative Progress: 490/2046 symbols completed. DHR took 1.3s. Estimated remaining: 10m 35s. Rate: 147.0 symbols/min [2025-10-28T22:10:30.401997] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:30.402355] [DEBUG] [LOCAL ] DHI: Derivative data saved (138 records). [2025-10-28T22:10:30.405048] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-28T22:10:30.408044] [INFO ] [MAIN ] Derivative Progress: 491/2046 symbols completed. DHI took 1.3s. Estimated remaining: 10m 33s. Rate: 147.3 symbols/min [2025-10-28T22:10:30.408255] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:30.422512] [INFO ] [MAIN ] DHT: Generated 138 derivative records from 47743 primary records. [2025-10-28T22:10:30.422720] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-28T22:10:30.444841] [DEBUG] [LOCAL ] DIAX: Loaded 12223 existing records from primary storage. [2025-10-28T22:10:30.444515] [DEBUG] [LOCAL ] DHX: Loaded 13052 existing records from primary storage. [2025-10-28T22:10:30.444911] [DEBUG] [LOCAL ] DHT: Derivative data saved (138 records). [2025-10-28T22:10:30.445225] [INFO ] [MAIN ] DIAX: Loaded 12223 primary data records. [2025-10-28T22:10:30.445139] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-28T22:10:30.445303] [INFO ] [MAIN ] DHX: Loaded 13052 primary data records. [2025-10-28T22:10:30.453017] [INFO ] [MAIN ] Derivative Progress: 492/2046 symbols completed. DHT took 1.3s. Estimated remaining: 10m 32s. Rate: 147.6 symbols/min [2025-10-28T22:10:30.459772] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:31.080026] [DEBUG] [LOCAL ] DIN: Loaded 36263 existing records from primary storage. [2025-10-28T22:10:31.080250] [INFO ] [MAIN ] DIN: Loaded 36263 primary data records. [2025-10-28T22:10:31.413915] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:31.442058] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:31.495966] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:31.535272] [INFO ] [MAIN ] DIAX: Generated 138 derivative records from 12223 primary records. [2025-10-28T22:10:31.537291] [INFO ] [MAIN ] DHX: Generated 138 derivative records from 13052 primary records. [2025-10-28T22:10:31.538590] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-28T22:10:31.539246] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-28T22:10:31.561562] [DEBUG] [LOCAL ] DIAX: Derivative data saved (138 records). [2025-10-28T22:10:31.567306] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-28T22:10:31.567413] [DEBUG] [LOCAL ] DHX: Derivative data saved (138 records). [2025-10-28T22:10:31.569470] [INFO ] [MAIN ] Derivative Progress: 493/2046 symbols completed. DIAX took 1.2s. Estimated remaining: 10m 34s. Rate: 147.1 symbols/min [2025-10-28T22:10:31.569898] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-28T22:10:31.572749] [INFO ] [MAIN ] Derivative Progress: 494/2046 symbols completed. DHX took 1.2s. Estimated remaining: 10m 32s. Rate: 147.3 symbols/min [2025-10-28T22:10:31.580188] [INFO ] [MAIN ] DIN: Generated 138 derivative records from 36263 primary records. [2025-10-28T22:10:31.580255] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-28T22:10:31.591800] [DEBUG] [LOCAL ] DIN: Derivative data saved (138 records). [2025-10-28T22:10:31.591854] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-28T22:10:31.594145] [INFO ] [MAIN ] Derivative Progress: 495/2046 symbols completed. DIN took 1.1s. Estimated remaining: 10m 30s. Rate: 147.6 symbols/min [2025-10-28T22:10:31.594664] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:31.594589] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:31.594508] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:31.611170] [DEBUG] [LOCAL ] DKL: Loaded 15947 existing records from primary storage. [2025-10-28T22:10:31.611398] [INFO ] [MAIN ] DKL: Loaded 15947 primary data records. [2025-10-28T22:10:31.959590] [DEBUG] [LOCAL ] DK: Loaded 49049 existing records from primary storage. [2025-10-28T22:10:31.969083] [INFO ] [MAIN ] DK: Loaded 49049 primary data records. [2025-10-28T22:10:32.040099] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-28T22:10:32.054740] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-28T22:10:32.608421] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:32.651426] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:32.694218] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:32.720948] [INFO ] [MAIN ] DKL: Generated 138 derivative records from 15947 primary records. [2025-10-28T22:10:32.721777] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-28T22:10:32.742730] [DEBUG] [LOCAL ] DKL: Derivative data saved (138 records). [2025-10-28T22:10:32.742959] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-28T22:10:32.745617] [INFO ] [MAIN ] Derivative Progress: 496/2046 symbols completed. DKL took 1.2s. Estimated remaining: 10m 32s. Rate: 147.1 symbols/min [2025-10-28T22:10:32.749027] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:32.765185] [INFO ] [MAIN ] DK: Generated 138 derivative records from 49049 primary records. [2025-10-28T22:10:32.767868] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-28T22:10:32.767792] [INFO ] [MAIN ] DIS: Generated 138 derivative records from 53788 primary records. [2025-10-28T22:10:32.768802] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-28T22:10:32.790834] [DEBUG] [LOCAL ] DK: Derivative data saved (138 records). [2025-10-28T22:10:32.792027] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-28T22:10:32.795343] [INFO ] [MAIN ] Derivative Progress: 497/2046 symbols completed. DK took 1.2s. Estimated remaining: 10m 31s. Rate: 147.3 symbols/min [2025-10-28T22:10:32.796224] [DEBUG] [LOCAL ] DIS: Derivative data saved (138 records). [2025-10-28T22:10:32.796463] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-28T22:10:32.799511] [INFO ] [MAIN ] Derivative Progress: 498/2046 symbols completed. DIS took 1.2s. Estimated remaining: 10m 29s. Rate: 147.6 symbols/min [2025-10-28T22:10:32.799422] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:32.799937] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:32.818078] [DEBUG] [LOCAL ] DLNG: Loaded 5867 existing records from primary storage. [2025-10-28T22:10:32.818224] [INFO ] [MAIN ] DLNG: Loaded 5867 primary data records. [2025-10-28T22:10:32.936860] [DEBUG] [LOCAL ] DKS: Loaded 48935 existing records from primary storage. [2025-10-28T22:10:32.953153] [INFO ] [MAIN ] DKS: Loaded 48935 primary data records. [2025-10-28T22:10:33.265097] [DEBUG] [LOCAL ] DLR: Loaded 50543 existing records from primary storage. [2025-10-28T22:10:33.265362] [INFO ] [MAIN ] DLR: Loaded 50543 primary data records. [2025-10-28T22:10:33.822798] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:33.857246] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:33.897413] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:33.929196] [INFO ] [MAIN ] DLNG: Generated 138 derivative records from 5867 primary records. [2025-10-28T22:10:33.930202] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-28T22:10:33.947176] [DEBUG] [LOCAL ] DLNG: Derivative data saved (138 records). [2025-10-28T22:10:33.947279] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-28T22:10:33.949442] [INFO ] [MAIN ] Derivative Progress: 499/2046 symbols completed. DLNG took 1.2s. Estimated remaining: 10m 31s. Rate: 147.1 symbols/min [2025-10-28T22:10:33.949861] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:33.958442] [INFO ] [MAIN ] DKS: Generated 138 derivative records from 48935 primary records. [2025-10-28T22:10:33.958844] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-28T22:10:33.973767] [DEBUG] [LOCAL ] DKS: Derivative data saved (138 records). [2025-10-28T22:10:33.973878] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-28T22:10:33.976528] [INFO ] [MAIN ] Derivative Progress: 500/2046 symbols completed. DKS took 1.2s. Estimated remaining: 10m 29s. Rate: 147.4 symbols/min [2025-10-28T22:10:33.984871] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:33.988759] [INFO ] [MAIN ] DLR: Generated 138 derivative records from 50543 primary records. [2025-10-28T22:10:33.988901] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-28T22:10:34.009881] [DEBUG] [LOCAL ] DMA: Loaded 4701 existing records from primary storage. [2025-10-28T22:10:34.010982] [INFO ] [MAIN ] DMA: Loaded 4701 primary data records. [2025-10-28T22:10:34.012375] [DEBUG] [LOCAL ] DLR: Derivative data saved (138 records). [2025-10-28T22:10:34.056669] [DEBUG] [LOCAL ] DLX: Loaded 27575 existing records from primary storage. [2025-10-28T22:10:34.061923] [INFO ] [MAIN ] DLX: Loaded 27575 primary data records. [2025-10-28T22:10:34.078218] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-28T22:10:34.108446] [INFO ] [MAIN ] Derivative Progress: 501/2046 symbols completed. DLR took 1.3s. Estimated remaining: 10m 28s. Rate: 147.6 symbols/min [2025-10-28T22:10:34.108611] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:34.307093] [DEBUG] [LOCAL ] DMO: Loaded 9429 existing records from primary storage. [2025-10-28T22:10:34.470292] [INFO ] [MAIN ] DMO: Loaded 9429 primary data records. [2025-10-28T22:10:34.932362] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:10:34.963148] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:35.008912] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:35.056688] [INFO ] [MAIN ] DMA: Generated 138 derivative records from 4701 primary records. [2025-10-28T22:10:35.058333] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-28T22:10:35.074194] [DEBUG] [LOCAL ] DMA: Derivative data saved (138 records). [2025-10-28T22:10:35.073045] [INFO ] [MAIN ] DLX: Generated 138 derivative records from 27575 primary records. [2025-10-28T22:10:35.074545] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-28T22:10:35.076993] [INFO ] [MAIN ] Derivative Progress: 502/2046 symbols completed. DMA took 1.1s. Estimated remaining: 10m 29s. Rate: 147.2 symbols/min [2025-10-28T22:10:35.078466] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:35.074696] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-28T22:10:35.094151] [DEBUG] [LOCAL ] DLX: Derivative data saved (138 records). [2025-10-28T22:10:35.095494] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-28T22:10:35.098007] [INFO ] [MAIN ] Derivative Progress: 503/2046 symbols completed. DLX took 1.1s. Estimated remaining: 10m 28s. Rate: 147.4 symbols/min [2025-10-28T22:10:35.098198] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:35.100602] [INFO ] [MAIN ] DMO: Generated 138 derivative records from 9429 primary records. [2025-10-28T22:10:35.100767] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-28T22:10:35.112763] [DEBUG] [LOCAL ] DMO: Derivative data saved (138 records). [2025-10-28T22:10:35.113171] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-28T22:10:35.115715] [INFO ] [MAIN ] Derivative Progress: 504/2046 symbols completed. DMO took 1.0s. Estimated remaining: 10m 26s. Rate: 147.7 symbols/min [2025-10-28T22:10:35.115970] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:35.164190] [DEBUG] [LOCAL ] DNA: Loaded 48345 existing records from primary storage. [2025-10-28T22:10:35.164376] [INFO ] [MAIN ] DNA: Loaded 48345 primary data records. [2025-10-28T22:10:35.211746] [DEBUG] [LOCAL ] DNP: Loaded 32822 existing records from primary storage. [2025-10-28T22:10:35.241896] [INFO ] [MAIN ] DNP: Loaded 32822 primary data records. [2025-10-28T22:10:35.337026] [DEBUG] [LOCAL ] DNOW: Loaded 43622 existing records from primary storage. [2025-10-28T22:10:35.374256] [INFO ] [MAIN ] DNOW: Loaded 43622 primary data records. [2025-10-28T22:10:36.143256] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:36.177803] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:36.206075] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:36.270230] [INFO ] [MAIN ] DNA: Generated 138 derivative records from 48345 primary records. [2025-10-28T22:10:36.271883] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-28T22:10:36.286392] [INFO ] [MAIN ] DNOW: Generated 138 derivative records from 43622 primary records. [2025-10-28T22:10:36.290915] [DEBUG] [LOCAL ] DNA: Derivative data saved (138 records). [2025-10-28T22:10:36.290980] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-28T22:10:36.291294] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-28T22:10:36.294356] [INFO ] [MAIN ] Derivative Progress: 505/2046 symbols completed. DNA took 1.2s. Estimated remaining: 10m 28s. Rate: 147.2 symbols/min [2025-10-28T22:10:36.297216] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:36.306421] [INFO ] [MAIN ] DNP: Generated 138 derivative records from 32822 primary records. [2025-10-28T22:10:36.309551] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-28T22:10:36.309481] [DEBUG] [LOCAL ] DNOW: Derivative data saved (138 records). [2025-10-28T22:10:36.309980] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-28T22:10:36.313065] [INFO ] [MAIN ] Derivative Progress: 506/2046 symbols completed. DNOW took 1.2s. Estimated remaining: 10m 27s. Rate: 147.5 symbols/min [2025-10-28T22:10:36.313553] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:36.325981] [DEBUG] [LOCAL ] DNP: Derivative data saved (138 records). [2025-10-28T22:10:36.326153] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-28T22:10:36.328804] [INFO ] [MAIN ] Derivative Progress: 507/2046 symbols completed. DNP took 1.2s. Estimated remaining: 10m 25s. Rate: 147.7 symbols/min [2025-10-28T22:10:36.328967] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:36.408059] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-28T22:10:36.409095] [INFO ] [MAIN ] DOC: Loaded 53554 primary data records. [2025-10-28T22:10:36.408801] [DEBUG] [LOCAL ] DOCN: Loaded 51087 existing records from primary storage. [2025-10-28T22:10:36.420537] [INFO ] [MAIN ] DOCN: Loaded 51087 primary data records. [2025-10-28T22:10:36.535586] [DEBUG] [LOCAL ] DOCS: Loaded 50085 existing records from primary storage. [2025-10-28T22:10:36.553274] [INFO ] [MAIN ] DOCS: Loaded 50085 primary data records. [2025-10-28T22:10:37.337199] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:37.391970] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:37.392739] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:37.454373] [INFO ] [MAIN ] DOC: Generated 138 derivative records from 53554 primary records. [2025-10-28T22:10:37.458145] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-28T22:10:37.481687] [DEBUG] [LOCAL ] DOC: Derivative data saved (138 records). [2025-10-28T22:10:37.482698] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-28T22:10:37.487251] [INFO ] [MAIN ] Derivative Progress: 508/2046 symbols completed. DOC took 1.2s. Estimated remaining: 10m 27s. Rate: 147.2 symbols/min [2025-10-28T22:10:37.499399] [INFO ] [MAIN ] DOCN: Generated 138 derivative records from 51087 primary records. [2025-10-28T22:10:37.500863] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-28T22:10:37.502534] [INFO ] [MAIN ] DOCS: Generated 138 derivative records from 50085 primary records. [2025-10-28T22:10:37.503457] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-28T22:10:37.526062] [DEBUG] [LOCAL ] DOCS: Derivative data saved (138 records). [2025-10-28T22:10:37.526538] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-28T22:10:37.531157] [INFO ] [MAIN ] Derivative Progress: 509/2046 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 25s. Rate: 147.5 symbols/min [2025-10-28T22:10:37.528219] [DEBUG] [LOCAL ] DOCN: Derivative data saved (138 records). [2025-10-28T22:10:37.531511] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-28T22:10:37.534008] [INFO ] [MAIN ] Derivative Progress: 510/2046 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 24s. Rate: 147.7 symbols/min [2025-10-28T22:10:37.534409] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:37.534596] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:37.534488] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:37.583757] [DEBUG] [LOCAL ] DOUG: Loaded 33370 existing records from primary storage. [2025-10-28T22:10:37.583951] [INFO ] [MAIN ] DOUG: Loaded 33370 primary data records. [2025-10-28T22:10:37.711344] [DEBUG] [LOCAL ] DOLE: Loaded 39074 existing records from primary storage. [2025-10-28T22:10:37.717823] [DEBUG] [LOCAL ] DOV: Loaded 45528 existing records from primary storage. [2025-10-28T22:10:37.723128] [INFO ] [MAIN ] DOV: Loaded 45528 primary data records. [2025-10-28T22:10:37.733619] [INFO ] [MAIN ] DOLE: Loaded 39074 primary data records. [2025-10-28T22:10:38.581083] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:38.616828] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:38.630948] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:38.693602] [INFO ] [MAIN ] DOUG: Generated 138 derivative records from 33370 primary records. [2025-10-28T22:10:38.694677] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-28T22:10:38.711719] [DEBUG] [LOCAL ] DOUG: Derivative data saved (138 records). [2025-10-28T22:10:38.715985] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-28T22:10:38.718036] [INFO ] [MAIN ] Derivative Progress: 511/2046 symbols completed. DOUG took 1.2s. Estimated remaining: 10m 26s. Rate: 147.2 symbols/min [2025-10-28T22:10:38.720743] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:38.730562] [INFO ] [MAIN ] DOV: Generated 138 derivative records from 45528 primary records. [2025-10-28T22:10:38.731669] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-28T22:10:38.746482] [INFO ] [MAIN ] DOLE: Generated 138 derivative records from 39074 primary records. [2025-10-28T22:10:38.748916] [DEBUG] [LOCAL ] DOV: Derivative data saved (138 records). [2025-10-28T22:10:38.748998] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-28T22:10:38.749493] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-28T22:10:38.752198] [INFO ] [MAIN ] Derivative Progress: 512/2046 symbols completed. DOV took 1.2s. Estimated remaining: 10m 24s. Rate: 147.5 symbols/min [2025-10-28T22:10:38.752387] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:38.764818] [DEBUG] [LOCAL ] DOLE: Derivative data saved (138 records). [2025-10-28T22:10:38.764984] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-28T22:10:38.767490] [INFO ] [MAIN ] Derivative Progress: 513/2046 symbols completed. DOLE took 1.2s. Estimated remaining: 10m 23s. Rate: 147.7 symbols/min [2025-10-28T22:10:38.771485] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:38.790574] [DEBUG] [LOCAL ] DPG: Loaded 13104 existing records from primary storage. [2025-10-28T22:10:38.790685] [INFO ] [MAIN ] DPG: Loaded 13104 primary data records. [2025-10-28T22:10:38.937755] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-28T22:10:38.956557] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-28T22:10:39.215010] [DEBUG] [LOCAL ] DQ: Loaded 43647 existing records from primary storage. [2025-10-28T22:10:39.221417] [INFO ] [MAIN ] DQ: Loaded 43647 primary data records. [2025-10-28T22:10:39.798737] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:39.831082] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:39.877327] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:39.919490] [INFO ] [MAIN ] DPG: Generated 138 derivative records from 13104 primary records. [2025-10-28T22:10:39.922872] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-28T22:10:39.936100] [INFO ] [MAIN ] DOW: Generated 138 derivative records from 53733 primary records. [2025-10-28T22:10:39.939066] [DEBUG] [LOCAL ] DPG: Derivative data saved (138 records). [2025-10-28T22:10:39.939184] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-28T22:10:39.939593] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-28T22:10:39.945073] [INFO ] [MAIN ] Derivative Progress: 514/2046 symbols completed. DPG took 1.2s. Estimated remaining: 10m 25s. Rate: 147.2 symbols/min [2025-10-28T22:10:39.945528] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:39.958925] [DEBUG] [LOCAL ] DOW: Derivative data saved (138 records). [2025-10-28T22:10:39.959116] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-28T22:10:39.961699] [INFO ] [MAIN ] Derivative Progress: 515/2046 symbols completed. DOW took 1.2s. Estimated remaining: 10m 23s. Rate: 147.5 symbols/min [2025-10-28T22:10:39.964802] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:39.969167] [INFO ] [MAIN ] DQ: Generated 138 derivative records from 43647 primary records. [2025-10-28T22:10:39.969335] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-28T22:10:39.982486] [DEBUG] [LOCAL ] DQ: Derivative data saved (138 records). [2025-10-28T22:10:39.982582] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-28T22:10:39.985018] [INFO ] [MAIN ] Derivative Progress: 516/2046 symbols completed. DQ took 1.2s. Estimated remaining: 10m 21s. Rate: 147.7 symbols/min [2025-10-28T22:10:39.985240] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:40.034160] [DEBUG] [LOCAL ] DRD: Loaded 37883 existing records from primary storage. [2025-10-28T22:10:40.035349] [INFO ] [MAIN ] DRD: Loaded 37883 primary data records. [2025-10-28T22:10:40.066334] [DEBUG] [LOCAL ] DRH: Loaded 50049 existing records from primary storage. [2025-10-28T22:10:40.090147] [INFO ] [MAIN ] DRH: Loaded 50049 primary data records. [2025-10-28T22:10:40.299180] [DEBUG] [LOCAL ] DRI: Loaded 47301 existing records from primary storage. [2025-10-28T22:10:40.330927] [INFO ] [MAIN ] DRI: Loaded 47301 primary data records. [2025-10-28T22:10:41.001993] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:41.033983] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:41.081360] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:41.136535] [INFO ] [MAIN ] DRD: Generated 138 derivative records from 37883 primary records. [2025-10-28T22:10:41.140351] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-28T22:10:41.143801] [INFO ] [MAIN ] DRH: Generated 138 derivative records from 50049 primary records. [2025-10-28T22:10:41.156835] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-28T22:10:41.157237] [DEBUG] [LOCAL ] DRD: Derivative data saved (138 records). [2025-10-28T22:10:41.159716] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-28T22:10:41.162742] [INFO ] [MAIN ] Derivative Progress: 517/2046 symbols completed. DRD took 1.2s. Estimated remaining: 10m 23s. Rate: 147.2 symbols/min [2025-10-28T22:10:41.163150] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:41.174736] [DEBUG] [LOCAL ] DRH: Derivative data saved (138 records). [2025-10-28T22:10:41.175833] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-28T22:10:41.178375] [INFO ] [MAIN ] Derivative Progress: 518/2046 symbols completed. DRH took 1.2s. Estimated remaining: 10m 22s. Rate: 147.5 symbols/min [2025-10-28T22:10:41.179054] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:41.182263] [INFO ] [MAIN ] DRI: Generated 138 derivative records from 47301 primary records. [2025-10-28T22:10:41.182480] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-28T22:10:41.201241] [DEBUG] [LOCAL ] DRI: Derivative data saved (138 records). [2025-10-28T22:10:41.201333] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-28T22:10:41.204118] [INFO ] [MAIN ] Derivative Progress: 519/2046 symbols completed. DRI took 1.2s. Estimated remaining: 10m 20s. Rate: 147.7 symbols/min [2025-10-28T22:10:41.201592] [DEBUG] [LOCAL ] DRLL: Loaded 8432 existing records from primary storage. [2025-10-28T22:10:41.204295] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:41.208376] [INFO ] [MAIN ] DRLL: Loaded 8432 primary data records. [2025-10-28T22:10:41.314897] [DEBUG] [LOCAL ] DSM: Loaded 13784 existing records from primary storage. [2025-10-28T22:10:41.337810] [INFO ] [MAIN ] DSM: Loaded 13784 primary data records. [2025-10-28T22:10:41.623350] [DEBUG] [LOCAL ] DSU: Loaded 22359 existing records from primary storage. [2025-10-28T22:10:41.656969] [INFO ] [MAIN ] DSU: Loaded 22359 primary data records. [2025-10-28T22:10:42.254888] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:10:42.296978] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:42.336328] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:42.367050] [INFO ] [MAIN ] DRLL: Generated 138 derivative records from 8432 primary records. [2025-10-28T22:10:42.370008] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-28T22:10:42.388803] [DEBUG] [LOCAL ] DRLL: Derivative data saved (138 records). [2025-10-28T22:10:42.389257] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-28T22:10:42.391322] [INFO ] [MAIN ] Derivative Progress: 520/2046 symbols completed. DRLL took 1.2s. Estimated remaining: 10m 22s. Rate: 147.2 symbols/min [2025-10-28T22:10:42.391528] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:42.397305] [INFO ] [MAIN ] DSM: Generated 138 derivative records from 13784 primary records. [2025-10-28T22:10:42.399764] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-28T22:10:42.421585] [DEBUG] [LOCAL ] DSM: Derivative data saved (138 records). [2025-10-28T22:10:42.422108] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-28T22:10:42.424751] [INFO ] [MAIN ] Derivative Progress: 521/2046 symbols completed. DSM took 1.2s. Estimated remaining: 10m 21s. Rate: 147.4 symbols/min [2025-10-28T22:10:42.424990] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:42.435831] [DEBUG] [LOCAL ] DSX: Loaded 23143 existing records from primary storage. [2025-10-28T22:10:42.437973] [INFO ] [MAIN ] DSU: Generated 138 derivative records from 22359 primary records. [2025-10-28T22:10:42.438116] [INFO ] [MAIN ] DSX: Loaded 23143 primary data records. [2025-10-28T22:10:42.438066] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-28T22:10:42.487596] [DEBUG] [LOCAL ] DSU: Derivative data saved (138 records). [2025-10-28T22:10:42.499432] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-28T22:10:42.532425] [INFO ] [MAIN ] Derivative Progress: 522/2046 symbols completed. DSU took 1.3s. Estimated remaining: 10m 19s. Rate: 147.7 symbols/min [2025-10-28T22:10:42.559450] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:42.768275] [DEBUG] [LOCAL ] DTB: Loaded 4861 existing records from primary storage. [2025-10-28T22:10:42.768408] [INFO ] [MAIN ] DTB: Loaded 4861 primary data records. [2025-10-28T22:10:42.897066] [DEBUG] [LOCAL ] DT: Loaded 52899 existing records from primary storage. [2025-10-28T22:10:42.903315] [INFO ] [MAIN ] DT: Loaded 52899 primary data records. [2025-10-28T22:10:43.447077] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:43.504943] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:43.551381] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:43.567659] [INFO ] [MAIN ] DSX: Generated 138 derivative records from 23143 primary records. [2025-10-28T22:10:43.576031] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-28T22:10:43.600017] [DEBUG] [LOCAL ] DSX: Derivative data saved (138 records). [2025-10-28T22:10:43.601783] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-28T22:10:43.606750] [INFO ] [MAIN ] Derivative Progress: 523/2046 symbols completed. DSX took 1.2s. Estimated remaining: 10m 21s. Rate: 147.2 symbols/min [2025-10-28T22:10:43.631469] [INFO ] [MAIN ] DTB: Generated 138 derivative records from 4861 primary records. [2025-10-28T22:10:43.633046] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-28T22:10:43.642839] [INFO ] [MAIN ] DT: Generated 138 derivative records from 52899 primary records. [2025-10-28T22:10:43.647757] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-28T22:10:43.647634] [DEBUG] [LOCAL ] DTB: Derivative data saved (138 records). [2025-10-28T22:10:43.648784] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-28T22:10:43.651282] [INFO ] [MAIN ] Derivative Progress: 524/2046 symbols completed. DTB took 1.1s. Estimated remaining: 10m 19s. Rate: 147.4 symbols/min [2025-10-28T22:10:43.663919] [DEBUG] [LOCAL ] DT: Derivative data saved (138 records). [2025-10-28T22:10:43.664162] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-28T22:10:43.666971] [INFO ] [MAIN ] Derivative Progress: 525/2046 symbols completed. DT took 1.2s. Estimated remaining: 10m 18s. Rate: 147.7 symbols/min [2025-10-28T22:10:43.667491] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:43.667394] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:43.667592] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:43.676877] [DEBUG] [LOCAL ] DTG: Loaded 5605 existing records from primary storage. [2025-10-28T22:10:43.677111] [INFO ] [MAIN ] DTG: Loaded 5605 primary data records. [2025-10-28T22:10:44.024756] [DEBUG] [LOCAL ] DTM: Loaded 43576 existing records from primary storage. [2025-10-28T22:10:44.025706] [INFO ] [MAIN ] DTM: Loaded 43576 primary data records. [2025-10-28T22:10:44.076968] [DEBUG] [LOCAL ] DUK: Loaded 53418 existing records from primary storage. [2025-10-28T22:10:44.119617] [INFO ] [MAIN ] DUK: Loaded 53418 primary data records. [2025-10-28T22:10:44.704045] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:44.762765] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:44.762178] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:44.822204] [INFO ] [MAIN ] DTG: Generated 138 derivative records from 5605 primary records. [2025-10-28T22:10:44.824348] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-28T22:10:44.841990] [DEBUG] [LOCAL ] DTG: Derivative data saved (138 records). [2025-10-28T22:10:44.846581] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-28T22:10:44.849665] [INFO ] [MAIN ] Derivative Progress: 526/2046 symbols completed. DTG took 1.2s. Estimated remaining: 10m 20s. Rate: 147.2 symbols/min [2025-10-28T22:10:44.850082] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:44.871970] [INFO ] [MAIN ] DTM: Generated 138 derivative records from 43576 primary records. [2025-10-28T22:10:44.869554] [DEBUG] [LOCAL ] DUKB: Loaded 5882 existing records from primary storage. [2025-10-28T22:10:44.872224] [INFO ] [MAIN ] DUKB: Loaded 5882 primary data records. [2025-10-28T22:10:44.871722] [INFO ] [MAIN ] DUK: Generated 138 derivative records from 53418 primary records. [2025-10-28T22:10:44.872315] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-28T22:10:44.885680] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-28T22:10:44.965828] [DEBUG] [LOCAL ] DTM: Derivative data saved (138 records). [2025-10-28T22:10:44.966724] [DEBUG] [LOCAL ] DUK: Derivative data saved (138 records). [2025-10-28T22:10:44.979745] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-28T22:10:45.002313] [INFO ] [MAIN ] Derivative Progress: 527/2046 symbols completed. DUK took 1.3s. Estimated remaining: 10m 19s. Rate: 147.4 symbols/min [2025-10-28T22:10:44.990169] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-28T22:10:45.015134] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:45.017471] [INFO ] [MAIN ] Derivative Progress: 528/2046 symbols completed. DTM took 1.3s. Estimated remaining: 10m 17s. Rate: 147.6 symbols/min [2025-10-28T22:10:45.017982] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:45.274058] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:45.274838] [DEBUG] [LOCAL ] DVA: Loaded 40399 existing records from primary storage. [2025-10-28T22:10:45.300585] [INFO ] [MAIN ] DVA: Loaded 40399 primary data records. [2025-10-28T22:10:45.321365] [DEBUG] [LOCAL ] DV: Loaded 51217 existing records from primary storage. [2025-10-28T22:10:45.327411] [INFO ] [MAIN ] DV: Loaded 51217 primary data records. [2025-10-28T22:10:45.963152] [INFO ] [MAIN ] DUKB: Generated 138 derivative records from 5882 primary records. [2025-10-28T22:10:45.963411] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-28T22:10:45.976444] [DEBUG] [LOCAL ] DUKB: Derivative data saved (138 records). [2025-10-28T22:10:45.976897] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-28T22:10:45.978825] [INFO ] [MAIN ] Derivative Progress: 529/2046 symbols completed. DUKB took 1.1s. Estimated remaining: 10m 18s. Rate: 147.2 symbols/min [2025-10-28T22:10:45.979109] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:46.015090] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:46.015619] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:46.104501] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-28T22:10:46.107399] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-10-28T22:10:46.227532] [INFO ] [MAIN ] DV: Generated 138 derivative records from 51217 primary records. [2025-10-28T22:10:46.235266] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-28T22:10:46.235164] [INFO ] [MAIN ] DVA: Generated 138 derivative records from 40399 primary records. [2025-10-28T22:10:46.235979] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-28T22:10:46.346716] [DEBUG] [LOCAL ] DVA: Derivative data saved (138 records). [2025-10-28T22:10:46.347533] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-28T22:10:46.353546] [INFO ] [MAIN ] Derivative Progress: 530/2046 symbols completed. DVA took 1.3s. Estimated remaining: 10m 18s. Rate: 147.3 symbols/min [2025-10-28T22:10:46.353789] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:46.350723] [DEBUG] [LOCAL ] DV: Derivative data saved (138 records). [2025-10-28T22:10:46.354506] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-28T22:10:46.509838] [INFO ] [MAIN ] Derivative Progress: 531/2046 symbols completed. DV took 1.5s. Estimated remaining: 10m 17s. Rate: 147.4 symbols/min [2025-10-28T22:10:46.510300] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:46.567082] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:46.602323] [DEBUG] [LOCAL ] DX: Loaded 52482 existing records from primary storage. [2025-10-28T22:10:46.615189] [INFO ] [MAIN ] DX: Loaded 52482 primary data records. [2025-10-28T22:10:46.651393] [DEBUG] [LOCAL ] DXC: Loaded 49802 existing records from primary storage. [2025-10-28T22:10:46.692798] [INFO ] [MAIN ] DXC: Loaded 49802 primary data records. [2025-10-28T22:10:47.265464] [INFO ] [MAIN ] DVN: Generated 138 derivative records from 53699 primary records. [2025-10-28T22:10:47.265984] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-28T22:10:47.280468] [DEBUG] [LOCAL ] DVN: Derivative data saved (138 records). [2025-10-28T22:10:47.280613] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-28T22:10:47.282861] [INFO ] [MAIN ] Derivative Progress: 532/2046 symbols completed. DVN took 1.3s. Estimated remaining: 10m 17s. Rate: 147.2 symbols/min [2025-10-28T22:10:47.285092] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:47.307987] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:47.346974] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:47.384243] [DEBUG] [LOCAL ] DXYZ: Loaded 36619 existing records from primary storage. [2025-10-28T22:10:47.386005] [INFO ] [MAIN ] DXYZ: Loaded 36619 primary data records. [2025-10-28T22:10:47.724876] [INFO ] [MAIN ] DX: Generated 138 derivative records from 52482 primary records. [2025-10-28T22:10:47.726246] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-28T22:10:47.744371] [DEBUG] [LOCAL ] DX: Derivative data saved (138 records). [2025-10-28T22:10:47.744965] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-28T22:10:47.746909] [INFO ] [MAIN ] Derivative Progress: 533/2046 symbols completed. DX took 1.4s. Estimated remaining: 10m 17s. Rate: 147.1 symbols/min [2025-10-28T22:10:47.747171] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:47.752445] [INFO ] [MAIN ] DXC: Generated 138 derivative records from 49802 primary records. [2025-10-28T22:10:47.753545] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-28T22:10:47.767268] [DEBUG] [LOCAL ] DXC: Derivative data saved (138 records). [2025-10-28T22:10:47.767434] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-28T22:10:47.770046] [INFO ] [MAIN ] Derivative Progress: 534/2046 symbols completed. DXC took 1.3s. Estimated remaining: 10m 15s. Rate: 147.4 symbols/min [2025-10-28T22:10:47.770581] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:47.808292] [DEBUG] [LOCAL ] DY: Loaded 27594 existing records from primary storage. [2025-10-28T22:10:47.808681] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:47.808986] [INFO ] [MAIN ] DY: Loaded 27594 primary data records. [2025-10-28T22:10:47.988620] [DEBUG] [LOCAL ] E: Loaded 32661 existing records from primary storage. [2025-10-28T22:10:48.012980] [INFO ] [MAIN ] E: Loaded 32661 primary data records. [2025-10-28T22:10:48.572454] [INFO ] [MAIN ] DXYZ: Generated 138 derivative records from 36619 primary records. [2025-10-28T22:10:48.573310] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-28T22:10:48.595763] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (138 records). [2025-10-28T22:10:48.598901] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-28T22:10:48.602532] [INFO ] [MAIN ] Derivative Progress: 535/2046 symbols completed. DXYZ took 1.3s. Estimated remaining: 10m 16s. Rate: 147.1 symbols/min [2025-10-28T22:10:48.603248] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:48.619919] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:48.667930] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:48.731055] [INFO ] [MAIN ] DY: Generated 138 derivative records from 27594 primary records. [2025-10-28T22:10:48.732625] [DEBUG] [LOCAL ] EAF: Loaded 40560 existing records from primary storage. [2025-10-28T22:10:48.734146] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-28T22:10:48.734716] [INFO ] [MAIN ] EAF: Loaded 40560 primary data records. [2025-10-28T22:10:48.794423] [DEBUG] [LOCAL ] DY: Derivative data saved (138 records). [2025-10-28T22:10:48.865170] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-28T22:10:48.874020] [INFO ] [MAIN ] Derivative Progress: 536/2046 symbols completed. DY took 1.1s. Estimated remaining: 10m 15s. Rate: 147.2 symbols/min [2025-10-28T22:10:48.904251] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:49.026477] [INFO ] [MAIN ] E: Generated 138 derivative records from 32661 primary records. [2025-10-28T22:10:49.036714] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-28T22:10:49.073672] [DEBUG] [LOCAL ] E: Derivative data saved (138 records). [2025-10-28T22:10:49.104852] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-28T22:10:49.258412] [INFO ] [MAIN ] Derivative Progress: 537/2046 symbols completed. E took 1.5s. Estimated remaining: 10m 15s. Rate: 147.2 symbols/min [2025-10-28T22:10:49.271041] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:49.312617] [DEBUG] [LOCAL ] EAT: Loaded 49680 existing records from primary storage. [2025-10-28T22:10:49.313184] [INFO ] [MAIN ] EAT: Loaded 49680 primary data records. [2025-10-28T22:10:49.344413] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:49.483637] [DEBUG] [LOCAL ] EB: Loaded 35675 existing records from primary storage. [2025-10-28T22:10:49.484695] [INFO ] [MAIN ] EB: Loaded 35675 primary data records. [2025-10-28T22:10:50.044929] [INFO ] [MAIN ] EAF: Generated 138 derivative records from 40560 primary records. [2025-10-28T22:10:50.045451] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-28T22:10:50.061378] [DEBUG] [LOCAL ] EAF: Derivative data saved (138 records). [2025-10-28T22:10:50.061983] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-28T22:10:50.064261] [INFO ] [MAIN ] Derivative Progress: 538/2046 symbols completed. EAF took 1.5s. Estimated remaining: 10m 16s. Rate: 147.0 symbols/min [2025-10-28T22:10:50.081903] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:50.117612] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:50.159787] [INFO ] [MAIN ] EAT: Generated 138 derivative records from 49680 primary records. [2025-10-28T22:10:50.160195] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-28T22:10:50.179711] [DEBUG] [LOCAL ] EAT: Derivative data saved (138 records). [2025-10-28T22:10:50.179931] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-28T22:10:50.182569] [INFO ] [MAIN ] Derivative Progress: 539/2046 symbols completed. EAT took 1.3s. Estimated remaining: 10m 14s. Rate: 147.2 symbols/min [2025-10-28T22:10:50.185556] [INFO ] [MAIN ] EB: Generated 138 derivative records from 35675 primary records. [2025-10-28T22:10:50.185741] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-28T22:10:50.198587] [DEBUG] [LOCAL ] EB: Derivative data saved (138 records). [2025-10-28T22:10:50.198681] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-28T22:10:50.201347] [INFO ] [MAIN ] Derivative Progress: 540/2046 symbols completed. EB took 0.9s. Estimated remaining: 10m 13s. Rate: 147.4 symbols/min [2025-10-28T22:10:50.201816] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:50.201953] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:50.202385] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:50.269556] [DEBUG] [LOCAL ] EBR: Loaded 43196 existing records from primary storage. [2025-10-28T22:10:50.282421] [INFO ] [MAIN ] EBR: Loaded 43196 primary data records. [2025-10-28T22:10:50.294522] [DEBUG] [LOCAL ] ECC: Loaded 43047 existing records from primary storage. [2025-10-28T22:10:50.304925] [INFO ] [MAIN ] ECC: Loaded 43047 primary data records. [2025-10-28T22:10:50.304817] [DEBUG] [LOCAL ] EBS: Loaded 46486 existing records from primary storage. [2025-10-28T22:10:50.348631] [INFO ] [MAIN ] EBS: Loaded 46486 primary data records. [2025-10-28T22:10:51.283177] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:51.329787] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:51.343988] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:51.409324] [INFO ] [MAIN ] EBR: Generated 138 derivative records from 43196 primary records. [2025-10-28T22:10:51.412135] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-28T22:10:51.427354] [DEBUG] [LOCAL ] EBR: Derivative data saved (138 records). [2025-10-28T22:10:51.427546] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-28T22:10:51.431624] [INFO ] [MAIN ] Derivative Progress: 541/2046 symbols completed. EBR took 1.2s. Estimated remaining: 10m 15s. Rate: 146.9 symbols/min [2025-10-28T22:10:51.431972] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:51.429799] [INFO ] [MAIN ] ECC: Generated 138 derivative records from 43047 primary records. [2025-10-28T22:10:51.433860] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-28T22:10:51.434609] [INFO ] [MAIN ] EBS: Generated 138 derivative records from 46486 primary records. [2025-10-28T22:10:51.435088] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-28T22:10:51.446725] [DEBUG] [LOCAL ] ECC: Derivative data saved (138 records). [2025-10-28T22:10:51.446828] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-28T22:10:51.449496] [INFO ] [MAIN ] Derivative Progress: 542/2046 symbols completed. ECC took 1.2s. Estimated remaining: 10m 13s. Rate: 147.1 symbols/min [2025-10-28T22:10:51.449904] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:51.461002] [DEBUG] [LOCAL ] ECCU: Loaded 2068 existing records from primary storage. [2025-10-28T22:10:51.463201] [DEBUG] [LOCAL ] EBS: Derivative data saved (138 records). [2025-10-28T22:10:51.463399] [INFO ] [MAIN ] ECCU: Loaded 2068 primary data records. [2025-10-28T22:10:51.463548] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-28T22:10:51.486601] [INFO ] [MAIN ] Derivative Progress: 543/2046 symbols completed. EBS took 1.3s. Estimated remaining: 10m 12s. Rate: 147.4 symbols/min [2025-10-28T22:10:51.509634] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:51.781342] [DEBUG] [LOCAL ] ECG: Loaded 32342 existing records from primary storage. [2025-10-28T22:10:51.781618] [INFO ] [MAIN ] ECG: Loaded 32342 primary data records. [2025-10-28T22:10:51.970678] [DEBUG] [LOCAL ] ECL: Loaded 46659 existing records from primary storage. [2025-10-28T22:10:51.987898] [INFO ] [MAIN ] ECL: Loaded 46659 primary data records. [2025-10-28T22:10:52.433028] [DEBUG] [MAIN ] ECCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:52.481022] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:52.519577] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:52.550335] [INFO ] [MAIN ] ECCU: Generated 138 derivative records from 2068 primary records. [2025-10-28T22:10:52.553916] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-28T22:10:52.573981] [DEBUG] [LOCAL ] ECCU: Derivative data saved (138 records). [2025-10-28T22:10:52.574428] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-28T22:10:52.579174] [INFO ] [MAIN ] Derivative Progress: 544/2046 symbols completed. ECCU took 1.1s. Estimated remaining: 10m 13s. Rate: 146.9 symbols/min [2025-10-28T22:10:52.579688] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:52.595634] [INFO ] [MAIN ] ECG: Generated 138 derivative records from 32342 primary records. [2025-10-28T22:10:52.595961] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-28T22:10:52.619046] [DEBUG] [LOCAL ] ECO: Loaded 17871 existing records from primary storage. [2025-10-28T22:10:52.619195] [INFO ] [MAIN ] ECO: Loaded 17871 primary data records. [2025-10-28T22:10:52.618604] [DEBUG] [LOCAL ] ECG: Derivative data saved (138 records). [2025-10-28T22:10:52.619605] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-28T22:10:52.633944] [INFO ] [MAIN ] Derivative Progress: 545/2046 symbols completed. ECG took 1.2s. Estimated remaining: 10m 12s. Rate: 147.2 symbols/min [2025-10-28T22:10:52.667469] [INFO ] [MAIN ] ECL: Generated 138 derivative records from 46659 primary records. [2025-10-28T22:10:52.686931] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-28T22:10:52.679605] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:52.740230] [DEBUG] [LOCAL ] ECL: Derivative data saved (138 records). [2025-10-28T22:10:52.762194] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-28T22:10:52.770014] [INFO ] [MAIN ] Derivative Progress: 546/2046 symbols completed. ECL took 1.3s. Estimated remaining: 10m 11s. Rate: 147.3 symbols/min [2025-10-28T22:10:52.791249] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:52.999123] [DEBUG] [LOCAL ] EDD: Loaded 26837 existing records from primary storage. [2025-10-28T22:10:52.999372] [INFO ] [MAIN ] EDD: Loaded 26837 primary data records. [2025-10-28T22:10:53.108392] [DEBUG] [LOCAL ] ED: Loaded 52473 existing records from primary storage. [2025-10-28T22:10:53.120879] [INFO ] [MAIN ] ED: Loaded 52473 primary data records. [2025-10-28T22:10:53.289952] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:53.734322] [INFO ] [MAIN ] ECO: Generated 138 derivative records from 17871 primary records. [2025-10-28T22:10:53.735008] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-28T22:10:53.750143] [DEBUG] [LOCAL ] ECO: Derivative data saved (138 records). [2025-10-28T22:10:53.751366] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-28T22:10:53.753274] [INFO ] [MAIN ] Derivative Progress: 547/2046 symbols completed. ECO took 1.2s. Estimated remaining: 10m 12s. Rate: 147.0 symbols/min [2025-10-28T22:10:53.753592] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:53.768543] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:53.805525] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:53.833618] [DEBUG] [LOCAL ] EDN: Loaded 19707 existing records from primary storage. [2025-10-28T22:10:53.834047] [INFO ] [MAIN ] EDN: Loaded 19707 primary data records. [2025-10-28T22:10:54.194436] [INFO ] [MAIN ] EDD: Generated 138 derivative records from 26837 primary records. [2025-10-28T22:10:54.199341] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-28T22:10:54.213950] [INFO ] [MAIN ] ED: Generated 138 derivative records from 52473 primary records. [2025-10-28T22:10:54.218830] [DEBUG] [LOCAL ] EDD: Derivative data saved (138 records). [2025-10-28T22:10:54.218393] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-28T22:10:54.218965] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-28T22:10:54.221801] [INFO ] [MAIN ] Derivative Progress: 548/2046 symbols completed. EDD took 1.4s. Estimated remaining: 10m 12s. Rate: 146.9 symbols/min [2025-10-28T22:10:54.221998] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:54.234931] [DEBUG] [LOCAL ] ED: Derivative data saved (138 records). [2025-10-28T22:10:54.235170] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-28T22:10:54.238678] [INFO ] [MAIN ] Derivative Progress: 549/2046 symbols completed. ED took 1.6s. Estimated remaining: 10m 10s. Rate: 147.2 symbols/min [2025-10-28T22:10:54.239012] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:54.257120] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:10:54.341791] [INFO ] [MAIN ] EDN: Generated 138 derivative records from 19707 primary records. [2025-10-28T22:10:54.341591] [DEBUG] [LOCAL ] EE: Loaded 32418 existing records from primary storage. [2025-10-28T22:10:54.342011] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-28T22:10:54.341951] [INFO ] [MAIN ] EE: Loaded 32418 primary data records. [2025-10-28T22:10:54.339243] [DEBUG] [LOCAL ] EDU: Loaded 44599 existing records from primary storage. [2025-10-28T22:10:54.397267] [DEBUG] [LOCAL ] EDN: Derivative data saved (138 records). [2025-10-28T22:10:54.390458] [INFO ] [MAIN ] EDU: Loaded 44599 primary data records. [2025-10-28T22:10:54.423153] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-28T22:10:54.425296] [INFO ] [MAIN ] Derivative Progress: 550/2046 symbols completed. EDN took 0.7s. Estimated remaining: 10m 9s. Rate: 147.3 symbols/min [2025-10-28T22:10:54.448140] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:54.769033] [DEBUG] [LOCAL ] EEX: Loaded 9325 existing records from primary storage. [2025-10-28T22:10:54.797577] [INFO ] [MAIN ] EEX: Loaded 9325 primary data records. [2025-10-28T22:10:55.317629] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:55.354180] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:55.402286] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:55.438200] [INFO ] [MAIN ] EE: Generated 138 derivative records from 32418 primary records. [2025-10-28T22:10:55.440159] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-28T22:10:55.460735] [DEBUG] [LOCAL ] EE: Derivative data saved (138 records). [2025-10-28T22:10:55.462502] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-28T22:10:55.465822] [INFO ] [MAIN ] Derivative Progress: 551/2046 symbols completed. EE took 1.2s. Estimated remaining: 10m 11s. Rate: 146.9 symbols/min [2025-10-28T22:10:55.468739] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:55.468336] [INFO ] [MAIN ] EDU: Generated 138 derivative records from 44599 primary records. [2025-10-28T22:10:55.471932] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-28T22:10:55.488154] [DEBUG] [LOCAL ] EDU: Derivative data saved (138 records). [2025-10-28T22:10:55.491794] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-28T22:10:55.495601] [INFO ] [MAIN ] Derivative Progress: 552/2046 symbols completed. EDU took 1.3s. Estimated remaining: 10m 9s. Rate: 147.1 symbols/min [2025-10-28T22:10:55.499119] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:55.499434] [INFO ] [MAIN ] EEX: Generated 138 derivative records from 9325 primary records. [2025-10-28T22:10:55.500006] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-28T22:10:55.523383] [DEBUG] [LOCAL ] EEX: Derivative data saved (138 records). [2025-10-28T22:10:55.526856] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-28T22:10:55.529395] [INFO ] [MAIN ] Derivative Progress: 553/2046 symbols completed. EEX took 1.1s. Estimated remaining: 10m 8s. Rate: 147.4 symbols/min [2025-10-28T22:10:55.537310] [DEBUG] [LOCAL ] EFR: Loaded 14666 existing records from primary storage. [2025-10-28T22:10:55.548614] [INFO ] [MAIN ] EFR: Loaded 14666 primary data records. [2025-10-28T22:10:55.613055] [DEBUG] [LOCAL ] EFC: Loaded 46143 existing records from primary storage. [2025-10-28T22:10:55.640443] [INFO ] [MAIN ] EFC: Loaded 46143 primary data records. [2025-10-28T22:10:56.191993] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:56.241311] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:56.262875] [INFO ] [MAIN ] EFR: Generated 138 derivative records from 14666 primary records. [2025-10-28T22:10:56.265616] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-28T22:10:56.281339] [DEBUG] [LOCAL ] EFR: Derivative data saved (138 records). [2025-10-28T22:10:56.282597] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-28T22:10:56.284768] [INFO ] [MAIN ] Derivative Progress: 554/2046 symbols completed. EFR took 0.8s. Estimated remaining: 10m 8s. Rate: 147.2 symbols/min [2025-10-28T22:10:56.292926] [INFO ] [MAIN ] EFC: Generated 138 derivative records from 46143 primary records. [2025-10-28T22:10:56.293004] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-28T22:10:56.305083] [DEBUG] [LOCAL ] EFC: Derivative data saved (138 records). [2025-10-28T22:10:56.305205] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-28T22:10:56.307306] [INFO ] [MAIN ] Derivative Progress: 555/2046 symbols completed. EFC took 0.8s. Estimated remaining: 10m 7s. Rate: 147.4 symbols/min [2025-10-28T22:10:56.307785] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:56.307890] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:56.308014] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:56.322476] [DEBUG] [LOCAL ] EFT: Loaded 12569 existing records from primary storage. [2025-10-28T22:10:56.322629] [INFO ] [MAIN ] EFT: Loaded 12569 primary data records. [2025-10-28T22:10:56.481639] [DEBUG] [LOCAL ] EFXT: Loaded 29387 existing records from primary storage. [2025-10-28T22:10:56.520122] [INFO ] [MAIN ] EFXT: Loaded 29387 primary data records. [2025-10-28T22:10:56.590110] [DEBUG] [LOCAL ] EFX: Loaded 44475 existing records from primary storage. [2025-10-28T22:10:56.734701] [INFO ] [MAIN ] EFX: Loaded 44475 primary data records. [2025-10-28T22:10:57.375508] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:57.427913] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:57.464115] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:57.467560] [INFO ] [MAIN ] EFT: Generated 138 derivative records from 12569 primary records. [2025-10-28T22:10:57.483290] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-28T22:10:57.499066] [DEBUG] [LOCAL ] EFT: Derivative data saved (138 records). [2025-10-28T22:10:57.499835] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-28T22:10:57.503438] [INFO ] [MAIN ] Derivative Progress: 556/2046 symbols completed. EFT took 1.2s. Estimated remaining: 10m 9s. Rate: 146.9 symbols/min [2025-10-28T22:10:57.507149] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:57.534991] [INFO ] [MAIN ] EFXT: Generated 138 derivative records from 29387 primary records. [2025-10-28T22:10:57.535387] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-28T22:10:57.564225] [INFO ] [MAIN ] EFX: Generated 138 derivative records from 44475 primary records. [2025-10-28T22:10:57.565018] [DEBUG] [LOCAL ] EFXT: Derivative data saved (138 records). [2025-10-28T22:10:57.565156] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-28T22:10:57.565213] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-28T22:10:57.567581] [INFO ] [MAIN ] Derivative Progress: 557/2046 symbols completed. EFXT took 1.3s. Estimated remaining: 10m 7s. Rate: 147.1 symbols/min [2025-10-28T22:10:57.569479] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:57.598316] [DEBUG] [LOCAL ] EFX: Derivative data saved (138 records). [2025-10-28T22:10:57.598454] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-28T22:10:57.601275] [INFO ] [MAIN ] Derivative Progress: 558/2046 symbols completed. EFX took 1.3s. Estimated remaining: 10m 6s. Rate: 147.4 symbols/min [2025-10-28T22:10:57.603134] [DEBUG] [LOCAL ] EGO: Loaded 51705 existing records from primary storage. [2025-10-28T22:10:57.603512] [INFO ] [MAIN ] EGO: Loaded 51705 primary data records. [2025-10-28T22:10:57.603378] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:57.769978] [DEBUG] [LOCAL ] EHI: Loaded 10489 existing records from primary storage. [2025-10-28T22:10:57.802417] [INFO ] [MAIN ] EHI: Loaded 10489 primary data records. [2025-10-28T22:10:58.024511] [DEBUG] [LOCAL ] EHC: Loaded 40562 existing records from primary storage. [2025-10-28T22:10:58.042069] [INFO ] [MAIN ] EHC: Loaded 40562 primary data records. [2025-10-28T22:10:58.561629] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:58.609410] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:58.650409] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:58.652503] [INFO ] [MAIN ] EGO: Generated 138 derivative records from 51705 primary records. [2025-10-28T22:10:58.664145] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-28T22:10:58.685877] [DEBUG] [LOCAL ] EGO: Derivative data saved (138 records). [2025-10-28T22:10:58.686278] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-28T22:10:58.688579] [INFO ] [MAIN ] Derivative Progress: 559/2046 symbols completed. EGO took 1.2s. Estimated remaining: 10m 7s. Rate: 146.9 symbols/min [2025-10-28T22:10:58.690908] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:58.718497] [INFO ] [MAIN ] EHI: Generated 138 derivative records from 10489 primary records. [2025-10-28T22:10:58.718899] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-28T22:10:58.735635] [DEBUG] [LOCAL ] EHI: Derivative data saved (138 records). [2025-10-28T22:10:58.735764] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-28T22:10:58.738410] [INFO ] [MAIN ] Derivative Progress: 560/2046 symbols completed. EHI took 1.1s. Estimated remaining: 10m 6s. Rate: 147.2 symbols/min [2025-10-28T22:10:58.738802] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:58.756705] [INFO ] [MAIN ] EHC: Generated 138 derivative records from 40562 primary records. [2025-10-28T22:10:58.756942] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-28T22:10:58.769397] [DEBUG] [LOCAL ] EHC: Derivative data saved (138 records). [2025-10-28T22:10:58.770188] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-28T22:10:58.772755] [INFO ] [MAIN ] Derivative Progress: 561/2046 symbols completed. EHC took 1.2s. Estimated remaining: 10m 4s. Rate: 147.4 symbols/min [2025-10-28T22:10:58.772953] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:58.790584] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-10-28T22:10:58.790927] [INFO ] [MAIN ] EIX: Loaded 53339 primary data records. [2025-10-28T22:10:59.138986] [DEBUG] [LOCAL ] EL: Loaded 53368 existing records from primary storage. [2025-10-28T22:10:59.139255] [INFO ] [MAIN ] EL: Loaded 53368 primary data records. [2025-10-28T22:10:59.257044] [DEBUG] [LOCAL ] ELAN: Loaded 53301 existing records from primary storage. [2025-10-28T22:10:59.269072] [INFO ] [MAIN ] ELAN: Loaded 53301 primary data records. [2025-10-28T22:10:59.825833] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:59.887425] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:59.910342] [INFO ] [MAIN ] EIX: Generated 138 derivative records from 53339 primary records. [2025-10-28T22:10:59.913269] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-28T22:10:59.927368] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:10:59.952442] [DEBUG] [LOCAL ] EIX: Derivative data saved (138 records). [2025-10-28T22:10:59.957522] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-28T22:10:59.961806] [INFO ] [MAIN ] Derivative Progress: 562/2046 symbols completed. EIX took 1.3s. Estimated remaining: 10m 6s. Rate: 146.9 symbols/min [2025-10-28T22:10:59.964080] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:10:59.978031] [DEBUG] [LOCAL ] ELC: Loaded 3405 existing records from primary storage. [2025-10-28T22:10:59.984283] [INFO ] [MAIN ] ELC: Loaded 3405 primary data records. [2025-10-28T22:11:00.062886] [INFO ] [MAIN ] EL: Generated 138 derivative records from 53368 primary records. [2025-10-28T22:11:00.089114] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-28T22:11:00.136915] [DEBUG] [LOCAL ] EL: Derivative data saved (138 records). [2025-10-28T22:11:00.158068] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-28T22:11:00.176089] [INFO ] [MAIN ] Derivative Progress: 563/2046 symbols completed. EL took 1.4s. Estimated remaining: 10m 5s. Rate: 147.0 symbols/min [2025-10-28T22:11:00.187176] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:00.338254] [INFO ] [MAIN ] ELAN: Generated 138 derivative records from 53301 primary records. [2025-10-28T22:11:00.338990] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-28T22:11:00.359636] [DEBUG] [LOCAL ] ELAN: Derivative data saved (138 records). [2025-10-28T22:11:00.360172] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-28T22:11:00.363286] [INFO ] [MAIN ] Derivative Progress: 564/2046 symbols completed. ELAN took 1.6s. Estimated remaining: 10m 4s. Rate: 147.2 symbols/min [2025-10-28T22:11:00.363741] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:00.373865] [DEBUG] [LOCAL ] ELP: Loaded 25193 existing records from primary storage. [2025-10-28T22:11:00.375135] [INFO ] [MAIN ] ELP: Loaded 25193 primary data records. [2025-10-28T22:11:00.709949] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:00.748218] [DEBUG] [LOCAL ] ELS: Loaded 49824 existing records from primary storage. [2025-10-28T22:11:00.750732] [INFO ] [MAIN ] ELS: Loaded 49824 primary data records. [2025-10-28T22:11:01.071920] [INFO ] [MAIN ] ELC: Generated 138 derivative records from 3405 primary records. [2025-10-28T22:11:01.072281] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-28T22:11:01.094683] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:01.113199] [DEBUG] [LOCAL ] ELC: Derivative data saved (138 records). [2025-10-28T22:11:01.114293] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-28T22:11:01.116429] [INFO ] [MAIN ] Derivative Progress: 565/2046 symbols completed. ELC took 1.2s. Estimated remaining: 10m 5s. Rate: 146.9 symbols/min [2025-10-28T22:11:01.116671] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:01.153545] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:01.155774] [INFO ] [MAIN ] ELP: Generated 138 derivative records from 25193 primary records. [2025-10-28T22:11:01.156080] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-28T22:11:01.179377] [DEBUG] [LOCAL ] ELP: Derivative data saved (138 records). [2025-10-28T22:11:01.179542] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-28T22:11:01.197399] [INFO ] [MAIN ] Derivative Progress: 566/2046 symbols completed. ELP took 1.0s. Estimated remaining: 10m 3s. Rate: 147.2 symbols/min [2025-10-28T22:11:01.199375] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:01.230251] [DEBUG] [LOCAL ] ELV: Loaded 50655 existing records from primary storage. [2025-10-28T22:11:01.234266] [INFO ] [MAIN ] ELV: Loaded 50655 primary data records. [2025-10-28T22:11:01.242448] [DEBUG] [LOCAL ] EMD: Loaded 20344 existing records from primary storage. [2025-10-28T22:11:01.273565] [INFO ] [MAIN ] EMD: Loaded 20344 primary data records. [2025-10-28T22:11:01.398412] [INFO ] [MAIN ] ELS: Generated 138 derivative records from 49824 primary records. [2025-10-28T22:11:01.421615] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-28T22:11:01.635850] [DEBUG] [LOCAL ] ELS: Derivative data saved (138 records). [2025-10-28T22:11:01.757816] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-28T22:11:01.778524] [INFO ] [MAIN ] Derivative Progress: 567/2046 symbols completed. ELS took 1.4s. Estimated remaining: 10m 4s. Rate: 147.0 symbols/min [2025-10-28T22:11:01.807570] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:01.952126] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:01.989868] [DEBUG] [LOCAL ] EME: Loaded 30406 existing records from primary storage. [2025-10-28T22:11:01.991773] [INFO ] [MAIN ] EME: Loaded 30406 primary data records. [2025-10-28T22:11:02.167360] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:02.337130] [INFO ] [MAIN ] ELV: Generated 138 derivative records from 50655 primary records. [2025-10-28T22:11:02.338758] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-28T22:11:02.356295] [DEBUG] [LOCAL ] ELV: Derivative data saved (138 records). [2025-10-28T22:11:02.358788] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-28T22:11:02.361713] [INFO ] [MAIN ] Derivative Progress: 568/2046 symbols completed. ELV took 1.2s. Estimated remaining: 10m 4s. Rate: 146.9 symbols/min [2025-10-28T22:11:02.380174] [INFO ] [MAIN ] EMD: Generated 138 derivative records from 20344 primary records. [2025-10-28T22:11:02.380594] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-28T22:11:02.396440] [DEBUG] [LOCAL ] EMD: Derivative data saved (138 records). [2025-10-28T22:11:02.396688] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-28T22:11:02.399247] [INFO ] [MAIN ] Derivative Progress: 569/2046 symbols completed. EMD took 1.2s. Estimated remaining: 10m 2s. Rate: 147.2 symbols/min [2025-10-28T22:11:02.411618] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:02.436604] [INFO ] [MAIN ] EME: Generated 138 derivative records from 30406 primary records. [2025-10-28T22:11:02.436753] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-28T22:11:02.448177] [DEBUG] [LOCAL ] EME: Derivative data saved (138 records). [2025-10-28T22:11:02.448239] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-28T22:11:02.450944] [INFO ] [MAIN ] Derivative Progress: 570/2046 symbols completed. EME took 0.6s. Estimated remaining: 10m 1s. Rate: 147.4 symbols/min [2025-10-28T22:11:02.451285] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:02.451412] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:02.451845] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:02.457714] [DEBUG] [LOCAL ] EMF: Loaded 2985 existing records from primary storage. [2025-10-28T22:11:02.458054] [INFO ] [MAIN ] EMF: Loaded 2985 primary data records. [2025-10-28T22:11:02.580421] [DEBUG] [LOCAL ] EMO: Loaded 13310 existing records from primary storage. [2025-10-28T22:11:02.580681] [INFO ] [MAIN ] EMO: Loaded 13310 primary data records. [2025-10-28T22:11:02.944214] [DEBUG] [LOCAL ] EMN: Loaded 50800 existing records from primary storage. [2025-10-28T22:11:02.996841] [INFO ] [MAIN ] EMN: Loaded 50800 primary data records. [2025-10-28T22:11:03.499836] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:03.534287] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:03.599850] [INFO ] [MAIN ] EMF: Generated 138 derivative records from 2985 primary records. [2025-10-28T22:11:03.597559] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:03.600250] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-28T22:11:03.632247] [DEBUG] [LOCAL ] EMF: Derivative data saved (138 records). [2025-10-28T22:11:03.636235] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-28T22:11:03.640885] [INFO ] [MAIN ] Derivative Progress: 571/2046 symbols completed. EMF took 1.2s. Estimated remaining: 10m 2s. Rate: 146.9 symbols/min [2025-10-28T22:11:03.642378] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:03.651615] [INFO ] [MAIN ] EMO: Generated 138 derivative records from 13310 primary records. [2025-10-28T22:11:03.655729] [DEBUG] [LOCAL ] EMP: Loaded 2819 existing records from primary storage. [2025-10-28T22:11:03.655834] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-28T22:11:03.657237] [INFO ] [MAIN ] EMP: Loaded 2819 primary data records. [2025-10-28T22:11:03.718871] [DEBUG] [LOCAL ] EMO: Derivative data saved (138 records). [2025-10-28T22:11:03.727600] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-28T22:11:03.754031] [INFO ] [MAIN ] Derivative Progress: 572/2046 symbols completed. EMO took 1.3s. Estimated remaining: 10m 1s. Rate: 147.1 symbols/min [2025-10-28T22:11:03.764467] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:03.982241] [INFO ] [MAIN ] EMN: Generated 138 derivative records from 50800 primary records. [2025-10-28T22:11:03.982940] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-28T22:11:04.005184] [DEBUG] [LOCAL ] EMN: Derivative data saved (138 records). [2025-10-28T22:11:04.005588] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-28T22:11:04.007993] [INFO ] [MAIN ] Derivative Progress: 573/2046 symbols completed. EMN took 1.6s. Estimated remaining: 10m 0s. Rate: 147.2 symbols/min [2025-10-28T22:11:04.008438] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:04.012251] [DEBUG] [LOCAL ] ENO: Loaded 1587 existing records from primary storage. [2025-10-28T22:11:04.012680] [INFO ] [MAIN ] ENO: Loaded 1587 primary data records. [2025-10-28T22:11:04.143703] [DEBUG] [LOCAL ] ENIC: Loaded 35951 existing records from primary storage. [2025-10-28T22:11:04.149309] [INFO ] [MAIN ] ENIC: Loaded 35951 primary data records. [2025-10-28T22:11:04.447244] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:04.697593] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:11:04.720165] [INFO ] [MAIN ] EMP: Generated 138 derivative records from 2819 primary records. [2025-10-28T22:11:04.723717] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-28T22:11:04.739117] [DEBUG] [LOCAL ] EMP: Derivative data saved (138 records). [2025-10-28T22:11:04.744485] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-28T22:11:04.760685] [INFO ] [MAIN ] Derivative Progress: 574/2046 symbols completed. EMP took 1.1s. Estimated remaining: 10m 1s. Rate: 147.0 symbols/min [2025-10-28T22:11:04.761062] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:04.761454] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:04.811616] [INFO ] [MAIN ] ENO: Generated 138 derivative records from 1587 primary records. [2025-10-28T22:11:04.812361] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-28T22:11:04.840180] [DEBUG] [LOCAL ] ENO: Derivative data saved (138 records). [2025-10-28T22:11:04.842818] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-28T22:11:04.846808] [DEBUG] [LOCAL ] ENS: Loaded 29403 existing records from primary storage. [2025-10-28T22:11:04.845546] [INFO ] [MAIN ] Derivative Progress: 575/2046 symbols completed. ENO took 0.8s. Estimated remaining: 9m 60s. Rate: 147.2 symbols/min [2025-10-28T22:11:04.847013] [INFO ] [MAIN ] ENS: Loaded 29403 primary data records. [2025-10-28T22:11:04.847274] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:04.927367] [INFO ] [MAIN ] ENIC: Generated 138 derivative records from 35951 primary records. [2025-10-28T22:11:04.951354] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-28T22:11:04.987976] [DEBUG] [LOCAL ] ENIC: Derivative data saved (138 records). [2025-10-28T22:11:05.007390] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-28T22:11:05.048080] [INFO ] [MAIN ] Derivative Progress: 576/2046 symbols completed. ENIC took 1.3s. Estimated remaining: 9m 59s. Rate: 147.3 symbols/min [2025-10-28T22:11:05.161677] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:05.187434] [DEBUG] [LOCAL ] EOI: Loaded 9917 existing records from primary storage. [2025-10-28T22:11:05.188071] [INFO ] [MAIN ] EOI: Loaded 9917 primary data records. [2025-10-28T22:11:05.330998] [DEBUG] [LOCAL ] EOG: Loaded 53388 existing records from primary storage. [2025-10-28T22:11:05.363767] [INFO ] [MAIN ] EOG: Loaded 53388 primary data records. [2025-10-28T22:11:05.745402] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:05.915558] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:05.928612] [INFO ] [MAIN ] ENS: Generated 138 derivative records from 29403 primary records. [2025-10-28T22:11:05.931842] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-28T22:11:05.949892] [DEBUG] [LOCAL ] ENS: Derivative data saved (138 records). [2025-10-28T22:11:05.951555] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-28T22:11:05.963688] [INFO ] [MAIN ] Derivative Progress: 577/2046 symbols completed. ENS took 1.2s. Estimated remaining: 9m 60s. Rate: 147.0 symbols/min [2025-10-28T22:11:05.963863] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:05.972533] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:06.016198] [DEBUG] [LOCAL ] EOS: Loaded 14269 existing records from primary storage. [2025-10-28T22:11:06.016542] [INFO ] [MAIN ] EOS: Loaded 14269 primary data records. [2025-10-28T22:11:06.094075] [INFO ] [MAIN ] EOI: Generated 138 derivative records from 9917 primary records. [2025-10-28T22:11:06.106172] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-28T22:11:06.160049] [DEBUG] [LOCAL ] EOI: Derivative data saved (138 records). [2025-10-28T22:11:06.183909] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-28T22:11:06.219684] [INFO ] [MAIN ] Derivative Progress: 578/2046 symbols completed. EOI took 1.1s. Estimated remaining: 9m 59s. Rate: 147.1 symbols/min [2025-10-28T22:11:06.340997] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:06.341229] [INFO ] [MAIN ] EOG: Generated 138 derivative records from 53388 primary records. [2025-10-28T22:11:06.342008] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-28T22:11:06.358857] [DEBUG] [LOCAL ] EOG: Derivative data saved (138 records). [2025-10-28T22:11:06.359408] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-28T22:11:06.362154] [INFO ] [MAIN ] Derivative Progress: 579/2046 symbols completed. EOG took 1.5s. Estimated remaining: 9m 58s. Rate: 147.2 symbols/min [2025-10-28T22:11:06.362629] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:06.366461] [DEBUG] [LOCAL ] EOT: Loaded 6982 existing records from primary storage. [2025-10-28T22:11:06.366971] [INFO ] [MAIN ] EOT: Loaded 6982 primary data records. [2025-10-28T22:11:06.554095] [DEBUG] [LOCAL ] EPAC: Loaded 25996 existing records from primary storage. [2025-10-28T22:11:06.687190] [INFO ] [MAIN ] EPAC: Loaded 25996 primary data records. [2025-10-28T22:11:06.774875] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:07.066257] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:07.090952] [INFO ] [MAIN ] EOS: Generated 138 derivative records from 14269 primary records. [2025-10-28T22:11:07.091399] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-28T22:11:07.110662] [DEBUG] [LOCAL ] EOS: Derivative data saved (138 records). [2025-10-28T22:11:07.111892] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-28T22:11:07.114121] [INFO ] [MAIN ] Derivative Progress: 580/2046 symbols completed. EOS took 1.2s. Estimated remaining: 9m 58s. Rate: 147.0 symbols/min [2025-10-28T22:11:07.118498] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:07.132938] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:07.163197] [INFO ] [MAIN ] EOT: Generated 138 derivative records from 6982 primary records. [2025-10-28T22:11:07.167871] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-28T22:11:07.193487] [DEBUG] [LOCAL ] EOT: Derivative data saved (138 records). [2025-10-28T22:11:07.195129] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-28T22:11:07.197613] [INFO ] [MAIN ] Derivative Progress: 581/2046 symbols completed. EOT took 0.9s. Estimated remaining: 9m 57s. Rate: 147.2 symbols/min [2025-10-28T22:11:07.201438] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:07.218000] [DEBUG] [LOCAL ] EPAM: Loaded 38976 existing records from primary storage. [2025-10-28T22:11:07.218422] [INFO ] [MAIN ] EPAC: Generated 138 derivative records from 25996 primary records. [2025-10-28T22:11:07.218518] [INFO ] [MAIN ] EPAM: Loaded 38976 primary data records. [2025-10-28T22:11:07.218592] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-28T22:11:07.307430] [DEBUG] [LOCAL ] EPAC: Derivative data saved (138 records). [2025-10-28T22:11:07.333315] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-28T22:11:07.357219] [INFO ] [MAIN ] Derivative Progress: 582/2046 symbols completed. EPAC took 1.0s. Estimated remaining: 9m 56s. Rate: 147.4 symbols/min [2025-10-28T22:11:07.357468] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:07.576951] [DEBUG] [LOCAL ] EPC: Loaded 39562 existing records from primary storage. [2025-10-28T22:11:07.577707] [INFO ] [MAIN ] EPC: Loaded 39562 primary data records. [2025-10-28T22:11:07.947604] [DEBUG] [LOCAL ] EPD: Loaded 53606 existing records from primary storage. [2025-10-28T22:11:07.948079] [INFO ] [MAIN ] EPD: Loaded 53606 primary data records. [2025-10-28T22:11:08.100114] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:08.306931] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:08.349934] [INFO ] [MAIN ] EPAM: Generated 138 derivative records from 38976 primary records. [2025-10-28T22:11:08.350464] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-28T22:11:08.379294] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:08.394744] [DEBUG] [LOCAL ] EPAM: Derivative data saved (138 records). [2025-10-28T22:11:08.396559] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-28T22:11:08.399012] [INFO ] [MAIN ] Derivative Progress: 583/2046 symbols completed. EPAM took 1.3s. Estimated remaining: 9m 57s. Rate: 147.0 symbols/min [2025-10-28T22:11:08.410096] [INFO ] [MAIN ] EPC: Generated 138 derivative records from 39562 primary records. [2025-10-28T22:11:08.412385] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-28T22:11:08.429776] [DEBUG] [LOCAL ] EPC: Derivative data saved (138 records). [2025-10-28T22:11:08.430157] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-28T22:11:08.433475] [INFO ] [MAIN ] Derivative Progress: 584/2046 symbols completed. EPC took 1.2s. Estimated remaining: 9m 56s. Rate: 147.2 symbols/min [2025-10-28T22:11:08.438019] [INFO ] [MAIN ] EPD: Generated 138 derivative records from 53606 primary records. [2025-10-28T22:11:08.438090] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-28T22:11:08.449926] [DEBUG] [LOCAL ] EPD: Derivative data saved (138 records). [2025-10-28T22:11:08.449991] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-28T22:11:08.452237] [INFO ] [MAIN ] Derivative Progress: 585/2046 symbols completed. EPD took 1.1s. Estimated remaining: 9m 54s. Rate: 147.5 symbols/min [2025-10-28T22:11:08.452666] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:08.453031] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:08.453216] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:08.510858] [DEBUG] [LOCAL ] EPR: Loaded 43440 existing records from primary storage. [2025-10-28T22:11:08.511006] [INFO ] [MAIN ] EPR: Loaded 43440 primary data records. [2025-10-28T22:11:08.625764] [DEBUG] [LOCAL ] EPRT: Loaded 48419 existing records from primary storage. [2025-10-28T22:11:08.625969] [INFO ] [MAIN ] EPRT: Loaded 48419 primary data records. [2025-10-28T22:11:08.638561] [DEBUG] [LOCAL ] EQH: Loaded 52655 existing records from primary storage. [2025-10-28T22:11:08.667586] [INFO ] [MAIN ] EQH: Loaded 52655 primary data records. [2025-10-28T22:11:09.467084] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:09.496131] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:09.525806] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:09.578810] [INFO ] [MAIN ] EPR: Generated 138 derivative records from 43440 primary records. [2025-10-28T22:11:09.582107] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-28T22:11:09.598393] [DEBUG] [LOCAL ] EPR: Derivative data saved (138 records). [2025-10-28T22:11:09.600875] [INFO ] [MAIN ] EQH: Generated 138 derivative records from 52655 primary records. [2025-10-28T22:11:09.601247] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-28T22:11:09.601123] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-28T22:11:09.603507] [INFO ] [MAIN ] Derivative Progress: 586/2046 symbols completed. EPR took 1.2s. Estimated remaining: 9m 56s. Rate: 147.0 symbols/min [2025-10-28T22:11:09.605458] [INFO ] [MAIN ] EPRT: Generated 138 derivative records from 48419 primary records. [2025-10-28T22:11:09.605560] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-28T22:11:09.606132] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:09.629434] [DEBUG] [LOCAL ] EQH: Derivative data saved (138 records). [2025-10-28T22:11:09.629541] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-28T22:11:09.632123] [INFO ] [MAIN ] Derivative Progress: 587/2046 symbols completed. EQH took 1.2s. Estimated remaining: 9m 55s. Rate: 147.2 symbols/min [2025-10-28T22:11:09.628345] [DEBUG] [LOCAL ] EPRT: Derivative data saved (138 records). [2025-10-28T22:11:09.632365] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:09.632781] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-28T22:11:09.635265] [INFO ] [MAIN ] Derivative Progress: 588/2046 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 53s. Rate: 147.5 symbols/min [2025-10-28T22:11:09.635515] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:09.640085] [DEBUG] [LOCAL ] EQV: Loaded 2819 existing records from primary storage. [2025-10-28T22:11:09.640394] [INFO ] [MAIN ] EQV: Loaded 2819 primary data records. [2025-10-28T22:11:10.008231] [DEBUG] [LOCAL ] EQNR: Loaded 53041 existing records from primary storage. [2025-10-28T22:11:10.008386] [INFO ] [MAIN ] EQNR: Loaded 53041 primary data records. [2025-10-28T22:11:10.119299] [DEBUG] [LOCAL ] ERJ: Loaded 50209 existing records from primary storage. [2025-10-28T22:11:10.131352] [INFO ] [MAIN ] ERJ: Loaded 50209 primary data records. [2025-10-28T22:11:10.643756] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:10.690034] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:10.733593] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:10.758758] [INFO ] [MAIN ] EQV: Generated 138 derivative records from 2819 primary records. [2025-10-28T22:11:10.762737] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-28T22:11:10.779251] [DEBUG] [LOCAL ] EQV: Derivative data saved (138 records). [2025-10-28T22:11:10.780857] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-28T22:11:10.783170] [INFO ] [MAIN ] Derivative Progress: 589/2046 symbols completed. EQV took 1.2s. Estimated remaining: 9m 55s. Rate: 147.0 symbols/min [2025-10-28T22:11:10.787389] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:10.805814] [INFO ] [MAIN ] EQNR: Generated 138 derivative records from 53041 primary records. [2025-10-28T22:11:10.806462] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-28T22:11:10.837588] [DEBUG] [LOCAL ] EQNR: Derivative data saved (138 records). [2025-10-28T22:11:10.840306] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-28T22:11:10.840171] [INFO ] [MAIN ] ERJ: Generated 138 derivative records from 50209 primary records. [2025-10-28T22:11:10.842242] [INFO ] [MAIN ] Derivative Progress: 590/2046 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 53s. Rate: 147.2 symbols/min [2025-10-28T22:11:10.842532] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:10.842445] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-28T22:11:10.855614] [DEBUG] [LOCAL ] ERJ: Derivative data saved (138 records). [2025-10-28T22:11:10.855971] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-28T22:11:10.859543] [INFO ] [MAIN ] Derivative Progress: 591/2046 symbols completed. ERJ took 1.2s. Estimated remaining: 9m 52s. Rate: 147.5 symbols/min [2025-10-28T22:11:10.859950] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:10.873494] [DEBUG] [LOCAL ] ERO: Loaded 41989 existing records from primary storage. [2025-10-28T22:11:10.873772] [INFO ] [MAIN ] ERO: Loaded 41989 primary data records. [2025-10-28T22:11:11.091692] [DEBUG] [LOCAL ] ESAB: Loaded 25690 existing records from primary storage. [2025-10-28T22:11:11.097707] [INFO ] [MAIN ] ESAB: Loaded 25690 primary data records. [2025-10-28T22:11:11.291006] [DEBUG] [LOCAL ] ES: Loaded 52680 existing records from primary storage. [2025-10-28T22:11:11.320042] [INFO ] [MAIN ] ES: Loaded 52680 primary data records. [2025-10-28T22:11:11.917073] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:11.972029] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:11.999511] [INFO ] [MAIN ] ERO: Generated 138 derivative records from 41989 primary records. [2025-10-28T22:11:12.013679] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-28T22:11:12.015289] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:12.047716] [DEBUG] [LOCAL ] ERO: Derivative data saved (138 records). [2025-10-28T22:11:12.052691] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-28T22:11:12.054995] [INFO ] [MAIN ] Derivative Progress: 592/2046 symbols completed. ERO took 1.3s. Estimated remaining: 9m 53s. Rate: 147.0 symbols/min [2025-10-28T22:11:12.058135] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:12.094377] [INFO ] [MAIN ] ESAB: Generated 138 derivative records from 25690 primary records. [2025-10-28T22:11:12.094687] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-28T22:11:12.099454] [DEBUG] [LOCAL ] ESE: Loaded 16155 existing records from primary storage. [2025-10-28T22:11:12.101098] [INFO ] [MAIN ] ESE: Loaded 16155 primary data records. [2025-10-28T22:11:12.124538] [DEBUG] [LOCAL ] ESAB: Derivative data saved (138 records). [2025-10-28T22:11:12.156676] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-28T22:11:12.192908] [INFO ] [MAIN ] Derivative Progress: 593/2046 symbols completed. ESAB took 1.3s. Estimated remaining: 9m 52s. Rate: 147.2 symbols/min [2025-10-28T22:11:12.190990] [INFO ] [MAIN ] ES: Generated 138 derivative records from 52680 primary records. [2025-10-28T22:11:12.203506] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:12.203404] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-28T22:11:12.369981] [DEBUG] [LOCAL ] ES: Derivative data saved (138 records). [2025-10-28T22:11:12.436387] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-28T22:11:12.439279] [INFO ] [MAIN ] Derivative Progress: 594/2046 symbols completed. ES took 1.6s. Estimated remaining: 9m 52s. Rate: 147.3 symbols/min [2025-10-28T22:11:12.439752] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:12.482040] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:12.520793] [DEBUG] [LOCAL ] ESI: Loaded 50572 existing records from primary storage. [2025-10-28T22:11:12.524905] [INFO ] [MAIN ] ESI: Loaded 50572 primary data records. [2025-10-28T22:11:12.636840] [DEBUG] [LOCAL ] ESRT: Loaded 46380 existing records from primary storage. [2025-10-28T22:11:12.655826] [INFO ] [MAIN ] ESRT: Loaded 46380 primary data records. [2025-10-28T22:11:13.165316] [INFO ] [MAIN ] ESE: Generated 138 derivative records from 16155 primary records. [2025-10-28T22:11:13.165724] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-28T22:11:13.180412] [DEBUG] [LOCAL ] ESE: Derivative data saved (138 records). [2025-10-28T22:11:13.181053] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-28T22:11:13.183364] [INFO ] [MAIN ] Derivative Progress: 595/2046 symbols completed. ESE took 1.1s. Estimated remaining: 9m 52s. Rate: 147.1 symbols/min [2025-10-28T22:11:13.183908] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:13.207768] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:13.243255] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:13.268957] [DEBUG] [LOCAL ] ESS: Loaded 29980 existing records from primary storage. [2025-10-28T22:11:13.272589] [INFO ] [MAIN ] ESS: Loaded 29980 primary data records. [2025-10-28T22:11:13.602883] [INFO ] [MAIN ] ESI: Generated 138 derivative records from 50572 primary records. [2025-10-28T22:11:13.605730] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-28T22:11:13.619895] [DEBUG] [LOCAL ] ESI: Derivative data saved (138 records). [2025-10-28T22:11:13.620098] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-28T22:11:13.625315] [INFO ] [MAIN ] Derivative Progress: 596/2046 symbols completed. ESI took 1.4s. Estimated remaining: 9m 52s. Rate: 147.0 symbols/min [2025-10-28T22:11:13.625753] [INFO ] [MAIN ] ESRT: Generated 138 derivative records from 46380 primary records. [2025-10-28T22:11:13.626217] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-28T22:11:13.626376] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:13.639966] [DEBUG] [LOCAL ] ESRT: Derivative data saved (138 records). [2025-10-28T22:11:13.640186] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-28T22:11:13.642154] [INFO ] [MAIN ] Derivative Progress: 597/2046 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 50s. Rate: 147.3 symbols/min [2025-10-28T22:11:13.642550] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:13.660559] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:13.728801] [DEBUG] [LOCAL ] ESTC: Loaded 50182 existing records from primary storage. [2025-10-28T22:11:13.730120] [INFO ] [MAIN ] ESTC: Loaded 50182 primary data records. [2025-10-28T22:11:13.732240] [INFO ] [MAIN ] ESS: Generated 138 derivative records from 29980 primary records. [2025-10-28T22:11:13.744828] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-28T22:11:13.824571] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-28T22:11:13.830193] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-28T22:11:13.922413] [DEBUG] [LOCAL ] ESS: Derivative data saved (138 records). [2025-10-28T22:11:13.959769] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-28T22:11:14.039050] [INFO ] [MAIN ] Derivative Progress: 598/2046 symbols completed. ESS took 0.9s. Estimated remaining: 9m 50s. Rate: 147.3 symbols/min [2025-10-28T22:11:14.398187] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:14.436501] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:14.465233] [INFO ] [MAIN ] ESTC: Generated 138 derivative records from 50182 primary records. [2025-10-28T22:11:14.467742] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-28T22:11:14.483298] [DEBUG] [LOCAL ] ESTC: Derivative data saved (138 records). [2025-10-28T22:11:14.486610] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-28T22:11:14.488990] [INFO ] [MAIN ] Derivative Progress: 599/2046 symbols completed. ESTC took 0.9s. Estimated remaining: 9m 50s. Rate: 147.3 symbols/min [2025-10-28T22:11:14.491905] [INFO ] [MAIN ] ET: Generated 138 derivative records from 53789 primary records. [2025-10-28T22:11:14.492071] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-28T22:11:14.504822] [DEBUG] [LOCAL ] ET: Derivative data saved (138 records). [2025-10-28T22:11:14.504894] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-28T22:11:14.506866] [INFO ] [MAIN ] Derivative Progress: 600/2046 symbols completed. ET took 0.9s. Estimated remaining: 9m 48s. Rate: 147.5 symbols/min [2025-10-28T22:11:14.507252] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:14.507367] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:14.507481] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:14.524075] [DEBUG] [LOCAL ] ETB: Loaded 11398 existing records from primary storage. [2025-10-28T22:11:14.524337] [INFO ] [MAIN ] ETB: Loaded 11398 primary data records. [2025-10-28T22:11:14.612543] [DEBUG] [LOCAL ] ETG: Loaded 16124 existing records from primary storage. [2025-10-28T22:11:14.636412] [INFO ] [MAIN ] ETG: Loaded 16124 primary data records. [2025-10-28T22:11:14.659473] [DEBUG] [LOCAL ] ETD: Loaded 26545 existing records from primary storage. [2025-10-28T22:11:14.671438] [INFO ] [MAIN ] ETD: Loaded 26545 primary data records. [2025-10-28T22:11:15.522691] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:15.554319] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:15.586194] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:15.641824] [INFO ] [MAIN ] ETB: Generated 138 derivative records from 11398 primary records. [2025-10-28T22:11:15.642280] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-28T22:11:15.659157] [DEBUG] [LOCAL ] ETB: Derivative data saved (138 records). [2025-10-28T22:11:15.661243] [INFO ] [MAIN ] ETG: Generated 138 derivative records from 16124 primary records. [2025-10-28T22:11:15.661116] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-28T22:11:15.663418] [INFO ] [MAIN ] Derivative Progress: 601/2046 symbols completed. ETB took 1.2s. Estimated remaining: 9m 50s. Rate: 147.0 symbols/min [2025-10-28T22:11:15.661450] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-28T22:11:15.663576] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:15.678480] [DEBUG] [LOCAL ] ETG: Derivative data saved (138 records). [2025-10-28T22:11:15.678594] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-28T22:11:15.680729] [INFO ] [MAIN ] Derivative Progress: 602/2046 symbols completed. ETG took 1.2s. Estimated remaining: 9m 48s. Rate: 147.3 symbols/min [2025-10-28T22:11:15.682871] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:15.683756] [INFO ] [MAIN ] ETD: Generated 138 derivative records from 26545 primary records. [2025-10-28T22:11:15.683984] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-28T22:11:15.703620] [DEBUG] [LOCAL ] ETD: Derivative data saved (138 records). [2025-10-28T22:11:15.709163] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-28T22:11:15.709460] [DEBUG] [LOCAL ] ETJ: Loaded 15711 existing records from primary storage. [2025-10-28T22:11:15.711776] [INFO ] [MAIN ] Derivative Progress: 603/2046 symbols completed. ETD took 1.2s. Estimated remaining: 9m 47s. Rate: 147.5 symbols/min [2025-10-28T22:11:15.712046] [INFO ] [MAIN ] ETJ: Loaded 15711 primary data records. [2025-10-28T22:11:15.712252] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:15.832076] [DEBUG] [LOCAL ] ETO: Loaded 6682 existing records from primary storage. [2025-10-28T22:11:15.832321] [INFO ] [MAIN ] ETO: Loaded 6682 primary data records. [2025-10-28T22:11:16.161935] [DEBUG] [LOCAL ] ETN: Loaded 52498 existing records from primary storage. [2025-10-28T22:11:16.171136] [INFO ] [MAIN ] ETN: Loaded 52498 primary data records. [2025-10-28T22:11:16.682725] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:16.717941] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:16.772359] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:16.795070] [INFO ] [MAIN ] ETJ: Generated 138 derivative records from 15711 primary records. [2025-10-28T22:11:16.799184] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-28T22:11:16.819488] [DEBUG] [LOCAL ] ETJ: Derivative data saved (138 records). [2025-10-28T22:11:16.820761] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-28T22:11:16.823158] [INFO ] [MAIN ] Derivative Progress: 604/2046 symbols completed. ETJ took 1.2s. Estimated remaining: 9m 48s. Rate: 147.1 symbols/min [2025-10-28T22:11:16.823435] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:16.828107] [INFO ] [MAIN ] ETO: Generated 138 derivative records from 6682 primary records. [2025-10-28T22:11:16.828862] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-28T22:11:16.844398] [DEBUG] [LOCAL ] ETO: Derivative data saved (138 records). [2025-10-28T22:11:16.844604] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-28T22:11:16.846554] [INFO ] [MAIN ] Derivative Progress: 605/2046 symbols completed. ETO took 1.1s. Estimated remaining: 9m 47s. Rate: 147.3 symbols/min [2025-10-28T22:11:16.846819] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:16.850395] [INFO ] [MAIN ] ETN: Generated 138 derivative records from 52498 primary records. [2025-10-28T22:11:16.850720] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-28T22:11:16.863314] [DEBUG] [LOCAL ] ETN: Derivative data saved (138 records). [2025-10-28T22:11:16.863390] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-28T22:11:16.865932] [INFO ] [MAIN ] Derivative Progress: 606/2046 symbols completed. ETN took 1.2s. Estimated remaining: 9m 46s. Rate: 147.5 symbols/min [2025-10-28T22:11:16.866226] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:16.895739] [DEBUG] [LOCAL ] ETV: Loaded 21314 existing records from primary storage. [2025-10-28T22:11:16.896066] [INFO ] [MAIN ] ETV: Loaded 21314 primary data records. [2025-10-28T22:11:17.028542] [DEBUG] [LOCAL ] ETW: Loaded 24557 existing records from primary storage. [2025-10-28T22:11:17.024512] [DEBUG] [LOCAL ] ETR: Loaded 53167 existing records from primary storage. [2025-10-28T22:11:17.039525] [INFO ] [MAIN ] ETR: Loaded 53167 primary data records. [2025-10-28T22:11:17.034281] [INFO ] [MAIN ] ETW: Loaded 24557 primary data records. [2025-10-28T22:11:17.828606] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:17.913879] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:17.945952] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:17.988437] [INFO ] [MAIN ] ETV: Generated 138 derivative records from 21314 primary records. [2025-10-28T22:11:17.989340] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-28T22:11:18.009399] [DEBUG] [LOCAL ] ETV: Derivative data saved (138 records). [2025-10-28T22:11:18.009698] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-28T22:11:18.011868] [INFO ] [MAIN ] Derivative Progress: 607/2046 symbols completed. ETV took 1.2s. Estimated remaining: 9m 47s. Rate: 147.1 symbols/min [2025-10-28T22:11:18.016712] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:18.030102] [INFO ] [MAIN ] ETR: Generated 138 derivative records from 53167 primary records. [2025-10-28T22:11:18.032271] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-28T22:11:18.032177] [INFO ] [MAIN ] ETW: Generated 138 derivative records from 24557 primary records. [2025-10-28T22:11:18.032886] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-28T22:11:18.051159] [DEBUG] [LOCAL ] ETR: Derivative data saved (138 records). [2025-10-28T22:11:18.051311] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-28T22:11:18.053677] [INFO ] [MAIN ] Derivative Progress: 608/2046 symbols completed. ETR took 1.2s. Estimated remaining: 9m 46s. Rate: 147.3 symbols/min [2025-10-28T22:11:18.061319] [DEBUG] [LOCAL ] EVC: Loaded 17402 existing records from primary storage. [2025-10-28T22:11:18.053831] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:18.061890] [INFO ] [MAIN ] EVC: Loaded 17402 primary data records. [2025-10-28T22:11:18.066524] [DEBUG] [LOCAL ] ETW: Derivative data saved (138 records). [2025-10-28T22:11:18.066756] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-28T22:11:18.080151] [INFO ] [MAIN ] Derivative Progress: 609/2046 symbols completed. ETW took 1.2s. Estimated remaining: 9m 44s. Rate: 147.5 symbols/min [2025-10-28T22:11:18.092763] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:18.197235] [DEBUG] [LOCAL ] EVF: Loaded 9375 existing records from primary storage. [2025-10-28T22:11:18.216774] [INFO ] [MAIN ] EVF: Loaded 9375 primary data records. [2025-10-28T22:11:18.287527] [DEBUG] [LOCAL ] EVEX: Loaded 33359 existing records from primary storage. [2025-10-28T22:11:18.465823] [INFO ] [MAIN ] EVEX: Loaded 33359 primary data records. [2025-10-28T22:11:19.014529] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:19.056767] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:19.084709] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:19.115541] [INFO ] [MAIN ] EVC: Generated 138 derivative records from 17402 primary records. [2025-10-28T22:11:19.117850] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-28T22:11:19.133009] [DEBUG] [LOCAL ] EVC: Derivative data saved (138 records). [2025-10-28T22:11:19.135781] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-28T22:11:19.140614] [INFO ] [MAIN ] Derivative Progress: 610/2046 symbols completed. EVC took 1.1s. Estimated remaining: 9m 46s. Rate: 147.2 symbols/min [2025-10-28T22:11:19.144836] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:19.160249] [DEBUG] [LOCAL ] EVG: Loaded 5672 existing records from primary storage. [2025-10-28T22:11:19.160582] [INFO ] [MAIN ] EVG: Loaded 5672 primary data records. [2025-10-28T22:11:19.199431] [INFO ] [MAIN ] EVF: Generated 138 derivative records from 9375 primary records. [2025-10-28T22:11:19.241442] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-28T22:11:19.280399] [DEBUG] [LOCAL ] EVF: Derivative data saved (138 records). [2025-10-28T22:11:19.280531] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-28T22:11:19.295215] [INFO ] [MAIN ] Derivative Progress: 611/2046 symbols completed. EVF took 1.2s. Estimated remaining: 9m 45s. Rate: 147.3 symbols/min [2025-10-28T22:11:19.300679] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:19.301023] [INFO ] [MAIN ] EVEX: Generated 138 derivative records from 33359 primary records. [2025-10-28T22:11:19.324044] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-28T22:11:19.487216] [DEBUG] [LOCAL ] EVEX: Derivative data saved (138 records). [2025-10-28T22:11:19.487376] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-28T22:11:19.489434] [INFO ] [MAIN ] Derivative Progress: 612/2046 symbols completed. EVEX took 1.4s. Estimated remaining: 9m 44s. Rate: 147.4 symbols/min [2025-10-28T22:11:19.489786] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:19.503707] [DEBUG] [LOCAL ] EVN: Loaded 10875 existing records from primary storage. [2025-10-28T22:11:19.503831] [INFO ] [MAIN ] EVN: Loaded 10875 primary data records. [2025-10-28T22:11:19.812815] [DEBUG] [LOCAL ] EVH: Loaded 49543 existing records from primary storage. [2025-10-28T22:11:19.841311] [INFO ] [MAIN ] EVH: Loaded 49543 primary data records. [2025-10-28T22:11:19.841769] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:20.282235] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:20.296699] [INFO ] [MAIN ] EVG: Generated 138 derivative records from 5672 primary records. [2025-10-28T22:11:20.296869] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-28T22:11:20.312462] [DEBUG] [LOCAL ] EVG: Derivative data saved (138 records). [2025-10-28T22:11:20.312828] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-28T22:11:20.317365] [INFO ] [MAIN ] Derivative Progress: 613/2046 symbols completed. EVG took 1.2s. Estimated remaining: 9m 44s. Rate: 147.2 symbols/min [2025-10-28T22:11:20.344231] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:20.372504] [INFO ] [MAIN ] EVN: Generated 138 derivative records from 10875 primary records. [2025-10-28T22:11:20.372963] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-28T22:11:20.387053] [DEBUG] [LOCAL ] EVN: Derivative data saved (138 records). [2025-10-28T22:11:20.390121] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-28T22:11:20.392612] [INFO ] [MAIN ] Derivative Progress: 614/2046 symbols completed. EVN took 0.9s. Estimated remaining: 9m 43s. Rate: 147.4 symbols/min [2025-10-28T22:11:20.401259] [INFO ] [MAIN ] EVH: Generated 138 derivative records from 49543 primary records. [2025-10-28T22:11:20.401475] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-28T22:11:20.414141] [DEBUG] [LOCAL ] EVH: Derivative data saved (138 records). [2025-10-28T22:11:20.414236] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-28T22:11:20.417559] [INFO ] [MAIN ] Derivative Progress: 615/2046 symbols completed. EVH took 1.1s. Estimated remaining: 9m 42s. Rate: 147.6 symbols/min [2025-10-28T22:11:20.418221] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:20.418395] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:20.418741] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:20.445016] [DEBUG] [LOCAL ] EVT: Loaded 16162 existing records from primary storage. [2025-10-28T22:11:20.452186] [INFO ] [MAIN ] EVT: Loaded 16162 primary data records. [2025-10-28T22:11:20.574068] [DEBUG] [LOCAL ] EVR: Loaded 32859 existing records from primary storage. [2025-10-28T22:11:20.575167] [DEBUG] [LOCAL ] EVTC: Loaded 26510 existing records from primary storage. [2025-10-28T22:11:20.575538] [INFO ] [MAIN ] EVR: Loaded 32859 primary data records. [2025-10-28T22:11:20.575735] [INFO ] [MAIN ] EVTC: Loaded 26510 primary data records. [2025-10-28T22:11:21.382127] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:21.418685] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:21.445318] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:21.503605] [INFO ] [MAIN ] EVT: Generated 138 derivative records from 16162 primary records. [2025-10-28T22:11:21.504015] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-28T22:11:21.522555] [DEBUG] [LOCAL ] EVT: Derivative data saved (138 records). [2025-10-28T22:11:21.523630] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-28T22:11:21.528575] [INFO ] [MAIN ] Derivative Progress: 616/2046 symbols completed. EVT took 1.1s. Estimated remaining: 9m 43s. Rate: 147.2 symbols/min [2025-10-28T22:11:21.530972] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:21.532202] [INFO ] [MAIN ] EVR: Generated 138 derivative records from 32859 primary records. [2025-10-28T22:11:21.532592] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-28T22:11:21.546068] [INFO ] [MAIN ] EVTC: Generated 138 derivative records from 26510 primary records. [2025-10-28T22:11:21.548055] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-28T22:11:21.548132] [DEBUG] [LOCAL ] EVR: Derivative data saved (138 records). [2025-10-28T22:11:21.548530] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-28T22:11:21.551019] [INFO ] [MAIN ] Derivative Progress: 617/2046 symbols completed. EVR took 1.1s. Estimated remaining: 9m 42s. Rate: 147.4 symbols/min [2025-10-28T22:11:21.551218] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:21.562982] [DEBUG] [LOCAL ] EVTC: Derivative data saved (138 records). [2025-10-28T22:11:21.563215] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-28T22:11:21.565439] [INFO ] [MAIN ] Derivative Progress: 618/2046 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 40s. Rate: 147.6 symbols/min [2025-10-28T22:11:21.565783] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:21.584857] [DEBUG] [LOCAL ] EVTR: Loaded 25713 existing records from primary storage. [2025-10-28T22:11:21.585013] [INFO ] [MAIN ] EVTR: Loaded 25713 primary data records. [2025-10-28T22:11:21.816491] [DEBUG] [LOCAL ] EXG: Loaded 32985 existing records from primary storage. [2025-10-28T22:11:21.927849] [INFO ] [MAIN ] EXG: Loaded 32985 primary data records. [2025-10-28T22:11:21.987140] [DEBUG] [LOCAL ] EW: Loaded 53386 existing records from primary storage. [2025-10-28T22:11:22.009471] [INFO ] [MAIN ] EW: Loaded 53386 primary data records. [2025-10-28T22:11:22.605576] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:11:22.641375] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:22.684080] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:22.716636] [INFO ] [MAIN ] EVTR: Generated 138 derivative records from 25713 primary records. [2025-10-28T22:11:22.722114] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-28T22:11:22.737002] [DEBUG] [LOCAL ] EVTR: Derivative data saved (138 records). [2025-10-28T22:11:22.737112] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-28T22:11:22.746693] [INFO ] [MAIN ] Derivative Progress: 619/2046 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 42s. Rate: 147.2 symbols/min [2025-10-28T22:11:22.750892] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:22.756928] [INFO ] [MAIN ] EXG: Generated 138 derivative records from 32985 primary records. [2025-10-28T22:11:22.757486] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-28T22:11:22.773797] [DEBUG] [LOCAL ] EXG: Derivative data saved (138 records). [2025-10-28T22:11:22.774050] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-28T22:11:22.776242] [INFO ] [MAIN ] Derivative Progress: 620/2046 symbols completed. EXG took 1.2s. Estimated remaining: 9m 40s. Rate: 147.4 symbols/min [2025-10-28T22:11:22.776471] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:22.780773] [INFO ] [MAIN ] EW: Generated 138 derivative records from 53386 primary records. [2025-10-28T22:11:22.780952] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-28T22:11:22.793818] [DEBUG] [LOCAL ] EW: Derivative data saved (138 records). [2025-10-28T22:11:22.794085] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-28T22:11:22.796483] [INFO ] [MAIN ] Derivative Progress: 621/2046 symbols completed. EW took 1.2s. Estimated remaining: 9m 39s. Rate: 147.6 symbols/min [2025-10-28T22:11:22.796694] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:22.830381] [DEBUG] [LOCAL ] EXP: Loaded 28717 existing records from primary storage. [2025-10-28T22:11:22.830736] [INFO ] [MAIN ] EXP: Loaded 28717 primary data records. [2025-10-28T22:11:22.962171] [DEBUG] [LOCAL ] EXK: Loaded 53188 existing records from primary storage. [2025-10-28T22:11:22.968030] [INFO ] [MAIN ] EXK: Loaded 53188 primary data records. [2025-10-28T22:11:23.164483] [DEBUG] [LOCAL ] EXPD: Loaded 47457 existing records from primary storage. [2025-10-28T22:11:23.293292] [INFO ] [MAIN ] EXPD: Loaded 47457 primary data records. [2025-10-28T22:11:23.831250] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:23.863942] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:23.903730] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:23.955050] [INFO ] [MAIN ] EXP: Generated 138 derivative records from 28717 primary records. [2025-10-28T22:11:23.956333] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-28T22:11:23.976111] [INFO ] [MAIN ] EXK: Generated 138 derivative records from 53188 primary records. [2025-10-28T22:11:23.975484] [DEBUG] [LOCAL ] EXP: Derivative data saved (138 records). [2025-10-28T22:11:23.977364] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-28T22:11:23.977311] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-28T22:11:23.982171] [INFO ] [MAIN ] EXPD: Generated 138 derivative records from 47457 primary records. [2025-10-28T22:11:23.981475] [INFO ] [MAIN ] Derivative Progress: 622/2046 symbols completed. EXP took 1.2s. Estimated remaining: 9m 41s. Rate: 147.2 symbols/min [2025-10-28T22:11:23.990803] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:23.992405] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-28T22:11:23.994077] [DEBUG] [LOCAL ] EXK: Derivative data saved (138 records). [2025-10-28T22:11:23.994243] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-28T22:11:23.997111] [INFO ] [MAIN ] Derivative Progress: 623/2046 symbols completed. EXK took 1.2s. Estimated remaining: 9m 39s. Rate: 147.4 symbols/min [2025-10-28T22:11:24.004713] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:24.009854] [DEBUG] [LOCAL ] EXPD: Derivative data saved (138 records). [2025-10-28T22:11:24.010176] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-28T22:11:24.012516] [INFO ] [MAIN ] Derivative Progress: 624/2046 symbols completed. EXPD took 1.2s. Estimated remaining: 9m 38s. Rate: 147.6 symbols/min [2025-10-28T22:11:24.012755] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:24.086090] [DEBUG] [LOCAL ] EXR: Loaded 45173 existing records from primary storage. [2025-10-28T22:11:24.086265] [INFO ] [MAIN ] EXR: Loaded 45173 primary data records. [2025-10-28T22:11:24.086912] [DEBUG] [LOCAL ] FAF: Loaded 41201 existing records from primary storage. [2025-10-28T22:11:24.120453] [INFO ] [MAIN ] FAF: Loaded 41201 primary data records. [2025-10-28T22:11:24.260527] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-28T22:11:24.291417] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-28T22:11:25.073774] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:25.074275] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:25.121159] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:25.178118] [INFO ] [MAIN ] EXR: Generated 138 derivative records from 45173 primary records. [2025-10-28T22:11:25.178591] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-28T22:11:25.180921] [INFO ] [MAIN ] FAF: Generated 138 derivative records from 41201 primary records. [2025-10-28T22:11:25.183322] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-28T22:11:25.195938] [DEBUG] [LOCAL ] EXR: Derivative data saved (138 records). [2025-10-28T22:11:25.196088] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-28T22:11:25.199938] [INFO ] [MAIN ] Derivative Progress: 625/2046 symbols completed. EXR took 1.2s. Estimated remaining: 9m 39s. Rate: 147.2 symbols/min [2025-10-28T22:11:25.207107] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:25.212005] [DEBUG] [LOCAL ] FAF: Derivative data saved (138 records). [2025-10-28T22:11:25.213983] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-28T22:11:25.216312] [INFO ] [MAIN ] Derivative Progress: 626/2046 symbols completed. FAF took 1.2s. Estimated remaining: 9m 38s. Rate: 147.4 symbols/min [2025-10-28T22:11:25.216569] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:25.214281] [INFO ] [MAIN ] F: Generated 138 derivative records from 53820 primary records. [2025-10-28T22:11:25.217016] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-28T22:11:25.229788] [DEBUG] [LOCAL ] F: Derivative data saved (138 records). [2025-10-28T22:11:25.230002] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-28T22:11:25.232341] [INFO ] [MAIN ] Derivative Progress: 627/2046 symbols completed. F took 1.2s. Estimated remaining: 9m 37s. Rate: 147.6 symbols/min [2025-10-28T22:11:25.232606] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:25.254478] [DEBUG] [LOCAL ] FBK: Loaded 27079 existing records from primary storage. [2025-10-28T22:11:25.263940] [INFO ] [MAIN ] FBK: Loaded 27079 primary data records. [2025-10-28T22:11:25.418637] [DEBUG] [LOCAL ] FBIN: Loaded 50171 existing records from primary storage. [2025-10-28T22:11:25.581263] [INFO ] [MAIN ] FBIN: Loaded 50171 primary data records. [2025-10-28T22:11:25.640331] [DEBUG] [LOCAL ] FBP: Loaded 45412 existing records from primary storage. [2025-10-28T22:11:25.673568] [INFO ] [MAIN ] FBP: Loaded 45412 primary data records. [2025-10-28T22:11:26.313164] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:26.364309] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:26.393636] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:26.425097] [INFO ] [MAIN ] FBK: Generated 138 derivative records from 27079 primary records. [2025-10-28T22:11:26.427443] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-28T22:11:26.449939] [DEBUG] [LOCAL ] FBK: Derivative data saved (138 records). [2025-10-28T22:11:26.453552] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-28T22:11:26.455907] [INFO ] [MAIN ] Derivative Progress: 628/2046 symbols completed. FBK took 1.2s. Estimated remaining: 9m 38s. Rate: 147.2 symbols/min [2025-10-28T22:11:26.471926] [INFO ] [MAIN ] FBIN: Generated 138 derivative records from 50171 primary records. [2025-10-28T22:11:26.475381] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-28T22:11:26.486887] [INFO ] [MAIN ] FBP: Generated 138 derivative records from 45412 primary records. [2025-10-28T22:11:26.490753] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-28T22:11:26.491362] [DEBUG] [LOCAL ] FBIN: Derivative data saved (138 records). [2025-10-28T22:11:26.492019] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-28T22:11:26.494264] [INFO ] [MAIN ] Derivative Progress: 629/2046 symbols completed. FBIN took 1.3s. Estimated remaining: 9m 37s. Rate: 147.4 symbols/min [2025-10-28T22:11:26.506313] [DEBUG] [LOCAL ] FBP: Derivative data saved (138 records). [2025-10-28T22:11:26.506440] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-28T22:11:26.509047] [INFO ] [MAIN ] Derivative Progress: 630/2046 symbols completed. FBP took 1.3s. Estimated remaining: 9m 36s. Rate: 147.6 symbols/min [2025-10-28T22:11:26.509528] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:26.509778] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:26.509736] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:26.524775] [DEBUG] [LOCAL ] FC: Loaded 13903 existing records from primary storage. [2025-10-28T22:11:26.524997] [INFO ] [MAIN ] FC: Loaded 13903 primary data records. [2025-10-28T22:11:26.742113] [DEBUG] [LOCAL ] FCF: Loaded 38576 existing records from primary storage. [2025-10-28T22:11:26.742220] [INFO ] [MAIN ] FCF: Loaded 38576 primary data records. [2025-10-28T22:11:26.749939] [DEBUG] [LOCAL ] FBRT: Loaded 34679 existing records from primary storage. [2025-10-28T22:11:26.767400] [INFO ] [MAIN ] FBRT: Loaded 34679 primary data records. [2025-10-28T22:11:27.506721] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:27.542670] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:27.586194] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:27.623214] [INFO ] [MAIN ] FC: Generated 138 derivative records from 13903 primary records. [2025-10-28T22:11:27.627388] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-28T22:11:27.643982] [DEBUG] [LOCAL ] FC: Derivative data saved (138 records). [2025-10-28T22:11:27.644236] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-28T22:11:27.646197] [INFO ] [MAIN ] Derivative Progress: 631/2046 symbols completed. FC took 1.1s. Estimated remaining: 9m 37s. Rate: 147.2 symbols/min [2025-10-28T22:11:27.646543] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:27.657406] [INFO ] [MAIN ] FCF: Generated 138 derivative records from 38576 primary records. [2025-10-28T22:11:27.657576] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-28T22:11:27.671908] [DEBUG] [LOCAL ] FCF: Derivative data saved (138 records). [2025-10-28T22:11:27.672048] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-28T22:11:27.676202] [INFO ] [MAIN ] Derivative Progress: 632/2046 symbols completed. FCF took 1.2s. Estimated remaining: 9m 36s. Rate: 147.4 symbols/min [2025-10-28T22:11:27.673917] [INFO ] [MAIN ] FBRT: Generated 138 derivative records from 34679 primary records. [2025-10-28T22:11:27.676447] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:27.676588] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-28T22:11:27.696362] [DEBUG] [LOCAL ] FBRT: Derivative data saved (138 records). [2025-10-28T22:11:27.696575] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-28T22:11:27.699020] [INFO ] [MAIN ] Derivative Progress: 633/2046 symbols completed. FBRT took 1.2s. Estimated remaining: 9m 34s. Rate: 147.6 symbols/min [2025-10-28T22:11:27.699195] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:27.708677] [DEBUG] [LOCAL ] FCN: Loaded 25819 existing records from primary storage. [2025-10-28T22:11:27.708863] [INFO ] [MAIN ] FCN: Loaded 25819 primary data records. [2025-10-28T22:11:27.828510] [DEBUG] [LOCAL ] FCT: Loaded 14513 existing records from primary storage. [2025-10-28T22:11:27.828766] [INFO ] [MAIN ] FCT: Loaded 14513 primary data records. [2025-10-28T22:11:27.992007] [DEBUG] [LOCAL ] FCPT: Loaded 36533 existing records from primary storage. [2025-10-28T22:11:28.080281] [INFO ] [MAIN ] FCPT: Loaded 36533 primary data records. [2025-10-28T22:11:28.701832] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:28.738369] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:28.776447] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:28.820602] [INFO ] [MAIN ] FCN: Generated 138 derivative records from 25819 primary records. [2025-10-28T22:11:28.823864] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-28T22:11:28.847551] [DEBUG] [LOCAL ] FCN: Derivative data saved (138 records). [2025-10-28T22:11:28.849221] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-28T22:11:28.851511] [INFO ] [MAIN ] Derivative Progress: 634/2046 symbols completed. FCN took 1.2s. Estimated remaining: 9m 36s. Rate: 147.2 symbols/min [2025-10-28T22:11:28.851990] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:28.854517] [INFO ] [MAIN ] FCT: Generated 138 derivative records from 14513 primary records. [2025-10-28T22:11:28.857463] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-28T22:11:28.873205] [DEBUG] [LOCAL ] FCT: Derivative data saved (138 records). [2025-10-28T22:11:28.873129] [INFO ] [MAIN ] FCPT: Generated 138 derivative records from 36533 primary records. [2025-10-28T22:11:28.873500] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-28T22:11:28.873430] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-28T22:11:28.876371] [INFO ] [MAIN ] Derivative Progress: 635/2046 symbols completed. FCT took 1.2s. Estimated remaining: 9m 34s. Rate: 147.4 symbols/min [2025-10-28T22:11:28.887807] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:28.888906] [DEBUG] [LOCAL ] FCPT: Derivative data saved (138 records). [2025-10-28T22:11:28.889401] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-28T22:11:28.891798] [INFO ] [MAIN ] Derivative Progress: 636/2046 symbols completed. FCPT took 1.2s. Estimated remaining: 9m 33s. Rate: 147.6 symbols/min [2025-10-28T22:11:28.892040] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:28.946143] [DEBUG] [LOCAL ] FDS: Loaded 28214 existing records from primary storage. [2025-10-28T22:11:28.945575] [DEBUG] [LOCAL ] FDP: Loaded 29373 existing records from primary storage. [2025-10-28T22:11:28.960535] [INFO ] [MAIN ] FDP: Loaded 29373 primary data records. [2025-10-28T22:11:28.960763] [INFO ] [MAIN ] FDS: Loaded 28214 primary data records. [2025-10-28T22:11:29.029552] [DEBUG] [LOCAL ] FCX: Loaded 53702 existing records from primary storage. [2025-10-28T22:11:29.063255] [INFO ] [MAIN ] FCX: Loaded 53702 primary data records. [2025-10-28T22:11:29.915362] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:29.915938] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:29.959618] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:30.031193] [INFO ] [MAIN ] FDP: Generated 138 derivative records from 29373 primary records. [2025-10-28T22:11:30.029161] [INFO ] [MAIN ] FDS: Generated 138 derivative records from 28214 primary records. [2025-10-28T22:11:30.033543] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-28T22:11:30.033940] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-28T22:11:30.058469] [DEBUG] [LOCAL ] FDP: Derivative data saved (138 records). [2025-10-28T22:11:30.061920] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-28T22:11:30.061815] [INFO ] [MAIN ] FCX: Generated 138 derivative records from 53702 primary records. [2025-10-28T22:11:30.064339] [INFO ] [MAIN ] Derivative Progress: 637/2046 symbols completed. FDP took 1.2s. Estimated remaining: 9m 34s. Rate: 147.2 symbols/min [2025-10-28T22:11:30.062033] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-28T22:11:30.064587] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:30.061403] [DEBUG] [LOCAL ] FDS: Derivative data saved (138 records). [2025-10-28T22:11:30.065190] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-28T22:11:30.068668] [INFO ] [MAIN ] Derivative Progress: 638/2046 symbols completed. FDS took 1.2s. Estimated remaining: 9m 33s. Rate: 147.4 symbols/min [2025-10-28T22:11:30.076040] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:30.080604] [DEBUG] [LOCAL ] FCX: Derivative data saved (138 records). [2025-10-28T22:11:30.081156] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-28T22:11:30.083691] [INFO ] [MAIN ] Derivative Progress: 639/2046 symbols completed. FCX took 1.2s. Estimated remaining: 9m 32s. Rate: 147.7 symbols/min [2025-10-28T22:11:30.083838] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:30.098006] [DEBUG] [LOCAL ] FET: Loaded 12901 existing records from primary storage. [2025-10-28T22:11:30.098343] [INFO ] [MAIN ] FET: Loaded 12901 primary data records. [2025-10-28T22:11:30.471146] [DEBUG] [LOCAL ] FERG: Loaded 48558 existing records from primary storage. [2025-10-28T22:11:30.471443] [INFO ] [MAIN ] FERG: Loaded 48558 primary data records. [2025-10-28T22:11:30.504802] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-28T22:11:30.510081] [INFO ] [MAIN ] FE: Loaded 53430 primary data records. [2025-10-28T22:11:31.082989] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:31.126704] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:31.161008] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:31.196693] [INFO ] [MAIN ] FET: Generated 138 derivative records from 12901 primary records. [2025-10-28T22:11:31.197354] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-28T22:11:31.214906] [DEBUG] [LOCAL ] FET: Derivative data saved (138 records). [2025-10-28T22:11:31.220517] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-28T22:11:31.223335] [INFO ] [MAIN ] Derivative Progress: 640/2046 symbols completed. FET took 1.1s. Estimated remaining: 9m 33s. Rate: 147.2 symbols/min [2025-10-28T22:11:31.223613] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:31.235258] [INFO ] [MAIN ] FERG: Generated 138 derivative records from 48558 primary records. [2025-10-28T22:11:31.235587] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-28T22:11:31.254271] [INFO ] [MAIN ] FE: Generated 138 derivative records from 53430 primary records. [2025-10-28T22:11:31.257708] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-28T22:11:31.258503] [DEBUG] [LOCAL ] FERG: Derivative data saved (138 records). [2025-10-28T22:11:31.259061] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-28T22:11:31.261158] [INFO ] [MAIN ] Derivative Progress: 641/2046 symbols completed. FERG took 1.2s. Estimated remaining: 9m 32s. Rate: 147.4 symbols/min [2025-10-28T22:11:31.268379] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:31.273141] [DEBUG] [LOCAL ] FE: Derivative data saved (138 records). [2025-10-28T22:11:31.280720] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-28T22:11:31.283413] [INFO ] [MAIN ] Derivative Progress: 642/2046 symbols completed. FE took 1.2s. Estimated remaining: 9m 30s. Rate: 147.7 symbols/min [2025-10-28T22:11:31.283704] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:31.284634] [DEBUG] [LOCAL ] FF: Loaded 23037 existing records from primary storage. [2025-10-28T22:11:31.285244] [INFO ] [MAIN ] FF: Loaded 23037 primary data records. [2025-10-28T22:11:31.355289] [DEBUG] [LOCAL ] FFA: Loaded 5236 existing records from primary storage. [2025-10-28T22:11:31.397789] [INFO ] [MAIN ] FFA: Loaded 5236 primary data records. [2025-10-28T22:11:31.503685] [DEBUG] [LOCAL ] FFC: Loaded 16268 existing records from primary storage. [2025-10-28T22:11:31.538249] [INFO ] [MAIN ] FFC: Loaded 16268 primary data records. [2025-10-28T22:11:32.242944] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:32.330445] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:32.366343] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:32.416993] [INFO ] [MAIN ] FF: Generated 138 derivative records from 23037 primary records. [2025-10-28T22:11:32.417742] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-28T22:11:32.440730] [DEBUG] [LOCAL ] FF: Derivative data saved (138 records). [2025-10-28T22:11:32.441060] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-28T22:11:32.446631] [INFO ] [MAIN ] Derivative Progress: 643/2046 symbols completed. FF took 1.2s. Estimated remaining: 9m 32s. Rate: 147.2 symbols/min [2025-10-28T22:11:32.448957] [INFO ] [MAIN ] FFA: Generated 138 derivative records from 5236 primary records. [2025-10-28T22:11:32.450363] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-28T22:11:32.452937] [INFO ] [MAIN ] FFC: Generated 138 derivative records from 16268 primary records. [2025-10-28T22:11:32.461516] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-28T22:11:32.466973] [DEBUG] [LOCAL ] FFA: Derivative data saved (138 records). [2025-10-28T22:11:32.467291] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-28T22:11:32.469925] [INFO ] [MAIN ] Derivative Progress: 644/2046 symbols completed. FFA took 1.2s. Estimated remaining: 9m 30s. Rate: 147.5 symbols/min [2025-10-28T22:11:32.481412] [DEBUG] [LOCAL ] FFC: Derivative data saved (138 records). [2025-10-28T22:11:32.481521] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-28T22:11:32.484053] [INFO ] [MAIN ] Derivative Progress: 645/2046 symbols completed. FFC took 1.2s. Estimated remaining: 9m 29s. Rate: 147.7 symbols/min [2025-10-28T22:11:32.484449] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:32.484577] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:32.484733] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:32.514020] [DEBUG] [LOCAL ] FG: Loaded 20582 existing records from primary storage. [2025-10-28T22:11:32.523517] [INFO ] [MAIN ] FG: Loaded 20582 primary data records. [2025-10-28T22:11:32.592578] [DEBUG] [LOCAL ] FFWM: Loaded 35414 existing records from primary storage. [2025-10-28T22:11:32.624771] [INFO ] [MAIN ] FFWM: Loaded 35414 primary data records. [2025-10-28T22:11:32.706084] [DEBUG] [LOCAL ] FHI: Loaded 39205 existing records from primary storage. [2025-10-28T22:11:32.724865] [INFO ] [MAIN ] FHI: Loaded 39205 primary data records. [2025-10-28T22:11:33.501171] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:33.550353] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:33.550108] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:33.610277] [INFO ] [MAIN ] FG: Generated 138 derivative records from 20582 primary records. [2025-10-28T22:11:33.612169] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-28T22:11:33.632406] [DEBUG] [LOCAL ] FG: Derivative data saved (138 records). [2025-10-28T22:11:33.634122] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-28T22:11:33.636128] [INFO ] [MAIN ] Derivative Progress: 646/2046 symbols completed. FG took 1.2s. Estimated remaining: 9m 30s. Rate: 147.3 symbols/min [2025-10-28T22:11:33.636979] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:33.644567] [INFO ] [MAIN ] FHI: Generated 138 derivative records from 39205 primary records. [2025-10-28T22:11:33.646558] [INFO ] [MAIN ] FFWM: Generated 138 derivative records from 35414 primary records. [2025-10-28T22:11:33.646727] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-28T22:11:33.646665] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-28T22:11:33.671603] [DEBUG] [LOCAL ] FHI: Derivative data saved (138 records). [2025-10-28T22:11:33.669510] [DEBUG] [LOCAL ] FFWM: Derivative data saved (138 records). [2025-10-28T22:11:33.671938] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-28T22:11:33.671869] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-28T22:11:33.675350] [INFO ] [MAIN ] Derivative Progress: 647/2046 symbols completed. FFWM took 1.2s. Estimated remaining: 9m 29s. Rate: 147.5 symbols/min [2025-10-28T22:11:33.678244] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:33.678308] [INFO ] [MAIN ] Derivative Progress: 648/2046 symbols completed. FHI took 1.2s. Estimated remaining: 9m 28s. Rate: 147.7 symbols/min [2025-10-28T22:11:33.678678] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:33.730296] [DEBUG] [LOCAL ] FHN: Loaded 53398 existing records from primary storage. [2025-10-28T22:11:33.730595] [INFO ] [MAIN ] FHN: Loaded 53398 primary data records. [2025-10-28T22:11:33.867058] [DEBUG] [LOCAL ] FIGS: Loaded 48318 existing records from primary storage. [2025-10-28T22:11:33.883631] [INFO ] [MAIN ] FIGS: Loaded 48318 primary data records. [2025-10-28T22:11:34.125101] [DEBUG] [LOCAL ] FI: Loaded 53573 existing records from primary storage. [2025-10-28T22:11:34.182593] [INFO ] [MAIN ] FI: Loaded 53573 primary data records. [2025-10-28T22:11:34.744253] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:34.779686] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:34.842996] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:34.884029] [INFO ] [MAIN ] FIGS: Generated 138 derivative records from 48318 primary records. [2025-10-28T22:11:34.889046] [INFO ] [MAIN ] FHN: Generated 138 derivative records from 53398 primary records. [2025-10-28T22:11:34.889478] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-28T22:11:34.894337] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-28T22:11:34.914291] [DEBUG] [LOCAL ] FIGS: Derivative data saved (138 records). [2025-10-28T22:11:34.918258] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-28T22:11:34.919015] [DEBUG] [LOCAL ] FHN: Derivative data saved (138 records). [2025-10-28T22:11:34.923055] [INFO ] [MAIN ] Derivative Progress: 649/2046 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 29s. Rate: 147.2 symbols/min [2025-10-28T22:11:34.923481] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:34.923356] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-28T22:11:34.925823] [INFO ] [MAIN ] Derivative Progress: 650/2046 symbols completed. FHN took 1.3s. Estimated remaining: 9m 28s. Rate: 147.4 symbols/min [2025-10-28T22:11:34.926918] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:34.945371] [DEBUG] [LOCAL ] FINS: Loaded 8142 existing records from primary storage. [2025-10-28T22:11:34.945025] [INFO ] [MAIN ] FI: Generated 138 derivative records from 53573 primary records. [2025-10-28T22:11:34.945860] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-28T22:11:34.945774] [INFO ] [MAIN ] FINS: Loaded 8142 primary data records. [2025-10-28T22:11:35.072998] [DEBUG] [LOCAL ] FI: Derivative data saved (138 records). [2025-10-28T22:11:35.093801] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-28T22:11:35.144765] [INFO ] [MAIN ] Derivative Progress: 651/2046 symbols completed. FI took 1.5s. Estimated remaining: 9m 27s. Rate: 147.5 symbols/min [2025-10-28T22:11:35.140251] [DEBUG] [LOCAL ] FIHL: Loaded 38617 existing records from primary storage. [2025-10-28T22:11:35.167574] [INFO ] [MAIN ] FIHL: Loaded 38617 primary data records. [2025-10-28T22:11:35.167400] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:35.641694] [DEBUG] [LOCAL ] FINV: Loaded 45195 existing records from primary storage. [2025-10-28T22:11:35.642026] [INFO ] [MAIN ] FINV: Loaded 45195 primary data records. [2025-10-28T22:11:35.745706] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:11:36.023874] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:36.052305] [INFO ] [MAIN ] FINS: Generated 138 derivative records from 8142 primary records. [2025-10-28T22:11:36.055162] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-28T22:11:36.077570] [DEBUG] [LOCAL ] FINS: Derivative data saved (138 records). [2025-10-28T22:11:36.090789] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-28T22:11:36.094055] [INFO ] [MAIN ] Derivative Progress: 652/2046 symbols completed. FINS took 1.2s. Estimated remaining: 9m 28s. Rate: 147.2 symbols/min [2025-10-28T22:11:36.096024] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:36.095740] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:36.136195] [INFO ] [MAIN ] FIHL: Generated 138 derivative records from 38617 primary records. [2025-10-28T22:11:36.136909] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-28T22:11:36.169739] [DEBUG] [LOCAL ] FIHL: Derivative data saved (138 records). [2025-10-28T22:11:36.169995] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-28T22:11:36.172976] [INFO ] [MAIN ] Derivative Progress: 653/2046 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 27s. Rate: 147.4 symbols/min [2025-10-28T22:11:36.174480] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:36.176882] [INFO ] [MAIN ] FINV: Generated 138 derivative records from 45195 primary records. [2025-10-28T22:11:36.177435] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-28T22:11:36.189706] [DEBUG] [LOCAL ] FINV: Derivative data saved (138 records). [2025-10-28T22:11:36.190882] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-28T22:11:36.193248] [INFO ] [MAIN ] Derivative Progress: 654/2046 symbols completed. FINV took 1.0s. Estimated remaining: 9m 26s. Rate: 147.6 symbols/min [2025-10-28T22:11:36.193661] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:36.212966] [DEBUG] [LOCAL ] FIS: Loaded 53324 existing records from primary storage. [2025-10-28T22:11:36.215106] [INFO ] [MAIN ] FIS: Loaded 53324 primary data records. [2025-10-28T22:11:36.287697] [DEBUG] [LOCAL ] FLC: Loaded 5080 existing records from primary storage. [2025-10-28T22:11:36.316360] [INFO ] [MAIN ] FLC: Loaded 5080 primary data records. [2025-10-28T22:11:36.375560] [DEBUG] [LOCAL ] FIX: Loaded 28232 existing records from primary storage. [2025-10-28T22:11:36.406143] [INFO ] [MAIN ] FIX: Loaded 28232 primary data records. [2025-10-28T22:11:37.270043] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:37.302920] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:37.339157] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:37.398850] [INFO ] [MAIN ] FIS: Generated 138 derivative records from 53324 primary records. [2025-10-28T22:11:37.400186] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-28T22:11:37.417401] [DEBUG] [LOCAL ] FIS: Derivative data saved (138 records). [2025-10-28T22:11:37.420154] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-28T22:11:37.424670] [INFO ] [MAIN ] Derivative Progress: 655/2046 symbols completed. FIS took 1.3s. Estimated remaining: 9m 27s. Rate: 147.2 symbols/min [2025-10-28T22:11:37.425280] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:37.434113] [INFO ] [MAIN ] FLC: Generated 138 derivative records from 5080 primary records. [2025-10-28T22:11:37.436022] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-28T22:11:37.447981] [INFO ] [MAIN ] FIX: Generated 138 derivative records from 28232 primary records. [2025-10-28T22:11:37.449407] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-28T22:11:37.460207] [DEBUG] [LOCAL ] FLC: Derivative data saved (138 records). [2025-10-28T22:11:37.462609] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-28T22:11:37.466214] [INFO ] [MAIN ] Derivative Progress: 656/2046 symbols completed. FLC took 1.3s. Estimated remaining: 9m 26s. Rate: 147.4 symbols/min [2025-10-28T22:11:37.468399] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:37.468139] [DEBUG] [LOCAL ] FIX: Derivative data saved (138 records). [2025-10-28T22:11:37.469142] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-28T22:11:37.473210] [INFO ] [MAIN ] Derivative Progress: 657/2046 symbols completed. FIX took 1.3s. Estimated remaining: 9m 25s. Rate: 147.6 symbols/min [2025-10-28T22:11:37.473611] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:37.520989] [DEBUG] [LOCAL ] FLG: Loaded 53316 existing records from primary storage. [2025-10-28T22:11:37.521326] [INFO ] [MAIN ] FLG: Loaded 53316 primary data records. [2025-10-28T22:11:37.649496] [DEBUG] [LOCAL ] FLNG: Loaded 32849 existing records from primary storage. [2025-10-28T22:11:37.653298] [INFO ] [MAIN ] FLNG: Loaded 32849 primary data records. [2025-10-28T22:11:37.823045] [DEBUG] [LOCAL ] FLO: Loaded 52068 existing records from primary storage. [2025-10-28T22:11:37.861573] [INFO ] [MAIN ] FLO: Loaded 52068 primary data records. [2025-10-28T22:11:38.493347] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:38.527156] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:38.564034] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:38.628882] [INFO ] [MAIN ] FLG: Generated 138 derivative records from 53316 primary records. [2025-10-28T22:11:38.632951] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-28T22:11:38.651840] [DEBUG] [LOCAL ] FLG: Derivative data saved (138 records). [2025-10-28T22:11:38.653885] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-28T22:11:38.656664] [INFO ] [MAIN ] FLO: Generated 138 derivative records from 52068 primary records. [2025-10-28T22:11:38.658849] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-28T22:11:38.658627] [INFO ] [MAIN ] Derivative Progress: 658/2046 symbols completed. FLG took 1.2s. Estimated remaining: 9m 26s. Rate: 147.2 symbols/min [2025-10-28T22:11:38.656248] [INFO ] [MAIN ] FLNG: Generated 138 derivative records from 32849 primary records. [2025-10-28T22:11:38.659662] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-28T22:11:38.683548] [DEBUG] [LOCAL ] FLO: Derivative data saved (138 records). [2025-10-28T22:11:38.683908] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-28T22:11:38.686691] [INFO ] [MAIN ] Derivative Progress: 659/2046 symbols completed. FLO took 1.2s. Estimated remaining: 9m 25s. Rate: 147.4 symbols/min [2025-10-28T22:11:38.688080] [DEBUG] [LOCAL ] FLNG: Derivative data saved (138 records). [2025-10-28T22:11:38.688179] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-28T22:11:38.691833] [INFO ] [MAIN ] Derivative Progress: 660/2046 symbols completed. FLNG took 1.2s. Estimated remaining: 9m 23s. Rate: 147.6 symbols/min [2025-10-28T22:11:38.692457] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:38.692390] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:38.692596] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:38.774695] [DEBUG] [LOCAL ] FLS: Loaded 50389 existing records from primary storage. [2025-10-28T22:11:38.788218] [INFO ] [MAIN ] FLS: Loaded 50389 primary data records. [2025-10-28T22:11:38.789064] [DEBUG] [LOCAL ] FLR: Loaded 53241 existing records from primary storage. [2025-10-28T22:11:38.826204] [INFO ] [MAIN ] FLR: Loaded 53241 primary data records. [2025-10-28T22:11:38.826054] [DEBUG] [LOCAL ] FLUT: Loaded 50602 existing records from primary storage. [2025-10-28T22:11:38.846328] [INFO ] [MAIN ] FLUT: Loaded 50602 primary data records. [2025-10-28T22:11:39.777284] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:39.799199] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:39.839314] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:39.908443] [INFO ] [MAIN ] FLS: Generated 138 derivative records from 50389 primary records. [2025-10-28T22:11:39.911345] [INFO ] [MAIN ] FLR: Generated 138 derivative records from 53241 primary records. [2025-10-28T22:11:39.912120] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-28T22:11:39.912301] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-28T22:11:39.930302] [DEBUG] [LOCAL ] FLS: Derivative data saved (138 records). [2025-10-28T22:11:39.939410] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-28T22:11:39.942230] [INFO ] [MAIN ] Derivative Progress: 661/2046 symbols completed. FLS took 1.2s. Estimated remaining: 9m 25s. Rate: 147.1 symbols/min [2025-10-28T22:11:39.946889] [DEBUG] [LOCAL ] FLR: Derivative data saved (138 records). [2025-10-28T22:11:39.947356] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:39.947891] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-28T22:11:39.949910] [INFO ] [MAIN ] Derivative Progress: 662/2046 symbols completed. FLR took 1.3s. Estimated remaining: 9m 23s. Rate: 147.4 symbols/min [2025-10-28T22:11:39.950252] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:39.947167] [INFO ] [MAIN ] FLUT: Generated 138 derivative records from 50602 primary records. [2025-10-28T22:11:39.950832] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-28T22:11:39.963858] [DEBUG] [LOCAL ] FLUT: Derivative data saved (138 records). [2025-10-28T22:11:39.964055] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-28T22:11:39.966706] [INFO ] [MAIN ] Derivative Progress: 663/2046 symbols completed. FLUT took 1.3s. Estimated remaining: 9m 22s. Rate: 147.6 symbols/min [2025-10-28T22:11:39.966919] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:39.980097] [DEBUG] [LOCAL ] FMN: Loaded 5507 existing records from primary storage. [2025-10-28T22:11:39.986132] [INFO ] [MAIN ] FMN: Loaded 5507 primary data records. [2025-10-28T22:11:39.992859] [DEBUG] [LOCAL ] FLXR: Loaded 21694 existing records from primary storage. [2025-10-28T22:11:40.034286] [INFO ] [MAIN ] FLXR: Loaded 21694 primary data records. [2025-10-28T22:11:40.347084] [DEBUG] [LOCAL ] FMC: Loaded 51833 existing records from primary storage. [2025-10-28T22:11:40.364017] [INFO ] [MAIN ] FMC: Loaded 51833 primary data records. [2025-10-28T22:11:40.996525] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:41.022327] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:41.067718] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:41.116266] [INFO ] [MAIN ] FMN: Generated 138 derivative records from 5507 primary records. [2025-10-28T22:11:41.119714] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-28T22:11:41.140751] [DEBUG] [LOCAL ] FMN: Derivative data saved (138 records). [2025-10-28T22:11:41.141765] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-28T22:11:41.144084] [INFO ] [MAIN ] Derivative Progress: 664/2046 symbols completed. FMN took 1.2s. Estimated remaining: 9m 23s. Rate: 147.2 symbols/min [2025-10-28T22:11:41.147351] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:41.153620] [INFO ] [MAIN ] FLXR: Generated 138 derivative records from 21694 primary records. [2025-10-28T22:11:41.154702] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-28T22:11:41.170191] [DEBUG] [LOCAL ] FLXR: Derivative data saved (138 records). [2025-10-28T22:11:41.170449] [INFO ] [MAIN ] FMC: Generated 138 derivative records from 51833 primary records. [2025-10-28T22:11:41.170906] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-28T22:11:41.170743] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-28T22:11:41.174211] [INFO ] [MAIN ] Derivative Progress: 665/2046 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 22s. Rate: 147.4 symbols/min [2025-10-28T22:11:41.174691] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:41.187981] [DEBUG] [LOCAL ] FMC: Derivative data saved (138 records). [2025-10-28T22:11:41.190336] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-28T22:11:41.193468] [INFO ] [MAIN ] Derivative Progress: 666/2046 symbols completed. FMC took 1.2s. Estimated remaining: 9m 21s. Rate: 147.6 symbols/min [2025-10-28T22:11:41.193634] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:41.205331] [DEBUG] [LOCAL ] FMY: Loaded 1325 existing records from primary storage. [2025-10-28T22:11:41.205477] [INFO ] [MAIN ] FMY: Loaded 1325 primary data records. [2025-10-28T22:11:41.301578] [DEBUG] [LOCAL ] FMS: Loaded 30062 existing records from primary storage. [2025-10-28T22:11:41.313164] [INFO ] [MAIN ] FMS: Loaded 30062 primary data records. [2025-10-28T22:11:41.659452] [DEBUG] [LOCAL ] FMX: Loaded 39942 existing records from primary storage. [2025-10-28T22:11:41.665876] [INFO ] [MAIN ] FMX: Loaded 39942 primary data records. [2025-10-28T22:11:42.206038] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:42.238230] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:42.276213] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:42.326960] [INFO ] [MAIN ] FMY: Generated 138 derivative records from 1325 primary records. [2025-10-28T22:11:42.328395] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-28T22:11:42.343937] [DEBUG] [LOCAL ] FMY: Derivative data saved (138 records). [2025-10-28T22:11:42.344076] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-28T22:11:42.346556] [INFO ] [MAIN ] Derivative Progress: 667/2046 symbols completed. FMY took 1.2s. Estimated remaining: 9m 22s. Rate: 147.2 symbols/min [2025-10-28T22:11:42.347917] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:42.352022] [INFO ] [MAIN ] FMS: Generated 138 derivative records from 30062 primary records. [2025-10-28T22:11:42.354467] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-28T22:11:42.369454] [INFO ] [MAIN ] FMX: Generated 138 derivative records from 39942 primary records. [2025-10-28T22:11:42.370628] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-28T22:11:42.370566] [DEBUG] [LOCAL ] FMS: Derivative data saved (138 records). [2025-10-28T22:11:42.371242] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-28T22:11:42.373622] [INFO ] [MAIN ] Derivative Progress: 668/2046 symbols completed. FMS took 1.2s. Estimated remaining: 9m 21s. Rate: 147.4 symbols/min [2025-10-28T22:11:42.382735] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:42.386142] [DEBUG] [LOCAL ] FMX: Derivative data saved (138 records). [2025-10-28T22:11:42.394964] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-28T22:11:42.397474] [INFO ] [MAIN ] Derivative Progress: 669/2046 symbols completed. FMX took 1.2s. Estimated remaining: 9m 20s. Rate: 147.6 symbols/min [2025-10-28T22:11:42.397735] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:42.412735] [DEBUG] [LOCAL ] FN: Loaded 36887 existing records from primary storage. [2025-10-28T22:11:42.412872] [INFO ] [MAIN ] FN: Loaded 36887 primary data records. [2025-10-28T22:11:42.765687] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-28T22:11:42.766631] [INFO ] [MAIN ] FNB: Loaded 52602 primary data records. [2025-10-28T22:11:42.767248] [DEBUG] [LOCAL ] FND: Loaded 52022 existing records from primary storage. [2025-10-28T22:11:42.769026] [INFO ] [MAIN ] FND: Loaded 52022 primary data records. [2025-10-28T22:11:43.423554] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:43.492864] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:43.492231] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:43.522035] [INFO ] [MAIN ] FN: Generated 138 derivative records from 36887 primary records. [2025-10-28T22:11:43.524535] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-28T22:11:43.540376] [DEBUG] [LOCAL ] FN: Derivative data saved (138 records). [2025-10-28T22:11:43.543193] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-28T22:11:43.546478] [INFO ] [MAIN ] Derivative Progress: 670/2046 symbols completed. FN took 1.2s. Estimated remaining: 9m 21s. Rate: 147.2 symbols/min [2025-10-28T22:11:43.549917] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:43.581600] [INFO ] [MAIN ] FND: Generated 138 derivative records from 52022 primary records. [2025-10-28T22:11:43.593388] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-28T22:11:43.605713] [DEBUG] [LOCAL ] FND: Derivative data saved (138 records). [2025-10-28T22:11:43.607870] [INFO ] [MAIN ] FNB: Generated 138 derivative records from 52602 primary records. [2025-10-28T22:11:43.607958] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-28T22:11:43.610597] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-28T22:11:43.610432] [INFO ] [MAIN ] Derivative Progress: 671/2046 symbols completed. FND took 1.2s. Estimated remaining: 9m 20s. Rate: 147.4 symbols/min [2025-10-28T22:11:43.611062] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:43.624056] [DEBUG] [LOCAL ] FNB: Derivative data saved (138 records). [2025-10-28T22:11:43.624183] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-28T22:11:43.626281] [INFO ] [MAIN ] Derivative Progress: 672/2046 symbols completed. FNB took 1.2s. Estimated remaining: 9m 19s. Rate: 147.6 symbols/min [2025-10-28T22:11:43.640102] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:43.641594] [DEBUG] [LOCAL ] FNF: Loaded 48424 existing records from primary storage. [2025-10-28T22:11:43.641909] [INFO ] [MAIN ] FNF: Loaded 48424 primary data records. [2025-10-28T22:11:43.753111] [DEBUG] [LOCAL ] FOA: Loaded 12715 existing records from primary storage. [2025-10-28T22:11:43.758825] [INFO ] [MAIN ] FOA: Loaded 12715 primary data records. [2025-10-28T22:11:44.158770] [DEBUG] [LOCAL ] FNV: Loaded 45877 existing records from primary storage. [2025-10-28T22:11:44.275907] [INFO ] [MAIN ] FNV: Loaded 45877 primary data records. [2025-10-28T22:11:44.618715] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:44.618397] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:44.690381] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:44.730351] [INFO ] [MAIN ] FOA: Generated 138 derivative records from 12715 primary records. [2025-10-28T22:11:44.733548] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-28T22:11:44.733383] [INFO ] [MAIN ] FNF: Generated 138 derivative records from 48424 primary records. [2025-10-28T22:11:44.734571] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-28T22:11:44.749793] [DEBUG] [LOCAL ] FOA: Derivative data saved (138 records). [2025-10-28T22:11:44.749936] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-28T22:11:44.760361] [INFO ] [MAIN ] Derivative Progress: 673/2046 symbols completed. FOA took 1.1s. Estimated remaining: 9m 20s. Rate: 147.2 symbols/min [2025-10-28T22:11:44.766464] [DEBUG] [LOCAL ] FNF: Derivative data saved (138 records). [2025-10-28T22:11:44.768979] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-28T22:11:44.771263] [INFO ] [MAIN ] Derivative Progress: 674/2046 symbols completed. FNF took 1.2s. Estimated remaining: 9m 18s. Rate: 147.4 symbols/min [2025-10-28T22:11:44.776812] [INFO ] [MAIN ] FNV: Generated 138 derivative records from 45877 primary records. [2025-10-28T22:11:44.776921] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-28T22:11:44.788623] [DEBUG] [LOCAL ] FNV: Derivative data saved (138 records). [2025-10-28T22:11:44.788705] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-28T22:11:44.791795] [INFO ] [MAIN ] Derivative Progress: 675/2046 symbols completed. FNV took 1.2s. Estimated remaining: 9m 17s. Rate: 147.6 symbols/min [2025-10-28T22:11:44.792222] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:44.792153] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:44.792325] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:44.807296] [DEBUG] [LOCAL ] FOF: Loaded 8130 existing records from primary storage. [2025-10-28T22:11:44.807424] [INFO ] [MAIN ] FOF: Loaded 8130 primary data records. [2025-10-28T22:11:44.917883] [DEBUG] [LOCAL ] FOR: Loaded 18946 existing records from primary storage. [2025-10-28T22:11:44.940680] [INFO ] [MAIN ] FOR: Loaded 18946 primary data records. [2025-10-28T22:11:45.157013] [DEBUG] [LOCAL ] FOUR: Loaded 49590 existing records from primary storage. [2025-10-28T22:11:45.295254] [INFO ] [MAIN ] FOUR: Loaded 49590 primary data records. [2025-10-28T22:11:45.803966] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:45.844339] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:45.896327] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:45.930071] [INFO ] [MAIN ] FOF: Generated 138 derivative records from 8130 primary records. [2025-10-28T22:11:45.935258] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-28T22:11:45.938678] [INFO ] [MAIN ] FOR: Generated 138 derivative records from 18946 primary records. [2025-10-28T22:11:45.939122] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-28T22:11:45.956368] [DEBUG] [LOCAL ] FOF: Derivative data saved (138 records). [2025-10-28T22:11:45.956816] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-28T22:11:45.959397] [INFO ] [MAIN ] Derivative Progress: 676/2046 symbols completed. FOF took 1.2s. Estimated remaining: 9m 18s. Rate: 147.2 symbols/min [2025-10-28T22:11:45.959855] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:45.975022] [DEBUG] [LOCAL ] FOR: Derivative data saved (138 records). [2025-10-28T22:11:45.978586] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-28T22:11:45.981522] [INFO ] [MAIN ] Derivative Progress: 677/2046 symbols completed. FOR took 1.2s. Estimated remaining: 9m 17s. Rate: 147.4 symbols/min [2025-10-28T22:11:45.981828] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:45.995413] [INFO ] [MAIN ] FOUR: Generated 138 derivative records from 49590 primary records. [2025-10-28T22:11:45.999976] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-28T22:11:46.021302] [DEBUG] [LOCAL ] FPF: Loaded 18437 existing records from primary storage. [2025-10-28T22:11:46.027426] [INFO ] [MAIN ] FPF: Loaded 18437 primary data records. [2025-10-28T22:11:46.029927] [DEBUG] [LOCAL ] FPH: Loaded 19084 existing records from primary storage. [2025-10-28T22:11:46.062961] [DEBUG] [LOCAL ] FOUR: Derivative data saved (138 records). [2025-10-28T22:11:46.068251] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-28T22:11:46.068183] [INFO ] [MAIN ] FPH: Loaded 19084 primary data records. [2025-10-28T22:11:46.077862] [INFO ] [MAIN ] Derivative Progress: 678/2046 symbols completed. FOUR took 1.3s. Estimated remaining: 9m 16s. Rate: 147.6 symbols/min [2025-10-28T22:11:46.089802] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:46.634818] [DEBUG] [LOCAL ] FPI: Loaded 30983 existing records from primary storage. [2025-10-28T22:11:46.635454] [INFO ] [MAIN ] FPI: Loaded 30983 primary data records. [2025-10-28T22:11:46.967098] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:47.005637] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:47.061895] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:47.082569] [INFO ] [MAIN ] FPF: Generated 138 derivative records from 18437 primary records. [2025-10-28T22:11:47.085289] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-28T22:11:47.103365] [INFO ] [MAIN ] FPH: Generated 138 derivative records from 19084 primary records. [2025-10-28T22:11:47.106118] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-28T22:11:47.103212] [DEBUG] [LOCAL ] FPF: Derivative data saved (138 records). [2025-10-28T22:11:47.108199] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-28T22:11:47.110444] [INFO ] [MAIN ] Derivative Progress: 679/2046 symbols completed. FPF took 1.2s. Estimated remaining: 9m 17s. Rate: 147.2 symbols/min [2025-10-28T22:11:47.122373] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:47.125503] [DEBUG] [LOCAL ] FPH: Derivative data saved (138 records). [2025-10-28T22:11:47.125594] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-28T22:11:47.132958] [INFO ] [MAIN ] Derivative Progress: 680/2046 symbols completed. FPH took 1.2s. Estimated remaining: 9m 16s. Rate: 147.4 symbols/min [2025-10-28T22:11:47.136605] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:47.149414] [INFO ] [MAIN ] FPI: Generated 138 derivative records from 30983 primary records. [2025-10-28T22:11:47.149710] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-28T22:11:47.166868] [DEBUG] [LOCAL ] FRA: Loaded 13295 existing records from primary storage. [2025-10-28T22:11:47.168853] [DEBUG] [LOCAL ] FPI: Derivative data saved (138 records). [2025-10-28T22:11:47.169000] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-28T22:11:47.168935] [INFO ] [MAIN ] FRA: Loaded 13295 primary data records. [2025-10-28T22:11:47.182792] [INFO ] [MAIN ] Derivative Progress: 681/2046 symbols completed. FPI took 1.1s. Estimated remaining: 9m 15s. Rate: 147.6 symbols/min [2025-10-28T22:11:47.214398] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:47.400565] [DEBUG] [LOCAL ] FRGE: Loaded 15273 existing records from primary storage. [2025-10-28T22:11:47.401622] [DEBUG] [LOCAL ] FR: Loaded 46483 existing records from primary storage. [2025-10-28T22:11:47.401762] [INFO ] [MAIN ] FR: Loaded 46483 primary data records. [2025-10-28T22:11:47.462700] [INFO ] [MAIN ] FRGE: Loaded 15273 primary data records. [2025-10-28T22:11:48.142102] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:48.180144] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:48.208973] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:48.254463] [INFO ] [MAIN ] FRA: Generated 138 derivative records from 13295 primary records. [2025-10-28T22:11:48.258987] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-28T22:11:48.277935] [DEBUG] [LOCAL ] FRA: Derivative data saved (138 records). [2025-10-28T22:11:48.278348] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-28T22:11:48.281177] [INFO ] [MAIN ] Derivative Progress: 682/2046 symbols completed. FRA took 1.1s. Estimated remaining: 9m 16s. Rate: 147.3 symbols/min [2025-10-28T22:11:48.281676] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:48.285326] [INFO ] [MAIN ] FRGE: Generated 138 derivative records from 15273 primary records. [2025-10-28T22:11:48.285464] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-28T22:11:48.300119] [DEBUG] [LOCAL ] FRGE: Derivative data saved (138 records). [2025-10-28T22:11:48.301555] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-28T22:11:48.304365] [INFO ] [MAIN ] Derivative Progress: 683/2046 symbols completed. FRGE took 1.1s. Estimated remaining: 9m 15s. Rate: 147.5 symbols/min [2025-10-28T22:11:48.306573] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:48.306791] [INFO ] [MAIN ] FR: Generated 138 derivative records from 46483 primary records. [2025-10-28T22:11:48.307258] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-28T22:11:48.319689] [DEBUG] [LOCAL ] FR: Derivative data saved (138 records). [2025-10-28T22:11:48.319873] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-28T22:11:48.322565] [INFO ] [MAIN ] Derivative Progress: 684/2046 symbols completed. FR took 1.2s. Estimated remaining: 9m 13s. Rate: 147.7 symbols/min [2025-10-28T22:11:48.322796] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:48.385282] [DEBUG] [LOCAL ] FRO: Loaded 51591 existing records from primary storage. [2025-10-28T22:11:48.385524] [INFO ] [MAIN ] FRO: Loaded 51591 primary data records. [2025-10-28T22:11:48.408184] [DEBUG] [LOCAL ] FRT: Loaded 41037 existing records from primary storage. [2025-10-28T22:11:48.460822] [INFO ] [MAIN ] FRT: Loaded 41037 primary data records. [2025-10-28T22:11:48.488393] [DEBUG] [LOCAL ] FSCO: Loaded 38332 existing records from primary storage. [2025-10-28T22:11:48.507264] [INFO ] [MAIN ] FSCO: Loaded 38332 primary data records. [2025-10-28T22:11:49.358040] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:49.391979] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:49.422756] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:49.474074] [INFO ] [MAIN ] FRO: Generated 138 derivative records from 51591 primary records. [2025-10-28T22:11:49.475460] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-28T22:11:49.494616] [DEBUG] [LOCAL ] FRO: Derivative data saved (138 records). [2025-10-28T22:11:49.496151] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-28T22:11:49.499593] [INFO ] [MAIN ] Derivative Progress: 685/2046 symbols completed. FRO took 1.2s. Estimated remaining: 9m 14s. Rate: 147.3 symbols/min [2025-10-28T22:11:49.500233] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:49.502793] [INFO ] [MAIN ] FRT: Generated 138 derivative records from 41037 primary records. [2025-10-28T22:11:49.505280] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-28T22:11:49.519446] [DEBUG] [LOCAL ] FRT: Derivative data saved (138 records). [2025-10-28T22:11:49.519584] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-28T22:11:49.522122] [INFO ] [MAIN ] Derivative Progress: 686/2046 symbols completed. FRT took 1.2s. Estimated remaining: 9m 13s. Rate: 147.5 symbols/min [2025-10-28T22:11:49.524031] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:49.524543] [INFO ] [MAIN ] FSCO: Generated 138 derivative records from 38332 primary records. [2025-10-28T22:11:49.524924] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-28T22:11:49.537419] [DEBUG] [LOCAL ] FSCO: Derivative data saved (138 records). [2025-10-28T22:11:49.537738] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-28T22:11:49.540613] [INFO ] [MAIN ] Derivative Progress: 687/2046 symbols completed. FSCO took 1.2s. Estimated remaining: 9m 12s. Rate: 147.7 symbols/min [2025-10-28T22:11:49.540852] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:49.600514] [DEBUG] [LOCAL ] FSK: Loaded 49374 existing records from primary storage. [2025-10-28T22:11:49.601151] [INFO ] [MAIN ] FSK: Loaded 49374 primary data records. [2025-10-28T22:11:49.695620] [DEBUG] [LOCAL ] FSLY: Loaded 51200 existing records from primary storage. [2025-10-28T22:11:49.700948] [INFO ] [MAIN ] FSLY: Loaded 51200 primary data records. [2025-10-28T22:11:49.861807] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-28T22:11:49.888133] [INFO ] [MAIN ] FSM: Loaded 53298 primary data records. [2025-10-28T22:11:50.551219] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:50.587288] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:50.633489] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:50.670223] [INFO ] [MAIN ] FSK: Generated 138 derivative records from 49374 primary records. [2025-10-28T22:11:50.673304] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-28T22:11:50.694863] [DEBUG] [LOCAL ] FSK: Derivative data saved (138 records). [2025-10-28T22:11:50.695317] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-28T22:11:50.697548] [INFO ] [MAIN ] Derivative Progress: 688/2046 symbols completed. FSK took 1.2s. Estimated remaining: 9m 13s. Rate: 147.3 symbols/min [2025-10-28T22:11:50.705028] [INFO ] [MAIN ] FSLY: Generated 138 derivative records from 51200 primary records. [2025-10-28T22:11:50.712675] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-28T22:11:50.725676] [INFO ] [MAIN ] FSM: Generated 138 derivative records from 53298 primary records. [2025-10-28T22:11:50.730397] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-28T22:11:50.730314] [DEBUG] [LOCAL ] FSLY: Derivative data saved (138 records). [2025-10-28T22:11:50.730528] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-28T22:11:50.733493] [INFO ] [MAIN ] Derivative Progress: 689/2046 symbols completed. FSLY took 1.2s. Estimated remaining: 9m 12s. Rate: 147.5 symbols/min [2025-10-28T22:11:50.751739] [DEBUG] [LOCAL ] FSM: Derivative data saved (138 records). [2025-10-28T22:11:50.751883] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-28T22:11:50.754716] [INFO ] [MAIN ] Derivative Progress: 690/2046 symbols completed. FSM took 1.2s. Estimated remaining: 9m 11s. Rate: 147.7 symbols/min [2025-10-28T22:11:50.755248] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:50.755384] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:50.755152] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:50.766470] [DEBUG] [LOCAL ] FT: Loaded 6758 existing records from primary storage. [2025-10-28T22:11:50.766739] [INFO ] [MAIN ] FT: Loaded 6758 primary data records. [2025-10-28T22:11:50.842174] [DEBUG] [LOCAL ] FTHY: Loaded 11966 existing records from primary storage. [2025-10-28T22:11:50.856246] [INFO ] [MAIN ] FTHY: Loaded 11966 primary data records. [2025-10-28T22:11:51.013984] [DEBUG] [LOCAL ] FSS: Loaded 32538 existing records from primary storage. [2025-10-28T22:11:51.079685] [INFO ] [MAIN ] FSS: Loaded 32538 primary data records. [2025-10-28T22:11:51.761371] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:51.791993] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:11:51.836121] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:51.878443] [INFO ] [MAIN ] FT: Generated 138 derivative records from 6758 primary records. [2025-10-28T22:11:51.886323] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-28T22:11:51.900570] [DEBUG] [LOCAL ] FT: Derivative data saved (138 records). [2025-10-28T22:11:51.903726] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-28T22:11:51.908749] [INFO ] [MAIN ] Derivative Progress: 691/2046 symbols completed. FT took 1.2s. Estimated remaining: 9m 12s. Rate: 147.3 symbols/min [2025-10-28T22:11:51.909563] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:51.909008] [INFO ] [MAIN ] FTHY: Generated 138 derivative records from 11966 primary records. [2025-10-28T22:11:51.910396] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-28T22:11:51.925792] [DEBUG] [LOCAL ] FTHY: Derivative data saved (138 records). [2025-10-28T22:11:51.926941] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-28T22:11:51.929381] [INFO ] [MAIN ] Derivative Progress: 692/2046 symbols completed. FTHY took 1.2s. Estimated remaining: 9m 11s. Rate: 147.5 symbols/min [2025-10-28T22:11:51.929567] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:51.932066] [INFO ] [MAIN ] FSS: Generated 138 derivative records from 32538 primary records. [2025-10-28T22:11:51.932295] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-28T22:11:51.944770] [DEBUG] [LOCAL ] FSS: Derivative data saved (138 records). [2025-10-28T22:11:51.944925] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-28T22:11:51.947692] [INFO ] [MAIN ] Derivative Progress: 693/2046 symbols completed. FSS took 1.2s. Estimated remaining: 9m 10s. Rate: 147.7 symbols/min [2025-10-28T22:11:51.947938] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:51.987346] [DEBUG] [LOCAL ] FTK: Loaded 33060 existing records from primary storage. [2025-10-28T22:11:51.987485] [INFO ] [MAIN ] FTK: Loaded 33060 primary data records. [2025-10-28T22:11:52.127965] [DEBUG] [LOCAL ] FTS: Loaded 42265 existing records from primary storage. [2025-10-28T22:11:52.127203] [DEBUG] [LOCAL ] FTI: Loaded 53291 existing records from primary storage. [2025-10-28T22:11:52.133908] [INFO ] [MAIN ] FTS: Loaded 42265 primary data records. [2025-10-28T22:11:52.128566] [INFO ] [MAIN ] FTI: Loaded 53291 primary data records. [2025-10-28T22:11:52.951728] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:52.992006] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:53.019730] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:53.071690] [INFO ] [MAIN ] FTK: Generated 138 derivative records from 33060 primary records. [2025-10-28T22:11:53.073112] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-28T22:11:53.095931] [DEBUG] [LOCAL ] FTK: Derivative data saved (138 records). [2025-10-28T22:11:53.096536] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-28T22:11:53.100101] [INFO ] [MAIN ] Derivative Progress: 694/2046 symbols completed. FTK took 1.2s. Estimated remaining: 9m 11s. Rate: 147.3 symbols/min [2025-10-28T22:11:53.101623] [INFO ] [MAIN ] FTS: Generated 138 derivative records from 42265 primary records. [2025-10-28T22:11:53.101964] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:53.102188] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-28T22:11:53.112372] [INFO ] [MAIN ] FTI: Generated 138 derivative records from 53291 primary records. [2025-10-28T22:11:53.116718] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-28T22:11:53.117855] [DEBUG] [LOCAL ] FTS: Derivative data saved (138 records). [2025-10-28T22:11:53.124943] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-28T22:11:53.127688] [INFO ] [MAIN ] Derivative Progress: 695/2046 symbols completed. FTS took 1.2s. Estimated remaining: 9m 10s. Rate: 147.5 symbols/min [2025-10-28T22:11:53.127971] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:53.133959] [DEBUG] [LOCAL ] FTI: Derivative data saved (138 records). [2025-10-28T22:11:53.134257] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-28T22:11:53.137402] [INFO ] [MAIN ] Derivative Progress: 696/2046 symbols completed. FTI took 1.2s. Estimated remaining: 9m 8s. Rate: 147.7 symbols/min [2025-10-28T22:11:53.139782] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:53.140099] [DEBUG] [LOCAL ] FTWO: Loaded 1923 existing records from primary storage. [2025-10-28T22:11:53.140385] [INFO ] [MAIN ] FTWO: Loaded 1923 primary data records. [2025-10-28T22:11:53.510669] [DEBUG] [LOCAL ] FTV: Loaded 52998 existing records from primary storage. [2025-10-28T22:11:53.510941] [INFO ] [MAIN ] FTV: Loaded 52998 primary data records. [2025-10-28T22:11:53.647620] [DEBUG] [LOCAL ] FUBO: Loaded 53714 existing records from primary storage. [2025-10-28T22:11:53.664032] [INFO ] [MAIN ] FUBO: Loaded 53714 primary data records. [2025-10-28T22:11:54.083244] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-28T22:11:54.297375] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:54.311761] [INFO ] [MAIN ] FTWO: Generated 138 derivative records from 1923 primary records. [2025-10-28T22:11:54.312855] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-28T22:11:54.341871] [DEBUG] [LOCAL ] FTWO: Derivative data saved (138 records). [2025-10-28T22:11:54.344847] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-28T22:11:54.347432] [INFO ] [MAIN ] Derivative Progress: 697/2046 symbols completed. FTWO took 1.2s. Estimated remaining: 9m 10s. Rate: 147.3 symbols/min [2025-10-28T22:11:54.347831] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:54.359997] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:54.415791] [DEBUG] [LOCAL ] FUL: Loaded 31642 existing records from primary storage. [2025-10-28T22:11:54.415083] [INFO ] [MAIN ] FTV: Generated 138 derivative records from 52998 primary records. [2025-10-28T22:11:54.415993] [INFO ] [MAIN ] FUL: Loaded 31642 primary data records. [2025-10-28T22:11:54.416146] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-28T22:11:54.470009] [INFO ] [MAIN ] FUBO: Generated 138 derivative records from 53714 primary records. [2025-10-28T22:11:54.493533] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-28T22:11:54.484918] [DEBUG] [LOCAL ] FTV: Derivative data saved (138 records). [2025-10-28T22:11:54.505242] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-28T22:11:54.530411] [INFO ] [MAIN ] Derivative Progress: 698/2046 symbols completed. FTV took 1.4s. Estimated remaining: 9m 9s. Rate: 147.4 symbols/min [2025-10-28T22:11:54.533972] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:54.735875] [DEBUG] [LOCAL ] FUBO: Derivative data saved (138 records). [2025-10-28T22:11:54.736677] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-28T22:11:54.739390] [INFO ] [MAIN ] Derivative Progress: 699/2046 symbols completed. FUBO took 1.6s. Estimated remaining: 9m 8s. Rate: 147.5 symbols/min [2025-10-28T22:11:54.739573] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:54.773767] [DEBUG] [LOCAL ] FVR: Loaded 20491 existing records from primary storage. [2025-10-28T22:11:54.774183] [INFO ] [MAIN ] FVR: Loaded 20491 primary data records. [2025-10-28T22:11:54.902109] [DEBUG] [LOCAL ] FUN: Loaded 52036 existing records from primary storage. [2025-10-28T22:11:54.909948] [INFO ] [MAIN ] FUN: Loaded 52036 primary data records. [2025-10-28T22:11:54.967381] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:55.498991] [INFO ] [MAIN ] FUL: Generated 138 derivative records from 31642 primary records. [2025-10-28T22:11:55.501157] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-28T22:11:55.527382] [DEBUG] [LOCAL ] FUL: Derivative data saved (138 records). [2025-10-28T22:11:55.527869] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:55.528037] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-28T22:11:55.530230] [INFO ] [MAIN ] Derivative Progress: 700/2046 symbols completed. FUL took 1.2s. Estimated remaining: 9m 8s. Rate: 147.3 symbols/min [2025-10-28T22:11:55.541891] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:55.570967] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:55.624587] [INFO ] [MAIN ] FVR: Generated 138 derivative records from 20491 primary records. [2025-10-28T22:11:55.625769] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-28T22:11:55.625672] [DEBUG] [LOCAL ] FVRR: Loaded 40391 existing records from primary storage. [2025-10-28T22:11:55.627189] [INFO ] [MAIN ] FVRR: Loaded 40391 primary data records. [2025-10-28T22:11:55.695583] [DEBUG] [LOCAL ] FVR: Derivative data saved (138 records). [2025-10-28T22:11:55.716393] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-28T22:11:55.729349] [INFO ] [MAIN ] Derivative Progress: 701/2046 symbols completed. FVR took 1.0s. Estimated remaining: 9m 7s. Rate: 147.4 symbols/min [2025-10-28T22:11:55.742199] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:55.825577] [DEBUG] [LOCAL ] FXED: Loaded 1212 existing records from primary storage. [2025-10-28T22:11:55.928986] [INFO ] [MAIN ] FXED: Loaded 1212 primary data records. [2025-10-28T22:11:55.961032] [INFO ] [MAIN ] FUN: Generated 138 derivative records from 52036 primary records. [2025-10-28T22:11:55.985274] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-28T22:11:56.033136] [DEBUG] [LOCAL ] FUN: Derivative data saved (138 records). [2025-10-28T22:11:56.044996] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-28T22:11:56.054003] [INFO ] [MAIN ] Derivative Progress: 702/2046 symbols completed. FUN took 1.5s. Estimated remaining: 9m 7s. Rate: 147.5 symbols/min [2025-10-28T22:11:56.062891] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:56.298312] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:56.330889] [DEBUG] [LOCAL ] G: Loaded 50000 existing records from primary storage. [2025-10-28T22:11:56.334301] [INFO ] [MAIN ] G: Loaded 50000 primary data records. [2025-10-28T22:11:56.513432] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:11:56.689228] [INFO ] [MAIN ] FVRR: Generated 138 derivative records from 40391 primary records. [2025-10-28T22:11:56.691421] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-28T22:11:56.709010] [DEBUG] [LOCAL ] FVRR: Derivative data saved (138 records). [2025-10-28T22:11:56.711001] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-28T22:11:56.713278] [INFO ] [MAIN ] Derivative Progress: 703/2046 symbols completed. FVRR took 1.2s. Estimated remaining: 9m 7s. Rate: 147.3 symbols/min [2025-10-28T22:11:56.724510] [INFO ] [MAIN ] FXED: Generated 138 derivative records from 1212 primary records. [2025-10-28T22:11:56.725150] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-28T22:11:56.750975] [DEBUG] [LOCAL ] FXED: Derivative data saved (138 records). [2025-10-28T22:11:56.751202] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:56.751353] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-28T22:11:56.754033] [INFO ] [MAIN ] Derivative Progress: 704/2046 symbols completed. FXED took 1.0s. Estimated remaining: 9m 6s. Rate: 147.5 symbols/min [2025-10-28T22:11:56.780371] [INFO ] [MAIN ] G: Generated 138 derivative records from 50000 primary records. [2025-10-28T22:11:56.780494] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-28T22:11:56.791790] [DEBUG] [LOCAL ] G: Derivative data saved (138 records). [2025-10-28T22:11:56.791847] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-28T22:11:56.794148] [INFO ] [MAIN ] Derivative Progress: 705/2046 symbols completed. G took 0.7s. Estimated remaining: 9m 5s. Rate: 147.7 symbols/min [2025-10-28T22:11:56.794838] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:56.795123] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:56.795304] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:56.801480] [DEBUG] [LOCAL ] GAM: Loaded 3674 existing records from primary storage. [2025-10-28T22:11:56.801844] [INFO ] [MAIN ] GAM: Loaded 3674 primary data records. [2025-10-28T22:11:56.975084] [DEBUG] [LOCAL ] GAB: Loaded 26834 existing records from primary storage. [2025-10-28T22:11:56.991397] [INFO ] [MAIN ] GAB: Loaded 26834 primary data records. [2025-10-28T22:11:57.320879] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-28T22:11:57.337444] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-28T22:11:57.847190] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:57.897192] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:57.924240] [INFO ] [MAIN ] GAM: Generated 138 derivative records from 3674 primary records. [2025-10-28T22:11:57.938227] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:57.938328] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-28T22:11:57.967616] [DEBUG] [LOCAL ] GAM: Derivative data saved (138 records). [2025-10-28T22:11:57.968832] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-28T22:11:57.973572] [INFO ] [MAIN ] Derivative Progress: 706/2046 symbols completed. GAM took 1.2s. Estimated remaining: 9m 6s. Rate: 147.3 symbols/min [2025-10-28T22:11:57.974037] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:57.988088] [INFO ] [MAIN ] GAB: Generated 138 derivative records from 26834 primary records. [2025-10-28T22:11:57.992945] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-28T22:11:58.006032] [DEBUG] [LOCAL ] GAB: Derivative data saved (138 records). [2025-10-28T22:11:58.011311] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-28T22:11:58.014411] [INFO ] [MAIN ] Derivative Progress: 707/2046 symbols completed. GAB took 1.2s. Estimated remaining: 9m 5s. Rate: 147.5 symbols/min [2025-10-28T22:11:58.015070] [DEBUG] [LOCAL ] GATX: Loaded 17729 existing records from primary storage. [2025-10-28T22:11:58.014553] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:58.017717] [INFO ] [MAIN ] GATX: Loaded 17729 primary data records. [2025-10-28T22:11:58.242297] [INFO ] [MAIN ] GAP: Generated 138 derivative records from 53653 primary records. [2025-10-28T22:11:58.349100] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-28T22:11:58.415881] [DEBUG] [LOCAL ] GBCI: Loaded 41010 existing records from primary storage. [2025-10-28T22:11:58.416352] [INFO ] [MAIN ] GBCI: Loaded 41010 primary data records. [2025-10-28T22:11:58.416105] [DEBUG] [LOCAL ] GAP: Derivative data saved (138 records). [2025-10-28T22:11:58.417457] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-28T22:11:58.458348] [INFO ] [MAIN ] Derivative Progress: 708/2046 symbols completed. GAP took 1.7s. Estimated remaining: 9m 4s. Rate: 147.5 symbols/min [2025-10-28T22:11:58.487588] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:58.678614] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:58.743613] [DEBUG] [LOCAL ] GBTG: Loaded 39877 existing records from primary storage. [2025-10-28T22:11:58.814787] [INFO ] [MAIN ] GBTG: Loaded 39877 primary data records. [2025-10-28T22:11:59.340743] [INFO ] [MAIN ] GATX: Generated 138 derivative records from 17729 primary records. [2025-10-28T22:11:59.355142] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-28T22:11:59.355069] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:59.384590] [DEBUG] [LOCAL ] GATX: Derivative data saved (138 records). [2025-10-28T22:11:59.386054] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-28T22:11:59.388573] [INFO ] [MAIN ] Derivative Progress: 709/2046 symbols completed. GATX took 1.4s. Estimated remaining: 9m 5s. Rate: 147.2 symbols/min [2025-10-28T22:11:59.389212] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:59.433164] [INFO ] [MAIN ] GBCI: Generated 138 derivative records from 41010 primary records. [2025-10-28T22:11:59.443342] [DEBUG] [LOCAL ] GBX: Loaded 27555 existing records from primary storage. [2025-10-28T22:11:59.443467] [INFO ] [MAIN ] GBX: Loaded 27555 primary data records. [2025-10-28T22:11:59.443886] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:11:59.442632] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-28T22:11:59.565204] [DEBUG] [LOCAL ] GBCI: Derivative data saved (138 records). [2025-10-28T22:11:59.577222] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-28T22:11:59.579716] [INFO ] [MAIN ] Derivative Progress: 710/2046 symbols completed. GBCI took 1.6s. Estimated remaining: 9m 4s. Rate: 147.3 symbols/min [2025-10-28T22:11:59.583237] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:59.806057] [INFO ] [MAIN ] GBTG: Generated 138 derivative records from 39877 primary records. [2025-10-28T22:11:59.806402] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-28T22:11:59.831100] [DEBUG] [LOCAL ] GBTG: Derivative data saved (138 records). [2025-10-28T22:11:59.831721] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-28T22:11:59.834435] [INFO ] [MAIN ] Derivative Progress: 711/2046 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 3s. Rate: 147.4 symbols/min [2025-10-28T22:11:59.835876] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:11:59.849480] [DEBUG] [LOCAL ] GCI: Loaded 43464 existing records from primary storage. [2025-10-28T22:11:59.850511] [INFO ] [MAIN ] GCI: Loaded 43464 primary data records. [2025-10-28T22:12:00.001211] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:00.047225] [DEBUG] [LOCAL ] GCO: Loaded 21977 existing records from primary storage. [2025-10-28T22:12:00.088943] [INFO ] [MAIN ] GCO: Loaded 21977 primary data records. [2025-10-28T22:12:00.580013] [INFO ] [MAIN ] GBX: Generated 138 derivative records from 27555 primary records. [2025-10-28T22:12:00.581066] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-28T22:12:00.607349] [DEBUG] [LOCAL ] GBX: Derivative data saved (138 records). [2025-10-28T22:12:00.608447] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-28T22:12:00.610699] [INFO ] [MAIN ] Derivative Progress: 712/2046 symbols completed. GBX took 1.2s. Estimated remaining: 9m 4s. Rate: 147.2 symbols/min [2025-10-28T22:12:00.611340] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:00.611052] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:00.653606] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:00.677132] [DEBUG] [LOCAL ] GCTS: Loaded 20155 existing records from primary storage. [2025-10-28T22:12:00.680601] [INFO ] [MAIN ] GCTS: Loaded 20155 primary data records. [2025-10-28T22:12:00.998393] [INFO ] [MAIN ] GCI: Generated 138 derivative records from 43464 primary records. [2025-10-28T22:12:00.999843] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-28T22:12:01.018954] [DEBUG] [LOCAL ] GCI: Derivative data saved (138 records). [2025-10-28T22:12:01.019797] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-28T22:12:01.022410] [INFO ] [MAIN ] Derivative Progress: 713/2046 symbols completed. GCI took 1.4s. Estimated remaining: 9m 3s. Rate: 147.2 symbols/min [2025-10-28T22:12:01.024864] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:01.033078] [INFO ] [MAIN ] GCO: Generated 138 derivative records from 21977 primary records. [2025-10-28T22:12:01.033783] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-28T22:12:01.053670] [DEBUG] [LOCAL ] GCO: Derivative data saved (138 records). [2025-10-28T22:12:01.053810] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-28T22:12:01.056225] [INFO ] [MAIN ] Derivative Progress: 714/2046 symbols completed. GCO took 1.2s. Estimated remaining: 9m 2s. Rate: 147.4 symbols/min [2025-10-28T22:12:01.056542] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:01.057543] [DEBUG] [LOCAL ] GCV: Loaded 7933 existing records from primary storage. [2025-10-28T22:12:01.058493] [INFO ] [MAIN ] GCV: Loaded 7933 primary data records. [2025-10-28T22:12:01.226703] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:01.450266] [DEBUG] [LOCAL ] GD: Loaded 46355 existing records from primary storage. [2025-10-28T22:12:01.451929] [INFO ] [MAIN ] GD: Loaded 46355 primary data records. [2025-10-28T22:12:01.543608] [INFO ] [MAIN ] GCTS: Generated 138 derivative records from 20155 primary records. [2025-10-28T22:12:01.574340] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-28T22:12:01.686986] [DEBUG] [LOCAL ] GCTS: Derivative data saved (138 records). [2025-10-28T22:12:01.687215] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:01.808759] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-28T22:12:01.812066] [INFO ] [MAIN ] Derivative Progress: 715/2046 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 2s. Rate: 147.2 symbols/min [2025-10-28T22:12:01.824565] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:01.856731] [INFO ] [MAIN ] GCV: Generated 138 derivative records from 7933 primary records. [2025-10-28T22:12:01.858449] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-28T22:12:01.894162] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:01.893956] [DEBUG] [LOCAL ] GCV: Derivative data saved (138 records). [2025-10-28T22:12:01.905672] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-28T22:12:01.909809] [INFO ] [MAIN ] Derivative Progress: 716/2046 symbols completed. GCV took 0.9s. Estimated remaining: 9m 1s. Rate: 147.4 symbols/min [2025-10-28T22:12:01.912164] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:01.929327] [DEBUG] [LOCAL ] GDDY: Loaded 49387 existing records from primary storage. [2025-10-28T22:12:01.930050] [INFO ] [MAIN ] GDDY: Loaded 49387 primary data records. [2025-10-28T22:12:02.043803] [DEBUG] [LOCAL ] GDIV: Loaded 3395 existing records from primary storage. [2025-10-28T22:12:02.070268] [INFO ] [MAIN ] GDIV: Loaded 3395 primary data records. [2025-10-28T22:12:02.453985] [INFO ] [MAIN ] GD: Generated 138 derivative records from 46355 primary records. [2025-10-28T22:12:02.459610] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-28T22:12:02.590355] [DEBUG] [LOCAL ] GD: Derivative data saved (138 records). [2025-10-28T22:12:02.590864] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-28T22:12:02.593360] [INFO ] [MAIN ] Derivative Progress: 717/2046 symbols completed. GD took 1.5s. Estimated remaining: 9m 2s. Rate: 147.2 symbols/min [2025-10-28T22:12:02.594135] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:02.600991] [DEBUG] [LOCAL ] GDL: Loaded 2505 existing records from primary storage. [2025-10-28T22:12:02.601693] [INFO ] [MAIN ] GDL: Loaded 2505 primary data records. [2025-10-28T22:12:02.757789] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:02.832008] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:12:03.017361] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:03.032765] [INFO ] [MAIN ] GDIV: Generated 138 derivative records from 3395 primary records. [2025-10-28T22:12:03.035337] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-28T22:12:03.049349] [DEBUG] [LOCAL ] GDIV: Derivative data saved (138 records). [2025-10-28T22:12:03.052889] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-28T22:12:03.055614] [INFO ] [MAIN ] Derivative Progress: 718/2046 symbols completed. GDIV took 1.1s. Estimated remaining: 9m 1s. Rate: 147.2 symbols/min [2025-10-28T22:12:03.058369] [INFO ] [MAIN ] GDDY: Generated 138 derivative records from 49387 primary records. [2025-10-28T22:12:03.061781] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-28T22:12:03.077498] [DEBUG] [LOCAL ] GDDY: Derivative data saved (138 records). [2025-10-28T22:12:03.078532] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-28T22:12:03.080826] [INFO ] [MAIN ] Derivative Progress: 719/2046 symbols completed. GDDY took 1.3s. Estimated remaining: 9m 0s. Rate: 147.4 symbols/min [2025-10-28T22:12:03.085249] [INFO ] [MAIN ] GDL: Generated 138 derivative records from 2505 primary records. [2025-10-28T22:12:03.085322] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-28T22:12:03.094495] [DEBUG] [LOCAL ] GDL: Derivative data saved (138 records). [2025-10-28T22:12:03.094549] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-28T22:12:03.096767] [INFO ] [MAIN ] Derivative Progress: 720/2046 symbols completed. GDL took 0.5s. Estimated remaining: 8m 59s. Rate: 147.6 symbols/min [2025-10-28T22:12:03.097107] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:03.097208] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:03.097440] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:03.104616] [DEBUG] [LOCAL ] GDO: Loaded 5703 existing records from primary storage. [2025-10-28T22:12:03.104905] [INFO ] [MAIN ] GDO: Loaded 5703 primary data records. [2025-10-28T22:12:03.228981] [DEBUG] [LOCAL ] GDV: Loaded 18696 existing records from primary storage. [2025-10-28T22:12:03.234746] [INFO ] [MAIN ] GDV: Loaded 18696 primary data records. [2025-10-28T22:12:03.536554] [DEBUG] [LOCAL ] GDOT: Loaded 37323 existing records from primary storage. [2025-10-28T22:12:03.547753] [INFO ] [MAIN ] GDOT: Loaded 37323 primary data records. [2025-10-28T22:12:04.108155] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:04.144616] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:04.190809] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:04.226689] [INFO ] [MAIN ] GDO: Generated 138 derivative records from 5703 primary records. [2025-10-28T22:12:04.228240] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-28T22:12:04.247073] [DEBUG] [LOCAL ] GDO: Derivative data saved (138 records). [2025-10-28T22:12:04.250353] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-28T22:12:04.252566] [INFO ] [MAIN ] GDV: Generated 138 derivative records from 18696 primary records. [2025-10-28T22:12:04.254925] [INFO ] [MAIN ] Derivative Progress: 721/2046 symbols completed. GDO took 1.2s. Estimated remaining: 8m 60s. Rate: 147.2 symbols/min [2025-10-28T22:12:04.255112] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-28T22:12:04.255239] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:04.271329] [DEBUG] [LOCAL ] GDV: Derivative data saved (138 records). [2025-10-28T22:12:04.272851] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-28T22:12:04.275372] [INFO ] [MAIN ] Derivative Progress: 722/2046 symbols completed. GDV took 1.2s. Estimated remaining: 8m 59s. Rate: 147.4 symbols/min [2025-10-28T22:12:04.275552] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:04.281714] [INFO ] [MAIN ] GDOT: Generated 138 derivative records from 37323 primary records. [2025-10-28T22:12:04.282045] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-28T22:12:04.294305] [DEBUG] [LOCAL ] GDOT: Derivative data saved (138 records). [2025-10-28T22:12:04.294471] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-28T22:12:04.296930] [INFO ] [MAIN ] Derivative Progress: 723/2046 symbols completed. GDOT took 1.2s. Estimated remaining: 8m 58s. Rate: 147.6 symbols/min [2025-10-28T22:12:04.297229] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:04.324369] [DEBUG] [LOCAL ] GEF: Loaded 20496 existing records from primary storage. [2025-10-28T22:12:04.324575] [INFO ] [MAIN ] GEF: Loaded 20496 primary data records. [2025-10-28T22:12:04.481751] [DEBUG] [LOCAL ] GE: Loaded 53688 existing records from primary storage. [2025-10-28T22:12:04.487842] [DEBUG] [LOCAL ] GEL: Loaded 30623 existing records from primary storage. [2025-10-28T22:12:04.519194] [INFO ] [MAIN ] GE: Loaded 53688 primary data records. [2025-10-28T22:12:04.534581] [INFO ] [MAIN ] GEL: Loaded 30623 primary data records. [2025-10-28T22:12:05.280207] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:05.328618] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:05.357218] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:05.392601] [INFO ] [MAIN ] GEF: Generated 138 derivative records from 20496 primary records. [2025-10-28T22:12:05.398134] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-28T22:12:05.416492] [DEBUG] [LOCAL ] GEF: Derivative data saved (138 records). [2025-10-28T22:12:05.416634] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-28T22:12:05.419903] [INFO ] [MAIN ] Derivative Progress: 724/2046 symbols completed. GEF took 1.1s. Estimated remaining: 8m 59s. Rate: 147.3 symbols/min [2025-10-28T22:12:05.420195] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:05.435893] [INFO ] [MAIN ] GE: Generated 138 derivative records from 53688 primary records. [2025-10-28T22:12:05.436616] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-28T22:12:05.451062] [DEBUG] [LOCAL ] GE: Derivative data saved (138 records). [2025-10-28T22:12:05.453030] [INFO ] [MAIN ] GEL: Generated 138 derivative records from 30623 primary records. [2025-10-28T22:12:05.453118] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-28T22:12:05.453327] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-28T22:12:05.455819] [INFO ] [MAIN ] Derivative Progress: 725/2046 symbols completed. GE took 1.2s. Estimated remaining: 8m 58s. Rate: 147.4 symbols/min [2025-10-28T22:12:05.456087] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:05.469052] [DEBUG] [LOCAL ] GEL: Derivative data saved (138 records). [2025-10-28T22:12:05.469360] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-28T22:12:05.471855] [INFO ] [MAIN ] Derivative Progress: 726/2046 symbols completed. GEL took 1.2s. Estimated remaining: 8m 56s. Rate: 147.6 symbols/min [2025-10-28T22:12:05.485221] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:05.528255] [DEBUG] [LOCAL ] GENI: Loaded 52850 existing records from primary storage. [2025-10-28T22:12:05.528552] [INFO ] [MAIN ] GENI: Loaded 52850 primary data records. [2025-10-28T22:12:05.629252] [DEBUG] [LOCAL ] GES: Loaded 37330 existing records from primary storage. [2025-10-28T22:12:05.636382] [INFO ] [MAIN ] GES: Loaded 37330 primary data records. [2025-10-28T22:12:05.831029] [DEBUG] [LOCAL ] GEO: Loaded 51534 existing records from primary storage. [2025-10-28T22:12:05.917548] [INFO ] [MAIN ] GEO: Loaded 51534 primary data records. [2025-10-28T22:12:06.541545] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:06.577191] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:06.618794] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:06.655409] [INFO ] [MAIN ] GENI: Generated 138 derivative records from 52850 primary records. [2025-10-28T22:12:06.657171] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-28T22:12:06.673959] [DEBUG] [LOCAL ] GENI: Derivative data saved (138 records). [2025-10-28T22:12:06.674991] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-28T22:12:06.677540] [INFO ] [MAIN ] Derivative Progress: 727/2046 symbols completed. GENI took 1.3s. Estimated remaining: 8m 58s. Rate: 147.2 symbols/min [2025-10-28T22:12:06.677875] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:06.691666] [INFO ] [MAIN ] GES: Generated 138 derivative records from 37330 primary records. [2025-10-28T22:12:06.692073] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-28T22:12:06.695739] [INFO ] [MAIN ] GEO: Generated 138 derivative records from 51534 primary records. [2025-10-28T22:12:06.702897] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-28T22:12:06.707858] [DEBUG] [LOCAL ] GES: Derivative data saved (138 records). [2025-10-28T22:12:06.716850] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-28T22:12:06.726385] [INFO ] [MAIN ] Derivative Progress: 728/2046 symbols completed. GES took 1.2s. Estimated remaining: 8m 56s. Rate: 147.4 symbols/min [2025-10-28T22:12:06.726548] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:06.731083] [DEBUG] [LOCAL ] GEO: Derivative data saved (138 records). [2025-10-28T22:12:06.731409] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-28T22:12:06.735436] [INFO ] [MAIN ] Derivative Progress: 729/2046 symbols completed. GEO took 1.3s. Estimated remaining: 8m 55s. Rate: 147.6 symbols/min [2025-10-28T22:12:06.735784] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:06.753027] [DEBUG] [LOCAL ] GF: Loaded 2523 existing records from primary storage. [2025-10-28T22:12:06.753767] [DEBUG] [LOCAL ] GETY: Loaded 34895 existing records from primary storage. [2025-10-28T22:12:06.754063] [INFO ] [MAIN ] GF: Loaded 2523 primary data records. [2025-10-28T22:12:06.754164] [INFO ] [MAIN ] GETY: Loaded 34895 primary data records. [2025-10-28T22:12:07.393300] [DEBUG] [LOCAL ] GEV: Loaded 52982 existing records from primary storage. [2025-10-28T22:12:07.394265] [INFO ] [MAIN ] GEV: Loaded 52982 primary data records. [2025-10-28T22:12:07.731346] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:07.748579] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:07.806301] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:07.844451] [INFO ] [MAIN ] GF: Generated 138 derivative records from 2523 primary records. [2025-10-28T22:12:07.846844] [INFO ] [MAIN ] GETY: Generated 138 derivative records from 34895 primary records. [2025-10-28T22:12:07.847084] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-28T22:12:07.847169] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-28T22:12:07.862842] [DEBUG] [LOCAL ] GF: Derivative data saved (138 records). [2025-10-28T22:12:07.863135] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-28T22:12:07.873913] [INFO ] [MAIN ] Derivative Progress: 730/2046 symbols completed. GF took 1.1s. Estimated remaining: 8m 56s. Rate: 147.2 symbols/min [2025-10-28T22:12:07.878975] [DEBUG] [LOCAL ] GETY: Derivative data saved (138 records). [2025-10-28T22:12:07.879322] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:07.879595] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-28T22:12:07.884569] [INFO ] [MAIN ] Derivative Progress: 731/2046 symbols completed. GETY took 1.2s. Estimated remaining: 8m 55s. Rate: 147.4 symbols/min [2025-10-28T22:12:07.884990] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:07.891992] [INFO ] [MAIN ] GEV: Generated 138 derivative records from 52982 primary records. [2025-10-28T22:12:07.892157] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-28T22:12:07.904861] [DEBUG] [LOCAL ] GEV: Derivative data saved (138 records). [2025-10-28T22:12:07.907282] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-28T22:12:07.909924] [INFO ] [MAIN ] Derivative Progress: 732/2046 symbols completed. GEV took 1.2s. Estimated remaining: 8m 54s. Rate: 147.6 symbols/min [2025-10-28T22:12:07.910264] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:07.930371] [DEBUG] [LOCAL ] GFF: Loaded 28815 existing records from primary storage. [2025-10-28T22:12:07.930573] [INFO ] [MAIN ] GFF: Loaded 28815 primary data records. [2025-10-28T22:12:08.141359] [DEBUG] [LOCAL ] GFI: Loaded 53115 existing records from primary storage. [2025-10-28T22:12:08.146066] [INFO ] [MAIN ] GFI: Loaded 53115 primary data records. [2025-10-28T22:12:08.378868] [DEBUG] [LOCAL ] GFL: Loaded 47208 existing records from primary storage. [2025-10-28T22:12:08.408179] [INFO ] [MAIN ] GFL: Loaded 47208 primary data records. [2025-10-28T22:12:08.925494] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:08.966955] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:09.008377] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:09.030067] [INFO ] [MAIN ] GFF: Generated 138 derivative records from 28815 primary records. [2025-10-28T22:12:09.032704] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-28T22:12:09.050182] [DEBUG] [LOCAL ] GFF: Derivative data saved (138 records). [2025-10-28T22:12:09.050670] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-28T22:12:09.053237] [INFO ] [MAIN ] Derivative Progress: 733/2046 symbols completed. GFF took 1.2s. Estimated remaining: 8m 55s. Rate: 147.3 symbols/min [2025-10-28T22:12:09.073305] [INFO ] [MAIN ] GFI: Generated 138 derivative records from 53115 primary records. [2025-10-28T22:12:09.074826] [INFO ] [MAIN ] GFL: Generated 138 derivative records from 47208 primary records. [2025-10-28T22:12:09.074946] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-28T22:12:09.075265] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-28T22:12:09.098593] [DEBUG] [LOCAL ] GFI: Derivative data saved (138 records). [2025-10-28T22:12:09.098696] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-28T22:12:09.097541] [DEBUG] [LOCAL ] GFL: Derivative data saved (138 records). [2025-10-28T22:12:09.098788] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-28T22:12:09.101020] [INFO ] [MAIN ] Derivative Progress: 734/2046 symbols completed. GFI took 1.2s. Estimated remaining: 8m 54s. Rate: 147.4 symbols/min [2025-10-28T22:12:09.103790] [INFO ] [MAIN ] Derivative Progress: 735/2046 symbols completed. GFL took 1.2s. Estimated remaining: 8m 53s. Rate: 147.6 symbols/min [2025-10-28T22:12:09.104168] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:09.104220] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:09.104761] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:09.112637] [DEBUG] [LOCAL ] GFR: Loaded 6871 existing records from primary storage. [2025-10-28T22:12:09.112938] [INFO ] [MAIN ] GFR: Loaded 6871 primary data records. [2025-10-28T22:12:09.468607] [DEBUG] [LOCAL ] GGG: Loaded 40372 existing records from primary storage. [2025-10-28T22:12:09.469318] [INFO ] [MAIN ] GGG: Loaded 40372 primary data records. [2025-10-28T22:12:09.470185] [DEBUG] [LOCAL ] GGB: Loaded 51530 existing records from primary storage. [2025-10-28T22:12:09.484058] [INFO ] [MAIN ] GGB: Loaded 51530 primary data records. [2025-10-28T22:12:10.160253] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:10.216146] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:10.247816] [INFO ] [MAIN ] GFR: Generated 138 derivative records from 6871 primary records. [2025-10-28T22:12:10.248500] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:10.248814] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-28T22:12:10.278927] [DEBUG] [LOCAL ] GFR: Derivative data saved (138 records). [2025-10-28T22:12:10.279062] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-28T22:12:10.282793] [INFO ] [MAIN ] Derivative Progress: 736/2046 symbols completed. GFR took 1.2s. Estimated remaining: 8m 54s. Rate: 147.3 symbols/min [2025-10-28T22:12:10.283267] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:10.310344] [DEBUG] [LOCAL ] GGT: Loaded 14413 existing records from primary storage. [2025-10-28T22:12:10.313194] [INFO ] [MAIN ] GGT: Loaded 14413 primary data records. [2025-10-28T22:12:10.432593] [INFO ] [MAIN ] GGG: Generated 138 derivative records from 40372 primary records. [2025-10-28T22:12:10.480131] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-28T22:12:10.635144] [DEBUG] [LOCAL ] GGG: Derivative data saved (138 records). [2025-10-28T22:12:10.635262] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-28T22:12:10.638221] [INFO ] [MAIN ] Derivative Progress: 737/2046 symbols completed. GGG took 1.5s. Estimated remaining: 8m 53s. Rate: 147.3 symbols/min [2025-10-28T22:12:10.642417] [INFO ] [MAIN ] GGB: Generated 138 derivative records from 51530 primary records. [2025-10-28T22:12:10.641145] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:10.643001] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-28T22:12:10.659206] [DEBUG] [LOCAL ] GGB: Derivative data saved (138 records). [2025-10-28T22:12:10.659688] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-28T22:12:10.662481] [INFO ] [MAIN ] Derivative Progress: 738/2046 symbols completed. GGB took 1.6s. Estimated remaining: 8m 52s. Rate: 147.5 symbols/min [2025-10-28T22:12:10.662852] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:10.665469] [DEBUG] [LOCAL ] GGZ: Loaded 2283 existing records from primary storage. [2025-10-28T22:12:10.666257] [INFO ] [MAIN ] GGZ: Loaded 2283 primary data records. [2025-10-28T22:12:10.718454] [DEBUG] [LOCAL ] GHC: Loaded 2943 existing records from primary storage. [2025-10-28T22:12:10.727364] [INFO ] [MAIN ] GHC: Loaded 2943 primary data records. [2025-10-28T22:12:10.935198] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:11.341156] [INFO ] [MAIN ] GGT: Generated 138 derivative records from 14413 primary records. [2025-10-28T22:12:11.341573] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-28T22:12:11.361911] [DEBUG] [LOCAL ] GGT: Derivative data saved (138 records). [2025-10-28T22:12:11.369953] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-28T22:12:11.375365] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:11.385441] [INFO ] [MAIN ] Derivative Progress: 739/2046 symbols completed. GGT took 1.1s. Estimated remaining: 8m 52s. Rate: 147.3 symbols/min [2025-10-28T22:12:11.405131] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:11.404802] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:11.429074] [DEBUG] [LOCAL ] GHG: Loaded 3266 existing records from primary storage. [2025-10-28T22:12:11.429316] [INFO ] [MAIN ] GHG: Loaded 3266 primary data records. [2025-10-28T22:12:11.784220] [INFO ] [MAIN ] GGZ: Generated 138 derivative records from 2283 primary records. [2025-10-28T22:12:11.785274] [INFO ] [MAIN ] GHC: Generated 138 derivative records from 2943 primary records. [2025-10-28T22:12:11.785393] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-28T22:12:11.785744] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-28T22:12:11.808732] [DEBUG] [LOCAL ] GHC: Derivative data saved (138 records). [2025-10-28T22:12:11.808228] [DEBUG] [LOCAL ] GGZ: Derivative data saved (138 records). [2025-10-28T22:12:11.808962] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-28T22:12:11.811196] [INFO ] [MAIN ] Derivative Progress: 740/2046 symbols completed. GGZ took 1.2s. Estimated remaining: 8m 52s. Rate: 147.3 symbols/min [2025-10-28T22:12:11.808849] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-28T22:12:11.811527] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:11.815024] [INFO ] [MAIN ] Derivative Progress: 741/2046 symbols completed. GHC took 1.2s. Estimated remaining: 8m 51s. Rate: 147.5 symbols/min [2025-10-28T22:12:11.815324] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:11.827416] [DEBUG] [LOCAL ] GHLD: Loaded 4340 existing records from primary storage. [2025-10-28T22:12:11.835490] [INFO ] [MAIN ] GHLD: Loaded 4340 primary data records. [2025-10-28T22:12:11.871340] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:12:11.887716] [DEBUG] [LOCAL ] GHI: Loaded 8022 existing records from primary storage. [2025-10-28T22:12:11.938842] [INFO ] [MAIN ] GHI: Loaded 8022 primary data records. [2025-10-28T22:12:12.550152] [INFO ] [MAIN ] GHG: Generated 138 derivative records from 3266 primary records. [2025-10-28T22:12:12.550594] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-28T22:12:12.566996] [DEBUG] [LOCAL ] GHG: Derivative data saved (138 records). [2025-10-28T22:12:12.567191] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-28T22:12:12.570470] [INFO ] [MAIN ] Derivative Progress: 742/2046 symbols completed. GHG took 1.2s. Estimated remaining: 8m 51s. Rate: 147.3 symbols/min [2025-10-28T22:12:12.571957] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:12.587998] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:12:12.629429] [DEBUG] [LOCAL ] GHM: Loaded 14314 existing records from primary storage. [2025-10-28T22:12:12.629716] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:12.644865] [INFO ] [MAIN ] GHM: Loaded 14314 primary data records. [2025-10-28T22:12:12.969416] [INFO ] [MAIN ] GHLD: Generated 138 derivative records from 4340 primary records. [2025-10-28T22:12:12.971429] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-28T22:12:12.986818] [DEBUG] [LOCAL ] GHLD: Derivative data saved (138 records). [2025-10-28T22:12:12.987144] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-28T22:12:12.989285] [INFO ] [MAIN ] Derivative Progress: 743/2046 symbols completed. GHLD took 1.2s. Estimated remaining: 8m 51s. Rate: 147.3 symbols/min [2025-10-28T22:12:12.990905] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:12.994858] [INFO ] [MAIN ] GHI: Generated 138 derivative records from 8022 primary records. [2025-10-28T22:12:12.995061] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-28T22:12:13.006870] [DEBUG] [LOCAL ] GHI: Derivative data saved (138 records). [2025-10-28T22:12:13.007169] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-28T22:12:13.009841] [INFO ] [MAIN ] Derivative Progress: 744/2046 symbols completed. GHI took 1.2s. Estimated remaining: 8m 50s. Rate: 147.5 symbols/min [2025-10-28T22:12:13.010116] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:13.038848] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:13.039951] [DEBUG] [LOCAL ] GHY: Loaded 20622 existing records from primary storage. [2025-10-28T22:12:13.040179] [INFO ] [MAIN ] GHY: Loaded 20622 primary data records. [2025-10-28T22:12:13.173975] [DEBUG] [LOCAL ] GIB: Loaded 30851 existing records from primary storage. [2025-10-28T22:12:13.177766] [INFO ] [MAIN ] GIB: Loaded 30851 primary data records. [2025-10-28T22:12:13.691705] [INFO ] [MAIN ] GHM: Generated 138 derivative records from 14314 primary records. [2025-10-28T22:12:13.692373] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-28T22:12:13.705160] [DEBUG] [LOCAL ] GHM: Derivative data saved (138 records). [2025-10-28T22:12:13.706296] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-28T22:12:13.709282] [INFO ] [MAIN ] Derivative Progress: 745/2046 symbols completed. GHM took 1.1s. Estimated remaining: 8m 50s. Rate: 147.4 symbols/min [2025-10-28T22:12:13.710368] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:13.725833] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:13.754602] [DEBUG] [LOCAL ] GIC: Loaded 12937 existing records from primary storage. [2025-10-28T22:12:13.755000] [INFO ] [MAIN ] GIC: Loaded 12937 primary data records. [2025-10-28T22:12:13.840860] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:14.111145] [INFO ] [MAIN ] GHY: Generated 138 derivative records from 20622 primary records. [2025-10-28T22:12:14.111784] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-28T22:12:14.128031] [DEBUG] [LOCAL ] GHY: Derivative data saved (138 records). [2025-10-28T22:12:14.128235] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-28T22:12:14.133215] [INFO ] [MAIN ] Derivative Progress: 746/2046 symbols completed. GHY took 1.1s. Estimated remaining: 8m 49s. Rate: 147.4 symbols/min [2025-10-28T22:12:14.133554] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:14.138752] [INFO ] [MAIN ] GIB: Generated 138 derivative records from 30851 primary records. [2025-10-28T22:12:14.138836] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-28T22:12:14.151818] [DEBUG] [LOCAL ] GIB: Derivative data saved (138 records). [2025-10-28T22:12:14.154580] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-28T22:12:14.157363] [INFO ] [MAIN ] Derivative Progress: 747/2046 symbols completed. GIB took 1.1s. Estimated remaining: 8m 48s. Rate: 147.6 symbols/min [2025-10-28T22:12:14.157689] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:14.172486] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:14.245005] [DEBUG] [LOCAL ] GIL: Loaded 43779 existing records from primary storage. [2025-10-28T22:12:14.247971] [INFO ] [MAIN ] GIC: Generated 138 derivative records from 12937 primary records. [2025-10-28T22:12:14.247796] [INFO ] [MAIN ] GIL: Loaded 43779 primary data records. [2025-10-28T22:12:14.248107] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-28T22:12:14.316940] [DEBUG] [LOCAL ] GIC: Derivative data saved (138 records). [2025-10-28T22:12:14.381458] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-28T22:12:14.382324] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-28T22:12:14.385331] [INFO ] [MAIN ] Derivative Progress: 748/2046 symbols completed. GIC took 0.7s. Estimated remaining: 8m 47s. Rate: 147.6 symbols/min [2025-10-28T22:12:14.395980] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-10-28T22:12:14.930454] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:14.968889] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:14.997164] [INFO ] [MAIN ] GIL: Generated 138 derivative records from 43779 primary records. [2025-10-28T22:12:14.997564] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-28T22:12:15.013890] [DEBUG] [LOCAL ] GIL: Derivative data saved (138 records). [2025-10-28T22:12:15.013975] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-28T22:12:15.017120] [INFO ] [MAIN ] Derivative Progress: 749/2046 symbols completed. GIL took 0.9s. Estimated remaining: 8m 47s. Rate: 147.5 symbols/min [2025-10-28T22:12:15.024377] [INFO ] [MAIN ] GIS: Generated 138 derivative records from 53675 primary records. [2025-10-28T22:12:15.024527] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-28T22:12:15.036416] [DEBUG] [LOCAL ] GIS: Derivative data saved (138 records). [2025-10-28T22:12:15.036478] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-28T22:12:15.039190] [INFO ] [MAIN ] Derivative Progress: 750/2046 symbols completed. GIS took 0.9s. Estimated remaining: 8m 46s. Rate: 147.7 symbols/min [2025-10-28T22:12:15.039637] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:15.039788] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:15.040220] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:15.107571] [DEBUG] [LOCAL ] GKOS: Loaded 42280 existing records from primary storage. [2025-10-28T22:12:15.120724] [INFO ] [MAIN ] GKOS: Loaded 42280 primary data records. [2025-10-28T22:12:15.121227] [DEBUG] [LOCAL ] GL: Loaded 37187 existing records from primary storage. [2025-10-28T22:12:15.121372] [INFO ] [MAIN ] GL: Loaded 37187 primary data records. [2025-10-28T22:12:15.166429] [DEBUG] [LOCAL ] GLOB: Loaded 48028 existing records from primary storage. [2025-10-28T22:12:15.171763] [INFO ] [MAIN ] GLOB: Loaded 48028 primary data records. [2025-10-28T22:12:16.072961] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:16.121347] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:16.122179] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:16.201101] [INFO ] [MAIN ] GL: Generated 138 derivative records from 37187 primary records. [2025-10-28T22:12:16.201901] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-28T22:12:16.218434] [DEBUG] [LOCAL ] GL: Derivative data saved (138 records). [2025-10-28T22:12:16.219573] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-28T22:12:16.223896] [INFO ] [MAIN ] Derivative Progress: 751/2046 symbols completed. GL took 1.2s. Estimated remaining: 8m 47s. Rate: 147.3 symbols/min [2025-10-28T22:12:16.224148] [INFO ] [MAIN ] GLOB: Generated 138 derivative records from 48028 primary records. [2025-10-28T22:12:16.224404] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:16.224670] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-28T22:12:16.236517] [INFO ] [MAIN ] GKOS: Generated 138 derivative records from 42280 primary records. [2025-10-28T22:12:16.239564] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-28T22:12:16.239500] [DEBUG] [LOCAL ] GLOB: Derivative data saved (138 records). [2025-10-28T22:12:16.251449] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-28T22:12:16.254456] [INFO ] [MAIN ] Derivative Progress: 752/2046 symbols completed. GLOB took 1.2s. Estimated remaining: 8m 46s. Rate: 147.5 symbols/min [2025-10-28T22:12:16.257480] [DEBUG] [LOCAL ] GKOS: Derivative data saved (138 records). [2025-10-28T22:12:16.256752] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:16.257589] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-28T22:12:16.261780] [INFO ] [MAIN ] Derivative Progress: 753/2046 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 45s. Rate: 147.7 symbols/min [2025-10-28T22:12:16.266511] [DEBUG] [LOCAL ] GLP: Loaded 9089 existing records from primary storage. [2025-10-28T22:12:16.266707] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:16.266983] [INFO ] [MAIN ] GLP: Loaded 9089 primary data records. [2025-10-28T22:12:16.660562] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-28T22:12:16.661996] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-10-28T22:12:16.662896] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-28T22:12:16.663083] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-28T22:12:16.910020] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:17.311244] [INFO ] [MAIN ] GLP: Generated 138 derivative records from 9089 primary records. [2025-10-28T22:12:17.312189] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-28T22:12:17.328853] [DEBUG] [LOCAL ] GLP: Derivative data saved (138 records). [2025-10-28T22:12:17.341579] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-28T22:12:17.342091] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:17.351566] [INFO ] [MAIN ] Derivative Progress: 754/2046 symbols completed. GLP took 1.1s. Estimated remaining: 8m 46s. Rate: 147.4 symbols/min [2025-10-28T22:12:17.356696] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:17.367999] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:17.436416] [INFO ] [MAIN ] GLW: Generated 138 derivative records from 53635 primary records. [2025-10-28T22:12:17.440208] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-28T22:12:17.474473] [INFO ] [MAIN ] GM: Generated 138 derivative records from 53729 primary records. [2025-10-28T22:12:17.476520] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-28T22:12:17.476615] [DEBUG] [LOCAL ] GLW: Derivative data saved (138 records). [2025-10-28T22:12:17.477941] [DEBUG] [LOCAL ] GME: Loaded 53776 existing records from primary storage. [2025-10-28T22:12:17.478320] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-28T22:12:17.481274] [INFO ] [MAIN ] Derivative Progress: 755/2046 symbols completed. GLW took 1.2s. Estimated remaining: 8m 45s. Rate: 147.5 symbols/min [2025-10-28T22:12:17.478620] [INFO ] [MAIN ] GME: Loaded 53776 primary data records. [2025-10-28T22:12:17.481593] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:17.574062] [DEBUG] [LOCAL ] GM: Derivative data saved (138 records). [2025-10-28T22:12:17.597709] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-28T22:12:17.603177] [INFO ] [MAIN ] Derivative Progress: 756/2046 symbols completed. GM took 1.3s. Estimated remaining: 8m 44s. Rate: 147.7 symbols/min [2025-10-28T22:12:17.603766] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:17.838879] [DEBUG] [LOCAL ] GMED: Loaded 48070 existing records from primary storage. [2025-10-28T22:12:17.849333] [INFO ] [MAIN ] GMED: Loaded 48070 primary data records. [2025-10-28T22:12:17.870678] [DEBUG] [LOCAL ] GMRE: Loaded 35511 existing records from primary storage. [2025-10-28T22:12:17.886453] [INFO ] [MAIN ] GMRE: Loaded 35511 primary data records. [2025-10-28T22:12:18.089924] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:18.588973] [INFO ] [MAIN ] GME: Generated 138 derivative records from 53776 primary records. [2025-10-28T22:12:18.591884] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:18.592138] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-28T22:12:18.624811] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:18.659929] [DEBUG] [LOCAL ] GME: Derivative data saved (138 records). [2025-10-28T22:12:18.663933] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-28T22:12:18.666394] [INFO ] [MAIN ] Derivative Progress: 757/2046 symbols completed. GME took 1.3s. Estimated remaining: 8m 45s. Rate: 147.3 symbols/min [2025-10-28T22:12:18.668978] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:18.716894] [DEBUG] [LOCAL ] GNE: Loaded 18106 existing records from primary storage. [2025-10-28T22:12:18.720091] [INFO ] [MAIN ] GNE: Loaded 18106 primary data records. [2025-10-28T22:12:18.822748] [INFO ] [MAIN ] GMED: Generated 138 derivative records from 48070 primary records. [2025-10-28T22:12:18.831340] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-28T22:12:18.847941] [INFO ] [MAIN ] GMRE: Generated 138 derivative records from 35511 primary records. [2025-10-28T22:12:18.861198] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-28T22:12:18.890214] [DEBUG] [LOCAL ] GMED: Derivative data saved (138 records). [2025-10-28T22:12:18.956367] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-28T22:12:19.076104] [INFO ] [MAIN ] Derivative Progress: 758/2046 symbols completed. GMED took 1.6s. Estimated remaining: 8m 44s. Rate: 147.3 symbols/min [2025-10-28T22:12:19.074115] [DEBUG] [LOCAL ] GMRE: Derivative data saved (138 records). [2025-10-28T22:12:19.077163] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-28T22:12:19.080223] [INFO ] [MAIN ] Derivative Progress: 759/2046 symbols completed. GMRE took 1.5s. Estimated remaining: 8m 43s. Rate: 147.5 symbols/min [2025-10-28T22:12:19.079879] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:19.080881] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:19.114978] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:19.158823] [DEBUG] [LOCAL ] GNK: Loaded 38830 existing records from primary storage. [2025-10-28T22:12:19.159570] [INFO ] [MAIN ] GNK: Loaded 38830 primary data records. [2025-10-28T22:12:19.231876] [DEBUG] [LOCAL ] GNL: Loaded 46178 existing records from primary storage. [2025-10-28T22:12:19.252386] [INFO ] [MAIN ] GNL: Loaded 46178 primary data records. [2025-10-28T22:12:19.614446] [INFO ] [MAIN ] GNE: Generated 138 derivative records from 18106 primary records. [2025-10-28T22:12:19.630431] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-28T22:12:19.811634] [DEBUG] [LOCAL ] GNE: Derivative data saved (138 records). [2025-10-28T22:12:19.812304] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-28T22:12:19.814346] [INFO ] [MAIN ] Derivative Progress: 760/2046 symbols completed. GNE took 1.1s. Estimated remaining: 8m 44s. Rate: 147.4 symbols/min [2025-10-28T22:12:19.814577] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:19.845079] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:19.874377] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:19.922552] [DEBUG] [LOCAL ] GNRC: Loaded 45153 existing records from primary storage. [2025-10-28T22:12:19.926895] [INFO ] [MAIN ] GNRC: Loaded 45153 primary data records. [2025-10-28T22:12:20.243559] [INFO ] [MAIN ] GNK: Generated 138 derivative records from 38830 primary records. [2025-10-28T22:12:20.245790] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-28T22:12:20.250022] [INFO ] [MAIN ] GNL: Generated 138 derivative records from 46178 primary records. [2025-10-28T22:12:20.257862] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-28T22:12:20.262811] [DEBUG] [LOCAL ] GNK: Derivative data saved (138 records). [2025-10-28T22:12:20.263457] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-28T22:12:20.265958] [INFO ] [MAIN ] Derivative Progress: 761/2046 symbols completed. GNK took 1.2s. Estimated remaining: 8m 43s. Rate: 147.4 symbols/min [2025-10-28T22:12:20.266116] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:20.279278] [DEBUG] [LOCAL ] GNL: Derivative data saved (138 records). [2025-10-28T22:12:20.279666] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-28T22:12:20.282556] [INFO ] [MAIN ] Derivative Progress: 762/2046 symbols completed. GNL took 1.2s. Estimated remaining: 8m 42s. Rate: 147.5 symbols/min [2025-10-28T22:12:20.282992] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:20.290560] [DEBUG] [LOCAL ] GNT: Loaded 8606 existing records from primary storage. [2025-10-28T22:12:20.291067] [INFO ] [MAIN ] GNT: Loaded 8606 primary data records. [2025-10-28T22:12:20.457283] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:20.700830] [DEBUG] [LOCAL ] GNW: Loaded 51232 existing records from primary storage. [2025-10-28T22:12:20.701251] [INFO ] [MAIN ] GNW: Loaded 51232 primary data records. [2025-10-28T22:12:21.016491] [INFO ] [MAIN ] GNRC: Generated 138 derivative records from 45153 primary records. [2025-10-28T22:12:21.016842] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-28T22:12:21.040040] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:21.042866] [DEBUG] [LOCAL ] GNRC: Derivative data saved (138 records). [2025-10-28T22:12:21.056984] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-28T22:12:21.060119] [INFO ] [MAIN ] Derivative Progress: 763/2046 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 42s. Rate: 147.4 symbols/min [2025-10-28T22:12:21.085909] [INFO ] [MAIN ] GNT: Generated 138 derivative records from 8606 primary records. [2025-10-28T22:12:21.086194] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-28T22:12:21.105834] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:21.120354] [DEBUG] [LOCAL ] GNT: Derivative data saved (138 records). [2025-10-28T22:12:21.123028] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-28T22:12:21.125287] [INFO ] [MAIN ] Derivative Progress: 764/2046 symbols completed. GNT took 0.9s. Estimated remaining: 8m 41s. Rate: 147.5 symbols/min [2025-10-28T22:12:21.138932] [INFO ] [MAIN ] GNW: Generated 138 derivative records from 51232 primary records. [2025-10-28T22:12:21.139002] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-28T22:12:21.150361] [DEBUG] [LOCAL ] GNW: Derivative data saved (138 records). [2025-10-28T22:12:21.150415] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-28T22:12:21.152760] [INFO ] [MAIN ] Derivative Progress: 765/2046 symbols completed. GNW took 0.9s. Estimated remaining: 8m 40s. Rate: 147.7 symbols/min [2025-10-28T22:12:21.153092] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:21.153194] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:21.153565] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:21.199325] [DEBUG] [LOCAL ] GOLF: Loaded 29624 existing records from primary storage. [2025-10-28T22:12:21.199566] [INFO ] [MAIN ] GOLF: Loaded 29624 primary data records. [2025-10-28T22:12:21.311008] [DEBUG] [LOCAL ] GOF: Loaded 42723 existing records from primary storage. [2025-10-28T22:12:21.329338] [INFO ] [MAIN ] GOF: Loaded 42723 primary data records. [2025-10-28T22:12:21.328984] [DEBUG] [LOCAL ] GOOS: Loaded 43634 existing records from primary storage. [2025-10-28T22:12:21.344998] [INFO ] [MAIN ] GOOS: Loaded 43634 primary data records. [2025-10-28T22:12:22.202900] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:22.256260] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:22.258036] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:22.333940] [INFO ] [MAIN ] GOLF: Generated 138 derivative records from 29624 primary records. [2025-10-28T22:12:22.336434] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-28T22:12:22.355961] [DEBUG] [LOCAL ] GOLF: Derivative data saved (138 records). [2025-10-28T22:12:22.356311] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-28T22:12:22.359244] [INFO ] [MAIN ] Derivative Progress: 766/2046 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 41s. Rate: 147.3 symbols/min [2025-10-28T22:12:22.360251] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:22.362638] [INFO ] [MAIN ] GOF: Generated 138 derivative records from 42723 primary records. [2025-10-28T22:12:22.365096] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-28T22:12:22.365287] [INFO ] [MAIN ] GOOS: Generated 138 derivative records from 43634 primary records. [2025-10-28T22:12:22.366338] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-28T22:12:22.378769] [DEBUG] [LOCAL ] GOF: Derivative data saved (138 records). [2025-10-28T22:12:22.379438] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-28T22:12:22.388693] [INFO ] [MAIN ] Derivative Progress: 767/2046 symbols completed. GOF took 1.2s. Estimated remaining: 8m 40s. Rate: 147.5 symbols/min [2025-10-28T22:12:22.393478] [DEBUG] [LOCAL ] GOOS: Derivative data saved (138 records). [2025-10-28T22:12:22.393714] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:22.394068] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-28T22:12:22.397581] [INFO ] [MAIN ] Derivative Progress: 768/2046 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 39s. Rate: 147.7 symbols/min [2025-10-28T22:12:22.397798] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:22.431869] [DEBUG] [LOCAL ] GPI: Loaded 14578 existing records from primary storage. [2025-10-28T22:12:22.432509] [DEBUG] [LOCAL ] GOTU: Loaded 36448 existing records from primary storage. [2025-10-28T22:12:22.432738] [INFO ] [MAIN ] GPI: Loaded 14578 primary data records. [2025-10-28T22:12:22.444128] [INFO ] [MAIN ] GOTU: Loaded 36448 primary data records. [2025-10-28T22:12:22.734896] [DEBUG] [LOCAL ] GPC: Loaded 45740 existing records from primary storage. [2025-10-28T22:12:22.812545] [INFO ] [MAIN ] GPC: Loaded 45740 primary data records. [2025-10-28T22:12:23.421421] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:23.454354] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:23.496083] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:23.532045] [INFO ] [MAIN ] GPI: Generated 138 derivative records from 14578 primary records. [2025-10-28T22:12:23.532814] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-28T22:12:23.554075] [DEBUG] [LOCAL ] GPI: Derivative data saved (138 records). [2025-10-28T22:12:23.554439] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-28T22:12:23.562916] [INFO ] [MAIN ] GOTU: Generated 138 derivative records from 36448 primary records. [2025-10-28T22:12:23.560172] [INFO ] [MAIN ] Derivative Progress: 769/2046 symbols completed. GPI took 1.2s. Estimated remaining: 8m 40s. Rate: 147.3 symbols/min [2025-10-28T22:12:23.563568] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-28T22:12:23.563181] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:23.587494] [DEBUG] [LOCAL ] GPJA: Loaded 4026 existing records from primary storage. [2025-10-28T22:12:23.589526] [DEBUG] [LOCAL ] GOTU: Derivative data saved (138 records). [2025-10-28T22:12:23.590598] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-28T22:12:23.593090] [INFO ] [MAIN ] GPJA: Loaded 4026 primary data records. [2025-10-28T22:12:23.592835] [INFO ] [MAIN ] Derivative Progress: 770/2046 symbols completed. GOTU took 1.2s. Estimated remaining: 8m 39s. Rate: 147.5 symbols/min [2025-10-28T22:12:23.625754] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:23.658619] [INFO ] [MAIN ] GPC: Generated 138 derivative records from 45740 primary records. [2025-10-28T22:12:23.664682] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-28T22:12:23.725130] [DEBUG] [LOCAL ] GPC: Derivative data saved (138 records). [2025-10-28T22:12:23.735576] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-28T22:12:23.738176] [INFO ] [MAIN ] Derivative Progress: 771/2046 symbols completed. GPC took 1.3s. Estimated remaining: 8m 38s. Rate: 147.6 symbols/min [2025-10-28T22:12:23.738438] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:23.950633] [DEBUG] [LOCAL ] GPK: Loaded 52757 existing records from primary storage. [2025-10-28T22:12:23.951147] [DEBUG] [LOCAL ] GPMT: Loaded 25367 existing records from primary storage. [2025-10-28T22:12:23.951737] [INFO ] [MAIN ] GPMT: Loaded 25367 primary data records. [2025-10-28T22:12:23.951443] [INFO ] [MAIN ] GPK: Loaded 52757 primary data records. [2025-10-28T22:12:24.270486] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:24.614339] [INFO ] [MAIN ] GPJA: Generated 138 derivative records from 4026 primary records. [2025-10-28T22:12:24.614498] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-28T22:12:24.640982] [DEBUG] [LOCAL ] GPJA: Derivative data saved (138 records). [2025-10-28T22:12:24.641361] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-28T22:12:24.641928] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:24.654538] [INFO ] [MAIN ] Derivative Progress: 772/2046 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 39s. Rate: 147.4 symbols/min [2025-10-28T22:12:24.663706] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:24.672059] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:24.736532] [INFO ] [MAIN ] GPMT: Generated 138 derivative records from 25367 primary records. [2025-10-28T22:12:24.738874] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-28T22:12:24.767404] [DEBUG] [LOCAL ] GPN: Loaded 51691 existing records from primary storage. [2025-10-28T22:12:24.770297] [DEBUG] [LOCAL ] GPMT: Derivative data saved (138 records). [2025-10-28T22:12:24.770434] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-28T22:12:24.770589] [INFO ] [MAIN ] GPN: Loaded 51691 primary data records. [2025-10-28T22:12:24.784066] [INFO ] [MAIN ] Derivative Progress: 773/2046 symbols completed. GPMT took 1.0s. Estimated remaining: 8m 38s. Rate: 147.5 symbols/min [2025-10-28T22:12:24.803743] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:24.861721] [INFO ] [MAIN ] GPK: Generated 138 derivative records from 52757 primary records. [2025-10-28T22:12:24.878172] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-28T22:12:24.935060] [DEBUG] [LOCAL ] GPK: Derivative data saved (138 records). [2025-10-28T22:12:24.935213] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-28T22:12:24.946251] [INFO ] [MAIN ] Derivative Progress: 774/2046 symbols completed. GPK took 1.3s. Estimated remaining: 8m 37s. Rate: 147.6 symbols/min [2025-10-28T22:12:24.970428] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:25.120191] [DEBUG] [LOCAL ] GPOR: Loaded 23382 existing records from primary storage. [2025-10-28T22:12:25.120458] [INFO ] [MAIN ] GPOR: Loaded 23382 primary data records. [2025-10-28T22:12:25.439944] [DEBUG] [LOCAL ] GPRK: Loaded 39986 existing records from primary storage. [2025-10-28T22:12:25.440296] [INFO ] [MAIN ] GPRK: Loaded 39986 primary data records. [2025-10-28T22:12:25.742400] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:25.800884] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:25.841393] [INFO ] [MAIN ] GPN: Generated 138 derivative records from 51691 primary records. [2025-10-28T22:12:25.841806] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:25.842048] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-28T22:12:25.869602] [DEBUG] [LOCAL ] GPN: Derivative data saved (138 records). [2025-10-28T22:12:25.870035] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-28T22:12:25.873913] [INFO ] [MAIN ] Derivative Progress: 775/2046 symbols completed. GPN took 1.2s. Estimated remaining: 8m 37s. Rate: 147.4 symbols/min [2025-10-28T22:12:25.877375] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:25.900028] [INFO ] [MAIN ] GPOR: Generated 138 derivative records from 23382 primary records. [2025-10-28T22:12:25.902598] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-28T22:12:25.923628] [DEBUG] [LOCAL ] GPOR: Derivative data saved (138 records). [2025-10-28T22:12:25.926690] [DEBUG] [LOCAL ] GRBK: Loaded 26209 existing records from primary storage. [2025-10-28T22:12:25.926890] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-28T22:12:25.928966] [INFO ] [MAIN ] Derivative Progress: 776/2046 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 36s. Rate: 147.6 symbols/min [2025-10-28T22:12:25.929101] [INFO ] [MAIN ] GRBK: Loaded 26209 primary data records. [2025-10-28T22:12:25.930312] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:25.977744] [INFO ] [MAIN ] GPRK: Generated 138 derivative records from 39986 primary records. [2025-10-28T22:12:26.018664] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-28T22:12:26.018873] [DEBUG] [LOCAL ] GRC: Loaded 9304 existing records from primary storage. [2025-10-28T22:12:26.029634] [INFO ] [MAIN ] GRC: Loaded 9304 primary data records. [2025-10-28T22:12:26.126409] [DEBUG] [LOCAL ] GPRK: Derivative data saved (138 records). [2025-10-28T22:12:26.140310] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-28T22:12:26.175265] [INFO ] [MAIN ] Derivative Progress: 777/2046 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 36s. Rate: 147.6 symbols/min [2025-10-28T22:12:26.204140] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:26.547232] [DEBUG] [LOCAL ] GRDN: Loaded 21652 existing records from primary storage. [2025-10-28T22:12:26.548289] [INFO ] [MAIN ] GRDN: Loaded 21652 primary data records. [2025-10-28T22:12:26.899544] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:26.937909] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:26.991766] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:27.011495] [INFO ] [MAIN ] GRBK: Generated 138 derivative records from 26209 primary records. [2025-10-28T22:12:27.011959] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-28T22:12:27.029451] [DEBUG] [LOCAL ] GRBK: Derivative data saved (138 records). [2025-10-28T22:12:27.029792] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-28T22:12:27.031774] [INFO ] [MAIN ] Derivative Progress: 778/2046 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 36s. Rate: 147.4 symbols/min [2025-10-28T22:12:27.052323] [INFO ] [MAIN ] GRC: Generated 138 derivative records from 9304 primary records. [2025-10-28T22:12:27.054912] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-28T22:12:27.058499] [INFO ] [MAIN ] GRDN: Generated 138 derivative records from 21652 primary records. [2025-10-28T22:12:27.058858] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-28T22:12:27.070676] [DEBUG] [LOCAL ] GRC: Derivative data saved (138 records). [2025-10-28T22:12:27.070970] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-28T22:12:27.080098] [INFO ] [MAIN ] Derivative Progress: 779/2046 symbols completed. GRC took 1.1s. Estimated remaining: 8m 35s. Rate: 147.6 symbols/min [2025-10-28T22:12:27.084758] [DEBUG] [LOCAL ] GRDN: Derivative data saved (138 records). [2025-10-28T22:12:27.084849] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-28T22:12:27.087567] [INFO ] [MAIN ] Derivative Progress: 780/2046 symbols completed. GRDN took 0.9s. Estimated remaining: 8m 34s. Rate: 147.8 symbols/min [2025-10-28T22:12:27.088114] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:27.088199] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:27.088008] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:27.135800] [DEBUG] [LOCAL ] GRNT: Loaded 33544 existing records from primary storage. [2025-10-28T22:12:27.136004] [INFO ] [MAIN ] GRNT: Loaded 33544 primary data records. [2025-10-28T22:12:27.228307] [DEBUG] [LOCAL ] GRMN: Loaded 39341 existing records from primary storage. [2025-10-28T22:12:27.252220] [INFO ] [MAIN ] GRMN: Loaded 39341 primary data records. [2025-10-28T22:12:27.276172] [DEBUG] [LOCAL ] GRND: Loaded 50168 existing records from primary storage. [2025-10-28T22:12:27.333052] [INFO ] [MAIN ] GRND: Loaded 50168 primary data records. [2025-10-28T22:12:28.083143] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:28.111370] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:28.141736] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:28.200475] [INFO ] [MAIN ] GRMN: Generated 138 derivative records from 39341 primary records. [2025-10-28T22:12:28.203338] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-28T22:12:28.207104] [INFO ] [MAIN ] GRNT: Generated 138 derivative records from 33544 primary records. [2025-10-28T22:12:28.219104] [DEBUG] [LOCAL ] GRMN: Derivative data saved (138 records). [2025-10-28T22:12:28.219325] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-28T22:12:28.207563] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-28T22:12:28.222090] [INFO ] [MAIN ] Derivative Progress: 781/2046 symbols completed. GRMN took 1.1s. Estimated remaining: 8m 35s. Rate: 147.4 symbols/min [2025-10-28T22:12:28.224741] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:28.238500] [INFO ] [MAIN ] GRND: Generated 138 derivative records from 50168 primary records. [2025-10-28T22:12:28.238992] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-28T22:12:28.258493] [DEBUG] [LOCAL ] GROV: Loaded 8721 existing records from primary storage. [2025-10-28T22:12:28.254516] [DEBUG] [LOCAL ] GRND: Derivative data saved (138 records). [2025-10-28T22:12:28.259034] [INFO ] [MAIN ] GROV: Loaded 8721 primary data records. [2025-10-28T22:12:28.259670] [DEBUG] [LOCAL ] GRNT: Derivative data saved (138 records). [2025-10-28T22:12:28.280206] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-28T22:12:28.290193] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-28T22:12:28.297400] [INFO ] [MAIN ] Derivative Progress: 782/2046 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 34s. Rate: 147.6 symbols/min [2025-10-28T22:12:28.333137] [INFO ] [MAIN ] Derivative Progress: 783/2046 symbols completed. GRND took 1.2s. Estimated remaining: 8m 33s. Rate: 147.8 symbols/min [2025-10-28T22:12:28.338576] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:28.333002] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:28.427793] [DEBUG] [LOCAL ] GRX: Loaded 4799 existing records from primary storage. [2025-10-28T22:12:28.447045] [INFO ] [MAIN ] GRX: Loaded 4799 primary data records. [2025-10-28T22:12:28.922412] [DEBUG] [LOCAL ] GS: Loaded 51731 existing records from primary storage. [2025-10-28T22:12:28.922862] [INFO ] [MAIN ] GS: Loaded 51731 primary data records. [2025-10-28T22:12:29.149002] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:29.269276] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:29.309812] [INFO ] [MAIN ] GROV: Generated 138 derivative records from 8721 primary records. [2025-10-28T22:12:29.310242] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-28T22:12:29.331150] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:29.354439] [DEBUG] [LOCAL ] GROV: Derivative data saved (138 records). [2025-10-28T22:12:29.354603] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-28T22:12:29.356991] [INFO ] [MAIN ] Derivative Progress: 784/2046 symbols completed. GROV took 1.1s. Estimated remaining: 8m 33s. Rate: 147.5 symbols/min [2025-10-28T22:12:29.357183] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:29.364891] [INFO ] [MAIN ] GRX: Generated 138 derivative records from 4799 primary records. [2025-10-28T22:12:29.365261] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-28T22:12:29.379735] [DEBUG] [LOCAL ] GRX: Derivative data saved (138 records). [2025-10-28T22:12:29.379859] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-28T22:12:29.382082] [INFO ] [MAIN ] Derivative Progress: 785/2046 symbols completed. GRX took 1.0s. Estimated remaining: 8m 32s. Rate: 147.7 symbols/min [2025-10-28T22:12:29.382343] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:29.402932] [INFO ] [MAIN ] GS: Generated 138 derivative records from 51731 primary records. [2025-10-28T22:12:29.403088] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-28T22:12:29.416115] [DEBUG] [LOCAL ] GS: Derivative data saved (138 records). [2025-10-28T22:12:29.426094] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-28T22:12:29.429357] [INFO ] [MAIN ] Derivative Progress: 786/2046 symbols completed. GS took 1.1s. Estimated remaining: 8m 31s. Rate: 147.8 symbols/min [2025-10-28T22:12:29.429706] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:29.430543] [DEBUG] [LOCAL ] GSBD: Loaded 39288 existing records from primary storage. [2025-10-28T22:12:29.431086] [INFO ] [MAIN ] GSBD: Loaded 39288 primary data records. [2025-10-28T22:12:29.766932] [DEBUG] [LOCAL ] GSL: Loaded 32477 existing records from primary storage. [2025-10-28T22:12:29.767105] [INFO ] [MAIN ] GSL: Loaded 32477 primary data records. [2025-10-28T22:12:29.768336] [DEBUG] [LOCAL ] GSK: Loaded 53510 existing records from primary storage. [2025-10-28T22:12:29.768538] [INFO ] [MAIN ] GSK: Loaded 53510 primary data records. [2025-10-28T22:12:30.375085] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:30.432091] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:30.448381] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:30.480447] [INFO ] [MAIN ] GSBD: Generated 138 derivative records from 39288 primary records. [2025-10-28T22:12:30.481564] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-28T22:12:30.495224] [DEBUG] [LOCAL ] GSBD: Derivative data saved (138 records). [2025-10-28T22:12:30.499404] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-28T22:12:30.501815] [INFO ] [MAIN ] Derivative Progress: 787/2046 symbols completed. GSBD took 1.1s. Estimated remaining: 8m 32s. Rate: 147.5 symbols/min [2025-10-28T22:12:30.502469] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:30.524951] [INFO ] [MAIN ] GSK: Generated 138 derivative records from 53510 primary records. [2025-10-28T22:12:30.524599] [INFO ] [MAIN ] GSL: Generated 138 derivative records from 32477 primary records. [2025-10-28T22:12:30.525104] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-28T22:12:30.525179] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-28T22:12:30.559082] [DEBUG] [LOCAL ] GSK: Derivative data saved (138 records). [2025-10-28T22:12:30.559243] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-28T22:12:30.557673] [DEBUG] [LOCAL ] GSL: Derivative data saved (138 records). [2025-10-28T22:12:30.561054] [INFO ] [MAIN ] Derivative Progress: 788/2046 symbols completed. GSK took 1.2s. Estimated remaining: 8m 31s. Rate: 147.7 symbols/min [2025-10-28T22:12:30.561293] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:30.561704] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-28T22:12:30.564394] [INFO ] [MAIN ] Derivative Progress: 789/2046 symbols completed. GSL took 1.1s. Estimated remaining: 8m 30s. Rate: 147.9 symbols/min [2025-10-28T22:12:30.564753] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:30.580819] [DEBUG] [LOCAL ] GTES: Loaded 50234 existing records from primary storage. [2025-10-28T22:12:30.581134] [INFO ] [MAIN ] GTES: Loaded 50234 primary data records. [2025-10-28T22:12:30.941682] [DEBUG] [LOCAL ] GTLS: Loaded 42859 existing records from primary storage. [2025-10-28T22:12:30.942988] [INFO ] [MAIN ] GTLS: Loaded 42859 primary data records. [2025-10-28T22:12:30.942901] [DEBUG] [LOCAL ] GTN: Loaded 44374 existing records from primary storage. [2025-10-28T22:12:30.943188] [INFO ] [MAIN ] GTN: Loaded 44374 primary data records. [2025-10-28T22:12:31.548227] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:31.590254] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:31.605316] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:31.647126] [INFO ] [MAIN ] GTES: Generated 138 derivative records from 50234 primary records. [2025-10-28T22:12:31.648184] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-28T22:12:31.666168] [DEBUG] [LOCAL ] GTES: Derivative data saved (138 records). [2025-10-28T22:12:31.666625] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-28T22:12:31.672145] [INFO ] [MAIN ] Derivative Progress: 790/2046 symbols completed. GTES took 1.2s. Estimated remaining: 8m 31s. Rate: 147.5 symbols/min [2025-10-28T22:12:31.672389] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:31.690682] [INFO ] [MAIN ] GTLS: Generated 138 derivative records from 42859 primary records. [2025-10-28T22:12:31.689001] [INFO ] [MAIN ] GTN: Generated 138 derivative records from 44374 primary records. [2025-10-28T22:12:31.690901] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-28T22:12:31.690957] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-28T22:12:31.728546] [DEBUG] [LOCAL ] GTN: Derivative data saved (138 records). [2025-10-28T22:12:31.728485] [DEBUG] [LOCAL ] GTLS: Derivative data saved (138 records). [2025-10-28T22:12:31.728966] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-28T22:12:31.728918] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-28T22:12:31.730926] [INFO ] [MAIN ] Derivative Progress: 791/2046 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 30s. Rate: 147.7 symbols/min [2025-10-28T22:12:31.733690] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:31.733807] [INFO ] [MAIN ] Derivative Progress: 792/2046 symbols completed. GTN took 1.2s. Estimated remaining: 8m 29s. Rate: 147.9 symbols/min [2025-10-28T22:12:31.734227] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:31.744818] [DEBUG] [LOCAL ] GTY: Loaded 29639 existing records from primary storage. [2025-10-28T22:12:31.744941] [INFO ] [MAIN ] GTY: Loaded 29639 primary data records. [2025-10-28T22:12:31.861199] [DEBUG] [LOCAL ] GUG: Loaded 12023 existing records from primary storage. [2025-10-28T22:12:31.866961] [DEBUG] [LOCAL ] GUT: Loaded 15398 existing records from primary storage. [2025-10-28T22:12:31.872166] [INFO ] [MAIN ] GUG: Loaded 12023 primary data records. [2025-10-28T22:12:31.877389] [INFO ] [MAIN ] GUT: Loaded 15398 primary data records. [2025-10-28T22:12:32.706032] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:32.741409] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:32.778594] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:32.824804] [INFO ] [MAIN ] GTY: Generated 138 derivative records from 29639 primary records. [2025-10-28T22:12:32.826358] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-28T22:12:32.845573] [DEBUG] [LOCAL ] GTY: Derivative data saved (138 records). [2025-10-28T22:12:32.845752] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-28T22:12:32.849259] [INFO ] [MAIN ] Derivative Progress: 793/2046 symbols completed. GTY took 1.2s. Estimated remaining: 8m 29s. Rate: 147.6 symbols/min [2025-10-28T22:12:32.853430] [INFO ] [MAIN ] GUT: Generated 138 derivative records from 15398 primary records. [2025-10-28T22:12:32.853958] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-28T22:12:32.868578] [DEBUG] [LOCAL ] GUT: Derivative data saved (138 records). [2025-10-28T22:12:32.869855] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-28T22:12:32.871956] [INFO ] [MAIN ] Derivative Progress: 794/2046 symbols completed. GUT took 1.1s. Estimated remaining: 8m 28s. Rate: 147.7 symbols/min [2025-10-28T22:12:32.872253] [INFO ] [MAIN ] GUG: Generated 138 derivative records from 12023 primary records. [2025-10-28T22:12:32.872420] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-28T22:12:32.883586] [DEBUG] [LOCAL ] GUG: Derivative data saved (138 records). [2025-10-28T22:12:32.883660] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-28T22:12:32.886341] [INFO ] [MAIN ] Derivative Progress: 795/2046 symbols completed. GUG took 1.2s. Estimated remaining: 8m 27s. Rate: 147.9 symbols/min [2025-10-28T22:12:32.887032] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:32.886965] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:32.886899] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:32.927110] [DEBUG] [LOCAL ] GWH: Loaded 21187 existing records from primary storage. [2025-10-28T22:12:32.937561] [INFO ] [MAIN ] GWH: Loaded 21187 primary data records. [2025-10-28T22:12:32.959118] [DEBUG] [LOCAL ] GWRE: Loaded 39159 existing records from primary storage. [2025-10-28T22:12:32.970095] [INFO ] [MAIN ] GWRE: Loaded 39159 primary data records. [2025-10-28T22:12:33.053409] [DEBUG] [LOCAL ] GVA: Loaded 32061 existing records from primary storage. [2025-10-28T22:12:33.089111] [INFO ] [MAIN ] GVA: Loaded 32061 primary data records. [2025-10-28T22:12:33.881505] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:33.881703] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:33.929791] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:33.989816] [INFO ] [MAIN ] GWRE: Generated 138 derivative records from 39159 primary records. [2025-10-28T22:12:33.989610] [INFO ] [MAIN ] GWH: Generated 138 derivative records from 21187 primary records. [2025-10-28T22:12:33.990177] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-28T22:12:33.990233] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-28T22:12:34.005605] [DEBUG] [LOCAL ] GWH: Derivative data saved (138 records). [2025-10-28T22:12:34.013033] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-28T22:12:34.017263] [INFO ] [MAIN ] Derivative Progress: 796/2046 symbols completed. GWH took 1.1s. Estimated remaining: 8m 28s. Rate: 147.6 symbols/min [2025-10-28T22:12:34.020300] [DEBUG] [LOCAL ] GWRE: Derivative data saved (138 records). [2025-10-28T22:12:34.020401] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-28T22:12:34.017628] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:34.022885] [INFO ] [MAIN ] Derivative Progress: 797/2046 symbols completed. GWRE took 1.1s. Estimated remaining: 8m 27s. Rate: 147.8 symbols/min [2025-10-28T22:12:34.025134] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:34.025582] [INFO ] [MAIN ] GVA: Generated 138 derivative records from 32061 primary records. [2025-10-28T22:12:34.025690] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-28T22:12:34.038551] [DEBUG] [LOCAL ] GVA: Derivative data saved (138 records). [2025-10-28T22:12:34.038839] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-28T22:12:34.041349] [INFO ] [MAIN ] Derivative Progress: 798/2046 symbols completed. GVA took 1.2s. Estimated remaining: 8m 26s. Rate: 147.9 symbols/min [2025-10-28T22:12:34.045852] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:34.049545] [DEBUG] [LOCAL ] GYLD: Loaded 1514 existing records from primary storage. [2025-10-28T22:12:34.049782] [INFO ] [MAIN ] GYLD: Loaded 1514 primary data records. [2025-10-28T22:12:34.119020] [DEBUG] [LOCAL ] GWW: Loaded 18883 existing records from primary storage. [2025-10-28T22:12:34.124291] [INFO ] [MAIN ] GWW: Loaded 18883 primary data records. [2025-10-28T22:12:34.474701] [DEBUG] [LOCAL ] GXO: Loaded 46093 existing records from primary storage. [2025-10-28T22:12:34.480511] [INFO ] [MAIN ] GXO: Loaded 46093 primary data records. [2025-10-28T22:12:35.019469] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:12:35.051333] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:35.087476] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:35.140013] [INFO ] [MAIN ] GYLD: Generated 138 derivative records from 1514 primary records. [2025-10-28T22:12:35.144715] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-28T22:12:35.163330] [DEBUG] [LOCAL ] GYLD: Derivative data saved (138 records). [2025-10-28T22:12:35.163593] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-28T22:12:35.161813] [INFO ] [MAIN ] GWW: Generated 138 derivative records from 18883 primary records. [2025-10-28T22:12:35.163858] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-28T22:12:35.168288] [INFO ] [MAIN ] Derivative Progress: 799/2046 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 27s. Rate: 147.6 symbols/min [2025-10-28T22:12:35.169519] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:35.173920] [INFO ] [MAIN ] GXO: Generated 138 derivative records from 46093 primary records. [2025-10-28T22:12:35.181316] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-28T22:12:35.198572] [DEBUG] [LOCAL ] GXO: Derivative data saved (138 records). [2025-10-28T22:12:35.198688] [DEBUG] [LOCAL ] GWW: Derivative data saved (138 records). [2025-10-28T22:12:35.198993] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-28T22:12:35.201343] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-28T22:12:35.201264] [INFO ] [MAIN ] Derivative Progress: 800/2046 symbols completed. GWW took 1.2s. Estimated remaining: 8m 26s. Rate: 147.8 symbols/min [2025-10-28T22:12:35.204062] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:35.204607] [INFO ] [MAIN ] Derivative Progress: 801/2046 symbols completed. GXO took 1.2s. Estimated remaining: 8m 25s. Rate: 148.0 symbols/min [2025-10-28T22:12:35.205030] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:35.255618] [DEBUG] [LOCAL ] H: Loaded 44158 existing records from primary storage. [2025-10-28T22:12:35.255911] [INFO ] [MAIN ] H: Loaded 44158 primary data records. [2025-10-28T22:12:35.385586] [DEBUG] [LOCAL ] HAFN: Loaded 42374 existing records from primary storage. [2025-10-28T22:12:35.384063] [DEBUG] [LOCAL ] HAE: Loaded 38836 existing records from primary storage. [2025-10-28T22:12:35.396114] [INFO ] [MAIN ] HAE: Loaded 38836 primary data records. [2025-10-28T22:12:35.406453] [INFO ] [MAIN ] HAFN: Loaded 42374 primary data records. [2025-10-28T22:12:36.206695] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:36.255760] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:36.283636] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:36.308085] [INFO ] [MAIN ] H: Generated 138 derivative records from 44158 primary records. [2025-10-28T22:12:36.313910] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-28T22:12:36.329394] [DEBUG] [LOCAL ] H: Derivative data saved (138 records). [2025-10-28T22:12:36.329522] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-28T22:12:36.334060] [INFO ] [MAIN ] Derivative Progress: 802/2046 symbols completed. H took 1.2s. Estimated remaining: 8m 26s. Rate: 147.6 symbols/min [2025-10-28T22:12:36.334207] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:36.361709] [INFO ] [MAIN ] HAFN: Generated 138 derivative records from 42374 primary records. [2025-10-28T22:12:36.363699] [INFO ] [MAIN ] HAE: Generated 138 derivative records from 38836 primary records. [2025-10-28T22:12:36.363839] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-28T22:12:36.363881] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-28T22:12:36.400875] [DEBUG] [LOCAL ] HAFN: Derivative data saved (138 records). [2025-10-28T22:12:36.400409] [DEBUG] [LOCAL ] HAE: Derivative data saved (138 records). [2025-10-28T22:12:36.401073] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-28T22:12:36.401133] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-28T22:12:36.403920] [INFO ] [MAIN ] Derivative Progress: 803/2046 symbols completed. HAE took 1.2s. Estimated remaining: 8m 25s. Rate: 147.8 symbols/min [2025-10-28T22:12:36.404096] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:36.406432] [INFO ] [MAIN ] Derivative Progress: 804/2046 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 24s. Rate: 148.0 symbols/min [2025-10-28T22:12:36.407329] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:36.426558] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-28T22:12:36.426940] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-28T22:12:36.770152] [DEBUG] [LOCAL ] HASI: Loaded 47390 existing records from primary storage. [2025-10-28T22:12:36.770358] [INFO ] [MAIN ] HASI: Loaded 47390 primary data records. [2025-10-28T22:12:36.771113] [DEBUG] [LOCAL ] HAYW: Loaded 48731 existing records from primary storage. [2025-10-28T22:12:36.771226] [INFO ] [MAIN ] HAYW: Loaded 48731 primary data records. [2025-10-28T22:12:37.429473] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:37.480134] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:37.509358] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:37.538755] [INFO ] [MAIN ] HAL: Generated 138 derivative records from 53718 primary records. [2025-10-28T22:12:37.539283] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-28T22:12:37.559583] [DEBUG] [LOCAL ] HAL: Derivative data saved (138 records). [2025-10-28T22:12:37.560914] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-28T22:12:37.563484] [INFO ] [MAIN ] Derivative Progress: 805/2046 symbols completed. HAL took 1.2s. Estimated remaining: 8m 24s. Rate: 147.6 symbols/min [2025-10-28T22:12:37.564799] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:37.584774] [DEBUG] [LOCAL ] HBB: Loaded 5976 existing records from primary storage. [2025-10-28T22:12:37.585578] [INFO ] [MAIN ] HBB: Loaded 5976 primary data records. [2025-10-28T22:12:37.645477] [INFO ] [MAIN ] HASI: Generated 138 derivative records from 47390 primary records. [2025-10-28T22:12:37.645789] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-28T22:12:37.676244] [INFO ] [MAIN ] HAYW: Generated 138 derivative records from 48731 primary records. [2025-10-28T22:12:37.691062] [DEBUG] [LOCAL ] HASI: Derivative data saved (138 records). [2025-10-28T22:12:37.691000] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-28T22:12:37.691188] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-28T22:12:37.708857] [INFO ] [MAIN ] Derivative Progress: 806/2046 symbols completed. HASI took 1.3s. Estimated remaining: 8m 24s. Rate: 147.8 symbols/min [2025-10-28T22:12:37.713202] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:37.802843] [DEBUG] [LOCAL ] HAYW: Derivative data saved (138 records). [2025-10-28T22:12:37.802945] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-28T22:12:37.805722] [INFO ] [MAIN ] Derivative Progress: 807/2046 symbols completed. HAYW took 1.4s. Estimated remaining: 8m 23s. Rate: 147.9 symbols/min [2025-10-28T22:12:37.918825] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:37.959093] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:38.007179] [DEBUG] [LOCAL ] HBI: Loaded 52883 existing records from primary storage. [2025-10-28T22:12:38.008514] [INFO ] [MAIN ] HBI: Loaded 52883 primary data records. [2025-10-28T22:12:38.129426] [DEBUG] [LOCAL ] HBM: Loaded 52979 existing records from primary storage. [2025-10-28T22:12:38.143678] [INFO ] [MAIN ] HBM: Loaded 52979 primary data records. [2025-10-28T22:12:38.439377] [INFO ] [MAIN ] HBB: Generated 138 derivative records from 5976 primary records. [2025-10-28T22:12:38.460710] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-28T22:12:38.531794] [DEBUG] [LOCAL ] HBB: Derivative data saved (138 records). [2025-10-28T22:12:38.632684] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-28T22:12:38.649353] [INFO ] [MAIN ] Derivative Progress: 808/2046 symbols completed. HBB took 1.1s. Estimated remaining: 8m 23s. Rate: 147.7 symbols/min [2025-10-28T22:12:38.673242] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:38.710919] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:38.741094] [INFO ] [MAIN ] HBI: Generated 138 derivative records from 52883 primary records. [2025-10-28T22:12:38.741506] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-28T22:12:38.759742] [DEBUG] [LOCAL ] HBI: Derivative data saved (138 records). [2025-10-28T22:12:38.760133] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-28T22:12:38.762145] [INFO ] [MAIN ] Derivative Progress: 809/2046 symbols completed. HBI took 1.0s. Estimated remaining: 8m 22s. Rate: 147.8 symbols/min [2025-10-28T22:12:38.767726] [INFO ] [MAIN ] HBM: Generated 138 derivative records from 52979 primary records. [2025-10-28T22:12:38.767856] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-28T22:12:38.781334] [DEBUG] [LOCAL ] HBM: Derivative data saved (138 records). [2025-10-28T22:12:38.781422] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-28T22:12:38.784325] [INFO ] [MAIN ] Derivative Progress: 810/2046 symbols completed. HBM took 0.9s. Estimated remaining: 8m 21s. Rate: 148.0 symbols/min [2025-10-28T22:12:38.784734] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:38.784922] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:38.784802] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:38.802215] [DEBUG] [LOCAL ] HCI: Loaded 13859 existing records from primary storage. [2025-10-28T22:12:38.802412] [INFO ] [MAIN ] HCI: Loaded 13859 primary data records. [2025-10-28T22:12:39.049114] [DEBUG] [LOCAL ] HCA: Loaded 46820 existing records from primary storage. [2025-10-28T22:12:39.061559] [INFO ] [MAIN ] HCA: Loaded 46820 primary data records. [2025-10-28T22:12:39.100985] [DEBUG] [LOCAL ] HCC: Loaded 44630 existing records from primary storage. [2025-10-28T22:12:39.294276] [INFO ] [MAIN ] HCC: Loaded 44630 primary data records. [2025-10-28T22:12:39.892489] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:39.934608] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:39.967031] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:40.011429] [INFO ] [MAIN ] HCI: Generated 138 derivative records from 13859 primary records. [2025-10-28T22:12:40.013712] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-28T22:12:40.033980] [DEBUG] [LOCAL ] HCI: Derivative data saved (138 records). [2025-10-28T22:12:40.037919] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-28T22:12:40.043169] [INFO ] [MAIN ] Derivative Progress: 811/2046 symbols completed. HCI took 1.3s. Estimated remaining: 8m 22s. Rate: 147.6 symbols/min [2025-10-28T22:12:40.043907] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:40.050154] [INFO ] [MAIN ] HCA: Generated 138 derivative records from 46820 primary records. [2025-10-28T22:12:40.050520] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-28T22:12:40.066585] [DEBUG] [LOCAL ] HCA: Derivative data saved (138 records). [2025-10-28T22:12:40.066861] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-28T22:12:40.064373] [INFO ] [MAIN ] HCC: Generated 138 derivative records from 44630 primary records. [2025-10-28T22:12:40.066998] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-28T22:12:40.069706] [INFO ] [MAIN ] Derivative Progress: 812/2046 symbols completed. HCA took 1.3s. Estimated remaining: 8m 21s. Rate: 147.8 symbols/min [2025-10-28T22:12:40.077396] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:40.082072] [DEBUG] [LOCAL ] HCC: Derivative data saved (138 records). [2025-10-28T22:12:40.082630] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-28T22:12:40.086098] [INFO ] [MAIN ] Derivative Progress: 813/2046 symbols completed. HCC took 1.3s. Estimated remaining: 8m 20s. Rate: 148.0 symbols/min [2025-10-28T22:12:40.086682] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:40.127254] [DEBUG] [LOCAL ] HD: Loaded 53446 existing records from primary storage. [2025-10-28T22:12:40.127403] [INFO ] [MAIN ] HD: Loaded 53446 primary data records. [2025-10-28T22:12:40.472364] [DEBUG] [LOCAL ] HDB: Loaded 51896 existing records from primary storage. [2025-10-28T22:12:40.473613] [DEBUG] [LOCAL ] HE: Loaded 48563 existing records from primary storage. [2025-10-28T22:12:40.473935] [INFO ] [MAIN ] HDB: Loaded 51896 primary data records. [2025-10-28T22:12:40.474022] [INFO ] [MAIN ] HE: Loaded 48563 primary data records. [2025-10-28T22:12:41.155845] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:41.211247] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:41.216415] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:41.250491] [INFO ] [MAIN ] HD: Generated 138 derivative records from 53446 primary records. [2025-10-28T22:12:41.251767] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-28T22:12:41.267672] [DEBUG] [LOCAL ] HD: Derivative data saved (138 records). [2025-10-28T22:12:41.270251] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-28T22:12:41.272850] [INFO ] [MAIN ] Derivative Progress: 814/2046 symbols completed. HD took 1.2s. Estimated remaining: 8m 21s. Rate: 147.6 symbols/min [2025-10-28T22:12:41.277456] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:41.309670] [INFO ] [MAIN ] HDB: Generated 138 derivative records from 51896 primary records. [2025-10-28T22:12:41.311685] [INFO ] [MAIN ] HE: Generated 138 derivative records from 48563 primary records. [2025-10-28T22:12:41.311877] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-28T22:12:41.311916] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-28T22:12:41.331682] [DEBUG] [LOCAL ] HDB: Derivative data saved (138 records). [2025-10-28T22:12:41.344189] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-28T22:12:41.345114] [DEBUG] [LOCAL ] HEI: Loaded 29971 existing records from primary storage. [2025-10-28T22:12:41.347890] [INFO ] [MAIN ] HEI: Loaded 29971 primary data records. [2025-10-28T22:12:41.349620] [INFO ] [MAIN ] Derivative Progress: 815/2046 symbols completed. HDB took 1.3s. Estimated remaining: 8m 20s. Rate: 147.8 symbols/min [2025-10-28T22:12:41.361422] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:41.361824] [DEBUG] [LOCAL ] HE: Derivative data saved (138 records). [2025-10-28T22:12:41.385865] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-28T22:12:41.424829] [INFO ] [MAIN ] Derivative Progress: 816/2046 symbols completed. HE took 1.3s. Estimated remaining: 8m 19s. Rate: 147.9 symbols/min [2025-10-28T22:12:41.461793] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:41.465757] [DEBUG] [LOCAL ] HEQ: Loaded 6561 existing records from primary storage. [2025-10-28T22:12:41.471455] [INFO ] [MAIN ] HEQ: Loaded 6561 primary data records. [2025-10-28T22:12:42.004873] [DEBUG] [LOCAL ] HESM: Loaded 48536 existing records from primary storage. [2025-10-28T22:12:42.005596] [INFO ] [MAIN ] HESM: Loaded 48536 primary data records. [2025-10-28T22:12:42.185478] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:42.411086] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:42.448453] [INFO ] [MAIN ] HEI: Generated 138 derivative records from 29971 primary records. [2025-10-28T22:12:42.450940] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-28T22:12:42.480575] [DEBUG] [LOCAL ] HEI: Derivative data saved (138 records). [2025-10-28T22:12:42.482277] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:42.482372] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-28T22:12:42.498152] [INFO ] [MAIN ] Derivative Progress: 817/2046 symbols completed. HEI took 1.2s. Estimated remaining: 8m 20s. Rate: 147.6 symbols/min [2025-10-28T22:12:42.504350] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:42.534291] [INFO ] [MAIN ] HEQ: Generated 138 derivative records from 6561 primary records. [2025-10-28T22:12:42.534485] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-28T22:12:42.548943] [DEBUG] [LOCAL ] HFRO: Loaded 15711 existing records from primary storage. [2025-10-28T22:12:42.550811] [INFO ] [MAIN ] HFRO: Loaded 15711 primary data records. [2025-10-28T22:12:42.553449] [DEBUG] [LOCAL ] HEQ: Derivative data saved (138 records). [2025-10-28T22:12:42.553808] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-28T22:12:42.580220] [INFO ] [MAIN ] Derivative Progress: 818/2046 symbols completed. HEQ took 1.2s. Estimated remaining: 8m 19s. Rate: 147.8 symbols/min [2025-10-28T22:12:42.636343] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:42.667956] [INFO ] [MAIN ] HESM: Generated 138 derivative records from 48536 primary records. [2025-10-28T22:12:42.715613] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-28T22:12:42.877620] [DEBUG] [LOCAL ] HGER: Loaded 15888 existing records from primary storage. [2025-10-28T22:12:42.880570] [INFO ] [MAIN ] HGER: Loaded 15888 primary data records. [2025-10-28T22:12:42.881774] [DEBUG] [LOCAL ] HESM: Derivative data saved (138 records). [2025-10-28T22:12:42.882391] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-28T22:12:42.884982] [INFO ] [MAIN ] Derivative Progress: 819/2046 symbols completed. HESM took 1.4s. Estimated remaining: 8m 18s. Rate: 147.8 symbols/min [2025-10-28T22:12:42.885152] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:42.997082] [DEBUG] [LOCAL ] HGLB: Loaded 9253 existing records from primary storage. [2025-10-28T22:12:42.998214] [INFO ] [MAIN ] HGLB: Loaded 9253 primary data records. [2025-10-28T22:12:43.422371] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:43.601828] [INFO ] [MAIN ] HFRO: Generated 138 derivative records from 15711 primary records. [2025-10-28T22:12:43.599156] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:43.617486] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-28T22:12:43.637290] [DEBUG] [LOCAL ] HFRO: Derivative data saved (138 records). [2025-10-28T22:12:43.653949] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:43.653238] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-28T22:12:43.667940] [INFO ] [MAIN ] Derivative Progress: 820/2046 symbols completed. HFRO took 1.2s. Estimated remaining: 8m 18s. Rate: 147.6 symbols/min [2025-10-28T22:12:43.668831] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:43.699866] [DEBUG] [LOCAL ] HGTY: Loaded 13398 existing records from primary storage. [2025-10-28T22:12:43.701671] [INFO ] [MAIN ] HGTY: Loaded 13398 primary data records. [2025-10-28T22:12:43.817265] [INFO ] [MAIN ] HGER: Generated 138 derivative records from 15888 primary records. [2025-10-28T22:12:43.828269] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-28T22:12:44.036255] [INFO ] [MAIN ] HGLB: Generated 138 derivative records from 9253 primary records. [2025-10-28T22:12:44.038124] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-28T22:12:44.038206] [DEBUG] [LOCAL ] HGER: Derivative data saved (138 records). [2025-10-28T22:12:44.038289] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-28T22:12:44.041713] [INFO ] [MAIN ] Derivative Progress: 821/2046 symbols completed. HGER took 1.4s. Estimated remaining: 8m 18s. Rate: 147.7 symbols/min [2025-10-28T22:12:44.051369] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:44.055971] [DEBUG] [LOCAL ] HGLB: Derivative data saved (138 records). [2025-10-28T22:12:44.056194] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-28T22:12:44.058608] [INFO ] [MAIN ] Derivative Progress: 822/2046 symbols completed. HGLB took 1.2s. Estimated remaining: 8m 17s. Rate: 147.8 symbols/min [2025-10-28T22:12:44.058800] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:44.080711] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:44.139483] [DEBUG] [LOCAL ] HHH: Loaded 32707 existing records from primary storage. [2025-10-28T22:12:44.142284] [DEBUG] [LOCAL ] HGV: Loaded 45892 existing records from primary storage. [2025-10-28T22:12:44.141737] [INFO ] [MAIN ] HHH: Loaded 32707 primary data records. [2025-10-28T22:12:44.142632] [INFO ] [MAIN ] HGV: Loaded 45892 primary data records. [2025-10-28T22:12:44.638945] [INFO ] [MAIN ] HGTY: Generated 138 derivative records from 13398 primary records. [2025-10-28T22:12:44.753364] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-28T22:12:44.767242] [DEBUG] [LOCAL ] HGTY: Derivative data saved (138 records). [2025-10-28T22:12:44.767581] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-28T22:12:44.769790] [INFO ] [MAIN ] Derivative Progress: 823/2046 symbols completed. HGTY took 1.1s. Estimated remaining: 8m 17s. Rate: 147.7 symbols/min [2025-10-28T22:12:44.794221] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:44.823967] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:44.867009] [INFO ] [MAIN ] HGV: Generated 138 derivative records from 45892 primary records. [2025-10-28T22:12:44.867368] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-28T22:12:44.880494] [DEBUG] [LOCAL ] HGV: Derivative data saved (138 records). [2025-10-28T22:12:44.882412] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-28T22:12:44.884773] [INFO ] [MAIN ] Derivative Progress: 824/2046 symbols completed. HGV took 0.8s. Estimated remaining: 8m 16s. Rate: 147.8 symbols/min [2025-10-28T22:12:44.887449] [INFO ] [MAIN ] HHH: Generated 138 derivative records from 32707 primary records. [2025-10-28T22:12:44.887516] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-28T22:12:44.898872] [DEBUG] [LOCAL ] HHH: Derivative data saved (138 records). [2025-10-28T22:12:44.898927] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-28T22:12:44.901440] [INFO ] [MAIN ] Derivative Progress: 825/2046 symbols completed. HHH took 0.8s. Estimated remaining: 8m 15s. Rate: 148.0 symbols/min [2025-10-28T22:12:44.901829] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:44.902148] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:44.901909] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:44.953387] [DEBUG] [LOCAL ] HI: Loaded 36061 existing records from primary storage. [2025-10-28T22:12:44.962617] [INFO ] [MAIN ] HI: Loaded 36061 primary data records. [2025-10-28T22:12:44.963246] [DEBUG] [LOCAL ] HII: Loaded 32873 existing records from primary storage. [2025-10-28T22:12:44.974526] [INFO ] [MAIN ] HII: Loaded 32873 primary data records. [2025-10-28T22:12:45.182539] [DEBUG] [LOCAL ] HIG: Loaded 51022 existing records from primary storage. [2025-10-28T22:12:45.182855] [INFO ] [MAIN ] HIG: Loaded 51022 primary data records. [2025-10-28T22:12:46.196682] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:46.277034] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:46.276302] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:46.319015] [INFO ] [MAIN ] HI: Generated 138 derivative records from 36061 primary records. [2025-10-28T22:12:46.322511] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-28T22:12:46.342095] [DEBUG] [LOCAL ] HI: Derivative data saved (138 records). [2025-10-28T22:12:46.342311] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-28T22:12:46.346834] [INFO ] [MAIN ] Derivative Progress: 826/2046 symbols completed. HI took 1.4s. Estimated remaining: 8m 16s. Rate: 147.5 symbols/min [2025-10-28T22:12:46.350355] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:46.378335] [INFO ] [MAIN ] HII: Generated 138 derivative records from 32873 primary records. [2025-10-28T22:12:46.379957] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-28T22:12:46.392146] [INFO ] [MAIN ] HIG: Generated 138 derivative records from 51022 primary records. [2025-10-28T22:12:46.392259] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-28T22:12:46.418446] [DEBUG] [LOCAL ] HII: Derivative data saved (138 records). [2025-10-28T22:12:46.422253] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-28T22:12:46.425257] [INFO ] [MAIN ] Derivative Progress: 827/2046 symbols completed. HII took 1.5s. Estimated remaining: 8m 15s. Rate: 147.7 symbols/min [2025-10-28T22:12:46.425894] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:46.429016] [DEBUG] [LOCAL ] HIG: Derivative data saved (138 records). [2025-10-28T22:12:46.444283] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-28T22:12:46.447891] [INFO ] [MAIN ] Derivative Progress: 828/2046 symbols completed. HIG took 1.5s. Estimated remaining: 8m 14s. Rate: 147.8 symbols/min [2025-10-28T22:12:46.448134] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:46.449557] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-28T22:12:46.449819] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-28T22:12:46.604177] [DEBUG] [LOCAL ] HIPO: Loaded 21001 existing records from primary storage. [2025-10-28T22:12:46.598696] [DEBUG] [LOCAL ] HIO: Loaded 23411 existing records from primary storage. [2025-10-28T22:12:46.630880] [INFO ] [MAIN ] HIPO: Loaded 21001 primary data records. [2025-10-28T22:12:46.754686] [INFO ] [MAIN ] HIO: Loaded 23411 primary data records. [2025-10-28T22:12:47.445327] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:47.482144] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:47.518542] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:47.555867] [INFO ] [MAIN ] HIMS: Generated 138 derivative records from 53817 primary records. [2025-10-28T22:12:47.557386] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-28T22:12:47.573193] [DEBUG] [LOCAL ] HIMS: Derivative data saved (138 records). [2025-10-28T22:12:47.577420] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-28T22:12:47.579879] [INFO ] [MAIN ] Derivative Progress: 829/2046 symbols completed. HIMS took 1.2s. Estimated remaining: 8m 15s. Rate: 147.5 symbols/min [2025-10-28T22:12:47.580069] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:47.594714] [INFO ] [MAIN ] HIPO: Generated 138 derivative records from 21001 primary records. [2025-10-28T22:12:47.597707] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-28T22:12:47.612827] [DEBUG] [LOCAL ] HIPO: Derivative data saved (138 records). [2025-10-28T22:12:47.615749] [INFO ] [MAIN ] HIO: Generated 138 derivative records from 23411 primary records. [2025-10-28T22:12:47.615968] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-28T22:12:47.615549] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-28T22:12:47.618930] [INFO ] [MAIN ] Derivative Progress: 830/2046 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 14s. Rate: 147.7 symbols/min [2025-10-28T22:12:47.626000] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:47.640202] [DEBUG] [LOCAL ] HIO: Derivative data saved (138 records). [2025-10-28T22:12:47.640403] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-28T22:12:47.642872] [INFO ] [MAIN ] Derivative Progress: 831/2046 symbols completed. HIO took 1.2s. Estimated remaining: 8m 13s. Rate: 147.9 symbols/min [2025-10-28T22:12:47.643069] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:47.662970] [DEBUG] [LOCAL ] HIW: Loaded 44259 existing records from primary storage. [2025-10-28T22:12:47.666769] [INFO ] [MAIN ] HIW: Loaded 44259 primary data records. [2025-10-28T22:12:47.748538] [DEBUG] [LOCAL ] HIX: Loaded 20042 existing records from primary storage. [2025-10-28T22:12:47.765988] [DEBUG] [LOCAL ] HKD: Loaded 18680 existing records from primary storage. [2025-10-28T22:12:47.765594] [INFO ] [MAIN ] HIX: Loaded 20042 primary data records. [2025-10-28T22:12:47.793392] [INFO ] [MAIN ] HKD: Loaded 18680 primary data records. [2025-10-28T22:12:48.611411] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:48.648818] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:48.685310] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:48.741284] [INFO ] [MAIN ] HIX: Generated 138 derivative records from 20042 primary records. [2025-10-28T22:12:48.746455] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-28T22:12:48.760841] [DEBUG] [LOCAL ] HIX: Derivative data saved (138 records). [2025-10-28T22:12:48.761034] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-28T22:12:48.762949] [INFO ] [MAIN ] HKD: Generated 138 derivative records from 18680 primary records. [2025-10-28T22:12:48.765501] [INFO ] [MAIN ] Derivative Progress: 832/2046 symbols completed. HIX took 1.1s. Estimated remaining: 8m 14s. Rate: 147.5 symbols/min [2025-10-28T22:12:48.765729] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:48.763094] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-28T22:12:48.768447] [INFO ] [MAIN ] HIW: Generated 138 derivative records from 44259 primary records. [2025-10-28T22:12:48.769242] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-28T22:12:48.791157] [DEBUG] [LOCAL ] HKD: Derivative data saved (138 records). [2025-10-28T22:12:48.792197] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-28T22:12:48.797532] [INFO ] [MAIN ] Derivative Progress: 833/2046 symbols completed. HKD took 1.2s. Estimated remaining: 8m 13s. Rate: 147.7 symbols/min [2025-10-28T22:12:48.799892] [DEBUG] [LOCAL ] HIW: Derivative data saved (138 records). [2025-10-28T22:12:48.800158] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-28T22:12:48.800291] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:48.803399] [INFO ] [MAIN ] Derivative Progress: 834/2046 symbols completed. HIW took 1.2s. Estimated remaining: 8m 12s. Rate: 147.9 symbols/min [2025-10-28T22:12:48.804049] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:48.858242] [DEBUG] [LOCAL ] HLI: Loaded 30307 existing records from primary storage. [2025-10-28T22:12:48.858428] [INFO ] [MAIN ] HLI: Loaded 30307 primary data records. [2025-10-28T22:12:48.964796] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-28T22:12:48.976562] [INFO ] [MAIN ] HL: Loaded 53676 primary data records. [2025-10-28T22:12:49.059414] [DEBUG] [LOCAL ] HLF: Loaded 48171 existing records from primary storage. [2025-10-28T22:12:49.200679] [INFO ] [MAIN ] HLF: Loaded 48171 primary data records. [2025-10-28T22:12:49.861108] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:49.899240] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:49.933151] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:49.980115] [INFO ] [MAIN ] HLI: Generated 138 derivative records from 30307 primary records. [2025-10-28T22:12:49.984270] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-28T22:12:50.004340] [DEBUG] [LOCAL ] HLI: Derivative data saved (138 records). [2025-10-28T22:12:50.006006] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-28T22:12:50.011147] [INFO ] [MAIN ] Derivative Progress: 835/2046 symbols completed. HLI took 1.2s. Estimated remaining: 8m 13s. Rate: 147.5 symbols/min [2025-10-28T22:12:50.011794] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:50.015812] [INFO ] [MAIN ] HL: Generated 138 derivative records from 53676 primary records. [2025-10-28T22:12:50.016121] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-28T22:12:50.035359] [INFO ] [MAIN ] HLF: Generated 138 derivative records from 48171 primary records. [2025-10-28T22:12:50.035214] [DEBUG] [LOCAL ] HL: Derivative data saved (138 records). [2025-10-28T22:12:50.035480] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-28T22:12:50.035550] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-28T22:12:50.038249] [INFO ] [MAIN ] Derivative Progress: 836/2046 symbols completed. HL took 1.3s. Estimated remaining: 8m 12s. Rate: 147.7 symbols/min [2025-10-28T22:12:50.038635] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:50.053979] [DEBUG] [LOCAL ] HLF: Derivative data saved (138 records). [2025-10-28T22:12:50.054148] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-28T22:12:50.057198] [INFO ] [MAIN ] Derivative Progress: 837/2046 symbols completed. HLF took 1.3s. Estimated remaining: 8m 11s. Rate: 147.9 symbols/min [2025-10-28T22:12:50.057567] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:50.080194] [DEBUG] [LOCAL ] HLIO: Loaded 27808 existing records from primary storage. [2025-10-28T22:12:50.088145] [INFO ] [MAIN ] HLIO: Loaded 27808 primary data records. [2025-10-28T22:12:50.222411] [DEBUG] [LOCAL ] HLLY: Loaded 33119 existing records from primary storage. [2025-10-28T22:12:50.233817] [INFO ] [MAIN ] HLLY: Loaded 33119 primary data records. [2025-10-28T22:12:50.516622] [DEBUG] [LOCAL ] HLN: Loaded 53097 existing records from primary storage. [2025-10-28T22:12:50.527937] [INFO ] [MAIN ] HLN: Loaded 53097 primary data records. [2025-10-28T22:12:51.050561] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:51.086926] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:51.120224] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:51.171435] [INFO ] [MAIN ] HLIO: Generated 138 derivative records from 27808 primary records. [2025-10-28T22:12:51.173992] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-28T22:12:51.193762] [DEBUG] [LOCAL ] HLIO: Derivative data saved (138 records). [2025-10-28T22:12:51.194165] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-28T22:12:51.197235] [INFO ] [MAIN ] Derivative Progress: 838/2046 symbols completed. HLIO took 1.2s. Estimated remaining: 8m 11s. Rate: 147.5 symbols/min [2025-10-28T22:12:51.199373] [INFO ] [MAIN ] HLLY: Generated 138 derivative records from 33119 primary records. [2025-10-28T22:12:51.199527] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-28T22:12:51.201673] [INFO ] [MAIN ] HLN: Generated 138 derivative records from 53097 primary records. [2025-10-28T22:12:51.201896] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-28T22:12:51.223014] [DEBUG] [LOCAL ] HLLY: Derivative data saved (138 records). [2025-10-28T22:12:51.224583] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-28T22:12:51.224544] [DEBUG] [LOCAL ] HLN: Derivative data saved (138 records). [2025-10-28T22:12:51.226597] [INFO ] [MAIN ] Derivative Progress: 839/2046 symbols completed. HLLY took 1.2s. Estimated remaining: 8m 10s. Rate: 147.7 symbols/min [2025-10-28T22:12:51.226721] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-28T22:12:51.229314] [INFO ] [MAIN ] Derivative Progress: 840/2046 symbols completed. HLN took 1.2s. Estimated remaining: 8m 9s. Rate: 147.9 symbols/min [2025-10-28T22:12:51.229717] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:51.229638] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:51.229802] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:51.315066] [DEBUG] [LOCAL ] HMC: Loaded 46011 existing records from primary storage. [2025-10-28T22:12:51.317204] [DEBUG] [LOCAL ] HLX: Loaded 47235 existing records from primary storage. [2025-10-28T22:12:51.316172] [INFO ] [MAIN ] HMC: Loaded 46011 primary data records. [2025-10-28T22:12:51.317312] [INFO ] [MAIN ] HLX: Loaded 47235 primary data records. [2025-10-28T22:12:51.318138] [DEBUG] [LOCAL ] HLT: Loaded 50372 existing records from primary storage. [2025-10-28T22:12:51.374088] [INFO ] [MAIN ] HLT: Loaded 50372 primary data records. [2025-10-28T22:12:52.257623] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:52.287788] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:52.314950] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:52.374783] [INFO ] [MAIN ] HLX: Generated 138 derivative records from 47235 primary records. [2025-10-28T22:12:52.375853] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-28T22:12:52.386517] [INFO ] [MAIN ] HLT: Generated 138 derivative records from 50372 primary records. [2025-10-28T22:12:52.391427] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-28T22:12:52.389280] [DEBUG] [LOCAL ] HLX: Derivative data saved (138 records). [2025-10-28T22:12:52.392388] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-28T22:12:52.395016] [INFO ] [MAIN ] Derivative Progress: 841/2046 symbols completed. HLX took 1.2s. Estimated remaining: 8m 10s. Rate: 147.6 symbols/min [2025-10-28T22:12:52.402754] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:52.409502] [DEBUG] [LOCAL ] HLT: Derivative data saved (138 records). [2025-10-28T22:12:52.409692] [INFO ] [MAIN ] HMC: Generated 138 derivative records from 46011 primary records. [2025-10-28T22:12:52.409971] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-28T22:12:52.410040] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-28T22:12:52.413169] [INFO ] [MAIN ] Derivative Progress: 842/2046 symbols completed. HLT took 1.2s. Estimated remaining: 8m 9s. Rate: 147.7 symbols/min [2025-10-28T22:12:52.420376] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:52.425405] [DEBUG] [LOCAL ] HMC: Derivative data saved (138 records). [2025-10-28T22:12:52.425699] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-28T22:12:52.428193] [INFO ] [MAIN ] Derivative Progress: 843/2046 symbols completed. HMC took 1.2s. Estimated remaining: 8m 8s. Rate: 147.9 symbols/min [2025-10-28T22:12:52.428381] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:52.445854] [DEBUG] [LOCAL ] HMN: Loaded 22876 existing records from primary storage. [2025-10-28T22:12:52.446025] [INFO ] [MAIN ] HMN: Loaded 22876 primary data records. [2025-10-28T22:12:52.566299] [DEBUG] [LOCAL ] HNI: Loaded 29761 existing records from primary storage. [2025-10-28T22:12:52.588786] [INFO ] [MAIN ] HNI: Loaded 29761 primary data records. [2025-10-28T22:12:52.875792] [DEBUG] [LOCAL ] HMY: Loaded 53165 existing records from primary storage. [2025-10-28T22:12:52.887174] [INFO ] [MAIN ] HMY: Loaded 53165 primary data records. [2025-10-28T22:12:53.399472] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:53.437585] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:53.480888] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:53.513148] [INFO ] [MAIN ] HMN: Generated 138 derivative records from 22876 primary records. [2025-10-28T22:12:53.513527] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-28T22:12:53.532193] [DEBUG] [LOCAL ] HMN: Derivative data saved (138 records). [2025-10-28T22:12:53.533280] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-28T22:12:53.536438] [INFO ] [MAIN ] Derivative Progress: 844/2046 symbols completed. HMN took 1.1s. Estimated remaining: 8m 9s. Rate: 147.6 symbols/min [2025-10-28T22:12:53.537066] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:53.542230] [INFO ] [MAIN ] HNI: Generated 138 derivative records from 29761 primary records. [2025-10-28T22:12:53.542493] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-28T22:12:53.558080] [DEBUG] [LOCAL ] HNI: Derivative data saved (138 records). [2025-10-28T22:12:53.559531] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-28T22:12:53.563779] [INFO ] [MAIN ] Derivative Progress: 845/2046 symbols completed. HNI took 1.1s. Estimated remaining: 8m 8s. Rate: 147.7 symbols/min [2025-10-28T22:12:53.564113] [INFO ] [MAIN ] HMY: Generated 138 derivative records from 53165 primary records. [2025-10-28T22:12:53.564344] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:53.564250] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-28T22:12:53.577905] [DEBUG] [LOCAL ] HMY: Derivative data saved (138 records). [2025-10-28T22:12:53.578157] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-28T22:12:53.583097] [INFO ] [MAIN ] Derivative Progress: 846/2046 symbols completed. HMY took 1.2s. Estimated remaining: 8m 7s. Rate: 147.9 symbols/min [2025-10-28T22:12:53.583323] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:53.627310] [DEBUG] [LOCAL ] HOG: Loaded 50482 existing records from primary storage. [2025-10-28T22:12:53.637460] [INFO ] [MAIN ] HOG: Loaded 50482 primary data records. [2025-10-28T22:12:53.736629] [DEBUG] [LOCAL ] HOMB: Loaded 43531 existing records from primary storage. [2025-10-28T22:12:53.742635] [INFO ] [MAIN ] HOMB: Loaded 43531 primary data records. [2025-10-28T22:12:54.082338] [DEBUG] [LOCAL ] HOUS: Loaded 45809 existing records from primary storage. [2025-10-28T22:12:54.086518] [INFO ] [MAIN ] HOUS: Loaded 45809 primary data records. [2025-10-28T22:12:54.614180] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:54.643033] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:54.698765] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:54.729837] [INFO ] [MAIN ] HOG: Generated 138 derivative records from 50482 primary records. [2025-10-28T22:12:54.730331] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-28T22:12:54.750062] [DEBUG] [LOCAL ] HOG: Derivative data saved (138 records). [2025-10-28T22:12:54.750250] [INFO ] [MAIN ] HOMB: Generated 138 derivative records from 43531 primary records. [2025-10-28T22:12:54.750434] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-28T22:12:54.750568] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-28T22:12:54.755534] [INFO ] [MAIN ] Derivative Progress: 847/2046 symbols completed. HOG took 1.2s. Estimated remaining: 8m 7s. Rate: 147.6 symbols/min [2025-10-28T22:12:54.756575] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:54.770047] [DEBUG] [LOCAL ] HOMB: Derivative data saved (138 records). [2025-10-28T22:12:54.770164] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-28T22:12:54.776798] [INFO ] [MAIN ] Derivative Progress: 848/2046 symbols completed. HOMB took 1.2s. Estimated remaining: 8m 6s. Rate: 147.8 symbols/min [2025-10-28T22:12:54.777669] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:54.790976] [INFO ] [MAIN ] HOUS: Generated 138 derivative records from 45809 primary records. [2025-10-28T22:12:54.795908] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-28T22:12:54.796918] [DEBUG] [LOCAL ] HOV: Loaded 13612 existing records from primary storage. [2025-10-28T22:12:54.797228] [INFO ] [MAIN ] HOV: Loaded 13612 primary data records. [2025-10-28T22:12:54.900544] [DEBUG] [LOCAL ] HOUS: Derivative data saved (138 records). [2025-10-28T22:12:54.918401] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-28T22:12:54.941267] [INFO ] [MAIN ] Derivative Progress: 849/2046 symbols completed. HOUS took 1.4s. Estimated remaining: 8m 6s. Rate: 147.9 symbols/min [2025-10-28T22:12:54.952776] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:55.042673] [DEBUG] [LOCAL ] HP: Loaded 51229 existing records from primary storage. [2025-10-28T22:12:55.159023] [INFO ] [MAIN ] HP: Loaded 51229 primary data records. [2025-10-28T22:12:55.505968] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-28T22:12:55.506335] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-28T22:12:55.779355] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:55.897486] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:55.935912] [INFO ] [MAIN ] HOV: Generated 138 derivative records from 13612 primary records. [2025-10-28T22:12:55.936607] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-28T22:12:55.952338] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:55.975627] [DEBUG] [LOCAL ] HOV: Derivative data saved (138 records). [2025-10-28T22:12:55.975892] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-28T22:12:55.980871] [INFO ] [MAIN ] Derivative Progress: 850/2046 symbols completed. HOV took 1.2s. Estimated remaining: 8m 6s. Rate: 147.6 symbols/min [2025-10-28T22:12:55.981213] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:55.993440] [INFO ] [MAIN ] HP: Generated 138 derivative records from 51229 primary records. [2025-10-28T22:12:55.994768] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-28T22:12:56.000905] [DEBUG] [LOCAL ] HPF: Loaded 7291 existing records from primary storage. [2025-10-28T22:12:56.001199] [INFO ] [MAIN ] HPF: Loaded 7291 primary data records. [2025-10-28T22:12:56.081022] [DEBUG] [LOCAL ] HP: Derivative data saved (138 records). [2025-10-28T22:12:56.092504] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-28T22:12:56.107252] [INFO ] [MAIN ] Derivative Progress: 851/2046 symbols completed. HP took 1.3s. Estimated remaining: 8m 5s. Rate: 147.7 symbols/min [2025-10-28T22:12:56.118256] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:56.315815] [DEBUG] [LOCAL ] HPI: Loaded 10492 existing records from primary storage. [2025-10-28T22:12:56.319321] [INFO ] [MAIN ] HPE: Generated 138 derivative records from 53697 primary records. [2025-10-28T22:12:56.319514] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-28T22:12:56.319140] [INFO ] [MAIN ] HPI: Loaded 10492 primary data records. [2025-10-28T22:12:56.368495] [DEBUG] [LOCAL ] HPE: Derivative data saved (138 records). [2025-10-28T22:12:56.375540] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-28T22:12:56.410136] [INFO ] [MAIN ] Derivative Progress: 852/2046 symbols completed. HPE took 1.5s. Estimated remaining: 8m 5s. Rate: 147.7 symbols/min [2025-10-28T22:12:56.420862] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:56.666190] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:56.702912] [DEBUG] [LOCAL ] HPP: Loaded 51198 existing records from primary storage. [2025-10-28T22:12:56.703328] [INFO ] [MAIN ] HPP: Loaded 51198 primary data records. [2025-10-28T22:12:56.843322] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:57.061040] [INFO ] [MAIN ] HPF: Generated 138 derivative records from 7291 primary records. [2025-10-28T22:12:57.061251] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-28T22:12:57.075209] [DEBUG] [LOCAL ] HPF: Derivative data saved (138 records). [2025-10-28T22:12:57.075479] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-28T22:12:57.079941] [INFO ] [MAIN ] Derivative Progress: 853/2046 symbols completed. HPF took 1.1s. Estimated remaining: 8m 5s. Rate: 147.6 symbols/min [2025-10-28T22:12:57.094083] [INFO ] [MAIN ] HPI: Generated 138 derivative records from 10492 primary records. [2025-10-28T22:12:57.094354] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-28T22:12:57.106808] [DEBUG] [LOCAL ] HPI: Derivative data saved (138 records). [2025-10-28T22:12:57.107018] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-28T22:12:57.109430] [INFO ] [MAIN ] Derivative Progress: 854/2046 symbols completed. HPI took 1.0s. Estimated remaining: 8m 4s. Rate: 147.8 symbols/min [2025-10-28T22:12:57.125019] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:57.150143] [INFO ] [MAIN ] HPP: Generated 138 derivative records from 51198 primary records. [2025-10-28T22:12:57.150246] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-28T22:12:57.161717] [DEBUG] [LOCAL ] HPP: Derivative data saved (138 records). [2025-10-28T22:12:57.161782] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-28T22:12:57.164107] [INFO ] [MAIN ] Derivative Progress: 855/2046 symbols completed. HPP took 0.7s. Estimated remaining: 8m 3s. Rate: 147.9 symbols/min [2025-10-28T22:12:57.164566] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:57.164755] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:57.164682] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:57.176562] [DEBUG] [LOCAL ] HPS: Loaded 10110 existing records from primary storage. [2025-10-28T22:12:57.183446] [INFO ] [MAIN ] HPS: Loaded 10110 primary data records. [2025-10-28T22:12:57.284240] [DEBUG] [LOCAL ] HQH: Loaded 25506 existing records from primary storage. [2025-10-28T22:12:57.295242] [INFO ] [MAIN ] HQH: Loaded 25506 primary data records. [2025-10-28T22:12:57.641847] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-28T22:12:57.647195] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-10-28T22:12:58.195446] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:58.213307] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:58.279488] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:58.314498] [INFO ] [MAIN ] HQH: Generated 138 derivative records from 25506 primary records. [2025-10-28T22:12:58.315511] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-28T22:12:58.332226] [DEBUG] [LOCAL ] HQH: Derivative data saved (138 records). [2025-10-28T22:12:58.329204] [INFO ] [MAIN ] HPS: Generated 138 derivative records from 10110 primary records. [2025-10-28T22:12:58.332802] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-28T22:12:58.332530] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-28T22:12:58.337914] [INFO ] [MAIN ] Derivative Progress: 856/2046 symbols completed. HQH took 1.2s. Estimated remaining: 8m 4s. Rate: 147.6 symbols/min [2025-10-28T22:12:58.338324] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:58.351232] [DEBUG] [LOCAL ] HPS: Derivative data saved (138 records). [2025-10-28T22:12:58.351535] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-28T22:12:58.354820] [INFO ] [MAIN ] Derivative Progress: 857/2046 symbols completed. HPS took 1.2s. Estimated remaining: 8m 3s. Rate: 147.8 symbols/min [2025-10-28T22:12:58.355288] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:58.370079] [INFO ] [MAIN ] HPQ: Generated 138 derivative records from 53669 primary records. [2025-10-28T22:12:58.370194] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-28T22:12:58.389345] [DEBUG] [LOCAL ] HQL: Loaded 17242 existing records from primary storage. [2025-10-28T22:12:58.390544] [INFO ] [MAIN ] HQL: Loaded 17242 primary data records. [2025-10-28T22:12:58.412048] [DEBUG] [LOCAL ] HPQ: Derivative data saved (138 records). [2025-10-28T22:12:58.412169] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-28T22:12:58.414780] [INFO ] [MAIN ] Derivative Progress: 858/2046 symbols completed. HPQ took 1.3s. Estimated remaining: 8m 2s. Rate: 147.9 symbols/min [2025-10-28T22:12:58.430350] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:58.722392] [DEBUG] [LOCAL ] HR: Loaded 52094 existing records from primary storage. [2025-10-28T22:12:58.723183] [INFO ] [MAIN ] HR: Loaded 52094 primary data records. [2025-10-28T22:12:58.928727] [DEBUG] [LOCAL ] HRB: Loaded 47981 existing records from primary storage. [2025-10-28T22:12:59.040281] [INFO ] [MAIN ] HRB: Loaded 47981 primary data records. [2025-10-28T22:12:59.347910] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:59.391167] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:59.431391] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:12:59.447969] [INFO ] [MAIN ] HQL: Generated 138 derivative records from 17242 primary records. [2025-10-28T22:12:59.450048] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-28T22:12:59.467609] [DEBUG] [LOCAL ] HQL: Derivative data saved (138 records). [2025-10-28T22:12:59.470110] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-28T22:12:59.472578] [INFO ] [MAIN ] Derivative Progress: 859/2046 symbols completed. HQL took 1.1s. Estimated remaining: 8m 2s. Rate: 147.7 symbols/min [2025-10-28T22:12:59.475344] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:59.490457] [INFO ] [MAIN ] HR: Generated 138 derivative records from 52094 primary records. [2025-10-28T22:12:59.491388] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-28T22:12:59.516629] [INFO ] [MAIN ] HRB: Generated 138 derivative records from 47981 primary records. [2025-10-28T22:12:59.518024] [DEBUG] [LOCAL ] HR: Derivative data saved (138 records). [2025-10-28T22:12:59.526499] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-28T22:12:59.527409] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-28T22:12:59.528467] [DEBUG] [LOCAL ] HRI: Loaded 32021 existing records from primary storage. [2025-10-28T22:12:59.531156] [INFO ] [MAIN ] Derivative Progress: 860/2046 symbols completed. HR took 1.2s. Estimated remaining: 8m 1s. Rate: 147.8 symbols/min [2025-10-28T22:12:59.528566] [INFO ] [MAIN ] HRI: Loaded 32021 primary data records. [2025-10-28T22:12:59.563035] [DEBUG] [LOCAL ] HRB: Derivative data saved (138 records). [2025-10-28T22:12:59.573321] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:59.588949] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-28T22:12:59.608283] [INFO ] [MAIN ] Derivative Progress: 861/2046 symbols completed. HRB took 1.2s. Estimated remaining: 8m 1s. Rate: 147.9 symbols/min [2025-10-28T22:12:59.613562] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:12:59.897112] [DEBUG] [LOCAL ] HRTG: Loaded 34248 existing records from primary storage. [2025-10-28T22:12:59.899842] [INFO ] [MAIN ] HRTG: Loaded 34248 primary data records. [2025-10-28T22:13:00.000856] [DEBUG] [LOCAL ] HRL: Loaded 53113 existing records from primary storage. [2025-10-28T22:13:00.017147] [INFO ] [MAIN ] HRL: Loaded 53113 primary data records. [2025-10-28T22:13:00.382896] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:00.566498] [INFO ] [MAIN ] HRI: Generated 138 derivative records from 32021 primary records. [2025-10-28T22:13:00.578911] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-28T22:13:00.581756] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:00.620313] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:00.615129] [DEBUG] [LOCAL ] HRI: Derivative data saved (138 records). [2025-10-28T22:13:00.621379] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-28T22:13:00.636402] [INFO ] [MAIN ] Derivative Progress: 862/2046 symbols completed. HRI took 1.2s. Estimated remaining: 8m 1s. Rate: 147.7 symbols/min [2025-10-28T22:13:00.637181] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:00.682932] [INFO ] [MAIN ] HRTG: Generated 138 derivative records from 34248 primary records. [2025-10-28T22:13:00.684152] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-28T22:13:00.686614] [INFO ] [MAIN ] HRL: Generated 138 derivative records from 53113 primary records. [2025-10-28T22:13:00.695062] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-28T22:13:00.698353] [DEBUG] [LOCAL ] HRTG: Derivative data saved (138 records). [2025-10-28T22:13:00.706312] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-28T22:13:00.708832] [INFO ] [MAIN ] Derivative Progress: 863/2046 symbols completed. HRTG took 1.1s. Estimated remaining: 8m 0s. Rate: 147.8 symbols/min [2025-10-28T22:13:00.710439] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:00.727616] [DEBUG] [LOCAL ] HRL: Derivative data saved (138 records). [2025-10-28T22:13:00.727749] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-28T22:13:00.730319] [INFO ] [MAIN ] Derivative Progress: 864/2046 symbols completed. HRL took 1.2s. Estimated remaining: 7m 59s. Rate: 148.0 symbols/min [2025-10-28T22:13:00.730577] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:00.731724] [DEBUG] [LOCAL ] HSBC: Loaded 50952 existing records from primary storage. [2025-10-28T22:13:00.732666] [INFO ] [MAIN ] HSBC: Loaded 50952 primary data records. [2025-10-28T22:13:00.840962] [DEBUG] [LOCAL ] HSHP: Loaded 13903 existing records from primary storage. [2025-10-28T22:13:00.844995] [INFO ] [MAIN ] HSHP: Loaded 13903 primary data records. [2025-10-28T22:13:01.349740] [DEBUG] [LOCAL ] HSY: Loaded 50287 existing records from primary storage. [2025-10-28T22:13:01.350691] [INFO ] [MAIN ] HSY: Loaded 50287 primary data records. [2025-10-28T22:13:01.744344] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:01.778253] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:01.835044] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:01.853600] [INFO ] [MAIN ] HSBC: Generated 138 derivative records from 50952 primary records. [2025-10-28T22:13:01.853942] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-28T22:13:01.868224] [DEBUG] [LOCAL ] HSBC: Derivative data saved (138 records). [2025-10-28T22:13:01.868402] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-28T22:13:01.872340] [INFO ] [MAIN ] Derivative Progress: 865/2046 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 60s. Rate: 147.7 symbols/min [2025-10-28T22:13:01.872635] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:01.876212] [INFO ] [MAIN ] HSHP: Generated 138 derivative records from 13903 primary records. [2025-10-28T22:13:01.877497] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-28T22:13:01.898608] [DEBUG] [LOCAL ] HSHP: Derivative data saved (138 records). [2025-10-28T22:13:01.903369] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-28T22:13:01.906291] [INFO ] [MAIN ] Derivative Progress: 866/2046 symbols completed. HSHP took 1.2s. Estimated remaining: 7m 59s. Rate: 147.8 symbols/min [2025-10-28T22:13:01.903840] [DEBUG] [LOCAL ] HTD: Loaded 14039 existing records from primary storage. [2025-10-28T22:13:01.906553] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:01.908614] [INFO ] [MAIN ] HTD: Loaded 14039 primary data records. [2025-10-28T22:13:01.993720] [INFO ] [MAIN ] HSY: Generated 138 derivative records from 50287 primary records. [2025-10-28T22:13:01.999407] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-28T22:13:02.105735] [DEBUG] [LOCAL ] HSY: Derivative data saved (138 records). [2025-10-28T22:13:02.211949] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-28T22:13:02.237535] [INFO ] [MAIN ] Derivative Progress: 867/2046 symbols completed. HSY took 1.5s. Estimated remaining: 7m 58s. Rate: 147.9 symbols/min [2025-10-28T22:13:02.237985] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:02.260377] [DEBUG] [LOCAL ] HTGC: Loaded 47495 existing records from primary storage. [2025-10-28T22:13:02.267485] [INFO ] [MAIN ] HTGC: Loaded 47495 primary data records. [2025-10-28T22:13:02.368853] [DEBUG] [LOCAL ] HTH: Loaded 32136 existing records from primary storage. [2025-10-28T22:13:02.380678] [INFO ] [MAIN ] HTH: Loaded 32136 primary data records. [2025-10-28T22:13:02.681940] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:02.952956] [INFO ] [MAIN ] HTD: Generated 138 derivative records from 14039 primary records. [2025-10-28T22:13:02.954928] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-28T22:13:02.955474] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:02.987438] [DEBUG] [LOCAL ] HTD: Derivative data saved (138 records). [2025-10-28T22:13:02.987798] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-28T22:13:02.998840] [INFO ] [MAIN ] Derivative Progress: 868/2046 symbols completed. HTD took 1.1s. Estimated remaining: 7m 59s. Rate: 147.7 symbols/min [2025-10-28T22:13:03.006219] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:03.043763] [INFO ] [MAIN ] HTGC: Generated 138 derivative records from 47495 primary records. [2025-10-28T22:13:03.045944] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-28T22:13:03.059495] [DEBUG] [LOCAL ] HTGC: Derivative data saved (138 records). [2025-10-28T22:13:03.061762] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-28T22:13:03.064188] [INFO ] [MAIN ] Derivative Progress: 869/2046 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 58s. Rate: 147.9 symbols/min [2025-10-28T22:13:03.068015] [INFO ] [MAIN ] HTH: Generated 138 derivative records from 32136 primary records. [2025-10-28T22:13:03.068100] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-28T22:13:03.080035] [DEBUG] [LOCAL ] HTH: Derivative data saved (138 records). [2025-10-28T22:13:03.080091] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-28T22:13:03.082741] [INFO ] [MAIN ] Derivative Progress: 870/2046 symbols completed. HTH took 0.8s. Estimated remaining: 7m 57s. Rate: 148.0 symbols/min [2025-10-28T22:13:03.083157] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:03.083294] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:03.083413] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:03.147745] [DEBUG] [LOCAL ] HUBS: Loaded 39593 existing records from primary storage. [2025-10-28T22:13:03.149877] [INFO ] [MAIN ] HUBS: Loaded 39593 primary data records. [2025-10-28T22:13:03.174201] [DEBUG] [LOCAL ] HUBB: Loaded 35648 existing records from primary storage. [2025-10-28T22:13:03.228059] [DEBUG] [LOCAL ] HUM: Loaded 48986 existing records from primary storage. [2025-10-28T22:13:03.227316] [INFO ] [MAIN ] HUBB: Loaded 35648 primary data records. [2025-10-28T22:13:03.239977] [INFO ] [MAIN ] HUM: Loaded 48986 primary data records. [2025-10-28T22:13:04.117397] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:04.175267] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:04.174110] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:04.232511] [INFO ] [MAIN ] HUBS: Generated 138 derivative records from 39593 primary records. [2025-10-28T22:13:04.236847] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-28T22:13:04.250560] [DEBUG] [LOCAL ] HUBS: Derivative data saved (138 records). [2025-10-28T22:13:04.254975] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-28T22:13:04.256941] [INFO ] [MAIN ] Derivative Progress: 871/2046 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 57s. Rate: 147.7 symbols/min [2025-10-28T22:13:04.257885] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:04.263425] [INFO ] [MAIN ] HUBB: Generated 138 derivative records from 35648 primary records. [2025-10-28T22:13:04.266481] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-28T22:13:04.280375] [DEBUG] [LOCAL ] HUBB: Derivative data saved (138 records). [2025-10-28T22:13:04.280542] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-28T22:13:04.283293] [INFO ] [MAIN ] Derivative Progress: 872/2046 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 56s. Rate: 147.9 symbols/min [2025-10-28T22:13:04.286451] [INFO ] [MAIN ] HUM: Generated 138 derivative records from 48986 primary records. [2025-10-28T22:13:04.286679] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:04.286761] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-28T22:13:04.300780] [DEBUG] [LOCAL ] HUM: Derivative data saved (138 records). [2025-10-28T22:13:04.301028] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-28T22:13:04.303738] [INFO ] [MAIN ] Derivative Progress: 873/2046 symbols completed. HUM took 1.2s. Estimated remaining: 7m 55s. Rate: 148.0 symbols/min [2025-10-28T22:13:04.303980] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:04.339300] [DEBUG] [LOCAL ] HVT: Loaded 14478 existing records from primary storage. [2025-10-28T22:13:04.339431] [INFO ] [MAIN ] HVT: Loaded 14478 primary data records. [2025-10-28T22:13:04.487862] [DEBUG] [LOCAL ] HUN: Loaded 53207 existing records from primary storage. [2025-10-28T22:13:04.499154] [DEBUG] [LOCAL ] HUYA: Loaded 43540 existing records from primary storage. [2025-10-28T22:13:04.509552] [INFO ] [MAIN ] HUN: Loaded 53207 primary data records. [2025-10-28T22:13:04.504391] [INFO ] [MAIN ] HUYA: Loaded 43540 primary data records. [2025-10-28T22:13:05.328452] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:05.370452] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:05.396033] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:05.438027] [INFO ] [MAIN ] HVT: Generated 138 derivative records from 14478 primary records. [2025-10-28T22:13:05.441397] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-28T22:13:05.455582] [DEBUG] [LOCAL ] HVT: Derivative data saved (138 records). [2025-10-28T22:13:05.456054] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-28T22:13:05.462479] [INFO ] [MAIN ] Derivative Progress: 874/2046 symbols completed. HVT took 1.2s. Estimated remaining: 7m 56s. Rate: 147.7 symbols/min [2025-10-28T22:13:05.463216] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:05.476825] [INFO ] [MAIN ] HUYA: Generated 138 derivative records from 43540 primary records. [2025-10-28T22:13:05.477058] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-28T22:13:05.478861] [INFO ] [MAIN ] HUN: Generated 138 derivative records from 53207 primary records. [2025-10-28T22:13:05.479182] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-28T22:13:05.503811] [DEBUG] [LOCAL ] HUYA: Derivative data saved (138 records). [2025-10-28T22:13:05.504256] [DEBUG] [LOCAL ] HUN: Derivative data saved (138 records). [2025-10-28T22:13:05.504432] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-28T22:13:05.503962] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-28T22:13:05.507072] [INFO ] [MAIN ] Derivative Progress: 875/2046 symbols completed. HUN took 1.2s. Estimated remaining: 7m 55s. Rate: 147.8 symbols/min [2025-10-28T22:13:05.522688] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:05.522812] [INFO ] [MAIN ] Derivative Progress: 876/2046 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 54s. Rate: 148.0 symbols/min [2025-10-28T22:13:05.523509] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:05.533418] [DEBUG] [LOCAL ] HY: Loaded 9548 existing records from primary storage. [2025-10-28T22:13:05.533617] [INFO ] [MAIN ] HY: Loaded 9548 primary data records. [2025-10-28T22:13:05.670987] [DEBUG] [LOCAL ] HWM: Loaded 52640 existing records from primary storage. [2025-10-28T22:13:05.676407] [INFO ] [MAIN ] HWM: Loaded 52640 primary data records. [2025-10-28T22:13:05.926598] [DEBUG] [LOCAL ] HXL: Loaded 45798 existing records from primary storage. [2025-10-28T22:13:05.974559] [INFO ] [MAIN ] HXL: Loaded 45798 primary data records. [2025-10-28T22:13:06.518728] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:06.563163] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:06.590274] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:06.636775] [INFO ] [MAIN ] HY: Generated 138 derivative records from 9548 primary records. [2025-10-28T22:13:06.637291] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-28T22:13:06.654618] [DEBUG] [LOCAL ] HY: Derivative data saved (138 records). [2025-10-28T22:13:06.655192] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-28T22:13:06.661218] [INFO ] [MAIN ] Derivative Progress: 877/2046 symbols completed. HY took 1.1s. Estimated remaining: 7m 55s. Rate: 147.7 symbols/min [2025-10-28T22:13:06.662567] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:06.668463] [INFO ] [MAIN ] HWM: Generated 138 derivative records from 52640 primary records. [2025-10-28T22:13:06.671410] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-28T22:13:06.671853] [INFO ] [MAIN ] HXL: Generated 138 derivative records from 45798 primary records. [2025-10-28T22:13:06.672449] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-28T22:13:06.698089] [DEBUG] [LOCAL ] HXL: Derivative data saved (138 records). [2025-10-28T22:13:06.702616] [DEBUG] [LOCAL ] HWM: Derivative data saved (138 records). [2025-10-28T22:13:06.703109] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-28T22:13:06.702942] [DEBUG] [LOCAL ] HYI: Loaded 9430 existing records from primary storage. [2025-10-28T22:13:06.705623] [INFO ] [MAIN ] Derivative Progress: 878/2046 symbols completed. HXL took 1.2s. Estimated remaining: 7m 54s. Rate: 147.9 symbols/min [2025-10-28T22:13:06.705794] [INFO ] [MAIN ] HYI: Loaded 9430 primary data records. [2025-10-28T22:13:06.705894] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:06.703046] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-28T22:13:06.741609] [INFO ] [MAIN ] Derivative Progress: 879/2046 symbols completed. HWM took 1.3s. Estimated remaining: 7m 53s. Rate: 148.0 symbols/min [2025-10-28T22:13:06.748980] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:06.859261] [DEBUG] [LOCAL ] HYTR: Loaded 3090 existing records from primary storage. [2025-10-28T22:13:06.875374] [INFO ] [MAIN ] HYTR: Loaded 3090 primary data records. [2025-10-28T22:13:07.144209] [DEBUG] [LOCAL ] HYT: Loaded 33000 existing records from primary storage. [2025-10-28T22:13:07.165464] [INFO ] [MAIN ] HYT: Loaded 33000 primary data records. [2025-10-28T22:13:07.657604] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:07.698483] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:13:07.744034] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:07.758592] [INFO ] [MAIN ] HYI: Generated 138 derivative records from 9430 primary records. [2025-10-28T22:13:07.760846] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-28T22:13:07.778714] [DEBUG] [LOCAL ] HYI: Derivative data saved (138 records). [2025-10-28T22:13:07.779160] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-28T22:13:07.784341] [INFO ] [MAIN ] Derivative Progress: 880/2046 symbols completed. HYI took 1.1s. Estimated remaining: 7m 54s. Rate: 147.7 symbols/min [2025-10-28T22:13:07.787478] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:07.801800] [INFO ] [MAIN ] HYTR: Generated 138 derivative records from 3090 primary records. [2025-10-28T22:13:07.802194] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-28T22:13:07.815870] [DEBUG] [LOCAL ] HYTR: Derivative data saved (138 records). [2025-10-28T22:13:07.816258] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-28T22:13:07.825470] [INFO ] [MAIN ] Derivative Progress: 881/2046 symbols completed. HYTR took 1.1s. Estimated remaining: 7m 53s. Rate: 147.9 symbols/min [2025-10-28T22:13:07.827049] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:07.839335] [DEBUG] [LOCAL ] HZO: Loaded 28055 existing records from primary storage. [2025-10-28T22:13:07.842558] [INFO ] [MAIN ] HZO: Loaded 28055 primary data records. [2025-10-28T22:13:07.856003] [INFO ] [MAIN ] HYT: Generated 138 derivative records from 33000 primary records. [2025-10-28T22:13:07.865783] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-28T22:13:07.915356] [DEBUG] [LOCAL ] IAE: Loaded 6432 existing records from primary storage. [2025-10-28T22:13:07.964249] [DEBUG] [LOCAL ] HYT: Derivative data saved (138 records). [2025-10-28T22:13:07.961445] [INFO ] [MAIN ] IAE: Loaded 6432 primary data records. [2025-10-28T22:13:07.975285] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-28T22:13:08.005964] [INFO ] [MAIN ] Derivative Progress: 882/2046 symbols completed. HYT took 1.3s. Estimated remaining: 7m 52s. Rate: 148.0 symbols/min [2025-10-28T22:13:08.025309] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:08.538329] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:08.539464] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-28T22:13:08.550613] [INFO ] [MAIN ] IAG: Loaded 53492 primary data records. [2025-10-28T22:13:08.628311] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:08.920830] [INFO ] [MAIN ] HZO: Generated 138 derivative records from 28055 primary records. [2025-10-28T22:13:08.925038] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-28T22:13:08.937794] [INFO ] [MAIN ] IAE: Generated 138 derivative records from 6432 primary records. [2025-10-28T22:13:08.942351] [DEBUG] [LOCAL ] HZO: Derivative data saved (138 records). [2025-10-28T22:13:08.942471] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-28T22:13:08.943384] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-28T22:13:08.945542] [INFO ] [MAIN ] Derivative Progress: 883/2046 symbols completed. HZO took 1.2s. Estimated remaining: 7m 52s. Rate: 147.8 symbols/min [2025-10-28T22:13:08.957482] [DEBUG] [LOCAL ] IAE: Derivative data saved (138 records). [2025-10-28T22:13:08.958129] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-28T22:13:08.961394] [INFO ] [MAIN ] Derivative Progress: 884/2046 symbols completed. IAE took 1.1s. Estimated remaining: 7m 51s. Rate: 147.9 symbols/min [2025-10-28T22:13:08.974687] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:08.999445] [INFO ] [MAIN ] IAG: Generated 138 derivative records from 53492 primary records. [2025-10-28T22:13:08.999525] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-28T22:13:09.011040] [DEBUG] [LOCAL ] IAG: Derivative data saved (138 records). [2025-10-28T22:13:09.011095] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-28T22:13:09.013305] [INFO ] [MAIN ] Derivative Progress: 885/2046 symbols completed. IAG took 1.0s. Estimated remaining: 7m 50s. Rate: 148.1 symbols/min [2025-10-28T22:13:09.013821] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:09.014005] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:09.013938] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:09.059023] [DEBUG] [LOCAL ] IBP: Loaded 28152 existing records from primary storage. [2025-10-28T22:13:09.071728] [INFO ] [MAIN ] IBP: Loaded 28152 primary data records. [2025-10-28T22:13:09.210115] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-28T22:13:09.232333] [DEBUG] [LOCAL ] IBN: Loaded 52793 existing records from primary storage. [2025-10-28T22:13:09.232546] [INFO ] [MAIN ] IBN: Loaded 52793 primary data records. [2025-10-28T22:13:09.232473] [INFO ] [MAIN ] IBM: Loaded 53628 primary data records. [2025-10-28T22:13:10.077551] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:10.108436] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:10.147568] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:10.186099] [INFO ] [MAIN ] IBP: Generated 138 derivative records from 28152 primary records. [2025-10-28T22:13:10.187723] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-28T22:13:10.204967] [DEBUG] [LOCAL ] IBP: Derivative data saved (138 records). [2025-10-28T22:13:10.206132] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-28T22:13:10.209126] [INFO ] [MAIN ] Derivative Progress: 886/2046 symbols completed. IBP took 1.2s. Estimated remaining: 7m 51s. Rate: 147.8 symbols/min [2025-10-28T22:13:10.209752] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:10.214213] [INFO ] [MAIN ] IBN: Generated 138 derivative records from 52793 primary records. [2025-10-28T22:13:10.214317] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-28T22:13:10.230305] [DEBUG] [LOCAL ] IBN: Derivative data saved (138 records). [2025-10-28T22:13:10.230520] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-28T22:13:10.233505] [INFO ] [MAIN ] Derivative Progress: 887/2046 symbols completed. IBN took 1.2s. Estimated remaining: 7m 50s. Rate: 147.9 symbols/min [2025-10-28T22:13:10.235285] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:10.238407] [INFO ] [MAIN ] IBM: Generated 138 derivative records from 53628 primary records. [2025-10-28T22:13:10.238674] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-28T22:13:10.258983] [DEBUG] [LOCAL ] IBM: Derivative data saved (138 records). [2025-10-28T22:13:10.259202] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-28T22:13:10.261568] [INFO ] [MAIN ] Derivative Progress: 888/2046 symbols completed. IBM took 1.2s. Estimated remaining: 7m 49s. Rate: 148.1 symbols/min [2025-10-28T22:13:10.261769] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:10.273994] [DEBUG] [LOCAL ] IBTA: Loaded 35416 existing records from primary storage. [2025-10-28T22:13:10.274242] [INFO ] [MAIN ] IBTA: Loaded 35416 primary data records. [2025-10-28T22:13:10.620622] [DEBUG] [LOCAL ] ICL: Loaded 37606 existing records from primary storage. [2025-10-28T22:13:10.620981] [INFO ] [MAIN ] ICL: Loaded 37606 primary data records. [2025-10-28T22:13:10.632867] [DEBUG] [LOCAL ] ICE: Loaded 53007 existing records from primary storage. [2025-10-28T22:13:10.633061] [INFO ] [MAIN ] ICE: Loaded 53007 primary data records. [2025-10-28T22:13:11.233274] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:11.280722] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:11.303538] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:11.328100] [INFO ] [MAIN ] IBTA: Generated 138 derivative records from 35416 primary records. [2025-10-28T22:13:11.332993] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-28T22:13:11.345949] [DEBUG] [LOCAL ] IBTA: Derivative data saved (138 records). [2025-10-28T22:13:11.347411] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-28T22:13:11.349780] [INFO ] [MAIN ] Derivative Progress: 889/2046 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 50s. Rate: 147.8 symbols/min [2025-10-28T22:13:11.352847] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:11.375027] [DEBUG] [LOCAL ] IDE: Loaded 9108 existing records from primary storage. [2025-10-28T22:13:11.376782] [INFO ] [MAIN ] IDE: Loaded 9108 primary data records. [2025-10-28T22:13:11.401742] [INFO ] [MAIN ] ICL: Generated 138 derivative records from 37606 primary records. [2025-10-28T22:13:11.445232] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-28T22:13:11.493556] [INFO ] [MAIN ] ICE: Generated 138 derivative records from 53007 primary records. [2025-10-28T22:13:11.496243] [DEBUG] [LOCAL ] ICL: Derivative data saved (138 records). [2025-10-28T22:13:11.496343] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-28T22:13:11.496424] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-28T22:13:11.499170] [INFO ] [MAIN ] Derivative Progress: 890/2046 symbols completed. ICL took 1.2s. Estimated remaining: 7m 49s. Rate: 147.9 symbols/min [2025-10-28T22:13:11.510195] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:11.587386] [DEBUG] [LOCAL ] ICE: Derivative data saved (138 records). [2025-10-28T22:13:11.587546] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-28T22:13:11.702600] [INFO ] [MAIN ] Derivative Progress: 891/2046 symbols completed. ICE took 1.5s. Estimated remaining: 7m 48s. Rate: 148.0 symbols/min [2025-10-28T22:13:11.703051] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:11.718681] [DEBUG] [LOCAL ] IDT: Loaded 18480 existing records from primary storage. [2025-10-28T22:13:11.719389] [INFO ] [MAIN ] IDT: Loaded 18480 primary data records. [2025-10-28T22:13:12.078666] [DEBUG] [LOCAL ] IEX: Loaded 37974 existing records from primary storage. [2025-10-28T22:13:12.079680] [INFO ] [MAIN ] IEX: Loaded 37974 primary data records. [2025-10-28T22:13:12.207880] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:12.449235] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:12.469971] [INFO ] [MAIN ] IDE: Generated 138 derivative records from 9108 primary records. [2025-10-28T22:13:12.471798] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-28T22:13:12.496173] [DEBUG] [LOCAL ] IDE: Derivative data saved (138 records). [2025-10-28T22:13:12.496748] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-28T22:13:12.513954] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:12.513037] [INFO ] [MAIN ] Derivative Progress: 892/2046 symbols completed. IDE took 1.2s. Estimated remaining: 7m 48s. Rate: 147.8 symbols/min [2025-10-28T22:13:12.530486] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:12.566330] [INFO ] [MAIN ] IDT: Generated 138 derivative records from 18480 primary records. [2025-10-28T22:13:12.583288] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-28T22:13:12.601704] [DEBUG] [LOCAL ] IDT: Derivative data saved (138 records). [2025-10-28T22:13:12.600995] [INFO ] [MAIN ] IEX: Generated 138 derivative records from 37974 primary records. [2025-10-28T22:13:12.601921] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-28T22:13:12.604066] [INFO ] [MAIN ] Derivative Progress: 893/2046 symbols completed. IDT took 1.1s. Estimated remaining: 7m 48s. Rate: 147.9 symbols/min [2025-10-28T22:13:12.601997] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-28T22:13:12.605028] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:12.634351] [DEBUG] [LOCAL ] IEX: Derivative data saved (138 records). [2025-10-28T22:13:12.634613] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-28T22:13:12.637589] [INFO ] [MAIN ] Derivative Progress: 894/2046 symbols completed. IEX took 0.9s. Estimated remaining: 7m 47s. Rate: 148.1 symbols/min [2025-10-28T22:13:12.637900] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:12.639336] [DEBUG] [LOCAL ] IFF: Loaded 51191 existing records from primary storage. [2025-10-28T22:13:12.639672] [INFO ] [MAIN ] IFF: Loaded 51191 primary data records. [2025-10-28T22:13:12.757550] [DEBUG] [LOCAL ] IFN: Loaded 18129 existing records from primary storage. [2025-10-28T22:13:12.768468] [INFO ] [MAIN ] IFN: Loaded 18129 primary data records. [2025-10-28T22:13:12.998253] [DEBUG] [LOCAL ] IFS: Loaded 21632 existing records from primary storage. [2025-10-28T22:13:13.032296] [INFO ] [MAIN ] IFS: Loaded 21632 primary data records. [2025-10-28T22:13:13.634310] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:13.704140] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:13.704415] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:13.746093] [INFO ] [MAIN ] IFF: Generated 138 derivative records from 51191 primary records. [2025-10-28T22:13:13.746687] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-28T22:13:13.768334] [DEBUG] [LOCAL ] IFF: Derivative data saved (138 records). [2025-10-28T22:13:13.769262] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-28T22:13:13.771354] [INFO ] [MAIN ] Derivative Progress: 895/2046 symbols completed. IFF took 1.2s. Estimated remaining: 7m 47s. Rate: 147.8 symbols/min [2025-10-28T22:13:13.771572] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:13.798320] [DEBUG] [LOCAL ] IGA: Loaded 9667 existing records from primary storage. [2025-10-28T22:13:13.801262] [INFO ] [MAIN ] IGA: Loaded 9667 primary data records. [2025-10-28T22:13:13.803635] [INFO ] [MAIN ] IFN: Generated 138 derivative records from 18129 primary records. [2025-10-28T22:13:13.803861] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-28T22:13:13.868575] [DEBUG] [LOCAL ] IFN: Derivative data saved (138 records). [2025-10-28T22:13:13.886378] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-28T22:13:13.895742] [INFO ] [MAIN ] IFS: Generated 138 derivative records from 21632 primary records. [2025-10-28T22:13:13.895461] [INFO ] [MAIN ] Derivative Progress: 896/2046 symbols completed. IFN took 1.3s. Estimated remaining: 7m 47s. Rate: 147.9 symbols/min [2025-10-28T22:13:13.921969] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-28T22:13:13.935955] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:13.963545] [DEBUG] [LOCAL ] IFS: Derivative data saved (138 records). [2025-10-28T22:13:13.974050] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-28T22:13:13.992770] [INFO ] [MAIN ] Derivative Progress: 897/2046 symbols completed. IFS took 1.4s. Estimated remaining: 7m 46s. Rate: 148.0 symbols/min [2025-10-28T22:13:14.064800] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:14.196880] [DEBUG] [LOCAL ] IGI: Loaded 4082 existing records from primary storage. [2025-10-28T22:13:14.202899] [INFO ] [MAIN ] IGI: Loaded 4082 primary data records. [2025-10-28T22:13:14.243031] [DEBUG] [LOCAL ] IGD: Loaded 19113 existing records from primary storage. [2025-10-28T22:13:14.282347] [INFO ] [MAIN ] IGD: Loaded 19113 primary data records. [2025-10-28T22:13:14.865222] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:14.917083] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:14.949459] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:14.964730] [INFO ] [MAIN ] IGA: Generated 138 derivative records from 9667 primary records. [2025-10-28T22:13:14.967750] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-28T22:13:14.982252] [DEBUG] [LOCAL ] IGA: Derivative data saved (138 records). [2025-10-28T22:13:14.982359] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-28T22:13:14.986671] [INFO ] [MAIN ] Derivative Progress: 898/2046 symbols completed. IGA took 1.2s. Estimated remaining: 7m 46s. Rate: 147.8 symbols/min [2025-10-28T22:13:15.011743] [INFO ] [MAIN ] IGI: Generated 138 derivative records from 4082 primary records. [2025-10-28T22:13:15.013383] [INFO ] [MAIN ] IGD: Generated 138 derivative records from 19113 primary records. [2025-10-28T22:13:15.013526] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-28T22:13:15.013589] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-28T22:13:15.033310] [DEBUG] [LOCAL ] IGD: Derivative data saved (138 records). [2025-10-28T22:13:15.034831] [DEBUG] [LOCAL ] IGI: Derivative data saved (138 records). [2025-10-28T22:13:15.034917] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-28T22:13:15.034989] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-28T22:13:15.037279] [INFO ] [MAIN ] Derivative Progress: 899/2046 symbols completed. IGI took 1.0s. Estimated remaining: 7m 45s. Rate: 147.9 symbols/min [2025-10-28T22:13:15.039952] [INFO ] [MAIN ] Derivative Progress: 900/2046 symbols completed. IGD took 1.1s. Estimated remaining: 7m 44s. Rate: 148.1 symbols/min [2025-10-28T22:13:15.040328] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:15.040467] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:15.040280] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:15.048171] [DEBUG] [LOCAL ] IH: Loaded 2664 existing records from primary storage. [2025-10-28T22:13:15.048418] [INFO ] [MAIN ] IH: Loaded 2664 primary data records. [2025-10-28T22:13:15.115726] [DEBUG] [LOCAL ] IHD: Loaded 7342 existing records from primary storage. [2025-10-28T22:13:15.160985] [INFO ] [MAIN ] IHD: Loaded 7342 primary data records. [2025-10-28T22:13:15.338504] [DEBUG] [LOCAL ] IGR: Loaded 30039 existing records from primary storage. [2025-10-28T22:13:15.343940] [INFO ] [MAIN ] IGR: Loaded 30039 primary data records. [2025-10-28T22:13:16.031900] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:13:16.064682] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:16.107858] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:16.155346] [INFO ] [MAIN ] IH: Generated 138 derivative records from 2664 primary records. [2025-10-28T22:13:16.158749] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-28T22:13:16.174372] [DEBUG] [LOCAL ] IH: Derivative data saved (138 records). [2025-10-28T22:13:16.174953] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-28T22:13:16.174855] [INFO ] [MAIN ] IHD: Generated 138 derivative records from 7342 primary records. [2025-10-28T22:13:16.176975] [INFO ] [MAIN ] Derivative Progress: 901/2046 symbols completed. IH took 1.1s. Estimated remaining: 7m 45s. Rate: 147.8 symbols/min [2025-10-28T22:13:16.180107] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-28T22:13:16.180855] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:16.194188] [DEBUG] [LOCAL ] IHD: Derivative data saved (138 records). [2025-10-28T22:13:16.196857] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-28T22:13:16.199578] [INFO ] [MAIN ] Derivative Progress: 902/2046 symbols completed. IHD took 1.2s. Estimated remaining: 7m 44s. Rate: 148.0 symbols/min [2025-10-28T22:13:16.200235] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:16.209619] [INFO ] [MAIN ] IGR: Generated 138 derivative records from 30039 primary records. [2025-10-28T22:13:16.209796] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-28T22:13:16.221442] [DEBUG] [LOCAL ] IGR: Derivative data saved (138 records). [2025-10-28T22:13:16.221637] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-28T22:13:16.224079] [INFO ] [MAIN ] Derivative Progress: 903/2046 symbols completed. IGR took 1.2s. Estimated remaining: 7m 43s. Rate: 148.1 symbols/min [2025-10-28T22:13:16.224257] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:16.234067] [DEBUG] [LOCAL ] IHG: Loaded 23472 existing records from primary storage. [2025-10-28T22:13:16.234364] [INFO ] [MAIN ] IHG: Loaded 23472 primary data records. [2025-10-28T22:13:16.276462] [DEBUG] [LOCAL ] IIF: Loaded 4964 existing records from primary storage. [2025-10-28T22:13:16.288313] [INFO ] [MAIN ] IIF: Loaded 4964 primary data records. [2025-10-28T22:13:16.461442] [DEBUG] [LOCAL ] IHS: Loaded 36825 existing records from primary storage. [2025-10-28T22:13:16.472544] [INFO ] [MAIN ] IHS: Loaded 36825 primary data records. [2025-10-28T22:13:17.190321] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:17.219816] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:17.259364] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:17.312276] [INFO ] [MAIN ] IIF: Generated 138 derivative records from 4964 primary records. [2025-10-28T22:13:17.315865] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-28T22:13:17.328847] [DEBUG] [LOCAL ] IIF: Derivative data saved (138 records). [2025-10-28T22:13:17.330852] [INFO ] [MAIN ] IHG: Generated 138 derivative records from 23472 primary records. [2025-10-28T22:13:17.330704] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-28T22:13:17.331079] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-28T22:13:17.333400] [INFO ] [MAIN ] Derivative Progress: 904/2046 symbols completed. IIF took 1.1s. Estimated remaining: 7m 44s. Rate: 147.8 symbols/min [2025-10-28T22:13:17.334173] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:17.350381] [DEBUG] [LOCAL ] IHG: Derivative data saved (138 records). [2025-10-28T22:13:17.352162] [INFO ] [MAIN ] IHS: Generated 138 derivative records from 36825 primary records. [2025-10-28T22:13:17.351947] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-28T22:13:17.354820] [INFO ] [MAIN ] Derivative Progress: 905/2046 symbols completed. IHG took 1.2s. Estimated remaining: 7m 43s. Rate: 148.0 symbols/min [2025-10-28T22:13:17.354897] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-28T22:13:17.355174] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:17.371754] [DEBUG] [LOCAL ] IHS: Derivative data saved (138 records). [2025-10-28T22:13:17.371900] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-28T22:13:17.374329] [INFO ] [MAIN ] Derivative Progress: 906/2046 symbols completed. IHS took 1.2s. Estimated remaining: 7m 42s. Rate: 148.1 symbols/min [2025-10-28T22:13:17.374532] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:17.385047] [DEBUG] [LOCAL ] IIIN: Loaded 15939 existing records from primary storage. [2025-10-28T22:13:17.385306] [INFO ] [MAIN ] IIIN: Loaded 15939 primary data records. [2025-10-28T22:13:17.445595] [DEBUG] [LOCAL ] IIM: Loaded 15240 existing records from primary storage. [2025-10-28T22:13:17.466631] [INFO ] [MAIN ] IIM: Loaded 15240 primary data records. [2025-10-28T22:13:17.667273] [DEBUG] [LOCAL ] IIPR: Loaded 28323 existing records from primary storage. [2025-10-28T22:13:17.714931] [INFO ] [MAIN ] IIPR: Loaded 28323 primary data records. [2025-10-28T22:13:18.381854] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:18.408816] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:18.457775] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:18.495871] [INFO ] [MAIN ] IIIN: Generated 138 derivative records from 15939 primary records. [2025-10-28T22:13:18.496911] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-28T22:13:18.513150] [DEBUG] [LOCAL ] IIIN: Derivative data saved (138 records). [2025-10-28T22:13:18.516869] [INFO ] [MAIN ] IIM: Generated 138 derivative records from 15240 primary records. [2025-10-28T22:13:18.515406] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-28T22:13:18.519197] [INFO ] [MAIN ] Derivative Progress: 907/2046 symbols completed. IIIN took 1.2s. Estimated remaining: 7m 42s. Rate: 147.8 symbols/min [2025-10-28T22:13:18.519519] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-28T22:13:18.519458] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:18.535478] [DEBUG] [LOCAL ] IIM: Derivative data saved (138 records). [2025-10-28T22:13:18.535831] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-28T22:13:18.539590] [INFO ] [MAIN ] Derivative Progress: 908/2046 symbols completed. IIM took 1.2s. Estimated remaining: 7m 41s. Rate: 148.0 symbols/min [2025-10-28T22:13:18.540399] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:18.546801] [INFO ] [MAIN ] IIPR: Generated 138 derivative records from 28323 primary records. [2025-10-28T22:13:18.547005] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-28T22:13:18.559478] [DEBUG] [LOCAL ] IIPR: Derivative data saved (138 records). [2025-10-28T22:13:18.569031] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-28T22:13:18.572903] [INFO ] [MAIN ] Derivative Progress: 909/2046 symbols completed. IIPR took 1.2s. Estimated remaining: 7m 40s. Rate: 148.1 symbols/min [2025-10-28T22:13:18.573214] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:18.599783] [DEBUG] [LOCAL ] IMAX: Loaded 43353 existing records from primary storage. [2025-10-28T22:13:18.600034] [INFO ] [MAIN ] IMAX: Loaded 43353 primary data records. [2025-10-28T22:13:18.730795] [DEBUG] [LOCAL ] INFA: Loaded 48282 existing records from primary storage. [2025-10-28T22:13:18.752275] [INFO ] [MAIN ] INFA: Loaded 48282 primary data records. [2025-10-28T22:13:19.021908] [DEBUG] [LOCAL ] INFY: Loaded 53594 existing records from primary storage. [2025-10-28T22:13:19.036011] [INFO ] [MAIN ] INFY: Loaded 53594 primary data records. [2025-10-28T22:13:19.561146] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:19.597941] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:19.630237] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:19.673079] [INFO ] [MAIN ] IMAX: Generated 138 derivative records from 43353 primary records. [2025-10-28T22:13:19.675233] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-28T22:13:19.690736] [DEBUG] [LOCAL ] IMAX: Derivative data saved (138 records). [2025-10-28T22:13:19.692676] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-28T22:13:19.695457] [INFO ] [MAIN ] Derivative Progress: 910/2046 symbols completed. IMAX took 1.2s. Estimated remaining: 7m 41s. Rate: 147.9 symbols/min [2025-10-28T22:13:19.696464] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:19.708775] [INFO ] [MAIN ] INFA: Generated 138 derivative records from 48282 primary records. [2025-10-28T22:13:19.710853] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-28T22:13:19.711459] [INFO ] [MAIN ] INFY: Generated 138 derivative records from 53594 primary records. [2025-10-28T22:13:19.711959] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-28T22:13:19.731530] [DEBUG] [LOCAL ] INFA: Derivative data saved (138 records). [2025-10-28T22:13:19.738944] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-28T22:13:19.745438] [INFO ] [MAIN ] Derivative Progress: 911/2046 symbols completed. INFA took 1.2s. Estimated remaining: 7m 40s. Rate: 148.0 symbols/min [2025-10-28T22:13:19.745663] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:19.743184] [DEBUG] [LOCAL ] INFY: Derivative data saved (138 records). [2025-10-28T22:13:19.746725] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-28T22:13:19.757106] [INFO ] [MAIN ] Derivative Progress: 912/2046 symbols completed. INFY took 1.2s. Estimated remaining: 7m 39s. Rate: 148.2 symbols/min [2025-10-28T22:13:19.757450] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:19.758481] [DEBUG] [LOCAL ] INGM: Loaded 27588 existing records from primary storage. [2025-10-28T22:13:19.758677] [INFO ] [MAIN ] INGM: Loaded 27588 primary data records. [2025-10-28T22:13:20.076814] [DEBUG] [LOCAL ] INGR: Loaded 33548 existing records from primary storage. [2025-10-28T22:13:20.077017] [INFO ] [MAIN ] INGR: Loaded 33548 primary data records. [2025-10-28T22:13:20.193770] [DEBUG] [LOCAL ] INN: Loaded 41032 existing records from primary storage. [2025-10-28T22:13:20.197496] [INFO ] [MAIN ] INN: Loaded 41032 primary data records. [2025-10-28T22:13:20.750326] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:20.816017] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:20.815477] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:20.848595] [INFO ] [MAIN ] INGM: Generated 138 derivative records from 27588 primary records. [2025-10-28T22:13:20.852518] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-28T22:13:20.870447] [DEBUG] [LOCAL ] INGM: Derivative data saved (138 records). [2025-10-28T22:13:20.873449] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-28T22:13:20.879155] [INFO ] [MAIN ] Derivative Progress: 913/2046 symbols completed. INGM took 1.2s. Estimated remaining: 7m 40s. Rate: 147.9 symbols/min [2025-10-28T22:13:20.897997] [INFO ] [MAIN ] INN: Generated 138 derivative records from 41032 primary records. [2025-10-28T22:13:20.898090] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-28T22:13:20.897864] [INFO ] [MAIN ] INGR: Generated 138 derivative records from 33548 primary records. [2025-10-28T22:13:20.898439] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-28T22:13:20.919934] [DEBUG] [LOCAL ] INN: Derivative data saved (138 records). [2025-10-28T22:13:20.920675] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-28T22:13:20.923104] [INFO ] [MAIN ] Derivative Progress: 914/2046 symbols completed. INN took 1.2s. Estimated remaining: 7m 39s. Rate: 148.0 symbols/min [2025-10-28T22:13:20.923914] [DEBUG] [LOCAL ] INGR: Derivative data saved (138 records). [2025-10-28T22:13:20.924064] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-28T22:13:20.926901] [INFO ] [MAIN ] Derivative Progress: 915/2046 symbols completed. INGR took 1.2s. Estimated remaining: 7m 38s. Rate: 148.2 symbols/min [2025-10-28T22:13:20.927469] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:20.927364] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:20.928071] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:20.994706] [DEBUG] [LOCAL ] INSW: Loaded 38711 existing records from primary storage. [2025-10-28T22:13:20.994941] [INFO ] [MAIN ] INSW: Loaded 38711 primary data records. [2025-10-28T22:13:20.995587] [DEBUG] [LOCAL ] INSP: Loaded 38628 existing records from primary storage. [2025-10-28T22:13:21.016682] [INFO ] [MAIN ] INSP: Loaded 38628 primary data records. [2025-10-28T22:13:21.231367] [DEBUG] [LOCAL ] INVH: Loaded 53180 existing records from primary storage. [2025-10-28T22:13:21.252607] [INFO ] [MAIN ] INVH: Loaded 53180 primary data records. [2025-10-28T22:13:21.939107] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:21.966924] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:22.004484] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:22.066132] [INFO ] [MAIN ] INSP: Generated 138 derivative records from 38628 primary records. [2025-10-28T22:13:22.066283] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-28T22:13:22.083939] [DEBUG] [LOCAL ] INSP: Derivative data saved (138 records). [2025-10-28T22:13:22.079286] [INFO ] [MAIN ] INSW: Generated 138 derivative records from 38711 primary records. [2025-10-28T22:13:22.084246] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-28T22:13:22.086973] [INFO ] [MAIN ] Derivative Progress: 916/2046 symbols completed. INSP took 1.2s. Estimated remaining: 7m 39s. Rate: 147.9 symbols/min [2025-10-28T22:13:22.084384] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-28T22:13:22.087695] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:22.104845] [DEBUG] [LOCAL ] INSW: Derivative data saved (138 records). [2025-10-28T22:13:22.105727] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-28T22:13:22.108243] [INFO ] [MAIN ] Derivative Progress: 917/2046 symbols completed. INSW took 1.2s. Estimated remaining: 7m 38s. Rate: 148.0 symbols/min [2025-10-28T22:13:22.108607] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:22.111246] [INFO ] [MAIN ] INVH: Generated 138 derivative records from 53180 primary records. [2025-10-28T22:13:22.111372] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-28T22:13:22.130782] [DEBUG] [LOCAL ] INVH: Derivative data saved (138 records). [2025-10-28T22:13:22.131012] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-28T22:13:22.133212] [INFO ] [MAIN ] Derivative Progress: 918/2046 symbols completed. INVH took 1.2s. Estimated remaining: 7m 37s. Rate: 148.2 symbols/min [2025-10-28T22:13:22.133472] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:22.145578] [DEBUG] [LOCAL ] INVX: Loaded 28510 existing records from primary storage. [2025-10-28T22:13:22.145736] [INFO ] [MAIN ] INVX: Loaded 28510 primary data records. [2025-10-28T22:13:22.511825] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-28T22:13:22.512062] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-28T22:13:22.581117] [DEBUG] [LOCAL ] IOT: Loaded 53440 existing records from primary storage. [2025-10-28T22:13:22.590909] [INFO ] [MAIN ] IOT: Loaded 53440 primary data records. [2025-10-28T22:13:23.143581] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:23.188754] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:23.219104] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:23.251277] [INFO ] [MAIN ] INVX: Generated 138 derivative records from 28510 primary records. [2025-10-28T22:13:23.251676] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-28T22:13:23.269346] [DEBUG] [LOCAL ] INVX: Derivative data saved (138 records). [2025-10-28T22:13:23.269455] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-28T22:13:23.272366] [INFO ] [MAIN ] Derivative Progress: 919/2046 symbols completed. INVX took 1.2s. Estimated remaining: 7m 37s. Rate: 147.9 symbols/min [2025-10-28T22:13:23.272613] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:23.294599] [INFO ] [MAIN ] IONQ: Generated 138 derivative records from 53788 primary records. [2025-10-28T22:13:23.295193] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-28T22:13:23.308590] [DEBUG] [LOCAL ] IONQ: Derivative data saved (138 records). [2025-10-28T22:13:23.308829] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-28T22:13:23.310752] [INFO ] [MAIN ] IOT: Generated 138 derivative records from 53440 primary records. [2025-10-28T22:13:23.312987] [INFO ] [MAIN ] Derivative Progress: 920/2046 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 36s. Rate: 148.0 symbols/min [2025-10-28T22:13:23.326515] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-28T22:13:23.326449] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:23.339108] [DEBUG] [LOCAL ] IOT: Derivative data saved (138 records). [2025-10-28T22:13:23.339379] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-28T22:13:23.341887] [INFO ] [MAIN ] Derivative Progress: 921/2046 symbols completed. IOT took 1.2s. Estimated remaining: 7m 36s. Rate: 148.2 symbols/min [2025-10-28T22:13:23.342086] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:23.360412] [DEBUG] [LOCAL ] IP: Loaded 53297 existing records from primary storage. [2025-10-28T22:13:23.360619] [INFO ] [MAIN ] IP: Loaded 53297 primary data records. [2025-10-28T22:13:23.459536] [DEBUG] [LOCAL ] IPI: Loaded 21264 existing records from primary storage. [2025-10-28T22:13:23.486292] [INFO ] [MAIN ] IPI: Loaded 21264 primary data records. [2025-10-28T22:13:23.804745] [DEBUG] [LOCAL ] IPG: Loaded 53327 existing records from primary storage. [2025-10-28T22:13:23.816181] [INFO ] [MAIN ] IPG: Loaded 53327 primary data records. [2025-10-28T22:13:24.372389] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:24.408538] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:24.456841] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:24.487296] [INFO ] [MAIN ] IP: Generated 138 derivative records from 53297 primary records. [2025-10-28T22:13:24.487740] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-28T22:13:24.508103] [DEBUG] [LOCAL ] IP: Derivative data saved (138 records). [2025-10-28T22:13:24.508601] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-28T22:13:24.512287] [INFO ] [MAIN ] Derivative Progress: 922/2046 symbols completed. IP took 1.2s. Estimated remaining: 7m 36s. Rate: 147.9 symbols/min [2025-10-28T22:13:24.512448] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:24.519973] [INFO ] [MAIN ] IPI: Generated 138 derivative records from 21264 primary records. [2025-10-28T22:13:24.520392] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-28T22:13:24.548270] [DEBUG] [LOCAL ] IPI: Derivative data saved (138 records). [2025-10-28T22:13:24.550481] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-28T22:13:24.553234] [INFO ] [MAIN ] Derivative Progress: 923/2046 symbols completed. IPI took 1.2s. Estimated remaining: 7m 35s. Rate: 148.0 symbols/min [2025-10-28T22:13:24.553723] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:24.553466] [INFO ] [MAIN ] IPG: Generated 138 derivative records from 53327 primary records. [2025-10-28T22:13:24.554289] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-28T22:13:24.561613] [DEBUG] [LOCAL ] IQI: Loaded 17371 existing records from primary storage. [2025-10-28T22:13:24.570795] [INFO ] [MAIN ] IQI: Loaded 17371 primary data records. [2025-10-28T22:13:24.573803] [DEBUG] [LOCAL ] IPG: Derivative data saved (138 records). [2025-10-28T22:13:24.585288] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-28T22:13:24.609214] [INFO ] [MAIN ] Derivative Progress: 924/2046 symbols completed. IPG took 1.3s. Estimated remaining: 7m 34s. Rate: 148.2 symbols/min [2025-10-28T22:13:24.614540] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:24.841981] [DEBUG] [LOCAL ] IQV: Loaded 49919 existing records from primary storage. [2025-10-28T22:13:24.865580] [INFO ] [MAIN ] IQV: Loaded 49919 primary data records. [2025-10-28T22:13:25.044833] [DEBUG] [LOCAL ] IR: Loaded 52717 existing records from primary storage. [2025-10-28T22:13:25.068101] [INFO ] [MAIN ] IR: Loaded 52717 primary data records. [2025-10-28T22:13:25.638419] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:25.683133] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:25.727298] [INFO ] [MAIN ] IQI: Generated 138 derivative records from 17371 primary records. [2025-10-28T22:13:25.727119] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:25.727456] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-28T22:13:25.752704] [DEBUG] [LOCAL ] IQI: Derivative data saved (138 records). [2025-10-28T22:13:25.754346] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-28T22:13:25.759484] [INFO ] [MAIN ] Derivative Progress: 925/2046 symbols completed. IQI took 1.2s. Estimated remaining: 7m 35s. Rate: 147.9 symbols/min [2025-10-28T22:13:25.759765] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:25.781062] [INFO ] [MAIN ] IQV: Generated 138 derivative records from 49919 primary records. [2025-10-28T22:13:25.784001] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-28T22:13:25.812736] [DEBUG] [LOCAL ] IQV: Derivative data saved (138 records). [2025-10-28T22:13:25.813126] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-28T22:13:25.817104] [INFO ] [MAIN ] Derivative Progress: 926/2046 symbols completed. IQV took 1.3s. Estimated remaining: 7m 34s. Rate: 148.0 symbols/min [2025-10-28T22:13:25.814924] [INFO ] [MAIN ] IR: Generated 138 derivative records from 52717 primary records. [2025-10-28T22:13:25.817961] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-28T22:13:25.818060] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:25.839927] [DEBUG] [LOCAL ] IRM: Loaded 48597 existing records from primary storage. [2025-10-28T22:13:25.841614] [INFO ] [MAIN ] IRM: Loaded 48597 primary data records. [2025-10-28T22:13:25.844631] [DEBUG] [LOCAL ] IR: Derivative data saved (138 records). [2025-10-28T22:13:25.876937] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-28T22:13:25.879621] [INFO ] [MAIN ] Derivative Progress: 927/2046 symbols completed. IR took 1.3s. Estimated remaining: 7m 33s. Rate: 148.1 symbols/min [2025-10-28T22:13:25.892303] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:26.163818] [DEBUG] [LOCAL ] IRS: Loaded 23690 existing records from primary storage. [2025-10-28T22:13:26.164551] [INFO ] [MAIN ] IRS: Loaded 23690 primary data records. [2025-10-28T22:13:26.338152] [DEBUG] [LOCAL ] IRT: Loaded 50290 existing records from primary storage. [2025-10-28T22:13:26.374351] [INFO ] [MAIN ] IRT: Loaded 50290 primary data records. [2025-10-28T22:13:26.893672] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:26.937992] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:27.004113] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:27.029198] [INFO ] [MAIN ] IRM: Generated 138 derivative records from 48597 primary records. [2025-10-28T22:13:27.032767] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-28T22:13:27.052605] [DEBUG] [LOCAL ] IRM: Derivative data saved (138 records). [2025-10-28T22:13:27.056861] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-28T22:13:27.060786] [INFO ] [MAIN ] Derivative Progress: 928/2046 symbols completed. IRM took 1.3s. Estimated remaining: 7m 34s. Rate: 147.8 symbols/min [2025-10-28T22:13:27.065209] [INFO ] [MAIN ] IRS: Generated 138 derivative records from 23690 primary records. [2025-10-28T22:13:27.069105] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-28T22:13:27.086428] [DEBUG] [LOCAL ] IRS: Derivative data saved (138 records). [2025-10-28T22:13:27.086520] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-28T22:13:27.088953] [INFO ] [MAIN ] Derivative Progress: 929/2046 symbols completed. IRS took 1.3s. Estimated remaining: 7m 33s. Rate: 148.0 symbols/min [2025-10-28T22:13:27.092161] [INFO ] [MAIN ] IRT: Generated 138 derivative records from 50290 primary records. [2025-10-28T22:13:27.092253] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-28T22:13:27.104380] [DEBUG] [LOCAL ] IRT: Derivative data saved (138 records). [2025-10-28T22:13:27.104448] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-28T22:13:27.107114] [INFO ] [MAIN ] Derivative Progress: 930/2046 symbols completed. IRT took 1.2s. Estimated remaining: 7m 32s. Rate: 148.1 symbols/min [2025-10-28T22:13:27.107544] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:27.107916] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:27.108180] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:27.124280] [DEBUG] [LOCAL ] ISD: Loaded 15340 existing records from primary storage. [2025-10-28T22:13:27.124537] [INFO ] [MAIN ] ISD: Loaded 15340 primary data records. [2025-10-28T22:13:27.255748] [DEBUG] [LOCAL ] ITGR: Loaded 31198 existing records from primary storage. [2025-10-28T22:13:27.277885] [INFO ] [MAIN ] ITGR: Loaded 31198 primary data records. [2025-10-28T22:13:27.529414] [DEBUG] [LOCAL ] IT: Loaded 42098 existing records from primary storage. [2025-10-28T22:13:27.541469] [INFO ] [MAIN ] IT: Loaded 42098 primary data records. [2025-10-28T22:13:28.092771] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:28.138070] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:28.173571] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:28.197594] [INFO ] [MAIN ] ISD: Generated 138 derivative records from 15340 primary records. [2025-10-28T22:13:28.202045] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-28T22:13:28.217024] [DEBUG] [LOCAL ] ISD: Derivative data saved (138 records). [2025-10-28T22:13:28.219783] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-28T22:13:28.222205] [INFO ] [MAIN ] Derivative Progress: 931/2046 symbols completed. ISD took 1.1s. Estimated remaining: 7m 32s. Rate: 147.9 symbols/min [2025-10-28T22:13:28.224092] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:28.245101] [INFO ] [MAIN ] ITGR: Generated 138 derivative records from 31198 primary records. [2025-10-28T22:13:28.245853] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-28T22:13:28.269221] [DEBUG] [LOCAL ] ITGR: Derivative data saved (138 records). [2025-10-28T22:13:28.280980] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-28T22:13:28.280884] [INFO ] [MAIN ] IT: Generated 138 derivative records from 42098 primary records. [2025-10-28T22:13:28.283363] [INFO ] [MAIN ] Derivative Progress: 932/2046 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 32s. Rate: 148.0 symbols/min [2025-10-28T22:13:28.283696] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-28T22:13:28.283814] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:28.285861] [DEBUG] [LOCAL ] ITT: Loaded 31933 existing records from primary storage. [2025-10-28T22:13:28.295045] [INFO ] [MAIN ] ITT: Loaded 31933 primary data records. [2025-10-28T22:13:28.334244] [DEBUG] [LOCAL ] IT: Derivative data saved (138 records). [2025-10-28T22:13:28.340916] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-28T22:13:28.355834] [INFO ] [MAIN ] Derivative Progress: 933/2046 symbols completed. IT took 1.2s. Estimated remaining: 7m 31s. Rate: 148.1 symbols/min [2025-10-28T22:13:28.370041] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:28.677540] [DEBUG] [LOCAL ] ITUB: Loaded 53301 existing records from primary storage. [2025-10-28T22:13:28.678131] [INFO ] [MAIN ] ITUB: Loaded 53301 primary data records. [2025-10-28T22:13:28.699999] [DEBUG] [LOCAL ] ITW: Loaded 45547 existing records from primary storage. [2025-10-28T22:13:28.716782] [INFO ] [MAIN ] ITW: Loaded 45547 primary data records. [2025-10-28T22:13:28.995169] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:29.333122] [INFO ] [MAIN ] ITT: Generated 138 derivative records from 31933 primary records. [2025-10-28T22:13:29.333672] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-28T22:13:29.350084] [DEBUG] [LOCAL ] ITT: Derivative data saved (138 records). [2025-10-28T22:13:29.351114] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-28T22:13:29.360877] [INFO ] [MAIN ] Derivative Progress: 934/2046 symbols completed. ITT took 1.1s. Estimated remaining: 7m 31s. Rate: 147.9 symbols/min [2025-10-28T22:13:29.366966] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:29.367104] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:29.394699] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:29.462702] [DEBUG] [LOCAL ] IVR: Loaded 47650 existing records from primary storage. [2025-10-28T22:13:29.467792] [INFO ] [MAIN ] IVR: Loaded 47650 primary data records. [2025-10-28T22:13:29.469058] [INFO ] [MAIN ] ITW: Generated 138 derivative records from 45547 primary records. [2025-10-28T22:13:29.469213] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-28T22:13:29.575311] [DEBUG] [LOCAL ] ITW: Derivative data saved (138 records). [2025-10-28T22:13:29.586520] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-28T22:13:29.589275] [INFO ] [MAIN ] Derivative Progress: 935/2046 symbols completed. ITW took 1.2s. Estimated remaining: 7m 31s. Rate: 148.0 symbols/min [2025-10-28T22:13:29.589464] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:29.592143] [INFO ] [MAIN ] ITUB: Generated 138 derivative records from 53301 primary records. [2025-10-28T22:13:29.608063] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-28T22:13:29.681219] [DEBUG] [LOCAL ] ITUB: Derivative data saved (138 records). [2025-10-28T22:13:29.685264] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-28T22:13:29.687875] [INFO ] [MAIN ] Derivative Progress: 936/2046 symbols completed. ITUB took 1.4s. Estimated remaining: 7m 30s. Rate: 148.1 symbols/min [2025-10-28T22:13:29.798973] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:29.826453] [DEBUG] [LOCAL ] IVT: Loaded 31153 existing records from primary storage. [2025-10-28T22:13:29.826716] [INFO ] [MAIN ] IVT: Loaded 31153 primary data records. [2025-10-28T22:13:29.994937] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:30.059441] [DEBUG] [LOCAL ] IVZ: Loaded 53126 existing records from primary storage. [2025-10-28T22:13:30.174310] [INFO ] [MAIN ] IVZ: Loaded 53126 primary data records. [2025-10-28T22:13:30.515973] [INFO ] [MAIN ] IVR: Generated 138 derivative records from 47650 primary records. [2025-10-28T22:13:30.516812] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-28T22:13:30.531104] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:30.555377] [DEBUG] [LOCAL ] IVR: Derivative data saved (138 records). [2025-10-28T22:13:30.557628] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-28T22:13:30.560950] [INFO ] [MAIN ] Derivative Progress: 937/2046 symbols completed. IVR took 1.2s. Estimated remaining: 7m 30s. Rate: 147.9 symbols/min [2025-10-28T22:13:30.561255] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:30.602385] [DEBUG] [LOCAL ] IX: Loaded 21585 existing records from primary storage. [2025-10-28T22:13:30.602761] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:30.603273] [INFO ] [MAIN ] IX: Loaded 21585 primary data records. [2025-10-28T22:13:30.851308] [INFO ] [MAIN ] IVT: Generated 138 derivative records from 31153 primary records. [2025-10-28T22:13:30.945741] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-28T22:13:30.984115] [DEBUG] [LOCAL ] IVT: Derivative data saved (138 records). [2025-10-28T22:13:30.985447] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-28T22:13:30.987757] [INFO ] [MAIN ] Derivative Progress: 938/2046 symbols completed. IVT took 1.4s. Estimated remaining: 7m 30s. Rate: 147.9 symbols/min [2025-10-28T22:13:30.988008] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:30.997582] [INFO ] [MAIN ] IVZ: Generated 138 derivative records from 53126 primary records. [2025-10-28T22:13:30.997841] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-28T22:13:31.010690] [DEBUG] [LOCAL ] IVZ: Derivative data saved (138 records). [2025-10-28T22:13:31.011810] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-28T22:13:31.014228] [INFO ] [MAIN ] Derivative Progress: 939/2046 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 29s. Rate: 148.0 symbols/min [2025-10-28T22:13:31.015214] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:31.038717] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:31.070341] [DEBUG] [LOCAL ] J: Loaded 40501 existing records from primary storage. [2025-10-28T22:13:31.073204] [INFO ] [MAIN ] J: Loaded 40501 primary data records. [2025-10-28T22:13:31.275820] [DEBUG] [LOCAL ] JBGS: Loaded 41208 existing records from primary storage. [2025-10-28T22:13:31.324701] [INFO ] [MAIN ] JBGS: Loaded 41208 primary data records. [2025-10-28T22:13:31.676261] [INFO ] [MAIN ] IX: Generated 138 derivative records from 21585 primary records. [2025-10-28T22:13:31.684374] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-28T22:13:31.697361] [DEBUG] [LOCAL ] IX: Derivative data saved (138 records). [2025-10-28T22:13:31.698582] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-28T22:13:31.701047] [INFO ] [MAIN ] Derivative Progress: 940/2046 symbols completed. IX took 1.1s. Estimated remaining: 7m 29s. Rate: 147.9 symbols/min [2025-10-28T22:13:31.701319] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:31.721605] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:31.764493] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:31.796617] [DEBUG] [LOCAL ] JBI: Loaded 42038 existing records from primary storage. [2025-10-28T22:13:31.798997] [INFO ] [MAIN ] JBI: Loaded 42038 primary data records. [2025-10-28T22:13:31.988127] [INFO ] [MAIN ] J: Generated 138 derivative records from 40501 primary records. [2025-10-28T22:13:31.988368] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-28T22:13:32.119792] [DEBUG] [LOCAL ] J: Derivative data saved (138 records). [2025-10-28T22:13:32.119924] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-28T22:13:32.124062] [INFO ] [MAIN ] Derivative Progress: 941/2046 symbols completed. J took 1.1s. Estimated remaining: 7m 28s. Rate: 147.9 symbols/min [2025-10-28T22:13:32.125157] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:32.135101] [INFO ] [MAIN ] JBGS: Generated 138 derivative records from 41208 primary records. [2025-10-28T22:13:32.135377] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-28T22:13:32.147922] [DEBUG] [LOCAL ] JBGS: Derivative data saved (138 records). [2025-10-28T22:13:32.148068] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-28T22:13:32.150456] [INFO ] [MAIN ] Derivative Progress: 942/2046 symbols completed. JBGS took 1.1s. Estimated remaining: 7m 27s. Rate: 148.1 symbols/min [2025-10-28T22:13:32.150784] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:32.168022] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:32.215525] [DEBUG] [LOCAL ] JBND: Loaded 27536 existing records from primary storage. [2025-10-28T22:13:32.216421] [INFO ] [MAIN ] JBND: Loaded 27536 primary data records. [2025-10-28T22:13:32.308019] [DEBUG] [LOCAL ] JBL: Loaded 48163 existing records from primary storage. [2025-10-28T22:13:32.324297] [INFO ] [MAIN ] JBL: Loaded 48163 primary data records. [2025-10-28T22:13:32.656168] [INFO ] [MAIN ] JBI: Generated 138 derivative records from 42038 primary records. [2025-10-28T22:13:32.685223] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-28T22:13:32.889231] [DEBUG] [LOCAL ] JBI: Derivative data saved (138 records). [2025-10-28T22:13:32.889515] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-28T22:13:32.891809] [INFO ] [MAIN ] Derivative Progress: 943/2046 symbols completed. JBI took 1.2s. Estimated remaining: 7m 27s. Rate: 147.9 symbols/min [2025-10-28T22:13:32.913861] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:32.945369] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:32.979422] [INFO ] [MAIN ] JBND: Generated 138 derivative records from 27536 primary records. [2025-10-28T22:13:32.981470] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-28T22:13:32.996934] [DEBUG] [LOCAL ] JBND: Derivative data saved (138 records). [2025-10-28T22:13:32.997237] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-28T22:13:32.999451] [INFO ] [MAIN ] Derivative Progress: 944/2046 symbols completed. JBND took 0.8s. Estimated remaining: 7m 27s. Rate: 148.0 symbols/min [2025-10-28T22:13:33.001963] [INFO ] [MAIN ] JBL: Generated 138 derivative records from 48163 primary records. [2025-10-28T22:13:33.002026] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-28T22:13:33.013454] [DEBUG] [LOCAL ] JBL: Derivative data saved (138 records). [2025-10-28T22:13:33.013508] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-28T22:13:33.016480] [INFO ] [MAIN ] Derivative Progress: 945/2046 symbols completed. JBL took 0.9s. Estimated remaining: 7m 26s. Rate: 148.2 symbols/min [2025-10-28T22:13:33.016888] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:33.016990] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:33.017391] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:33.026454] [DEBUG] [LOCAL ] JCE: Loaded 7103 existing records from primary storage. [2025-10-28T22:13:33.026679] [INFO ] [MAIN ] JCE: Loaded 7103 primary data records. [2025-10-28T22:13:33.350171] [DEBUG] [LOCAL ] JBTM: Loaded 33118 existing records from primary storage. [2025-10-28T22:13:33.350476] [INFO ] [MAIN ] JBTM: Loaded 33118 primary data records. [2025-10-28T22:13:33.457980] [DEBUG] [LOCAL ] JCI: Loaded 53505 existing records from primary storage. [2025-10-28T22:13:33.468770] [INFO ] [MAIN ] JCI: Loaded 53505 primary data records. [2025-10-28T22:13:33.981267] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:34.027352] [DEBUG] [MAIN ] JBTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:34.057262] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:34.076746] [INFO ] [MAIN ] JCE: Generated 138 derivative records from 7103 primary records. [2025-10-28T22:13:34.079860] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-28T22:13:34.104459] [DEBUG] [LOCAL ] JCE: Derivative data saved (138 records). [2025-10-28T22:13:34.108418] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-28T22:13:34.113758] [INFO ] [MAIN ] Derivative Progress: 946/2046 symbols completed. JCE took 1.1s. Estimated remaining: 7m 26s. Rate: 147.9 symbols/min [2025-10-28T22:13:34.114146] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:34.132771] [INFO ] [MAIN ] JBTM: Generated 138 derivative records from 33118 primary records. [2025-10-28T22:13:34.133335] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-10-28T22:13:34.150828] [DEBUG] [LOCAL ] JBTM: Derivative data saved (138 records). [2025-10-28T22:13:34.149198] [INFO ] [MAIN ] JCI: Generated 138 derivative records from 53505 primary records. [2025-10-28T22:13:34.150979] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-10-28T22:13:34.153317] [INFO ] [MAIN ] Derivative Progress: 947/2046 symbols completed. JBTM took 1.1s. Estimated remaining: 7m 25s. Rate: 148.1 symbols/min [2025-10-28T22:13:34.153491] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:34.153750] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-28T22:13:34.177237] [DEBUG] [LOCAL ] JCI: Derivative data saved (138 records). [2025-10-28T22:13:34.177339] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-28T22:13:34.179782] [INFO ] [MAIN ] Derivative Progress: 948/2046 symbols completed. JCI took 1.2s. Estimated remaining: 7m 24s. Rate: 148.2 symbols/min [2025-10-28T22:13:34.179977] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:34.195849] [DEBUG] [LOCAL ] JEF: Loaded 50140 existing records from primary storage. [2025-10-28T22:13:34.196247] [INFO ] [MAIN ] JEF: Loaded 50140 primary data records. [2025-10-28T22:13:34.519544] [DEBUG] [LOCAL ] JELD: Loaded 45524 existing records from primary storage. [2025-10-28T22:13:34.529197] [DEBUG] [LOCAL ] JFR: Loaded 30734 existing records from primary storage. [2025-10-28T22:13:34.528607] [INFO ] [MAIN ] JELD: Loaded 45524 primary data records. [2025-10-28T22:13:34.529427] [INFO ] [MAIN ] JFR: Loaded 30734 primary data records. [2025-10-28T22:13:35.213959] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:35.264527] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:35.294225] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:35.328970] [INFO ] [MAIN ] JEF: Generated 138 derivative records from 50140 primary records. [2025-10-28T22:13:35.331968] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-28T22:13:35.348777] [DEBUG] [LOCAL ] JEF: Derivative data saved (138 records). [2025-10-28T22:13:35.349487] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-28T22:13:35.352639] [INFO ] [MAIN ] Derivative Progress: 949/2046 symbols completed. JEF took 1.2s. Estimated remaining: 7m 25s. Rate: 147.9 symbols/min [2025-10-28T22:13:35.353087] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:35.372061] [INFO ] [MAIN ] JFR: Generated 138 derivative records from 30734 primary records. [2025-10-28T22:13:35.375150] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-28T22:13:35.392598] [DEBUG] [LOCAL ] JGH: Loaded 12300 existing records from primary storage. [2025-10-28T22:13:35.394695] [INFO ] [MAIN ] JGH: Loaded 12300 primary data records. [2025-10-28T22:13:35.394865] [INFO ] [MAIN ] JELD: Generated 138 derivative records from 45524 primary records. [2025-10-28T22:13:35.395013] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-28T22:13:35.396285] [DEBUG] [LOCAL ] JFR: Derivative data saved (138 records). [2025-10-28T22:13:35.443405] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-28T22:13:35.446780] [INFO ] [MAIN ] Derivative Progress: 950/2046 symbols completed. JFR took 1.3s. Estimated remaining: 7m 24s. Rate: 148.0 symbols/min [2025-10-28T22:13:35.447146] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:35.471016] [DEBUG] [LOCAL ] JELD: Derivative data saved (138 records). [2025-10-28T22:13:35.485913] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-28T22:13:35.488607] [INFO ] [MAIN ] Derivative Progress: 951/2046 symbols completed. JELD took 1.3s. Estimated remaining: 7m 23s. Rate: 148.2 symbols/min [2025-10-28T22:13:35.523466] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:35.612236] [DEBUG] [LOCAL ] JHI: Loaded 4056 existing records from primary storage. [2025-10-28T22:13:35.727278] [INFO ] [MAIN ] JHI: Loaded 4056 primary data records. [2025-10-28T22:13:35.931721] [DEBUG] [LOCAL ] JHG: Loaded 47435 existing records from primary storage. [2025-10-28T22:13:36.045540] [INFO ] [MAIN ] JHG: Loaded 47435 primary data records. [2025-10-28T22:13:36.375491] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:36.419618] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:36.462934] [INFO ] [MAIN ] JGH: Generated 138 derivative records from 12300 primary records. [2025-10-28T22:13:36.470667] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-28T22:13:36.470957] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:36.494821] [DEBUG] [LOCAL ] JGH: Derivative data saved (138 records). [2025-10-28T22:13:36.501088] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-28T22:13:36.504384] [INFO ] [MAIN ] Derivative Progress: 952/2046 symbols completed. JGH took 1.2s. Estimated remaining: 7m 24s. Rate: 147.9 symbols/min [2025-10-28T22:13:36.504948] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:36.518838] [DEBUG] [LOCAL ] JHS: Loaded 2960 existing records from primary storage. [2025-10-28T22:13:36.519245] [INFO ] [MAIN ] JHS: Loaded 2960 primary data records. [2025-10-28T22:13:36.586764] [INFO ] [MAIN ] JHI: Generated 138 derivative records from 4056 primary records. [2025-10-28T22:13:36.594903] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-28T22:13:36.646205] [DEBUG] [LOCAL ] JHI: Derivative data saved (138 records). [2025-10-28T22:13:36.646314] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-28T22:13:36.664083] [INFO ] [MAIN ] Derivative Progress: 953/2046 symbols completed. JHI took 1.1s. Estimated remaining: 7m 23s. Rate: 148.0 symbols/min [2025-10-28T22:13:36.669443] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:36.893366] [INFO ] [MAIN ] JHG: Generated 138 derivative records from 47435 primary records. [2025-10-28T22:13:36.894097] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-28T22:13:36.908236] [DEBUG] [LOCAL ] JHG: Derivative data saved (138 records). [2025-10-28T22:13:36.908457] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-28T22:13:36.911076] [INFO ] [MAIN ] Derivative Progress: 954/2046 symbols completed. JHG took 1.5s. Estimated remaining: 7m 22s. Rate: 148.1 symbols/min [2025-10-28T22:13:36.911217] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:36.941682] [DEBUG] [LOCAL ] JILL: Loaded 14956 existing records from primary storage. [2025-10-28T22:13:36.941855] [INFO ] [MAIN ] JILL: Loaded 14956 primary data records. [2025-10-28T22:13:37.037634] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:37.080386] [DEBUG] [LOCAL ] JHX: Loaded 53186 existing records from primary storage. [2025-10-28T22:13:37.094078] [INFO ] [MAIN ] JHX: Loaded 53186 primary data records. [2025-10-28T22:13:37.643159] [INFO ] [MAIN ] JHS: Generated 138 derivative records from 2960 primary records. [2025-10-28T22:13:37.644508] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-28T22:13:37.663799] [DEBUG] [LOCAL ] JHS: Derivative data saved (138 records). [2025-10-28T22:13:37.664459] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-28T22:13:37.675190] [INFO ] [MAIN ] Derivative Progress: 955/2046 symbols completed. JHS took 1.2s. Estimated remaining: 7m 22s. Rate: 148.0 symbols/min [2025-10-28T22:13:37.680888] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:37.681225] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:37.726896] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:37.800790] [DEBUG] [LOCAL ] JKS: Loaded 38705 existing records from primary storage. [2025-10-28T22:13:37.804759] [INFO ] [MAIN ] JILL: Generated 138 derivative records from 14956 primary records. [2025-10-28T22:13:37.805493] [INFO ] [MAIN ] JKS: Loaded 38705 primary data records. [2025-10-28T22:13:37.805664] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-28T22:13:37.904145] [DEBUG] [LOCAL ] JILL: Derivative data saved (138 records). [2025-10-28T22:13:37.937812] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-28T22:13:37.974256] [INFO ] [MAIN ] Derivative Progress: 956/2046 symbols completed. JILL took 1.1s. Estimated remaining: 7m 22s. Rate: 148.0 symbols/min [2025-10-28T22:13:38.010151] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:38.086508] [INFO ] [MAIN ] JHX: Generated 138 derivative records from 53186 primary records. [2025-10-28T22:13:38.131473] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-28T22:13:38.323667] [DEBUG] [LOCAL ] JHX: Derivative data saved (138 records). [2025-10-28T22:13:38.326213] [DEBUG] [LOCAL ] JLL: Loaded 30962 existing records from primary storage. [2025-10-28T22:13:38.324665] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-28T22:13:38.326665] [INFO ] [MAIN ] JLL: Loaded 30962 primary data records. [2025-10-28T22:13:38.346320] [INFO ] [MAIN ] Derivative Progress: 957/2046 symbols completed. JHX took 1.7s. Estimated remaining: 7m 21s. Rate: 148.0 symbols/min [2025-10-28T22:13:38.357913] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:38.725484] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:38.762858] [DEBUG] [LOCAL ] JMIA: Loaded 51198 existing records from primary storage. [2025-10-28T22:13:38.768612] [INFO ] [MAIN ] JMIA: Loaded 51198 primary data records. [2025-10-28T22:13:38.982092] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:39.157729] [INFO ] [MAIN ] JKS: Generated 138 derivative records from 38705 primary records. [2025-10-28T22:13:39.158726] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-28T22:13:39.177901] [DEBUG] [LOCAL ] JKS: Derivative data saved (138 records). [2025-10-28T22:13:39.180546] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-28T22:13:39.182823] [INFO ] [MAIN ] Derivative Progress: 958/2046 symbols completed. JKS took 1.5s. Estimated remaining: 7m 22s. Rate: 147.9 symbols/min [2025-10-28T22:13:39.197791] [INFO ] [MAIN ] JLL: Generated 138 derivative records from 30962 primary records. [2025-10-28T22:13:39.197898] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-28T22:13:39.211980] [DEBUG] [LOCAL ] JLL: Derivative data saved (138 records). [2025-10-28T22:13:39.212818] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-28T22:13:39.215574] [INFO ] [MAIN ] Derivative Progress: 959/2046 symbols completed. JLL took 1.2s. Estimated remaining: 7m 21s. Rate: 148.0 symbols/min [2025-10-28T22:13:39.228149] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:39.252822] [INFO ] [MAIN ] JMIA: Generated 138 derivative records from 51198 primary records. [2025-10-28T22:13:39.252907] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-28T22:13:39.264310] [DEBUG] [LOCAL ] JMIA: Derivative data saved (138 records). [2025-10-28T22:13:39.264367] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-28T22:13:39.266698] [INFO ] [MAIN ] Derivative Progress: 960/2046 symbols completed. JMIA took 0.9s. Estimated remaining: 7m 20s. Rate: 148.1 symbols/min [2025-10-28T22:13:39.267111] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:39.267231] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:39.267054] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:39.307257] [DEBUG] [LOCAL ] JOE: Loaded 23070 existing records from primary storage. [2025-10-28T22:13:39.307398] [INFO ] [MAIN ] JOE: Loaded 23070 primary data records. [2025-10-28T22:13:39.467690] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-28T22:13:39.468877] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-28T22:13:39.469086] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-28T22:13:39.469012] [INFO ] [MAIN ] JOBY: Loaded 53809 primary data records. [2025-10-28T22:13:40.307687] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:40.348119] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:40.382284] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:40.425082] [INFO ] [MAIN ] JOE: Generated 138 derivative records from 23070 primary records. [2025-10-28T22:13:40.427943] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-28T22:13:40.442487] [DEBUG] [LOCAL ] JOE: Derivative data saved (138 records). [2025-10-28T22:13:40.445759] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-28T22:13:40.447691] [INFO ] [MAIN ] Derivative Progress: 961/2046 symbols completed. JOE took 1.2s. Estimated remaining: 7m 20s. Rate: 147.8 symbols/min [2025-10-28T22:13:40.450424] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:40.454767] [INFO ] [MAIN ] JNJ: Generated 138 derivative records from 53753 primary records. [2025-10-28T22:13:40.456169] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-28T22:13:40.472765] [DEBUG] [LOCAL ] JNJ: Derivative data saved (138 records). [2025-10-28T22:13:40.474233] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-28T22:13:40.476633] [INFO ] [MAIN ] Derivative Progress: 962/2046 symbols completed. JNJ took 1.2s. Estimated remaining: 7m 20s. Rate: 148.0 symbols/min [2025-10-28T22:13:40.476873] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:40.483110] [INFO ] [MAIN ] JOBY: Generated 138 derivative records from 53809 primary records. [2025-10-28T22:13:40.482748] [DEBUG] [LOCAL ] JOF: Loaded 6891 existing records from primary storage. [2025-10-28T22:13:40.483240] [INFO ] [MAIN ] JOF: Loaded 6891 primary data records. [2025-10-28T22:13:40.483320] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-28T22:13:40.594377] [DEBUG] [LOCAL ] JOBY: Derivative data saved (138 records). [2025-10-28T22:13:40.597946] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-28T22:13:40.616364] [INFO ] [MAIN ] Derivative Progress: 963/2046 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 19s. Rate: 148.1 symbols/min [2025-10-28T22:13:40.648525] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:40.818238] [DEBUG] [LOCAL ] JPC: Loaded 36664 existing records from primary storage. [2025-10-28T22:13:40.819015] [INFO ] [MAIN ] JPC: Loaded 36664 primary data records. [2025-10-28T22:13:41.156997] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-28T22:13:41.158051] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-28T22:13:41.355946] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:41.559921] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:41.617293] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:41.635754] [INFO ] [MAIN ] JOF: Generated 138 derivative records from 6891 primary records. [2025-10-28T22:13:41.637741] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-28T22:13:41.653171] [DEBUG] [LOCAL ] JOF: Derivative data saved (138 records). [2025-10-28T22:13:41.656557] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-28T22:13:41.658889] [INFO ] [MAIN ] Derivative Progress: 964/2046 symbols completed. JOF took 1.2s. Estimated remaining: 7m 19s. Rate: 147.8 symbols/min [2025-10-28T22:13:41.659392] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:41.662698] [INFO ] [MAIN ] JPC: Generated 138 derivative records from 36664 primary records. [2025-10-28T22:13:41.663124] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-28T22:13:41.681292] [DEBUG] [LOCAL ] JPC: Derivative data saved (138 records). [2025-10-28T22:13:41.682578] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-28T22:13:41.687125] [INFO ] [MAIN ] Derivative Progress: 965/2046 symbols completed. JPC took 1.2s. Estimated remaining: 7m 18s. Rate: 148.0 symbols/min [2025-10-28T22:13:41.687439] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:41.699561] [INFO ] [MAIN ] JPM: Generated 138 derivative records from 53794 primary records. [2025-10-28T22:13:41.699744] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-28T22:13:41.712410] [DEBUG] [LOCAL ] JPM: Derivative data saved (138 records). [2025-10-28T22:13:41.712563] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-28T22:13:41.724546] [INFO ] [MAIN ] Derivative Progress: 966/2046 symbols completed. JPM took 1.1s. Estimated remaining: 7m 17s. Rate: 148.1 symbols/min [2025-10-28T22:13:41.727913] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:41.729022] [DEBUG] [LOCAL ] JQC: Loaded 33418 existing records from primary storage. [2025-10-28T22:13:41.729282] [INFO ] [MAIN ] JQC: Loaded 33418 primary data records. [2025-10-28T22:13:41.813333] [DEBUG] [LOCAL ] JRI: Loaded 15017 existing records from primary storage. [2025-10-28T22:13:41.821260] [INFO ] [MAIN ] JRI: Loaded 15017 primary data records. [2025-10-28T22:13:41.928569] [DEBUG] [LOCAL ] JRS: Loaded 11407 existing records from primary storage. [2025-10-28T22:13:41.933957] [INFO ] [MAIN ] JRS: Loaded 11407 primary data records. [2025-10-28T22:13:42.671089] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:42.705715] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:42.742294] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:42.787872] [INFO ] [MAIN ] JQC: Generated 138 derivative records from 33418 primary records. [2025-10-28T22:13:42.791526] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-28T22:13:42.809368] [DEBUG] [LOCAL ] JQC: Derivative data saved (138 records). [2025-10-28T22:13:42.813273] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-28T22:13:42.815452] [INFO ] [MAIN ] Derivative Progress: 967/2046 symbols completed. JQC took 1.2s. Estimated remaining: 7m 18s. Rate: 147.9 symbols/min [2025-10-28T22:13:42.820805] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:42.827223] [INFO ] [MAIN ] JRS: Generated 138 derivative records from 11407 primary records. [2025-10-28T22:13:42.827443] [INFO ] [MAIN ] JRI: Generated 138 derivative records from 15017 primary records. [2025-10-28T22:13:42.827766] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-28T22:13:42.828385] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-28T22:13:42.839674] [DEBUG] [LOCAL ] JRS: Derivative data saved (138 records). [2025-10-28T22:13:42.840083] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-28T22:13:42.842758] [INFO ] [MAIN ] Derivative Progress: 968/2046 symbols completed. JRS took 1.1s. Estimated remaining: 7m 17s. Rate: 148.0 symbols/min [2025-10-28T22:13:42.843338] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:42.855630] [DEBUG] [LOCAL ] JRI: Derivative data saved (138 records). [2025-10-28T22:13:42.855979] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-28T22:13:42.858247] [INFO ] [MAIN ] Derivative Progress: 969/2046 symbols completed. JRI took 1.2s. Estimated remaining: 7m 16s. Rate: 148.1 symbols/min [2025-10-28T22:13:42.858480] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:42.893869] [DEBUG] [LOCAL ] KAI: Loaded 13188 existing records from primary storage. [2025-10-28T22:13:42.894184] [INFO ] [MAIN ] KAI: Loaded 13188 primary data records. [2025-10-28T22:13:42.894944] [DEBUG] [LOCAL ] JXN: Loaded 43769 existing records from primary storage. [2025-10-28T22:13:42.925601] [INFO ] [MAIN ] JXN: Loaded 43769 primary data records. [2025-10-28T22:13:43.403765] [DEBUG] [LOCAL ] K: Loaded 50245 existing records from primary storage. [2025-10-28T22:13:43.416522] [INFO ] [MAIN ] K: Loaded 50245 primary data records. [2025-10-28T22:13:43.899538] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:43.887248] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:43.961931] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:44.001316] [INFO ] [MAIN ] KAI: Generated 138 derivative records from 13188 primary records. [2025-10-28T22:13:44.003547] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-28T22:13:44.019805] [INFO ] [MAIN ] JXN: Generated 138 derivative records from 43769 primary records. [2025-10-28T22:13:44.021502] [DEBUG] [LOCAL ] KAI: Derivative data saved (138 records). [2025-10-28T22:13:44.021565] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-28T22:13:44.022884] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-28T22:13:44.033025] [INFO ] [MAIN ] Derivative Progress: 970/2046 symbols completed. KAI took 1.2s. Estimated remaining: 7m 17s. Rate: 147.9 symbols/min [2025-10-28T22:13:44.039828] [DEBUG] [LOCAL ] JXN: Derivative data saved (138 records). [2025-10-28T22:13:44.039922] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:44.040521] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-28T22:13:44.044057] [INFO ] [MAIN ] Derivative Progress: 971/2046 symbols completed. JXN took 1.2s. Estimated remaining: 7m 16s. Rate: 148.0 symbols/min [2025-10-28T22:13:44.047302] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:44.050962] [INFO ] [MAIN ] K: Generated 138 derivative records from 50245 primary records. [2025-10-28T22:13:44.051177] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-28T22:13:44.063785] [DEBUG] [LOCAL ] K: Derivative data saved (138 records). [2025-10-28T22:13:44.063949] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-28T22:13:44.066381] [INFO ] [MAIN ] Derivative Progress: 972/2046 symbols completed. K took 1.2s. Estimated remaining: 7m 15s. Rate: 148.2 symbols/min [2025-10-28T22:13:44.066791] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:44.090615] [DEBUG] [LOCAL ] KB: Loaded 22618 existing records from primary storage. [2025-10-28T22:13:44.090775] [INFO ] [MAIN ] KB: Loaded 22618 primary data records. [2025-10-28T22:13:44.206882] [DEBUG] [LOCAL ] KAR: Loaded 39565 existing records from primary storage. [2025-10-28T22:13:44.232385] [INFO ] [MAIN ] KAR: Loaded 39565 primary data records. [2025-10-28T22:13:44.243147] [DEBUG] [LOCAL ] KBDC: Loaded 22598 existing records from primary storage. [2025-10-28T22:13:44.264994] [INFO ] [MAIN ] KBDC: Loaded 22598 primary data records. [2025-10-28T22:13:45.072128] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:45.115242] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:45.144090] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:45.179756] [INFO ] [MAIN ] KB: Generated 138 derivative records from 22618 primary records. [2025-10-28T22:13:45.181257] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-28T22:13:45.199160] [DEBUG] [LOCAL ] KB: Derivative data saved (138 records). [2025-10-28T22:13:45.202187] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-28T22:13:45.204463] [INFO ] [MAIN ] Derivative Progress: 973/2046 symbols completed. KB took 1.2s. Estimated remaining: 7m 15s. Rate: 147.9 symbols/min [2025-10-28T22:13:45.229393] [INFO ] [MAIN ] KAR: Generated 138 derivative records from 39565 primary records. [2025-10-28T22:13:45.231409] [INFO ] [MAIN ] KBDC: Generated 138 derivative records from 22598 primary records. [2025-10-28T22:13:45.231586] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-28T22:13:45.231674] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-28T22:13:45.255833] [DEBUG] [LOCAL ] KAR: Derivative data saved (138 records). [2025-10-28T22:13:45.257479] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-28T22:13:45.257316] [DEBUG] [LOCAL ] KBDC: Derivative data saved (138 records). [2025-10-28T22:13:45.259979] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-28T22:13:45.259882] [INFO ] [MAIN ] Derivative Progress: 974/2046 symbols completed. KAR took 1.2s. Estimated remaining: 7m 15s. Rate: 148.0 symbols/min [2025-10-28T22:13:45.262886] [INFO ] [MAIN ] Derivative Progress: 975/2046 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 14s. Rate: 148.2 symbols/min [2025-10-28T22:13:45.263294] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:45.263363] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:45.263480] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:45.339156] [DEBUG] [LOCAL ] KBH: Loaded 48535 existing records from primary storage. [2025-10-28T22:13:45.340466] [INFO ] [MAIN ] KBH: Loaded 48535 primary data records. [2025-10-28T22:13:45.352602] [DEBUG] [LOCAL ] KBR: Loaded 47937 existing records from primary storage. [2025-10-28T22:13:45.362378] [INFO ] [MAIN ] KBR: Loaded 47937 primary data records. [2025-10-28T22:13:45.526511] [DEBUG] [LOCAL ] KD: Loaded 52294 existing records from primary storage. [2025-10-28T22:13:45.566164] [INFO ] [MAIN ] KD: Loaded 52294 primary data records. [2025-10-28T22:13:46.356692] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:46.357248] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:46.410945] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:46.465482] [INFO ] [MAIN ] KBR: Generated 138 derivative records from 47937 primary records. [2025-10-28T22:13:46.468037] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-28T22:13:46.482531] [DEBUG] [LOCAL ] KBR: Derivative data saved (138 records). [2025-10-28T22:13:46.484955] [INFO ] [MAIN ] KBH: Generated 138 derivative records from 48535 primary records. [2025-10-28T22:13:46.487510] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-28T22:13:46.487457] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-28T22:13:46.490461] [INFO ] [MAIN ] Derivative Progress: 976/2046 symbols completed. KBR took 1.2s. Estimated remaining: 7m 14s. Rate: 147.9 symbols/min [2025-10-28T22:13:46.490635] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:46.505973] [INFO ] [MAIN ] KD: Generated 138 derivative records from 52294 primary records. [2025-10-28T22:13:46.511296] [DEBUG] [LOCAL ] KEN: Loaded 4287 existing records from primary storage. [2025-10-28T22:13:46.508767] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-28T22:13:46.508611] [DEBUG] [LOCAL ] KBH: Derivative data saved (138 records). [2025-10-28T22:13:46.511407] [INFO ] [MAIN ] KEN: Loaded 4287 primary data records. [2025-10-28T22:13:46.541545] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-28T22:13:46.595342] [INFO ] [MAIN ] Derivative Progress: 977/2046 symbols completed. KBH took 1.3s. Estimated remaining: 7m 13s. Rate: 148.0 symbols/min [2025-10-28T22:13:46.626295] [DEBUG] [LOCAL ] KD: Derivative data saved (138 records). [2025-10-28T22:13:46.620366] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:46.626619] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-28T22:13:46.635097] [INFO ] [MAIN ] Derivative Progress: 978/2046 symbols completed. KD took 1.4s. Estimated remaining: 7m 13s. Rate: 148.1 symbols/min [2025-10-28T22:13:46.651197] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:46.853170] [DEBUG] [LOCAL ] KEP: Loaded 32541 existing records from primary storage. [2025-10-28T22:13:46.853520] [INFO ] [MAIN ] KEP: Loaded 32541 primary data records. [2025-10-28T22:13:46.942352] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:47.002931] [DEBUG] [LOCAL ] KEX: Loaded 38656 existing records from primary storage. [2025-10-28T22:13:47.030990] [INFO ] [MAIN ] KEX: Loaded 38656 primary data records. [2025-10-28T22:13:47.551740] [INFO ] [MAIN ] KEN: Generated 138 derivative records from 4287 primary records. [2025-10-28T22:13:47.552091] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-28T22:13:47.566723] [DEBUG] [LOCAL ] KEN: Derivative data saved (138 records). [2025-10-28T22:13:47.567328] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-28T22:13:47.569259] [INFO ] [MAIN ] Derivative Progress: 979/2046 symbols completed. KEN took 1.1s. Estimated remaining: 7m 13s. Rate: 147.9 symbols/min [2025-10-28T22:13:47.569532] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:47.583746] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:47.635262] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:47.670138] [DEBUG] [LOCAL ] KEYS: Loaded 42890 existing records from primary storage. [2025-10-28T22:13:47.672377] [INFO ] [MAIN ] KEP: Generated 138 derivative records from 32541 primary records. [2025-10-28T22:13:47.672012] [INFO ] [MAIN ] KEYS: Loaded 42890 primary data records. [2025-10-28T22:13:47.715050] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-28T22:13:47.790186] [DEBUG] [LOCAL ] KEP: Derivative data saved (138 records). [2025-10-28T22:13:47.791440] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-28T22:13:47.834671] [INFO ] [MAIN ] Derivative Progress: 980/2046 symbols completed. KEP took 1.2s. Estimated remaining: 7m 12s. Rate: 148.0 symbols/min [2025-10-28T22:13:47.895797] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:47.991389] [DEBUG] [LOCAL ] KF: Loaded 2314 existing records from primary storage. [2025-10-28T22:13:47.993847] [INFO ] [MAIN ] KF: Loaded 2314 primary data records. [2025-10-28T22:13:48.038577] [INFO ] [MAIN ] KEX: Generated 138 derivative records from 38656 primary records. [2025-10-28T22:13:48.050799] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-28T22:13:48.110039] [DEBUG] [LOCAL ] KEX: Derivative data saved (138 records). [2025-10-28T22:13:48.120947] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-28T22:13:48.128833] [INFO ] [MAIN ] Derivative Progress: 981/2046 symbols completed. KEX took 1.5s. Estimated remaining: 7m 12s. Rate: 148.0 symbols/min [2025-10-28T22:13:48.128977] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:48.328443] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:48.350049] [DEBUG] [LOCAL ] KFRC: Loaded 20978 existing records from primary storage. [2025-10-28T22:13:48.351603] [INFO ] [MAIN ] KFRC: Loaded 20978 primary data records. [2025-10-28T22:13:48.672332] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:48.688805] [INFO ] [MAIN ] KEYS: Generated 138 derivative records from 42890 primary records. [2025-10-28T22:13:48.691890] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-28T22:13:48.707464] [DEBUG] [LOCAL ] KEYS: Derivative data saved (138 records). [2025-10-28T22:13:48.710920] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-28T22:13:48.713030] [INFO ] [MAIN ] Derivative Progress: 982/2046 symbols completed. KEYS took 1.1s. Estimated remaining: 7m 12s. Rate: 147.9 symbols/min [2025-10-28T22:13:48.715359] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:48.733145] [DEBUG] [LOCAL ] KFS: Loaded 8698 existing records from primary storage. [2025-10-28T22:13:48.752512] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:48.746767] [INFO ] [MAIN ] KFS: Loaded 8698 primary data records. [2025-10-28T22:13:48.808517] [INFO ] [MAIN ] KF: Generated 138 derivative records from 2314 primary records. [2025-10-28T22:13:48.831177] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-28T22:13:48.914285] [DEBUG] [LOCAL ] KF: Derivative data saved (138 records). [2025-10-28T22:13:48.937379] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-28T22:13:48.951950] [INFO ] [MAIN ] Derivative Progress: 983/2046 symbols completed. KF took 1.1s. Estimated remaining: 7m 11s. Rate: 148.0 symbols/min [2025-10-28T22:13:48.974340] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:49.121537] [INFO ] [MAIN ] KFRC: Generated 138 derivative records from 20978 primary records. [2025-10-28T22:13:49.121911] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-28T22:13:49.142631] [DEBUG] [LOCAL ] KFRC: Derivative data saved (138 records). [2025-10-28T22:13:49.142830] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-28T22:13:49.145365] [INFO ] [MAIN ] Derivative Progress: 984/2046 symbols completed. KFRC took 1.0s. Estimated remaining: 7m 10s. Rate: 148.1 symbols/min [2025-10-28T22:13:49.145720] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:49.158481] [DEBUG] [LOCAL ] KFY: Loaded 28988 existing records from primary storage. [2025-10-28T22:13:49.158898] [INFO ] [MAIN ] KFY: Loaded 28988 primary data records. [2025-10-28T22:13:49.365703] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:13:49.581890] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-28T22:13:49.582833] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-10-28T22:13:49.802581] [INFO ] [MAIN ] KFS: Generated 138 derivative records from 8698 primary records. [2025-10-28T22:13:49.809497] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-28T22:13:49.959515] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:49.959991] [DEBUG] [LOCAL ] KFS: Derivative data saved (138 records). [2025-10-28T22:13:49.973865] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-28T22:13:49.978745] [INFO ] [MAIN ] Derivative Progress: 985/2046 symbols completed. KFS took 1.3s. Estimated remaining: 7m 10s. Rate: 147.9 symbols/min [2025-10-28T22:13:49.979795] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:50.024521] [INFO ] [MAIN ] KFY: Generated 138 derivative records from 28988 primary records. [2025-10-28T22:13:50.024762] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-28T22:13:50.038204] [DEBUG] [LOCAL ] KFY: Derivative data saved (138 records). [2025-10-28T22:13:50.038306] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-28T22:13:50.042906] [INFO ] [MAIN ] Derivative Progress: 986/2046 symbols completed. KFY took 1.1s. Estimated remaining: 7m 10s. Rate: 148.0 symbols/min [2025-10-28T22:13:50.044165] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:50.075427] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:50.075007] [DEBUG] [LOCAL ] KGS: Loaded 45848 existing records from primary storage. [2025-10-28T22:13:50.088116] [INFO ] [MAIN ] KGS: Loaded 45848 primary data records. [2025-10-28T22:13:50.459201] [DEBUG] [LOCAL ] KIM: Loaded 52988 existing records from primary storage. [2025-10-28T22:13:50.464231] [INFO ] [MAIN ] KIM: Loaded 52988 primary data records. [2025-10-28T22:13:50.652792] [INFO ] [MAIN ] KGC: Generated 138 derivative records from 53699 primary records. [2025-10-28T22:13:50.772047] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-28T22:13:50.787919] [DEBUG] [LOCAL ] KGC: Derivative data saved (138 records). [2025-10-28T22:13:50.789879] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-28T22:13:50.792528] [INFO ] [MAIN ] Derivative Progress: 987/2046 symbols completed. KGC took 1.6s. Estimated remaining: 7m 10s. Rate: 147.9 symbols/min [2025-10-28T22:13:50.792912] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:50.807137] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:50.843333] [DEBUG] [LOCAL ] KIO: Loaded 21659 existing records from primary storage. [2025-10-28T22:13:50.845386] [INFO ] [MAIN ] KIO: Loaded 21659 primary data records. [2025-10-28T22:13:50.961807] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:51.173820] [INFO ] [MAIN ] KGS: Generated 138 derivative records from 45848 primary records. [2025-10-28T22:13:51.177959] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-28T22:13:51.196630] [DEBUG] [LOCAL ] KGS: Derivative data saved (138 records). [2025-10-28T22:13:51.198225] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-28T22:13:51.204275] [INFO ] [MAIN ] Derivative Progress: 988/2046 symbols completed. KGS took 1.2s. Estimated remaining: 7m 9s. Rate: 147.9 symbols/min [2025-10-28T22:13:51.208259] [INFO ] [MAIN ] KIM: Generated 138 derivative records from 52988 primary records. [2025-10-28T22:13:51.208549] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-28T22:13:51.220992] [DEBUG] [LOCAL ] KIM: Derivative data saved (138 records). [2025-10-28T22:13:51.221130] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-28T22:13:51.223950] [INFO ] [MAIN ] Derivative Progress: 989/2046 symbols completed. KIM took 1.2s. Estimated remaining: 7m 8s. Rate: 148.1 symbols/min [2025-10-28T22:13:51.238132] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:51.263041] [INFO ] [MAIN ] KIO: Generated 138 derivative records from 21659 primary records. [2025-10-28T22:13:51.263136] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-28T22:13:51.274695] [DEBUG] [LOCAL ] KIO: Derivative data saved (138 records). [2025-10-28T22:13:51.274755] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-28T22:13:51.277431] [INFO ] [MAIN ] Derivative Progress: 990/2046 symbols completed. KIO took 0.5s. Estimated remaining: 7m 8s. Rate: 148.2 symbols/min [2025-10-28T22:13:51.277810] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:51.277979] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:51.277915] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:51.285915] [DEBUG] [LOCAL ] KKRS: Loaded 5436 existing records from primary storage. [2025-10-28T22:13:51.286153] [INFO ] [MAIN ] KKRS: Loaded 5436 primary data records. [2025-10-28T22:13:51.505515] [DEBUG] [LOCAL ] KLC: Loaded 35763 existing records from primary storage. [2025-10-28T22:13:51.623120] [INFO ] [MAIN ] KLC: Loaded 35763 primary data records. [2025-10-28T22:13:51.670398] [DEBUG] [LOCAL ] KKR: Loaded 53492 existing records from primary storage. [2025-10-28T22:13:51.686361] [INFO ] [MAIN ] KKR: Loaded 53492 primary data records. [2025-10-28T22:13:52.329906] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:52.397114] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:52.418160] [INFO ] [MAIN ] KKRS: Generated 138 derivative records from 5436 primary records. [2025-10-28T22:13:52.420789] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-28T22:13:52.404264] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:52.446460] [DEBUG] [LOCAL ] KKRS: Derivative data saved (138 records). [2025-10-28T22:13:52.447986] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-28T22:13:52.450483] [INFO ] [MAIN ] Derivative Progress: 991/2046 symbols completed. KKRS took 1.2s. Estimated remaining: 7m 8s. Rate: 147.9 symbols/min [2025-10-28T22:13:52.452707] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:52.491491] [INFO ] [MAIN ] KLC: Generated 138 derivative records from 35763 primary records. [2025-10-28T22:13:52.505188] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-28T22:13:52.520681] [DEBUG] [LOCAL ] KLC: Derivative data saved (138 records). [2025-10-28T22:13:52.519858] [INFO ] [MAIN ] KKR: Generated 138 derivative records from 53492 primary records. [2025-10-28T22:13:52.520771] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-28T22:13:52.523723] [INFO ] [MAIN ] Derivative Progress: 992/2046 symbols completed. KLC took 1.2s. Estimated remaining: 7m 7s. Rate: 148.0 symbols/min [2025-10-28T22:13:52.524129] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-28T22:13:52.524005] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:52.554103] [DEBUG] [LOCAL ] KKR: Derivative data saved (138 records). [2025-10-28T22:13:52.553269] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-28T22:13:52.556868] [DEBUG] [LOCAL ] KMPB: Loaded 3417 existing records from primary storage. [2025-10-28T22:13:52.554320] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-28T22:13:52.557012] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-28T22:13:52.559673] [INFO ] [MAIN ] Derivative Progress: 993/2046 symbols completed. KKR took 1.3s. Estimated remaining: 7m 6s. Rate: 148.2 symbols/min [2025-10-28T22:13:52.559866] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:52.560056] [INFO ] [MAIN ] KMPB: Loaded 3417 primary data records. [2025-10-28T22:13:53.182923] [DEBUG] [LOCAL ] KMPR: Loaded 40506 existing records from primary storage. [2025-10-28T22:13:53.192715] [INFO ] [MAIN ] KMPR: Loaded 40506 primary data records. [2025-10-28T22:13:53.576538] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:53.605012] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:13:53.656675] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:53.712476] [INFO ] [MAIN ] KMPB: Generated 138 derivative records from 3417 primary records. [2025-10-28T22:13:53.712934] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-28T22:13:53.716731] [INFO ] [MAIN ] KMI: Generated 138 derivative records from 53693 primary records. [2025-10-28T22:13:53.716883] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-28T22:13:53.730979] [DEBUG] [LOCAL ] KMPB: Derivative data saved (138 records). [2025-10-28T22:13:53.744489] [DEBUG] [LOCAL ] KMI: Derivative data saved (138 records). [2025-10-28T22:13:53.744796] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-28T22:13:53.748944] [INFO ] [MAIN ] Derivative Progress: 994/2046 symbols completed. KMI took 1.3s. Estimated remaining: 7m 7s. Rate: 147.9 symbols/min [2025-10-28T22:13:53.749327] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:53.744692] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-28T22:13:53.752561] [INFO ] [MAIN ] Derivative Progress: 995/2046 symbols completed. KMPB took 1.2s. Estimated remaining: 7m 6s. Rate: 148.0 symbols/min [2025-10-28T22:13:53.754622] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:53.756915] [INFO ] [MAIN ] KMPR: Generated 138 derivative records from 40506 primary records. [2025-10-28T22:13:53.757088] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-28T22:13:53.770117] [DEBUG] [LOCAL ] KMPR: Derivative data saved (138 records). [2025-10-28T22:13:53.770188] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-28T22:13:53.773227] [INFO ] [MAIN ] Derivative Progress: 996/2046 symbols completed. KMPR took 1.2s. Estimated remaining: 7m 5s. Rate: 148.2 symbols/min [2025-10-28T22:13:53.773625] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:53.811409] [DEBUG] [LOCAL ] KMT: Loaded 42364 existing records from primary storage. [2025-10-28T22:13:53.811848] [INFO ] [MAIN ] KMT: Loaded 42364 primary data records. [2025-10-28T22:13:53.953958] [DEBUG] [LOCAL ] KN: Loaded 38185 existing records from primary storage. [2025-10-28T22:13:53.957380] [INFO ] [MAIN ] KN: Loaded 38185 primary data records. [2025-10-28T22:13:53.969375] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-28T22:13:53.979345] [INFO ] [MAIN ] KMX: Loaded 53284 primary data records. [2025-10-28T22:13:54.798279] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:54.849380] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:54.850020] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:54.922263] [INFO ] [MAIN ] KMT: Generated 138 derivative records from 42364 primary records. [2025-10-28T22:13:54.927470] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-28T22:13:54.949289] [DEBUG] [LOCAL ] KMT: Derivative data saved (138 records). [2025-10-28T22:13:54.951319] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-28T22:13:54.954888] [INFO ] [MAIN ] Derivative Progress: 997/2046 symbols completed. KMT took 1.2s. Estimated remaining: 7m 6s. Rate: 147.9 symbols/min [2025-10-28T22:13:54.957336] [INFO ] [MAIN ] KMX: Generated 138 derivative records from 53284 primary records. [2025-10-28T22:13:54.957502] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:54.957912] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-28T22:13:54.961096] [INFO ] [MAIN ] KN: Generated 138 derivative records from 38185 primary records. [2025-10-28T22:13:54.968919] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-28T22:13:54.973605] [DEBUG] [LOCAL ] KMX: Derivative data saved (138 records). [2025-10-28T22:13:54.974592] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-28T22:13:54.985161] [INFO ] [MAIN ] Derivative Progress: 998/2046 symbols completed. KMX took 1.2s. Estimated remaining: 7m 5s. Rate: 148.0 symbols/min [2025-10-28T22:13:54.988115] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:54.990315] [DEBUG] [LOCAL ] KN: Derivative data saved (138 records). [2025-10-28T22:13:54.990663] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-28T22:13:54.993436] [INFO ] [MAIN ] Derivative Progress: 999/2046 symbols completed. KN took 1.2s. Estimated remaining: 7m 4s. Rate: 148.2 symbols/min [2025-10-28T22:13:54.993815] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:55.005569] [DEBUG] [LOCAL ] KNOP: Loaded 9773 existing records from primary storage. [2025-10-28T22:13:55.019168] [INFO ] [MAIN ] KNOP: Loaded 9773 primary data records. [2025-10-28T22:13:55.097689] [DEBUG] [LOCAL ] KNSL: Loaded 18536 existing records from primary storage. [2025-10-28T22:13:55.107845] [INFO ] [MAIN ] KNSL: Loaded 18536 primary data records. [2025-10-28T22:13:55.143749] [DEBUG] [LOCAL ] KNF: Loaded 36657 existing records from primary storage. [2025-10-28T22:13:55.159844] [INFO ] [MAIN ] KNF: Loaded 36657 primary data records. [2025-10-28T22:13:56.017869] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:56.049735] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:56.091508] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:56.147345] [INFO ] [MAIN ] KNSL: Generated 138 derivative records from 18536 primary records. [2025-10-28T22:13:56.152180] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-28T22:13:56.152360] [INFO ] [MAIN ] KNOP: Generated 138 derivative records from 9773 primary records. [2025-10-28T22:13:56.153511] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-28T22:13:56.178159] [DEBUG] [LOCAL ] KNOP: Derivative data saved (138 records). [2025-10-28T22:13:56.175250] [DEBUG] [LOCAL ] KNSL: Derivative data saved (138 records). [2025-10-28T22:13:56.178552] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-28T22:13:56.180549] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-28T22:13:56.180449] [INFO ] [MAIN ] Derivative Progress: 1000/2046 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 4s. Rate: 147.9 symbols/min [2025-10-28T22:13:56.183291] [INFO ] [MAIN ] Derivative Progress: 1001/2046 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 4s. Rate: 148.0 symbols/min [2025-10-28T22:13:56.180808] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:56.187088] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:56.191350] [INFO ] [MAIN ] KNF: Generated 138 derivative records from 36657 primary records. [2025-10-28T22:13:56.191472] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-28T22:13:56.203899] [DEBUG] [LOCAL ] KNF: Derivative data saved (138 records). [2025-10-28T22:13:56.204255] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-28T22:13:56.207508] [INFO ] [MAIN ] Derivative Progress: 1002/2046 symbols completed. KNF took 1.2s. Estimated remaining: 7m 3s. Rate: 148.2 symbols/min [2025-10-28T22:13:56.207931] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:56.252169] [DEBUG] [LOCAL ] KNTK: Loaded 47159 existing records from primary storage. [2025-10-28T22:13:56.252333] [INFO ] [MAIN ] KNTK: Loaded 47159 primary data records. [2025-10-28T22:13:56.382320] [DEBUG] [LOCAL ] KNX: Loaded 52642 existing records from primary storage. [2025-10-28T22:13:56.393243] [INFO ] [MAIN ] KNX: Loaded 52642 primary data records. [2025-10-28T22:13:56.614194] [DEBUG] [LOCAL ] KODK: Loaded 43385 existing records from primary storage. [2025-10-28T22:13:56.637002] [INFO ] [MAIN ] KODK: Loaded 43385 primary data records. [2025-10-28T22:13:57.284570] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:57.335389] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:57.360942] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:57.407016] [INFO ] [MAIN ] KNTK: Generated 138 derivative records from 47159 primary records. [2025-10-28T22:13:57.408095] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-28T22:13:57.425662] [DEBUG] [LOCAL ] KNTK: Derivative data saved (138 records). [2025-10-28T22:13:57.428918] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-28T22:13:57.430995] [INFO ] [MAIN ] Derivative Progress: 1003/2046 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 3s. Rate: 147.9 symbols/min [2025-10-28T22:13:57.442150] [INFO ] [MAIN ] KODK: Generated 138 derivative records from 43385 primary records. [2025-10-28T22:13:57.443229] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-28T22:13:57.445602] [INFO ] [MAIN ] KNX: Generated 138 derivative records from 52642 primary records. [2025-10-28T22:13:57.453719] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-28T22:13:57.456847] [DEBUG] [LOCAL ] KODK: Derivative data saved (138 records). [2025-10-28T22:13:57.463800] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-28T22:13:57.467878] [INFO ] [MAIN ] Derivative Progress: 1004/2046 symbols completed. KODK took 1.3s. Estimated remaining: 7m 2s. Rate: 148.0 symbols/min [2025-10-28T22:13:57.470870] [DEBUG] [LOCAL ] KNX: Derivative data saved (138 records). [2025-10-28T22:13:57.470933] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-28T22:13:57.473329] [INFO ] [MAIN ] Derivative Progress: 1005/2046 symbols completed. KNX took 1.3s. Estimated remaining: 7m 2s. Rate: 148.1 symbols/min [2025-10-28T22:13:57.473791] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:57.473884] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:57.473953] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:57.479366] [DEBUG] [LOCAL ] KORE: Loaded 2278 existing records from primary storage. [2025-10-28T22:13:57.479627] [INFO ] [MAIN ] KORE: Loaded 2278 primary data records. [2025-10-28T22:13:57.601007] [DEBUG] [LOCAL ] KOP: Loaded 17107 existing records from primary storage. [2025-10-28T22:13:57.622214] [INFO ] [MAIN ] KOP: Loaded 17107 primary data records. [2025-10-28T22:13:57.714297] [DEBUG] [LOCAL ] KOF: Loaded 25986 existing records from primary storage. [2025-10-28T22:13:57.864468] [INFO ] [MAIN ] KOF: Loaded 25986 primary data records. [2025-10-28T22:13:58.484625] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:13:58.539371] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:58.567353] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:58.593500] [INFO ] [MAIN ] KORE: Generated 138 derivative records from 2278 primary records. [2025-10-28T22:13:58.597240] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-28T22:13:58.611688] [DEBUG] [LOCAL ] KORE: Derivative data saved (138 records). [2025-10-28T22:13:58.612274] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-28T22:13:58.614458] [INFO ] [MAIN ] Derivative Progress: 1006/2046 symbols completed. KORE took 1.1s. Estimated remaining: 7m 2s. Rate: 147.9 symbols/min [2025-10-28T22:13:58.614956] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:58.639442] [INFO ] [MAIN ] KOP: Generated 138 derivative records from 17107 primary records. [2025-10-28T22:13:58.640730] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-28T22:13:58.654714] [DEBUG] [LOCAL ] KOP: Derivative data saved (138 records). [2025-10-28T22:13:58.654860] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-28T22:13:58.657669] [INFO ] [MAIN ] Derivative Progress: 1007/2046 symbols completed. KOP took 1.2s. Estimated remaining: 7m 1s. Rate: 148.0 symbols/min [2025-10-28T22:13:58.658098] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:58.660369] [INFO ] [MAIN ] KOF: Generated 138 derivative records from 25986 primary records. [2025-10-28T22:13:58.660574] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-28T22:13:58.685908] [DEBUG] [LOCAL ] KOF: Derivative data saved (138 records). [2025-10-28T22:13:58.686047] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-28T22:13:58.688714] [INFO ] [MAIN ] Derivative Progress: 1008/2046 symbols completed. KOF took 1.2s. Estimated remaining: 7m 0s. Rate: 148.1 symbols/min [2025-10-28T22:13:58.688908] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:58.707877] [DEBUG] [LOCAL ] KOS: Loaded 53090 existing records from primary storage. [2025-10-28T22:13:58.708248] [INFO ] [MAIN ] KOS: Loaded 53090 primary data records. [2025-10-28T22:13:58.895101] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-28T22:13:58.920584] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-28T22:13:59.153004] [DEBUG] [LOCAL ] KRC: Loaded 47934 existing records from primary storage. [2025-10-28T22:13:59.156822] [INFO ] [MAIN ] KRC: Loaded 47934 primary data records. [2025-10-28T22:13:59.686924] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:59.730027] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:59.775477] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:13:59.776138] [INFO ] [MAIN ] KOS: Generated 138 derivative records from 53090 primary records. [2025-10-28T22:13:59.786714] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-28T22:13:59.805032] [DEBUG] [LOCAL ] KOS: Derivative data saved (138 records). [2025-10-28T22:13:59.805420] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-28T22:13:59.810222] [INFO ] [MAIN ] Derivative Progress: 1009/2046 symbols completed. KOS took 1.2s. Estimated remaining: 7m 1s. Rate: 147.9 symbols/min [2025-10-28T22:13:59.810791] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:59.838201] [INFO ] [MAIN ] KRC: Generated 138 derivative records from 47934 primary records. [2025-10-28T22:13:59.838687] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-28T22:13:59.863879] [DEBUG] [LOCAL ] KRC: Derivative data saved (138 records). [2025-10-28T22:13:59.864011] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-28T22:13:59.866990] [INFO ] [MAIN ] Derivative Progress: 1010/2046 symbols completed. KRC took 1.2s. Estimated remaining: 6m 60s. Rate: 148.0 symbols/min [2025-10-28T22:13:59.867377] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:59.869531] [INFO ] [MAIN ] KR: Generated 138 derivative records from 53681 primary records. [2025-10-28T22:13:59.870085] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-28T22:13:59.882939] [DEBUG] [LOCAL ] KR: Derivative data saved (138 records). [2025-10-28T22:13:59.895409] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-28T22:13:59.898307] [INFO ] [MAIN ] Derivative Progress: 1011/2046 symbols completed. KR took 1.2s. Estimated remaining: 6m 59s. Rate: 148.1 symbols/min [2025-10-28T22:13:59.898450] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:13:59.900011] [DEBUG] [LOCAL ] KREF: Loaded 37791 existing records from primary storage. [2025-10-28T22:13:59.900411] [INFO ] [MAIN ] KREF: Loaded 37791 primary data records. [2025-10-28T22:14:00.120824] [DEBUG] [LOCAL ] KRO: Loaded 26457 existing records from primary storage. [2025-10-28T22:14:00.267753] [DEBUG] [LOCAL ] KRG: Loaded 49201 existing records from primary storage. [2025-10-28T22:14:00.281514] [INFO ] [MAIN ] KRG: Loaded 49201 primary data records. [2025-10-28T22:14:00.281302] [INFO ] [MAIN ] KRO: Loaded 26457 primary data records. [2025-10-28T22:14:00.916692] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:00.985004] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:00.984703] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:01.015103] [INFO ] [MAIN ] KREF: Generated 138 derivative records from 37791 primary records. [2025-10-28T22:14:01.016937] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-28T22:14:01.036009] [DEBUG] [LOCAL ] KREF: Derivative data saved (138 records). [2025-10-28T22:14:01.036144] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-28T22:14:01.038589] [INFO ] [MAIN ] Derivative Progress: 1012/2046 symbols completed. KREF took 1.2s. Estimated remaining: 6m 60s. Rate: 147.9 symbols/min [2025-10-28T22:14:01.044062] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:01.071680] [INFO ] [MAIN ] KRG: Generated 138 derivative records from 49201 primary records. [2025-10-28T22:14:01.072073] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-28T22:14:01.092370] [INFO ] [MAIN ] KRO: Generated 138 derivative records from 26457 primary records. [2025-10-28T22:14:01.097251] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-28T22:14:01.107196] [DEBUG] [LOCAL ] KRG: Derivative data saved (138 records). [2025-10-28T22:14:01.108220] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-28T22:14:01.111295] [INFO ] [MAIN ] Derivative Progress: 1013/2046 symbols completed. KRG took 1.2s. Estimated remaining: 6m 59s. Rate: 148.0 symbols/min [2025-10-28T22:14:01.112306] [DEBUG] [LOCAL ] KRP: Loaded 35449 existing records from primary storage. [2025-10-28T22:14:01.111477] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:01.112487] [INFO ] [MAIN ] KRP: Loaded 35449 primary data records. [2025-10-28T22:14:01.124892] [DEBUG] [LOCAL ] KRO: Derivative data saved (138 records). [2025-10-28T22:14:01.155833] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-28T22:14:01.190804] [INFO ] [MAIN ] Derivative Progress: 1014/2046 symbols completed. KRO took 1.3s. Estimated remaining: 6m 58s. Rate: 148.1 symbols/min [2025-10-28T22:14:01.213195] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:01.462692] [DEBUG] [LOCAL ] KSS: Loaded 53573 existing records from primary storage. [2025-10-28T22:14:01.463737] [INFO ] [MAIN ] KSS: Loaded 53573 primary data records. [2025-10-28T22:14:01.589266] [DEBUG] [LOCAL ] KT: Loaded 45095 existing records from primary storage. [2025-10-28T22:14:01.595130] [INFO ] [MAIN ] KT: Loaded 45095 primary data records. [2025-10-28T22:14:01.968567] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:02.273305] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:02.294850] [INFO ] [MAIN ] KRP: Generated 138 derivative records from 35449 primary records. [2025-10-28T22:14:02.297034] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-28T22:14:02.325363] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:02.345737] [DEBUG] [LOCAL ] KRP: Derivative data saved (138 records). [2025-10-28T22:14:02.348951] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-28T22:14:02.354757] [INFO ] [MAIN ] Derivative Progress: 1015/2046 symbols completed. KRP took 1.3s. Estimated remaining: 6m 58s. Rate: 147.8 symbols/min [2025-10-28T22:14:02.359001] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:02.378726] [INFO ] [MAIN ] KSS: Generated 138 derivative records from 53573 primary records. [2025-10-28T22:14:02.379265] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-28T22:14:02.403841] [DEBUG] [LOCAL ] KSS: Derivative data saved (138 records). [2025-10-28T22:14:02.404259] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-28T22:14:02.406687] [INFO ] [MAIN ] Derivative Progress: 1016/2046 symbols completed. KSS took 1.3s. Estimated remaining: 6m 58s. Rate: 148.0 symbols/min [2025-10-28T22:14:02.407754] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:02.425392] [DEBUG] [LOCAL ] KTB: Loaded 39775 existing records from primary storage. [2025-10-28T22:14:02.426831] [INFO ] [MAIN ] KTB: Loaded 39775 primary data records. [2025-10-28T22:14:02.453205] [INFO ] [MAIN ] KT: Generated 138 derivative records from 45095 primary records. [2025-10-28T22:14:02.469520] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-28T22:14:02.544376] [DEBUG] [LOCAL ] KTF: Loaded 11465 existing records from primary storage. [2025-10-28T22:14:02.560531] [INFO ] [MAIN ] KTF: Loaded 11465 primary data records. [2025-10-28T22:14:02.559967] [DEBUG] [LOCAL ] KT: Derivative data saved (138 records). [2025-10-28T22:14:02.608405] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-28T22:14:02.651815] [INFO ] [MAIN ] Derivative Progress: 1017/2046 symbols completed. KT took 1.4s. Estimated remaining: 6m 57s. Rate: 148.0 symbols/min [2025-10-28T22:14:02.713008] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:03.119887] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:03.166613] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-28T22:14:03.167216] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:03.180709] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-28T22:14:03.541907] [INFO ] [MAIN ] KTB: Generated 138 derivative records from 39775 primary records. [2025-10-28T22:14:03.544063] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-28T22:14:03.556115] [INFO ] [MAIN ] KTF: Generated 138 derivative records from 11465 primary records. [2025-10-28T22:14:03.557858] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-28T22:14:03.559322] [DEBUG] [LOCAL ] KTB: Derivative data saved (138 records). [2025-10-28T22:14:03.560177] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-28T22:14:03.562161] [INFO ] [MAIN ] Derivative Progress: 1018/2046 symbols completed. KTB took 1.2s. Estimated remaining: 6m 57s. Rate: 147.8 symbols/min [2025-10-28T22:14:03.573873] [DEBUG] [LOCAL ] KTF: Derivative data saved (138 records). [2025-10-28T22:14:03.574038] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-28T22:14:03.576414] [INFO ] [MAIN ] Derivative Progress: 1019/2046 symbols completed. KTF took 1.2s. Estimated remaining: 6m 56s. Rate: 148.0 symbols/min [2025-10-28T22:14:03.591111] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:03.616209] [INFO ] [MAIN ] KVUE: Generated 138 derivative records from 53667 primary records. [2025-10-28T22:14:03.616287] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-28T22:14:03.628072] [DEBUG] [LOCAL ] KVUE: Derivative data saved (138 records). [2025-10-28T22:14:03.628125] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-28T22:14:03.630544] [INFO ] [MAIN ] Derivative Progress: 1020/2046 symbols completed. KVUE took 0.9s. Estimated remaining: 6m 56s. Rate: 148.1 symbols/min [2025-10-28T22:14:03.631286] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:03.631423] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:03.631226] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:03.647883] [DEBUG] [LOCAL ] KWR: Loaded 15320 existing records from primary storage. [2025-10-28T22:14:03.648101] [INFO ] [MAIN ] KWR: Loaded 15320 primary data records. [2025-10-28T22:14:03.856320] [DEBUG] [LOCAL ] KW: Loaded 39949 existing records from primary storage. [2025-10-28T22:14:03.859525] [DEBUG] [LOCAL ] KVYO: Loaded 50922 existing records from primary storage. [2025-10-28T22:14:03.858892] [INFO ] [MAIN ] KW: Loaded 39949 primary data records. [2025-10-28T22:14:03.878550] [INFO ] [MAIN ] KVYO: Loaded 50922 primary data records. [2025-10-28T22:14:04.681209] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:04.728120] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:04.757417] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:04.792020] [INFO ] [MAIN ] KWR: Generated 138 derivative records from 15320 primary records. [2025-10-28T22:14:04.793333] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-28T22:14:04.814175] [DEBUG] [LOCAL ] KWR: Derivative data saved (138 records). [2025-10-28T22:14:04.816540] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-28T22:14:04.824374] [INFO ] [MAIN ] Derivative Progress: 1021/2046 symbols completed. KWR took 1.2s. Estimated remaining: 6m 56s. Rate: 147.8 symbols/min [2025-10-28T22:14:04.824989] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:04.833730] [INFO ] [MAIN ] KVYO: Generated 138 derivative records from 50922 primary records. [2025-10-28T22:14:04.834299] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-28T22:14:04.849800] [DEBUG] [LOCAL ] KVYO: Derivative data saved (138 records). [2025-10-28T22:14:04.850161] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-28T22:14:04.850082] [INFO ] [MAIN ] KW: Generated 138 derivative records from 39949 primary records. [2025-10-28T22:14:04.852562] [INFO ] [MAIN ] Derivative Progress: 1022/2046 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 55s. Rate: 148.0 symbols/min [2025-10-28T22:14:04.852924] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:04.852764] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-28T22:14:04.873452] [DEBUG] [LOCAL ] KW: Derivative data saved (138 records). [2025-10-28T22:14:04.873534] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-28T22:14:04.877129] [INFO ] [MAIN ] Derivative Progress: 1023/2046 symbols completed. KW took 1.2s. Estimated remaining: 6m 54s. Rate: 148.1 symbols/min [2025-10-28T22:14:04.877470] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:04.888991] [DEBUG] [LOCAL ] KYN: Loaded 29647 existing records from primary storage. [2025-10-28T22:14:04.889127] [INFO ] [MAIN ] KYN: Loaded 29647 primary data records. [2025-10-28T22:14:05.117552] [DEBUG] [LOCAL ] L: Loaded 40788 existing records from primary storage. [2025-10-28T22:14:05.136360] [INFO ] [MAIN ] L: Loaded 40788 primary data records. [2025-10-28T22:14:05.284492] [DEBUG] [LOCAL ] LAC: Loaded 52592 existing records from primary storage. [2025-10-28T22:14:05.331404] [INFO ] [MAIN ] LAC: Loaded 52592 primary data records. [2025-10-28T22:14:05.871181] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:05.900506] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:05.948957] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:05.981950] [INFO ] [MAIN ] KYN: Generated 138 derivative records from 29647 primary records. [2025-10-28T22:14:05.982342] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-28T22:14:06.006286] [INFO ] [MAIN ] L: Generated 138 derivative records from 40788 primary records. [2025-10-28T22:14:06.007300] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-28T22:14:06.009129] [DEBUG] [LOCAL ] KYN: Derivative data saved (138 records). [2025-10-28T22:14:06.011523] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-28T22:14:06.014395] [INFO ] [MAIN ] Derivative Progress: 1024/2046 symbols completed. KYN took 1.2s. Estimated remaining: 6m 55s. Rate: 147.8 symbols/min [2025-10-28T22:14:06.014546] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:06.028315] [DEBUG] [LOCAL ] L: Derivative data saved (138 records). [2025-10-28T22:14:06.029028] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-28T22:14:06.033935] [INFO ] [MAIN ] Derivative Progress: 1025/2046 symbols completed. L took 1.2s. Estimated remaining: 6m 54s. Rate: 148.0 symbols/min [2025-10-28T22:14:06.034828] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:06.034703] [INFO ] [MAIN ] LAC: Generated 138 derivative records from 52592 primary records. [2025-10-28T22:14:06.035480] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-28T22:14:06.049474] [DEBUG] [LOCAL ] LAC: Derivative data saved (138 records). [2025-10-28T22:14:06.049674] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-28T22:14:06.052279] [INFO ] [MAIN ] Derivative Progress: 1026/2046 symbols completed. LAC took 1.2s. Estimated remaining: 6m 53s. Rate: 148.1 symbols/min [2025-10-28T22:14:06.052522] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:06.063334] [DEBUG] [LOCAL ] LANV: Loaded 2765 existing records from primary storage. [2025-10-28T22:14:06.063544] [INFO ] [MAIN ] LANV: Loaded 2765 primary data records. [2025-10-28T22:14:06.128755] [DEBUG] [LOCAL ] LAD: Loaded 23261 existing records from primary storage. [2025-10-28T22:14:06.155227] [INFO ] [MAIN ] LAD: Loaded 23261 primary data records. [2025-10-28T22:14:06.267966] [DEBUG] [LOCAL ] LADR: Loaded 39034 existing records from primary storage. [2025-10-28T22:14:06.301340] [INFO ] [MAIN ] LADR: Loaded 39034 primary data records. [2025-10-28T22:14:07.042861] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7829 incomplete bins [2025-10-28T22:14:07.075140] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:07.113970] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:07.157859] [INFO ] [MAIN ] LANV: Generated 138 derivative records from 2765 primary records. [2025-10-28T22:14:07.160149] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-28T22:14:07.175295] [DEBUG] [LOCAL ] LANV: Derivative data saved (138 records). [2025-10-28T22:14:07.175399] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-28T22:14:07.179064] [INFO ] [MAIN ] Derivative Progress: 1027/2046 symbols completed. LANV took 1.1s. Estimated remaining: 6m 54s. Rate: 147.9 symbols/min [2025-10-28T22:14:07.182395] [INFO ] [MAIN ] LAD: Generated 138 derivative records from 23261 primary records. [2025-10-28T22:14:07.182498] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-28T22:14:07.183491] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:07.199012] [DEBUG] [LOCAL ] LAD: Derivative data saved (138 records). [2025-10-28T22:14:07.199182] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-28T22:14:07.201369] [INFO ] [MAIN ] Derivative Progress: 1028/2046 symbols completed. LAD took 1.2s. Estimated remaining: 6m 53s. Rate: 148.0 symbols/min [2025-10-28T22:14:07.208363] [INFO ] [MAIN ] LADR: Generated 138 derivative records from 39034 primary records. [2025-10-28T22:14:07.208478] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-28T22:14:07.208565] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:07.227092] [DEBUG] [LOCAL ] LAW: Loaded 15102 existing records from primary storage. [2025-10-28T22:14:07.227196] [INFO ] [MAIN ] LAW: Loaded 15102 primary data records. [2025-10-28T22:14:07.226802] [DEBUG] [LOCAL ] LADR: Derivative data saved (138 records). [2025-10-28T22:14:07.258678] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-28T22:14:07.273905] [INFO ] [MAIN ] Derivative Progress: 1029/2046 symbols completed. LADR took 1.2s. Estimated remaining: 6m 52s. Rate: 148.1 symbols/min [2025-10-28T22:14:07.308854] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:07.585473] [DEBUG] [LOCAL ] LAZ: Loaded 44224 existing records from primary storage. [2025-10-28T22:14:07.592973] [INFO ] [MAIN ] LAZ: Loaded 44224 primary data records. [2025-10-28T22:14:07.714387] [DEBUG] [LOCAL ] LB: Loaded 36485 existing records from primary storage. [2025-10-28T22:14:07.735295] [INFO ] [MAIN ] LB: Loaded 36485 primary data records. [2025-10-28T22:14:08.218875] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:08.307945] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:08.346073] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:08.374123] [INFO ] [MAIN ] LAW: Generated 138 derivative records from 15102 primary records. [2025-10-28T22:14:08.376667] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-28T22:14:08.396789] [DEBUG] [LOCAL ] LAW: Derivative data saved (138 records). [2025-10-28T22:14:08.397008] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-28T22:14:08.402589] [INFO ] [MAIN ] Derivative Progress: 1030/2046 symbols completed. LAW took 1.2s. Estimated remaining: 6m 52s. Rate: 147.9 symbols/min [2025-10-28T22:14:08.406214] [INFO ] [MAIN ] LAZ: Generated 138 derivative records from 44224 primary records. [2025-10-28T22:14:08.404944] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:08.406370] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-28T22:14:08.421010] [DEBUG] [LOCAL ] LAZ: Derivative data saved (138 records). [2025-10-28T22:14:08.421272] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-28T22:14:08.423743] [INFO ] [MAIN ] Derivative Progress: 1031/2046 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 52s. Rate: 148.0 symbols/min [2025-10-28T22:14:08.423943] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:08.427799] [INFO ] [MAIN ] LB: Generated 138 derivative records from 36485 primary records. [2025-10-28T22:14:08.428035] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-28T22:14:08.440307] [DEBUG] [LOCAL ] LB: Derivative data saved (138 records). [2025-10-28T22:14:08.440581] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-28T22:14:08.442935] [INFO ] [MAIN ] Derivative Progress: 1032/2046 symbols completed. LB took 1.1s. Estimated remaining: 6m 51s. Rate: 148.1 symbols/min [2025-10-28T22:14:08.443105] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:08.488349] [DEBUG] [LOCAL ] LCII: Loaded 26239 existing records from primary storage. [2025-10-28T22:14:08.502506] [INFO ] [MAIN ] LCII: Loaded 26239 primary data records. [2025-10-28T22:14:08.548507] [DEBUG] [LOCAL ] LBRT: Loaded 53005 existing records from primary storage. [2025-10-28T22:14:08.572507] [INFO ] [MAIN ] LBRT: Loaded 53005 primary data records. [2025-10-28T22:14:08.683444] [DEBUG] [LOCAL ] LC: Loaded 48227 existing records from primary storage. [2025-10-28T22:14:08.721386] [INFO ] [MAIN ] LC: Loaded 48227 primary data records. [2025-10-28T22:14:09.461266] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:09.462268] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:09.517578] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:09.568390] [INFO ] [MAIN ] LBRT: Generated 138 derivative records from 53005 primary records. [2025-10-28T22:14:09.568777] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-28T22:14:09.590327] [INFO ] [MAIN ] LCII: Generated 138 derivative records from 26239 primary records. [2025-10-28T22:14:09.592794] [DEBUG] [LOCAL ] LBRT: Derivative data saved (138 records). [2025-10-28T22:14:09.593236] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-28T22:14:09.593107] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-28T22:14:09.597586] [INFO ] [MAIN ] Derivative Progress: 1033/2046 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 51s. Rate: 147.9 symbols/min [2025-10-28T22:14:09.612772] [INFO ] [MAIN ] LC: Generated 138 derivative records from 48227 primary records. [2025-10-28T22:14:09.613081] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-28T22:14:09.626708] [DEBUG] [LOCAL ] LCII: Derivative data saved (138 records). [2025-10-28T22:14:09.626756] [DEBUG] [LOCAL ] LC: Derivative data saved (138 records). [2025-10-28T22:14:09.626853] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-28T22:14:09.626934] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-28T22:14:09.629543] [INFO ] [MAIN ] Derivative Progress: 1034/2046 symbols completed. LC took 1.2s. Estimated remaining: 6m 50s. Rate: 148.0 symbols/min [2025-10-28T22:14:09.631528] [INFO ] [MAIN ] Derivative Progress: 1035/2046 symbols completed. LCII took 1.2s. Estimated remaining: 6m 49s. Rate: 148.1 symbols/min [2025-10-28T22:14:09.631945] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:09.632000] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:09.632346] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:09.648751] [DEBUG] [LOCAL ] LDP: Loaded 12139 existing records from primary storage. [2025-10-28T22:14:09.658232] [INFO ] [MAIN ] LDP: Loaded 12139 primary data records. [2025-10-28T22:14:09.839344] [DEBUG] [LOCAL ] LDI: Loaded 45252 existing records from primary storage. [2025-10-28T22:14:09.990349] [INFO ] [MAIN ] LDI: Loaded 45252 primary data records. [2025-10-28T22:14:09.991700] [DEBUG] [LOCAL ] LDOS: Loaded 44181 existing records from primary storage. [2025-10-28T22:14:09.992047] [INFO ] [MAIN ] LDOS: Loaded 44181 primary data records. [2025-10-28T22:14:10.661513] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:10.705359] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:10.740685] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:10.760289] [INFO ] [MAIN ] LDP: Generated 138 derivative records from 12139 primary records. [2025-10-28T22:14:10.762110] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-28T22:14:10.781802] [DEBUG] [LOCAL ] LDP: Derivative data saved (138 records). [2025-10-28T22:14:10.783893] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-28T22:14:10.787290] [INFO ] [MAIN ] Derivative Progress: 1036/2046 symbols completed. LDP took 1.2s. Estimated remaining: 6m 50s. Rate: 147.9 symbols/min [2025-10-28T22:14:10.787812] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:10.801835] [INFO ] [MAIN ] LDOS: Generated 138 derivative records from 44181 primary records. [2025-10-28T22:14:10.805879] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-28T22:14:10.819948] [DEBUG] [LOCAL ] LDOS: Derivative data saved (138 records). [2025-10-28T22:14:10.828832] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-28T22:14:10.833045] [INFO ] [MAIN ] Derivative Progress: 1037/2046 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 49s. Rate: 148.0 symbols/min [2025-10-28T22:14:10.830985] [INFO ] [MAIN ] LDI: Generated 138 derivative records from 45252 primary records. [2025-10-28T22:14:10.833271] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:10.833474] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-28T22:14:10.847243] [DEBUG] [LOCAL ] LDI: Derivative data saved (138 records). [2025-10-28T22:14:10.858524] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-28T22:14:10.861357] [INFO ] [MAIN ] Derivative Progress: 1038/2046 symbols completed. LDI took 1.2s. Estimated remaining: 6m 48s. Rate: 148.1 symbols/min [2025-10-28T22:14:10.862251] [DEBUG] [LOCAL ] LEA: Loaded 40774 existing records from primary storage. [2025-10-28T22:14:10.861671] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:10.862934] [INFO ] [MAIN ] LEA: Loaded 40774 primary data records. [2025-10-28T22:14:11.150827] [DEBUG] [LOCAL ] LEG: Loaded 49848 existing records from primary storage. [2025-10-28T22:14:11.170135] [INFO ] [MAIN ] LEG: Loaded 49848 primary data records. [2025-10-28T22:14:11.359030] [DEBUG] [LOCAL ] LEN: Loaded 53188 existing records from primary storage. [2025-10-28T22:14:11.368169] [INFO ] [MAIN ] LEN: Loaded 53188 primary data records. [2025-10-28T22:14:11.828601] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:11.877590] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:11.919525] [INFO ] [MAIN ] LEA: Generated 138 derivative records from 40774 primary records. [2025-10-28T22:14:11.919356] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:11.921297] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-28T22:14:11.953098] [DEBUG] [LOCAL ] LEA: Derivative data saved (138 records). [2025-10-28T22:14:11.954615] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-28T22:14:11.956928] [INFO ] [MAIN ] Derivative Progress: 1039/2046 symbols completed. LEA took 1.2s. Estimated remaining: 6m 49s. Rate: 147.9 symbols/min [2025-10-28T22:14:11.960743] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:11.984227] [INFO ] [MAIN ] LEG: Generated 138 derivative records from 49848 primary records. [2025-10-28T22:14:11.984799] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-28T22:14:11.993801] [DEBUG] [LOCAL ] LEO: Loaded 16438 existing records from primary storage. [2025-10-28T22:14:12.001494] [INFO ] [MAIN ] LEO: Loaded 16438 primary data records. [2025-10-28T22:14:12.005827] [DEBUG] [LOCAL ] LEG: Derivative data saved (138 records). [2025-10-28T22:14:12.006022] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-28T22:14:12.076704] [INFO ] [MAIN ] Derivative Progress: 1040/2046 symbols completed. LEG took 1.2s. Estimated remaining: 6m 48s. Rate: 148.0 symbols/min [2025-10-28T22:14:12.094148] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:12.137118] [INFO ] [MAIN ] LEN: Generated 138 derivative records from 53188 primary records. [2025-10-28T22:14:12.194752] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-28T22:14:12.325987] [DEBUG] [LOCAL ] LEN: Derivative data saved (138 records). [2025-10-28T22:14:12.326126] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-28T22:14:12.329954] [INFO ] [MAIN ] Derivative Progress: 1041/2046 symbols completed. LEN took 1.5s. Estimated remaining: 6m 47s. Rate: 148.0 symbols/min [2025-10-28T22:14:12.330227] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:12.392390] [DEBUG] [LOCAL ] LFT: Loaded 18066 existing records from primary storage. [2025-10-28T22:14:12.394159] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:12.393535] [DEBUG] [LOCAL ] LEVI: Loaded 51799 existing records from primary storage. [2025-10-28T22:14:12.393896] [INFO ] [MAIN ] LFT: Loaded 18066 primary data records. [2025-10-28T22:14:12.404960] [INFO ] [MAIN ] LEVI: Loaded 51799 primary data records. [2025-10-28T22:14:13.074977] [INFO ] [MAIN ] LEO: Generated 138 derivative records from 16438 primary records. [2025-10-28T22:14:13.075627] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-28T22:14:13.088869] [DEBUG] [LOCAL ] LEO: Derivative data saved (138 records). [2025-10-28T22:14:13.089343] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-28T22:14:13.091765] [INFO ] [MAIN ] Derivative Progress: 1042/2046 symbols completed. LEO took 1.1s. Estimated remaining: 6m 47s. Rate: 147.9 symbols/min [2025-10-28T22:14:13.092157] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:13.113544] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:13.131681] [DEBUG] [LOCAL ] LGI: Loaded 9777 existing records from primary storage. [2025-10-28T22:14:13.133619] [INFO ] [MAIN ] LGI: Loaded 9777 primary data records. [2025-10-28T22:14:13.215587] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:13.498944] [INFO ] [MAIN ] LFT: Generated 138 derivative records from 18066 primary records. [2025-10-28T22:14:13.502011] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-28T22:14:13.518518] [DEBUG] [LOCAL ] LFT: Derivative data saved (138 records). [2025-10-28T22:14:13.532876] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-28T22:14:13.533636] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:13.533316] [INFO ] [MAIN ] LEVI: Generated 138 derivative records from 51799 primary records. [2025-10-28T22:14:13.545295] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-28T22:14:13.547481] [INFO ] [MAIN ] Derivative Progress: 1043/2046 symbols completed. LFT took 1.2s. Estimated remaining: 6m 47s. Rate: 147.9 symbols/min [2025-10-28T22:14:13.550184] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:13.567399] [DEBUG] [LOCAL ] LEVI: Derivative data saved (138 records). [2025-10-28T22:14:13.567762] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-28T22:14:13.570284] [INFO ] [MAIN ] Derivative Progress: 1044/2046 symbols completed. LEVI took 1.5s. Estimated remaining: 6m 46s. Rate: 148.0 symbols/min [2025-10-28T22:14:13.570531] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:13.594262] [INFO ] [MAIN ] LGI: Generated 138 derivative records from 9777 primary records. [2025-10-28T22:14:13.594523] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-28T22:14:13.606681] [DEBUG] [LOCAL ] LGI: Derivative data saved (138 records). [2025-10-28T22:14:13.607358] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-28T22:14:13.619050] [INFO ] [MAIN ] Derivative Progress: 1045/2046 symbols completed. LGI took 0.5s. Estimated remaining: 6m 45s. Rate: 148.2 symbols/min [2025-10-28T22:14:13.629333] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:13.630434] [DEBUG] [LOCAL ] LH: Loaded 36806 existing records from primary storage. [2025-10-28T22:14:13.630589] [INFO ] [MAIN ] LH: Loaded 36806 primary data records. [2025-10-28T22:14:13.749354] [DEBUG] [LOCAL ] LHX: Loaded 48202 existing records from primary storage. [2025-10-28T22:14:13.757300] [INFO ] [MAIN ] LHX: Loaded 48202 primary data records. [2025-10-28T22:14:14.072982] [DEBUG] [LOCAL ] LII: Loaded 27548 existing records from primary storage. [2025-10-28T22:14:14.073522] [INFO ] [MAIN ] LII: Loaded 27548 primary data records. [2025-10-28T22:14:14.644728] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:14.672571] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:14.735719] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:14.751005] [INFO ] [MAIN ] LH: Generated 138 derivative records from 36806 primary records. [2025-10-28T22:14:14.753593] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-28T22:14:14.770546] [DEBUG] [LOCAL ] LH: Derivative data saved (138 records). [2025-10-28T22:14:14.770915] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-28T22:14:14.773596] [INFO ] [MAIN ] Derivative Progress: 1046/2046 symbols completed. LH took 1.2s. Estimated remaining: 6m 46s. Rate: 147.9 symbols/min [2025-10-28T22:14:14.774324] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:14.777786] [INFO ] [MAIN ] LHX: Generated 138 derivative records from 48202 primary records. [2025-10-28T22:14:14.780551] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-28T22:14:14.797438] [DEBUG] [LOCAL ] LHX: Derivative data saved (138 records). [2025-10-28T22:14:14.797615] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-28T22:14:14.801184] [INFO ] [MAIN ] Derivative Progress: 1047/2046 symbols completed. LHX took 1.2s. Estimated remaining: 6m 45s. Rate: 148.0 symbols/min [2025-10-28T22:14:14.801493] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:14.812802] [INFO ] [MAIN ] LII: Generated 138 derivative records from 27548 primary records. [2025-10-28T22:14:14.816180] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-28T22:14:14.816108] [DEBUG] [LOCAL ] LITB: Loaded 3682 existing records from primary storage. [2025-10-28T22:14:14.816762] [INFO ] [MAIN ] LITB: Loaded 3682 primary data records. [2025-10-28T22:14:14.888852] [DEBUG] [LOCAL ] LII: Derivative data saved (138 records). [2025-10-28T22:14:14.897213] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-28T22:14:14.925021] [INFO ] [MAIN ] Derivative Progress: 1048/2046 symbols completed. LII took 1.3s. Estimated remaining: 6m 44s. Rate: 148.1 symbols/min [2025-10-28T22:14:15.012724] [DEBUG] [LOCAL ] LION: Loaded 47410 existing records from primary storage. [2025-10-28T22:14:15.021931] [INFO ] [MAIN ] LION: Loaded 47410 primary data records. [2025-10-28T22:14:15.460380] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:15.502394] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:15.520522] [INFO ] [MAIN ] LITB: Generated 138 derivative records from 3682 primary records. [2025-10-28T22:14:15.520618] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-28T22:14:15.534634] [DEBUG] [LOCAL ] LITB: Derivative data saved (138 records). [2025-10-28T22:14:15.536889] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-28T22:14:15.539076] [INFO ] [MAIN ] Derivative Progress: 1049/2046 symbols completed. LITB took 0.7s. Estimated remaining: 6m 44s. Rate: 148.1 symbols/min [2025-10-28T22:14:15.546778] [INFO ] [MAIN ] LION: Generated 138 derivative records from 47410 primary records. [2025-10-28T22:14:15.546844] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-28T22:14:15.557774] [DEBUG] [LOCAL ] LION: Derivative data saved (138 records). [2025-10-28T22:14:15.557830] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-28T22:14:15.560069] [INFO ] [MAIN ] Derivative Progress: 1050/2046 symbols completed. LION took 0.8s. Estimated remaining: 6m 43s. Rate: 148.2 symbols/min [2025-10-28T22:14:15.560438] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:15.560550] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:15.560673] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:15.641166] [DEBUG] [LOCAL ] LMND: Loaded 52101 existing records from primary storage. [2025-10-28T22:14:15.642337] [DEBUG] [LOCAL ] LMT: Loaded 49484 existing records from primary storage. [2025-10-28T22:14:15.642574] [INFO ] [MAIN ] LMT: Loaded 49484 primary data records. [2025-10-28T22:14:15.642513] [INFO ] [MAIN ] LMND: Loaded 52101 primary data records. [2025-10-28T22:14:15.712589] [DEBUG] [LOCAL ] LLY: Loaded 53161 existing records from primary storage. [2025-10-28T22:14:15.746484] [INFO ] [MAIN ] LLY: Loaded 53161 primary data records. [2025-10-28T22:14:16.598253] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:16.627457] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:16.658927] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:16.720182] [INFO ] [MAIN ] LMT: Generated 138 derivative records from 49484 primary records. [2025-10-28T22:14:16.723732] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-28T22:14:16.726609] [INFO ] [MAIN ] LMND: Generated 138 derivative records from 52101 primary records. [2025-10-28T22:14:16.739938] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-28T22:14:16.739750] [DEBUG] [LOCAL ] LMT: Derivative data saved (138 records). [2025-10-28T22:14:16.741282] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-28T22:14:16.752796] [INFO ] [MAIN ] Derivative Progress: 1051/2046 symbols completed. LMT took 1.2s. Estimated remaining: 6m 44s. Rate: 147.9 symbols/min [2025-10-28T22:14:16.757389] [DEBUG] [LOCAL ] LMND: Derivative data saved (138 records). [2025-10-28T22:14:16.757869] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:16.758473] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-28T22:14:16.760421] [INFO ] [MAIN ] Derivative Progress: 1052/2046 symbols completed. LMND took 1.2s. Estimated remaining: 6m 43s. Rate: 148.0 symbols/min [2025-10-28T22:14:16.760807] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:16.765860] [INFO ] [MAIN ] LLY: Generated 138 derivative records from 53161 primary records. [2025-10-28T22:14:16.766004] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-28T22:14:16.782341] [DEBUG] [LOCAL ] LND: Loaded 4868 existing records from primary storage. [2025-10-28T22:14:16.779773] [DEBUG] [LOCAL ] LLY: Derivative data saved (138 records). [2025-10-28T22:14:16.782688] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-28T22:14:16.782456] [INFO ] [MAIN ] LND: Loaded 4868 primary data records. [2025-10-28T22:14:16.785417] [INFO ] [MAIN ] Derivative Progress: 1053/2046 symbols completed. LLY took 1.2s. Estimated remaining: 6m 42s. Rate: 148.2 symbols/min [2025-10-28T22:14:16.821016] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:17.109258] [DEBUG] [LOCAL ] LNC: Loaded 51302 existing records from primary storage. [2025-10-28T22:14:17.124396] [INFO ] [MAIN ] LNC: Loaded 51302 primary data records. [2025-10-28T22:14:17.244981] [DEBUG] [LOCAL ] LNG: Loaded 50969 existing records from primary storage. [2025-10-28T22:14:17.255596] [INFO ] [MAIN ] LNG: Loaded 50969 primary data records. [2025-10-28T22:14:17.754568] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:17.809677] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:17.838400] [INFO ] [MAIN ] LND: Generated 138 derivative records from 4868 primary records. [2025-10-28T22:14:17.840679] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-28T22:14:17.852140] [DEBUG] [LOCAL ] LND: Derivative data saved (138 records). [2025-10-28T22:14:17.864486] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-28T22:14:17.869473] [INFO ] [MAIN ] Derivative Progress: 1054/2046 symbols completed. LND took 1.1s. Estimated remaining: 6m 42s. Rate: 147.9 symbols/min [2025-10-28T22:14:17.870081] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:17.870580] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:17.907328] [DEBUG] [LOCAL ] LNN: Loaded 11561 existing records from primary storage. [2025-10-28T22:14:17.911955] [INFO ] [MAIN ] LNN: Loaded 11561 primary data records. [2025-10-28T22:14:18.009140] [INFO ] [MAIN ] LNC: Generated 138 derivative records from 51302 primary records. [2025-10-28T22:14:18.016880] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-28T22:14:18.033210] [DEBUG] [LOCAL ] LNC: Derivative data saved (138 records). [2025-10-28T22:14:18.043819] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-28T22:14:18.056310] [INFO ] [MAIN ] Derivative Progress: 1055/2046 symbols completed. LNC took 1.3s. Estimated remaining: 6m 42s. Rate: 148.0 symbols/min [2025-10-28T22:14:18.076734] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:18.234604] [INFO ] [MAIN ] LNG: Generated 138 derivative records from 50969 primary records. [2025-10-28T22:14:18.234867] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-28T22:14:18.248908] [DEBUG] [LOCAL ] LNG: Derivative data saved (138 records). [2025-10-28T22:14:18.249798] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-28T22:14:18.252836] [INFO ] [MAIN ] Derivative Progress: 1056/2046 symbols completed. LNG took 1.4s. Estimated remaining: 6m 41s. Rate: 148.1 symbols/min [2025-10-28T22:14:18.253513] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:18.291970] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:18.324575] [DEBUG] [LOCAL ] LOB: Loaded 26260 existing records from primary storage. [2025-10-28T22:14:18.324840] [INFO ] [MAIN ] LOB: Loaded 26260 primary data records. [2025-10-28T22:14:18.325776] [DEBUG] [LOCAL ] LOAR: Loaded 41655 existing records from primary storage. [2025-10-28T22:14:18.357931] [INFO ] [MAIN ] LOAR: Loaded 41655 primary data records. [2025-10-28T22:14:18.962321] [INFO ] [MAIN ] LNN: Generated 138 derivative records from 11561 primary records. [2025-10-28T22:14:18.963675] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-28T22:14:18.976855] [DEBUG] [LOCAL ] LNN: Derivative data saved (138 records). [2025-10-28T22:14:18.977289] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-28T22:14:18.979316] [INFO ] [MAIN ] Derivative Progress: 1057/2046 symbols completed. LNN took 1.1s. Estimated remaining: 6m 41s. Rate: 148.0 symbols/min [2025-10-28T22:14:18.979579] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:18.985358] [DEBUG] [LOCAL ] LOCL: Loaded 3227 existing records from primary storage. [2025-10-28T22:14:18.985663] [INFO ] [MAIN ] LOCL: Loaded 3227 primary data records. [2025-10-28T22:14:19.085789] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:19.330666] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:19.384266] [INFO ] [MAIN ] LOB: Generated 138 derivative records from 26260 primary records. [2025-10-28T22:14:19.385100] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-28T22:14:19.399959] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:19.432199] [DEBUG] [LOCAL ] LOB: Derivative data saved (138 records). [2025-10-28T22:14:19.433422] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-28T22:14:19.436894] [INFO ] [MAIN ] Derivative Progress: 1058/2046 symbols completed. LOB took 1.2s. Estimated remaining: 6m 41s. Rate: 148.0 symbols/min [2025-10-28T22:14:19.437715] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:19.440380] [INFO ] [MAIN ] LOAR: Generated 138 derivative records from 41655 primary records. [2025-10-28T22:14:19.444116] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-28T22:14:19.460748] [DEBUG] [LOCAL ] LOAR: Derivative data saved (138 records). [2025-10-28T22:14:19.462669] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-28T22:14:19.465346] [INFO ] [MAIN ] Derivative Progress: 1059/2046 symbols completed. LOAR took 1.4s. Estimated remaining: 6m 40s. Rate: 148.1 symbols/min [2025-10-28T22:14:19.469023] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:19.486850] [INFO ] [MAIN ] LOCL: Generated 138 derivative records from 3227 primary records. [2025-10-28T22:14:19.487011] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-28T22:14:19.498301] [DEBUG] [LOCAL ] LOCL: Derivative data saved (138 records). [2025-10-28T22:14:19.498602] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-28T22:14:19.502170] [INFO ] [MAIN ] Derivative Progress: 1060/2046 symbols completed. LOCL took 0.5s. Estimated remaining: 6m 39s. Rate: 148.2 symbols/min [2025-10-28T22:14:19.512609] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:19.514163] [DEBUG] [LOCAL ] LOMA: Loaded 33069 existing records from primary storage. [2025-10-28T22:14:19.514514] [INFO ] [MAIN ] LOMA: Loaded 33069 primary data records. [2025-10-28T22:14:19.742750] [DEBUG] [LOCAL ] LOW: Loaded 52926 existing records from primary storage. [2025-10-28T22:14:19.749226] [INFO ] [MAIN ] LOW: Loaded 52926 primary data records. [2025-10-28T22:14:19.977639] [DEBUG] [LOCAL ] LPG: Loaded 38700 existing records from primary storage. [2025-10-28T22:14:20.000869] [INFO ] [MAIN ] LPG: Loaded 38700 primary data records. [2025-10-28T22:14:20.577441] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:20.622510] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:20.655116] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:20.671797] [INFO ] [MAIN ] LOMA: Generated 138 derivative records from 33069 primary records. [2025-10-28T22:14:20.674573] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-28T22:14:20.691543] [DEBUG] [LOCAL ] LOMA: Derivative data saved (138 records). [2025-10-28T22:14:20.693407] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-28T22:14:20.697527] [INFO ] [MAIN ] Derivative Progress: 1061/2046 symbols completed. LOMA took 1.3s. Estimated remaining: 6m 39s. Rate: 147.9 symbols/min [2025-10-28T22:14:20.697860] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:20.729192] [INFO ] [MAIN ] LOW: Generated 138 derivative records from 52926 primary records. [2025-10-28T22:14:20.732868] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-28T22:14:20.743173] [DEBUG] [LOCAL ] LPL: Loaded 29274 existing records from primary storage. [2025-10-28T22:14:20.754874] [DEBUG] [LOCAL ] LOW: Derivative data saved (138 records). [2025-10-28T22:14:20.755017] [INFO ] [MAIN ] LPL: Loaded 29274 primary data records. [2025-10-28T22:14:20.756717] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-28T22:14:20.759440] [INFO ] [MAIN ] LPG: Generated 138 derivative records from 38700 primary records. [2025-10-28T22:14:20.759615] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-28T22:14:20.759218] [INFO ] [MAIN ] Derivative Progress: 1062/2046 symbols completed. LOW took 1.3s. Estimated remaining: 6m 39s. Rate: 148.1 symbols/min [2025-10-28T22:14:20.780163] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:20.840984] [DEBUG] [LOCAL ] LPG: Derivative data saved (138 records). [2025-10-28T22:14:20.846831] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-28T22:14:20.859588] [INFO ] [MAIN ] Derivative Progress: 1063/2046 symbols completed. LPG took 1.3s. Estimated remaining: 6m 38s. Rate: 148.2 symbols/min [2025-10-28T22:14:21.085374] [DEBUG] [LOCAL ] LPX: Loaded 39916 existing records from primary storage. [2025-10-28T22:14:21.086328] [INFO ] [MAIN ] LPX: Loaded 39916 primary data records. [2025-10-28T22:14:21.397323] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:21.429799] [INFO ] [MAIN ] LPL: Generated 138 derivative records from 29274 primary records. [2025-10-28T22:14:21.431088] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-28T22:14:21.455113] [DEBUG] [LOCAL ] LPL: Derivative data saved (138 records). [2025-10-28T22:14:21.453968] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:21.465599] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-28T22:14:21.468374] [INFO ] [MAIN ] Derivative Progress: 1064/2046 symbols completed. LPL took 0.8s. Estimated remaining: 6m 38s. Rate: 148.1 symbols/min [2025-10-28T22:14:21.483351] [INFO ] [MAIN ] LPX: Generated 138 derivative records from 39916 primary records. [2025-10-28T22:14:21.483418] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-28T22:14:21.495012] [DEBUG] [LOCAL ] LPX: Derivative data saved (138 records). [2025-10-28T22:14:21.495067] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-28T22:14:21.497598] [INFO ] [MAIN ] Derivative Progress: 1065/2046 symbols completed. LPX took 0.7s. Estimated remaining: 6m 37s. Rate: 148.2 symbols/min [2025-10-28T22:14:21.498073] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:21.498226] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:21.498008] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:21.543827] [DEBUG] [LOCAL ] LTC: Loaded 30479 existing records from primary storage. [2025-10-28T22:14:21.544015] [INFO ] [MAIN ] LTC: Loaded 30479 primary data records. [2025-10-28T22:14:21.666223] [DEBUG] [LOCAL ] LRN: Loaded 39089 existing records from primary storage. [2025-10-28T22:14:21.669983] [DEBUG] [LOCAL ] LSPD: Loaded 41999 existing records from primary storage. [2025-10-28T22:14:21.670369] [INFO ] [MAIN ] LRN: Loaded 39089 primary data records. [2025-10-28T22:14:21.680963] [INFO ] [MAIN ] LSPD: Loaded 41999 primary data records. [2025-10-28T22:14:22.507120] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:22.512837] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:22.568048] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:22.669584] [INFO ] [MAIN ] LSPD: Generated 138 derivative records from 41999 primary records. [2025-10-28T22:14:22.671796] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-28T22:14:22.687482] [DEBUG] [LOCAL ] LSPD: Derivative data saved (138 records). [2025-10-28T22:14:22.687687] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-28T22:14:22.693308] [INFO ] [MAIN ] Derivative Progress: 1066/2046 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 37s. Rate: 148.0 symbols/min [2025-10-28T22:14:22.689692] [INFO ] [MAIN ] LTC: Generated 138 derivative records from 30479 primary records. [2025-10-28T22:14:22.693597] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:22.693858] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-28T22:14:22.710100] [DEBUG] [LOCAL ] LTC: Derivative data saved (138 records). [2025-10-28T22:14:22.711593] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-28T22:14:22.714800] [INFO ] [MAIN ] Derivative Progress: 1067/2046 symbols completed. LTC took 1.2s. Estimated remaining: 6m 37s. Rate: 148.1 symbols/min [2025-10-28T22:14:22.715272] [INFO ] [MAIN ] LRN: Generated 138 derivative records from 39089 primary records. [2025-10-28T22:14:22.715386] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:22.715560] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-28T22:14:22.728354] [DEBUG] [LOCAL ] LRN: Derivative data saved (138 records). [2025-10-28T22:14:22.728498] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-28T22:14:22.730875] [INFO ] [MAIN ] Derivative Progress: 1068/2046 symbols completed. LRN took 1.2s. Estimated remaining: 6m 36s. Rate: 148.2 symbols/min [2025-10-28T22:14:22.731110] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:22.796248] [DEBUG] [LOCAL ] LTM: Loaded 39530 existing records from primary storage. [2025-10-28T22:14:22.797449] [DEBUG] [LOCAL ] LTH: Loaded 51532 existing records from primary storage. [2025-10-28T22:14:22.797764] [INFO ] [MAIN ] LTM: Loaded 39530 primary data records. [2025-10-28T22:14:22.797874] [INFO ] [MAIN ] LTH: Loaded 51532 primary data records. [2025-10-28T22:14:23.002617] [DEBUG] [LOCAL ] LU: Loaded 49221 existing records from primary storage. [2025-10-28T22:14:23.027227] [INFO ] [MAIN ] LU: Loaded 49221 primary data records. [2025-10-28T22:14:23.729990] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:23.758021] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:23.794125] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:23.837601] [INFO ] [MAIN ] LTM: Generated 138 derivative records from 39530 primary records. [2025-10-28T22:14:23.839965] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-28T22:14:23.857335] [DEBUG] [LOCAL ] LTM: Derivative data saved (138 records). [2025-10-28T22:14:23.857437] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-28T22:14:23.859395] [INFO ] [MAIN ] Derivative Progress: 1069/2046 symbols completed. LTM took 1.1s. Estimated remaining: 6m 36s. Rate: 148.0 symbols/min [2025-10-28T22:14:23.860797] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:23.865458] [INFO ] [MAIN ] LTH: Generated 138 derivative records from 51532 primary records. [2025-10-28T22:14:23.865567] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-28T22:14:23.879486] [DEBUG] [LOCAL ] LTH: Derivative data saved (138 records). [2025-10-28T22:14:23.881510] [INFO ] [MAIN ] LU: Generated 138 derivative records from 49221 primary records. [2025-10-28T22:14:23.881611] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-28T22:14:23.881371] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-28T22:14:23.889759] [INFO ] [MAIN ] Derivative Progress: 1070/2046 symbols completed. LTH took 1.2s. Estimated remaining: 6m 35s. Rate: 148.1 symbols/min [2025-10-28T22:14:23.890165] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:23.902446] [DEBUG] [LOCAL ] LU: Derivative data saved (138 records). [2025-10-28T22:14:23.909700] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-28T22:14:23.912106] [INFO ] [MAIN ] Derivative Progress: 1071/2046 symbols completed. LU took 1.2s. Estimated remaining: 6m 35s. Rate: 148.2 symbols/min [2025-10-28T22:14:23.912303] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:23.913355] [DEBUG] [LOCAL ] LUCK: Loaded 23109 existing records from primary storage. [2025-10-28T22:14:23.913586] [INFO ] [MAIN ] LUCK: Loaded 23109 primary data records. [2025-10-28T22:14:24.245855] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-28T22:14:24.246043] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-28T22:14:24.365308] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-28T22:14:24.381346] [INFO ] [MAIN ] LVS: Loaded 53569 primary data records. [2025-10-28T22:14:24.977407] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:25.058601] [INFO ] [MAIN ] LUCK: Generated 138 derivative records from 23109 primary records. [2025-10-28T22:14:25.059049] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-28T22:14:25.063998] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:25.101558] [DEBUG] [LOCAL ] LUCK: Derivative data saved (138 records). [2025-10-28T22:14:25.102530] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-28T22:14:25.122243] [INFO ] [MAIN ] Derivative Progress: 1072/2046 symbols completed. LUCK took 1.3s. Estimated remaining: 6m 35s. Rate: 148.0 symbols/min [2025-10-28T22:14:25.119012] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:25.122562] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:25.195032] [DEBUG] [LOCAL ] LVWR: Loaded 18684 existing records from primary storage. [2025-10-28T22:14:25.197145] [INFO ] [MAIN ] LVWR: Loaded 18684 primary data records. [2025-10-28T22:14:25.228236] [INFO ] [MAIN ] LVS: Generated 138 derivative records from 53569 primary records. [2025-10-28T22:14:25.228576] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-28T22:14:25.339485] [DEBUG] [LOCAL ] LVS: Derivative data saved (138 records). [2025-10-28T22:14:25.339668] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-28T22:14:25.357462] [INFO ] [MAIN ] LUV: Generated 138 derivative records from 53689 primary records. [2025-10-28T22:14:25.343150] [INFO ] [MAIN ] Derivative Progress: 1073/2046 symbols completed. LVS took 1.4s. Estimated remaining: 6m 34s. Rate: 148.0 symbols/min [2025-10-28T22:14:25.357711] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-28T22:14:25.364226] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:25.409261] [DEBUG] [LOCAL ] LUV: Derivative data saved (138 records). [2025-10-28T22:14:25.421615] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-28T22:14:25.424371] [INFO ] [MAIN ] Derivative Progress: 1074/2046 symbols completed. LUV took 1.5s. Estimated remaining: 6m 34s. Rate: 148.1 symbols/min [2025-10-28T22:14:25.425368] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:25.691886] [DEBUG] [LOCAL ] LXFR: Loaded 16103 existing records from primary storage. [2025-10-28T22:14:25.692383] [INFO ] [MAIN ] LXFR: Loaded 16103 primary data records. [2025-10-28T22:14:25.816191] [DEBUG] [LOCAL ] LW: Loaded 51101 existing records from primary storage. [2025-10-28T22:14:25.827466] [INFO ] [MAIN ] LW: Loaded 51101 primary data records. [2025-10-28T22:14:26.182423] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:26.393538] [INFO ] [MAIN ] LVWR: Generated 138 derivative records from 18684 primary records. [2025-10-28T22:14:26.391514] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:26.405600] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-28T22:14:26.422471] [DEBUG] [LOCAL ] LVWR: Derivative data saved (138 records). [2025-10-28T22:14:26.422572] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-28T22:14:26.424809] [INFO ] [MAIN ] Derivative Progress: 1075/2046 symbols completed. LVWR took 1.3s. Estimated remaining: 6m 34s. Rate: 147.9 symbols/min [2025-10-28T22:14:26.426720] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:26.444377] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:26.476798] [INFO ] [MAIN ] LXFR: Generated 138 derivative records from 16103 primary records. [2025-10-28T22:14:26.477130] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-28T22:14:26.505729] [DEBUG] [LOCAL ] LXFR: Derivative data saved (138 records). [2025-10-28T22:14:26.506114] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-28T22:14:26.510400] [INFO ] [MAIN ] Derivative Progress: 1076/2046 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 33s. Rate: 148.0 symbols/min [2025-10-28T22:14:26.510585] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:26.534907] [INFO ] [MAIN ] LW: Generated 138 derivative records from 51101 primary records. [2025-10-28T22:14:26.536184] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-28T22:14:26.535953] [DEBUG] [LOCAL ] LXP: Loaded 50647 existing records from primary storage. [2025-10-28T22:14:26.536946] [INFO ] [MAIN ] LXP: Loaded 50647 primary data records. [2025-10-28T22:14:26.627450] [DEBUG] [LOCAL ] LW: Derivative data saved (138 records). [2025-10-28T22:14:26.639925] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-28T22:14:26.673729] [INFO ] [MAIN ] Derivative Progress: 1077/2046 symbols completed. LW took 1.3s. Estimated remaining: 6m 33s. Rate: 148.1 symbols/min [2025-10-28T22:14:26.679164] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:26.680589] [DEBUG] [LOCAL ] LXU: Loaded 31022 existing records from primary storage. [2025-10-28T22:14:26.681423] [INFO ] [MAIN ] LXU: Loaded 31022 primary data records. [2025-10-28T22:14:27.278587] [DEBUG] [LOCAL ] LYB: Loaded 53620 existing records from primary storage. [2025-10-28T22:14:27.279374] [INFO ] [MAIN ] LYB: Loaded 53620 primary data records. [2025-10-28T22:14:27.399999] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:27.642436] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:27.676760] [INFO ] [MAIN ] LXP: Generated 138 derivative records from 50647 primary records. [2025-10-28T22:14:27.681579] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-28T22:14:27.715252] [DEBUG] [LOCAL ] LXP: Derivative data saved (138 records). [2025-10-28T22:14:27.717914] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:27.718053] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-28T22:14:27.720247] [INFO ] [MAIN ] Derivative Progress: 1078/2046 symbols completed. LXP took 1.3s. Estimated remaining: 6m 33s. Rate: 147.9 symbols/min [2025-10-28T22:14:27.745067] [INFO ] [MAIN ] LXU: Generated 138 derivative records from 31022 primary records. [2025-10-28T22:14:27.746338] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-28T22:14:27.760735] [DEBUG] [LOCAL ] LXU: Derivative data saved (138 records). [2025-10-28T22:14:27.762593] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-28T22:14:27.764909] [INFO ] [MAIN ] Derivative Progress: 1079/2046 symbols completed. LXU took 1.3s. Estimated remaining: 6m 32s. Rate: 148.0 symbols/min [2025-10-28T22:14:27.772701] [INFO ] [MAIN ] LYB: Generated 138 derivative records from 53620 primary records. [2025-10-28T22:14:27.772861] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-28T22:14:27.784938] [DEBUG] [LOCAL ] LYB: Derivative data saved (138 records). [2025-10-28T22:14:27.785023] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-28T22:14:27.787332] [INFO ] [MAIN ] Derivative Progress: 1080/2046 symbols completed. LYB took 1.1s. Estimated remaining: 6m 31s. Rate: 148.2 symbols/min [2025-10-28T22:14:27.787824] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:27.787976] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:27.788451] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:27.844016] [DEBUG] [LOCAL ] LZB: Loaded 34736 existing records from primary storage. [2025-10-28T22:14:27.844251] [INFO ] [MAIN ] LZB: Loaded 34736 primary data records. [2025-10-28T22:14:27.967945] [DEBUG] [LOCAL ] LYV: Loaded 50878 existing records from primary storage. [2025-10-28T22:14:27.987747] [INFO ] [MAIN ] LYV: Loaded 50878 primary data records. [2025-10-28T22:14:28.009428] [DEBUG] [LOCAL ] LYG: Loaded 52636 existing records from primary storage. [2025-10-28T22:14:28.090705] [INFO ] [MAIN ] LYG: Loaded 52636 primary data records. [2025-10-28T22:14:28.812258] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:28.849490] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:28.887720] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:28.921084] [INFO ] [MAIN ] LZB: Generated 138 derivative records from 34736 primary records. [2025-10-28T22:14:28.921597] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-28T22:14:28.938310] [DEBUG] [LOCAL ] LZB: Derivative data saved (138 records). [2025-10-28T22:14:28.938465] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-28T22:14:28.940586] [INFO ] [MAIN ] Derivative Progress: 1081/2046 symbols completed. LZB took 1.2s. Estimated remaining: 6m 31s. Rate: 147.9 symbols/min [2025-10-28T22:14:28.941032] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:28.961470] [INFO ] [MAIN ] LYV: Generated 138 derivative records from 50878 primary records. [2025-10-28T22:14:28.963037] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-28T22:14:28.969824] [DEBUG] [LOCAL ] LZM: Loaded 14881 existing records from primary storage. [2025-10-28T22:14:28.977795] [INFO ] [MAIN ] LZM: Loaded 14881 primary data records. [2025-10-28T22:14:28.996718] [DEBUG] [LOCAL ] LYV: Derivative data saved (138 records). [2025-10-28T22:14:28.996855] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-28T22:14:28.998896] [INFO ] [MAIN ] Derivative Progress: 1082/2046 symbols completed. LYV took 1.2s. Estimated remaining: 6m 31s. Rate: 148.0 symbols/min [2025-10-28T22:14:29.053118] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:29.078859] [INFO ] [MAIN ] LYG: Generated 138 derivative records from 52636 primary records. [2025-10-28T22:14:29.096580] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-28T22:14:29.125395] [DEBUG] [LOCAL ] LYG: Derivative data saved (138 records). [2025-10-28T22:14:29.156972] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-28T22:14:29.188348] [INFO ] [MAIN ] Derivative Progress: 1083/2046 symbols completed. LYG took 1.4s. Estimated remaining: 6m 30s. Rate: 148.1 symbols/min [2025-10-28T22:14:29.318823] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:29.370575] [DEBUG] [LOCAL ] M: Loaded 53542 existing records from primary storage. [2025-10-28T22:14:29.370835] [INFO ] [MAIN ] M: Loaded 53542 primary data records. [2025-10-28T22:14:29.398786] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:29.534412] [DEBUG] [LOCAL ] MA: Loaded 52412 existing records from primary storage. [2025-10-28T22:14:29.555749] [INFO ] [MAIN ] MA: Loaded 52412 primary data records. [2025-10-28T22:14:30.042990] [INFO ] [MAIN ] LZM: Generated 138 derivative records from 14881 primary records. [2025-10-28T22:14:30.044332] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-28T22:14:30.057183] [DEBUG] [LOCAL ] LZM: Derivative data saved (138 records). [2025-10-28T22:14:30.057442] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-28T22:14:30.059451] [INFO ] [MAIN ] Derivative Progress: 1084/2046 symbols completed. LZM took 1.1s. Estimated remaining: 6m 30s. Rate: 147.9 symbols/min [2025-10-28T22:14:30.059608] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:30.077131] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:30.125282] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:30.160120] [DEBUG] [LOCAL ] MAA: Loaded 42852 existing records from primary storage. [2025-10-28T22:14:30.168219] [INFO ] [MAIN ] MAA: Loaded 42852 primary data records. [2025-10-28T22:14:30.247610] [INFO ] [MAIN ] M: Generated 138 derivative records from 53542 primary records. [2025-10-28T22:14:30.263699] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-28T22:14:30.310151] [DEBUG] [LOCAL ] M: Derivative data saved (138 records). [2025-10-28T22:14:30.310752] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-28T22:14:30.313253] [INFO ] [MAIN ] Derivative Progress: 1085/2046 symbols completed. M took 1.3s. Estimated remaining: 6m 30s. Rate: 148.0 symbols/min [2025-10-28T22:14:30.332839] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:30.504494] [INFO ] [MAIN ] MA: Generated 138 derivative records from 52412 primary records. [2025-10-28T22:14:30.512984] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-28T22:14:30.526217] [DEBUG] [LOCAL ] MA: Derivative data saved (138 records). [2025-10-28T22:14:30.526465] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-28T22:14:30.529716] [INFO ] [MAIN ] Derivative Progress: 1086/2046 symbols completed. MA took 1.2s. Estimated remaining: 6m 29s. Rate: 148.1 symbols/min [2025-10-28T22:14:30.531113] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:30.559285] [DEBUG] [LOCAL ] MAGN: Loaded 35786 existing records from primary storage. [2025-10-28T22:14:30.560205] [INFO ] [MAIN ] MAGN: Loaded 35786 primary data records. [2025-10-28T22:14:30.686053] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:30.792837] [DEBUG] [LOCAL ] MAIN: Loaded 41648 existing records from primary storage. [2025-10-28T22:14:30.801000] [INFO ] [MAIN ] MAIN: Loaded 41648 primary data records. [2025-10-28T22:14:31.293987] [INFO ] [MAIN ] MAA: Generated 138 derivative records from 42852 primary records. [2025-10-28T22:14:31.294737] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-28T22:14:31.310486] [DEBUG] [LOCAL ] MAA: Derivative data saved (138 records). [2025-10-28T22:14:31.311988] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-28T22:14:31.313976] [INFO ] [MAIN ] Derivative Progress: 1087/2046 symbols completed. MAA took 1.3s. Estimated remaining: 6m 29s. Rate: 147.9 symbols/min [2025-10-28T22:14:31.314142] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:31.330471] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:31.382917] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:31.418870] [INFO ] [MAIN ] MAGN: Generated 138 derivative records from 35786 primary records. [2025-10-28T22:14:31.421393] [DEBUG] [LOCAL ] MAN: Loaded 44330 existing records from primary storage. [2025-10-28T22:14:31.420305] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-28T22:14:31.424257] [INFO ] [MAIN ] MAN: Loaded 44330 primary data records. [2025-10-28T22:14:31.534204] [DEBUG] [LOCAL ] MAGN: Derivative data saved (138 records). [2025-10-28T22:14:31.546915] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-28T22:14:31.562056] [INFO ] [MAIN ] Derivative Progress: 1088/2046 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 28s. Rate: 148.0 symbols/min [2025-10-28T22:14:31.563774] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:31.757934] [INFO ] [MAIN ] MAIN: Generated 138 derivative records from 41648 primary records. [2025-10-28T22:14:31.765280] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-28T22:14:31.789352] [DEBUG] [LOCAL ] MAIN: Derivative data saved (138 records). [2025-10-28T22:14:31.790005] [DEBUG] [LOCAL ] MANU: Loaded 26793 existing records from primary storage. [2025-10-28T22:14:31.790696] [INFO ] [MAIN ] MANU: Loaded 26793 primary data records. [2025-10-28T22:14:31.790252] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-28T22:14:31.793254] [INFO ] [MAIN ] Derivative Progress: 1089/2046 symbols completed. MAIN took 1.3s. Estimated remaining: 6m 28s. Rate: 148.0 symbols/min [2025-10-28T22:14:31.793615] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:32.128597] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:32.165503] [DEBUG] [LOCAL ] MAS: Loaded 52159 existing records from primary storage. [2025-10-28T22:14:32.166570] [INFO ] [MAIN ] MAS: Loaded 52159 primary data records. [2025-10-28T22:14:32.308090] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:32.551586] [INFO ] [MAIN ] MAN: Generated 138 derivative records from 44330 primary records. [2025-10-28T22:14:32.552118] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-28T22:14:32.569081] [DEBUG] [LOCAL ] MAN: Derivative data saved (138 records). [2025-10-28T22:14:32.569825] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-28T22:14:32.572265] [INFO ] [MAIN ] Derivative Progress: 1090/2046 symbols completed. MAN took 1.3s. Estimated remaining: 6m 28s. Rate: 147.9 symbols/min [2025-10-28T22:14:32.572476] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:32.581806] [INFO ] [MAIN ] MANU: Generated 138 derivative records from 26793 primary records. [2025-10-28T22:14:32.582075] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-28T22:14:32.596757] [DEBUG] [LOCAL ] MANU: Derivative data saved (138 records). [2025-10-28T22:14:32.596965] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-28T22:14:32.599259] [INFO ] [MAIN ] Derivative Progress: 1091/2046 symbols completed. MANU took 1.0s. Estimated remaining: 6m 27s. Rate: 148.0 symbols/min [2025-10-28T22:14:32.599597] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:32.613353] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:32.676061] [DEBUG] [LOCAL ] MATV: Loaded 34396 existing records from primary storage. [2025-10-28T22:14:32.679995] [INFO ] [MAIN ] MATV: Loaded 34396 primary data records. [2025-10-28T22:14:32.773019] [DEBUG] [LOCAL ] MATX: Loaded 31448 existing records from primary storage. [2025-10-28T22:14:32.795043] [INFO ] [MAIN ] MATX: Loaded 31448 primary data records. [2025-10-28T22:14:32.750935] [INFO ] [MAIN ] MAS: Generated 138 derivative records from 52159 primary records. [2025-10-28T22:14:32.795340] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-28T22:14:32.983240] [DEBUG] [LOCAL ] MAS: Derivative data saved (138 records). [2025-10-28T22:14:33.014829] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-28T22:14:33.045767] [INFO ] [MAIN ] Derivative Progress: 1092/2046 symbols completed. MAS took 1.3s. Estimated remaining: 6m 27s. Rate: 148.0 symbols/min [2025-10-28T22:14:33.159253] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:33.422703] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:33.421875] [DEBUG] [LOCAL ] MAX: Loaded 30439 existing records from primary storage. [2025-10-28T22:14:33.433584] [INFO ] [MAIN ] MAX: Loaded 30439 primary data records. [2025-10-28T22:14:33.766231] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:33.804685] [INFO ] [MAIN ] MATV: Generated 138 derivative records from 34396 primary records. [2025-10-28T22:14:33.808095] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-28T22:14:33.825163] [DEBUG] [LOCAL ] MATV: Derivative data saved (138 records). [2025-10-28T22:14:33.825381] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-28T22:14:33.827317] [INFO ] [MAIN ] Derivative Progress: 1093/2046 symbols completed. MATV took 1.3s. Estimated remaining: 6m 27s. Rate: 147.9 symbols/min [2025-10-28T22:14:33.836801] [INFO ] [MAIN ] MATX: Generated 138 derivative records from 31448 primary records. [2025-10-28T22:14:33.837024] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-28T22:14:33.849473] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:33.878068] [DEBUG] [LOCAL ] MATX: Derivative data saved (138 records). [2025-10-28T22:14:33.878509] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-28T22:14:33.881910] [INFO ] [MAIN ] Derivative Progress: 1094/2046 symbols completed. MATX took 1.3s. Estimated remaining: 6m 26s. Rate: 148.0 symbols/min [2025-10-28T22:14:33.891847] [INFO ] [MAIN ] MAX: Generated 138 derivative records from 30439 primary records. [2025-10-28T22:14:33.891915] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-28T22:14:33.903612] [DEBUG] [LOCAL ] MAX: Derivative data saved (138 records). [2025-10-28T22:14:33.903693] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-28T22:14:33.905808] [INFO ] [MAIN ] Derivative Progress: 1095/2046 symbols completed. MAX took 0.7s. Estimated remaining: 6m 25s. Rate: 148.1 symbols/min [2025-10-28T22:14:33.906161] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:33.906434] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:33.906749] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:33.929673] [DEBUG] [LOCAL ] MBI: Loaded 23464 existing records from primary storage. [2025-10-28T22:14:33.929809] [INFO ] [MAIN ] MBI: Loaded 23464 primary data records. [2025-10-28T22:14:34.143748] [DEBUG] [LOCAL ] MC: Loaded 43337 existing records from primary storage. [2025-10-28T22:14:34.269587] [INFO ] [MAIN ] MC: Loaded 43337 primary data records. [2025-10-28T22:14:34.272191] [DEBUG] [LOCAL ] MBC: Loaded 43688 existing records from primary storage. [2025-10-28T22:14:34.294017] [INFO ] [MAIN ] MBC: Loaded 43688 primary data records. [2025-10-28T22:14:34.935982] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:34.997124] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:35.031372] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:35.054158] [INFO ] [MAIN ] MBI: Generated 138 derivative records from 23464 primary records. [2025-10-28T22:14:35.058902] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-28T22:14:35.082099] [DEBUG] [LOCAL ] MBI: Derivative data saved (138 records). [2025-10-28T22:14:35.082436] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-28T22:14:35.087910] [INFO ] [MAIN ] Derivative Progress: 1096/2046 symbols completed. MBI took 1.2s. Estimated remaining: 6m 25s. Rate: 147.9 symbols/min [2025-10-28T22:14:35.088403] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:35.118046] [DEBUG] [LOCAL ] MCB: Loaded 11282 existing records from primary storage. [2025-10-28T22:14:35.119498] [INFO ] [MAIN ] MCB: Loaded 11282 primary data records. [2025-10-28T22:14:35.211511] [INFO ] [MAIN ] MC: Generated 138 derivative records from 43337 primary records. [2025-10-28T22:14:35.233909] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-28T22:14:35.289023] [INFO ] [MAIN ] MBC: Generated 138 derivative records from 43688 primary records. [2025-10-28T22:14:35.324843] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-28T22:14:35.444975] [DEBUG] [LOCAL ] MC: Derivative data saved (138 records). [2025-10-28T22:14:35.445900] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-28T22:14:35.448388] [INFO ] [MAIN ] Derivative Progress: 1097/2046 symbols completed. MC took 1.5s. Estimated remaining: 6m 25s. Rate: 147.9 symbols/min [2025-10-28T22:14:35.448916] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:35.462031] [DEBUG] [LOCAL ] MBC: Derivative data saved (138 records). [2025-10-28T22:14:35.463747] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-28T22:14:35.466111] [INFO ] [MAIN ] Derivative Progress: 1098/2046 symbols completed. MBC took 1.6s. Estimated remaining: 6m 24s. Rate: 148.0 symbols/min [2025-10-28T22:14:35.466344] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:35.472231] [DEBUG] [LOCAL ] MCI: Loaded 6116 existing records from primary storage. [2025-10-28T22:14:35.472705] [INFO ] [MAIN ] MCI: Loaded 6116 primary data records. [2025-10-28T22:14:35.891298] [DEBUG] [LOCAL ] MCK: Loaded 37402 existing records from primary storage. [2025-10-28T22:14:35.891990] [INFO ] [MAIN ] MCK: Loaded 37402 primary data records. [2025-10-28T22:14:35.994975] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:36.277939] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:36.301989] [INFO ] [MAIN ] MCB: Generated 138 derivative records from 11282 primary records. [2025-10-28T22:14:36.303582] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-28T22:14:36.326635] [DEBUG] [LOCAL ] MCB: Derivative data saved (138 records). [2025-10-28T22:14:36.327395] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-28T22:14:36.330483] [INFO ] [MAIN ] Derivative Progress: 1099/2046 symbols completed. MCB took 1.2s. Estimated remaining: 6m 24s. Rate: 147.9 symbols/min [2025-10-28T22:14:36.348156] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:36.347465] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:36.386583] [DEBUG] [LOCAL ] MCN: Loaded 7839 existing records from primary storage. [2025-10-28T22:14:36.388728] [INFO ] [MAIN ] MCN: Loaded 7839 primary data records. [2025-10-28T22:14:36.511126] [INFO ] [MAIN ] MCI: Generated 138 derivative records from 6116 primary records. [2025-10-28T22:14:36.522953] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-28T22:14:36.596163] [DEBUG] [LOCAL ] MCI: Derivative data saved (138 records). [2025-10-28T22:14:36.617624] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-28T22:14:36.624942] [INFO ] [MAIN ] Derivative Progress: 1100/2046 symbols completed. MCI took 1.2s. Estimated remaining: 6m 24s. Rate: 147.9 symbols/min [2025-10-28T22:14:36.625712] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:36.750590] [INFO ] [MAIN ] MCK: Generated 138 derivative records from 37402 primary records. [2025-10-28T22:14:36.751843] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-28T22:14:36.766072] [DEBUG] [LOCAL ] MCK: Derivative data saved (138 records). [2025-10-28T22:14:36.766447] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-28T22:14:36.769151] [INFO ] [MAIN ] Derivative Progress: 1101/2046 symbols completed. MCK took 1.3s. Estimated remaining: 6m 23s. Rate: 148.0 symbols/min [2025-10-28T22:14:36.769430] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:36.781149] [DEBUG] [LOCAL ] MCR: Loaded 8864 existing records from primary storage. [2025-10-28T22:14:36.790738] [INFO ] [MAIN ] MCR: Loaded 8864 primary data records. [2025-10-28T22:14:36.932575] [DEBUG] [LOCAL ] MCO: Loaded 39204 existing records from primary storage. [2025-10-28T22:14:36.943327] [INFO ] [MAIN ] MCO: Loaded 39204 primary data records. [2025-10-28T22:14:36.943700] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:37.544558] [INFO ] [MAIN ] MCN: Generated 138 derivative records from 7839 primary records. [2025-10-28T22:14:37.545814] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-28T22:14:37.563208] [DEBUG] [LOCAL ] MCN: Derivative data saved (138 records). [2025-10-28T22:14:37.575561] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-28T22:14:37.577896] [INFO ] [MAIN ] Derivative Progress: 1102/2046 symbols completed. MCN took 1.2s. Estimated remaining: 6m 23s. Rate: 147.9 symbols/min [2025-10-28T22:14:37.585589] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:37.586307] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:37.628070] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:37.652833] [DEBUG] [LOCAL ] MCS: Loaded 21032 existing records from primary storage. [2025-10-28T22:14:37.653390] [INFO ] [MAIN ] MCS: Loaded 21032 primary data records. [2025-10-28T22:14:37.826630] [INFO ] [MAIN ] MCR: Generated 138 derivative records from 8864 primary records. [2025-10-28T22:14:37.836503] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-28T22:14:38.045001] [DEBUG] [LOCAL ] MCR: Derivative data saved (138 records). [2025-10-28T22:14:38.047607] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-28T22:14:38.050101] [INFO ] [MAIN ] Derivative Progress: 1103/2046 symbols completed. MCR took 1.3s. Estimated remaining: 6m 23s. Rate: 147.8 symbols/min [2025-10-28T22:14:38.051490] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:38.060332] [INFO ] [MAIN ] MCO: Generated 138 derivative records from 39204 primary records. [2025-10-28T22:14:38.060471] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-28T22:14:38.074494] [DEBUG] [LOCAL ] MCO: Derivative data saved (138 records). [2025-10-28T22:14:38.079957] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-28T22:14:38.083254] [INFO ] [MAIN ] Derivative Progress: 1104/2046 symbols completed. MCO took 1.5s. Estimated remaining: 6m 22s. Rate: 148.0 symbols/min [2025-10-28T22:14:38.083527] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:38.093680] [DEBUG] [LOCAL ] MCY: Loaded 22925 existing records from primary storage. [2025-10-28T22:14:38.093903] [INFO ] [MAIN ] MCY: Loaded 22925 primary data records. [2025-10-28T22:14:38.254829] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:38.326834] [DEBUG] [LOCAL ] MD: Loaded 38397 existing records from primary storage. [2025-10-28T22:14:38.332269] [INFO ] [MAIN ] MD: Loaded 38397 primary data records. [2025-10-28T22:14:38.780709] [INFO ] [MAIN ] MCS: Generated 138 derivative records from 21032 primary records. [2025-10-28T22:14:38.783034] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-28T22:14:38.805270] [DEBUG] [LOCAL ] MCS: Derivative data saved (138 records). [2025-10-28T22:14:38.811971] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:38.811232] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-28T22:14:38.826291] [INFO ] [MAIN ] Derivative Progress: 1105/2046 symbols completed. MCS took 1.2s. Estimated remaining: 6m 22s. Rate: 147.9 symbols/min [2025-10-28T22:14:38.829745] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:38.850787] [DEBUG] [LOCAL ] MDST: Loaded 6210 existing records from primary storage. [2025-10-28T22:14:38.867383] [INFO ] [MAIN ] MDST: Loaded 6210 primary data records. [2025-10-28T22:14:38.867308] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:39.074696] [INFO ] [MAIN ] MCY: Generated 138 derivative records from 22925 primary records. [2025-10-28T22:14:39.195729] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-28T22:14:39.215378] [DEBUG] [LOCAL ] MCY: Derivative data saved (138 records). [2025-10-28T22:14:39.218899] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-28T22:14:39.221502] [INFO ] [MAIN ] Derivative Progress: 1106/2046 symbols completed. MCY took 1.2s. Estimated remaining: 6m 21s. Rate: 147.9 symbols/min [2025-10-28T22:14:39.222142] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:39.232518] [INFO ] [MAIN ] MD: Generated 138 derivative records from 38397 primary records. [2025-10-28T22:14:39.232991] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-28T22:14:39.247491] [DEBUG] [LOCAL ] MD: Derivative data saved (138 records). [2025-10-28T22:14:39.247638] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-28T22:14:39.250212] [INFO ] [MAIN ] Derivative Progress: 1107/2046 symbols completed. MD took 1.2s. Estimated remaining: 6m 21s. Rate: 148.0 symbols/min [2025-10-28T22:14:39.250469] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:39.267715] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:14:39.330608] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-28T22:14:39.331035] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-28T22:14:39.458113] [DEBUG] [LOCAL ] MDU: Loaded 47933 existing records from primary storage. [2025-10-28T22:14:39.480337] [INFO ] [MAIN ] MDU: Loaded 47933 primary data records. [2025-10-28T22:14:39.493155] [INFO ] [MAIN ] MDST: Generated 138 derivative records from 6210 primary records. [2025-10-28T22:14:39.508575] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-28T22:14:39.737404] [DEBUG] [LOCAL ] MDST: Derivative data saved (138 records). [2025-10-28T22:14:39.748364] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-28T22:14:39.761362] [INFO ] [MAIN ] Derivative Progress: 1108/2046 symbols completed. MDST took 0.9s. Estimated remaining: 6m 20s. Rate: 147.9 symbols/min [2025-10-28T22:14:40.003502] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:40.049536] [INFO ] [MAIN ] MDT: Generated 138 derivative records from 53678 primary records. [2025-10-28T22:14:40.047870] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:40.059950] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-28T22:14:40.074545] [DEBUG] [LOCAL ] MDT: Derivative data saved (138 records). [2025-10-28T22:14:40.075818] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-28T22:14:40.077910] [INFO ] [MAIN ] Derivative Progress: 1109/2046 symbols completed. MDT took 0.9s. Estimated remaining: 6m 20s. Rate: 148.0 symbols/min [2025-10-28T22:14:40.090233] [INFO ] [MAIN ] MDU: Generated 138 derivative records from 47933 primary records. [2025-10-28T22:14:40.090300] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-28T22:14:40.101621] [DEBUG] [LOCAL ] MDU: Derivative data saved (138 records). [2025-10-28T22:14:40.101703] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-28T22:14:40.103858] [INFO ] [MAIN ] Derivative Progress: 1110/2046 symbols completed. MDU took 0.9s. Estimated remaining: 6m 19s. Rate: 148.1 symbols/min [2025-10-28T22:14:40.104257] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:40.104602] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:40.104378] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:40.119088] [DEBUG] [LOCAL ] MDV: Loaded 8222 existing records from primary storage. [2025-10-28T22:14:40.119278] [INFO ] [MAIN ] MDV: Loaded 8222 primary data records. [2025-10-28T22:14:40.211920] [DEBUG] [LOCAL ] MEC: Loaded 16939 existing records from primary storage. [2025-10-28T22:14:40.204770] [DEBUG] [LOCAL ] MED: Loaded 20631 existing records from primary storage. [2025-10-28T22:14:40.235845] [INFO ] [MAIN ] MEC: Loaded 16939 primary data records. [2025-10-28T22:14:40.222395] [INFO ] [MAIN ] MED: Loaded 20631 primary data records. [2025-10-28T22:14:41.061099] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:41.095087] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:41.128364] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:41.181051] [INFO ] [MAIN ] MDV: Generated 138 derivative records from 8222 primary records. [2025-10-28T22:14:41.182949] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-28T22:14:41.200201] [DEBUG] [LOCAL ] MDV: Derivative data saved (138 records). [2025-10-28T22:14:41.200355] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-28T22:14:41.203983] [INFO ] [MAIN ] Derivative Progress: 1111/2046 symbols completed. MDV took 1.1s. Estimated remaining: 6m 19s. Rate: 147.9 symbols/min [2025-10-28T22:14:41.204249] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:41.208446] [INFO ] [MAIN ] MEC: Generated 138 derivative records from 16939 primary records. [2025-10-28T22:14:41.211760] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-28T22:14:41.225632] [DEBUG] [LOCAL ] MEC: Derivative data saved (138 records). [2025-10-28T22:14:41.227344] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-28T22:14:41.230074] [INFO ] [MAIN ] Derivative Progress: 1112/2046 symbols completed. MEC took 1.1s. Estimated remaining: 6m 19s. Rate: 148.0 symbols/min [2025-10-28T22:14:41.230266] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:41.230946] [INFO ] [MAIN ] MED: Generated 138 derivative records from 20631 primary records. [2025-10-28T22:14:41.231176] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-28T22:14:41.251835] [DEBUG] [LOCAL ] MED: Derivative data saved (138 records). [2025-10-28T22:14:41.252085] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-28T22:14:41.254496] [INFO ] [MAIN ] Derivative Progress: 1113/2046 symbols completed. MED took 1.2s. Estimated remaining: 6m 18s. Rate: 148.1 symbols/min [2025-10-28T22:14:41.254781] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:41.277321] [DEBUG] [LOCAL ] MEG: Loaded 31110 existing records from primary storage. [2025-10-28T22:14:41.278469] [INFO ] [MAIN ] MEG: Loaded 31110 primary data records. [2025-10-28T22:14:41.278938] [DEBUG] [LOCAL ] MEGI: Loaded 19566 existing records from primary storage. [2025-10-28T22:14:41.316444] [INFO ] [MAIN ] MEGI: Loaded 19566 primary data records. [2025-10-28T22:14:41.498075] [DEBUG] [LOCAL ] MEI: Loaded 30990 existing records from primary storage. [2025-10-28T22:14:41.543471] [INFO ] [MAIN ] MEI: Loaded 30990 primary data records. [2025-10-28T22:14:42.271697] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:42.272039] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:42.329181] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:42.375576] [INFO ] [MAIN ] MEG: Generated 138 derivative records from 31110 primary records. [2025-10-28T22:14:42.379217] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-28T22:14:42.393620] [INFO ] [MAIN ] MEGI: Generated 138 derivative records from 19566 primary records. [2025-10-28T22:14:42.397203] [DEBUG] [LOCAL ] MEG: Derivative data saved (138 records). [2025-10-28T22:14:42.399685] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-28T22:14:42.412435] [DEBUG] [LOCAL ] MEGI: Derivative data saved (138 records). [2025-10-28T22:14:42.400862] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-28T22:14:42.414747] [INFO ] [MAIN ] Derivative Progress: 1114/2046 symbols completed. MEG took 1.2s. Estimated remaining: 6m 18s. Rate: 147.9 symbols/min [2025-10-28T22:14:42.412628] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-28T22:14:42.417554] [INFO ] [MAIN ] Derivative Progress: 1115/2046 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 17s. Rate: 148.0 symbols/min [2025-10-28T22:14:42.418717] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:42.417159] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:42.426193] [INFO ] [MAIN ] MEI: Generated 138 derivative records from 30990 primary records. [2025-10-28T22:14:42.426385] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-28T22:14:42.438422] [DEBUG] [LOCAL ] MEI: Derivative data saved (138 records). [2025-10-28T22:14:42.438623] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-28T22:14:42.441484] [INFO ] [MAIN ] Derivative Progress: 1116/2046 symbols completed. MEI took 1.2s. Estimated remaining: 6m 17s. Rate: 148.1 symbols/min [2025-10-28T22:14:42.441972] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:42.447601] [DEBUG] [LOCAL ] MFAN: Loaded 4177 existing records from primary storage. [2025-10-28T22:14:42.447917] [INFO ] [MAIN ] MFAN: Loaded 4177 primary data records. [2025-10-28T22:14:42.602992] [DEBUG] [LOCAL ] MFA: Loaded 45144 existing records from primary storage. [2025-10-28T22:14:42.626260] [INFO ] [MAIN ] MFA: Loaded 45144 primary data records. [2025-10-28T22:14:42.700974] [DEBUG] [LOCAL ] MET: Loaded 53277 existing records from primary storage. [2025-10-28T22:14:42.748362] [INFO ] [MAIN ] MET: Loaded 53277 primary data records. [2025-10-28T22:14:43.431063] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:43.466544] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:43.526123] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:43.553273] [INFO ] [MAIN ] MFAN: Generated 138 derivative records from 4177 primary records. [2025-10-28T22:14:43.554307] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-28T22:14:43.572190] [DEBUG] [LOCAL ] MFAN: Derivative data saved (138 records). [2025-10-28T22:14:43.575251] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-28T22:14:43.577375] [INFO ] [MAIN ] Derivative Progress: 1117/2046 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 17s. Rate: 147.9 symbols/min [2025-10-28T22:14:43.578040] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:43.594103] [DEBUG] [LOCAL ] MFAO: Loaded 3740 existing records from primary storage. [2025-10-28T22:14:43.595639] [INFO ] [MAIN ] MFA: Generated 138 derivative records from 45144 primary records. [2025-10-28T22:14:43.596404] [INFO ] [MAIN ] MFAO: Loaded 3740 primary data records. [2025-10-28T22:14:43.619717] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-28T22:14:43.714265] [DEBUG] [LOCAL ] MFA: Derivative data saved (138 records). [2025-10-28T22:14:43.717808] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-28T22:14:43.721579] [INFO ] [MAIN ] Derivative Progress: 1118/2046 symbols completed. MFA took 1.3s. Estimated remaining: 6m 16s. Rate: 148.0 symbols/min [2025-10-28T22:14:43.747963] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:43.963834] [INFO ] [MAIN ] MET: Generated 138 derivative records from 53277 primary records. [2025-10-28T22:14:43.963998] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-28T22:14:43.980248] [DEBUG] [LOCAL ] MET: Derivative data saved (138 records). [2025-10-28T22:14:43.980788] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-28T22:14:43.983705] [INFO ] [MAIN ] Derivative Progress: 1119/2046 symbols completed. MET took 1.6s. Estimated remaining: 6m 16s. Rate: 148.0 symbols/min [2025-10-28T22:14:43.984084] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:44.017897] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:44.047032] [DEBUG] [LOCAL ] MFC: Loaded 50873 existing records from primary storage. [2025-10-28T22:14:44.058115] [INFO ] [MAIN ] MFC: Loaded 50873 primary data records. [2025-10-28T22:14:44.202354] [DEBUG] [LOCAL ] MFG: Loaded 49381 existing records from primary storage. [2025-10-28T22:14:44.227084] [INFO ] [MAIN ] MFG: Loaded 49381 primary data records. [2025-10-28T22:14:44.692682] [INFO ] [MAIN ] MFAO: Generated 138 derivative records from 3740 primary records. [2025-10-28T22:14:44.693336] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-28T22:14:44.706864] [DEBUG] [LOCAL ] MFAO: Derivative data saved (138 records). [2025-10-28T22:14:44.707634] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-28T22:14:44.709954] [INFO ] [MAIN ] Derivative Progress: 1120/2046 symbols completed. MFAO took 1.1s. Estimated remaining: 6m 16s. Rate: 147.9 symbols/min [2025-10-28T22:14:44.711049] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:44.744850] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:44.745223] [DEBUG] [LOCAL ] MFM: Loaded 13406 existing records from primary storage. [2025-10-28T22:14:44.756886] [INFO ] [MAIN ] MFM: Loaded 13406 primary data records. [2025-10-28T22:14:44.896523] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:45.136500] [INFO ] [MAIN ] MFC: Generated 138 derivative records from 50873 primary records. [2025-10-28T22:14:45.139778] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-28T22:14:45.155080] [INFO ] [MAIN ] MFG: Generated 138 derivative records from 49381 primary records. [2025-10-28T22:14:45.156509] [DEBUG] [LOCAL ] MFC: Derivative data saved (138 records). [2025-10-28T22:14:45.155702] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-28T22:14:45.156713] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-28T22:14:45.159491] [INFO ] [MAIN ] Derivative Progress: 1121/2046 symbols completed. MFC took 1.4s. Estimated remaining: 6m 15s. Rate: 147.9 symbols/min [2025-10-28T22:14:45.160058] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:45.174356] [DEBUG] [LOCAL ] MFG: Derivative data saved (138 records). [2025-10-28T22:14:45.175346] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-28T22:14:45.178108] [INFO ] [MAIN ] Derivative Progress: 1122/2046 symbols completed. MFG took 1.2s. Estimated remaining: 6m 15s. Rate: 148.0 symbols/min [2025-10-28T22:14:45.192360] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:45.192709] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:45.210253] [DEBUG] [LOCAL ] MFSG: Loaded 5923 existing records from primary storage. [2025-10-28T22:14:45.210628] [INFO ] [MAIN ] MFSG: Loaded 5923 primary data records. [2025-10-28T22:14:45.323463] [DEBUG] [LOCAL ] MFSI: Loaded 12969 existing records from primary storage. [2025-10-28T22:14:45.328722] [INFO ] [MAIN ] MFSI: Loaded 12969 primary data records. [2025-10-28T22:14:45.858710] [INFO ] [MAIN ] MFM: Generated 138 derivative records from 13406 primary records. [2025-10-28T22:14:45.859984] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-28T22:14:45.872840] [DEBUG] [LOCAL ] MFM: Derivative data saved (138 records). [2025-10-28T22:14:45.873794] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-28T22:14:45.876181] [INFO ] [MAIN ] Derivative Progress: 1123/2046 symbols completed. MFM took 1.2s. Estimated remaining: 6m 14s. Rate: 147.9 symbols/min [2025-10-28T22:14:45.897726] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:14:45.933594] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:45.965493] [INFO ] [MAIN ] MFSG: Generated 138 derivative records from 5923 primary records. [2025-10-28T22:14:45.966975] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-28T22:14:45.981897] [DEBUG] [LOCAL ] MFSG: Derivative data saved (138 records). [2025-10-28T22:14:45.983292] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-28T22:14:45.987915] [INFO ] [MAIN ] Derivative Progress: 1124/2046 symbols completed. MFSG took 0.8s. Estimated remaining: 6m 14s. Rate: 148.0 symbols/min [2025-10-28T22:14:45.991270] [INFO ] [MAIN ] MFSI: Generated 138 derivative records from 12969 primary records. [2025-10-28T22:14:45.991364] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-28T22:14:46.003201] [DEBUG] [LOCAL ] MFSI: Derivative data saved (138 records). [2025-10-28T22:14:46.003276] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-28T22:14:46.005795] [INFO ] [MAIN ] Derivative Progress: 1125/2046 symbols completed. MFSI took 0.8s. Estimated remaining: 6m 13s. Rate: 148.2 symbols/min [2025-10-28T22:14:46.006340] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:46.006227] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:46.006276] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:46.012611] [DEBUG] [LOCAL ] MFSV: Loaded 3053 existing records from primary storage. [2025-10-28T22:14:46.012771] [INFO ] [MAIN ] MFSV: Loaded 3053 primary data records. [2025-10-28T22:14:46.116950] [DEBUG] [LOCAL ] MG: Loaded 14922 existing records from primary storage. [2025-10-28T22:14:46.137034] [INFO ] [MAIN ] MG: Loaded 14922 primary data records. [2025-10-28T22:14:46.568098] [DEBUG] [LOCAL ] MGA: Loaded 50260 existing records from primary storage. [2025-10-28T22:14:46.568298] [INFO ] [MAIN ] MGA: Loaded 50260 primary data records. [2025-10-28T22:14:47.003897] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7827 incomplete bins [2025-10-28T22:14:47.038779] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:47.081820] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:47.110532] [INFO ] [MAIN ] MFSV: Generated 138 derivative records from 3053 primary records. [2025-10-28T22:14:47.112346] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-28T22:14:47.127192] [DEBUG] [LOCAL ] MFSV: Derivative data saved (138 records). [2025-10-28T22:14:47.130072] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-28T22:14:47.134727] [INFO ] [MAIN ] Derivative Progress: 1126/2046 symbols completed. MFSV took 1.1s. Estimated remaining: 6m 13s. Rate: 147.9 symbols/min [2025-10-28T22:14:47.135675] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:47.147935] [INFO ] [MAIN ] MG: Generated 138 derivative records from 14922 primary records. [2025-10-28T22:14:47.148151] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-28T22:14:47.164868] [DEBUG] [LOCAL ] MG: Derivative data saved (138 records). [2025-10-28T22:14:47.165448] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-28T22:14:47.167915] [INFO ] [MAIN ] Derivative Progress: 1127/2046 symbols completed. MG took 1.2s. Estimated remaining: 6m 12s. Rate: 148.0 symbols/min [2025-10-28T22:14:47.168223] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:47.165254] [DEBUG] [LOCAL ] MGF: Loaded 4090 existing records from primary storage. [2025-10-28T22:14:47.172189] [INFO ] [MAIN ] MGF: Loaded 4090 primary data records. [2025-10-28T22:14:47.316518] [INFO ] [MAIN ] MGA: Generated 138 derivative records from 50260 primary records. [2025-10-28T22:14:47.321921] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-28T22:14:47.538026] [DEBUG] [LOCAL ] MGA: Derivative data saved (138 records). [2025-10-28T22:14:47.538172] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-28T22:14:47.541040] [INFO ] [MAIN ] Derivative Progress: 1128/2046 symbols completed. MGA took 1.5s. Estimated remaining: 6m 12s. Rate: 148.1 symbols/min [2025-10-28T22:14:47.542320] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:47.568376] [DEBUG] [LOCAL ] MGM: Loaded 53601 existing records from primary storage. [2025-10-28T22:14:47.570526] [INFO ] [MAIN ] MGM: Loaded 53601 primary data records. [2025-10-28T22:14:47.643461] [DEBUG] [LOCAL ] MGR: Loaded 5423 existing records from primary storage. [2025-10-28T22:14:47.667801] [INFO ] [MAIN ] MGR: Loaded 5423 primary data records. [2025-10-28T22:14:48.062611] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:48.305899] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:48.325243] [INFO ] [MAIN ] MGF: Generated 138 derivative records from 4090 primary records. [2025-10-28T22:14:48.334761] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-28T22:14:48.343144] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:48.368832] [DEBUG] [LOCAL ] MGF: Derivative data saved (138 records). [2025-10-28T22:14:48.371044] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-28T22:14:48.375068] [INFO ] [MAIN ] Derivative Progress: 1129/2046 symbols completed. MGF took 1.2s. Estimated remaining: 6m 12s. Rate: 147.9 symbols/min [2025-10-28T22:14:48.377081] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:48.392315] [DEBUG] [LOCAL ] MGRB: Loaded 3854 existing records from primary storage. [2025-10-28T22:14:48.392580] [INFO ] [MAIN ] MGRB: Loaded 3854 primary data records. [2025-10-28T22:14:48.526678] [INFO ] [MAIN ] MGM: Generated 138 derivative records from 53601 primary records. [2025-10-28T22:14:48.548042] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-28T22:14:48.714118] [DEBUG] [LOCAL ] MGM: Derivative data saved (138 records). [2025-10-28T22:14:48.718570] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-28T22:14:48.720940] [INFO ] [MAIN ] Derivative Progress: 1130/2046 symbols completed. MGM took 1.6s. Estimated remaining: 6m 12s. Rate: 147.9 symbols/min [2025-10-28T22:14:48.721580] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:48.727629] [INFO ] [MAIN ] MGR: Generated 138 derivative records from 5423 primary records. [2025-10-28T22:14:48.728264] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-28T22:14:48.731255] [DEBUG] [LOCAL ] MGRD: Loaded 2150 existing records from primary storage. [2025-10-28T22:14:48.731730] [INFO ] [MAIN ] MGRD: Loaded 2150 primary data records. [2025-10-28T22:14:48.776001] [DEBUG] [LOCAL ] MGR: Derivative data saved (138 records). [2025-10-28T22:14:48.781391] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-28T22:14:48.791226] [INFO ] [MAIN ] Derivative Progress: 1131/2046 symbols completed. MGR took 1.2s. Estimated remaining: 6m 11s. Rate: 148.0 symbols/min [2025-10-28T22:14:48.796610] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:48.923488] [DEBUG] [LOCAL ] MGRE: Loaded 6301 existing records from primary storage. [2025-10-28T22:14:48.944421] [INFO ] [MAIN ] MGRE: Loaded 6301 primary data records. [2025-10-28T22:14:49.087192] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:49.455305] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:49.472418] [INFO ] [MAIN ] MGRB: Generated 138 derivative records from 3854 primary records. [2025-10-28T22:14:49.474798] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-28T22:14:49.488434] [DEBUG] [LOCAL ] MGRB: Derivative data saved (138 records). [2025-10-28T22:14:49.488865] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-28T22:14:49.495349] [INFO ] [MAIN ] Derivative Progress: 1132/2046 symbols completed. MGRB took 1.1s. Estimated remaining: 6m 11s. Rate: 147.9 symbols/min [2025-10-28T22:14:49.498817] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:49.518172] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:49.558715] [INFO ] [MAIN ] MGRD: Generated 138 derivative records from 2150 primary records. [2025-10-28T22:14:49.562541] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-28T22:14:49.586178] [DEBUG] [LOCAL ] MGRD: Derivative data saved (138 records). [2025-10-28T22:14:49.587411] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-28T22:14:49.590198] [INFO ] [MAIN ] Derivative Progress: 1133/2046 symbols completed. MGRD took 0.9s. Estimated remaining: 6m 10s. Rate: 148.0 symbols/min [2025-10-28T22:14:49.593683] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:49.614405] [DEBUG] [LOCAL ] MGY: Loaded 52401 existing records from primary storage. [2025-10-28T22:14:49.614563] [INFO ] [MAIN ] MGY: Loaded 52401 primary data records. [2025-10-28T22:14:49.613268] [INFO ] [MAIN ] MGRE: Generated 138 derivative records from 6301 primary records. [2025-10-28T22:14:49.649345] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-28T22:14:49.715598] [DEBUG] [LOCAL ] MHD: Loaded 11655 existing records from primary storage. [2025-10-28T22:14:49.727883] [INFO ] [MAIN ] MHD: Loaded 11655 primary data records. [2025-10-28T22:14:49.757940] [DEBUG] [LOCAL ] MGRE: Derivative data saved (138 records). [2025-10-28T22:14:49.816343] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-28T22:14:49.836106] [INFO ] [MAIN ] Derivative Progress: 1134/2046 symbols completed. MGRE took 1.0s. Estimated remaining: 6m 9s. Rate: 148.1 symbols/min [2025-10-28T22:14:49.873744] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:50.187408] [DEBUG] [LOCAL ] MHF: Loaded 9214 existing records from primary storage. [2025-10-28T22:14:50.271518] [INFO ] [MAIN ] MHF: Loaded 9214 primary data records. [2025-10-28T22:14:50.596739] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:50.634983] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:50.679532] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:50.701837] [INFO ] [MAIN ] MGY: Generated 138 derivative records from 52401 primary records. [2025-10-28T22:14:50.703638] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-28T22:14:50.728332] [DEBUG] [LOCAL ] MGY: Derivative data saved (138 records). [2025-10-28T22:14:50.730834] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-28T22:14:50.733107] [INFO ] [MAIN ] Derivative Progress: 1135/2046 symbols completed. MGY took 1.2s. Estimated remaining: 6m 9s. Rate: 147.9 symbols/min [2025-10-28T22:14:50.733398] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:50.736781] [INFO ] [MAIN ] MHD: Generated 138 derivative records from 11655 primary records. [2025-10-28T22:14:50.737551] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-28T22:14:50.752683] [DEBUG] [LOCAL ] MHD: Derivative data saved (138 records). [2025-10-28T22:14:50.753537] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-28T22:14:50.756122] [INFO ] [MAIN ] Derivative Progress: 1136/2046 symbols completed. MHD took 1.2s. Estimated remaining: 6m 9s. Rate: 148.1 symbols/min [2025-10-28T22:14:50.756292] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:50.763305] [INFO ] [MAIN ] MHF: Generated 138 derivative records from 9214 primary records. [2025-10-28T22:14:50.765311] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-28T22:14:50.787181] [DEBUG] [LOCAL ] MHN: Loaded 6981 existing records from primary storage. [2025-10-28T22:14:50.787490] [INFO ] [MAIN ] MHN: Loaded 6981 primary data records. [2025-10-28T22:14:50.788777] [DEBUG] [LOCAL ] MHF: Derivative data saved (138 records). [2025-10-28T22:14:50.810026] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-28T22:14:50.812729] [INFO ] [MAIN ] Derivative Progress: 1137/2046 symbols completed. MHF took 0.9s. Estimated remaining: 6m 8s. Rate: 148.2 symbols/min [2025-10-28T22:14:50.812946] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:50.934340] [DEBUG] [LOCAL ] MHK: Loaded 41941 existing records from primary storage. [2025-10-28T22:14:50.976696] [INFO ] [MAIN ] MHK: Loaded 41941 primary data records. [2025-10-28T22:14:50.967498] [DEBUG] [LOCAL ] MHO: Loaded 23473 existing records from primary storage. [2025-10-28T22:14:51.001781] [INFO ] [MAIN ] MHO: Loaded 23473 primary data records. [2025-10-28T22:14:51.756251] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:51.805964] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:51.824874] [INFO ] [MAIN ] MHN: Generated 138 derivative records from 6981 primary records. [2025-10-28T22:14:51.826236] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-28T22:14:51.854225] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:51.867576] [DEBUG] [LOCAL ] MHN: Derivative data saved (138 records). [2025-10-28T22:14:51.872809] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-28T22:14:51.878140] [INFO ] [MAIN ] Derivative Progress: 1138/2046 symbols completed. MHN took 1.1s. Estimated remaining: 6m 8s. Rate: 148.0 symbols/min [2025-10-28T22:14:51.903450] [INFO ] [MAIN ] MHK: Generated 138 derivative records from 41941 primary records. [2025-10-28T22:14:51.903828] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-28T22:14:51.907008] [INFO ] [MAIN ] MHO: Generated 138 derivative records from 23473 primary records. [2025-10-28T22:14:51.914221] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-28T22:14:51.929936] [DEBUG] [LOCAL ] MHO: Derivative data saved (138 records). [2025-10-28T22:14:51.930256] [DEBUG] [LOCAL ] MHK: Derivative data saved (138 records). [2025-10-28T22:14:51.930301] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-28T22:14:51.933099] [INFO ] [MAIN ] Derivative Progress: 1139/2046 symbols completed. MHO took 1.1s. Estimated remaining: 6m 8s. Rate: 148.1 symbols/min [2025-10-28T22:14:51.933199] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-28T22:14:51.935871] [INFO ] [MAIN ] Derivative Progress: 1140/2046 symbols completed. MHK took 1.2s. Estimated remaining: 6m 7s. Rate: 148.2 symbols/min [2025-10-28T22:14:51.936241] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:51.936383] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:51.936291] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:51.941378] [DEBUG] [LOCAL ] MITP: Loaded 2084 existing records from primary storage. [2025-10-28T22:14:51.941746] [INFO ] [MAIN ] MITP: Loaded 2084 primary data records. [2025-10-28T22:14:52.052171] [DEBUG] [LOCAL ] MIN: Loaded 13560 existing records from primary storage. [2025-10-28T22:14:52.055762] [INFO ] [MAIN ] MIN: Loaded 13560 primary data records. [2025-10-28T22:14:52.429199] [DEBUG] [LOCAL ] MIR: Loaded 51420 existing records from primary storage. [2025-10-28T22:14:52.481118] [INFO ] [MAIN ] MIR: Loaded 51420 primary data records. [2025-10-28T22:14:52.918680] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:14:52.955263] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:53.003691] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:53.024361] [INFO ] [MAIN ] MITP: Generated 138 derivative records from 2084 primary records. [2025-10-28T22:14:53.027933] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-28T22:14:53.041676] [DEBUG] [LOCAL ] MITP: Derivative data saved (138 records). [2025-10-28T22:14:53.044444] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-28T22:14:53.046978] [INFO ] [MAIN ] Derivative Progress: 1141/2046 symbols completed. MITP took 1.1s. Estimated remaining: 6m 7s. Rate: 148.0 symbols/min [2025-10-28T22:14:53.048279] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:53.055250] [INFO ] [MAIN ] MIN: Generated 138 derivative records from 13560 primary records. [2025-10-28T22:14:53.056686] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-28T22:14:53.083870] [DEBUG] [LOCAL ] MIN: Derivative data saved (138 records). [2025-10-28T22:14:53.087190] [DEBUG] [LOCAL ] MITT: Loaded 21509 existing records from primary storage. [2025-10-28T22:14:53.088167] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-28T22:14:53.090759] [INFO ] [MAIN ] Derivative Progress: 1142/2046 symbols completed. MIN took 1.2s. Estimated remaining: 6m 6s. Rate: 148.1 symbols/min [2025-10-28T22:14:53.088399] [INFO ] [MAIN ] MITT: Loaded 21509 primary data records. [2025-10-28T22:14:53.103232] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:53.149739] [INFO ] [MAIN ] MIR: Generated 138 derivative records from 51420 primary records. [2025-10-28T22:14:53.165900] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-28T22:14:53.209591] [DEBUG] [LOCAL ] MIY: Loaded 6134 existing records from primary storage. [2025-10-28T22:14:53.211959] [INFO ] [MAIN ] MIY: Loaded 6134 primary data records. [2025-10-28T22:14:53.232005] [DEBUG] [LOCAL ] MIR: Derivative data saved (138 records). [2025-10-28T22:14:53.262444] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-28T22:14:53.300919] [INFO ] [MAIN ] Derivative Progress: 1143/2046 symbols completed. MIR took 1.4s. Estimated remaining: 6m 6s. Rate: 148.2 symbols/min [2025-10-28T22:14:53.327203] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:53.767433] [DEBUG] [LOCAL ] MKC: Loaded 52495 existing records from primary storage. [2025-10-28T22:14:53.769666] [INFO ] [MAIN ] MKC: Loaded 52495 primary data records. [2025-10-28T22:14:53.850023] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:53.999066] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:54.244894] [INFO ] [MAIN ] MIY: Generated 138 derivative records from 6134 primary records. [2025-10-28T22:14:54.252067] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-28T22:14:54.251737] [INFO ] [MAIN ] MITT: Generated 138 derivative records from 21509 primary records. [2025-10-28T22:14:54.252396] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:54.263773] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-28T22:14:54.289363] [DEBUG] [LOCAL ] MIY: Derivative data saved (138 records). [2025-10-28T22:14:54.290572] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-28T22:14:54.290493] [DEBUG] [LOCAL ] MITT: Derivative data saved (138 records). [2025-10-28T22:14:54.290747] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-28T22:14:54.292964] [INFO ] [MAIN ] Derivative Progress: 1144/2046 symbols completed. MITT took 1.2s. Estimated remaining: 6m 6s. Rate: 148.0 symbols/min [2025-10-28T22:14:54.297104] [INFO ] [MAIN ] Derivative Progress: 1145/2046 symbols completed. MIY took 1.2s. Estimated remaining: 6m 5s. Rate: 148.1 symbols/min [2025-10-28T22:14:54.296710] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:54.297959] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:54.317565] [INFO ] [MAIN ] MKC: Generated 138 derivative records from 52495 primary records. [2025-10-28T22:14:54.317807] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-28T22:14:54.329941] [DEBUG] [LOCAL ] MKC: Derivative data saved (138 records). [2025-10-28T22:14:54.330092] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-28T22:14:54.341472] [INFO ] [MAIN ] Derivative Progress: 1146/2046 symbols completed. MKC took 1.0s. Estimated remaining: 6m 4s. Rate: 148.2 symbols/min [2025-10-28T22:14:54.341860] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:54.364470] [DEBUG] [LOCAL ] MKL: Loaded 33336 existing records from primary storage. [2025-10-28T22:14:54.376945] [INFO ] [MAIN ] MKL: Loaded 33336 primary data records. [2025-10-28T22:14:54.414336] [DEBUG] [LOCAL ] MLI: Loaded 43128 existing records from primary storage. [2025-10-28T22:14:54.466738] [INFO ] [MAIN ] MLI: Loaded 43128 primary data records. [2025-10-28T22:14:54.523750] [DEBUG] [LOCAL ] MLM: Loaded 28163 existing records from primary storage. [2025-10-28T22:14:54.548944] [INFO ] [MAIN ] MLM: Loaded 28163 primary data records. [2025-10-28T22:14:55.340903] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:55.374463] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:55.413766] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:55.456152] [INFO ] [MAIN ] MKL: Generated 138 derivative records from 33336 primary records. [2025-10-28T22:14:55.459205] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-28T22:14:55.476047] [DEBUG] [LOCAL ] MKL: Derivative data saved (138 records). [2025-10-28T22:14:55.479808] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-28T22:14:55.482436] [INFO ] [MAIN ] Derivative Progress: 1147/2046 symbols completed. MKL took 1.2s. Estimated remaining: 6m 5s. Rate: 148.0 symbols/min [2025-10-28T22:14:55.482768] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:55.493445] [DEBUG] [LOCAL ] MLP: Loaded 2938 existing records from primary storage. [2025-10-28T22:14:55.496817] [INFO ] [MAIN ] MLP: Loaded 2938 primary data records. [2025-10-28T22:14:55.557251] [INFO ] [MAIN ] MLI: Generated 138 derivative records from 43128 primary records. [2025-10-28T22:14:55.557413] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-28T22:14:55.571486] [INFO ] [MAIN ] MLM: Generated 138 derivative records from 28163 primary records. [2025-10-28T22:14:55.588599] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-28T22:14:55.634793] [DEBUG] [LOCAL ] MLM: Derivative data saved (138 records). [2025-10-28T22:14:55.634936] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-28T22:14:55.622830] [DEBUG] [LOCAL ] MLI: Derivative data saved (138 records). [2025-10-28T22:14:55.653224] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-28T22:14:55.648005] [INFO ] [MAIN ] Derivative Progress: 1148/2046 symbols completed. MLM took 1.3s. Estimated remaining: 6m 4s. Rate: 148.1 symbols/min [2025-10-28T22:14:55.687738] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:55.687868] [INFO ] [MAIN ] Derivative Progress: 1149/2046 symbols completed. MLI took 1.4s. Estimated remaining: 6m 3s. Rate: 148.2 symbols/min [2025-10-28T22:14:55.820202] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:55.843022] [DEBUG] [LOCAL ] MLR: Loaded 11797 existing records from primary storage. [2025-10-28T22:14:55.843354] [INFO ] [MAIN ] MLR: Loaded 11797 primary data records. [2025-10-28T22:14:56.050807] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:14:56.239287] [DEBUG] [LOCAL ] MMC: Loaded 51895 existing records from primary storage. [2025-10-28T22:14:56.242523] [INFO ] [MAIN ] MMC: Loaded 51895 primary data records. [2025-10-28T22:14:56.470425] [INFO ] [MAIN ] MLP: Generated 138 derivative records from 2938 primary records. [2025-10-28T22:14:56.517674] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-28T22:14:56.596953] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:56.621035] [DEBUG] [LOCAL ] MLP: Derivative data saved (138 records). [2025-10-28T22:14:56.621178] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-28T22:14:56.624549] [INFO ] [MAIN ] Derivative Progress: 1150/2046 symbols completed. MLP took 1.1s. Estimated remaining: 6m 3s. Rate: 148.0 symbols/min [2025-10-28T22:14:56.625126] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:56.648444] [DEBUG] [LOCAL ] MMD: Loaded 10584 existing records from primary storage. [2025-10-28T22:14:56.651503] [INFO ] [MAIN ] MMD: Loaded 10584 primary data records. [2025-10-28T22:14:56.694503] [INFO ] [MAIN ] MLR: Generated 138 derivative records from 11797 primary records. [2025-10-28T22:14:56.725380] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-28T22:14:56.806280] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:56.837629] [DEBUG] [LOCAL ] MLR: Derivative data saved (138 records). [2025-10-28T22:14:56.838417] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-28T22:14:56.858175] [INFO ] [MAIN ] Derivative Progress: 1151/2046 symbols completed. MLR took 1.2s. Estimated remaining: 6m 3s. Rate: 148.1 symbols/min [2025-10-28T22:14:56.920090] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:57.065998] [INFO ] [MAIN ] MMC: Generated 138 derivative records from 51895 primary records. [2025-10-28T22:14:57.071857] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-28T22:14:57.071802] [DEBUG] [LOCAL ] MMI: Loaded 15038 existing records from primary storage. [2025-10-28T22:14:57.072623] [INFO ] [MAIN ] MMI: Loaded 15038 primary data records. [2025-10-28T22:14:57.139827] [DEBUG] [LOCAL ] MMC: Derivative data saved (138 records). [2025-10-28T22:14:57.170455] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-28T22:14:57.191555] [INFO ] [MAIN ] Derivative Progress: 1152/2046 symbols completed. MMC took 1.4s. Estimated remaining: 6m 2s. Rate: 148.1 symbols/min [2025-10-28T22:14:57.197695] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:57.244008] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:57.447379] [INFO ] [MAIN ] MMD: Generated 138 derivative records from 10584 primary records. [2025-10-28T22:14:57.447680] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-28T22:14:57.460530] [DEBUG] [LOCAL ] MMD: Derivative data saved (138 records). [2025-10-28T22:14:57.460790] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-28T22:14:57.475996] [INFO ] [MAIN ] Derivative Progress: 1153/2046 symbols completed. MMD took 0.9s. Estimated remaining: 6m 2s. Rate: 148.1 symbols/min [2025-10-28T22:14:57.478509] [DEBUG] [LOCAL ] MMM: Loaded 53108 existing records from primary storage. [2025-10-28T22:14:57.478810] [INFO ] [MAIN ] MMM: Loaded 53108 primary data records. [2025-10-28T22:14:57.598762] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:57.826037] [INFO ] [MAIN ] MMI: Generated 138 derivative records from 15038 primary records. [2025-10-28T22:14:57.826271] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-28T22:14:57.839310] [DEBUG] [LOCAL ] MMI: Derivative data saved (138 records). [2025-10-28T22:14:57.839680] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-28T22:14:57.842109] [INFO ] [MAIN ] Derivative Progress: 1154/2046 symbols completed. MMI took 0.9s. Estimated remaining: 6m 1s. Rate: 148.1 symbols/min [2025-10-28T22:14:57.858599] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:57.884132] [INFO ] [MAIN ] MMM: Generated 138 derivative records from 53108 primary records. [2025-10-28T22:14:57.884215] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-28T22:14:57.897109] [DEBUG] [LOCAL ] MMM: Derivative data saved (138 records). [2025-10-28T22:14:57.897181] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-28T22:14:57.899517] [INFO ] [MAIN ] Derivative Progress: 1155/2046 symbols completed. MMM took 0.7s. Estimated remaining: 6m 1s. Rate: 148.2 symbols/min [2025-10-28T22:14:57.900141] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:57.900074] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:57.900324] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:57.915428] [DEBUG] [LOCAL ] MMT: Loaded 9815 existing records from primary storage. [2025-10-28T22:14:57.915715] [INFO ] [MAIN ] MMT: Loaded 9815 primary data records. [2025-10-28T22:14:58.031994] [DEBUG] [LOCAL ] MMU: Loaded 16459 existing records from primary storage. [2025-10-28T22:14:58.047473] [INFO ] [MAIN ] MMU: Loaded 16459 primary data records. [2025-10-28T22:14:58.075410] [DEBUG] [LOCAL ] MMS: Loaded 32977 existing records from primary storage. [2025-10-28T22:14:58.100360] [INFO ] [MAIN ] MMS: Loaded 32977 primary data records. [2025-10-28T22:14:58.894012] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:58.949945] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:58.950243] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:14:59.004006] [INFO ] [MAIN ] MMT: Generated 138 derivative records from 9815 primary records. [2025-10-28T22:14:59.004496] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-28T22:14:59.022818] [DEBUG] [LOCAL ] MMT: Derivative data saved (138 records). [2025-10-28T22:14:59.024036] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-28T22:14:59.026626] [INFO ] [MAIN ] Derivative Progress: 1156/2046 symbols completed. MMT took 1.1s. Estimated remaining: 6m 1s. Rate: 148.0 symbols/min [2025-10-28T22:14:59.028039] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:59.038535] [INFO ] [MAIN ] MMS: Generated 138 derivative records from 32977 primary records. [2025-10-28T22:14:59.039060] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-28T22:14:59.053966] [INFO ] [MAIN ] MMU: Generated 138 derivative records from 16459 primary records. [2025-10-28T22:14:59.064090] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-28T22:14:59.064007] [DEBUG] [LOCAL ] MMS: Derivative data saved (138 records). [2025-10-28T22:14:59.064889] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-28T22:14:59.067517] [INFO ] [MAIN ] Derivative Progress: 1157/2046 symbols completed. MMS took 1.2s. Estimated remaining: 6m 0s. Rate: 148.1 symbols/min [2025-10-28T22:14:59.067998] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:59.081296] [DEBUG] [LOCAL ] MMU: Derivative data saved (138 records). [2025-10-28T22:14:59.081746] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-28T22:14:59.084439] [INFO ] [MAIN ] Derivative Progress: 1158/2046 symbols completed. MMU took 1.2s. Estimated remaining: 5m 59s. Rate: 148.2 symbols/min [2025-10-28T22:14:59.091814] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:14:59.094264] [DEBUG] [LOCAL ] MNR: Loaded 24820 existing records from primary storage. [2025-10-28T22:14:59.094677] [INFO ] [MAIN ] MNR: Loaded 24820 primary data records. [2025-10-28T22:14:59.423511] [DEBUG] [LOCAL ] MNSO: Loaded 43522 existing records from primary storage. [2025-10-28T22:14:59.423848] [INFO ] [MAIN ] MNSO: Loaded 43522 primary data records. [2025-10-28T22:14:59.544494] [DEBUG] [LOCAL ] MOD: Loaded 44234 existing records from primary storage. [2025-10-28T22:14:59.584346] [INFO ] [MAIN ] MOD: Loaded 44234 primary data records. [2025-10-28T22:15:00.059223] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:00.114598] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:00.142773] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:00.158931] [INFO ] [MAIN ] MNR: Generated 138 derivative records from 24820 primary records. [2025-10-28T22:15:00.160726] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-28T22:15:00.182472] [DEBUG] [LOCAL ] MNR: Derivative data saved (138 records). [2025-10-28T22:15:00.183262] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-28T22:15:00.189123] [INFO ] [MAIN ] Derivative Progress: 1159/2046 symbols completed. MNR took 1.2s. Estimated remaining: 5m 60s. Rate: 148.0 symbols/min [2025-10-28T22:15:00.189497] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:00.208846] [INFO ] [MAIN ] MNSO: Generated 138 derivative records from 43522 primary records. [2025-10-28T22:15:00.209868] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-28T22:15:00.212312] [INFO ] [MAIN ] MOD: Generated 138 derivative records from 44234 primary records. [2025-10-28T22:15:00.212838] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-28T22:15:00.249010] [DEBUG] [LOCAL ] MNSO: Derivative data saved (138 records). [2025-10-28T22:15:00.249100] [DEBUG] [LOCAL ] MOD: Derivative data saved (138 records). [2025-10-28T22:15:00.249278] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-28T22:15:00.249357] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-28T22:15:00.251175] [INFO ] [MAIN ] Derivative Progress: 1160/2046 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 59s. Rate: 148.1 symbols/min [2025-10-28T22:15:00.253740] [INFO ] [MAIN ] Derivative Progress: 1161/2046 symbols completed. MOD took 1.2s. Estimated remaining: 5m 58s. Rate: 148.3 symbols/min [2025-10-28T22:15:00.254487] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:00.253572] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:00.270812] [DEBUG] [LOCAL ] MODG: Loaded 51428 existing records from primary storage. [2025-10-28T22:15:00.271134] [INFO ] [MAIN ] MODG: Loaded 51428 primary data records. [2025-10-28T22:15:00.619275] [DEBUG] [LOCAL ] MOH: Loaded 43224 existing records from primary storage. [2025-10-28T22:15:00.619397] [INFO ] [MAIN ] MOH: Loaded 43224 primary data records. [2025-10-28T22:15:00.712960] [DEBUG] [LOCAL ] MOS: Loaded 53505 existing records from primary storage. [2025-10-28T22:15:00.737445] [INFO ] [MAIN ] MOS: Loaded 53505 primary data records. [2025-10-28T22:15:01.270973] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:01.322442] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:01.375036] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:01.395439] [INFO ] [MAIN ] MODG: Generated 138 derivative records from 51428 primary records. [2025-10-28T22:15:01.398247] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-28T22:15:01.418981] [DEBUG] [LOCAL ] MODG: Derivative data saved (138 records). [2025-10-28T22:15:01.419786] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-28T22:15:01.419528] [INFO ] [MAIN ] MOH: Generated 138 derivative records from 43224 primary records. [2025-10-28T22:15:01.423770] [INFO ] [MAIN ] Derivative Progress: 1162/2046 symbols completed. MODG took 1.2s. Estimated remaining: 5m 58s. Rate: 148.0 symbols/min [2025-10-28T22:15:01.423929] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:01.427184] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-28T22:15:01.445303] [DEBUG] [LOCAL ] MOH: Derivative data saved (138 records). [2025-10-28T22:15:01.445471] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-28T22:15:01.447348] [INFO ] [MAIN ] Derivative Progress: 1163/2046 symbols completed. MOH took 1.2s. Estimated remaining: 5m 58s. Rate: 148.1 symbols/min [2025-10-28T22:15:01.448792] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:01.460547] [INFO ] [MAIN ] MOS: Generated 138 derivative records from 53505 primary records. [2025-10-28T22:15:01.460769] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-28T22:15:01.473382] [DEBUG] [LOCAL ] MOS: Derivative data saved (138 records). [2025-10-28T22:15:01.480910] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-28T22:15:01.481406] [DEBUG] [LOCAL ] MOV: Loaded 20464 existing records from primary storage. [2025-10-28T22:15:01.484741] [INFO ] [MAIN ] MOV: Loaded 20464 primary data records. [2025-10-28T22:15:01.484563] [INFO ] [MAIN ] Derivative Progress: 1164/2046 symbols completed. MOS took 1.2s. Estimated remaining: 5m 57s. Rate: 148.3 symbols/min [2025-10-28T22:15:01.485160] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:01.618225] [DEBUG] [LOCAL ] MPA: Loaded 5049 existing records from primary storage. [2025-10-28T22:15:01.628749] [INFO ] [MAIN ] MPA: Loaded 5049 primary data records. [2025-10-28T22:15:01.942813] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-28T22:15:01.947460] [INFO ] [MAIN ] MP: Loaded 53744 primary data records. [2025-10-28T22:15:02.523068] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:02.570539] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:02.605090] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:02.625027] [INFO ] [MAIN ] MOV: Generated 138 derivative records from 20464 primary records. [2025-10-28T22:15:02.626825] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-28T22:15:02.647558] [DEBUG] [LOCAL ] MOV: Derivative data saved (138 records). [2025-10-28T22:15:02.650547] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-28T22:15:02.653096] [INFO ] [MAIN ] Derivative Progress: 1165/2046 symbols completed. MOV took 1.2s. Estimated remaining: 5m 57s. Rate: 148.0 symbols/min [2025-10-28T22:15:02.653470] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:02.665965] [INFO ] [MAIN ] MPA: Generated 138 derivative records from 5049 primary records. [2025-10-28T22:15:02.666623] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-28T22:15:02.682574] [DEBUG] [LOCAL ] MPA: Derivative data saved (138 records). [2025-10-28T22:15:02.687795] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-28T22:15:02.690358] [INFO ] [MAIN ] Derivative Progress: 1166/2046 symbols completed. MPA took 1.2s. Estimated remaining: 5m 56s. Rate: 148.1 symbols/min [2025-10-28T22:15:02.692363] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:02.694908] [INFO ] [MAIN ] MP: Generated 138 derivative records from 53744 primary records. [2025-10-28T22:15:02.695128] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-28T22:15:02.722519] [DEBUG] [LOCAL ] MP: Derivative data saved (138 records). [2025-10-28T22:15:02.722798] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-28T22:15:02.725572] [INFO ] [MAIN ] Derivative Progress: 1167/2046 symbols completed. MP took 1.3s. Estimated remaining: 5m 56s. Rate: 148.3 symbols/min [2025-10-28T22:15:02.725894] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:02.747440] [DEBUG] [LOCAL ] MPV: Loaded 4290 existing records from primary storage. [2025-10-28T22:15:02.747771] [INFO ] [MAIN ] MPV: Loaded 4290 primary data records. [2025-10-28T22:15:02.769679] [DEBUG] [LOCAL ] MPC: Loaded 51754 existing records from primary storage. [2025-10-28T22:15:02.769936] [INFO ] [MAIN ] MPC: Loaded 51754 primary data records. [2025-10-28T22:15:02.998808] [DEBUG] [LOCAL ] MPLX: Loaded 50719 existing records from primary storage. [2025-10-28T22:15:03.029699] [INFO ] [MAIN ] MPLX: Loaded 50719 primary data records. [2025-10-28T22:15:03.709768] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:03.743420] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:03.787838] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:03.823889] [INFO ] [MAIN ] MPV: Generated 138 derivative records from 4290 primary records. [2025-10-28T22:15:03.825117] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-28T22:15:03.842538] [DEBUG] [LOCAL ] MPV: Derivative data saved (138 records). [2025-10-28T22:15:03.842803] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-28T22:15:03.847418] [INFO ] [MAIN ] Derivative Progress: 1168/2046 symbols completed. MPV took 1.1s. Estimated remaining: 5m 56s. Rate: 148.0 symbols/min [2025-10-28T22:15:03.857267] [INFO ] [MAIN ] MPC: Generated 138 derivative records from 51754 primary records. [2025-10-28T22:15:03.857427] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-28T22:15:03.875365] [DEBUG] [LOCAL ] MPC: Derivative data saved (138 records). [2025-10-28T22:15:03.875486] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-28T22:15:03.879859] [INFO ] [MAIN ] Derivative Progress: 1169/2046 symbols completed. MPC took 1.2s. Estimated remaining: 5m 55s. Rate: 148.1 symbols/min [2025-10-28T22:15:03.880392] [INFO ] [MAIN ] MPLX: Generated 138 derivative records from 50719 primary records. [2025-10-28T22:15:03.880673] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-28T22:15:03.892089] [DEBUG] [LOCAL ] MPLX: Derivative data saved (138 records). [2025-10-28T22:15:03.892144] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-28T22:15:03.894386] [INFO ] [MAIN ] Derivative Progress: 1170/2046 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 55s. Rate: 148.3 symbols/min [2025-10-28T22:15:03.894826] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:03.894883] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:03.895064] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:03.907601] [DEBUG] [LOCAL ] MPX: Loaded 3722 existing records from primary storage. [2025-10-28T22:15:03.907445] [DEBUG] [LOCAL ] MQT: Loaded 7863 existing records from primary storage. [2025-10-28T22:15:03.907771] [INFO ] [MAIN ] MPX: Loaded 3722 primary data records. [2025-10-28T22:15:03.907854] [INFO ] [MAIN ] MQT: Loaded 7863 primary data records. [2025-10-28T22:15:04.574378] [DEBUG] [LOCAL ] MPW: Loaded 53479 existing records from primary storage. [2025-10-28T22:15:04.583480] [INFO ] [MAIN ] MPW: Loaded 53479 primary data records. [2025-10-28T22:15:04.951277] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:04.951829] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:05.031813] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:05.070111] [INFO ] [MAIN ] MQT: Generated 138 derivative records from 7863 primary records. [2025-10-28T22:15:05.070865] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-28T22:15:05.089155] [DEBUG] [LOCAL ] MQT: Derivative data saved (138 records). [2025-10-28T22:15:05.078400] [INFO ] [MAIN ] MPX: Generated 138 derivative records from 3722 primary records. [2025-10-28T22:15:05.090840] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-28T22:15:05.090767] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-28T22:15:05.093701] [INFO ] [MAIN ] Derivative Progress: 1171/2046 symbols completed. MQT took 1.2s. Estimated remaining: 5m 55s. Rate: 148.0 symbols/min [2025-10-28T22:15:05.094418] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:05.108917] [DEBUG] [LOCAL ] MPX: Derivative data saved (138 records). [2025-10-28T22:15:05.109667] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-28T22:15:05.112232] [INFO ] [MAIN ] Derivative Progress: 1172/2046 symbols completed. MPX took 1.2s. Estimated remaining: 5m 54s. Rate: 148.1 symbols/min [2025-10-28T22:15:05.112551] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:05.128785] [INFO ] [MAIN ] MPW: Generated 138 derivative records from 53479 primary records. [2025-10-28T22:15:05.129046] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-28T22:15:05.141873] [DEBUG] [LOCAL ] MPW: Derivative data saved (138 records). [2025-10-28T22:15:05.147879] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-28T22:15:05.150254] [INFO ] [MAIN ] Derivative Progress: 1173/2046 symbols completed. MPW took 1.3s. Estimated remaining: 5m 53s. Rate: 148.3 symbols/min [2025-10-28T22:15:05.151113] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:05.150982] [DEBUG] [LOCAL ] MQY: Loaded 16406 existing records from primary storage. [2025-10-28T22:15:05.151251] [INFO ] [MAIN ] MQY: Loaded 16406 primary data records. [2025-10-28T22:15:05.310884] [DEBUG] [LOCAL ] MRC: Loaded 36691 existing records from primary storage. [2025-10-28T22:15:05.354836] [INFO ] [MAIN ] MRC: Loaded 36691 primary data records. [2025-10-28T22:15:05.789977] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-28T22:15:05.803994] [INFO ] [MAIN ] MRK: Loaded 53790 primary data records. [2025-10-28T22:15:06.121306] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:06.167849] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:06.217976] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:06.233981] [INFO ] [MAIN ] MQY: Generated 138 derivative records from 16406 primary records. [2025-10-28T22:15:06.234864] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-28T22:15:06.258597] [DEBUG] [LOCAL ] MQY: Derivative data saved (138 records). [2025-10-28T22:15:06.259456] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-28T22:15:06.264552] [INFO ] [MAIN ] Derivative Progress: 1174/2046 symbols completed. MQY took 1.2s. Estimated remaining: 5m 53s. Rate: 148.0 symbols/min [2025-10-28T22:15:06.266841] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:06.275116] [INFO ] [MAIN ] MRC: Generated 138 derivative records from 36691 primary records. [2025-10-28T22:15:06.276699] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-28T22:15:06.292822] [DEBUG] [LOCAL ] MRC: Derivative data saved (138 records). [2025-10-28T22:15:06.293202] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-28T22:15:06.296109] [INFO ] [MAIN ] Derivative Progress: 1175/2046 symbols completed. MRC took 1.2s. Estimated remaining: 5m 53s. Rate: 148.1 symbols/min [2025-10-28T22:15:06.296417] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:06.304106] [INFO ] [MAIN ] MRK: Generated 138 derivative records from 53790 primary records. [2025-10-28T22:15:06.304450] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-10-28T22:15:06.317047] [DEBUG] [LOCAL ] MRK: Derivative data saved (138 records). [2025-10-28T22:15:06.317245] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-10-28T22:15:06.319581] [INFO ] [MAIN ] Derivative Progress: 1176/2046 symbols completed. MRK took 1.2s. Estimated remaining: 5m 52s. Rate: 148.3 symbols/min [2025-10-28T22:15:06.319882] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:06.346257] [DEBUG] [LOCAL ] MSB: Loaded 7927 existing records from primary storage. [2025-10-28T22:15:06.352793] [INFO ] [MAIN ] MSB: Loaded 7927 primary data records. [2025-10-28T22:15:06.364506] [DEBUG] [LOCAL ] MSA: Loaded 18566 existing records from primary storage. [2025-10-28T22:15:06.384427] [INFO ] [MAIN ] MSA: Loaded 18566 primary data records. [2025-10-28T22:15:06.520804] [DEBUG] [LOCAL ] MS: Loaded 53686 existing records from primary storage. [2025-10-28T22:15:06.559244] [INFO ] [MAIN ] MS: Loaded 53686 primary data records. [2025-10-28T22:15:07.340928] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:07.339484] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:07.384877] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:07.456405] [INFO ] [MAIN ] MSA: Generated 138 derivative records from 18566 primary records. [2025-10-28T22:15:07.459066] [INFO ] [MAIN ] MSB: Generated 138 derivative records from 7927 primary records. [2025-10-28T22:15:07.460495] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-28T22:15:07.460392] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-28T22:15:07.463438] [INFO ] [MAIN ] MS: Generated 138 derivative records from 53686 primary records. [2025-10-28T22:15:07.463805] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-28T22:15:07.484746] [DEBUG] [LOCAL ] MSA: Derivative data saved (138 records). [2025-10-28T22:15:07.487628] [DEBUG] [LOCAL ] MSB: Derivative data saved (138 records). [2025-10-28T22:15:07.494908] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-28T22:15:07.496536] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-28T22:15:07.498848] [INFO ] [MAIN ] Derivative Progress: 1177/2046 symbols completed. MSB took 1.2s. Estimated remaining: 5m 52s. Rate: 148.0 symbols/min [2025-10-28T22:15:07.504466] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:07.504578] [INFO ] [MAIN ] Derivative Progress: 1178/2046 symbols completed. MSA took 1.2s. Estimated remaining: 5m 52s. Rate: 148.1 symbols/min [2025-10-28T22:15:07.504333] [DEBUG] [LOCAL ] MS: Derivative data saved (138 records). [2025-10-28T22:15:07.505212] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-10-28T22:15:07.508175] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:07.508786] [INFO ] [MAIN ] Derivative Progress: 1179/2046 symbols completed. MS took 1.2s. Estimated remaining: 5m 51s. Rate: 148.3 symbols/min [2025-10-28T22:15:07.508962] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:07.524558] [DEBUG] [LOCAL ] MSD: Loaded 16600 existing records from primary storage. [2025-10-28T22:15:07.524816] [INFO ] [MAIN ] MSD: Loaded 16600 primary data records. [2025-10-28T22:15:07.668936] [DEBUG] [LOCAL ] MSCI: Loaded 33812 existing records from primary storage. [2025-10-28T22:15:07.690935] [INFO ] [MAIN ] MSCI: Loaded 33812 primary data records. [2025-10-28T22:15:07.680525] [DEBUG] [LOCAL ] MSDL: Loaded 38502 existing records from primary storage. [2025-10-28T22:15:07.738701] [INFO ] [MAIN ] MSDL: Loaded 38502 primary data records. [2025-10-28T22:15:08.522595] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:08.563122] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:08.592450] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:08.627257] [INFO ] [MAIN ] MSD: Generated 138 derivative records from 16600 primary records. [2025-10-28T22:15:08.628498] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-28T22:15:08.650075] [DEBUG] [LOCAL ] MSD: Derivative data saved (138 records). [2025-10-28T22:15:08.650791] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-28T22:15:08.655305] [INFO ] [MAIN ] Derivative Progress: 1180/2046 symbols completed. MSD took 1.1s. Estimated remaining: 5m 51s. Rate: 148.0 symbols/min [2025-10-28T22:15:08.655503] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:08.662987] [INFO ] [MAIN ] MSCI: Generated 138 derivative records from 33812 primary records. [2025-10-28T22:15:08.664350] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-28T22:15:08.667255] [INFO ] [MAIN ] MSDL: Generated 138 derivative records from 38502 primary records. [2025-10-28T22:15:08.667388] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-28T22:15:08.687826] [DEBUG] [LOCAL ] MSCI: Derivative data saved (138 records). [2025-10-28T22:15:08.690461] [DEBUG] [LOCAL ] MSDL: Derivative data saved (138 records). [2025-10-28T22:15:08.690586] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-28T22:15:08.690762] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-28T22:15:08.693106] [INFO ] [MAIN ] Derivative Progress: 1181/2046 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 50s. Rate: 148.2 symbols/min [2025-10-28T22:15:08.695633] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:08.695832] [INFO ] [MAIN ] Derivative Progress: 1182/2046 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 50s. Rate: 148.3 symbols/min [2025-10-28T22:15:08.704063] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:08.720399] [DEBUG] [LOCAL ] MSGE: Loaded 26626 existing records from primary storage. [2025-10-28T22:15:08.720701] [INFO ] [MAIN ] MSGE: Loaded 26626 primary data records. [2025-10-28T22:15:08.820311] [DEBUG] [LOCAL ] MSGS: Loaded 17118 existing records from primary storage. [2025-10-28T22:15:08.831750] [INFO ] [MAIN ] MSGS: Loaded 17118 primary data records. [2025-10-28T22:15:09.009388] [DEBUG] [LOCAL ] MSI: Loaded 39253 existing records from primary storage. [2025-10-28T22:15:09.027234] [INFO ] [MAIN ] MSI: Loaded 39253 primary data records. [2025-10-28T22:15:09.663777] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:09.704599] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:09.731781] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:09.772257] [INFO ] [MAIN ] MSGE: Generated 138 derivative records from 26626 primary records. [2025-10-28T22:15:09.775807] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-28T22:15:09.792153] [DEBUG] [LOCAL ] MSGE: Derivative data saved (138 records). [2025-10-28T22:15:09.792620] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-28T22:15:09.797431] [INFO ] [MAIN ] Derivative Progress: 1183/2046 symbols completed. MSGE took 1.1s. Estimated remaining: 5m 50s. Rate: 148.1 symbols/min [2025-10-28T22:15:09.804925] [INFO ] [MAIN ] MSGS: Generated 138 derivative records from 17118 primary records. [2025-10-28T22:15:09.806736] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-28T22:15:09.806636] [INFO ] [MAIN ] MSI: Generated 138 derivative records from 39253 primary records. [2025-10-28T22:15:09.806820] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-28T22:15:09.829706] [DEBUG] [LOCAL ] MSI: Derivative data saved (138 records). [2025-10-28T22:15:09.830252] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-28T22:15:09.833251] [INFO ] [MAIN ] Derivative Progress: 1184/2046 symbols completed. MSI took 1.1s. Estimated remaining: 5m 49s. Rate: 148.2 symbols/min [2025-10-28T22:15:09.830880] [DEBUG] [LOCAL ] MSGS: Derivative data saved (138 records). [2025-10-28T22:15:09.833480] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-28T22:15:09.835899] [INFO ] [MAIN ] Derivative Progress: 1185/2046 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 48s. Rate: 148.3 symbols/min [2025-10-28T22:15:09.836386] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:09.836255] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:09.836324] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:09.888558] [DEBUG] [LOCAL ] MSM: Loaded 35302 existing records from primary storage. [2025-10-28T22:15:09.889246] [INFO ] [MAIN ] MSM: Loaded 35302 primary data records. [2025-10-28T22:15:10.016177] [DEBUG] [LOCAL ] MTB: Loaded 46497 existing records from primary storage. [2025-10-28T22:15:10.008223] [DEBUG] [LOCAL ] MT: Loaded 50241 existing records from primary storage. [2025-10-28T22:15:10.019507] [INFO ] [MAIN ] MT: Loaded 50241 primary data records. [2025-10-28T22:15:10.019678] [INFO ] [MAIN ] MTB: Loaded 46497 primary data records. [2025-10-28T22:15:10.897620] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:10.927125] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:10.970125] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:15:11.017612] [INFO ] [MAIN ] MSM: Generated 138 derivative records from 35302 primary records. [2025-10-28T22:15:11.023626] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-28T22:15:11.029712] [INFO ] [MAIN ] MT: Generated 138 derivative records from 50241 primary records. [2025-10-28T22:15:11.030051] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-28T22:15:11.041935] [DEBUG] [LOCAL ] MSM: Derivative data saved (138 records). [2025-10-28T22:15:11.049228] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-28T22:15:11.054613] [INFO ] [MAIN ] Derivative Progress: 1186/2046 symbols completed. MSM took 1.2s. Estimated remaining: 5m 49s. Rate: 148.1 symbols/min [2025-10-28T22:15:11.057545] [DEBUG] [LOCAL ] MT: Derivative data saved (138 records). [2025-10-28T22:15:11.058185] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-28T22:15:11.060965] [INFO ] [MAIN ] Derivative Progress: 1187/2046 symbols completed. MT took 1.2s. Estimated remaining: 5m 48s. Rate: 148.2 symbols/min [2025-10-28T22:15:11.058363] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:11.061093] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:11.066748] [INFO ] [MAIN ] MTB: Generated 138 derivative records from 46497 primary records. [2025-10-28T22:15:11.066966] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-28T22:15:11.083311] [DEBUG] [LOCAL ] MTB: Derivative data saved (138 records). [2025-10-28T22:15:11.083453] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-28T22:15:11.085841] [INFO ] [MAIN ] Derivative Progress: 1188/2046 symbols completed. MTB took 1.2s. Estimated remaining: 5m 47s. Rate: 148.3 symbols/min [2025-10-28T22:15:11.086312] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:11.093586] [DEBUG] [LOCAL ] MTD: Loaded 14642 existing records from primary storage. [2025-10-28T22:15:11.093756] [INFO ] [MAIN ] MTD: Loaded 14642 primary data records. [2025-10-28T22:15:11.424634] [DEBUG] [LOCAL ] MTDR: Loaded 51734 existing records from primary storage. [2025-10-28T22:15:11.425428] [INFO ] [MAIN ] MTDR: Loaded 51734 primary data records. [2025-10-28T22:15:11.545417] [DEBUG] [LOCAL ] MTG: Loaded 50971 existing records from primary storage. [2025-10-28T22:15:11.551931] [INFO ] [MAIN ] MTG: Loaded 50971 primary data records. [2025-10-28T22:15:12.058392] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:12.104585] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:12.139856] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:12.153003] [INFO ] [MAIN ] MTD: Generated 138 derivative records from 14642 primary records. [2025-10-28T22:15:12.158549] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-28T22:15:12.182066] [DEBUG] [LOCAL ] MTD: Derivative data saved (138 records). [2025-10-28T22:15:12.182813] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-28T22:15:12.190313] [INFO ] [MAIN ] Derivative Progress: 1189/2046 symbols completed. MTD took 1.1s. Estimated remaining: 5m 47s. Rate: 148.1 symbols/min [2025-10-28T22:15:12.198343] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:12.208087] [INFO ] [MAIN ] MTDR: Generated 138 derivative records from 51734 primary records. [2025-10-28T22:15:12.209422] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-28T22:15:12.226426] [DEBUG] [LOCAL ] MTDR: Derivative data saved (138 records). [2025-10-28T22:15:12.229194] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-28T22:15:12.229118] [INFO ] [MAIN ] MTG: Generated 138 derivative records from 50971 primary records. [2025-10-28T22:15:12.229319] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-28T22:15:12.231628] [INFO ] [MAIN ] Derivative Progress: 1190/2046 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 47s. Rate: 148.2 symbols/min [2025-10-28T22:15:12.232114] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:12.244682] [DEBUG] [LOCAL ] MTG: Derivative data saved (138 records). [2025-10-28T22:15:12.254278] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-28T22:15:12.257720] [INFO ] [MAIN ] Derivative Progress: 1191/2046 symbols completed. MTG took 1.2s. Estimated remaining: 5m 46s. Rate: 148.3 symbols/min [2025-10-28T22:15:12.258047] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:12.279201] [DEBUG] [LOCAL ] MTH: Loaded 43638 existing records from primary storage. [2025-10-28T22:15:12.279448] [INFO ] [MAIN ] MTH: Loaded 43638 primary data records. [2025-10-28T22:15:12.349369] [DEBUG] [LOCAL ] MTRN: Loaded 17922 existing records from primary storage. [2025-10-28T22:15:12.376636] [INFO ] [MAIN ] MTRN: Loaded 17922 primary data records. [2025-10-28T22:15:12.451327] [DEBUG] [LOCAL ] MTN: Loaded 38993 existing records from primary storage. [2025-10-28T22:15:12.545804] [INFO ] [MAIN ] MTN: Loaded 38993 primary data records. [2025-10-28T22:15:13.252482] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:13.288525] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:13.318908] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:13.378791] [INFO ] [MAIN ] MTH: Generated 138 derivative records from 43638 primary records. [2025-10-28T22:15:13.383146] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-28T22:15:13.399742] [DEBUG] [LOCAL ] MTH: Derivative data saved (138 records). [2025-10-28T22:15:13.399982] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-28T22:15:13.402173] [INFO ] [MAIN ] Derivative Progress: 1192/2046 symbols completed. MTH took 1.2s. Estimated remaining: 5m 46s. Rate: 148.1 symbols/min [2025-10-28T22:15:13.405262] [INFO ] [MAIN ] MTRN: Generated 138 derivative records from 17922 primary records. [2025-10-28T22:15:13.407750] [INFO ] [MAIN ] MTN: Generated 138 derivative records from 38993 primary records. [2025-10-28T22:15:13.407388] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-28T22:15:13.407080] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:13.407964] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-28T22:15:13.428838] [DEBUG] [LOCAL ] MTRN: Derivative data saved (138 records). [2025-10-28T22:15:13.433728] [DEBUG] [LOCAL ] MTN: Derivative data saved (138 records). [2025-10-28T22:15:13.432592] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-28T22:15:13.436623] [INFO ] [MAIN ] Derivative Progress: 1193/2046 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 45s. Rate: 148.2 symbols/min [2025-10-28T22:15:13.433959] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-28T22:15:13.436931] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:13.440096] [INFO ] [MAIN ] Derivative Progress: 1194/2046 symbols completed. MTN took 1.2s. Estimated remaining: 5m 45s. Rate: 148.3 symbols/min [2025-10-28T22:15:13.448137] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:13.467681] [DEBUG] [LOCAL ] MTUS: Loaded 26927 existing records from primary storage. [2025-10-28T22:15:13.473817] [INFO ] [MAIN ] MTUS: Loaded 26927 primary data records. [2025-10-28T22:15:13.581812] [DEBUG] [LOCAL ] MTW: Loaded 26085 existing records from primary storage. [2025-10-28T22:15:13.583088] [DEBUG] [LOCAL ] MTX: Loaded 22204 existing records from primary storage. [2025-10-28T22:15:13.583347] [INFO ] [MAIN ] MTX: Loaded 22204 primary data records. [2025-10-28T22:15:13.583265] [INFO ] [MAIN ] MTW: Loaded 26085 primary data records. [2025-10-28T22:15:14.450051] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:14.497795] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:14.503953] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:14.580796] [INFO ] [MAIN ] MTUS: Generated 138 derivative records from 26927 primary records. [2025-10-28T22:15:14.587094] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-28T22:15:14.604819] [DEBUG] [LOCAL ] MTUS: Derivative data saved (138 records). [2025-10-28T22:15:14.610958] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-28T22:15:14.610852] [INFO ] [MAIN ] MTW: Generated 138 derivative records from 26085 primary records. [2025-10-28T22:15:14.613515] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-28T22:15:14.613178] [INFO ] [MAIN ] Derivative Progress: 1195/2046 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 45s. Rate: 148.1 symbols/min [2025-10-28T22:15:14.625838] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:14.629347] [DEBUG] [LOCAL ] MTW: Derivative data saved (138 records). [2025-10-28T22:15:14.629541] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-28T22:15:14.634063] [INFO ] [MAIN ] Derivative Progress: 1196/2046 symbols completed. MTW took 1.2s. Estimated remaining: 5m 44s. Rate: 148.2 symbols/min [2025-10-28T22:15:14.634533] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:14.634295] [INFO ] [MAIN ] MTX: Generated 138 derivative records from 22204 primary records. [2025-10-28T22:15:14.635217] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-28T22:15:14.654228] [DEBUG] [LOCAL ] MTX: Derivative data saved (138 records). [2025-10-28T22:15:14.654468] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-28T22:15:14.657415] [INFO ] [MAIN ] Derivative Progress: 1197/2046 symbols completed. MTX took 1.2s. Estimated remaining: 5m 43s. Rate: 148.3 symbols/min [2025-10-28T22:15:14.657600] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:14.663900] [DEBUG] [LOCAL ] MUA: Loaded 11526 existing records from primary storage. [2025-10-28T22:15:14.664081] [INFO ] [MAIN ] MUA: Loaded 11526 primary data records. [2025-10-28T22:15:14.876354] [DEBUG] [LOCAL ] MUC: Loaded 20351 existing records from primary storage. [2025-10-28T22:15:14.876468] [DEBUG] [LOCAL ] MTZ: Loaded 42486 existing records from primary storage. [2025-10-28T22:15:14.892835] [INFO ] [MAIN ] MUC: Loaded 20351 primary data records. [2025-10-28T22:15:14.897989] [INFO ] [MAIN ] MTZ: Loaded 42486 primary data records. [2025-10-28T22:15:15.638016] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:15.680960] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:15.724285] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:15.748073] [INFO ] [MAIN ] MUA: Generated 138 derivative records from 11526 primary records. [2025-10-28T22:15:15.748764] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-28T22:15:15.771848] [DEBUG] [LOCAL ] MUA: Derivative data saved (138 records). [2025-10-28T22:15:15.773308] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-28T22:15:15.776083] [INFO ] [MAIN ] Derivative Progress: 1198/2046 symbols completed. MUA took 1.1s. Estimated remaining: 5m 44s. Rate: 148.1 symbols/min [2025-10-28T22:15:15.779660] [INFO ] [MAIN ] MTZ: Generated 138 derivative records from 42486 primary records. [2025-10-28T22:15:15.781840] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-28T22:15:15.797714] [DEBUG] [LOCAL ] MTZ: Derivative data saved (138 records). [2025-10-28T22:15:15.798858] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-28T22:15:15.801524] [INFO ] [MAIN ] Derivative Progress: 1199/2046 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 43s. Rate: 148.2 symbols/min [2025-10-28T22:15:15.807613] [INFO ] [MAIN ] MUC: Generated 138 derivative records from 20351 primary records. [2025-10-28T22:15:15.807714] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-28T22:15:15.820375] [DEBUG] [LOCAL ] MUC: Derivative data saved (138 records). [2025-10-28T22:15:15.820446] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-28T22:15:15.822908] [INFO ] [MAIN ] Derivative Progress: 1200/2046 symbols completed. MUC took 1.2s. Estimated remaining: 5m 42s. Rate: 148.3 symbols/min [2025-10-28T22:15:15.823310] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:15.823639] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:15.823796] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:15.836864] [DEBUG] [LOCAL ] MUE: Loaded 11984 existing records from primary storage. [2025-10-28T22:15:15.837085] [INFO ] [MAIN ] MUE: Loaded 11984 primary data records. [2025-10-28T22:15:15.910999] [DEBUG] [LOCAL ] MUJ: Loaded 13697 existing records from primary storage. [2025-10-28T22:15:15.945796] [INFO ] [MAIN ] MUJ: Loaded 13697 primary data records. [2025-10-28T22:15:16.179561] [DEBUG] [LOCAL ] MUFG: Loaded 52371 existing records from primary storage. [2025-10-28T22:15:16.190541] [INFO ] [MAIN ] MUFG: Loaded 52371 primary data records. [2025-10-28T22:15:16.867829] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:16.894858] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:16.945256] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:16.986860] [INFO ] [MAIN ] MUE: Generated 138 derivative records from 11984 primary records. [2025-10-28T22:15:16.989857] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-28T22:15:16.994015] [INFO ] [MAIN ] MUJ: Generated 138 derivative records from 13697 primary records. [2025-10-28T22:15:17.008224] [DEBUG] [LOCAL ] MUE: Derivative data saved (138 records). [2025-10-28T22:15:17.008353] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-28T22:15:17.010899] [INFO ] [MAIN ] Derivative Progress: 1201/2046 symbols completed. MUE took 1.2s. Estimated remaining: 5m 42s. Rate: 148.1 symbols/min [2025-10-28T22:15:17.011077] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-28T22:15:17.020736] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:17.030321] [DEBUG] [LOCAL ] MUJ: Derivative data saved (138 records). [2025-10-28T22:15:17.030618] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-28T22:15:17.033557] [INFO ] [MAIN ] Derivative Progress: 1202/2046 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 42s. Rate: 148.2 symbols/min [2025-10-28T22:15:17.034132] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:17.043797] [INFO ] [MAIN ] MUFG: Generated 138 derivative records from 52371 primary records. [2025-10-28T22:15:17.044033] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-28T22:15:17.057406] [DEBUG] [LOCAL ] MUFG: Derivative data saved (138 records). [2025-10-28T22:15:17.057519] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-28T22:15:17.060173] [INFO ] [MAIN ] Derivative Progress: 1203/2046 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 41s. Rate: 148.3 symbols/min [2025-10-28T22:15:17.066171] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:17.092530] [DEBUG] [LOCAL ] MUSA: Loaded 24532 existing records from primary storage. [2025-10-28T22:15:17.107185] [INFO ] [MAIN ] MUSA: Loaded 24532 primary data records. [2025-10-28T22:15:17.120491] [DEBUG] [LOCAL ] MUR: Loaded 52788 existing records from primary storage. [2025-10-28T22:15:17.146342] [INFO ] [MAIN ] MUR: Loaded 52788 primary data records. [2025-10-28T22:15:17.475163] [DEBUG] [LOCAL ] MUX: Loaded 43942 existing records from primary storage. [2025-10-28T22:15:17.615623] [INFO ] [MAIN ] MUX: Loaded 43942 primary data records. [2025-10-28T22:15:18.061400] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:18.096961] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:18.139348] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:18.191375] [INFO ] [MAIN ] MUR: Generated 138 derivative records from 52788 primary records. [2025-10-28T22:15:18.191153] [INFO ] [MAIN ] MUSA: Generated 138 derivative records from 24532 primary records. [2025-10-28T22:15:18.192725] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-28T22:15:18.192890] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-28T22:15:18.208866] [DEBUG] [LOCAL ] MUSA: Derivative data saved (138 records). [2025-10-28T22:15:18.209188] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-28T22:15:18.224094] [DEBUG] [LOCAL ] MUR: Derivative data saved (138 records). [2025-10-28T22:15:18.222386] [INFO ] [MAIN ] Derivative Progress: 1204/2046 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 41s. Rate: 148.1 symbols/min [2025-10-28T22:15:18.224504] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:18.224318] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-28T22:15:18.227280] [INFO ] [MAIN ] Derivative Progress: 1205/2046 symbols completed. MUR took 1.2s. Estimated remaining: 5m 40s. Rate: 148.2 symbols/min [2025-10-28T22:15:18.227706] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:18.239586] [INFO ] [MAIN ] MUX: Generated 138 derivative records from 43942 primary records. [2025-10-28T22:15:18.239832] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-28T22:15:18.257467] [DEBUG] [LOCAL ] MVO: Loaded 8915 existing records from primary storage. [2025-10-28T22:15:18.259884] [DEBUG] [LOCAL ] MUX: Derivative data saved (138 records). [2025-10-28T22:15:18.260127] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-28T22:15:18.260450] [INFO ] [MAIN ] MVO: Loaded 8915 primary data records. [2025-10-28T22:15:18.262961] [INFO ] [MAIN ] Derivative Progress: 1206/2046 symbols completed. MUX took 1.2s. Estimated remaining: 5m 40s. Rate: 148.3 symbols/min [2025-10-28T22:15:18.260385] [DEBUG] [LOCAL ] MVF: Loaded 12493 existing records from primary storage. [2025-10-28T22:15:18.274358] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:18.274581] [INFO ] [MAIN ] MVF: Loaded 12493 primary data records. [2025-10-28T22:15:18.476349] [DEBUG] [LOCAL ] MVT: Loaded 9490 existing records from primary storage. [2025-10-28T22:15:18.476796] [INFO ] [MAIN ] MVT: Loaded 9490 primary data records. [2025-10-28T22:15:19.245003] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:19.245498] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:19.293077] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:19.356199] [INFO ] [MAIN ] MVO: Generated 138 derivative records from 8915 primary records. [2025-10-28T22:15:19.361942] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-28T22:15:19.379726] [INFO ] [MAIN ] MVT: Generated 138 derivative records from 9490 primary records. [2025-10-28T22:15:19.382210] [INFO ] [MAIN ] MVF: Generated 138 derivative records from 12493 primary records. [2025-10-28T22:15:19.382340] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-28T22:15:19.379399] [DEBUG] [LOCAL ] MVO: Derivative data saved (138 records). [2025-10-28T22:15:19.382035] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-28T22:15:19.382527] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-28T22:15:19.385482] [INFO ] [MAIN ] Derivative Progress: 1207/2046 symbols completed. MVO took 1.2s. Estimated remaining: 5m 40s. Rate: 148.1 symbols/min [2025-10-28T22:15:19.386690] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:19.411279] [DEBUG] [LOCAL ] MVT: Derivative data saved (138 records). [2025-10-28T22:15:19.413098] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-28T22:15:19.415739] [INFO ] [MAIN ] Derivative Progress: 1208/2046 symbols completed. MVT took 1.1s. Estimated remaining: 5m 39s. Rate: 148.2 symbols/min [2025-10-28T22:15:19.417895] [DEBUG] [LOCAL ] MVF: Derivative data saved (138 records). [2025-10-28T22:15:19.415906] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:19.418090] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-28T22:15:19.421314] [INFO ] [MAIN ] Derivative Progress: 1209/2046 symbols completed. MVF took 1.2s. Estimated remaining: 5m 39s. Rate: 148.3 symbols/min [2025-10-28T22:15:19.421632] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:19.430216] [DEBUG] [LOCAL ] MXF: Loaded 5436 existing records from primary storage. [2025-10-28T22:15:19.435424] [INFO ] [MAIN ] MXF: Loaded 5436 primary data records. [2025-10-28T22:15:19.550233] [DEBUG] [LOCAL ] MX: Loaded 22003 existing records from primary storage. [2025-10-28T22:15:19.559917] [INFO ] [MAIN ] MX: Loaded 22003 primary data records. [2025-10-28T22:15:19.721995] [DEBUG] [LOCAL ] MWA: Loaded 45451 existing records from primary storage. [2025-10-28T22:15:19.722093] [INFO ] [MAIN ] MWA: Loaded 45451 primary data records. [2025-10-28T22:15:20.376176] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:20.416058] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:20.451865] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:20.494575] [INFO ] [MAIN ] MXF: Generated 138 derivative records from 5436 primary records. [2025-10-28T22:15:20.496732] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-28T22:15:20.513060] [DEBUG] [LOCAL ] MXF: Derivative data saved (138 records). [2025-10-28T22:15:20.513788] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-28T22:15:20.519059] [INFO ] [MAIN ] Derivative Progress: 1210/2046 symbols completed. MXF took 1.1s. Estimated remaining: 5m 39s. Rate: 148.1 symbols/min [2025-10-28T22:15:20.522461] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:20.541453] [INFO ] [MAIN ] MWA: Generated 138 derivative records from 45451 primary records. [2025-10-28T22:15:20.543301] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-28T22:15:20.551449] [INFO ] [MAIN ] MX: Generated 138 derivative records from 22003 primary records. [2025-10-28T22:15:20.564955] [DEBUG] [LOCAL ] MYD: Loaded 13012 existing records from primary storage. [2025-10-28T22:15:20.561990] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-28T22:15:20.565626] [DEBUG] [LOCAL ] MWA: Derivative data saved (138 records). [2025-10-28T22:15:20.565569] [INFO ] [MAIN ] MYD: Loaded 13012 primary data records. [2025-10-28T22:15:20.565964] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-28T22:15:20.575530] [INFO ] [MAIN ] Derivative Progress: 1211/2046 symbols completed. MWA took 1.2s. Estimated remaining: 5m 38s. Rate: 148.2 symbols/min [2025-10-28T22:15:20.575690] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:20.591399] [DEBUG] [LOCAL ] MX: Derivative data saved (138 records). [2025-10-28T22:15:20.610891] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-28T22:15:20.625964] [INFO ] [MAIN ] Derivative Progress: 1212/2046 symbols completed. MX took 1.2s. Estimated remaining: 5m 37s. Rate: 148.3 symbols/min [2025-10-28T22:15:20.626272] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:20.766055] [DEBUG] [LOCAL ] MYE: Loaded 23673 existing records from primary storage. [2025-10-28T22:15:20.765432] [DEBUG] [LOCAL ] MYI: Loaded 19012 existing records from primary storage. [2025-10-28T22:15:20.917909] [INFO ] [MAIN ] MYE: Loaded 23673 primary data records. [2025-10-28T22:15:20.926037] [INFO ] [MAIN ] MYI: Loaded 19012 primary data records. [2025-10-28T22:15:21.527730] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:21.576870] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:21.604454] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:21.625755] [INFO ] [MAIN ] MYD: Generated 138 derivative records from 13012 primary records. [2025-10-28T22:15:21.626375] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-28T22:15:21.643530] [DEBUG] [LOCAL ] MYD: Derivative data saved (138 records). [2025-10-28T22:15:21.645165] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-28T22:15:21.648918] [INFO ] [MAIN ] Derivative Progress: 1213/2046 symbols completed. MYD took 1.1s. Estimated remaining: 5m 37s. Rate: 148.2 symbols/min [2025-10-28T22:15:21.673113] [INFO ] [MAIN ] MYI: Generated 138 derivative records from 19012 primary records. [2025-10-28T22:15:21.674572] [INFO ] [MAIN ] MYE: Generated 138 derivative records from 23673 primary records. [2025-10-28T22:15:21.674732] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-28T22:15:21.674808] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-28T22:15:21.698207] [DEBUG] [LOCAL ] MYE: Derivative data saved (138 records). [2025-10-28T22:15:21.698158] [DEBUG] [LOCAL ] MYI: Derivative data saved (138 records). [2025-10-28T22:15:21.698301] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-28T22:15:21.700917] [INFO ] [MAIN ] Derivative Progress: 1214/2046 symbols completed. MYI took 1.1s. Estimated remaining: 5m 37s. Rate: 148.3 symbols/min [2025-10-28T22:15:21.701124] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-28T22:15:21.703712] [INFO ] [MAIN ] Derivative Progress: 1215/2046 symbols completed. MYE took 1.1s. Estimated remaining: 5m 36s. Rate: 148.4 symbols/min [2025-10-28T22:15:21.704029] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:21.704122] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:21.704485] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:21.714579] [DEBUG] [LOCAL ] MYN: Loaded 9831 existing records from primary storage. [2025-10-28T22:15:21.714863] [INFO ] [MAIN ] MYN: Loaded 9831 primary data records. [2025-10-28T22:15:21.850932] [DEBUG] [LOCAL ] NAC: Loaded 24219 existing records from primary storage. [2025-10-28T22:15:21.879234] [INFO ] [MAIN ] NAC: Loaded 24219 primary data records. [2025-10-28T22:15:22.144740] [DEBUG] [LOCAL ] NABL: Loaded 38426 existing records from primary storage. [2025-10-28T22:15:22.156244] [INFO ] [MAIN ] NABL: Loaded 38426 primary data records. [2025-10-28T22:15:22.702052] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:22.738040] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:22.780740] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:22.827928] [INFO ] [MAIN ] MYN: Generated 138 derivative records from 9831 primary records. [2025-10-28T22:15:22.831748] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-28T22:15:22.855786] [INFO ] [MAIN ] NAC: Generated 138 derivative records from 24219 primary records. [2025-10-28T22:15:22.852785] [DEBUG] [LOCAL ] MYN: Derivative data saved (138 records). [2025-10-28T22:15:22.856260] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-28T22:15:22.857584] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-28T22:15:22.861226] [INFO ] [MAIN ] Derivative Progress: 1216/2046 symbols completed. MYN took 1.2s. Estimated remaining: 5m 36s. Rate: 148.2 symbols/min [2025-10-28T22:15:22.861867] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:22.873533] [INFO ] [MAIN ] NABL: Generated 138 derivative records from 38426 primary records. [2025-10-28T22:15:22.876577] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-28T22:15:22.876504] [DEBUG] [LOCAL ] NAC: Derivative data saved (138 records). [2025-10-28T22:15:22.877381] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-28T22:15:22.879623] [INFO ] [MAIN ] Derivative Progress: 1217/2046 symbols completed. NAC took 1.2s. Estimated remaining: 5m 35s. Rate: 148.3 symbols/min [2025-10-28T22:15:22.879776] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:22.892918] [DEBUG] [LOCAL ] NABL: Derivative data saved (138 records). [2025-10-28T22:15:22.893238] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-28T22:15:22.896169] [INFO ] [MAIN ] Derivative Progress: 1218/2046 symbols completed. NABL took 1.2s. Estimated remaining: 5m 35s. Rate: 148.4 symbols/min [2025-10-28T22:15:22.898279] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:22.904835] [DEBUG] [LOCAL ] NAN: Loaded 8250 existing records from primary storage. [2025-10-28T22:15:22.905078] [INFO ] [MAIN ] NAN: Loaded 8250 primary data records. [2025-10-28T22:15:23.084564] [DEBUG] [LOCAL ] NAD: Loaded 32946 existing records from primary storage. [2025-10-28T22:15:23.106819] [INFO ] [MAIN ] NAD: Loaded 32946 primary data records. [2025-10-28T22:15:23.332893] [DEBUG] [LOCAL ] NAT: Loaded 49164 existing records from primary storage. [2025-10-28T22:15:23.343930] [INFO ] [MAIN ] NAT: Loaded 49164 primary data records. [2025-10-28T22:15:23.879017] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:23.904892] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:23.945619] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:24.005589] [INFO ] [MAIN ] NAN: Generated 138 derivative records from 8250 primary records. [2025-10-28T22:15:24.005999] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-28T22:15:24.008863] [INFO ] [MAIN ] NAD: Generated 138 derivative records from 32946 primary records. [2025-10-28T22:15:24.019985] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-28T22:15:24.022505] [DEBUG] [LOCAL ] NAN: Derivative data saved (138 records). [2025-10-28T22:15:24.023485] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-28T22:15:24.026793] [INFO ] [MAIN ] Derivative Progress: 1219/2046 symbols completed. NAN took 1.1s. Estimated remaining: 5m 35s. Rate: 148.2 symbols/min [2025-10-28T22:15:24.039603] [DEBUG] [LOCAL ] NAD: Derivative data saved (138 records). [2025-10-28T22:15:24.039736] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:24.040013] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-28T22:15:24.042391] [INFO ] [MAIN ] Derivative Progress: 1220/2046 symbols completed. NAD took 1.2s. Estimated remaining: 5m 34s. Rate: 148.3 symbols/min [2025-10-28T22:15:24.044999] [INFO ] [MAIN ] NAT: Generated 138 derivative records from 49164 primary records. [2025-10-28T22:15:24.045191] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-28T22:15:24.045279] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:24.058595] [DEBUG] [LOCAL ] NAT: Derivative data saved (138 records). [2025-10-28T22:15:24.058819] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-28T22:15:24.063958] [DEBUG] [LOCAL ] NAZ: Loaded 2627 existing records from primary storage. [2025-10-28T22:15:24.061390] [INFO ] [MAIN ] Derivative Progress: 1221/2046 symbols completed. NAT took 1.2s. Estimated remaining: 5m 34s. Rate: 148.4 symbols/min [2025-10-28T22:15:24.064094] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:24.064201] [INFO ] [MAIN ] NAZ: Loaded 2627 primary data records. [2025-10-28T22:15:24.183381] [DEBUG] [LOCAL ] NBB: Loaded 8885 existing records from primary storage. [2025-10-28T22:15:24.202636] [INFO ] [MAIN ] NBB: Loaded 8885 primary data records. [2025-10-28T22:15:24.424886] [DEBUG] [LOCAL ] NATL: Loaded 31569 existing records from primary storage. [2025-10-28T22:15:24.474732] [INFO ] [MAIN ] NATL: Loaded 31569 primary data records. [2025-10-28T22:15:25.077970] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:25.118733] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:25.152091] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:25.195186] [INFO ] [MAIN ] NAZ: Generated 138 derivative records from 2627 primary records. [2025-10-28T22:15:25.197841] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-28T22:15:25.212357] [DEBUG] [LOCAL ] NAZ: Derivative data saved (138 records). [2025-10-28T22:15:25.212562] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-28T22:15:25.217394] [INFO ] [MAIN ] Derivative Progress: 1222/2046 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 34s. Rate: 148.2 symbols/min [2025-10-28T22:15:25.217842] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:25.232664] [INFO ] [MAIN ] NBB: Generated 138 derivative records from 8885 primary records. [2025-10-28T22:15:25.235031] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-28T22:15:25.235410] [INFO ] [MAIN ] NATL: Generated 138 derivative records from 31569 primary records. [2025-10-28T22:15:25.235593] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-28T22:15:25.264297] [DEBUG] [LOCAL ] NATL: Derivative data saved (138 records). [2025-10-28T22:15:25.265314] [DEBUG] [LOCAL ] NBB: Derivative data saved (138 records). [2025-10-28T22:15:25.265438] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-28T22:15:25.268181] [INFO ] [MAIN ] Derivative Progress: 1223/2046 symbols completed. NATL took 1.2s. Estimated remaining: 5m 33s. Rate: 148.3 symbols/min [2025-10-28T22:15:25.268844] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:25.268691] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-28T22:15:25.278876] [INFO ] [MAIN ] Derivative Progress: 1224/2046 symbols completed. NBB took 1.2s. Estimated remaining: 5m 32s. Rate: 148.4 symbols/min [2025-10-28T22:15:25.279921] [DEBUG] [LOCAL ] NBHC: Loaded 23470 existing records from primary storage. [2025-10-28T22:15:25.279224] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:25.280502] [INFO ] [MAIN ] NBHC: Loaded 23470 primary data records. [2025-10-28T22:15:25.463639] [DEBUG] [LOCAL ] NBXG: Loaded 21117 existing records from primary storage. [2025-10-28T22:15:25.598365] [INFO ] [MAIN ] NBXG: Loaded 21117 primary data records. [2025-10-28T22:15:25.608015] [DEBUG] [LOCAL ] NBR: Loaded 34102 existing records from primary storage. [2025-10-28T22:15:25.613479] [INFO ] [MAIN ] NBR: Loaded 34102 primary data records. [2025-10-28T22:15:26.238478] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:26.290319] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:26.303055] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:26.334966] [INFO ] [MAIN ] NBHC: Generated 138 derivative records from 23470 primary records. [2025-10-28T22:15:26.335263] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-28T22:15:26.354785] [DEBUG] [LOCAL ] NBHC: Derivative data saved (138 records). [2025-10-28T22:15:26.358114] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-28T22:15:26.362012] [INFO ] [MAIN ] Derivative Progress: 1225/2046 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 32s. Rate: 148.2 symbols/min [2025-10-28T22:15:26.369510] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:26.380749] [DEBUG] [LOCAL ] NC: Loaded 1797 existing records from primary storage. [2025-10-28T22:15:26.380871] [INFO ] [MAIN ] NC: Loaded 1797 primary data records. [2025-10-28T22:15:26.480394] [INFO ] [MAIN ] NBR: Generated 138 derivative records from 34102 primary records. [2025-10-28T22:15:26.473292] [INFO ] [MAIN ] NBXG: Generated 138 derivative records from 21117 primary records. [2025-10-28T22:15:26.488214] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-28T22:15:26.488151] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-28T22:15:26.533484] [DEBUG] [LOCAL ] NBXG: Derivative data saved (138 records). [2025-10-28T22:15:26.533714] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-28T22:15:26.538192] [INFO ] [MAIN ] Derivative Progress: 1226/2046 symbols completed. NBXG took 1.3s. Estimated remaining: 5m 32s. Rate: 148.3 symbols/min [2025-10-28T22:15:26.544011] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:26.571765] [DEBUG] [LOCAL ] NBR: Derivative data saved (138 records). [2025-10-28T22:15:26.594818] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-28T22:15:26.652039] [INFO ] [MAIN ] Derivative Progress: 1227/2046 symbols completed. NBR took 1.4s. Estimated remaining: 5m 31s. Rate: 148.4 symbols/min [2025-10-28T22:15:26.740113] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:26.745667] [DEBUG] [LOCAL ] NCA: Loaded 9429 existing records from primary storage. [2025-10-28T22:15:26.746456] [INFO ] [MAIN ] NCA: Loaded 9429 primary data records. [2025-10-28T22:15:26.910469] [DEBUG] [LOCAL ] NCDL: Loaded 21315 existing records from primary storage. [2025-10-28T22:15:26.910801] [INFO ] [MAIN ] NCDL: Loaded 21315 primary data records. [2025-10-28T22:15:27.390821] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:27.437674] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:27.461532] [INFO ] [MAIN ] NC: Generated 138 derivative records from 1797 primary records. [2025-10-28T22:15:27.461764] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-28T22:15:27.477230] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:27.498765] [DEBUG] [LOCAL ] NC: Derivative data saved (138 records). [2025-10-28T22:15:27.498895] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-28T22:15:27.502883] [INFO ] [MAIN ] Derivative Progress: 1228/2046 symbols completed. NC took 1.1s. Estimated remaining: 5m 31s. Rate: 148.2 symbols/min [2025-10-28T22:15:27.524070] [INFO ] [MAIN ] NCA: Generated 138 derivative records from 9429 primary records. [2025-10-28T22:15:27.526299] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-28T22:15:27.538577] [DEBUG] [LOCAL ] NCA: Derivative data saved (138 records). [2025-10-28T22:15:27.538700] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-28T22:15:27.541383] [INFO ] [MAIN ] Derivative Progress: 1229/2046 symbols completed. NCA took 1.0s. Estimated remaining: 5m 30s. Rate: 148.3 symbols/min [2025-10-28T22:15:27.545628] [INFO ] [MAIN ] NCDL: Generated 138 derivative records from 21315 primary records. [2025-10-28T22:15:27.545715] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-28T22:15:27.557243] [DEBUG] [LOCAL ] NCDL: Derivative data saved (138 records). [2025-10-28T22:15:27.557296] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-28T22:15:27.559988] [INFO ] [MAIN ] Derivative Progress: 1230/2046 symbols completed. NCDL took 0.8s. Estimated remaining: 5m 30s. Rate: 148.4 symbols/min [2025-10-28T22:15:27.560326] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:27.560425] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:27.560838] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:27.581704] [DEBUG] [LOCAL ] NCZ: Loaded 12096 existing records from primary storage. [2025-10-28T22:15:27.582038] [DEBUG] [LOCAL ] NCV: Loaded 13788 existing records from primary storage. [2025-10-28T22:15:27.582291] [INFO ] [MAIN ] NCV: Loaded 13788 primary data records. [2025-10-28T22:15:27.582244] [INFO ] [MAIN ] NCZ: Loaded 12096 primary data records. [2025-10-28T22:15:28.079714] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-28T22:15:28.079984] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-10-28T22:15:28.569808] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:28.602404] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:28.650172] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:28.684480] [INFO ] [MAIN ] NCV: Generated 138 derivative records from 13788 primary records. [2025-10-28T22:15:28.684908] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-28T22:15:28.704536] [DEBUG] [LOCAL ] NCV: Derivative data saved (138 records). [2025-10-28T22:15:28.704735] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-28T22:15:28.707480] [INFO ] [MAIN ] Derivative Progress: 1231/2046 symbols completed. NCV took 1.1s. Estimated remaining: 5m 30s. Rate: 148.2 symbols/min [2025-10-28T22:15:28.709615] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:28.713461] [INFO ] [MAIN ] NCZ: Generated 138 derivative records from 12096 primary records. [2025-10-28T22:15:28.716500] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-28T22:15:28.729998] [DEBUG] [LOCAL ] NCZ: Derivative data saved (138 records). [2025-10-28T22:15:28.730155] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-28T22:15:28.732709] [INFO ] [MAIN ] Derivative Progress: 1232/2046 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 29s. Rate: 148.3 symbols/min [2025-10-28T22:15:28.737183] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:28.743330] [INFO ] [MAIN ] NCLH: Generated 138 derivative records from 53753 primary records. [2025-10-28T22:15:28.749406] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-10-28T22:15:28.749346] [DEBUG] [LOCAL ] NDMO: Loaded 16778 existing records from primary storage. [2025-10-28T22:15:28.750044] [INFO ] [MAIN ] NDMO: Loaded 16778 primary data records. [2025-10-28T22:15:28.797341] [DEBUG] [LOCAL ] NCLH: Derivative data saved (138 records). [2025-10-28T22:15:28.821688] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-10-28T22:15:28.833132] [INFO ] [MAIN ] Derivative Progress: 1233/2046 symbols completed. NCLH took 1.3s. Estimated remaining: 5m 29s. Rate: 148.4 symbols/min [2025-10-28T22:15:28.838557] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:29.114554] [DEBUG] [LOCAL ] NE: Loaded 52271 existing records from primary storage. [2025-10-28T22:15:29.115636] [INFO ] [MAIN ] NE: Loaded 52271 primary data records. [2025-10-28T22:15:29.234208] [DEBUG] [LOCAL ] NEA: Loaded 34710 existing records from primary storage. [2025-10-28T22:15:29.237794] [INFO ] [MAIN ] NEA: Loaded 34710 primary data records. [2025-10-28T22:15:29.736101] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:29.795672] [INFO ] [MAIN ] NDMO: Generated 138 derivative records from 16778 primary records. [2025-10-28T22:15:29.791727] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:29.795866] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-28T22:15:29.831489] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:29.851627] [DEBUG] [LOCAL ] NDMO: Derivative data saved (138 records). [2025-10-28T22:15:29.854628] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-28T22:15:29.857343] [INFO ] [MAIN ] Derivative Progress: 1234/2046 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 29s. Rate: 148.2 symbols/min [2025-10-28T22:15:29.857517] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:29.911715] [INFO ] [MAIN ] NE: Generated 138 derivative records from 52271 primary records. [2025-10-28T22:15:29.913284] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-28T22:15:29.916465] [INFO ] [MAIN ] NEA: Generated 138 derivative records from 34710 primary records. [2025-10-28T22:15:29.924074] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-28T22:15:29.943756] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-28T22:15:29.944017] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-10-28T22:15:29.943900] [DEBUG] [LOCAL ] NE: Derivative data saved (138 records). [2025-10-28T22:15:29.944412] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-28T22:15:29.955481] [INFO ] [MAIN ] Derivative Progress: 1235/2046 symbols completed. NE took 1.2s. Estimated remaining: 5m 28s. Rate: 148.3 symbols/min [2025-10-28T22:15:29.955695] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:30.031759] [DEBUG] [LOCAL ] NEA: Derivative data saved (138 records). [2025-10-28T22:15:30.054276] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-28T22:15:30.068618] [INFO ] [MAIN ] Derivative Progress: 1236/2046 symbols completed. NEA took 1.2s. Estimated remaining: 5m 27s. Rate: 148.4 symbols/min [2025-10-28T22:15:30.079868] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:30.307352] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-28T22:15:30.307795] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-10-28T22:15:30.436036] [DEBUG] [LOCAL ] NET: Loaded 52682 existing records from primary storage. [2025-10-28T22:15:30.483919] [INFO ] [MAIN ] NET: Loaded 52682 primary data records. [2025-10-28T22:15:30.537791] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:31.031988] [INFO ] [MAIN ] NEE: Generated 138 derivative records from 53707 primary records. [2025-10-28T22:15:31.029865] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:31.032317] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-28T22:15:31.060455] [DEBUG] [LOCAL ] NEE: Derivative data saved (138 records). [2025-10-28T22:15:31.060927] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-10-28T22:15:31.064482] [INFO ] [MAIN ] Derivative Progress: 1237/2046 symbols completed. NEE took 1.2s. Estimated remaining: 5m 27s. Rate: 148.2 symbols/min [2025-10-28T22:15:31.064951] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:31.085200] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:31.109675] [DEBUG] [LOCAL ] NEU: Loaded 8549 existing records from primary storage. [2025-10-28T22:15:31.111460] [INFO ] [MAIN ] NEU: Loaded 8549 primary data records. [2025-10-28T22:15:31.447066] [INFO ] [MAIN ] NEM: Generated 138 derivative records from 53708 primary records. [2025-10-28T22:15:31.449703] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-28T22:15:31.453671] [INFO ] [MAIN ] NET: Generated 138 derivative records from 52682 primary records. [2025-10-28T22:15:31.453924] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-28T22:15:31.466458] [DEBUG] [LOCAL ] NEM: Derivative data saved (138 records). [2025-10-28T22:15:31.474434] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-10-28T22:15:31.476684] [INFO ] [MAIN ] Derivative Progress: 1238/2046 symbols completed. NEM took 1.5s. Estimated remaining: 5m 27s. Rate: 148.2 symbols/min [2025-10-28T22:15:31.481549] [DEBUG] [LOCAL ] NET: Derivative data saved (138 records). [2025-10-28T22:15:31.481630] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-28T22:15:31.478442] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:31.484389] [INFO ] [MAIN ] Derivative Progress: 1239/2046 symbols completed. NET took 1.4s. Estimated remaining: 5m 26s. Rate: 148.4 symbols/min [2025-10-28T22:15:31.484796] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:31.491761] [DEBUG] [LOCAL ] NEXA: Loaded 5916 existing records from primary storage. [2025-10-28T22:15:31.492154] [INFO ] [MAIN ] NEXA: Loaded 5916 primary data records. [2025-10-28T22:15:31.614602] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:31.883566] [DEBUG] [LOCAL ] NFG: Loaded 38026 existing records from primary storage. [2025-10-28T22:15:31.883948] [INFO ] [MAIN ] NFG: Loaded 38026 primary data records. [2025-10-28T22:15:32.211332] [INFO ] [MAIN ] NEU: Generated 138 derivative records from 8549 primary records. [2025-10-28T22:15:32.212003] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-28T22:15:32.232367] [DEBUG] [LOCAL ] NEU: Derivative data saved (138 records). [2025-10-28T22:15:32.232710] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-28T22:15:32.242714] [INFO ] [MAIN ] Derivative Progress: 1240/2046 symbols completed. NEU took 1.2s. Estimated remaining: 5m 26s. Rate: 148.3 symbols/min [2025-10-28T22:15:32.247576] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:32.248492] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:32.292861] [DEBUG] [LOCAL ] NFJ: Loaded 19422 existing records from primary storage. [2025-10-28T22:15:32.293274] [INFO ] [MAIN ] NFJ: Loaded 19422 primary data records. [2025-10-28T22:15:32.329194] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:32.464175] [INFO ] [MAIN ] NEXA: Generated 138 derivative records from 5916 primary records. [2025-10-28T22:15:32.489271] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-28T22:15:32.657002] [DEBUG] [LOCAL ] NEXA: Derivative data saved (138 records). [2025-10-28T22:15:32.658906] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-28T22:15:32.661215] [INFO ] [MAIN ] Derivative Progress: 1241/2046 symbols completed. NEXA took 1.2s. Estimated remaining: 5m 26s. Rate: 148.3 symbols/min [2025-10-28T22:15:32.661574] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:32.682151] [INFO ] [MAIN ] NFG: Generated 138 derivative records from 38026 primary records. [2025-10-28T22:15:32.682535] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-28T22:15:32.706410] [DEBUG] [LOCAL ] NFG: Derivative data saved (138 records). [2025-10-28T22:15:32.706534] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-28T22:15:32.709182] [INFO ] [MAIN ] Derivative Progress: 1242/2046 symbols completed. NFG took 1.2s. Estimated remaining: 5m 25s. Rate: 148.4 symbols/min [2025-10-28T22:15:32.709726] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:32.741041] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:32.741276] [DEBUG] [LOCAL ] NGG: Loaded 46493 existing records from primary storage. [2025-10-28T22:15:32.752621] [INFO ] [MAIN ] NGG: Loaded 46493 primary data records. [2025-10-28T22:15:32.910218] [DEBUG] [LOCAL ] NGL: Loaded 29266 existing records from primary storage. [2025-10-28T22:15:32.923525] [INFO ] [MAIN ] NGL: Loaded 29266 primary data records. [2025-10-28T22:15:33.659888] [INFO ] [MAIN ] NFJ: Generated 138 derivative records from 19422 primary records. [2025-10-28T22:15:33.661682] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-28T22:15:33.688152] [DEBUG] [LOCAL ] NFJ: Derivative data saved (138 records). [2025-10-28T22:15:33.694873] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-28T22:15:33.707749] [INFO ] [MAIN ] Derivative Progress: 1243/2046 symbols completed. NFJ took 1.5s. Estimated remaining: 5m 25s. Rate: 148.2 symbols/min [2025-10-28T22:15:33.708324] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:33.764833] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:33.767162] [INFO ] [MAIN ] NGG: Generated 138 derivative records from 46493 primary records. [2025-10-28T22:15:33.786360] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-28T22:15:33.810509] [DEBUG] [LOCAL ] NGG: Derivative data saved (138 records). [2025-10-28T22:15:33.816403] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-28T22:15:33.819949] [INFO ] [MAIN ] Derivative Progress: 1244/2046 symbols completed. NGG took 1.2s. Estimated remaining: 5m 25s. Rate: 148.3 symbols/min [2025-10-28T22:15:33.832255] [INFO ] [MAIN ] NGL: Generated 138 derivative records from 29266 primary records. [2025-10-28T22:15:33.832462] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-28T22:15:33.850585] [DEBUG] [LOCAL ] NGL: Derivative data saved (138 records). [2025-10-28T22:15:33.850770] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-28T22:15:33.853822] [INFO ] [MAIN ] Derivative Progress: 1245/2046 symbols completed. NGL took 1.1s. Estimated remaining: 5m 24s. Rate: 148.4 symbols/min [2025-10-28T22:15:33.854436] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:33.854371] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:33.854602] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:33.885536] [DEBUG] [LOCAL ] NGS: Loaded 10472 existing records from primary storage. [2025-10-28T22:15:33.885827] [INFO ] [MAIN ] NGS: Loaded 10472 primary data records. [2025-10-28T22:15:33.950187] [DEBUG] [LOCAL ] NGVC: Loaded 22622 existing records from primary storage. [2025-10-28T22:15:33.956474] [DEBUG] [LOCAL ] NGVT: Loaded 23101 existing records from primary storage. [2025-10-28T22:15:33.981744] [INFO ] [MAIN ] NGVC: Loaded 22622 primary data records. [2025-10-28T22:15:33.981948] [INFO ] [MAIN ] NGVT: Loaded 23101 primary data records. [2025-10-28T22:15:34.898107] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:34.955104] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:34.954538] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:35.019172] [INFO ] [MAIN ] NGS: Generated 138 derivative records from 10472 primary records. [2025-10-28T22:15:35.023138] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-28T22:15:35.044072] [DEBUG] [LOCAL ] NGS: Derivative data saved (138 records). [2025-10-28T22:15:35.044292] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-28T22:15:35.047058] [INFO ] [MAIN ] Derivative Progress: 1246/2046 symbols completed. NGS took 1.2s. Estimated remaining: 5m 24s. Rate: 148.1 symbols/min [2025-10-28T22:15:35.050026] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:35.055468] [INFO ] [MAIN ] NGVT: Generated 138 derivative records from 23101 primary records. [2025-10-28T22:15:35.057261] [INFO ] [MAIN ] NGVC: Generated 138 derivative records from 22622 primary records. [2025-10-28T22:15:35.057432] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-28T22:15:35.057495] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-28T22:15:35.086483] [DEBUG] [LOCAL ] NGVT: Derivative data saved (138 records). [2025-10-28T22:15:35.086672] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-28T22:15:35.090198] [INFO ] [MAIN ] Derivative Progress: 1247/2046 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 23s. Rate: 148.3 symbols/min [2025-10-28T22:15:35.090696] [DEBUG] [LOCAL ] NGVC: Derivative data saved (138 records). [2025-10-28T22:15:35.090979] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-28T22:15:35.090885] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:35.093332] [INFO ] [MAIN ] Derivative Progress: 1248/2046 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 23s. Rate: 148.4 symbols/min [2025-10-28T22:15:35.093850] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:35.101999] [DEBUG] [LOCAL ] NHI: Loaded 21509 existing records from primary storage. [2025-10-28T22:15:35.102253] [INFO ] [MAIN ] NHI: Loaded 21509 primary data records. [2025-10-28T22:15:35.217809] [DEBUG] [LOCAL ] NIC: Loaded 9020 existing records from primary storage. [2025-10-28T22:15:35.218086] [INFO ] [MAIN ] NIC: Loaded 9020 primary data records. [2025-10-28T22:15:35.814674] [DEBUG] [LOCAL ] NI: Loaded 53401 existing records from primary storage. [2025-10-28T22:15:35.815060] [INFO ] [MAIN ] NI: Loaded 53401 primary data records. [2025-10-28T22:15:36.180859] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:36.219463] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:36.271301] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:36.307527] [INFO ] [MAIN ] NHI: Generated 138 derivative records from 21509 primary records. [2025-10-28T22:15:36.310504] [INFO ] [MAIN ] NIC: Generated 138 derivative records from 9020 primary records. [2025-10-28T22:15:36.310856] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-28T22:15:36.310569] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-28T22:15:36.341333] [DEBUG] [LOCAL ] NHI: Derivative data saved (138 records). [2025-10-28T22:15:36.342529] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-28T22:15:36.344488] [DEBUG] [LOCAL ] NIC: Derivative data saved (138 records). [2025-10-28T22:15:36.344766] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-28T22:15:36.347204] [INFO ] [MAIN ] Derivative Progress: 1249/2046 symbols completed. NHI took 1.3s. Estimated remaining: 5m 23s. Rate: 148.1 symbols/min [2025-10-28T22:15:36.351264] [INFO ] [MAIN ] Derivative Progress: 1250/2046 symbols completed. NIC took 1.3s. Estimated remaining: 5m 22s. Rate: 148.2 symbols/min [2025-10-28T22:15:36.349053] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:36.351759] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:36.363265] [DEBUG] [LOCAL ] NIM: Loaded 3496 existing records from primary storage. [2025-10-28T22:15:36.363900] [INFO ] [MAIN ] NIM: Loaded 3496 primary data records. [2025-10-28T22:15:36.476669] [DEBUG] [LOCAL ] NIE: Loaded 11725 existing records from primary storage. [2025-10-28T22:15:36.476862] [INFO ] [MAIN ] NI: Generated 138 derivative records from 53401 primary records. [2025-10-28T22:15:36.477114] [INFO ] [MAIN ] NIE: Loaded 11725 primary data records. [2025-10-28T22:15:36.477044] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-28T22:15:36.546079] [DEBUG] [LOCAL ] NI: Derivative data saved (138 records). [2025-10-28T22:15:36.602361] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-10-28T22:15:36.675289] [INFO ] [MAIN ] Derivative Progress: 1251/2046 symbols completed. NI took 1.6s. Estimated remaining: 5m 22s. Rate: 148.3 symbols/min [2025-10-28T22:15:36.803692] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:37.021154] [DEBUG] [LOCAL ] NINE: Loaded 28928 existing records from primary storage. [2025-10-28T22:15:37.021912] [INFO ] [MAIN ] NINE: Loaded 28928 primary data records. [2025-10-28T22:15:37.210235] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:37.416035] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:37.452535] [INFO ] [MAIN ] NIM: Generated 138 derivative records from 3496 primary records. [2025-10-28T22:15:37.454182] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-28T22:15:37.480685] [DEBUG] [LOCAL ] NIM: Derivative data saved (138 records). [2025-10-28T22:15:37.481301] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-28T22:15:37.483839] [INFO ] [MAIN ] Derivative Progress: 1252/2046 symbols completed. NIM took 1.1s. Estimated remaining: 5m 22s. Rate: 148.1 symbols/min [2025-10-28T22:15:37.483974] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:37.487518] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:37.514281] [INFO ] [MAIN ] NIE: Generated 138 derivative records from 11725 primary records. [2025-10-28T22:15:37.516700] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-28T22:15:37.533458] [DEBUG] [LOCAL ] NIE: Derivative data saved (138 records). [2025-10-28T22:15:37.533581] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-28T22:15:37.536093] [INFO ] [MAIN ] Derivative Progress: 1253/2046 symbols completed. NIE took 1.2s. Estimated remaining: 5m 21s. Rate: 148.2 symbols/min [2025-10-28T22:15:37.536570] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:37.558793] [INFO ] [MAIN ] NINE: Generated 138 derivative records from 28928 primary records. [2025-10-28T22:15:37.559073] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-28T22:15:37.586148] [DEBUG] [LOCAL ] NINE: Derivative data saved (138 records). [2025-10-28T22:15:37.587383] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-28T22:15:37.590130] [INFO ] [MAIN ] Derivative Progress: 1254/2046 symbols completed. NINE took 0.8s. Estimated remaining: 5m 20s. Rate: 148.4 symbols/min [2025-10-28T22:15:37.591360] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-28T22:15:37.599350] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-28T22:15:37.599269] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:37.744109] [DEBUG] [LOCAL ] NJR: Loaded 37471 existing records from primary storage. [2025-10-28T22:15:37.749371] [INFO ] [MAIN ] NJR: Loaded 37471 primary data records. [2025-10-28T22:15:37.732915] [DEBUG] [LOCAL ] NKX: Loaded 13471 existing records from primary storage. [2025-10-28T22:15:37.778437] [INFO ] [MAIN ] NKX: Loaded 13471 primary data records. [2025-10-28T22:15:38.558742] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:38.607544] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:38.638595] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:38.669746] [INFO ] [MAIN ] NIO: Generated 138 derivative records from 53802 primary records. [2025-10-28T22:15:38.671389] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-28T22:15:38.691480] [DEBUG] [LOCAL ] NIO: Derivative data saved (138 records). [2025-10-28T22:15:38.691889] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-28T22:15:38.696388] [INFO ] [MAIN ] Derivative Progress: 1255/2046 symbols completed. NIO took 1.2s. Estimated remaining: 5m 20s. Rate: 148.1 symbols/min [2025-10-28T22:15:38.697295] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:38.714230] [INFO ] [MAIN ] NKX: Generated 138 derivative records from 13471 primary records. [2025-10-28T22:15:38.717334] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-28T22:15:38.732328] [DEBUG] [LOCAL ] NKX: Derivative data saved (138 records). [2025-10-28T22:15:38.736913] [DEBUG] [LOCAL ] NLOP: Loaded 11208 existing records from primary storage. [2025-10-28T22:15:38.737047] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-28T22:15:38.737207] [INFO ] [MAIN ] NLOP: Loaded 11208 primary data records. [2025-10-28T22:15:38.740745] [INFO ] [MAIN ] Derivative Progress: 1256/2046 symbols completed. NKX took 1.1s. Estimated remaining: 5m 20s. Rate: 148.3 symbols/min [2025-10-28T22:15:38.752090] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:38.834927] [INFO ] [MAIN ] NJR: Generated 138 derivative records from 37471 primary records. [2025-10-28T22:15:38.859169] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-28T22:15:38.928613] [DEBUG] [LOCAL ] NJR: Derivative data saved (138 records). [2025-10-28T22:15:38.949231] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-28T22:15:39.071428] [INFO ] [MAIN ] Derivative Progress: 1257/2046 symbols completed. NJR took 1.5s. Estimated remaining: 5m 19s. Rate: 148.3 symbols/min [2025-10-28T22:15:39.086130] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:39.100805] [DEBUG] [LOCAL ] NMAI: Loaded 12383 existing records from primary storage. [2025-10-28T22:15:39.101850] [INFO ] [MAIN ] NMAI: Loaded 12383 primary data records. [2025-10-28T22:15:39.201821] [DEBUG] [LOCAL ] NLY: Loaded 53560 existing records from primary storage. [2025-10-28T22:15:39.214635] [INFO ] [MAIN ] NLY: Loaded 53560 primary data records. [2025-10-28T22:15:39.598394] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:39.854508] [INFO ] [MAIN ] NLOP: Generated 138 derivative records from 11208 primary records. [2025-10-28T22:15:39.854778] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-28T22:15:39.871102] [DEBUG] [LOCAL ] NLOP: Derivative data saved (138 records). [2025-10-28T22:15:39.871526] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-28T22:15:39.874072] [INFO ] [MAIN ] Derivative Progress: 1258/2046 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 19s. Rate: 148.2 symbols/min [2025-10-28T22:15:39.887390] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:39.921233] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:39.960914] [INFO ] [MAIN ] NMAI: Generated 138 derivative records from 12383 primary records. [2025-10-28T22:15:39.961283] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-28T22:15:39.980708] [INFO ] [MAIN ] NLY: Generated 138 derivative records from 53560 primary records. [2025-10-28T22:15:39.980457] [DEBUG] [LOCAL ] NMAI: Derivative data saved (138 records). [2025-10-28T22:15:39.980910] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-28T22:15:39.980982] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-28T22:15:39.983785] [INFO ] [MAIN ] Derivative Progress: 1259/2046 symbols completed. NMAI took 0.9s. Estimated remaining: 5m 19s. Rate: 148.2 symbols/min [2025-10-28T22:15:39.996143] [DEBUG] [LOCAL ] NLY: Derivative data saved (138 records). [2025-10-28T22:15:39.996248] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-28T22:15:39.998803] [INFO ] [MAIN ] Derivative Progress: 1260/2046 symbols completed. NLY took 1.2s. Estimated remaining: 5m 18s. Rate: 148.4 symbols/min [2025-10-28T22:15:39.999268] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:39.999387] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:39.999203] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:40.010377] [DEBUG] [LOCAL ] NMI: Loaded 3964 existing records from primary storage. [2025-10-28T22:15:40.014136] [INFO ] [MAIN ] NMI: Loaded 3964 primary data records. [2025-10-28T22:15:40.075684] [DEBUG] [LOCAL ] NMG: Loaded 12859 existing records from primary storage. [2025-10-28T22:15:40.089029] [DEBUG] [LOCAL ] NMCO: Loaded 16088 existing records from primary storage. [2025-10-28T22:15:40.098940] [INFO ] [MAIN ] NMG: Loaded 12859 primary data records. [2025-10-28T22:15:40.109432] [INFO ] [MAIN ] NMCO: Loaded 16088 primary data records. [2025-10-28T22:15:41.018690] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:41.076210] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:41.074504] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:15:41.127302] [INFO ] [MAIN ] NMI: Generated 138 derivative records from 3964 primary records. [2025-10-28T22:15:41.130789] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-28T22:15:41.147323] [DEBUG] [LOCAL ] NMI: Derivative data saved (138 records). [2025-10-28T22:15:41.147965] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-28T22:15:41.152289] [INFO ] [MAIN ] Derivative Progress: 1261/2046 symbols completed. NMI took 1.2s. Estimated remaining: 5m 18s. Rate: 148.1 symbols/min [2025-10-28T22:15:41.152432] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:41.181471] [DEBUG] [LOCAL ] NMM: Loaded 13657 existing records from primary storage. [2025-10-28T22:15:41.184350] [INFO ] [MAIN ] NMM: Loaded 13657 primary data records. [2025-10-28T22:15:41.184174] [INFO ] [MAIN ] NMCO: Generated 138 derivative records from 16088 primary records. [2025-10-28T22:15:41.195958] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-28T22:15:41.238763] [INFO ] [MAIN ] NMG: Generated 138 derivative records from 12859 primary records. [2025-10-28T22:15:41.240700] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-28T22:15:41.256014] [DEBUG] [LOCAL ] NMCO: Derivative data saved (138 records). [2025-10-28T22:15:41.265075] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-28T22:15:41.286445] [INFO ] [MAIN ] Derivative Progress: 1262/2046 symbols completed. NMCO took 1.3s. Estimated remaining: 5m 17s. Rate: 148.2 symbols/min [2025-10-28T22:15:41.305759] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:41.308712] [DEBUG] [LOCAL ] NMG: Derivative data saved (138 records). [2025-10-28T22:15:41.317056] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-28T22:15:41.319834] [INFO ] [MAIN ] Derivative Progress: 1263/2046 symbols completed. NMG took 1.3s. Estimated remaining: 5m 17s. Rate: 148.3 symbols/min [2025-10-28T22:15:41.323711] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:41.410767] [DEBUG] [LOCAL ] NMS: Loaded 2914 existing records from primary storage. [2025-10-28T22:15:41.536540] [INFO ] [MAIN ] NMS: Loaded 2914 primary data records. [2025-10-28T22:15:41.674097] [DEBUG] [LOCAL ] NMR: Loaded 35110 existing records from primary storage. [2025-10-28T22:15:41.679348] [INFO ] [MAIN ] NMR: Loaded 35110 primary data records. [2025-10-28T22:15:42.162430] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:42.323496] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:42.354156] [INFO ] [MAIN ] NMM: Generated 138 derivative records from 13657 primary records. [2025-10-28T22:15:42.357425] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-28T22:15:42.372477] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:42.383881] [DEBUG] [LOCAL ] NMM: Derivative data saved (138 records). [2025-10-28T22:15:42.398146] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-28T22:15:42.404116] [INFO ] [MAIN ] Derivative Progress: 1264/2046 symbols completed. NMM took 1.3s. Estimated remaining: 5m 17s. Rate: 148.1 symbols/min [2025-10-28T22:15:42.404262] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:42.417446] [DEBUG] [LOCAL ] NMT: Loaded 2711 existing records from primary storage. [2025-10-28T22:15:42.419352] [INFO ] [MAIN ] NMT: Loaded 2711 primary data records. [2025-10-28T22:15:42.594062] [INFO ] [MAIN ] NMS: Generated 138 derivative records from 2914 primary records. [2025-10-28T22:15:42.617498] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-28T22:15:42.752501] [DEBUG] [LOCAL ] NMS: Derivative data saved (138 records). [2025-10-28T22:15:42.753942] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-28T22:15:42.757906] [INFO ] [MAIN ] Derivative Progress: 1265/2046 symbols completed. NMS took 1.4s. Estimated remaining: 5m 16s. Rate: 148.1 symbols/min [2025-10-28T22:15:42.760892] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:42.764352] [INFO ] [MAIN ] NMR: Generated 138 derivative records from 35110 primary records. [2025-10-28T22:15:42.765495] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-28T22:15:42.779055] [DEBUG] [LOCAL ] NMR: Derivative data saved (138 records). [2025-10-28T22:15:42.779277] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-28T22:15:42.782988] [INFO ] [MAIN ] Derivative Progress: 1266/2046 symbols completed. NMR took 1.5s. Estimated remaining: 5m 16s. Rate: 148.3 symbols/min [2025-10-28T22:15:42.783214] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:42.819402] [DEBUG] [LOCAL ] NMZ: Loaded 20640 existing records from primary storage. [2025-10-28T22:15:42.824636] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:42.825409] [DEBUG] [LOCAL ] NNI: Loaded 10473 existing records from primary storage. [2025-10-28T22:15:42.825553] [INFO ] [MAIN ] NMZ: Loaded 20640 primary data records. [2025-10-28T22:15:42.838130] [INFO ] [MAIN ] NNI: Loaded 10473 primary data records. [2025-10-28T22:15:43.511630] [INFO ] [MAIN ] NMT: Generated 138 derivative records from 2711 primary records. [2025-10-28T22:15:43.512807] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-28T22:15:43.526201] [DEBUG] [LOCAL ] NMT: Derivative data saved (138 records). [2025-10-28T22:15:43.526689] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-28T22:15:43.529815] [INFO ] [MAIN ] Derivative Progress: 1267/2046 symbols completed. NMT took 1.1s. Estimated remaining: 5m 15s. Rate: 148.2 symbols/min [2025-10-28T22:15:43.530291] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:43.552618] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:43.582745] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:43.653974] [DEBUG] [LOCAL ] NNN: Loaded 47907 existing records from primary storage. [2025-10-28T22:15:43.656114] [INFO ] [MAIN ] NNN: Loaded 47907 primary data records. [2025-10-28T22:15:43.775891] [INFO ] [MAIN ] NNI: Generated 138 derivative records from 10473 primary records. [2025-10-28T22:15:43.783554] [INFO ] [MAIN ] NMZ: Generated 138 derivative records from 20640 primary records. [2025-10-28T22:15:43.783711] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-28T22:15:43.789216] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-28T22:15:43.903945] [DEBUG] [LOCAL ] NMZ: Derivative data saved (138 records). [2025-10-28T22:15:44.058431] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-28T22:15:44.073606] [INFO ] [MAIN ] Derivative Progress: 1268/2046 symbols completed. NMZ took 1.3s. Estimated remaining: 5m 15s. Rate: 148.1 symbols/min [2025-10-28T22:15:44.070404] [DEBUG] [LOCAL ] NNI: Derivative data saved (138 records). [2025-10-28T22:15:44.074069] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-28T22:15:44.076679] [INFO ] [MAIN ] Derivative Progress: 1269/2046 symbols completed. NNI took 1.3s. Estimated remaining: 5m 15s. Rate: 148.2 symbols/min [2025-10-28T22:15:44.076940] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:44.074207] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:44.085489] [DEBUG] [LOCAL ] NNY: Loaded 5762 existing records from primary storage. [2025-10-28T22:15:44.085876] [INFO ] [MAIN ] NNY: Loaded 5762 primary data records. [2025-10-28T22:15:44.205335] [DEBUG] [LOCAL ] NOA: Loaded 15397 existing records from primary storage. [2025-10-28T22:15:44.208897] [INFO ] [MAIN ] NOA: Loaded 15397 primary data records. [2025-10-28T22:15:44.740519] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:44.792226] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:44.817586] [INFO ] [MAIN ] NNN: Generated 138 derivative records from 47907 primary records. [2025-10-28T22:15:44.818672] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-28T22:15:44.838870] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:44.870040] [DEBUG] [LOCAL ] NNN: Derivative data saved (138 records). [2025-10-28T22:15:44.872591] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-28T22:15:44.877321] [INFO ] [MAIN ] Derivative Progress: 1270/2046 symbols completed. NNN took 1.3s. Estimated remaining: 5m 14s. Rate: 148.1 symbols/min [2025-10-28T22:15:44.881753] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:44.912074] [INFO ] [MAIN ] NNY: Generated 138 derivative records from 5762 primary records. [2025-10-28T22:15:44.919701] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-28T22:15:44.924376] [DEBUG] [LOCAL ] NOAH: Loaded 19143 existing records from primary storage. [2025-10-28T22:15:44.938957] [INFO ] [MAIN ] NOAH: Loaded 19143 primary data records. [2025-10-28T22:15:44.964618] [DEBUG] [LOCAL ] NNY: Derivative data saved (138 records). [2025-10-28T22:15:44.979616] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-28T22:15:44.996019] [INFO ] [MAIN ] Derivative Progress: 1271/2046 symbols completed. NNY took 0.9s. Estimated remaining: 5m 14s. Rate: 148.2 symbols/min [2025-10-28T22:15:45.001466] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:45.044299] [INFO ] [MAIN ] NOA: Generated 138 derivative records from 15397 primary records. [2025-10-28T22:15:45.049843] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-28T22:15:45.087452] [DEBUG] [LOCAL ] NOA: Derivative data saved (138 records). [2025-10-28T22:15:45.087615] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-28T22:15:45.108718] [INFO ] [MAIN ] Derivative Progress: 1272/2046 symbols completed. NOA took 1.0s. Estimated remaining: 5m 13s. Rate: 148.3 symbols/min [2025-10-28T22:15:45.119431] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:45.385377] [DEBUG] [LOCAL ] NOG: Loaded 51317 existing records from primary storage. [2025-10-28T22:15:45.386358] [INFO ] [MAIN ] NOG: Loaded 51317 primary data records. [2025-10-28T22:15:45.430179] [DEBUG] [LOCAL ] NOMD: Loaded 43269 existing records from primary storage. [2025-10-28T22:15:45.451110] [INFO ] [MAIN ] NOMD: Loaded 43269 primary data records. [2025-10-28T22:15:45.664036] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:46.158738] [INFO ] [MAIN ] NOAH: Generated 138 derivative records from 19143 primary records. [2025-10-28T22:15:46.159146] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-28T22:15:46.174629] [DEBUG] [LOCAL ] NOAH: Derivative data saved (138 records). [2025-10-28T22:15:46.175369] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-28T22:15:46.177697] [INFO ] [MAIN ] Derivative Progress: 1273/2046 symbols completed. NOAH took 1.3s. Estimated remaining: 5m 13s. Rate: 148.1 symbols/min [2025-10-28T22:15:46.206329] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:46.206739] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:46.264532] [INFO ] [MAIN ] NOG: Generated 138 derivative records from 51317 primary records. [2025-10-28T22:15:46.266791] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-28T22:15:46.282750] [DEBUG] [LOCAL ] NOG: Derivative data saved (138 records). [2025-10-28T22:15:46.280884] [INFO ] [MAIN ] NOMD: Generated 138 derivative records from 43269 primary records. [2025-10-28T22:15:46.282873] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-28T22:15:46.285138] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-28T22:15:46.285032] [INFO ] [MAIN ] Derivative Progress: 1274/2046 symbols completed. NOG took 1.3s. Estimated remaining: 5m 13s. Rate: 148.2 symbols/min [2025-10-28T22:15:46.298216] [DEBUG] [LOCAL ] NOMD: Derivative data saved (138 records). [2025-10-28T22:15:46.298296] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-28T22:15:46.301001] [INFO ] [MAIN ] Derivative Progress: 1275/2046 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 12s. Rate: 148.3 symbols/min [2025-10-28T22:15:46.301398] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:46.301526] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:46.301934] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:46.349543] [DEBUG] [LOCAL ] NOTE: Loaded 39113 existing records from primary storage. [2025-10-28T22:15:46.349874] [INFO ] [MAIN ] NOTE: Loaded 39113 primary data records. [2025-10-28T22:15:46.506998] [DEBUG] [LOCAL ] NOV: Loaded 53159 existing records from primary storage. [2025-10-28T22:15:46.528756] [INFO ] [MAIN ] NOV: Loaded 53159 primary data records. [2025-10-28T22:15:46.528600] [DEBUG] [LOCAL ] NOW: Loaded 47552 existing records from primary storage. [2025-10-28T22:15:46.534254] [INFO ] [MAIN ] NOW: Loaded 47552 primary data records. [2025-10-28T22:15:47.357784] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:47.403247] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:47.406902] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:47.478350] [INFO ] [MAIN ] NOTE: Generated 138 derivative records from 39113 primary records. [2025-10-28T22:15:47.481577] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-28T22:15:47.498804] [DEBUG] [LOCAL ] NOTE: Derivative data saved (138 records). [2025-10-28T22:15:47.501469] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-28T22:15:47.503577] [INFO ] [MAIN ] Derivative Progress: 1276/2046 symbols completed. NOTE took 1.2s. Estimated remaining: 5m 12s. Rate: 148.1 symbols/min [2025-10-28T22:15:47.504846] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:47.507248] [INFO ] [MAIN ] NOW: Generated 138 derivative records from 47552 primary records. [2025-10-28T22:15:47.507850] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-28T22:15:47.510437] [INFO ] [MAIN ] NOV: Generated 138 derivative records from 53159 primary records. [2025-10-28T22:15:47.511198] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-28T22:15:47.537929] [DEBUG] [LOCAL ] NOW: Derivative data saved (138 records). [2025-10-28T22:15:47.538076] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-10-28T22:15:47.549665] [INFO ] [MAIN ] Derivative Progress: 1277/2046 symbols completed. NOW took 1.2s. Estimated remaining: 5m 11s. Rate: 148.2 symbols/min [2025-10-28T22:15:47.549898] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:47.546608] [DEBUG] [LOCAL ] NOV: Derivative data saved (138 records). [2025-10-28T22:15:47.550612] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-28T22:15:47.554164] [INFO ] [MAIN ] Derivative Progress: 1278/2046 symbols completed. NOV took 1.3s. Estimated remaining: 5m 11s. Rate: 148.3 symbols/min [2025-10-28T22:15:47.554369] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:47.561924] [DEBUG] [LOCAL ] NPCT: Loaded 16155 existing records from primary storage. [2025-10-28T22:15:47.562192] [INFO ] [MAIN ] NPCT: Loaded 16155 primary data records. [2025-10-28T22:15:47.657105] [DEBUG] [LOCAL ] NPK: Loaded 8431 existing records from primary storage. [2025-10-28T22:15:47.662758] [INFO ] [MAIN ] NPK: Loaded 8431 primary data records. [2025-10-28T22:15:47.662619] [DEBUG] [LOCAL ] NPFD: Loaded 9872 existing records from primary storage. [2025-10-28T22:15:47.681883] [INFO ] [MAIN ] NPFD: Loaded 9872 primary data records. [2025-10-28T22:15:48.564047] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:48.615029] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:48.642922] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:48.673082] [INFO ] [MAIN ] NPCT: Generated 138 derivative records from 16155 primary records. [2025-10-28T22:15:48.673297] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-28T22:15:48.692441] [DEBUG] [LOCAL ] NPCT: Derivative data saved (138 records). [2025-10-28T22:15:48.695626] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-28T22:15:48.697839] [INFO ] [MAIN ] Derivative Progress: 1279/2046 symbols completed. NPCT took 1.2s. Estimated remaining: 5m 11s. Rate: 148.1 symbols/min [2025-10-28T22:15:48.698126] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:48.719857] [INFO ] [MAIN ] NPK: Generated 138 derivative records from 8431 primary records. [2025-10-28T22:15:48.723857] [INFO ] [MAIN ] NPFD: Generated 138 derivative records from 9872 primary records. [2025-10-28T22:15:48.724143] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-28T22:15:48.724080] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-28T22:15:48.743197] [DEBUG] [LOCAL ] NPK: Derivative data saved (138 records). [2025-10-28T22:15:48.746820] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-28T22:15:48.749534] [INFO ] [MAIN ] Derivative Progress: 1280/2046 symbols completed. NPK took 1.2s. Estimated remaining: 5m 10s. Rate: 148.2 symbols/min [2025-10-28T22:15:48.750116] [DEBUG] [LOCAL ] NPFD: Derivative data saved (138 records). [2025-10-28T22:15:48.758857] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-28T22:15:48.758670] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:48.761732] [INFO ] [MAIN ] Derivative Progress: 1281/2046 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 10s. Rate: 148.3 symbols/min [2025-10-28T22:15:48.762406] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:48.773180] [DEBUG] [LOCAL ] NPV: Loaded 5322 existing records from primary storage. [2025-10-28T22:15:48.774046] [INFO ] [MAIN ] NPV: Loaded 5322 primary data records. [2025-10-28T22:15:48.845732] [DEBUG] [LOCAL ] NPKI: Loaded 40197 existing records from primary storage. [2025-10-28T22:15:48.845910] [INFO ] [MAIN ] NPKI: Loaded 40197 primary data records. [2025-10-28T22:15:48.844805] [DEBUG] [LOCAL ] NPO: Loaded 13391 existing records from primary storage. [2025-10-28T22:15:48.846055] [INFO ] [MAIN ] NPO: Loaded 13391 primary data records. [2025-10-28T22:15:49.725814] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:49.782058] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:15:49.783802] [DEBUG] [MAIN ] NPKI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:49.849744] [INFO ] [MAIN ] NPV: Generated 138 derivative records from 5322 primary records. [2025-10-28T22:15:49.850211] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-28T22:15:49.869079] [DEBUG] [LOCAL ] NPV: Derivative data saved (138 records). [2025-10-28T22:15:49.871369] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-28T22:15:49.874685] [INFO ] [MAIN ] Derivative Progress: 1282/2046 symbols completed. NPV took 1.1s. Estimated remaining: 5m 10s. Rate: 148.1 symbols/min [2025-10-28T22:15:49.874850] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:49.881308] [INFO ] [MAIN ] NPKI: Generated 138 derivative records from 40197 primary records. [2025-10-28T22:15:49.881836] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-28T22:15:49.886468] [INFO ] [MAIN ] NPO: Generated 138 derivative records from 13391 primary records. [2025-10-28T22:15:49.897017] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-28T22:15:49.916347] [DEBUG] [LOCAL ] NPO: Derivative data saved (138 records). [2025-10-28T22:15:49.916474] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-28T22:15:49.918982] [INFO ] [MAIN ] Derivative Progress: 1283/2046 symbols completed. NPO took 1.2s. Estimated remaining: 5m 9s. Rate: 148.2 symbols/min [2025-10-28T22:15:49.919195] [DEBUG] [LOCAL ] NPKI: Derivative data saved (138 records). [2025-10-28T22:15:49.919388] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-10-28T22:15:49.922099] [INFO ] [MAIN ] Derivative Progress: 1284/2046 symbols completed. NPKI took 1.2s. Estimated remaining: 5m 8s. Rate: 148.3 symbols/min [2025-10-28T22:15:49.919591] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:49.922864] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:49.941969] [DEBUG] [LOCAL ] NQP: Loaded 8928 existing records from primary storage. [2025-10-28T22:15:49.942100] [INFO ] [MAIN ] NQP: Loaded 8928 primary data records. [2025-10-28T22:15:50.066293] [DEBUG] [LOCAL ] NPWR: Loaded 43583 existing records from primary storage. [2025-10-28T22:15:50.066630] [INFO ] [MAIN ] NPWR: Loaded 43583 primary data records. [2025-10-28T22:15:50.312139] [DEBUG] [LOCAL ] NRDY: Loaded 32019 existing records from primary storage. [2025-10-28T22:15:50.405434] [INFO ] [MAIN ] NRDY: Loaded 32019 primary data records. [2025-10-28T22:15:50.943880] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:15:50.975124] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:51.017047] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:51.072345] [INFO ] [MAIN ] NQP: Generated 138 derivative records from 8928 primary records. [2025-10-28T22:15:51.074954] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-28T22:15:51.093832] [DEBUG] [LOCAL ] NQP: Derivative data saved (138 records). [2025-10-28T22:15:51.093731] [INFO ] [MAIN ] NPWR: Generated 138 derivative records from 43583 primary records. [2025-10-28T22:15:51.095380] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-28T22:15:51.095478] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-28T22:15:51.098952] [INFO ] [MAIN ] Derivative Progress: 1285/2046 symbols completed. NQP took 1.2s. Estimated remaining: 5m 8s. Rate: 148.1 symbols/min [2025-10-28T22:15:51.099623] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:51.114483] [DEBUG] [LOCAL ] NPWR: Derivative data saved (138 records). [2025-10-28T22:15:51.116628] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-28T22:15:51.119459] [INFO ] [MAIN ] Derivative Progress: 1286/2046 symbols completed. NPWR took 1.2s. Estimated remaining: 5m 8s. Rate: 148.2 symbols/min [2025-10-28T22:15:51.116877] [INFO ] [MAIN ] NRDY: Generated 138 derivative records from 32019 primary records. [2025-10-28T22:15:51.122257] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-28T22:15:51.122086] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:51.136895] [DEBUG] [LOCAL ] NREF: Loaded 7656 existing records from primary storage. [2025-10-28T22:15:51.138634] [DEBUG] [LOCAL ] NRDY: Derivative data saved (138 records). [2025-10-28T22:15:51.138760] [INFO ] [MAIN ] NREF: Loaded 7656 primary data records. [2025-10-28T22:15:51.138988] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-28T22:15:51.163871] [INFO ] [MAIN ] Derivative Progress: 1287/2046 symbols completed. NRDY took 1.2s. Estimated remaining: 5m 7s. Rate: 148.3 symbols/min [2025-10-28T22:15:51.164057] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:51.526326] [DEBUG] [LOCAL ] NRGV: Loaded 44051 existing records from primary storage. [2025-10-28T22:15:51.525135] [DEBUG] [LOCAL ] NRG: Loaded 52752 existing records from primary storage. [2025-10-28T22:15:51.526943] [INFO ] [MAIN ] NRGV: Loaded 44051 primary data records. [2025-10-28T22:15:51.526874] [INFO ] [MAIN ] NRG: Loaded 52752 primary data records. [2025-10-28T22:15:52.246743] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:52.294305] [INFO ] [MAIN ] NREF: Generated 138 derivative records from 7656 primary records. [2025-10-28T22:15:52.307891] [DEBUG] [MAIN ] NRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:52.321323] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-28T22:15:52.362766] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:52.363499] [DEBUG] [LOCAL ] NREF: Derivative data saved (138 records). [2025-10-28T22:15:52.386095] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-28T22:15:52.391768] [INFO ] [MAIN ] Derivative Progress: 1288/2046 symbols completed. NREF took 1.3s. Estimated remaining: 5m 7s. Rate: 148.1 symbols/min [2025-10-28T22:15:52.420615] [INFO ] [MAIN ] NRG: Generated 138 derivative records from 52752 primary records. [2025-10-28T22:15:52.421258] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-10-28T22:15:52.441310] [DEBUG] [LOCAL ] NRG: Derivative data saved (138 records). [2025-10-28T22:15:52.441534] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-10-28T22:15:52.444562] [INFO ] [MAIN ] Derivative Progress: 1289/2046 symbols completed. NRG took 1.3s. Estimated remaining: 5m 7s. Rate: 148.2 symbols/min [2025-10-28T22:15:52.446942] [INFO ] [MAIN ] NRGV: Generated 138 derivative records from 44051 primary records. [2025-10-28T22:15:52.447210] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-28T22:15:52.460323] [DEBUG] [LOCAL ] NRGV: Derivative data saved (138 records). [2025-10-28T22:15:52.460465] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-28T22:15:52.463088] [INFO ] [MAIN ] Derivative Progress: 1290/2046 symbols completed. NRGV took 1.3s. Estimated remaining: 5m 6s. Rate: 148.3 symbols/min [2025-10-28T22:15:52.463796] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:52.463684] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:52.463574] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:52.473838] [DEBUG] [LOCAL ] NRT: Loaded 4850 existing records from primary storage. [2025-10-28T22:15:52.477315] [INFO ] [MAIN ] NRT: Loaded 4850 primary data records. [2025-10-28T22:15:52.477050] [DEBUG] [LOCAL ] NRP: Loaded 3986 existing records from primary storage. [2025-10-28T22:15:52.477536] [INFO ] [MAIN ] NRP: Loaded 3986 primary data records. [2025-10-28T22:15:52.666426] [DEBUG] [LOCAL ] NRK: Loaded 20343 existing records from primary storage. [2025-10-28T22:15:52.694614] [INFO ] [MAIN ] NRK: Loaded 20343 primary data records. [2025-10-28T22:15:53.514943] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:53.543669] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:53.581537] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:53.651759] [INFO ] [MAIN ] NRP: Generated 138 derivative records from 3986 primary records. [2025-10-28T22:15:53.653076] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-28T22:15:53.667901] [INFO ] [MAIN ] NRT: Generated 138 derivative records from 4850 primary records. [2025-10-28T22:15:53.671857] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-28T22:15:53.673251] [DEBUG] [LOCAL ] NRP: Derivative data saved (138 records). [2025-10-28T22:15:53.674438] [INFO ] [MAIN ] NRK: Generated 138 derivative records from 20343 primary records. [2025-10-28T22:15:53.674538] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-28T22:15:53.681706] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-28T22:15:53.685590] [INFO ] [MAIN ] Derivative Progress: 1291/2046 symbols completed. NRP took 1.2s. Estimated remaining: 5m 6s. Rate: 148.0 symbols/min [2025-10-28T22:15:53.686780] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:53.689772] [DEBUG] [LOCAL ] NRT: Derivative data saved (138 records). [2025-10-28T22:15:53.690120] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-28T22:15:53.693326] [INFO ] [MAIN ] Derivative Progress: 1292/2046 symbols completed. NRT took 1.2s. Estimated remaining: 5m 5s. Rate: 148.1 symbols/min [2025-10-28T22:15:53.709545] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:53.709357] [DEBUG] [LOCAL ] NRK: Derivative data saved (138 records). [2025-10-28T22:15:53.713028] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-28T22:15:53.712863] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-10-28T22:15:53.715738] [INFO ] [MAIN ] Derivative Progress: 1293/2046 symbols completed. NRK took 1.3s. Estimated remaining: 5m 5s. Rate: 148.3 symbols/min [2025-10-28T22:15:53.715862] [INFO ] [MAIN ] NRUC: Loaded 3083 primary data records. [2025-10-28T22:15:53.727443] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:54.048514] [DEBUG] [LOCAL ] NSA: Loaded 45102 existing records from primary storage. [2025-10-28T22:15:54.048910] [INFO ] [MAIN ] NSA: Loaded 45102 primary data records. [2025-10-28T22:15:54.148697] [DEBUG] [LOCAL ] NSC: Loaded 48473 existing records from primary storage. [2025-10-28T22:15:54.174490] [INFO ] [MAIN ] NSC: Loaded 48473 primary data records. [2025-10-28T22:15:54.607995] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:54.830841] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:54.852767] [INFO ] [MAIN ] NRUC: Generated 138 derivative records from 3083 primary records. [2025-10-28T22:15:54.854279] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-28T22:15:54.881102] [DEBUG] [MAIN ] NSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:54.884896] [DEBUG] [LOCAL ] NRUC: Derivative data saved (138 records). [2025-10-28T22:15:54.885003] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-28T22:15:54.899726] [INFO ] [MAIN ] Derivative Progress: 1294/2046 symbols completed. NRUC took 1.2s. Estimated remaining: 5m 5s. Rate: 148.0 symbols/min [2025-10-28T22:15:54.902779] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:54.950726] [INFO ] [MAIN ] NSA: Generated 138 derivative records from 45102 primary records. [2025-10-28T22:15:54.955523] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-28T22:15:54.959385] [INFO ] [MAIN ] NSC: Generated 138 derivative records from 48473 primary records. [2025-10-28T22:15:54.977741] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-10-28T22:15:54.983417] [DEBUG] [LOCAL ] NSA: Derivative data saved (138 records). [2025-10-28T22:15:54.993673] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-28T22:15:54.997229] [INFO ] [MAIN ] Derivative Progress: 1295/2046 symbols completed. NSA took 1.3s. Estimated remaining: 5m 4s. Rate: 148.1 symbols/min [2025-10-28T22:15:54.997673] [DEBUG] [LOCAL ] NSC: Derivative data saved (138 records). [2025-10-28T22:15:54.983333] [DEBUG] [LOCAL ] NSP: Loaded 35731 existing records from primary storage. [2025-10-28T22:15:54.998044] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-10-28T22:15:55.001343] [INFO ] [MAIN ] NSP: Loaded 35731 primary data records. [2025-10-28T22:15:55.001176] [INFO ] [MAIN ] Derivative Progress: 1296/2046 symbols completed. NSC took 1.3s. Estimated remaining: 5m 4s. Rate: 148.2 symbols/min [2025-10-28T22:15:54.997938] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:55.002116] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:55.187292] [DEBUG] [LOCAL ] NTB: Loaded 19841 existing records from primary storage. [2025-10-28T22:15:55.197676] [INFO ] [MAIN ] NTB: Loaded 19841 primary data records. [2025-10-28T22:15:55.519150] [DEBUG] [LOCAL ] NTR: Loaded 52544 existing records from primary storage. [2025-10-28T22:15:55.536370] [INFO ] [MAIN ] NTR: Loaded 52544 primary data records. [2025-10-28T22:15:55.994142] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:56.035607] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:56.088885] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:56.111594] [INFO ] [MAIN ] NSP: Generated 138 derivative records from 35731 primary records. [2025-10-28T22:15:56.111957] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-28T22:15:56.131158] [DEBUG] [LOCAL ] NSP: Derivative data saved (138 records). [2025-10-28T22:15:56.131359] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-28T22:15:56.136311] [INFO ] [MAIN ] Derivative Progress: 1297/2046 symbols completed. NSP took 1.2s. Estimated remaining: 5m 4s. Rate: 148.0 symbols/min [2025-10-28T22:15:56.138859] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:56.146371] [INFO ] [MAIN ] NTB: Generated 138 derivative records from 19841 primary records. [2025-10-28T22:15:56.146731] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-28T22:15:56.164245] [DEBUG] [LOCAL ] NTB: Derivative data saved (138 records). [2025-10-28T22:15:56.165425] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-28T22:15:56.169115] [INFO ] [MAIN ] Derivative Progress: 1298/2046 symbols completed. NTB took 1.2s. Estimated remaining: 5m 3s. Rate: 148.1 symbols/min [2025-10-28T22:15:56.171572] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:56.175108] [INFO ] [MAIN ] NTR: Generated 138 derivative records from 52544 primary records. [2025-10-28T22:15:56.175433] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-28T22:15:56.197096] [DEBUG] [LOCAL ] NTR: Derivative data saved (138 records). [2025-10-28T22:15:56.197432] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-28T22:15:56.199588] [INFO ] [MAIN ] Derivative Progress: 1299/2046 symbols completed. NTR took 1.2s. Estimated remaining: 5m 2s. Rate: 148.2 symbols/min [2025-10-28T22:15:56.199915] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:56.217071] [DEBUG] [LOCAL ] NTST: Loaded 43995 existing records from primary storage. [2025-10-28T22:15:56.217313] [INFO ] [MAIN ] NTST: Loaded 43995 primary data records. [2025-10-28T22:15:56.428749] [DEBUG] [LOCAL ] NUS: Loaded 35572 existing records from primary storage. [2025-10-28T22:15:56.428910] [INFO ] [MAIN ] NUS: Loaded 35572 primary data records. [2025-10-28T22:15:56.598536] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-28T22:15:56.625676] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-10-28T22:15:57.187963] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:57.229342] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:57.263303] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:57.290167] [INFO ] [MAIN ] NTST: Generated 138 derivative records from 43995 primary records. [2025-10-28T22:15:57.291369] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-28T22:15:57.309468] [DEBUG] [LOCAL ] NTST: Derivative data saved (138 records). [2025-10-28T22:15:57.310227] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-28T22:15:57.312592] [INFO ] [MAIN ] Derivative Progress: 1300/2046 symbols completed. NTST took 1.2s. Estimated remaining: 5m 2s. Rate: 148.0 symbols/min [2025-10-28T22:15:57.313907] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:57.323324] [INFO ] [MAIN ] NUS: Generated 138 derivative records from 35572 primary records. [2025-10-28T22:15:57.324244] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-28T22:15:57.345804] [DEBUG] [LOCAL ] NUS: Derivative data saved (138 records). [2025-10-28T22:15:57.346160] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-28T22:15:57.350436] [INFO ] [MAIN ] Derivative Progress: 1301/2046 symbols completed. NUS took 1.2s. Estimated remaining: 5m 2s. Rate: 148.1 symbols/min [2025-10-28T22:15:57.358191] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:57.358735] [DEBUG] [LOCAL ] NUV: Loaded 22854 existing records from primary storage. [2025-10-28T22:15:57.360209] [INFO ] [MAIN ] NUV: Loaded 22854 primary data records. [2025-10-28T22:15:57.373925] [INFO ] [MAIN ] NU: Generated 138 derivative records from 53746 primary records. [2025-10-28T22:15:57.405841] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-28T22:15:57.495485] [DEBUG] [LOCAL ] NU: Derivative data saved (138 records). [2025-10-28T22:15:57.519699] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-28T22:15:57.661992] [INFO ] [MAIN ] Derivative Progress: 1302/2046 symbols completed. NU took 1.5s. Estimated remaining: 5m 1s. Rate: 148.2 symbols/min [2025-10-28T22:15:57.684874] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:57.692783] [DEBUG] [LOCAL ] NUW: Loaded 6350 existing records from primary storage. [2025-10-28T22:15:57.694178] [INFO ] [MAIN ] NUW: Loaded 6350 primary data records. [2025-10-28T22:15:57.811598] [DEBUG] [LOCAL ] NUVB: Loaded 51757 existing records from primary storage. [2025-10-28T22:15:57.812517] [INFO ] [MAIN ] NUVB: Loaded 51757 primary data records. [2025-10-28T22:15:58.304668] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:58.352392] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:58.390178] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:58.411326] [INFO ] [MAIN ] NUV: Generated 138 derivative records from 22854 primary records. [2025-10-28T22:15:58.413021] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-28T22:15:58.433156] [DEBUG] [LOCAL ] NUV: Derivative data saved (138 records). [2025-10-28T22:15:58.433305] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-28T22:15:58.435861] [INFO ] [MAIN ] Derivative Progress: 1303/2046 symbols completed. NUV took 1.1s. Estimated remaining: 5m 1s. Rate: 148.1 symbols/min [2025-10-28T22:15:58.456866] [INFO ] [MAIN ] NUW: Generated 138 derivative records from 6350 primary records. [2025-10-28T22:15:58.457162] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-28T22:15:58.477211] [DEBUG] [LOCAL ] NUW: Derivative data saved (138 records). [2025-10-28T22:15:58.476163] [INFO ] [MAIN ] NUVB: Generated 138 derivative records from 51757 primary records. [2025-10-28T22:15:58.477350] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-28T22:15:58.477418] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-28T22:15:58.479689] [INFO ] [MAIN ] Derivative Progress: 1304/2046 symbols completed. NUW took 0.8s. Estimated remaining: 5m 0s. Rate: 148.2 symbols/min [2025-10-28T22:15:58.491289] [DEBUG] [LOCAL ] NUVB: Derivative data saved (138 records). [2025-10-28T22:15:58.491346] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-28T22:15:58.493603] [INFO ] [MAIN ] Derivative Progress: 1305/2046 symbols completed. NUVB took 1.1s. Estimated remaining: 4m 60s. Rate: 148.3 symbols/min [2025-10-28T22:15:58.494061] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:58.494143] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:58.494001] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:58.524093] [DEBUG] [LOCAL ] NVG: Loaded 26950 existing records from primary storage. [2025-10-28T22:15:58.530707] [INFO ] [MAIN ] NVG: Loaded 26950 primary data records. [2025-10-28T22:15:58.629841] [DEBUG] [LOCAL ] NVR: Loaded 18111 existing records from primary storage. [2025-10-28T22:15:58.635178] [INFO ] [MAIN ] NVR: Loaded 18111 primary data records. [2025-10-28T22:15:58.683600] [DEBUG] [LOCAL ] NVGS: Loaded 29406 existing records from primary storage. [2025-10-28T22:15:58.707578] [INFO ] [MAIN ] NVGS: Loaded 29406 primary data records. [2025-10-28T22:15:59.505865] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:59.533328] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:59.572822] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:15:59.627612] [INFO ] [MAIN ] NVG: Generated 138 derivative records from 26950 primary records. [2025-10-28T22:15:59.631498] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-28T22:15:59.648395] [DEBUG] [LOCAL ] NVG: Derivative data saved (138 records). [2025-10-28T22:15:59.649008] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-28T22:15:59.648764] [INFO ] [MAIN ] NVR: Generated 138 derivative records from 18111 primary records. [2025-10-28T22:15:59.653479] [INFO ] [MAIN ] Derivative Progress: 1306/2046 symbols completed. NVG took 1.2s. Estimated remaining: 4m 60s. Rate: 148.1 symbols/min [2025-10-28T22:15:59.654086] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-28T22:15:59.655095] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:59.668079] [INFO ] [MAIN ] NVGS: Generated 138 derivative records from 29406 primary records. [2025-10-28T22:15:59.671349] [DEBUG] [LOCAL ] NVR: Derivative data saved (138 records). [2025-10-28T22:15:59.671592] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-28T22:15:59.670039] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-28T22:15:59.674367] [INFO ] [MAIN ] Derivative Progress: 1307/2046 symbols completed. NVR took 1.2s. Estimated remaining: 4m 59s. Rate: 148.2 symbols/min [2025-10-28T22:15:59.674638] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:59.687549] [DEBUG] [LOCAL ] NVGS: Derivative data saved (138 records). [2025-10-28T22:15:59.687904] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-28T22:15:59.690216] [INFO ] [MAIN ] Derivative Progress: 1308/2046 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 59s. Rate: 148.3 symbols/min [2025-10-28T22:15:59.690506] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:15:59.718323] [DEBUG] [LOCAL ] NVRI: Loaded 38512 existing records from primary storage. [2025-10-28T22:15:59.731007] [INFO ] [MAIN ] NVRI: Loaded 38512 primary data records. [2025-10-28T22:15:59.880529] [DEBUG] [LOCAL ] NVS: Loaded 51266 existing records from primary storage. [2025-10-28T22:15:59.919128] [INFO ] [MAIN ] NVS: Loaded 51266 primary data records. [2025-10-28T22:16:00.120528] [DEBUG] [LOCAL ] NVST: Loaded 51370 existing records from primary storage. [2025-10-28T22:16:00.133604] [INFO ] [MAIN ] NVST: Loaded 51370 primary data records. [2025-10-28T22:16:00.757961] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:00.799977] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:00.845399] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:00.859092] [INFO ] [MAIN ] NVRI: Generated 138 derivative records from 38512 primary records. [2025-10-28T22:16:00.862471] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-28T22:16:00.884541] [DEBUG] [LOCAL ] NVRI: Derivative data saved (138 records). [2025-10-28T22:16:00.888632] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-28T22:16:00.891139] [INFO ] [MAIN ] Derivative Progress: 1309/2046 symbols completed. NVRI took 1.2s. Estimated remaining: 4m 59s. Rate: 148.1 symbols/min [2025-10-28T22:16:00.895561] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:00.906713] [INFO ] [MAIN ] NVS: Generated 138 derivative records from 51266 primary records. [2025-10-28T22:16:00.907075] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-28T22:16:00.926586] [DEBUG] [LOCAL ] NVS: Derivative data saved (138 records). [2025-10-28T22:16:00.927241] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-28T22:16:00.929909] [INFO ] [MAIN ] Derivative Progress: 1310/2046 symbols completed. NVS took 1.3s. Estimated remaining: 4m 58s. Rate: 148.2 symbols/min [2025-10-28T22:16:00.932628] [INFO ] [MAIN ] NVST: Generated 138 derivative records from 51370 primary records. [2025-10-28T22:16:00.932959] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:00.933433] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-28T22:16:00.946825] [DEBUG] [LOCAL ] NVST: Derivative data saved (138 records). [2025-10-28T22:16:00.946960] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-28T22:16:00.962787] [INFO ] [MAIN ] Derivative Progress: 1311/2046 symbols completed. NVST took 1.3s. Estimated remaining: 4m 57s. Rate: 148.3 symbols/min [2025-10-28T22:16:00.963023] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:00.990058] [DEBUG] [LOCAL ] NVT: Loaded 51371 existing records from primary storage. [2025-10-28T22:16:00.990388] [INFO ] [MAIN ] NVT: Loaded 51371 primary data records. [2025-10-28T22:16:01.114834] [DEBUG] [LOCAL ] NWN: Loaded 25982 existing records from primary storage. [2025-10-28T22:16:01.172806] [DEBUG] [LOCAL ] NWG: Loaded 51335 existing records from primary storage. [2025-10-28T22:16:01.178281] [INFO ] [MAIN ] NWN: Loaded 25982 primary data records. [2025-10-28T22:16:01.225701] [INFO ] [MAIN ] NWG: Loaded 51335 primary data records. [2025-10-28T22:16:01.994272] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:02.046073] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:02.058623] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:02.138531] [INFO ] [MAIN ] NWG: Generated 138 derivative records from 51335 primary records. [2025-10-28T22:16:02.138867] [INFO ] [MAIN ] NVT: Generated 138 derivative records from 51371 primary records. [2025-10-28T22:16:02.139636] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-28T22:16:02.138944] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-28T22:16:02.157553] [INFO ] [MAIN ] NWN: Generated 138 derivative records from 25982 primary records. [2025-10-28T22:16:02.157706] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-28T22:16:02.157807] [DEBUG] [LOCAL ] NWG: Derivative data saved (138 records). [2025-10-28T22:16:02.158105] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-28T22:16:02.161205] [INFO ] [MAIN ] Derivative Progress: 1312/2046 symbols completed. NWG took 1.2s. Estimated remaining: 4m 57s. Rate: 148.0 symbols/min [2025-10-28T22:16:02.168859] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:02.174266] [DEBUG] [LOCAL ] NVT: Derivative data saved (138 records). [2025-10-28T22:16:02.185665] [DEBUG] [LOCAL ] NWN: Derivative data saved (138 records). [2025-10-28T22:16:02.185818] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-28T22:16:02.183824] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-28T22:16:02.191960] [INFO ] [MAIN ] Derivative Progress: 1313/2046 symbols completed. NVT took 1.3s. Estimated remaining: 4m 57s. Rate: 148.1 symbols/min [2025-10-28T22:16:02.194571] [INFO ] [MAIN ] Derivative Progress: 1314/2046 symbols completed. NWN took 1.2s. Estimated remaining: 4m 56s. Rate: 148.3 symbols/min [2025-10-28T22:16:02.192164] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:02.194775] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:02.206990] [DEBUG] [LOCAL ] NXC: Loaded 3980 existing records from primary storage. [2025-10-28T22:16:02.207178] [INFO ] [MAIN ] NXC: Loaded 3980 primary data records. [2025-10-28T22:16:02.305707] [DEBUG] [LOCAL ] NXDT: Loaded 14178 existing records from primary storage. [2025-10-28T22:16:02.338183] [INFO ] [MAIN ] NXDT: Loaded 14178 primary data records. [2025-10-28T22:16:02.431490] [DEBUG] [LOCAL ] NX: Loaded 32959 existing records from primary storage. [2025-10-28T22:16:02.497322] [INFO ] [MAIN ] NX: Loaded 32959 primary data records. [2025-10-28T22:16:03.279580] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:03.311912] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:03.363787] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:03.414709] [INFO ] [MAIN ] NXC: Generated 138 derivative records from 3980 primary records. [2025-10-28T22:16:03.416277] [INFO ] [MAIN ] NXDT: Generated 138 derivative records from 14178 primary records. [2025-10-28T22:16:03.416572] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-28T22:16:03.416495] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-28T22:16:03.446824] [DEBUG] [LOCAL ] NXC: Derivative data saved (138 records). [2025-10-28T22:16:03.445422] [DEBUG] [LOCAL ] NXDT: Derivative data saved (138 records). [2025-10-28T22:16:03.447017] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-28T22:16:03.447148] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-28T22:16:03.449216] [INFO ] [MAIN ] Derivative Progress: 1315/2046 symbols completed. NXC took 1.3s. Estimated remaining: 4m 56s. Rate: 148.0 symbols/min [2025-10-28T22:16:03.449458] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:03.453501] [INFO ] [MAIN ] Derivative Progress: 1316/2046 symbols completed. NXDT took 1.3s. Estimated remaining: 4m 56s. Rate: 148.1 symbols/min [2025-10-28T22:16:03.454124] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:03.457587] [INFO ] [MAIN ] NX: Generated 138 derivative records from 32959 primary records. [2025-10-28T22:16:03.457853] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-28T22:16:03.474065] [DEBUG] [LOCAL ] NX: Derivative data saved (138 records). [2025-10-28T22:16:03.474209] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-28T22:16:03.476872] [INFO ] [MAIN ] Derivative Progress: 1317/2046 symbols completed. NX took 1.3s. Estimated remaining: 4m 55s. Rate: 148.2 symbols/min [2025-10-28T22:16:03.477202] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:03.483772] [DEBUG] [LOCAL ] NXG: Loaded 10307 existing records from primary storage. [2025-10-28T22:16:03.487347] [INFO ] [MAIN ] NXG: Loaded 10307 primary data records. [2025-10-28T22:16:03.500441] [DEBUG] [LOCAL ] NXN: Loaded 2285 existing records from primary storage. [2025-10-28T22:16:03.510535] [INFO ] [MAIN ] NXN: Loaded 2285 primary data records. [2025-10-28T22:16:03.587136] [DEBUG] [LOCAL ] NXJ: Loaded 14451 existing records from primary storage. [2025-10-28T22:16:03.630282] [INFO ] [MAIN ] NXJ: Loaded 14451 primary data records. [2025-10-28T22:16:04.482249] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:04.522360] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:04.549844] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:16:04.609122] [INFO ] [MAIN ] NXG: Generated 138 derivative records from 10307 primary records. [2025-10-28T22:16:04.612518] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-28T22:16:04.628324] [DEBUG] [LOCAL ] NXG: Derivative data saved (138 records). [2025-10-28T22:16:04.628735] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-28T22:16:04.628679] [INFO ] [MAIN ] NXJ: Generated 138 derivative records from 14451 primary records. [2025-10-28T22:16:04.630900] [INFO ] [MAIN ] Derivative Progress: 1318/2046 symbols completed. NXG took 1.2s. Estimated remaining: 4m 55s. Rate: 148.0 symbols/min [2025-10-28T22:16:04.634157] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-28T22:16:04.650374] [INFO ] [MAIN ] NXN: Generated 138 derivative records from 2285 primary records. [2025-10-28T22:16:04.648359] [DEBUG] [LOCAL ] NXJ: Derivative data saved (138 records). [2025-10-28T22:16:04.650566] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-28T22:16:04.650511] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-28T22:16:04.653858] [INFO ] [MAIN ] Derivative Progress: 1319/2046 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 54s. Rate: 148.1 symbols/min [2025-10-28T22:16:04.664087] [DEBUG] [LOCAL ] NXN: Derivative data saved (138 records). [2025-10-28T22:16:04.664165] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-28T22:16:04.666778] [INFO ] [MAIN ] Derivative Progress: 1320/2046 symbols completed. NXN took 1.2s. Estimated remaining: 4m 54s. Rate: 148.2 symbols/min [2025-10-28T22:16:04.667215] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:04.667155] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:04.667299] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:04.684930] [DEBUG] [LOCAL ] NXP: Loaded 12023 existing records from primary storage. [2025-10-28T22:16:04.685151] [INFO ] [MAIN ] NXP: Loaded 12023 primary data records. [2025-10-28T22:16:04.755518] [DEBUG] [LOCAL ] NXRT: Loaded 18353 existing records from primary storage. [2025-10-28T22:16:04.784622] [INFO ] [MAIN ] NXRT: Loaded 18353 primary data records. [2025-10-28T22:16:05.181738] [DEBUG] [LOCAL ] NYT: Loaded 49242 existing records from primary storage. [2025-10-28T22:16:05.204721] [INFO ] [MAIN ] NYT: Loaded 49242 primary data records. [2025-10-28T22:16:05.796220] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:05.836279] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:05.879951] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:05.911050] [INFO ] [MAIN ] NXP: Generated 138 derivative records from 12023 primary records. [2025-10-28T22:16:05.915771] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-28T22:16:05.937796] [DEBUG] [LOCAL ] NXP: Derivative data saved (138 records). [2025-10-28T22:16:05.937938] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-28T22:16:05.940410] [INFO ] [MAIN ] Derivative Progress: 1321/2046 symbols completed. NXP took 1.3s. Estimated remaining: 4m 54s. Rate: 148.0 symbols/min [2025-10-28T22:16:05.941098] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:05.953830] [INFO ] [MAIN ] NXRT: Generated 138 derivative records from 18353 primary records. [2025-10-28T22:16:05.954316] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-28T22:16:05.971303] [DEBUG] [LOCAL ] NXRT: Derivative data saved (138 records). [2025-10-28T22:16:05.971720] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-28T22:16:05.985757] [INFO ] [MAIN ] Derivative Progress: 1322/2046 symbols completed. NXRT took 1.3s. Estimated remaining: 4m 53s. Rate: 148.1 symbols/min [2025-10-28T22:16:05.985968] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:05.983559] [INFO ] [MAIN ] NYT: Generated 138 derivative records from 49242 primary records. [2025-10-28T22:16:05.986675] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-28T22:16:06.009196] [DEBUG] [LOCAL ] NYT: Derivative data saved (138 records). [2025-10-28T22:16:06.009400] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-28T22:16:06.012306] [INFO ] [MAIN ] Derivative Progress: 1323/2046 symbols completed. NYT took 1.3s. Estimated remaining: 4m 53s. Rate: 148.2 symbols/min [2025-10-28T22:16:06.012476] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:06.013610] [DEBUG] [LOCAL ] NZF: Loaded 28206 existing records from primary storage. [2025-10-28T22:16:06.014124] [INFO ] [MAIN ] NZF: Loaded 28206 primary data records. [2025-10-28T22:16:06.155982] [DEBUG] [LOCAL ] OBK: Loaded 16242 existing records from primary storage. [2025-10-28T22:16:06.162285] [INFO ] [MAIN ] OBK: Loaded 16242 primary data records. [2025-10-28T22:16:06.370725] [DEBUG] [LOCAL ] OBDC: Loaded 51706 existing records from primary storage. [2025-10-28T22:16:06.487412] [INFO ] [MAIN ] OBDC: Loaded 51706 primary data records. [2025-10-28T22:16:07.171555] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:07.209861] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:07.252441] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:07.296972] [INFO ] [MAIN ] NZF: Generated 138 derivative records from 28206 primary records. [2025-10-28T22:16:07.299059] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-28T22:16:07.320013] [DEBUG] [LOCAL ] NZF: Derivative data saved (138 records). [2025-10-28T22:16:07.323339] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-28T22:16:07.325827] [INFO ] [MAIN ] Derivative Progress: 1324/2046 symbols completed. NZF took 1.4s. Estimated remaining: 4m 53s. Rate: 148.0 symbols/min [2025-10-28T22:16:07.329234] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:07.330020] [INFO ] [MAIN ] OBK: Generated 138 derivative records from 16242 primary records. [2025-10-28T22:16:07.331887] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-28T22:16:07.332099] [INFO ] [MAIN ] OBDC: Generated 138 derivative records from 51706 primary records. [2025-10-28T22:16:07.332326] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-28T22:16:07.358262] [DEBUG] [LOCAL ] OBK: Derivative data saved (138 records). [2025-10-28T22:16:07.358775] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-28T22:16:07.363020] [DEBUG] [LOCAL ] OBDC: Derivative data saved (138 records). [2025-10-28T22:16:07.362154] [INFO ] [MAIN ] Derivative Progress: 1325/2046 symbols completed. OBK took 1.3s. Estimated remaining: 4m 52s. Rate: 148.1 symbols/min [2025-10-28T22:16:07.363269] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-28T22:16:07.363361] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:07.366516] [INFO ] [MAIN ] Derivative Progress: 1326/2046 symbols completed. OBDC took 1.4s. Estimated remaining: 4m 52s. Rate: 148.2 symbols/min [2025-10-28T22:16:07.366711] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:07.377800] [DEBUG] [LOCAL ] OCFT: Loaded 6842 existing records from primary storage. [2025-10-28T22:16:07.382289] [INFO ] [MAIN ] OCFT: Loaded 6842 primary data records. [2025-10-28T22:16:07.382139] [DEBUG] [LOCAL ] ODC: Loaded 8632 existing records from primary storage. [2025-10-28T22:16:07.394427] [INFO ] [MAIN ] ODC: Loaded 8632 primary data records. [2025-10-28T22:16:07.620938] [DEBUG] [LOCAL ] OC: Loaded 44627 existing records from primary storage. [2025-10-28T22:16:07.664580] [INFO ] [MAIN ] OC: Loaded 44627 primary data records. [2025-10-28T22:16:08.429625] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:08.446149] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:08.491933] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:08.554012] [INFO ] [MAIN ] ODC: Generated 138 derivative records from 8632 primary records. [2025-10-28T22:16:08.556427] [INFO ] [MAIN ] OCFT: Generated 138 derivative records from 6842 primary records. [2025-10-28T22:16:08.558315] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-28T22:16:08.560004] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-28T22:16:08.583298] [DEBUG] [LOCAL ] OCFT: Derivative data saved (138 records). [2025-10-28T22:16:08.588269] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-28T22:16:08.586314] [DEBUG] [LOCAL ] ODC: Derivative data saved (138 records). [2025-10-28T22:16:08.588439] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-28T22:16:08.590567] [INFO ] [MAIN ] Derivative Progress: 1327/2046 symbols completed. OCFT took 1.2s. Estimated remaining: 4m 52s. Rate: 147.9 symbols/min [2025-10-28T22:16:08.593699] [INFO ] [MAIN ] OC: Generated 138 derivative records from 44627 primary records. [2025-10-28T22:16:08.594040] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-28T22:16:08.593380] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:08.593915] [INFO ] [MAIN ] Derivative Progress: 1328/2046 symbols completed. ODC took 1.2s. Estimated remaining: 4m 51s. Rate: 148.1 symbols/min [2025-10-28T22:16:08.594975] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:08.608264] [DEBUG] [LOCAL ] OC: Derivative data saved (138 records). [2025-10-28T22:16:08.608693] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-28T22:16:08.612241] [INFO ] [MAIN ] Derivative Progress: 1329/2046 symbols completed. OC took 1.3s. Estimated remaining: 4m 50s. Rate: 148.2 symbols/min [2025-10-28T22:16:08.612637] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:08.636402] [DEBUG] [LOCAL ] OFG: Loaded 20280 existing records from primary storage. [2025-10-28T22:16:08.636538] [INFO ] [MAIN ] OFG: Loaded 20280 primary data records. [2025-10-28T22:16:08.747345] [DEBUG] [LOCAL ] ODV: Loaded 30679 existing records from primary storage. [2025-10-28T22:16:08.783331] [INFO ] [MAIN ] ODV: Loaded 30679 primary data records. [2025-10-28T22:16:09.082987] [DEBUG] [LOCAL ] OGE: Loaded 45627 existing records from primary storage. [2025-10-28T22:16:09.100194] [INFO ] [MAIN ] OGE: Loaded 45627 primary data records. [2025-10-28T22:16:09.713791] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:09.759925] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:09.808852] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:09.836390] [INFO ] [MAIN ] OFG: Generated 138 derivative records from 20280 primary records. [2025-10-28T22:16:09.836744] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-28T22:16:09.859212] [DEBUG] [LOCAL ] OFG: Derivative data saved (138 records). [2025-10-28T22:16:09.862208] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-28T22:16:09.867502] [INFO ] [MAIN ] Derivative Progress: 1330/2046 symbols completed. OFG took 1.3s. Estimated remaining: 4m 50s. Rate: 147.9 symbols/min [2025-10-28T22:16:09.867695] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:09.864956] [INFO ] [MAIN ] ODV: Generated 138 derivative records from 30679 primary records. [2025-10-28T22:16:09.870114] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-28T22:16:09.890036] [DEBUG] [LOCAL ] ODV: Derivative data saved (138 records). [2025-10-28T22:16:09.890851] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-28T22:16:09.893998] [INFO ] [MAIN ] Derivative Progress: 1331/2046 symbols completed. ODV took 1.3s. Estimated remaining: 4m 50s. Rate: 148.0 symbols/min [2025-10-28T22:16:09.894566] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:09.902894] [INFO ] [MAIN ] OGE: Generated 138 derivative records from 45627 primary records. [2025-10-28T22:16:09.903044] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-28T22:16:09.915358] [DEBUG] [LOCAL ] OGE: Derivative data saved (138 records). [2025-10-28T22:16:09.915832] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-28T22:16:09.934390] [INFO ] [MAIN ] Derivative Progress: 1332/2046 symbols completed. OGE took 1.3s. Estimated remaining: 4m 49s. Rate: 148.1 symbols/min [2025-10-28T22:16:09.934521] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:09.971186] [DEBUG] [LOCAL ] OGS: Loaded 33598 existing records from primary storage. [2025-10-28T22:16:09.972801] [INFO ] [MAIN ] OGS: Loaded 33598 primary data records. [2025-10-28T22:16:09.973816] [DEBUG] [LOCAL ] OGN: Loaded 53104 existing records from primary storage. [2025-10-28T22:16:09.996585] [INFO ] [MAIN ] OGN: Loaded 53104 primary data records. [2025-10-28T22:16:10.295998] [DEBUG] [LOCAL ] OHI: Loaded 51753 existing records from primary storage. [2025-10-28T22:16:10.347112] [INFO ] [MAIN ] OHI: Loaded 51753 primary data records. [2025-10-28T22:16:10.968317] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:10.969263] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:11.028118] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:11.081109] [INFO ] [MAIN ] OGS: Generated 138 derivative records from 33598 primary records. [2025-10-28T22:16:11.082457] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-28T22:16:11.095738] [INFO ] [MAIN ] OGN: Generated 138 derivative records from 53104 primary records. [2025-10-28T22:16:11.096944] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-28T22:16:11.102399] [DEBUG] [LOCAL ] OGS: Derivative data saved (138 records). [2025-10-28T22:16:11.102802] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-10-28T22:16:11.112177] [INFO ] [MAIN ] Derivative Progress: 1333/2046 symbols completed. OGS took 1.2s. Estimated remaining: 4m 49s. Rate: 147.9 symbols/min [2025-10-28T22:16:11.116772] [DEBUG] [LOCAL ] OGN: Derivative data saved (138 records). [2025-10-28T22:16:11.116913] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-28T22:16:11.121905] [INFO ] [MAIN ] Derivative Progress: 1334/2046 symbols completed. OGN took 1.3s. Estimated remaining: 4m 49s. Rate: 148.0 symbols/min [2025-10-28T22:16:11.124605] [INFO ] [MAIN ] OHI: Generated 138 derivative records from 51753 primary records. [2025-10-28T22:16:11.124699] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-28T22:16:11.136249] [DEBUG] [LOCAL ] OHI: Derivative data saved (138 records). [2025-10-28T22:16:11.136305] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-28T22:16:11.138803] [INFO ] [MAIN ] Derivative Progress: 1335/2046 symbols completed. OHI took 1.2s. Estimated remaining: 4m 48s. Rate: 148.1 symbols/min [2025-10-28T22:16:11.139214] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:11.139527] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:11.139150] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:11.156469] [DEBUG] [LOCAL ] OIA: Loaded 12659 existing records from primary storage. [2025-10-28T22:16:11.156715] [INFO ] [MAIN ] OIA: Loaded 12659 primary data records. [2025-10-28T22:16:11.364816] [DEBUG] [LOCAL ] OII: Loaded 41572 existing records from primary storage. [2025-10-28T22:16:11.403145] [INFO ] [MAIN ] OII: Loaded 41572 primary data records. [2025-10-28T22:16:11.525958] [DEBUG] [LOCAL ] OI: Loaded 46799 existing records from primary storage. [2025-10-28T22:16:11.567688] [INFO ] [MAIN ] OI: Loaded 46799 primary data records. [2025-10-28T22:16:12.208621] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:12.261273] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:12.297811] [INFO ] [MAIN ] OIA: Generated 138 derivative records from 12659 primary records. [2025-10-28T22:16:12.298752] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:12.309778] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-28T22:16:12.326855] [DEBUG] [LOCAL ] OIA: Derivative data saved (138 records). [2025-10-28T22:16:12.329288] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-28T22:16:12.332045] [INFO ] [MAIN ] Derivative Progress: 1336/2046 symbols completed. OIA took 1.2s. Estimated remaining: 4m 48s. Rate: 147.9 symbols/min [2025-10-28T22:16:12.332309] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:12.374424] [INFO ] [MAIN ] OII: Generated 138 derivative records from 41572 primary records. [2025-10-28T22:16:12.374942] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-28T22:16:12.377284] [INFO ] [MAIN ] OI: Generated 138 derivative records from 46799 primary records. [2025-10-28T22:16:12.377563] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-28T22:16:12.411897] [DEBUG] [LOCAL ] OII: Derivative data saved (138 records). [2025-10-28T22:16:12.400948] [DEBUG] [LOCAL ] OI: Derivative data saved (138 records). [2025-10-28T22:16:12.412099] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-28T22:16:12.415978] [INFO ] [MAIN ] Derivative Progress: 1337/2046 symbols completed. OI took 1.3s. Estimated remaining: 4m 47s. Rate: 148.0 symbols/min [2025-10-28T22:16:12.413028] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-28T22:16:12.416160] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:12.418291] [INFO ] [MAIN ] Derivative Progress: 1338/2046 symbols completed. OII took 1.3s. Estimated remaining: 4m 47s. Rate: 148.1 symbols/min [2025-10-28T22:16:12.419554] [DEBUG] [LOCAL ] OIS: Loaded 39512 existing records from primary storage. [2025-10-28T22:16:12.418465] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:12.420101] [INFO ] [MAIN ] OIS: Loaded 39512 primary data records. [2025-10-28T22:16:12.762612] [DEBUG] [LOCAL ] OKE: Loaded 53576 existing records from primary storage. [2025-10-28T22:16:12.776448] [INFO ] [MAIN ] OKE: Loaded 53576 primary data records. [2025-10-28T22:16:12.777362] [DEBUG] [LOCAL ] OLN: Loaded 51984 existing records from primary storage. [2025-10-28T22:16:12.788808] [INFO ] [MAIN ] OLN: Loaded 51984 primary data records. [2025-10-28T22:16:13.020504] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:13.422457] [INFO ] [MAIN ] OIS: Generated 138 derivative records from 39512 primary records. [2025-10-28T22:16:13.422973] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-28T22:16:13.435458] [DEBUG] [LOCAL ] OIS: Derivative data saved (138 records). [2025-10-28T22:16:13.436437] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-28T22:16:13.439438] [INFO ] [MAIN ] Derivative Progress: 1339/2046 symbols completed. OIS took 1.1s. Estimated remaining: 4m 47s. Rate: 147.9 symbols/min [2025-10-28T22:16:13.439810] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:13.455193] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:13.467702] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:13.500468] [DEBUG] [LOCAL ] OLP: Loaded 9995 existing records from primary storage. [2025-10-28T22:16:13.500619] [INFO ] [MAIN ] OLP: Loaded 9995 primary data records. [2025-10-28T22:16:13.868961] [INFO ] [MAIN ] OKE: Generated 138 derivative records from 53576 primary records. [2025-10-28T22:16:13.870109] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-28T22:16:13.872933] [INFO ] [MAIN ] OLN: Generated 138 derivative records from 51984 primary records. [2025-10-28T22:16:13.884601] [DEBUG] [LOCAL ] OKE: Derivative data saved (138 records). [2025-10-28T22:16:13.883091] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-28T22:16:13.885291] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-28T22:16:13.888112] [INFO ] [MAIN ] Derivative Progress: 1340/2046 symbols completed. OKE took 1.5s. Estimated remaining: 4m 46s. Rate: 147.9 symbols/min [2025-10-28T22:16:13.888496] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:13.901960] [DEBUG] [LOCAL ] OLN: Derivative data saved (138 records). [2025-10-28T22:16:13.902407] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-28T22:16:13.912691] [INFO ] [MAIN ] Derivative Progress: 1341/2046 symbols completed. OLN took 1.5s. Estimated remaining: 4m 46s. Rate: 148.0 symbols/min [2025-10-28T22:16:13.918068] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:13.917789] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:13.964251] [INFO ] [MAIN ] OLP: Generated 138 derivative records from 9995 primary records. [2025-10-28T22:16:13.964519] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-28T22:16:13.985600] [DEBUG] [LOCAL ] OLP: Derivative data saved (138 records). [2025-10-28T22:16:13.985751] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-28T22:16:13.987883] [INFO ] [MAIN ] Derivative Progress: 1342/2046 symbols completed. OLP took 0.5s. Estimated remaining: 4m 45s. Rate: 148.1 symbols/min [2025-10-28T22:16:13.988102] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:14.005829] [DEBUG] [LOCAL ] OMC: Loaded 53290 existing records from primary storage. [2025-10-28T22:16:14.006497] [INFO ] [MAIN ] OMC: Loaded 53290 primary data records. [2025-10-28T22:16:14.078957] [DEBUG] [LOCAL ] OMF: Loaded 46348 existing records from primary storage. [2025-10-28T22:16:14.096697] [INFO ] [MAIN ] OMF: Loaded 46348 primary data records. [2025-10-28T22:16:14.364793] [DEBUG] [LOCAL ] OMI: Loaded 45955 existing records from primary storage. [2025-10-28T22:16:14.514823] [INFO ] [MAIN ] OMI: Loaded 45955 primary data records. [2025-10-28T22:16:14.998281] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:15.029984] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:15.079847] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:15.126594] [INFO ] [MAIN ] OMC: Generated 138 derivative records from 53290 primary records. [2025-10-28T22:16:15.127266] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-28T22:16:15.149824] [DEBUG] [LOCAL ] OMC: Derivative data saved (138 records). [2025-10-28T22:16:15.150247] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-28T22:16:15.152536] [INFO ] [MAIN ] Derivative Progress: 1343/2046 symbols completed. OMC took 1.3s. Estimated remaining: 4m 45s. Rate: 147.9 symbols/min [2025-10-28T22:16:15.153003] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:15.157824] [INFO ] [MAIN ] OMF: Generated 138 derivative records from 46348 primary records. [2025-10-28T22:16:15.158116] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-28T22:16:15.181073] [DEBUG] [LOCAL ] ONIT: Loaded 7204 existing records from primary storage. [2025-10-28T22:16:15.181565] [INFO ] [MAIN ] ONIT: Loaded 7204 primary data records. [2025-10-28T22:16:15.181475] [INFO ] [MAIN ] OMI: Generated 138 derivative records from 45955 primary records. [2025-10-28T22:16:15.205456] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-28T22:16:15.242406] [DEBUG] [LOCAL ] OMF: Derivative data saved (138 records). [2025-10-28T22:16:15.259983] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-28T22:16:15.268028] [INFO ] [MAIN ] Derivative Progress: 1344/2046 symbols completed. OMF took 1.4s. Estimated remaining: 4m 45s. Rate: 148.0 symbols/min [2025-10-28T22:16:15.276893] [DEBUG] [LOCAL ] OMI: Derivative data saved (138 records). [2025-10-28T22:16:15.301152] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-28T22:16:15.300963] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:15.307217] [INFO ] [MAIN ] Derivative Progress: 1345/2046 symbols completed. OMI took 1.3s. Estimated remaining: 4m 44s. Rate: 148.1 symbols/min [2025-10-28T22:16:15.307799] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:15.529491] [DEBUG] [LOCAL ] ONL: Loaded 28174 existing records from primary storage. [2025-10-28T22:16:15.542948] [INFO ] [MAIN ] ONL: Loaded 28174 primary data records. [2025-10-28T22:16:15.681234] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-28T22:16:15.685745] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-10-28T22:16:15.881843] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:16:16.310157] [INFO ] [MAIN ] ONIT: Generated 138 derivative records from 7204 primary records. [2025-10-28T22:16:16.310490] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-28T22:16:16.337021] [DEBUG] [LOCAL ] ONIT: Derivative data saved (138 records). [2025-10-28T22:16:16.337365] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-28T22:16:16.336953] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:16.350540] [INFO ] [MAIN ] Derivative Progress: 1346/2046 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 44s. Rate: 147.9 symbols/min [2025-10-28T22:16:16.354701] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:16.375548] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:16.410857] [DEBUG] [LOCAL ] ONTF: Loaded 22465 existing records from primary storage. [2025-10-28T22:16:16.414170] [INFO ] [MAIN ] ONTF: Loaded 22465 primary data records. [2025-10-28T22:16:16.615035] [INFO ] [MAIN ] ONL: Generated 138 derivative records from 28174 primary records. [2025-10-28T22:16:16.731939] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-28T22:16:16.753177] [DEBUG] [LOCAL ] ONL: Derivative data saved (138 records). [2025-10-28T22:16:16.753525] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-28T22:16:16.758589] [INFO ] [MAIN ] Derivative Progress: 1347/2046 symbols completed. ONL took 1.5s. Estimated remaining: 4m 44s. Rate: 147.9 symbols/min [2025-10-28T22:16:16.758854] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:16.767086] [INFO ] [MAIN ] ONON: Generated 138 derivative records from 53613 primary records. [2025-10-28T22:16:16.767331] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-28T22:16:16.781853] [DEBUG] [LOCAL ] ONON: Derivative data saved (138 records). [2025-10-28T22:16:16.782093] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-28T22:16:16.785159] [INFO ] [MAIN ] Derivative Progress: 1348/2046 symbols completed. ONON took 1.5s. Estimated remaining: 4m 43s. Rate: 148.0 symbols/min [2025-10-28T22:16:16.814346] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:16.853843] [DEBUG] [LOCAL ] ONTO: Loaded 46900 existing records from primary storage. [2025-10-28T22:16:16.856465] [INFO ] [MAIN ] ONTO: Loaded 46900 primary data records. [2025-10-28T22:16:16.931747] [INFO ] [MAIN ] ONTF: Generated 138 derivative records from 22465 primary records. [2025-10-28T22:16:16.944106] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-28T22:16:16.990664] [DEBUG] [LOCAL ] ONTF: Derivative data saved (138 records). [2025-10-28T22:16:17.000980] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-28T22:16:17.008210] [INFO ] [MAIN ] Derivative Progress: 1349/2046 symbols completed. ONTF took 0.7s. Estimated remaining: 4m 42s. Rate: 148.1 symbols/min [2025-10-28T22:16:17.202015] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:17.227048] [INFO ] [MAIN ] ONTO: Generated 138 derivative records from 46900 primary records. [2025-10-28T22:16:17.227188] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-28T22:16:17.238749] [DEBUG] [LOCAL ] ONTO: Derivative data saved (138 records). [2025-10-28T22:16:17.238811] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-28T22:16:17.241074] [INFO ] [MAIN ] Derivative Progress: 1350/2046 symbols completed. ONTO took 0.5s. Estimated remaining: 4m 42s. Rate: 148.1 symbols/min [2025-10-28T22:16:17.241795] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:17.241937] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:17.241700] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:17.289393] [DEBUG] [LOCAL ] OOMA: Loaded 18057 existing records from primary storage. [2025-10-28T22:16:17.289668] [INFO ] [MAIN ] OOMA: Loaded 18057 primary data records. [2025-10-28T22:16:17.311420] [DEBUG] [LOCAL ] OPAD: Loaded 27488 existing records from primary storage. [2025-10-28T22:16:17.333710] [INFO ] [MAIN ] OPAD: Loaded 27488 primary data records. [2025-10-28T22:16:17.457505] [DEBUG] [LOCAL ] OPFI: Loaded 45734 existing records from primary storage. [2025-10-28T22:16:17.493949] [INFO ] [MAIN ] OPFI: Loaded 45734 primary data records. [2025-10-28T22:16:18.310090] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:18.336520] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:18.374541] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:18.429708] [INFO ] [MAIN ] OPAD: Generated 138 derivative records from 27488 primary records. [2025-10-28T22:16:18.434679] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-28T22:16:18.435627] [INFO ] [MAIN ] OOMA: Generated 138 derivative records from 18057 primary records. [2025-10-28T22:16:18.443766] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-28T22:16:18.457756] [DEBUG] [LOCAL ] OPAD: Derivative data saved (138 records). [2025-10-28T22:16:18.461974] [DEBUG] [LOCAL ] OOMA: Derivative data saved (138 records). [2025-10-28T22:16:18.463575] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-28T22:16:18.463689] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-28T22:16:18.465548] [INFO ] [MAIN ] Derivative Progress: 1351/2046 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 42s. Rate: 147.9 symbols/min [2025-10-28T22:16:18.468513] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:18.469465] [INFO ] [MAIN ] Derivative Progress: 1352/2046 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 41s. Rate: 148.0 symbols/min [2025-10-28T22:16:18.470069] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:18.474832] [INFO ] [MAIN ] OPFI: Generated 138 derivative records from 45734 primary records. [2025-10-28T22:16:18.474932] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-28T22:16:18.490190] [DEBUG] [LOCAL ] OPFI: Derivative data saved (138 records). [2025-10-28T22:16:18.490337] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-28T22:16:18.493558] [INFO ] [MAIN ] Derivative Progress: 1353/2046 symbols completed. OPFI took 1.3s. Estimated remaining: 4m 41s. Rate: 148.1 symbols/min [2025-10-28T22:16:18.493892] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:18.499105] [DEBUG] [LOCAL ] OPP: Loaded 12213 existing records from primary storage. [2025-10-28T22:16:18.499353] [INFO ] [MAIN ] OPP: Loaded 12213 primary data records. [2025-10-28T22:16:18.832176] [DEBUG] [LOCAL ] ORA: Loaded 32705 existing records from primary storage. [2025-10-28T22:16:18.832351] [INFO ] [MAIN ] ORA: Loaded 32705 primary data records. [2025-10-28T22:16:18.833179] [DEBUG] [LOCAL ] OR: Loaded 46874 existing records from primary storage. [2025-10-28T22:16:18.855161] [INFO ] [MAIN ] OR: Loaded 46874 primary data records. [2025-10-28T22:16:19.476031] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:19.523753] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:19.567136] [INFO ] [MAIN ] OPP: Generated 138 derivative records from 12213 primary records. [2025-10-28T22:16:19.568738] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:19.569011] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-28T22:16:19.598824] [DEBUG] [LOCAL ] OPP: Derivative data saved (138 records). [2025-10-28T22:16:19.600075] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-28T22:16:19.602680] [INFO ] [MAIN ] Derivative Progress: 1354/2046 symbols completed. OPP took 1.1s. Estimated remaining: 4m 41s. Rate: 147.9 symbols/min [2025-10-28T22:16:19.605055] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:19.624886] [INFO ] [MAIN ] ORA: Generated 138 derivative records from 32705 primary records. [2025-10-28T22:16:19.627219] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-28T22:16:19.645122] [DEBUG] [LOCAL ] ORA: Derivative data saved (138 records). [2025-10-28T22:16:19.645279] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-28T22:16:19.648779] [INFO ] [MAIN ] Derivative Progress: 1355/2046 symbols completed. ORA took 1.2s. Estimated remaining: 4m 40s. Rate: 148.0 symbols/min [2025-10-28T22:16:19.649252] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:19.666499] [INFO ] [MAIN ] OR: Generated 138 derivative records from 46874 primary records. [2025-10-28T22:16:19.666960] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-28T22:16:19.680962] [DEBUG] [LOCAL ] OR: Derivative data saved (138 records). [2025-10-28T22:16:19.681942] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-28T22:16:19.698613] [INFO ] [MAIN ] Derivative Progress: 1356/2046 symbols completed. OR took 1.2s. Estimated remaining: 4m 40s. Rate: 148.1 symbols/min [2025-10-28T22:16:19.700403] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:19.702514] [DEBUG] [LOCAL ] ORC: Loaded 52468 existing records from primary storage. [2025-10-28T22:16:19.702729] [INFO ] [MAIN ] ORC: Loaded 52468 primary data records. [2025-10-28T22:16:19.844902] [DEBUG] [LOCAL ] ORN: Loaded 30441 existing records from primary storage. [2025-10-28T22:16:19.845220] [INFO ] [MAIN ] ORN: Loaded 30441 primary data records. [2025-10-28T22:16:20.455683] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-28T22:16:20.456535] [INFO ] [MAIN ] OSCR: Loaded 53769 primary data records. [2025-10-28T22:16:20.872582] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:20.926485] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:21.028200] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:21.029355] [INFO ] [MAIN ] ORN: Generated 138 derivative records from 30441 primary records. [2025-10-28T22:16:21.056337] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-28T22:16:21.057253] [INFO ] [MAIN ] ORC: Generated 138 derivative records from 52468 primary records. [2025-10-28T22:16:21.059330] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-28T22:16:21.099474] [DEBUG] [LOCAL ] ORN: Derivative data saved (138 records). [2025-10-28T22:16:21.099637] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-28T22:16:21.109624] [DEBUG] [LOCAL ] ORC: Derivative data saved (138 records). [2025-10-28T22:16:21.114311] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-28T22:16:21.114099] [INFO ] [MAIN ] Derivative Progress: 1357/2046 symbols completed. ORN took 1.5s. Estimated remaining: 4m 40s. Rate: 147.8 symbols/min [2025-10-28T22:16:21.119891] [INFO ] [MAIN ] Derivative Progress: 1358/2046 symbols completed. ORC took 1.5s. Estimated remaining: 4m 39s. Rate: 148.0 symbols/min [2025-10-28T22:16:21.120035] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:21.119481] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:21.138637] [INFO ] [MAIN ] OSCR: Generated 138 derivative records from 53769 primary records. [2025-10-28T22:16:21.138937] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-28T22:16:21.159868] [DEBUG] [LOCAL ] OSCR: Derivative data saved (138 records). [2025-10-28T22:16:21.160038] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-28T22:16:21.163372] [INFO ] [MAIN ] Derivative Progress: 1359/2046 symbols completed. OSCR took 1.5s. Estimated remaining: 4m 38s. Rate: 148.1 symbols/min [2025-10-28T22:16:21.163919] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:21.234505] [DEBUG] [LOCAL ] OUT: Loaded 47551 existing records from primary storage. [2025-10-28T22:16:21.253538] [INFO ] [MAIN ] OUT: Loaded 47551 primary data records. [2025-10-28T22:16:21.254981] [DEBUG] [LOCAL ] OTIS: Loaded 52671 existing records from primary storage. [2025-10-28T22:16:21.290204] [INFO ] [MAIN ] OTIS: Loaded 52671 primary data records. [2025-10-28T22:16:21.545910] [DEBUG] [LOCAL ] OVV: Loaded 53477 existing records from primary storage. [2025-10-28T22:16:21.585234] [INFO ] [MAIN ] OVV: Loaded 53477 primary data records. [2025-10-28T22:16:22.360761] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:22.448450] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:22.493075] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:22.529112] [INFO ] [MAIN ] OUT: Generated 138 derivative records from 47551 primary records. [2025-10-28T22:16:22.530624] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-28T22:16:22.555104] [DEBUG] [LOCAL ] OUT: Derivative data saved (138 records). [2025-10-28T22:16:22.556344] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-28T22:16:22.559265] [INFO ] [MAIN ] Derivative Progress: 1360/2046 symbols completed. OUT took 1.4s. Estimated remaining: 4m 39s. Rate: 147.8 symbols/min [2025-10-28T22:16:22.563276] [INFO ] [MAIN ] OTIS: Generated 138 derivative records from 52671 primary records. [2025-10-28T22:16:22.559749] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:22.564758] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-28T22:16:22.579900] [DEBUG] [LOCAL ] OTIS: Derivative data saved (138 records). [2025-10-28T22:16:22.580267] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-28T22:16:22.583784] [INFO ] [MAIN ] Derivative Progress: 1361/2046 symbols completed. OTIS took 1.5s. Estimated remaining: 4m 38s. Rate: 147.9 symbols/min [2025-10-28T22:16:22.585017] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:22.588904] [INFO ] [MAIN ] OVV: Generated 138 derivative records from 53477 primary records. [2025-10-28T22:16:22.589219] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-28T22:16:22.604345] [DEBUG] [LOCAL ] OVV: Derivative data saved (138 records). [2025-10-28T22:16:22.604473] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-28T22:16:22.607420] [INFO ] [MAIN ] Derivative Progress: 1362/2046 symbols completed. OVV took 1.4s. Estimated remaining: 4m 37s. Rate: 148.0 symbols/min [2025-10-28T22:16:22.607693] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:22.612934] [DEBUG] [LOCAL ] OWLT: Loaded 10264 existing records from primary storage. [2025-10-28T22:16:22.613060] [INFO ] [MAIN ] OWLT: Loaded 10264 primary data records. [2025-10-28T22:16:22.945387] [DEBUG] [LOCAL ] OXM: Loaded 32690 existing records from primary storage. [2025-10-28T22:16:22.953793] [INFO ] [MAIN ] OXM: Loaded 32690 primary data records. [2025-10-28T22:16:22.955184] [DEBUG] [LOCAL ] OWL: Loaded 53560 existing records from primary storage. [2025-10-28T22:16:22.967022] [INFO ] [MAIN ] OWL: Loaded 53560 primary data records. [2025-10-28T22:16:23.605576] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:16:23.649788] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:23.677366] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:23.717141] [INFO ] [MAIN ] OWLT: Generated 138 derivative records from 10264 primary records. [2025-10-28T22:16:23.723197] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-28T22:16:23.747247] [DEBUG] [LOCAL ] OWLT: Derivative data saved (138 records). [2025-10-28T22:16:23.753369] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-28T22:16:23.756210] [INFO ] [MAIN ] Derivative Progress: 1363/2046 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 37s. Rate: 147.8 symbols/min [2025-10-28T22:16:23.761249] [INFO ] [MAIN ] OWL: Generated 138 derivative records from 53560 primary records. [2025-10-28T22:16:23.761364] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-28T22:16:23.761561] [INFO ] [MAIN ] OXM: Generated 138 derivative records from 32690 primary records. [2025-10-28T22:16:23.761709] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-28T22:16:23.787144] [DEBUG] [LOCAL ] OWL: Derivative data saved (138 records). [2025-10-28T22:16:23.787282] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-28T22:16:23.789270] [INFO ] [MAIN ] Derivative Progress: 1364/2046 symbols completed. OWL took 1.2s. Estimated remaining: 4m 37s. Rate: 147.9 symbols/min [2025-10-28T22:16:23.785260] [DEBUG] [LOCAL ] OXM: Derivative data saved (138 records). [2025-10-28T22:16:23.789422] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-28T22:16:23.792235] [INFO ] [MAIN ] Derivative Progress: 1365/2046 symbols completed. OXM took 1.2s. Estimated remaining: 4m 36s. Rate: 148.0 symbols/min [2025-10-28T22:16:23.792590] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:23.792680] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:23.792799] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:23.807009] [DEBUG] [LOCAL ] PAC: Loaded 11226 existing records from primary storage. [2025-10-28T22:16:23.807145] [INFO ] [MAIN ] PAC: Loaded 11226 primary data records. [2025-10-28T22:16:24.004167] [DEBUG] [LOCAL ] PACK: Loaded 31683 existing records from primary storage. [2025-10-28T22:16:24.136213] [INFO ] [MAIN ] PACK: Loaded 31683 primary data records. [2025-10-28T22:16:24.203475] [DEBUG] [LOCAL ] PACS: Loaded 34402 existing records from primary storage. [2025-10-28T22:16:24.212610] [INFO ] [MAIN ] PACS: Loaded 34402 primary data records. [2025-10-28T22:16:24.810845] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:24.861372] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:24.891094] [INFO ] [MAIN ] PAC: Generated 138 derivative records from 11226 primary records. [2025-10-28T22:16:24.892720] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-28T22:16:24.907161] [DEBUG] [LOCAL ] PAC: Derivative data saved (138 records). [2025-10-28T22:16:24.915258] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-28T22:16:24.922310] [INFO ] [MAIN ] Derivative Progress: 1366/2046 symbols completed. PAC took 1.1s. Estimated remaining: 4m 36s. Rate: 147.8 symbols/min [2025-10-28T22:16:24.925407] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:24.926999] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:24.962239] [INFO ] [MAIN ] PACK: Generated 138 derivative records from 31683 primary records. [2025-10-28T22:16:24.962814] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-28T22:16:24.970883] [DEBUG] [LOCAL ] PAG: Loaded 20871 existing records from primary storage. [2025-10-28T22:16:24.971027] [INFO ] [MAIN ] PAG: Loaded 20871 primary data records. [2025-10-28T22:16:25.052454] [DEBUG] [LOCAL ] PACK: Derivative data saved (138 records). [2025-10-28T22:16:25.091135] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-28T22:16:25.093674] [INFO ] [MAIN ] Derivative Progress: 1367/2046 symbols completed. PACK took 1.3s. Estimated remaining: 4m 36s. Rate: 147.9 symbols/min [2025-10-28T22:16:25.097560] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:25.304932] [INFO ] [MAIN ] PACS: Generated 138 derivative records from 34402 primary records. [2025-10-28T22:16:25.305101] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-28T22:16:25.320757] [DEBUG] [LOCAL ] PACS: Derivative data saved (138 records). [2025-10-28T22:16:25.334969] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-28T22:16:25.338244] [INFO ] [MAIN ] Derivative Progress: 1368/2046 symbols completed. PACS took 1.5s. Estimated remaining: 4m 35s. Rate: 147.9 symbols/min [2025-10-28T22:16:25.338698] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:25.345892] [DEBUG] [LOCAL ] PAI: Loaded 2967 existing records from primary storage. [2025-10-28T22:16:25.346880] [INFO ] [MAIN ] PAI: Loaded 2967 primary data records. [2025-10-28T22:16:25.456395] [DEBUG] [LOCAL ] PAGS: Loaded 52787 existing records from primary storage. [2025-10-28T22:16:25.468020] [INFO ] [MAIN ] PAGS: Loaded 52787 primary data records. [2025-10-28T22:16:25.957959] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:26.023517] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:26.039832] [INFO ] [MAIN ] PAG: Generated 138 derivative records from 20871 primary records. [2025-10-28T22:16:26.049637] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-28T22:16:26.056412] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:26.067963] [DEBUG] [LOCAL ] PAG: Derivative data saved (138 records). [2025-10-28T22:16:26.070291] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-28T22:16:26.084019] [INFO ] [MAIN ] Derivative Progress: 1369/2046 symbols completed. PAG took 1.2s. Estimated remaining: 4m 35s. Rate: 147.8 symbols/min [2025-10-28T22:16:26.087371] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:26.129262] [INFO ] [MAIN ] PAI: Generated 138 derivative records from 2967 primary records. [2025-10-28T22:16:26.129862] [DEBUG] [LOCAL ] PAM: Loaded 29215 existing records from primary storage. [2025-10-28T22:16:26.130016] [INFO ] [MAIN ] PAM: Loaded 29215 primary data records. [2025-10-28T22:16:26.130094] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-28T22:16:26.256217] [DEBUG] [LOCAL ] PAI: Derivative data saved (138 records). [2025-10-28T22:16:26.256533] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-28T22:16:26.280256] [INFO ] [MAIN ] PAGS: Generated 138 derivative records from 52787 primary records. [2025-10-28T22:16:26.292798] [INFO ] [MAIN ] Derivative Progress: 1370/2046 symbols completed. PAI took 1.0s. Estimated remaining: 4m 34s. Rate: 147.9 symbols/min [2025-10-28T22:16:26.317620] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-28T22:16:26.317813] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:26.478261] [DEBUG] [LOCAL ] PAGS: Derivative data saved (138 records). [2025-10-28T22:16:26.478547] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-28T22:16:26.482011] [INFO ] [MAIN ] Derivative Progress: 1371/2046 symbols completed. PAGS took 1.4s. Estimated remaining: 4m 34s. Rate: 147.9 symbols/min [2025-10-28T22:16:26.482445] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:26.527059] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:26.550988] [DEBUG] [LOCAL ] PAR: Loaded 34132 existing records from primary storage. [2025-10-28T22:16:26.551243] [INFO ] [MAIN ] PAR: Loaded 34132 primary data records. [2025-10-28T22:16:26.653790] [DEBUG] [LOCAL ] PARR: Loaded 47790 existing records from primary storage. [2025-10-28T22:16:26.670952] [INFO ] [MAIN ] PARR: Loaded 47790 primary data records. [2025-10-28T22:16:27.210890] [INFO ] [MAIN ] PAM: Generated 138 derivative records from 29215 primary records. [2025-10-28T22:16:27.212102] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-28T22:16:27.227142] [DEBUG] [LOCAL ] PAM: Derivative data saved (138 records). [2025-10-28T22:16:27.227882] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-28T22:16:27.230012] [INFO ] [MAIN ] Derivative Progress: 1372/2046 symbols completed. PAM took 1.1s. Estimated remaining: 4m 34s. Rate: 147.8 symbols/min [2025-10-28T22:16:27.230503] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:27.250539] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:27.281999] [DEBUG] [LOCAL ] PAXS: Loaded 20453 existing records from primary storage. [2025-10-28T22:16:27.283553] [INFO ] [MAIN ] PAXS: Loaded 20453 primary data records. [2025-10-28T22:16:27.297698] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:27.646261] [INFO ] [MAIN ] PAR: Generated 138 derivative records from 34132 primary records. [2025-10-28T22:16:27.647158] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-28T22:16:27.665345] [DEBUG] [LOCAL ] PAR: Derivative data saved (138 records). [2025-10-28T22:16:27.670115] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-28T22:16:27.672270] [INFO ] [MAIN ] Derivative Progress: 1373/2046 symbols completed. PAR took 1.4s. Estimated remaining: 4m 33s. Rate: 147.8 symbols/min [2025-10-28T22:16:27.673104] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:27.680007] [INFO ] [MAIN ] PARR: Generated 138 derivative records from 47790 primary records. [2025-10-28T22:16:27.680552] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-28T22:16:27.694351] [DEBUG] [LOCAL ] PARR: Derivative data saved (138 records). [2025-10-28T22:16:27.694551] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-28T22:16:27.697429] [INFO ] [MAIN ] Derivative Progress: 1374/2046 symbols completed. PARR took 1.2s. Estimated remaining: 4m 33s. Rate: 147.9 symbols/min [2025-10-28T22:16:27.697871] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:27.725720] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:27.756549] [DEBUG] [LOCAL ] PAY: Loaded 38268 existing records from primary storage. [2025-10-28T22:16:27.767247] [INFO ] [MAIN ] PAY: Loaded 38268 primary data records. [2025-10-28T22:16:27.852589] [DEBUG] [LOCAL ] PAYC: Loaded 35569 existing records from primary storage. [2025-10-28T22:16:27.875217] [INFO ] [MAIN ] PAYC: Loaded 35569 primary data records. [2025-10-28T22:16:28.266067] [INFO ] [MAIN ] PAXS: Generated 138 derivative records from 20453 primary records. [2025-10-28T22:16:28.293278] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-28T22:16:28.430576] [DEBUG] [LOCAL ] PAXS: Derivative data saved (138 records). [2025-10-28T22:16:28.431525] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-28T22:16:28.433807] [INFO ] [MAIN ] Derivative Progress: 1375/2046 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 32s. Rate: 147.8 symbols/min [2025-10-28T22:16:28.434051] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:28.479993] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:28.480194] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:28.547095] [DEBUG] [LOCAL ] PB: Loaded 42433 existing records from primary storage. [2025-10-28T22:16:28.554427] [INFO ] [MAIN ] PB: Loaded 42433 primary data records. [2025-10-28T22:16:28.926086] [INFO ] [MAIN ] PAY: Generated 138 derivative records from 38268 primary records. [2025-10-28T22:16:28.925848] [INFO ] [MAIN ] PAYC: Generated 138 derivative records from 35569 primary records. [2025-10-28T22:16:28.926257] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-28T22:16:28.926684] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-28T22:16:28.952358] [DEBUG] [LOCAL ] PAY: Derivative data saved (138 records). [2025-10-28T22:16:28.953632] [DEBUG] [LOCAL ] PAYC: Derivative data saved (138 records). [2025-10-28T22:16:28.953811] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-28T22:16:28.953928] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-28T22:16:28.956143] [INFO ] [MAIN ] Derivative Progress: 1376/2046 symbols completed. PAY took 1.3s. Estimated remaining: 4m 32s. Rate: 147.8 symbols/min [2025-10-28T22:16:28.959437] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:28.959564] [INFO ] [MAIN ] Derivative Progress: 1377/2046 symbols completed. PAYC took 1.3s. Estimated remaining: 4m 31s. Rate: 147.9 symbols/min [2025-10-28T22:16:28.960193] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:28.981824] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:29.035830] [INFO ] [MAIN ] PB: Generated 138 derivative records from 42433 primary records. [2025-10-28T22:16:29.036014] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-28T22:16:29.048281] [DEBUG] [LOCAL ] PB: Derivative data saved (138 records). [2025-10-28T22:16:29.049309] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-28T22:16:29.051675] [INFO ] [MAIN ] Derivative Progress: 1378/2046 symbols completed. PB took 0.6s. Estimated remaining: 4m 31s. Rate: 148.0 symbols/min [2025-10-28T22:16:29.080946] [DEBUG] [LOCAL ] PBA: Loaded 48986 existing records from primary storage. [2025-10-28T22:16:29.082086] [INFO ] [MAIN ] PBA: Loaded 48986 primary data records. [2025-10-28T22:16:29.083052] [DEBUG] [LOCAL ] PBF: Loaded 53092 existing records from primary storage. [2025-10-28T22:16:29.126263] [INFO ] [MAIN ] PBF: Loaded 53092 primary data records. [2025-10-28T22:16:29.707478] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:29.735734] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:29.776575] [INFO ] [MAIN ] PBA: Generated 138 derivative records from 48986 primary records. [2025-10-28T22:16:29.777785] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-28T22:16:29.793503] [INFO ] [MAIN ] PBF: Generated 138 derivative records from 53092 primary records. [2025-10-28T22:16:29.794246] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-28T22:16:29.795147] [DEBUG] [LOCAL ] PBA: Derivative data saved (138 records). [2025-10-28T22:16:29.795400] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-28T22:16:29.797518] [INFO ] [MAIN ] Derivative Progress: 1379/2046 symbols completed. PBA took 0.8s. Estimated remaining: 4m 31s. Rate: 147.9 symbols/min [2025-10-28T22:16:29.810711] [DEBUG] [LOCAL ] PBF: Derivative data saved (138 records). [2025-10-28T22:16:29.810807] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-28T22:16:29.812997] [INFO ] [MAIN ] Derivative Progress: 1380/2046 symbols completed. PBF took 0.9s. Estimated remaining: 4m 30s. Rate: 148.0 symbols/min [2025-10-28T22:16:29.813431] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:29.813521] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:29.813372] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:29.844581] [DEBUG] [LOCAL ] PBH: Loaded 32203 existing records from primary storage. [2025-10-28T22:16:29.854069] [INFO ] [MAIN ] PBH: Loaded 32203 primary data records. [2025-10-28T22:16:30.006201] [DEBUG] [LOCAL ] PBI: Loaded 49833 existing records from primary storage. [2025-10-28T22:16:30.017784] [INFO ] [MAIN ] PBI: Loaded 49833 primary data records. [2025-10-28T22:16:30.048924] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-28T22:16:30.096949] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-10-28T22:16:30.904463] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:30.962311] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:30.975204] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:31.029277] [INFO ] [MAIN ] PBH: Generated 138 derivative records from 32203 primary records. [2025-10-28T22:16:31.031134] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-28T22:16:31.051254] [DEBUG] [LOCAL ] PBH: Derivative data saved (138 records). [2025-10-28T22:16:31.051673] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-28T22:16:31.054772] [INFO ] [MAIN ] Derivative Progress: 1381/2046 symbols completed. PBH took 1.2s. Estimated remaining: 4m 30s. Rate: 147.8 symbols/min [2025-10-28T22:16:31.056792] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:31.059842] [INFO ] [MAIN ] PBI: Generated 138 derivative records from 49833 primary records. [2025-10-28T22:16:31.062599] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-28T22:16:31.067054] [INFO ] [MAIN ] PBR: Generated 138 derivative records from 53713 primary records. [2025-10-28T22:16:31.080727] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-28T22:16:31.083428] [DEBUG] [LOCAL ] PBI: Derivative data saved (138 records). [2025-10-28T22:16:31.084066] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-28T22:16:31.086981] [INFO ] [MAIN ] Derivative Progress: 1382/2046 symbols completed. PBI took 1.3s. Estimated remaining: 4m 29s. Rate: 147.9 symbols/min [2025-10-28T22:16:31.096296] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:31.099784] [DEBUG] [LOCAL ] PBR: Derivative data saved (138 records). [2025-10-28T22:16:31.105980] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-28T22:16:31.109169] [INFO ] [MAIN ] Derivative Progress: 1383/2046 symbols completed. PBR took 1.3s. Estimated remaining: 4m 29s. Rate: 148.0 symbols/min [2025-10-28T22:16:31.109410] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:31.106320] [DEBUG] [LOCAL ] PBT: Loaded 17051 existing records from primary storage. [2025-10-28T22:16:31.110123] [INFO ] [MAIN ] PBT: Loaded 17051 primary data records. [2025-10-28T22:16:31.197490] [DEBUG] [LOCAL ] PCF: Loaded 8935 existing records from primary storage. [2025-10-28T22:16:31.219120] [INFO ] [MAIN ] PCF: Loaded 8935 primary data records. [2025-10-28T22:16:31.765578] [DEBUG] [LOCAL ] PCG: Loaded 53719 existing records from primary storage. [2025-10-28T22:16:31.766261] [INFO ] [MAIN ] PCG: Loaded 53719 primary data records. [2025-10-28T22:16:32.109341] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:32.143790] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:16:32.217557] [DEBUG] [MAIN ] PCG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:32.232059] [INFO ] [MAIN ] PBT: Generated 138 derivative records from 17051 primary records. [2025-10-28T22:16:32.233825] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-28T22:16:32.253371] [DEBUG] [LOCAL ] PBT: Derivative data saved (138 records). [2025-10-28T22:16:32.253043] [INFO ] [MAIN ] PCF: Generated 138 derivative records from 8935 primary records. [2025-10-28T22:16:32.253988] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-28T22:16:32.254227] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-28T22:16:32.259341] [INFO ] [MAIN ] Derivative Progress: 1384/2046 symbols completed. PBT took 1.2s. Estimated remaining: 4m 29s. Rate: 147.8 symbols/min [2025-10-28T22:16:32.259990] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:32.272511] [DEBUG] [LOCAL ] PCF: Derivative data saved (138 records). [2025-10-28T22:16:32.273706] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-28T22:16:32.276321] [INFO ] [MAIN ] Derivative Progress: 1385/2046 symbols completed. PCF took 1.2s. Estimated remaining: 4m 28s. Rate: 147.9 symbols/min [2025-10-28T22:16:32.278585] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:32.290530] [DEBUG] [LOCAL ] PCM: Loaded 6740 existing records from primary storage. [2025-10-28T22:16:32.292215] [INFO ] [MAIN ] PCM: Loaded 6740 primary data records. [2025-10-28T22:16:32.421562] [INFO ] [MAIN ] PCG: Generated 138 derivative records from 53719 primary records. [2025-10-28T22:16:32.428005] [DEBUG] [LOCAL ] PCN: Loaded 24966 existing records from primary storage. [2025-10-28T22:16:32.433553] [INFO ] [MAIN ] PCN: Loaded 24966 primary data records. [2025-10-28T22:16:32.433478] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-10-28T22:16:32.722441] [DEBUG] [LOCAL ] PCG: Derivative data saved (138 records). [2025-10-28T22:16:32.726265] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-10-28T22:16:32.728579] [INFO ] [MAIN ] Derivative Progress: 1386/2046 symbols completed. PCG took 1.6s. Estimated remaining: 4m 28s. Rate: 147.9 symbols/min [2025-10-28T22:16:32.729290] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:33.004158] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:33.033043] [DEBUG] [LOCAL ] PCOR: Loaded 47096 existing records from primary storage. [2025-10-28T22:16:33.035347] [INFO ] [MAIN ] PCOR: Loaded 47096 primary data records. [2025-10-28T22:16:33.338008] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:33.391476] [INFO ] [MAIN ] PCM: Generated 138 derivative records from 6740 primary records. [2025-10-28T22:16:33.393543] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-28T22:16:33.410128] [DEBUG] [LOCAL ] PCM: Derivative data saved (138 records). [2025-10-28T22:16:33.410397] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-28T22:16:33.412680] [INFO ] [MAIN ] Derivative Progress: 1387/2046 symbols completed. PCM took 1.2s. Estimated remaining: 4m 27s. Rate: 147.8 symbols/min [2025-10-28T22:16:33.413253] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:33.434343] [DEBUG] [LOCAL ] PCQ: Loaded 11878 existing records from primary storage. [2025-10-28T22:16:33.449861] [INFO ] [MAIN ] PCQ: Loaded 11878 primary data records. [2025-10-28T22:16:33.449763] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:33.522061] [INFO ] [MAIN ] PCN: Generated 138 derivative records from 24966 primary records. [2025-10-28T22:16:33.561155] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-28T22:16:33.595236] [DEBUG] [LOCAL ] PCN: Derivative data saved (138 records). [2025-10-28T22:16:33.600734] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-28T22:16:33.634965] [INFO ] [MAIN ] Derivative Progress: 1388/2046 symbols completed. PCN took 1.4s. Estimated remaining: 4m 27s. Rate: 147.9 symbols/min [2025-10-28T22:16:33.795986] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:33.812192] [INFO ] [MAIN ] PCOR: Generated 138 derivative records from 47096 primary records. [2025-10-28T22:16:33.812448] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-28T22:16:33.826512] [DEBUG] [LOCAL ] PCOR: Derivative data saved (138 records). [2025-10-28T22:16:33.826886] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-28T22:16:33.829220] [INFO ] [MAIN ] Derivative Progress: 1389/2046 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 26s. Rate: 147.9 symbols/min [2025-10-28T22:16:33.829574] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:33.858365] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:33.889943] [DEBUG] [LOCAL ] PD: Loaded 48145 existing records from primary storage. [2025-10-28T22:16:33.892852] [INFO ] [MAIN ] PD: Loaded 48145 primary data records. [2025-10-28T22:16:34.152862] [DEBUG] [LOCAL ] PDI: Loaded 50163 existing records from primary storage. [2025-10-28T22:16:34.226237] [INFO ] [MAIN ] PDI: Loaded 50163 primary data records. [2025-10-28T22:16:34.285898] [INFO ] [MAIN ] PCQ: Generated 138 derivative records from 11878 primary records. [2025-10-28T22:16:34.313122] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-28T22:16:34.424605] [DEBUG] [LOCAL ] PCQ: Derivative data saved (138 records). [2025-10-28T22:16:34.537858] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-28T22:16:34.540325] [INFO ] [MAIN ] Derivative Progress: 1390/2046 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 26s. Rate: 147.8 symbols/min [2025-10-28T22:16:34.540867] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:34.561639] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:34.611276] [DEBUG] [LOCAL ] PDM: Loaded 39412 existing records from primary storage. [2025-10-28T22:16:34.623930] [INFO ] [MAIN ] PDM: Loaded 39412 primary data records. [2025-10-28T22:16:34.638311] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:34.845726] [INFO ] [MAIN ] PD: Generated 138 derivative records from 48145 primary records. [2025-10-28T22:16:34.963663] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-28T22:16:34.987075] [DEBUG] [LOCAL ] PD: Derivative data saved (138 records). [2025-10-28T22:16:34.987843] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-28T22:16:34.990211] [INFO ] [MAIN ] Derivative Progress: 1391/2046 symbols completed. PD took 1.2s. Estimated remaining: 4m 26s. Rate: 147.8 symbols/min [2025-10-28T22:16:34.993812] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:34.999562] [INFO ] [MAIN ] PDI: Generated 138 derivative records from 50163 primary records. [2025-10-28T22:16:34.999962] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-28T22:16:35.013451] [DEBUG] [LOCAL ] PDI: Derivative data saved (138 records). [2025-10-28T22:16:35.013553] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-28T22:16:35.016083] [INFO ] [MAIN ] Derivative Progress: 1392/2046 symbols completed. PDI took 1.2s. Estimated remaining: 4m 25s. Rate: 147.9 symbols/min [2025-10-28T22:16:35.016458] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:35.045992] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:35.071672] [DEBUG] [LOCAL ] PDS: Loaded 16034 existing records from primary storage. [2025-10-28T22:16:35.073916] [INFO ] [MAIN ] PDS: Loaded 16034 primary data records. [2025-10-28T22:16:35.074587] [DEBUG] [LOCAL ] PDO: Loaded 30847 existing records from primary storage. [2025-10-28T22:16:35.095675] [INFO ] [MAIN ] PDO: Loaded 30847 primary data records. [2025-10-28T22:16:35.734785] [INFO ] [MAIN ] PDM: Generated 138 derivative records from 39412 primary records. [2025-10-28T22:16:35.735085] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-28T22:16:35.748135] [DEBUG] [LOCAL ] PDM: Derivative data saved (138 records). [2025-10-28T22:16:35.748261] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-28T22:16:35.750592] [INFO ] [MAIN ] Derivative Progress: 1393/2046 symbols completed. PDM took 1.2s. Estimated remaining: 4m 25s. Rate: 147.8 symbols/min [2025-10-28T22:16:35.787233] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:35.798240] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:35.851493] [INFO ] [MAIN ] PDO: Generated 138 derivative records from 30847 primary records. [2025-10-28T22:16:35.852802] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-28T22:16:35.855329] [INFO ] [MAIN ] PDS: Generated 138 derivative records from 16034 primary records. [2025-10-28T22:16:35.862830] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-28T22:16:35.867723] [DEBUG] [LOCAL ] PDO: Derivative data saved (138 records). [2025-10-28T22:16:35.867815] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-28T22:16:35.870224] [INFO ] [MAIN ] Derivative Progress: 1394/2046 symbols completed. PDO took 0.9s. Estimated remaining: 4m 24s. Rate: 147.9 symbols/min [2025-10-28T22:16:35.881538] [DEBUG] [LOCAL ] PDS: Derivative data saved (138 records). [2025-10-28T22:16:35.881628] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-28T22:16:35.884126] [INFO ] [MAIN ] Derivative Progress: 1395/2046 symbols completed. PDS took 0.9s. Estimated remaining: 4m 24s. Rate: 148.0 symbols/min [2025-10-28T22:16:35.884531] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:35.884629] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:35.884754] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:35.903322] [DEBUG] [LOCAL ] PDX: Loaded 13733 existing records from primary storage. [2025-10-28T22:16:35.903479] [INFO ] [MAIN ] PDX: Loaded 13733 primary data records. [2025-10-28T22:16:35.945090] [DEBUG] [LOCAL ] PDT: Loaded 17334 existing records from primary storage. [2025-10-28T22:16:35.952180] [INFO ] [MAIN ] PDT: Loaded 17334 primary data records. [2025-10-28T22:16:36.364407] [DEBUG] [LOCAL ] PEB: Loaded 50640 existing records from primary storage. [2025-10-28T22:16:36.402527] [INFO ] [MAIN ] PEB: Loaded 50640 primary data records. [2025-10-28T22:16:36.866583] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:36.884367] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:36.933205] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:36.988029] [INFO ] [MAIN ] PDX: Generated 138 derivative records from 13733 primary records. [2025-10-28T22:16:36.991064] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-28T22:16:37.010735] [DEBUG] [LOCAL ] PDX: Derivative data saved (138 records). [2025-10-28T22:16:37.011330] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-28T22:16:37.011048] [INFO ] [MAIN ] PDT: Generated 138 derivative records from 17334 primary records. [2025-10-28T22:16:37.011555] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-28T22:16:37.013778] [INFO ] [MAIN ] Derivative Progress: 1396/2046 symbols completed. PDX took 1.1s. Estimated remaining: 4m 24s. Rate: 147.8 symbols/min [2025-10-28T22:16:37.016729] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:37.030761] [INFO ] [MAIN ] PEB: Generated 138 derivative records from 50640 primary records. [2025-10-28T22:16:37.030979] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-28T22:16:37.030261] [DEBUG] [LOCAL ] PDT: Derivative data saved (138 records). [2025-10-28T22:16:37.032187] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-28T22:16:37.034674] [INFO ] [MAIN ] Derivative Progress: 1397/2046 symbols completed. PDT took 1.2s. Estimated remaining: 4m 23s. Rate: 147.9 symbols/min [2025-10-28T22:16:37.035107] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:37.047233] [DEBUG] [LOCAL ] PEB: Derivative data saved (138 records). [2025-10-28T22:16:37.047676] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-28T22:16:37.050561] [INFO ] [MAIN ] Derivative Progress: 1398/2046 symbols completed. PEB took 1.2s. Estimated remaining: 4m 23s. Rate: 148.0 symbols/min [2025-10-28T22:16:37.051008] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:37.063008] [DEBUG] [LOCAL ] PEO: Loaded 10885 existing records from primary storage. [2025-10-28T22:16:37.070437] [INFO ] [MAIN ] PEO: Loaded 10885 primary data records. [2025-10-28T22:16:37.169774] [DEBUG] [LOCAL ] PEN: Loaded 29229 existing records from primary storage. [2025-10-28T22:16:37.193134] [INFO ] [MAIN ] PEN: Loaded 29229 primary data records. [2025-10-28T22:16:37.344899] [DEBUG] [LOCAL ] PEG: Loaded 53104 existing records from primary storage. [2025-10-28T22:16:37.358316] [INFO ] [MAIN ] PEG: Loaded 53104 primary data records. [2025-10-28T22:16:38.051111] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:38.078096] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:38.128858] [DEBUG] [MAIN ] PEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:38.180294] [INFO ] [MAIN ] PEO: Generated 138 derivative records from 10885 primary records. [2025-10-28T22:16:38.180785] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-28T22:16:38.194228] [INFO ] [MAIN ] PEN: Generated 138 derivative records from 29229 primary records. [2025-10-28T22:16:38.198600] [DEBUG] [LOCAL ] PEO: Derivative data saved (138 records). [2025-10-28T22:16:38.198895] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-28T22:16:38.198382] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-28T22:16:38.201028] [INFO ] [MAIN ] Derivative Progress: 1399/2046 symbols completed. PEO took 1.2s. Estimated remaining: 4m 23s. Rate: 147.8 symbols/min [2025-10-28T22:16:38.201814] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:38.218172] [DEBUG] [LOCAL ] PEN: Derivative data saved (138 records). [2025-10-28T22:16:38.218425] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-28T22:16:38.222188] [INFO ] [MAIN ] Derivative Progress: 1400/2046 symbols completed. PEN took 1.2s. Estimated remaining: 4m 22s. Rate: 147.9 symbols/min [2025-10-28T22:16:38.225993] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:38.226540] [INFO ] [MAIN ] PEG: Generated 138 derivative records from 53104 primary records. [2025-10-28T22:16:38.226723] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-10-28T22:16:38.245629] [DEBUG] [LOCAL ] PERF: Loaded 14651 existing records from primary storage. [2025-10-28T22:16:38.248216] [DEBUG] [LOCAL ] PFD: Loaded 5200 existing records from primary storage. [2025-10-28T22:16:38.248306] [INFO ] [MAIN ] PERF: Loaded 14651 primary data records. [2025-10-28T22:16:38.245363] [DEBUG] [LOCAL ] PEG: Derivative data saved (138 records). [2025-10-28T22:16:38.253807] [INFO ] [MAIN ] PFD: Loaded 5200 primary data records. [2025-10-28T22:16:38.260047] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-10-28T22:16:38.288788] [INFO ] [MAIN ] Derivative Progress: 1401/2046 symbols completed. PEG took 1.3s. Estimated remaining: 4m 21s. Rate: 148.0 symbols/min [2025-10-28T22:16:38.298111] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:38.876721] [DEBUG] [LOCAL ] PFGC: Loaded 46489 existing records from primary storage. [2025-10-28T22:16:38.878295] [INFO ] [MAIN ] PFGC: Loaded 46489 primary data records. [2025-10-28T22:16:39.031380] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:39.109334] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:39.336501] [INFO ] [MAIN ] PERF: Generated 138 derivative records from 14651 primary records. [2025-10-28T22:16:39.334189] [INFO ] [MAIN ] PFD: Generated 138 derivative records from 5200 primary records. [2025-10-28T22:16:39.337585] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-28T22:16:39.336794] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-28T22:16:39.376205] [DEBUG] [LOCAL ] PFD: Derivative data saved (138 records). [2025-10-28T22:16:39.368955] [DEBUG] [LOCAL ] PERF: Derivative data saved (138 records). [2025-10-28T22:16:39.376483] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-28T22:16:39.376346] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-28T22:16:39.378611] [INFO ] [MAIN ] Derivative Progress: 1402/2046 symbols completed. PERF took 1.2s. Estimated remaining: 4m 21s. Rate: 147.8 symbols/min [2025-10-28T22:16:39.382071] [INFO ] [MAIN ] Derivative Progress: 1403/2046 symbols completed. PFD took 1.2s. Estimated remaining: 4m 21s. Rate: 148.0 symbols/min [2025-10-28T22:16:39.379289] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:39.379416] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:39.382346] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:39.422554] [DEBUG] [LOCAL ] PFH: Loaded 6345 existing records from primary storage. [2025-10-28T22:16:39.422994] [DEBUG] [LOCAL ] PFL: Loaded 13921 existing records from primary storage. [2025-10-28T22:16:39.423094] [INFO ] [MAIN ] PFH: Loaded 6345 primary data records. [2025-10-28T22:16:39.423214] [INFO ] [MAIN ] PFL: Loaded 13921 primary data records. [2025-10-28T22:16:40.057708] [INFO ] [MAIN ] PFGC: Generated 138 derivative records from 46489 primary records. [2025-10-28T22:16:40.059104] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-28T22:16:40.075852] [DEBUG] [LOCAL ] PFGC: Derivative data saved (138 records). [2025-10-28T22:16:40.076417] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-28T22:16:40.079147] [INFO ] [MAIN ] Derivative Progress: 1404/2046 symbols completed. PFGC took 1.8s. Estimated remaining: 4m 20s. Rate: 147.9 symbols/min [2025-10-28T22:16:40.080636] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:40.104596] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:40.135037] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:40.188471] [DEBUG] [LOCAL ] PFLT: Loaded 44018 existing records from primary storage. [2025-10-28T22:16:40.194368] [INFO ] [MAIN ] PFLT: Loaded 44018 primary data records. [2025-10-28T22:16:40.346462] [INFO ] [MAIN ] PFL: Generated 138 derivative records from 13921 primary records. [2025-10-28T22:16:40.381003] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-28T22:16:40.519570] [DEBUG] [LOCAL ] PFL: Derivative data saved (138 records). [2025-10-28T22:16:40.519975] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-28T22:16:40.522033] [INFO ] [MAIN ] Derivative Progress: 1405/2046 symbols completed. PFL took 1.1s. Estimated remaining: 4m 20s. Rate: 147.9 symbols/min [2025-10-28T22:16:40.525360] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:40.532518] [INFO ] [MAIN ] PFH: Generated 138 derivative records from 6345 primary records. [2025-10-28T22:16:40.532711] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-28T22:16:40.546306] [DEBUG] [LOCAL ] PFH: Derivative data saved (138 records). [2025-10-28T22:16:40.546599] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-28T22:16:40.549303] [INFO ] [MAIN ] Derivative Progress: 1406/2046 symbols completed. PFH took 1.2s. Estimated remaining: 4m 20s. Rate: 148.0 symbols/min [2025-10-28T22:16:40.554458] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:40.565468] [DEBUG] [LOCAL ] PFN: Loaded 21635 existing records from primary storage. [2025-10-28T22:16:40.565863] [INFO ] [MAIN ] PFN: Loaded 21635 primary data records. [2025-10-28T22:16:40.614407] [DEBUG] [LOCAL ] PFO: Loaded 6007 existing records from primary storage. [2025-10-28T22:16:40.642141] [INFO ] [MAIN ] PFO: Loaded 6007 primary data records. [2025-10-28T22:16:40.725992] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:41.312499] [INFO ] [MAIN ] PFLT: Generated 138 derivative records from 44018 primary records. [2025-10-28T22:16:41.313082] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-28T22:16:41.326473] [DEBUG] [LOCAL ] PFLT: Derivative data saved (138 records). [2025-10-28T22:16:41.327572] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-28T22:16:41.330845] [INFO ] [MAIN ] Derivative Progress: 1407/2046 symbols completed. PFLT took 1.3s. Estimated remaining: 4m 19s. Rate: 147.9 symbols/min [2025-10-28T22:16:41.331268] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:41.347515] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:41.379620] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:41.425274] [DEBUG] [LOCAL ] PFSI: Loaded 28803 existing records from primary storage. [2025-10-28T22:16:41.425833] [INFO ] [MAIN ] PFSI: Loaded 28803 primary data records. [2025-10-28T22:16:41.744792] [INFO ] [MAIN ] PFN: Generated 138 derivative records from 21635 primary records. [2025-10-28T22:16:41.747324] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-28T22:16:41.764293] [INFO ] [MAIN ] PFO: Generated 138 derivative records from 6007 primary records. [2025-10-28T22:16:41.763578] [DEBUG] [LOCAL ] PFN: Derivative data saved (138 records). [2025-10-28T22:16:41.764611] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-28T22:16:41.765350] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-28T22:16:41.767719] [INFO ] [MAIN ] Derivative Progress: 1408/2046 symbols completed. PFN took 1.2s. Estimated remaining: 4m 19s. Rate: 147.9 symbols/min [2025-10-28T22:16:41.779236] [DEBUG] [LOCAL ] PFO: Derivative data saved (138 records). [2025-10-28T22:16:41.779316] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-28T22:16:41.781830] [INFO ] [MAIN ] Derivative Progress: 1409/2046 symbols completed. PFO took 1.2s. Estimated remaining: 4m 18s. Rate: 148.0 symbols/min [2025-10-28T22:16:41.802193] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:41.829353] [INFO ] [MAIN ] PFSI: Generated 138 derivative records from 28803 primary records. [2025-10-28T22:16:41.829470] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-28T22:16:41.841008] [DEBUG] [LOCAL ] PFSI: Derivative data saved (138 records). [2025-10-28T22:16:41.841065] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-28T22:16:41.843469] [INFO ] [MAIN ] Derivative Progress: 1410/2046 symbols completed. PFSI took 0.5s. Estimated remaining: 4m 18s. Rate: 148.1 symbols/min [2025-10-28T22:16:41.843939] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:41.844295] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:41.843874] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:41.853187] [DEBUG] [LOCAL ] PGP: Loaded 5651 existing records from primary storage. [2025-10-28T22:16:41.853513] [INFO ] [MAIN ] PGP: Loaded 5651 primary data records. [2025-10-28T22:16:42.196449] [DEBUG] [LOCAL ] PGRE: Loaded 46802 existing records from primary storage. [2025-10-28T22:16:42.196767] [INFO ] [MAIN ] PGRE: Loaded 46802 primary data records. [2025-10-28T22:16:42.321697] [DEBUG] [LOCAL ] PGR: Loaded 52858 existing records from primary storage. [2025-10-28T22:16:42.322739] [INFO ] [MAIN ] PGR: Loaded 52858 primary data records. [2025-10-28T22:16:42.838144] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:42.884965] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:42.929264] [DEBUG] [MAIN ] PGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:42.948319] [INFO ] [MAIN ] PGP: Generated 138 derivative records from 5651 primary records. [2025-10-28T22:16:42.950333] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-28T22:16:42.967269] [DEBUG] [LOCAL ] PGP: Derivative data saved (138 records). [2025-10-28T22:16:42.967427] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-28T22:16:42.969954] [INFO ] [MAIN ] Derivative Progress: 1411/2046 symbols completed. PGP took 1.1s. Estimated remaining: 4m 18s. Rate: 147.9 symbols/min [2025-10-28T22:16:42.970287] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:42.987768] [DEBUG] [LOCAL ] PGZ: Loaded 5417 existing records from primary storage. [2025-10-28T22:16:42.989981] [INFO ] [MAIN ] PGZ: Loaded 5417 primary data records. [2025-10-28T22:16:43.078220] [INFO ] [MAIN ] PGRE: Generated 138 derivative records from 46802 primary records. [2025-10-28T22:16:43.094946] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-28T22:16:43.134582] [DEBUG] [LOCAL ] PGRE: Derivative data saved (138 records). [2025-10-28T22:16:43.158794] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-28T22:16:43.301948] [INFO ] [MAIN ] Derivative Progress: 1412/2046 symbols completed. PGRE took 1.5s. Estimated remaining: 4m 17s. Rate: 147.9 symbols/min [2025-10-28T22:16:43.300067] [INFO ] [MAIN ] PGR: Generated 138 derivative records from 52858 primary records. [2025-10-28T22:16:43.302229] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:43.302293] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-28T22:16:43.368247] [DEBUG] [LOCAL ] PGR: Derivative data saved (138 records). [2025-10-28T22:16:43.368917] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-10-28T22:16:43.371684] [INFO ] [MAIN ] Derivative Progress: 1413/2046 symbols completed. PGR took 1.5s. Estimated remaining: 4m 17s. Rate: 148.0 symbols/min [2025-10-28T22:16:43.371877] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:43.412805] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:43.425387] [DEBUG] [LOCAL ] PH: Loaded 35877 existing records from primary storage. [2025-10-28T22:16:43.427493] [INFO ] [MAIN ] PH: Loaded 35877 primary data records. [2025-10-28T22:16:43.557264] [DEBUG] [LOCAL ] PHG: Loaded 45218 existing records from primary storage. [2025-10-28T22:16:43.568169] [INFO ] [MAIN ] PHG: Loaded 45218 primary data records. [2025-10-28T22:16:44.070177] [INFO ] [MAIN ] PGZ: Generated 138 derivative records from 5417 primary records. [2025-10-28T22:16:44.070470] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-28T22:16:44.084885] [DEBUG] [LOCAL ] PGZ: Derivative data saved (138 records). [2025-10-28T22:16:44.085387] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-28T22:16:44.088073] [INFO ] [MAIN ] Derivative Progress: 1414/2046 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 16s. Rate: 147.9 symbols/min [2025-10-28T22:16:44.088416] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:44.112418] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:44.135006] [DEBUG] [LOCAL ] PHI: Loaded 15150 existing records from primary storage. [2025-10-28T22:16:44.135374] [INFO ] [MAIN ] PHI: Loaded 15150 primary data records. [2025-10-28T22:16:44.258158] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:44.516742] [INFO ] [MAIN ] PH: Generated 138 derivative records from 35877 primary records. [2025-10-28T22:16:44.517768] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-28T22:16:44.533479] [DEBUG] [LOCAL ] PH: Derivative data saved (138 records). [2025-10-28T22:16:44.535151] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-10-28T22:16:44.540669] [INFO ] [MAIN ] Derivative Progress: 1415/2046 symbols completed. PH took 1.2s. Estimated remaining: 4m 16s. Rate: 147.9 symbols/min [2025-10-28T22:16:44.554564] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:44.556156] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:44.573521] [INFO ] [MAIN ] PHG: Generated 138 derivative records from 45218 primary records. [2025-10-28T22:16:44.573798] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-28T22:16:44.592390] [DEBUG] [LOCAL ] PHG: Derivative data saved (138 records). [2025-10-28T22:16:44.594049] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-28T22:16:44.597101] [INFO ] [MAIN ] Derivative Progress: 1416/2046 symbols completed. PHG took 1.2s. Estimated remaining: 4m 15s. Rate: 148.0 symbols/min [2025-10-28T22:16:44.601207] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:44.635807] [DEBUG] [LOCAL ] PHIN: Loaded 31139 existing records from primary storage. [2025-10-28T22:16:44.636180] [INFO ] [MAIN ] PHIN: Loaded 31139 primary data records. [2025-10-28T22:16:44.636384] [INFO ] [MAIN ] PHI: Generated 138 derivative records from 15150 primary records. [2025-10-28T22:16:44.636554] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-28T22:16:44.780818] [DEBUG] [LOCAL ] PHK: Loaded 26182 existing records from primary storage. [2025-10-28T22:16:44.785372] [DEBUG] [LOCAL ] PHI: Derivative data saved (138 records). [2025-10-28T22:16:44.790747] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-28T22:16:44.803315] [INFO ] [MAIN ] Derivative Progress: 1417/2046 symbols completed. PHI took 0.7s. Estimated remaining: 4m 15s. Rate: 148.0 symbols/min [2025-10-28T22:16:44.808553] [INFO ] [MAIN ] PHK: Loaded 26182 primary data records. [2025-10-28T22:16:45.009102] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:45.380191] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:45.410870] [DEBUG] [LOCAL ] PHM: Loaded 51674 existing records from primary storage. [2025-10-28T22:16:45.412688] [INFO ] [MAIN ] PHM: Loaded 51674 primary data records. [2025-10-28T22:16:45.729957] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:45.766581] [INFO ] [MAIN ] PHIN: Generated 138 derivative records from 31139 primary records. [2025-10-28T22:16:45.769468] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-28T22:16:45.787744] [DEBUG] [LOCAL ] PHIN: Derivative data saved (138 records). [2025-10-28T22:16:45.788516] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-28T22:16:45.791568] [INFO ] [MAIN ] Derivative Progress: 1418/2046 symbols completed. PHIN took 1.2s. Estimated remaining: 4m 15s. Rate: 147.9 symbols/min [2025-10-28T22:16:45.791839] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:45.807662] [DEBUG] [MAIN ] PHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:45.824916] [INFO ] [MAIN ] PHK: Generated 138 derivative records from 26182 primary records. [2025-10-28T22:16:45.826286] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-28T22:16:45.845089] [DEBUG] [LOCAL ] PHK: Derivative data saved (138 records). [2025-10-28T22:16:45.857787] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-28T22:16:45.864542] [INFO ] [MAIN ] Derivative Progress: 1419/2046 symbols completed. PHK took 1.3s. Estimated remaining: 4m 14s. Rate: 148.0 symbols/min [2025-10-28T22:16:45.867584] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:45.885538] [DEBUG] [LOCAL ] PHR: Loaded 37604 existing records from primary storage. [2025-10-28T22:16:45.887288] [INFO ] [MAIN ] PHR: Loaded 37604 primary data records. [2025-10-28T22:16:45.989797] [INFO ] [MAIN ] PHM: Generated 138 derivative records from 51674 primary records. [2025-10-28T22:16:46.011109] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-10-28T22:16:46.133595] [DEBUG] [LOCAL ] PHM: Derivative data saved (138 records). [2025-10-28T22:16:46.142844] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-10-28T22:16:46.276226] [INFO ] [MAIN ] Derivative Progress: 1420/2046 symbols completed. PHM took 1.3s. Estimated remaining: 4m 14s. Rate: 148.0 symbols/min [2025-10-28T22:16:46.273925] [DEBUG] [LOCAL ] PII: Loaded 48536 existing records from primary storage. [2025-10-28T22:16:46.277132] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:46.277596] [INFO ] [MAIN ] PII: Loaded 48536 primary data records. [2025-10-28T22:16:46.370333] [DEBUG] [LOCAL ] PIM: Loaded 4884 existing records from primary storage. [2025-10-28T22:16:46.387294] [INFO ] [MAIN ] PIM: Loaded 4884 primary data records. [2025-10-28T22:16:46.950966] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:46.994466] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:47.036731] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:16:47.062199] [INFO ] [MAIN ] PHR: Generated 138 derivative records from 37604 primary records. [2025-10-28T22:16:47.066421] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-28T22:16:47.082370] [DEBUG] [LOCAL ] PHR: Derivative data saved (138 records). [2025-10-28T22:16:47.083241] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-28T22:16:47.087020] [INFO ] [MAIN ] Derivative Progress: 1421/2046 symbols completed. PHR took 1.3s. Estimated remaining: 4m 14s. Rate: 147.8 symbols/min [2025-10-28T22:16:47.087186] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:47.109473] [INFO ] [MAIN ] PII: Generated 138 derivative records from 48536 primary records. [2025-10-28T22:16:47.114380] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-28T22:16:47.119585] [DEBUG] [LOCAL ] PINE: Loaded 14314 existing records from primary storage. [2025-10-28T22:16:47.120530] [INFO ] [MAIN ] PINE: Loaded 14314 primary data records. [2025-10-28T22:16:47.136019] [DEBUG] [LOCAL ] PII: Derivative data saved (138 records). [2025-10-28T22:16:47.141557] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-28T22:16:47.162556] [INFO ] [MAIN ] Derivative Progress: 1422/2046 symbols completed. PII took 1.3s. Estimated remaining: 4m 13s. Rate: 147.9 symbols/min [2025-10-28T22:16:47.141760] [INFO ] [MAIN ] PIM: Generated 138 derivative records from 4884 primary records. [2025-10-28T22:16:47.206899] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:47.206969] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-28T22:16:47.259637] [DEBUG] [LOCAL ] PIM: Derivative data saved (138 records). [2025-10-28T22:16:47.259944] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-28T22:16:47.262872] [INFO ] [MAIN ] Derivative Progress: 1423/2046 symbols completed. PIM took 1.0s. Estimated remaining: 4m 13s. Rate: 148.0 symbols/min [2025-10-28T22:16:47.347758] [DEBUG] [LOCAL ] PIPR: Loaded 14534 existing records from primary storage. [2025-10-28T22:16:47.458733] [INFO ] [MAIN ] PIPR: Loaded 14534 primary data records. [2025-10-28T22:16:47.822577] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:47.867301] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:47.868911] [INFO ] [MAIN ] PINE: Generated 138 derivative records from 14314 primary records. [2025-10-28T22:16:47.880679] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-28T22:16:47.898805] [DEBUG] [LOCAL ] PINE: Derivative data saved (138 records). [2025-10-28T22:16:47.899474] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-28T22:16:47.901621] [INFO ] [MAIN ] Derivative Progress: 1424/2046 symbols completed. PINE took 0.8s. Estimated remaining: 4m 12s. Rate: 148.0 symbols/min [2025-10-28T22:16:47.913041] [INFO ] [MAIN ] PIPR: Generated 138 derivative records from 14534 primary records. [2025-10-28T22:16:47.913161] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-28T22:16:47.924669] [DEBUG] [LOCAL ] PIPR: Derivative data saved (138 records). [2025-10-28T22:16:47.924730] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-28T22:16:47.927005] [INFO ] [MAIN ] Derivative Progress: 1425/2046 symbols completed. PIPR took 0.7s. Estimated remaining: 4m 12s. Rate: 148.0 symbols/min [2025-10-28T22:16:47.927397] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:47.927555] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:47.927511] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:47.956362] [DEBUG] [LOCAL ] PJT: Loaded 20579 existing records from primary storage. [2025-10-28T22:16:47.955863] [DEBUG] [LOCAL ] PKE: Loaded 14234 existing records from primary storage. [2025-10-28T22:16:47.956515] [INFO ] [MAIN ] PKE: Loaded 14234 primary data records. [2025-10-28T22:16:47.956603] [INFO ] [MAIN ] PJT: Loaded 20579 primary data records. [2025-10-28T22:16:48.217776] [DEBUG] [LOCAL ] PK: Loaded 52716 existing records from primary storage. [2025-10-28T22:16:48.281969] [INFO ] [MAIN ] PK: Loaded 52716 primary data records. [2025-10-28T22:16:48.918885] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:48.946125] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:48.996061] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:49.050510] [INFO ] [MAIN ] PKE: Generated 138 derivative records from 14234 primary records. [2025-10-28T22:16:49.055604] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-28T22:16:49.057094] [INFO ] [MAIN ] PJT: Generated 138 derivative records from 20579 primary records. [2025-10-28T22:16:49.057738] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-28T22:16:49.084396] [DEBUG] [LOCAL ] PKE: Derivative data saved (138 records). [2025-10-28T22:16:49.084846] [DEBUG] [LOCAL ] PJT: Derivative data saved (138 records). [2025-10-28T22:16:49.085012] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-28T22:16:49.085212] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-28T22:16:49.087577] [INFO ] [MAIN ] Derivative Progress: 1426/2046 symbols completed. PKE took 1.2s. Estimated remaining: 4m 12s. Rate: 147.9 symbols/min [2025-10-28T22:16:49.088672] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:49.091367] [INFO ] [MAIN ] Derivative Progress: 1427/2046 symbols completed. PJT took 1.2s. Estimated remaining: 4m 11s. Rate: 148.0 symbols/min [2025-10-28T22:16:49.094220] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:49.094910] [INFO ] [MAIN ] PK: Generated 138 derivative records from 52716 primary records. [2025-10-28T22:16:49.095145] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-28T22:16:49.108134] [DEBUG] [LOCAL ] PK: Derivative data saved (138 records). [2025-10-28T22:16:49.108313] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-28T22:16:49.111032] [INFO ] [MAIN ] Derivative Progress: 1428/2046 symbols completed. PK took 1.2s. Estimated remaining: 4m 10s. Rate: 148.1 symbols/min [2025-10-28T22:16:49.115508] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:49.124413] [DEBUG] [LOCAL ] PKST: Loaded 17898 existing records from primary storage. [2025-10-28T22:16:49.124499] [INFO ] [MAIN ] PKST: Loaded 17898 primary data records. [2025-10-28T22:16:49.309971] [DEBUG] [LOCAL ] PKX: Loaded 21982 existing records from primary storage. [2025-10-28T22:16:49.309571] [DEBUG] [LOCAL ] PKG: Loaded 38437 existing records from primary storage. [2025-10-28T22:16:49.333221] [INFO ] [MAIN ] PKX: Loaded 21982 primary data records. [2025-10-28T22:16:49.333449] [INFO ] [MAIN ] PKG: Loaded 38437 primary data records. [2025-10-28T22:16:50.146677] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:50.212539] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:50.215770] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:50.252450] [INFO ] [MAIN ] PKST: Generated 138 derivative records from 17898 primary records. [2025-10-28T22:16:50.255064] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-28T22:16:50.274204] [DEBUG] [LOCAL ] PKST: Derivative data saved (138 records). [2025-10-28T22:16:50.278899] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-28T22:16:50.281834] [INFO ] [MAIN ] Derivative Progress: 1429/2046 symbols completed. PKST took 1.2s. Estimated remaining: 4m 10s. Rate: 147.9 symbols/min [2025-10-28T22:16:50.282605] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:50.311334] [INFO ] [MAIN ] PKG: Generated 138 derivative records from 38437 primary records. [2025-10-28T22:16:50.311834] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-28T22:16:50.311556] [INFO ] [MAIN ] PKX: Generated 138 derivative records from 21982 primary records. [2025-10-28T22:16:50.312507] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-28T22:16:50.334183] [DEBUG] [LOCAL ] PKG: Derivative data saved (138 records). [2025-10-28T22:16:50.336938] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-10-28T22:16:50.340065] [INFO ] [MAIN ] Derivative Progress: 1430/2046 symbols completed. PKG took 1.3s. Estimated remaining: 4m 10s. Rate: 148.0 symbols/min [2025-10-28T22:16:50.353382] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:50.337299] [DEBUG] [LOCAL ] PKX: Derivative data saved (138 records). [2025-10-28T22:16:50.354127] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-28T22:16:50.356846] [INFO ] [MAIN ] Derivative Progress: 1431/2046 symbols completed. PKX took 1.2s. Estimated remaining: 4m 9s. Rate: 148.0 symbols/min [2025-10-28T22:16:50.357198] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:50.380436] [DEBUG] [LOCAL ] PL: Loaded 53219 existing records from primary storage. [2025-10-28T22:16:50.380847] [INFO ] [MAIN ] PL: Loaded 53219 primary data records. [2025-10-28T22:16:50.560163] [DEBUG] [LOCAL ] PLNT: Loaded 47899 existing records from primary storage. [2025-10-28T22:16:50.574858] [INFO ] [MAIN ] PLNT: Loaded 47899 primary data records. [2025-10-28T22:16:50.828963] [DEBUG] [LOCAL ] PLD: Loaded 53404 existing records from primary storage. [2025-10-28T22:16:50.840669] [INFO ] [MAIN ] PLD: Loaded 53404 primary data records. [2025-10-28T22:16:51.422938] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:51.480084] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:51.517958] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:51.540632] [INFO ] [MAIN ] PL: Generated 138 derivative records from 53219 primary records. [2025-10-28T22:16:51.542469] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-28T22:16:51.561347] [DEBUG] [LOCAL ] PL: Derivative data saved (138 records). [2025-10-28T22:16:51.561848] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-28T22:16:51.564614] [INFO ] [MAIN ] Derivative Progress: 1432/2046 symbols completed. PL took 1.3s. Estimated remaining: 4m 9s. Rate: 147.8 symbols/min [2025-10-28T22:16:51.568262] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:51.608973] [INFO ] [MAIN ] PLNT: Generated 138 derivative records from 47899 primary records. [2025-10-28T22:16:51.610908] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-28T22:16:51.609381] [DEBUG] [LOCAL ] PLOW: Loaded 19200 existing records from primary storage. [2025-10-28T22:16:51.612152] [INFO ] [MAIN ] PLOW: Loaded 19200 primary data records. [2025-10-28T22:16:51.614550] [INFO ] [MAIN ] PLD: Generated 138 derivative records from 53404 primary records. [2025-10-28T22:16:51.644229] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-28T22:16:51.663701] [DEBUG] [LOCAL ] PLNT: Derivative data saved (138 records). [2025-10-28T22:16:51.716731] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-28T22:16:51.741463] [DEBUG] [LOCAL ] PLD: Derivative data saved (138 records). [2025-10-28T22:16:51.749498] [INFO ] [MAIN ] Derivative Progress: 1433/2046 symbols completed. PLNT took 1.4s. Estimated remaining: 4m 9s. Rate: 147.9 symbols/min [2025-10-28T22:16:51.792010] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-28T22:16:51.782999] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:51.813970] [INFO ] [MAIN ] Derivative Progress: 1434/2046 symbols completed. PLD took 1.5s. Estimated remaining: 4m 8s. Rate: 148.0 symbols/min [2025-10-28T22:16:51.820050] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:51.991970] [DEBUG] [LOCAL ] PLYM: Loaded 34436 existing records from primary storage. [2025-10-28T22:16:51.992428] [INFO ] [MAIN ] PLYM: Loaded 34436 primary data records. [2025-10-28T22:16:52.130681] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:52.237309] [DEBUG] [LOCAL ] PM: Loaded 53674 existing records from primary storage. [2025-10-28T22:16:52.243294] [INFO ] [MAIN ] PM: Loaded 53674 primary data records. [2025-10-28T22:16:52.739800] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:52.753164] [INFO ] [MAIN ] PLOW: Generated 138 derivative records from 19200 primary records. [2025-10-28T22:16:52.755205] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-28T22:16:52.769898] [DEBUG] [LOCAL ] PLOW: Derivative data saved (138 records). [2025-10-28T22:16:52.770234] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-10-28T22:16:52.772380] [INFO ] [MAIN ] Derivative Progress: 1435/2046 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 8s. Rate: 147.8 symbols/min [2025-10-28T22:16:52.775354] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:52.807536] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:52.835689] [DEBUG] [LOCAL ] PML: Loaded 21633 existing records from primary storage. [2025-10-28T22:16:52.837945] [INFO ] [MAIN ] PLYM: Generated 138 derivative records from 34436 primary records. [2025-10-28T22:16:52.838073] [INFO ] [MAIN ] PML: Loaded 21633 primary data records. [2025-10-28T22:16:52.841226] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-28T22:16:52.936993] [DEBUG] [LOCAL ] PLYM: Derivative data saved (138 records). [2025-10-28T22:16:52.937141] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-28T22:16:52.953085] [INFO ] [MAIN ] Derivative Progress: 1436/2046 symbols completed. PLYM took 1.2s. Estimated remaining: 4m 7s. Rate: 147.9 symbols/min [2025-10-28T22:16:52.964528] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:53.171245] [DEBUG] [LOCAL ] PMM: Loaded 9697 existing records from primary storage. [2025-10-28T22:16:53.182929] [INFO ] [MAIN ] PMM: Loaded 9697 primary data records. [2025-10-28T22:16:53.261140] [INFO ] [MAIN ] PM: Generated 138 derivative records from 53674 primary records. [2025-10-28T22:16:53.280686] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-28T22:16:53.411408] [DEBUG] [LOCAL ] PM: Derivative data saved (138 records). [2025-10-28T22:16:53.411533] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-10-28T22:16:53.469229] [INFO ] [MAIN ] Derivative Progress: 1437/2046 symbols completed. PM took 1.6s. Estimated remaining: 4m 7s. Rate: 147.9 symbols/min [2025-10-28T22:16:53.533878] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:53.559922] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:53.559540] [DEBUG] [LOCAL ] PMO: Loaded 8969 existing records from primary storage. [2025-10-28T22:16:53.560184] [INFO ] [MAIN ] PMO: Loaded 8969 primary data records. [2025-10-28T22:16:53.955049] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:53.983010] [INFO ] [MAIN ] PML: Generated 138 derivative records from 21633 primary records. [2025-10-28T22:16:53.986311] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-28T22:16:54.000448] [DEBUG] [LOCAL ] PML: Derivative data saved (138 records). [2025-10-28T22:16:54.001936] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-28T22:16:54.007176] [INFO ] [MAIN ] Derivative Progress: 1438/2046 symbols completed. PML took 1.2s. Estimated remaining: 4m 7s. Rate: 147.8 symbols/min [2025-10-28T22:16:54.024083] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:54.051039] [INFO ] [MAIN ] PMM: Generated 138 derivative records from 9697 primary records. [2025-10-28T22:16:54.051198] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-28T22:16:54.066967] [DEBUG] [LOCAL ] PMM: Derivative data saved (138 records). [2025-10-28T22:16:54.067139] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-28T22:16:54.069496] [INFO ] [MAIN ] Derivative Progress: 1439/2046 symbols completed. PMM took 1.1s. Estimated remaining: 4m 6s. Rate: 147.9 symbols/min [2025-10-28T22:16:54.080085] [INFO ] [MAIN ] PMO: Generated 138 derivative records from 8969 primary records. [2025-10-28T22:16:54.080157] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-28T22:16:54.091068] [DEBUG] [LOCAL ] PMO: Derivative data saved (138 records). [2025-10-28T22:16:54.091125] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-28T22:16:54.093836] [INFO ] [MAIN ] Derivative Progress: 1440/2046 symbols completed. PMO took 0.6s. Estimated remaining: 4m 6s. Rate: 148.0 symbols/min [2025-10-28T22:16:54.094181] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:54.094596] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:54.094794] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:54.104685] [DEBUG] [LOCAL ] PNI: Loaded 6590 existing records from primary storage. [2025-10-28T22:16:54.104938] [INFO ] [MAIN ] PNI: Loaded 6590 primary data records. [2025-10-28T22:16:54.435284] [DEBUG] [LOCAL ] PMT: Loaded 40471 existing records from primary storage. [2025-10-28T22:16:54.436050] [INFO ] [MAIN ] PMT: Loaded 40471 primary data records. [2025-10-28T22:16:54.532236] [DEBUG] [LOCAL ] PNC: Loaded 52019 existing records from primary storage. [2025-10-28T22:16:54.543336] [INFO ] [MAIN ] PNC: Loaded 52019 primary data records. [2025-10-28T22:16:55.069612] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:55.103839] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:55.144324] [DEBUG] [MAIN ] PNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:55.171407] [INFO ] [MAIN ] PNI: Generated 138 derivative records from 6590 primary records. [2025-10-28T22:16:55.172032] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-28T22:16:55.195052] [DEBUG] [LOCAL ] PNI: Derivative data saved (138 records). [2025-10-28T22:16:55.196691] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-28T22:16:55.199467] [INFO ] [MAIN ] Derivative Progress: 1441/2046 symbols completed. PNI took 1.1s. Estimated remaining: 4m 6s. Rate: 147.8 symbols/min [2025-10-28T22:16:55.199760] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:55.207835] [INFO ] [MAIN ] PMT: Generated 138 derivative records from 40471 primary records. [2025-10-28T22:16:55.210909] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-28T22:16:55.214581] [INFO ] [MAIN ] PNC: Generated 138 derivative records from 52019 primary records. [2025-10-28T22:16:55.214839] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-10-28T22:16:55.234531] [DEBUG] [LOCAL ] PMT: Derivative data saved (138 records). [2025-10-28T22:16:55.242022] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-28T22:16:55.245893] [INFO ] [MAIN ] Derivative Progress: 1442/2046 symbols completed. PMT took 1.2s. Estimated remaining: 4m 5s. Rate: 147.9 symbols/min [2025-10-28T22:16:55.247038] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:55.249031] [DEBUG] [LOCAL ] PNC: Derivative data saved (138 records). [2025-10-28T22:16:55.249725] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-10-28T22:16:55.252684] [INFO ] [MAIN ] Derivative Progress: 1443/2046 symbols completed. PNC took 1.2s. Estimated remaining: 4m 4s. Rate: 148.0 symbols/min [2025-10-28T22:16:55.252835] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:55.264148] [DEBUG] [LOCAL ] PNNT: Loaded 32715 existing records from primary storage. [2025-10-28T22:16:55.264503] [INFO ] [MAIN ] PNNT: Loaded 32715 primary data records. [2025-10-28T22:16:55.612403] [DEBUG] [LOCAL ] PNR: Loaded 47303 existing records from primary storage. [2025-10-28T22:16:55.612714] [INFO ] [MAIN ] PNR: Loaded 47303 primary data records. [2025-10-28T22:16:55.611123] [DEBUG] [LOCAL ] PNW: Loaded 45297 existing records from primary storage. [2025-10-28T22:16:55.614072] [INFO ] [MAIN ] PNW: Loaded 45297 primary data records. [2025-10-28T22:16:56.264009] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:56.314961] [DEBUG] [MAIN ] PNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:56.345910] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:56.361041] [INFO ] [MAIN ] PNNT: Generated 138 derivative records from 32715 primary records. [2025-10-28T22:16:56.366771] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-28T22:16:56.383738] [DEBUG] [LOCAL ] PNNT: Derivative data saved (138 records). [2025-10-28T22:16:56.385338] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-28T22:16:56.387879] [INFO ] [MAIN ] Derivative Progress: 1444/2046 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 4s. Rate: 147.9 symbols/min [2025-10-28T22:16:56.388064] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:56.408904] [INFO ] [MAIN ] PNR: Generated 138 derivative records from 47303 primary records. [2025-10-28T22:16:56.421201] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-10-28T22:16:56.437937] [DEBUG] [LOCAL ] PNR: Derivative data saved (138 records). [2025-10-28T22:16:56.439846] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-10-28T22:16:56.458081] [DEBUG] [LOCAL ] POR: Loaded 46612 existing records from primary storage. [2025-10-28T22:16:56.459063] [INFO ] [MAIN ] POR: Loaded 46612 primary data records. [2025-10-28T22:16:56.456800] [INFO ] [MAIN ] Derivative Progress: 1445/2046 symbols completed. PNR took 1.2s. Estimated remaining: 4m 4s. Rate: 147.9 symbols/min [2025-10-28T22:16:56.460218] [INFO ] [MAIN ] PNW: Generated 138 derivative records from 45297 primary records. [2025-10-28T22:16:56.471630] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:56.471835] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-28T22:16:56.570870] [DEBUG] [LOCAL ] PNW: Derivative data saved (138 records). [2025-10-28T22:16:56.571016] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-28T22:16:56.573432] [INFO ] [MAIN ] Derivative Progress: 1446/2046 symbols completed. PNW took 1.3s. Estimated remaining: 4m 3s. Rate: 148.0 symbols/min [2025-10-28T22:16:56.583429] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:56.830508] [DEBUG] [LOCAL ] POST: Loaded 38153 existing records from primary storage. [2025-10-28T22:16:56.831624] [INFO ] [MAIN ] POST: Loaded 38153 primary data records. [2025-10-28T22:16:57.035202] [DEBUG] [LOCAL ] PPG: Loaded 50400 existing records from primary storage. [2025-10-28T22:16:57.067834] [INFO ] [MAIN ] PPG: Loaded 50400 primary data records. [2025-10-28T22:16:57.445433] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:57.496092] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:57.543498] [INFO ] [MAIN ] POR: Generated 138 derivative records from 46612 primary records. [2025-10-28T22:16:57.549998] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:57.552073] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-28T22:16:57.579964] [DEBUG] [LOCAL ] POR: Derivative data saved (138 records). [2025-10-28T22:16:57.580401] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-28T22:16:57.587584] [INFO ] [MAIN ] Derivative Progress: 1447/2046 symbols completed. POR took 1.2s. Estimated remaining: 4m 3s. Rate: 147.9 symbols/min [2025-10-28T22:16:57.588612] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:57.593812] [INFO ] [MAIN ] POST: Generated 138 derivative records from 38153 primary records. [2025-10-28T22:16:57.596790] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-28T22:16:57.617433] [DEBUG] [LOCAL ] POST: Derivative data saved (138 records). [2025-10-28T22:16:57.617881] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-28T22:16:57.620230] [INFO ] [MAIN ] Derivative Progress: 1448/2046 symbols completed. POST took 1.1s. Estimated remaining: 4m 3s. Rate: 148.0 symbols/min [2025-10-28T22:16:57.621482] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:57.624460] [INFO ] [MAIN ] PPG: Generated 138 derivative records from 50400 primary records. [2025-10-28T22:16:57.637524] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-28T22:16:57.654373] [DEBUG] [LOCAL ] PPG: Derivative data saved (138 records). [2025-10-28T22:16:57.654583] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-28T22:16:57.657457] [INFO ] [MAIN ] Derivative Progress: 1449/2046 symbols completed. PPG took 1.1s. Estimated remaining: 4m 2s. Rate: 148.0 symbols/min [2025-10-28T22:16:57.658416] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:57.679843] [DEBUG] [LOCAL ] PPT: Loaded 19088 existing records from primary storage. [2025-10-28T22:16:57.680000] [INFO ] [MAIN ] PPT: Loaded 19088 primary data records. [2025-10-28T22:16:57.680921] [DEBUG] [LOCAL ] PPL: Loaded 53503 existing records from primary storage. [2025-10-28T22:16:57.692352] [INFO ] [MAIN ] PPL: Loaded 53503 primary data records. [2025-10-28T22:16:58.319819] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-10-28T22:16:58.320573] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-10-28T22:16:58.648956] [DEBUG] [MAIN ] PPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:58.674630] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:58.730681] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:58.757429] [INFO ] [MAIN ] PPT: Generated 138 derivative records from 19088 primary records. [2025-10-28T22:16:58.760397] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-28T22:16:58.770828] [INFO ] [MAIN ] PPL: Generated 138 derivative records from 53503 primary records. [2025-10-28T22:16:58.773187] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-10-28T22:16:58.777664] [DEBUG] [LOCAL ] PPT: Derivative data saved (138 records). [2025-10-28T22:16:58.779249] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-28T22:16:58.791100] [INFO ] [MAIN ] Derivative Progress: 1450/2046 symbols completed. PPT took 1.2s. Estimated remaining: 4m 2s. Rate: 147.9 symbols/min [2025-10-28T22:16:58.795681] [DEBUG] [LOCAL ] PPL: Derivative data saved (138 records). [2025-10-28T22:16:58.796026] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:58.795952] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-10-28T22:16:58.798715] [INFO ] [MAIN ] Derivative Progress: 1451/2046 symbols completed. PPL took 1.2s. Estimated remaining: 4m 1s. Rate: 148.0 symbols/min [2025-10-28T22:16:58.800630] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:58.808084] [INFO ] [MAIN ] PR: Generated 138 derivative records from 53609 primary records. [2025-10-28T22:16:58.808301] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-28T22:16:58.810924] [DEBUG] [LOCAL ] PRCS: Loaded 2689 existing records from primary storage. [2025-10-28T22:16:58.811099] [INFO ] [MAIN ] PRCS: Loaded 2689 primary data records. [2025-10-28T22:16:58.907490] [DEBUG] [LOCAL ] PR: Derivative data saved (138 records). [2025-10-28T22:16:58.945127] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-28T22:16:58.947804] [INFO ] [MAIN ] Derivative Progress: 1452/2046 symbols completed. PR took 1.3s. Estimated remaining: 4m 1s. Rate: 148.0 symbols/min [2025-10-28T22:16:58.953208] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:16:58.944959] [DEBUG] [LOCAL ] PRA: Loaded 33736 existing records from primary storage. [2025-10-28T22:16:58.969307] [INFO ] [MAIN ] PRA: Loaded 33736 primary data records. [2025-10-28T22:16:59.450971] [DEBUG] [LOCAL ] PRG: Loaded 29520 existing records from primary storage. [2025-10-28T22:16:59.459608] [INFO ] [MAIN ] PRG: Loaded 29520 primary data records. [2025-10-28T22:16:59.828479] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:16:59.869948] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:59.920194] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:16:59.958397] [INFO ] [MAIN ] PRCS: Generated 138 derivative records from 2689 primary records. [2025-10-28T22:16:59.959709] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-28T22:16:59.985171] [DEBUG] [LOCAL ] PRCS: Derivative data saved (138 records). [2025-10-28T22:16:59.985498] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-28T22:16:59.991032] [INFO ] [MAIN ] PRA: Generated 138 derivative records from 33736 primary records. [2025-10-28T22:16:59.990346] [INFO ] [MAIN ] Derivative Progress: 1453/2046 symbols completed. PRCS took 1.2s. Estimated remaining: 4m 1s. Rate: 147.9 symbols/min [2025-10-28T22:16:59.992783] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-28T22:17:00.010261] [DEBUG] [LOCAL ] PRA: Derivative data saved (138 records). [2025-10-28T22:17:00.012718] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-28T22:17:00.015196] [INFO ] [MAIN ] Derivative Progress: 1454/2046 symbols completed. PRA took 1.2s. Estimated remaining: 4m 0s. Rate: 148.0 symbols/min [2025-10-28T22:17:00.015895] [INFO ] [MAIN ] PRG: Generated 138 derivative records from 29520 primary records. [2025-10-28T22:17:00.016007] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-28T22:17:00.033497] [DEBUG] [LOCAL ] PRG: Derivative data saved (138 records). [2025-10-28T22:17:00.033609] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-28T22:17:00.036813] [INFO ] [MAIN ] Derivative Progress: 1455/2046 symbols completed. PRG took 1.1s. Estimated remaining: 3m 59s. Rate: 148.1 symbols/min [2025-10-28T22:17:00.037478] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:00.037412] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:00.037568] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:00.045407] [DEBUG] [LOCAL ] PRH: Loaded 4516 existing records from primary storage. [2025-10-28T22:17:00.045843] [INFO ] [MAIN ] PRH: Loaded 4516 primary data records. [2025-10-28T22:17:00.161996] [DEBUG] [LOCAL ] PRI: Loaded 17299 existing records from primary storage. [2025-10-28T22:17:00.172754] [INFO ] [MAIN ] PRI: Loaded 17299 primary data records. [2025-10-28T22:17:00.508624] [DEBUG] [LOCAL ] PRGO: Loaded 47033 existing records from primary storage. [2025-10-28T22:17:00.519911] [INFO ] [MAIN ] PRGO: Loaded 47033 primary data records. [2025-10-28T22:17:01.061627] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:01.112822] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:01.143606] [INFO ] [MAIN ] PRH: Generated 138 derivative records from 4516 primary records. [2025-10-28T22:17:01.145351] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:01.145613] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-28T22:17:01.177200] [DEBUG] [LOCAL ] PRH: Derivative data saved (138 records). [2025-10-28T22:17:01.178035] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-28T22:17:01.184053] [INFO ] [MAIN ] Derivative Progress: 1456/2046 symbols completed. PRH took 1.1s. Estimated remaining: 3m 59s. Rate: 147.9 symbols/min [2025-10-28T22:17:01.186450] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:01.217569] [INFO ] [MAIN ] PRGO: Generated 138 derivative records from 47033 primary records. [2025-10-28T22:17:01.219434] [INFO ] [MAIN ] PRI: Generated 138 derivative records from 17299 primary records. [2025-10-28T22:17:01.219578] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-28T22:17:01.219689] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-28T22:17:01.242844] [DEBUG] [LOCAL ] PRI: Derivative data saved (138 records). [2025-10-28T22:17:01.244328] [DEBUG] [LOCAL ] PRGO: Derivative data saved (138 records). [2025-10-28T22:17:01.244009] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-28T22:17:01.244521] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-28T22:17:01.247107] [INFO ] [MAIN ] Derivative Progress: 1457/2046 symbols completed. PRI took 1.2s. Estimated remaining: 3m 59s. Rate: 148.0 symbols/min [2025-10-28T22:17:01.261249] [INFO ] [MAIN ] Derivative Progress: 1458/2046 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 58s. Rate: 148.1 symbols/min [2025-10-28T22:17:01.258627] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:01.262925] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:01.264850] [DEBUG] [LOCAL ] PRIM: Loaded 43903 existing records from primary storage. [2025-10-28T22:17:01.265010] [INFO ] [MAIN ] PRIM: Loaded 43903 primary data records. [2025-10-28T22:17:01.436481] [DEBUG] [LOCAL ] PRLB: Loaded 19896 existing records from primary storage. [2025-10-28T22:17:01.474934] [INFO ] [MAIN ] PRLB: Loaded 19896 primary data records. [2025-10-28T22:17:01.699835] [DEBUG] [LOCAL ] PRKS: Loaded 41902 existing records from primary storage. [2025-10-28T22:17:01.717304] [INFO ] [MAIN ] PRKS: Loaded 41902 primary data records. [2025-10-28T22:17:02.289380] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:02.336497] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:02.379088] [INFO ] [MAIN ] PRIM: Generated 138 derivative records from 43903 primary records. [2025-10-28T22:17:02.378788] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:02.392341] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-28T22:17:02.411373] [DEBUG] [LOCAL ] PRIM: Derivative data saved (138 records). [2025-10-28T22:17:02.411792] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-28T22:17:02.419593] [INFO ] [MAIN ] Derivative Progress: 1459/2046 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 58s. Rate: 147.9 symbols/min [2025-10-28T22:17:02.419973] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:02.437511] [INFO ] [MAIN ] PRLB: Generated 138 derivative records from 19896 primary records. [2025-10-28T22:17:02.440965] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-28T22:17:02.472121] [DEBUG] [LOCAL ] PRLB: Derivative data saved (138 records). [2025-10-28T22:17:02.472044] [INFO ] [MAIN ] PRKS: Generated 138 derivative records from 41902 primary records. [2025-10-28T22:17:02.472260] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-28T22:17:02.472310] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-28T22:17:02.474705] [INFO ] [MAIN ] Derivative Progress: 1460/2046 symbols completed. PRLB took 1.2s. Estimated remaining: 3m 58s. Rate: 148.0 symbols/min [2025-10-28T22:17:02.475568] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:02.502322] [DEBUG] [LOCAL ] PRM: Loaded 44041 existing records from primary storage. [2025-10-28T22:17:02.502908] [INFO ] [MAIN ] PRM: Loaded 44041 primary data records. [2025-10-28T22:17:02.504483] [DEBUG] [LOCAL ] PRKS: Derivative data saved (138 records). [2025-10-28T22:17:02.526202] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-28T22:17:02.573897] [INFO ] [MAIN ] Derivative Progress: 1461/2046 symbols completed. PRKS took 1.3s. Estimated remaining: 3m 57s. Rate: 148.0 symbols/min [2025-10-28T22:17:02.586755] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:02.859327] [DEBUG] [LOCAL ] PRMB: Loaded 53062 existing records from primary storage. [2025-10-28T22:17:02.860484] [INFO ] [MAIN ] PRMB: Loaded 53062 primary data records. [2025-10-28T22:17:02.936945] [DEBUG] [LOCAL ] PRO: Loaded 39970 existing records from primary storage. [2025-10-28T22:17:02.955503] [INFO ] [MAIN ] PRO: Loaded 39970 primary data records. [2025-10-28T22:17:03.379944] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:03.546469] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:03.566124] [INFO ] [MAIN ] PRM: Generated 138 derivative records from 44041 primary records. [2025-10-28T22:17:03.568201] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-28T22:17:03.592881] [DEBUG] [LOCAL ] PRM: Derivative data saved (138 records). [2025-10-28T22:17:03.597866] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-28T22:17:03.600602] [INFO ] [MAIN ] Derivative Progress: 1462/2046 symbols completed. PRM took 1.2s. Estimated remaining: 3m 57s. Rate: 147.9 symbols/min [2025-10-28T22:17:03.601024] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:03.598206] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:03.644072] [INFO ] [MAIN ] PRMB: Generated 138 derivative records from 53062 primary records. [2025-10-28T22:17:03.644566] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-28T22:17:03.655358] [DEBUG] [LOCAL ] PRSU: Loaded 22587 existing records from primary storage. [2025-10-28T22:17:03.671971] [DEBUG] [LOCAL ] PRMB: Derivative data saved (138 records). [2025-10-28T22:17:03.672054] [INFO ] [MAIN ] PRSU: Loaded 22587 primary data records. [2025-10-28T22:17:03.673127] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-28T22:17:03.680920] [INFO ] [MAIN ] Derivative Progress: 1463/2046 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 56s. Rate: 148.0 symbols/min [2025-10-28T22:17:03.721895] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:03.796412] [DEBUG] [LOCAL ] PRT: Loaded 4940 existing records from primary storage. [2025-10-28T22:17:03.796723] [INFO ] [MAIN ] PRT: Loaded 4940 primary data records. [2025-10-28T22:17:03.971216] [INFO ] [MAIN ] PRO: Generated 138 derivative records from 39970 primary records. [2025-10-28T22:17:04.101855] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-28T22:17:04.165064] [DEBUG] [LOCAL ] PRO: Derivative data saved (138 records). [2025-10-28T22:17:04.170533] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-28T22:17:04.173528] [INFO ] [MAIN ] Derivative Progress: 1464/2046 symbols completed. PRO took 1.6s. Estimated remaining: 3m 56s. Rate: 147.9 symbols/min [2025-10-28T22:17:04.191044] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:04.370505] [DEBUG] [MAIN ] PRSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:04.419747] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:04.453257] [DEBUG] [LOCAL ] PRU: Loaded 51037 existing records from primary storage. [2025-10-28T22:17:04.454952] [INFO ] [MAIN ] PRU: Loaded 51037 primary data records. [2025-10-28T22:17:04.617777] [INFO ] [MAIN ] PRSU: Generated 138 derivative records from 22587 primary records. [2025-10-28T22:17:04.747962] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-10-28T22:17:04.779419] [DEBUG] [LOCAL ] PRSU: Derivative data saved (138 records). [2025-10-28T22:17:04.780064] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-10-28T22:17:04.785032] [INFO ] [MAIN ] Derivative Progress: 1465/2046 symbols completed. PRSU took 1.2s. Estimated remaining: 3m 56s. Rate: 147.9 symbols/min [2025-10-28T22:17:04.788286] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:04.791175] [INFO ] [MAIN ] PRT: Generated 138 derivative records from 4940 primary records. [2025-10-28T22:17:04.791350] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-28T22:17:04.804246] [DEBUG] [LOCAL ] PRT: Derivative data saved (138 records). [2025-10-28T22:17:04.804562] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-28T22:17:04.807193] [INFO ] [MAIN ] Derivative Progress: 1466/2046 symbols completed. PRT took 1.1s. Estimated remaining: 3m 55s. Rate: 148.0 symbols/min [2025-10-28T22:17:04.807497] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:04.840588] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:04.841176] [DEBUG] [LOCAL ] PSBD: Loaded 8259 existing records from primary storage. [2025-10-28T22:17:04.853282] [INFO ] [MAIN ] PSBD: Loaded 8259 primary data records. [2025-10-28T22:17:04.945936] [DEBUG] [LOCAL ] PSA: Loaded 41764 existing records from primary storage. [2025-10-28T22:17:04.974282] [INFO ] [MAIN ] PSA: Loaded 41764 primary data records. [2025-10-28T22:17:05.484776] [INFO ] [MAIN ] PRU: Generated 138 derivative records from 51037 primary records. [2025-10-28T22:17:05.485237] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-28T22:17:05.502786] [DEBUG] [LOCAL ] PRU: Derivative data saved (138 records). [2025-10-28T22:17:05.502881] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-28T22:17:05.505999] [INFO ] [MAIN ] Derivative Progress: 1467/2046 symbols completed. PRU took 1.3s. Estimated remaining: 3m 55s. Rate: 147.9 symbols/min [2025-10-28T22:17:05.507523] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:05.530469] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:05.546969] [DEBUG] [LOCAL ] PSF: Loaded 6736 existing records from primary storage. [2025-10-28T22:17:05.548921] [INFO ] [MAIN ] PSF: Loaded 6736 primary data records. [2025-10-28T22:17:05.573957] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:05.913564] [INFO ] [MAIN ] PSA: Generated 138 derivative records from 41764 primary records. [2025-10-28T22:17:05.915393] [INFO ] [MAIN ] PSBD: Generated 138 derivative records from 8259 primary records. [2025-10-28T22:17:05.915608] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-28T22:17:05.915705] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-28T22:17:05.939515] [DEBUG] [LOCAL ] PSA: Derivative data saved (138 records). [2025-10-28T22:17:05.940473] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-28T22:17:05.939359] [DEBUG] [LOCAL ] PSBD: Derivative data saved (138 records). [2025-10-28T22:17:05.943611] [INFO ] [MAIN ] Derivative Progress: 1468/2046 symbols completed. PSA took 1.2s. Estimated remaining: 3m 54s. Rate: 147.9 symbols/min [2025-10-28T22:17:05.944392] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-28T22:17:05.946604] [INFO ] [MAIN ] Derivative Progress: 1469/2046 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 54s. Rate: 148.0 symbols/min [2025-10-28T22:17:05.959485] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:05.984350] [INFO ] [MAIN ] PSF: Generated 138 derivative records from 6736 primary records. [2025-10-28T22:17:05.984420] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-28T22:17:05.995594] [DEBUG] [LOCAL ] PSF: Derivative data saved (138 records). [2025-10-28T22:17:05.995672] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-28T22:17:05.997931] [INFO ] [MAIN ] Derivative Progress: 1470/2046 symbols completed. PSF took 0.5s. Estimated remaining: 3m 53s. Rate: 148.1 symbols/min [2025-10-28T22:17:05.998304] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:05.998498] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:05.998400] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:06.042452] [DEBUG] [LOCAL ] PSFE: Loaded 29016 existing records from primary storage. [2025-10-28T22:17:06.042632] [INFO ] [MAIN ] PSFE: Loaded 29016 primary data records. [2025-10-28T22:17:06.170341] [DEBUG] [LOCAL ] PSN: Loaded 44784 existing records from primary storage. [2025-10-28T22:17:06.170959] [DEBUG] [LOCAL ] PSO: Loaded 36033 existing records from primary storage. [2025-10-28T22:17:06.171141] [INFO ] [MAIN ] PSO: Loaded 36033 primary data records. [2025-10-28T22:17:06.171033] [INFO ] [MAIN ] PSN: Loaded 44784 primary data records. [2025-10-28T22:17:07.000264] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:07.049310] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:07.049143] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:07.121748] [INFO ] [MAIN ] PSFE: Generated 138 derivative records from 29016 primary records. [2025-10-28T22:17:07.125614] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-28T22:17:07.141509] [DEBUG] [LOCAL ] PSFE: Derivative data saved (138 records). [2025-10-28T22:17:07.142824] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-28T22:17:07.146326] [INFO ] [MAIN ] Derivative Progress: 1471/2046 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 53s. Rate: 147.9 symbols/min [2025-10-28T22:17:07.147106] [INFO ] [MAIN ] PSN: Generated 138 derivative records from 44784 primary records. [2025-10-28T22:17:07.147209] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:07.149288] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-28T22:17:07.150381] [INFO ] [MAIN ] PSO: Generated 138 derivative records from 36033 primary records. [2025-10-28T22:17:07.150588] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-28T22:17:07.172575] [DEBUG] [LOCAL ] PSO: Derivative data saved (138 records). [2025-10-28T22:17:07.174359] [DEBUG] [LOCAL ] PSN: Derivative data saved (138 records). [2025-10-28T22:17:07.172817] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-28T22:17:07.174572] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-28T22:17:07.177529] [INFO ] [MAIN ] Derivative Progress: 1472/2046 symbols completed. PSO took 1.2s. Estimated remaining: 3m 53s. Rate: 148.0 symbols/min [2025-10-28T22:17:07.180199] [INFO ] [MAIN ] Derivative Progress: 1473/2046 symbols completed. PSN took 1.2s. Estimated remaining: 3m 52s. Rate: 148.1 symbols/min [2025-10-28T22:17:07.180131] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:07.180493] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:07.216843] [DEBUG] [LOCAL ] PSQH: Loaded 35305 existing records from primary storage. [2025-10-28T22:17:07.217326] [DEBUG] [LOCAL ] PSTL: Loaded 19659 existing records from primary storage. [2025-10-28T22:17:07.217444] [INFO ] [MAIN ] PSQH: Loaded 35305 primary data records. [2025-10-28T22:17:07.217513] [INFO ] [MAIN ] PSTL: Loaded 19659 primary data records. [2025-10-28T22:17:07.681876] [DEBUG] [LOCAL ] PSTG: Loaded 52764 existing records from primary storage. [2025-10-28T22:17:07.824122] [INFO ] [MAIN ] PSTG: Loaded 52764 primary data records. [2025-10-28T22:17:08.214577] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:08.241920] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:08.286618] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:08.330317] [INFO ] [MAIN ] PSQH: Generated 138 derivative records from 35305 primary records. [2025-10-28T22:17:08.331421] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-28T22:17:08.350382] [DEBUG] [LOCAL ] PSQH: Derivative data saved (138 records). [2025-10-28T22:17:08.353025] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-28T22:17:08.355478] [INFO ] [MAIN ] Derivative Progress: 1474/2046 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 52s. Rate: 147.9 symbols/min [2025-10-28T22:17:08.355744] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:08.362085] [INFO ] [MAIN ] PSTL: Generated 138 derivative records from 19659 primary records. [2025-10-28T22:17:08.363508] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-28T22:17:08.366444] [INFO ] [MAIN ] PSTG: Generated 138 derivative records from 52764 primary records. [2025-10-28T22:17:08.376475] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-28T22:17:08.379185] [DEBUG] [LOCAL ] PSTL: Derivative data saved (138 records). [2025-10-28T22:17:08.379359] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-28T22:17:08.381687] [INFO ] [MAIN ] Derivative Progress: 1475/2046 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 51s. Rate: 148.0 symbols/min [2025-10-28T22:17:08.381946] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:08.393974] [DEBUG] [LOCAL ] PSTG: Derivative data saved (138 records). [2025-10-28T22:17:08.394114] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-28T22:17:08.396989] [INFO ] [MAIN ] Derivative Progress: 1476/2046 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 51s. Rate: 148.1 symbols/min [2025-10-28T22:17:08.397223] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:08.412330] [DEBUG] [LOCAL ] PTA: Loaded 15193 existing records from primary storage. [2025-10-28T22:17:08.424991] [INFO ] [MAIN ] PTA: Loaded 15193 primary data records. [2025-10-28T22:17:08.564523] [DEBUG] [LOCAL ] PSX: Loaded 53107 existing records from primary storage. [2025-10-28T22:17:08.609364] [INFO ] [MAIN ] PSX: Loaded 53107 primary data records. [2025-10-28T22:17:08.652634] [DEBUG] [LOCAL ] PTY: Loaded 37657 existing records from primary storage. [2025-10-28T22:17:08.652898] [INFO ] [MAIN ] PTY: Loaded 37657 primary data records. [2025-10-28T22:17:09.425087] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:09.474350] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:09.503908] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:09.540581] [INFO ] [MAIN ] PTA: Generated 138 derivative records from 15193 primary records. [2025-10-28T22:17:09.543551] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-28T22:17:09.561808] [DEBUG] [LOCAL ] PTA: Derivative data saved (138 records). [2025-10-28T22:17:09.562161] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-28T22:17:09.565678] [INFO ] [MAIN ] Derivative Progress: 1477/2046 symbols completed. PTA took 1.2s. Estimated remaining: 3m 51s. Rate: 147.9 symbols/min [2025-10-28T22:17:09.571243] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:09.587313] [INFO ] [MAIN ] PTY: Generated 138 derivative records from 37657 primary records. [2025-10-28T22:17:09.589362] [INFO ] [MAIN ] PSX: Generated 138 derivative records from 53107 primary records. [2025-10-28T22:17:09.589471] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-28T22:17:09.589568] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-28T22:17:09.624325] [DEBUG] [LOCAL ] PSX: Derivative data saved (138 records). [2025-10-28T22:17:09.624474] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-28T22:17:09.627827] [INFO ] [MAIN ] Derivative Progress: 1478/2046 symbols completed. PSX took 1.3s. Estimated remaining: 3m 50s. Rate: 148.0 symbols/min [2025-10-28T22:17:09.624552] [DEBUG] [LOCAL ] PTY: Derivative data saved (138 records). [2025-10-28T22:17:09.628091] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:09.628208] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-28T22:17:09.631039] [INFO ] [MAIN ] Derivative Progress: 1479/2046 symbols completed. PTY took 1.2s. Estimated remaining: 3m 50s. Rate: 148.1 symbols/min [2025-10-28T22:17:09.631491] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:09.646587] [DEBUG] [LOCAL ] PUK: Loaded 44131 existing records from primary storage. [2025-10-28T22:17:09.646918] [INFO ] [MAIN ] PUK: Loaded 44131 primary data records. [2025-10-28T22:17:09.988063] [DEBUG] [LOCAL ] PUMP: Loaded 49411 existing records from primary storage. [2025-10-28T22:17:09.990421] [DEBUG] [LOCAL ] PVH: Loaded 48888 existing records from primary storage. [2025-10-28T22:17:09.990623] [INFO ] [MAIN ] PUMP: Loaded 49411 primary data records. [2025-10-28T22:17:09.990808] [INFO ] [MAIN ] PVH: Loaded 48888 primary data records. [2025-10-28T22:17:10.629880] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:10.678090] [INFO ] [MAIN ] PUK: Generated 138 derivative records from 44131 primary records. [2025-10-28T22:17:10.678435] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-28T22:17:10.691811] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:10.725158] [DEBUG] [LOCAL ] PUK: Derivative data saved (138 records). [2025-10-28T22:17:10.729588] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-28T22:17:10.732600] [INFO ] [MAIN ] Derivative Progress: 1480/2046 symbols completed. PUK took 1.2s. Estimated remaining: 3m 50s. Rate: 147.9 symbols/min [2025-10-28T22:17:10.734956] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:10.736483] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:10.761098] [DEBUG] [LOCAL ] PVL: Loaded 4790 existing records from primary storage. [2025-10-28T22:17:10.762898] [INFO ] [MAIN ] PVL: Loaded 4790 primary data records. [2025-10-28T22:17:11.091209] [INFO ] [MAIN ] PVH: Generated 138 derivative records from 48888 primary records. [2025-10-28T22:17:11.092307] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-28T22:17:11.107892] [INFO ] [MAIN ] PUMP: Generated 138 derivative records from 49411 primary records. [2025-10-28T22:17:11.110747] [DEBUG] [LOCAL ] PVH: Derivative data saved (138 records). [2025-10-28T22:17:11.111754] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-28T22:17:11.111802] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-28T22:17:11.114670] [INFO ] [MAIN ] Derivative Progress: 1481/2046 symbols completed. PVH took 1.5s. Estimated remaining: 3m 49s. Rate: 147.9 symbols/min [2025-10-28T22:17:11.116144] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:11.127797] [DEBUG] [LOCAL ] PUMP: Derivative data saved (138 records). [2025-10-28T22:17:11.128001] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-10-28T22:17:11.130836] [INFO ] [MAIN ] Derivative Progress: 1482/2046 symbols completed. PUMP took 1.5s. Estimated remaining: 3m 49s. Rate: 148.0 symbols/min [2025-10-28T22:17:11.131226] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:11.149629] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:11.210090] [DEBUG] [LOCAL ] PX: Loaded 33219 existing records from primary storage. [2025-10-28T22:17:11.212238] [INFO ] [MAIN ] PX: Loaded 33219 primary data records. [2025-10-28T22:17:11.212173] [INFO ] [MAIN ] PVL: Generated 138 derivative records from 4790 primary records. [2025-10-28T22:17:11.212875] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-28T22:17:11.293317] [DEBUG] [LOCAL ] PVL: Derivative data saved (138 records). [2025-10-28T22:17:11.303279] [DEBUG] [LOCAL ] PWR: Loaded 46230 existing records from primary storage. [2025-10-28T22:17:11.308580] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-28T22:17:11.308513] [INFO ] [MAIN ] PWR: Loaded 46230 primary data records. [2025-10-28T22:17:11.323706] [INFO ] [MAIN ] Derivative Progress: 1483/2046 symbols completed. PVL took 0.6s. Estimated remaining: 3m 48s. Rate: 148.1 symbols/min [2025-10-28T22:17:11.865550] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:11.902036] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:11.931050] [INFO ] [MAIN ] PX: Generated 138 derivative records from 33219 primary records. [2025-10-28T22:17:11.931543] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-28T22:17:11.947267] [DEBUG] [LOCAL ] PX: Derivative data saved (138 records). [2025-10-28T22:17:11.949960] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-28T22:17:11.952698] [INFO ] [MAIN ] Derivative Progress: 1484/2046 symbols completed. PX took 0.8s. Estimated remaining: 3m 48s. Rate: 148.0 symbols/min [2025-10-28T22:17:11.958228] [INFO ] [MAIN ] PWR: Generated 138 derivative records from 46230 primary records. [2025-10-28T22:17:11.958300] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-28T22:17:11.970134] [DEBUG] [LOCAL ] PWR: Derivative data saved (138 records). [2025-10-28T22:17:11.970190] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-28T22:17:11.972543] [INFO ] [MAIN ] Derivative Progress: 1485/2046 symbols completed. PWR took 0.9s. Estimated remaining: 3m 47s. Rate: 148.1 symbols/min [2025-10-28T22:17:11.972931] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:11.973031] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:11.973140] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:12.006326] [DEBUG] [LOCAL ] QD: Loaded 27313 existing records from primary storage. [2025-10-28T22:17:12.006465] [INFO ] [MAIN ] QD: Loaded 27313 primary data records. [2025-10-28T22:17:12.350064] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-28T22:17:12.363564] [INFO ] [MAIN ] QS: Loaded 53760 primary data records. [2025-10-28T22:17:12.385597] [DEBUG] [LOCAL ] QGEN: Loaded 48868 existing records from primary storage. [2025-10-28T22:17:12.408214] [INFO ] [MAIN ] QGEN: Loaded 48868 primary data records. [2025-10-28T22:17:13.206522] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:13.295550] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:13.365591] [INFO ] [MAIN ] QD: Generated 138 derivative records from 27313 primary records. [2025-10-28T22:17:13.370236] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-28T22:17:13.410064] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:13.433511] [INFO ] [MAIN ] QS: Generated 138 derivative records from 53760 primary records. [2025-10-28T22:17:13.430777] [DEBUG] [LOCAL ] QD: Derivative data saved (138 records). [2025-10-28T22:17:13.434984] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-28T22:17:13.434906] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-28T22:17:13.439425] [INFO ] [MAIN ] Derivative Progress: 1486/2046 symbols completed. QD took 1.5s. Estimated remaining: 3m 47s. Rate: 147.9 symbols/min [2025-10-28T22:17:13.458176] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:13.458019] [DEBUG] [LOCAL ] QS: Derivative data saved (138 records). [2025-10-28T22:17:13.458666] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-28T22:17:13.460971] [INFO ] [MAIN ] Derivative Progress: 1487/2046 symbols completed. QS took 1.5s. Estimated remaining: 3m 47s. Rate: 147.9 symbols/min [2025-10-28T22:17:13.461536] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:13.477389] [INFO ] [MAIN ] QGEN: Generated 138 derivative records from 48868 primary records. [2025-10-28T22:17:13.477615] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-28T22:17:13.500625] [DEBUG] [LOCAL ] QGEN: Derivative data saved (138 records). [2025-10-28T22:17:13.501050] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-28T22:17:13.504748] [INFO ] [MAIN ] Derivative Progress: 1488/2046 symbols completed. QGEN took 1.5s. Estimated remaining: 3m 46s. Rate: 148.0 symbols/min [2025-10-28T22:17:13.505151] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:13.535956] [DEBUG] [LOCAL ] QTWO: Loaded 39175 existing records from primary storage. [2025-10-28T22:17:13.536128] [INFO ] [MAIN ] QTWO: Loaded 39175 primary data records. [2025-10-28T22:17:13.675508] [DEBUG] [LOCAL ] QUAD: Loaded 22828 existing records from primary storage. [2025-10-28T22:17:13.674464] [DEBUG] [LOCAL ] QSR: Loaded 52364 existing records from primary storage. [2025-10-28T22:17:13.675752] [INFO ] [MAIN ] QSR: Loaded 52364 primary data records. [2025-10-28T22:17:13.675870] [INFO ] [MAIN ] QUAD: Loaded 22828 primary data records. [2025-10-28T22:17:14.516387] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:14.579801] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:14.579658] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:14.629291] [INFO ] [MAIN ] QTWO: Generated 138 derivative records from 39175 primary records. [2025-10-28T22:17:14.629743] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-28T22:17:14.652360] [DEBUG] [LOCAL ] QTWO: Derivative data saved (138 records). [2025-10-28T22:17:14.655453] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-28T22:17:14.660922] [INFO ] [MAIN ] Derivative Progress: 1489/2046 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 46s. Rate: 147.9 symbols/min [2025-10-28T22:17:14.661277] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:14.678463] [DEBUG] [LOCAL ] QVCC: Loaded 8513 existing records from primary storage. [2025-10-28T22:17:14.682311] [INFO ] [MAIN ] QSR: Generated 138 derivative records from 52364 primary records. [2025-10-28T22:17:14.682429] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-28T22:17:14.682546] [INFO ] [MAIN ] QVCC: Loaded 8513 primary data records. [2025-10-28T22:17:14.696452] [INFO ] [MAIN ] QUAD: Generated 138 derivative records from 22828 primary records. [2025-10-28T22:17:14.696778] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-28T22:17:14.791244] [DEBUG] [LOCAL ] QSR: Derivative data saved (138 records). [2025-10-28T22:17:14.791385] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-28T22:17:14.776574] [DEBUG] [LOCAL ] QUAD: Derivative data saved (138 records). [2025-10-28T22:17:14.819424] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-28T22:17:14.804322] [INFO ] [MAIN ] Derivative Progress: 1490/2046 symbols completed. QSR took 1.3s. Estimated remaining: 3m 46s. Rate: 147.9 symbols/min [2025-10-28T22:17:14.823432] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:14.826211] [INFO ] [MAIN ] Derivative Progress: 1491/2046 symbols completed. QUAD took 1.3s. Estimated remaining: 3m 45s. Rate: 148.0 symbols/min [2025-10-28T22:17:14.854753] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:14.889496] [DEBUG] [LOCAL ] QVCD: Loaded 4430 existing records from primary storage. [2025-10-28T22:17:14.910760] [INFO ] [MAIN ] QVCD: Loaded 4430 primary data records. [2025-10-28T22:17:15.406178] [DEBUG] [LOCAL ] QXO: Loaded 53497 existing records from primary storage. [2025-10-28T22:17:15.406389] [INFO ] [MAIN ] QXO: Loaded 53497 primary data records. [2025-10-28T22:17:15.404905] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:15.759495] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:17:15.800538] [INFO ] [MAIN ] QVCC: Generated 138 derivative records from 8513 primary records. [2025-10-28T22:17:15.803276] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-28T22:17:15.832498] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:15.831567] [DEBUG] [LOCAL ] QVCC: Derivative data saved (138 records). [2025-10-28T22:17:15.834053] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-28T22:17:15.848008] [INFO ] [MAIN ] Derivative Progress: 1492/2046 symbols completed. QVCC took 1.2s. Estimated remaining: 3m 45s. Rate: 147.9 symbols/min [2025-10-28T22:17:15.848347] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:15.863435] [INFO ] [MAIN ] QVCD: Generated 138 derivative records from 4430 primary records. [2025-10-28T22:17:15.867420] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-28T22:17:15.880602] [DEBUG] [LOCAL ] QVCD: Derivative data saved (138 records). [2025-10-28T22:17:15.883446] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-28T22:17:15.886100] [INFO ] [MAIN ] Derivative Progress: 1493/2046 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 44s. Rate: 148.0 symbols/min [2025-10-28T22:17:15.894105] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:15.902064] [INFO ] [MAIN ] QXO: Generated 138 derivative records from 53497 primary records. [2025-10-28T22:17:15.902353] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-28T22:17:15.923694] [DEBUG] [LOCAL ] QXO: Derivative data saved (138 records). [2025-10-28T22:17:15.924025] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-28T22:17:15.926780] [INFO ] [MAIN ] Derivative Progress: 1494/2046 symbols completed. QXO took 1.1s. Estimated remaining: 3m 44s. Rate: 148.0 symbols/min [2025-10-28T22:17:15.931358] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:15.932754] [DEBUG] [LOCAL ] R: Loaded 27904 existing records from primary storage. [2025-10-28T22:17:15.932971] [INFO ] [MAIN ] R: Loaded 27904 primary data records. [2025-10-28T22:17:16.008409] [DEBUG] [LOCAL ] RA: Loaded 21494 existing records from primary storage. [2025-10-28T22:17:16.031994] [INFO ] [MAIN ] RA: Loaded 21494 primary data records. [2025-10-28T22:17:16.255018] [DEBUG] [LOCAL ] RACE: Loaded 32727 existing records from primary storage. [2025-10-28T22:17:16.419823] [INFO ] [MAIN ] RACE: Loaded 32727 primary data records. [2025-10-28T22:17:16.957910] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:16.986258] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:17.030790] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:17.074339] [INFO ] [MAIN ] R: Generated 138 derivative records from 27904 primary records. [2025-10-28T22:17:17.077254] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-28T22:17:17.095507] [DEBUG] [LOCAL ] R: Derivative data saved (138 records). [2025-10-28T22:17:17.096130] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-28T22:17:17.100044] [INFO ] [MAIN ] Derivative Progress: 1495/2046 symbols completed. R took 1.3s. Estimated remaining: 3m 44s. Rate: 147.9 symbols/min [2025-10-28T22:17:17.100357] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:17.104958] [INFO ] [MAIN ] RA: Generated 138 derivative records from 21494 primary records. [2025-10-28T22:17:17.107840] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-28T22:17:17.122173] [DEBUG] [LOCAL ] RA: Derivative data saved (138 records). [2025-10-28T22:17:17.124377] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-28T22:17:17.124275] [INFO ] [MAIN ] RACE: Generated 138 derivative records from 32727 primary records. [2025-10-28T22:17:17.124568] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-28T22:17:17.127187] [INFO ] [MAIN ] Derivative Progress: 1496/2046 symbols completed. RA took 1.2s. Estimated remaining: 3m 43s. Rate: 147.9 symbols/min [2025-10-28T22:17:17.128014] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:17.140568] [DEBUG] [LOCAL ] RACE: Derivative data saved (138 records). [2025-10-28T22:17:17.140806] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-28T22:17:17.143727] [INFO ] [MAIN ] Derivative Progress: 1497/2046 symbols completed. RACE took 1.2s. Estimated remaining: 3m 43s. Rate: 148.0 symbols/min [2025-10-28T22:17:17.144036] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:17.172420] [DEBUG] [LOCAL ] RAMP: Loaded 37292 existing records from primary storage. [2025-10-28T22:17:17.177624] [INFO ] [MAIN ] RAMP: Loaded 37292 primary data records. [2025-10-28T22:17:17.188485] [DEBUG] [LOCAL ] RBC: Loaded 15204 existing records from primary storage. [2025-10-28T22:17:17.188626] [INFO ] [MAIN ] RBC: Loaded 15204 primary data records. [2025-10-28T22:17:17.407503] [DEBUG] [LOCAL ] RBA: Loaded 45883 existing records from primary storage. [2025-10-28T22:17:17.471215] [INFO ] [MAIN ] RBA: Loaded 45883 primary data records. [2025-10-28T22:17:18.171347] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:18.176448] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:18.237896] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:18.287229] [INFO ] [MAIN ] RBC: Generated 138 derivative records from 15204 primary records. [2025-10-28T22:17:18.286843] [INFO ] [MAIN ] RAMP: Generated 138 derivative records from 37292 primary records. [2025-10-28T22:17:18.287570] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-28T22:17:18.287430] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-28T22:17:18.315836] [DEBUG] [LOCAL ] RAMP: Derivative data saved (138 records). [2025-10-28T22:17:18.317041] [DEBUG] [LOCAL ] RBC: Derivative data saved (138 records). [2025-10-28T22:17:18.317245] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-28T22:17:18.319794] [INFO ] [MAIN ] Derivative Progress: 1498/2046 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 42s. Rate: 147.9 symbols/min [2025-10-28T22:17:18.322350] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-28T22:17:18.325295] [INFO ] [MAIN ] Derivative Progress: 1499/2046 symbols completed. RBC took 1.2s. Estimated remaining: 3m 42s. Rate: 147.9 symbols/min [2025-10-28T22:17:18.327667] [INFO ] [MAIN ] RBA: Generated 138 derivative records from 45883 primary records. [2025-10-28T22:17:18.327796] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-28T22:17:18.339529] [DEBUG] [LOCAL ] RBA: Derivative data saved (138 records). [2025-10-28T22:17:18.339585] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-28T22:17:18.342321] [INFO ] [MAIN ] Derivative Progress: 1500/2046 symbols completed. RBA took 1.2s. Estimated remaining: 3m 41s. Rate: 148.0 symbols/min [2025-10-28T22:17:18.343146] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:18.342986] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:18.343078] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:18.354564] [DEBUG] [LOCAL ] RBOT: Loaded 6311 existing records from primary storage. [2025-10-28T22:17:18.354813] [INFO ] [MAIN ] RBOT: Loaded 6311 primary data records. [2025-10-28T22:17:18.703042] [DEBUG] [LOCAL ] RBRK: Loaded 53163 existing records from primary storage. [2025-10-28T22:17:18.703949] [INFO ] [MAIN ] RBRK: Loaded 53163 primary data records. [2025-10-28T22:17:18.809159] [DEBUG] [LOCAL ] RBLX: Loaded 53718 existing records from primary storage. [2025-10-28T22:17:18.834250] [INFO ] [MAIN ] RBLX: Loaded 53718 primary data records. [2025-10-28T22:17:19.396158] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:19.449382] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:19.482184] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:19.485524] [INFO ] [MAIN ] RBOT: Generated 138 derivative records from 6311 primary records. [2025-10-28T22:17:19.502365] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-28T22:17:19.521048] [DEBUG] [LOCAL ] RBOT: Derivative data saved (138 records). [2025-10-28T22:17:19.521184] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-28T22:17:19.526039] [INFO ] [MAIN ] Derivative Progress: 1501/2046 symbols completed. RBOT took 1.2s. Estimated remaining: 3m 41s. Rate: 147.9 symbols/min [2025-10-28T22:17:19.526414] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:19.564250] [INFO ] [MAIN ] RBLX: Generated 138 derivative records from 53718 primary records. [2025-10-28T22:17:19.564100] [INFO ] [MAIN ] RBRK: Generated 138 derivative records from 53163 primary records. [2025-10-28T22:17:19.564410] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-28T22:17:19.564480] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-28T22:17:19.600886] [DEBUG] [LOCAL ] RBLX: Derivative data saved (138 records). [2025-10-28T22:17:19.603366] [DEBUG] [LOCAL ] RBRK: Derivative data saved (138 records). [2025-10-28T22:17:19.603007] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-28T22:17:19.603458] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-28T22:17:19.606248] [INFO ] [MAIN ] Derivative Progress: 1502/2046 symbols completed. RBLX took 1.3s. Estimated remaining: 3m 41s. Rate: 147.9 symbols/min [2025-10-28T22:17:19.609467] [INFO ] [MAIN ] Derivative Progress: 1503/2046 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 40s. Rate: 148.0 symbols/min [2025-10-28T22:17:19.609586] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:19.609251] [DEBUG] [LOCAL ] RC: Loaded 48686 existing records from primary storage. [2025-10-28T22:17:19.609388] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:19.610428] [INFO ] [MAIN ] RC: Loaded 48686 primary data records. [2025-10-28T22:17:19.688686] [DEBUG] [LOCAL ] RCD: Loaded 3240 existing records from primary storage. [2025-10-28T22:17:19.715277] [INFO ] [MAIN ] RCD: Loaded 3240 primary data records. [2025-10-28T22:17:20.229570] [DEBUG] [LOCAL ] RCI: Loaded 48534 existing records from primary storage. [2025-10-28T22:17:20.230937] [INFO ] [MAIN ] RCI: Loaded 48534 primary data records. [2025-10-28T22:17:20.560291] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:20.579997] [DEBUG] [MAIN ] RCD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-28T22:17:20.646077] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:20.675181] [INFO ] [MAIN ] RC: Generated 138 derivative records from 48686 primary records. [2025-10-28T22:17:20.675676] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-28T22:17:20.692499] [DEBUG] [LOCAL ] RC: Derivative data saved (138 records). [2025-10-28T22:17:20.692721] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-28T22:17:20.694835] [INFO ] [MAIN ] Derivative Progress: 1504/2046 symbols completed. RC took 1.2s. Estimated remaining: 3m 40s. Rate: 147.9 symbols/min [2025-10-28T22:17:20.697600] [INFO ] [MAIN ] RCD: Generated 138 derivative records from 3240 primary records. [2025-10-28T22:17:20.695013] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:20.697779] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-28T22:17:20.717588] [DEBUG] [LOCAL ] RCD: Derivative data saved (138 records). [2025-10-28T22:17:20.718018] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-10-28T22:17:20.721371] [INFO ] [MAIN ] Derivative Progress: 1505/2046 symbols completed. RCD took 1.1s. Estimated remaining: 3m 39s. Rate: 148.0 symbols/min [2025-10-28T22:17:20.721607] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:20.733949] [DEBUG] [LOCAL ] RCS: Loaded 12242 existing records from primary storage. [2025-10-28T22:17:20.734471] [INFO ] [MAIN ] RCS: Loaded 12242 primary data records. [2025-10-28T22:17:20.776262] [INFO ] [MAIN ] RCI: Generated 138 derivative records from 48534 primary records. [2025-10-28T22:17:20.804350] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-28T22:17:20.920325] [DEBUG] [LOCAL ] RCI: Derivative data saved (138 records). [2025-10-28T22:17:20.963087] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-28T22:17:20.969175] [INFO ] [MAIN ] Derivative Progress: 1506/2046 symbols completed. RCI took 1.4s. Estimated remaining: 3m 39s. Rate: 148.0 symbols/min [2025-10-28T22:17:20.969332] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:20.970396] [DEBUG] [LOCAL ] RCUS: Loaded 42731 existing records from primary storage. [2025-10-28T22:17:21.108079] [INFO ] [MAIN ] RCUS: Loaded 42731 primary data records. [2025-10-28T22:17:21.443903] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:21.473885] [DEBUG] [LOCAL ] RDDT: Loaded 53769 existing records from primary storage. [2025-10-28T22:17:21.475692] [INFO ] [MAIN ] RDDT: Loaded 53769 primary data records. [2025-10-28T22:17:21.677857] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:21.820683] [INFO ] [MAIN ] RCS: Generated 138 derivative records from 12242 primary records. [2025-10-28T22:17:21.824847] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-28T22:17:21.841287] [DEBUG] [LOCAL ] RCS: Derivative data saved (138 records). [2025-10-28T22:17:21.841689] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-28T22:17:21.843799] [INFO ] [MAIN ] Derivative Progress: 1507/2046 symbols completed. RCS took 1.1s. Estimated remaining: 3m 39s. Rate: 147.9 symbols/min [2025-10-28T22:17:21.846588] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:21.867704] [INFO ] [MAIN ] RCUS: Generated 138 derivative records from 42731 primary records. [2025-10-28T22:17:21.867826] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-28T22:17:21.867480] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:21.893212] [DEBUG] [LOCAL ] RCUS: Derivative data saved (138 records). [2025-10-28T22:17:21.893392] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-28T22:17:21.897673] [INFO ] [MAIN ] Derivative Progress: 1508/2046 symbols completed. RCUS took 1.2s. Estimated remaining: 3m 38s. Rate: 148.0 symbols/min [2025-10-28T22:17:21.898341] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:21.926193] [INFO ] [MAIN ] RDDT: Generated 138 derivative records from 53769 primary records. [2025-10-28T22:17:21.926447] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-28T22:17:21.950094] [DEBUG] [LOCAL ] RDDT: Derivative data saved (138 records). [2025-10-28T22:17:21.950284] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-28T22:17:21.951053] [DEBUG] [LOCAL ] RDN: Loaded 43547 existing records from primary storage. [2025-10-28T22:17:21.965448] [INFO ] [MAIN ] RDN: Loaded 43547 primary data records. [2025-10-28T22:17:21.965256] [INFO ] [MAIN ] Derivative Progress: 1509/2046 symbols completed. RDDT took 1.0s. Estimated remaining: 3m 38s. Rate: 148.1 symbols/min [2025-10-28T22:17:21.965629] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:22.099930] [DEBUG] [LOCAL ] RDW: Loaded 52320 existing records from primary storage. [2025-10-28T22:17:22.130864] [INFO ] [MAIN ] RDW: Loaded 52320 primary data records. [2025-10-28T22:17:22.410085] [DEBUG] [LOCAL ] RDY: Loaded 46012 existing records from primary storage. [2025-10-28T22:17:22.445488] [INFO ] [MAIN ] RDY: Loaded 46012 primary data records. [2025-10-28T22:17:22.979187] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:23.031918] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:23.066838] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:23.069873] [INFO ] [MAIN ] RDN: Generated 138 derivative records from 43547 primary records. [2025-10-28T22:17:23.085902] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-28T22:17:23.102949] [DEBUG] [LOCAL ] RDN: Derivative data saved (138 records). [2025-10-28T22:17:23.105308] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-28T22:17:23.108383] [INFO ] [MAIN ] Derivative Progress: 1510/2046 symbols completed. RDN took 1.3s. Estimated remaining: 3m 37s. Rate: 147.9 symbols/min [2025-10-28T22:17:23.108788] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:23.127611] [INFO ] [MAIN ] RDW: Generated 138 derivative records from 52320 primary records. [2025-10-28T22:17:23.130352] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-28T22:17:23.144160] [DEBUG] [LOCAL ] RDW: Derivative data saved (138 records). [2025-10-28T22:17:23.144316] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-28T22:17:23.146561] [INFO ] [MAIN ] Derivative Progress: 1511/2046 symbols completed. RDW took 1.2s. Estimated remaining: 3m 37s. Rate: 148.0 symbols/min [2025-10-28T22:17:23.148331] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:23.148697] [INFO ] [MAIN ] RDY: Generated 138 derivative records from 46012 primary records. [2025-10-28T22:17:23.158956] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-28T22:17:23.172184] [DEBUG] [LOCAL ] RDY: Derivative data saved (138 records). [2025-10-28T22:17:23.172460] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-28T22:17:23.175269] [INFO ] [MAIN ] Derivative Progress: 1512/2046 symbols completed. RDY took 1.2s. Estimated remaining: 3m 36s. Rate: 148.1 symbols/min [2025-10-28T22:17:23.175560] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:23.191048] [DEBUG] [LOCAL ] RELX: Loaded 48428 existing records from primary storage. [2025-10-28T22:17:23.191394] [INFO ] [MAIN ] RELX: Loaded 48428 primary data records. [2025-10-28T22:17:23.373571] [DEBUG] [LOCAL ] RERE: Loaded 41655 existing records from primary storage. [2025-10-28T22:17:23.401797] [INFO ] [MAIN ] RERE: Loaded 41655 primary data records. [2025-10-28T22:17:23.613825] [DEBUG] [LOCAL ] RES: Loaded 46787 existing records from primary storage. [2025-10-28T22:17:23.620363] [INFO ] [MAIN ] RES: Loaded 46787 primary data records. [2025-10-28T22:17:24.140169] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:24.174851] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:24.219149] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:24.251816] [INFO ] [MAIN ] RELX: Generated 138 derivative records from 48428 primary records. [2025-10-28T22:17:24.252345] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-28T22:17:24.255593] [INFO ] [MAIN ] RERE: Generated 138 derivative records from 41655 primary records. [2025-10-28T22:17:24.264499] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-28T22:17:24.267595] [DEBUG] [LOCAL ] RELX: Derivative data saved (138 records). [2025-10-28T22:17:24.274799] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-28T22:17:24.279216] [INFO ] [MAIN ] Derivative Progress: 1513/2046 symbols completed. RELX took 1.2s. Estimated remaining: 3m 36s. Rate: 147.9 symbols/min [2025-10-28T22:17:24.283551] [DEBUG] [LOCAL ] RERE: Derivative data saved (138 records). [2025-10-28T22:17:24.283900] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-28T22:17:24.286009] [INFO ] [MAIN ] Derivative Progress: 1514/2046 symbols completed. RERE took 1.1s. Estimated remaining: 3m 36s. Rate: 148.0 symbols/min [2025-10-28T22:17:24.293715] [INFO ] [MAIN ] RES: Generated 138 derivative records from 46787 primary records. [2025-10-28T22:17:24.293787] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-28T22:17:24.304825] [DEBUG] [LOCAL ] RES: Derivative data saved (138 records). [2025-10-28T22:17:24.304881] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-28T22:17:24.307266] [INFO ] [MAIN ] Derivative Progress: 1515/2046 symbols completed. RES took 1.1s. Estimated remaining: 3m 35s. Rate: 148.1 symbols/min [2025-10-28T22:17:24.307728] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:24.307635] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:24.307850] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:24.323367] [DEBUG] [LOCAL ] REX: Loaded 14064 existing records from primary storage. [2025-10-28T22:17:24.323597] [INFO ] [MAIN ] REX: Loaded 14064 primary data records. [2025-10-28T22:17:24.645211] [DEBUG] [LOCAL ] REVG: Loaded 39757 existing records from primary storage. [2025-10-28T22:17:24.658854] [INFO ] [MAIN ] REVG: Loaded 39757 primary data records. [2025-10-28T22:17:24.690822] [DEBUG] [LOCAL ] REXR: Loaded 52140 existing records from primary storage. [2025-10-28T22:17:24.708699] [INFO ] [MAIN ] REXR: Loaded 52140 primary data records. [2025-10-28T22:17:25.302142] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:25.340840] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:25.375224] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:25.404702] [INFO ] [MAIN ] REX: Generated 138 derivative records from 14064 primary records. [2025-10-28T22:17:25.405520] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-28T22:17:25.423894] [DEBUG] [LOCAL ] REX: Derivative data saved (138 records). [2025-10-28T22:17:25.424834] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-28T22:17:25.427706] [INFO ] [MAIN ] Derivative Progress: 1516/2046 symbols completed. REX took 1.1s. Estimated remaining: 3m 35s. Rate: 147.9 symbols/min [2025-10-28T22:17:25.428019] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:25.439152] [INFO ] [MAIN ] REVG: Generated 138 derivative records from 39757 primary records. [2025-10-28T22:17:25.439682] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-28T22:17:25.457661] [DEBUG] [LOCAL ] REVG: Derivative data saved (138 records). [2025-10-28T22:17:25.456984] [INFO ] [MAIN ] REXR: Generated 138 derivative records from 52140 primary records. [2025-10-28T22:17:25.457902] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-28T22:17:25.457859] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-28T22:17:25.460064] [INFO ] [MAIN ] Derivative Progress: 1517/2046 symbols completed. REVG took 1.2s. Estimated remaining: 3m 34s. Rate: 148.0 symbols/min [2025-10-28T22:17:25.460982] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:25.482155] [DEBUG] [LOCAL ] REXR: Derivative data saved (138 records). [2025-10-28T22:17:25.482343] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-28T22:17:25.484834] [INFO ] [MAIN ] Derivative Progress: 1518/2046 symbols completed. REXR took 1.2s. Estimated remaining: 3m 34s. Rate: 148.1 symbols/min [2025-10-28T22:17:25.485039] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:25.503216] [DEBUG] [LOCAL ] REZI: Loaded 47007 existing records from primary storage. [2025-10-28T22:17:25.503515] [INFO ] [MAIN ] REZI: Loaded 47007 primary data records. [2025-10-28T22:17:25.570902] [DEBUG] [LOCAL ] RFI: Loaded 9985 existing records from primary storage. [2025-10-28T22:17:25.593218] [INFO ] [MAIN ] RFI: Loaded 9985 primary data records. [2025-10-28T22:17:26.113734] [DEBUG] [LOCAL ] RF: Loaded 53633 existing records from primary storage. [2025-10-28T22:17:26.113993] [INFO ] [MAIN ] RF: Loaded 53633 primary data records. [2025-10-28T22:17:26.427998] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:26.473853] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:26.510559] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:26.535566] [INFO ] [MAIN ] REZI: Generated 138 derivative records from 47007 primary records. [2025-10-28T22:17:26.536337] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-28T22:17:26.557960] [DEBUG] [LOCAL ] REZI: Derivative data saved (138 records). [2025-10-28T22:17:26.562704] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-28T22:17:26.567425] [INFO ] [MAIN ] Derivative Progress: 1519/2046 symbols completed. REZI took 1.1s. Estimated remaining: 3m 34s. Rate: 147.9 symbols/min [2025-10-28T22:17:26.568054] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:26.580791] [INFO ] [MAIN ] RFI: Generated 138 derivative records from 9985 primary records. [2025-10-28T22:17:26.584000] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-28T22:17:26.604424] [DEBUG] [LOCAL ] RFI: Derivative data saved (138 records). [2025-10-28T22:17:26.603852] [DEBUG] [LOCAL ] RFL: Loaded 11399 existing records from primary storage. [2025-10-28T22:17:26.605226] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-28T22:17:26.605321] [INFO ] [MAIN ] RFL: Loaded 11399 primary data records. [2025-10-28T22:17:26.609230] [INFO ] [MAIN ] Derivative Progress: 1520/2046 symbols completed. RFI took 1.1s. Estimated remaining: 3m 33s. Rate: 148.0 symbols/min [2025-10-28T22:17:26.646218] [INFO ] [MAIN ] RF: Generated 138 derivative records from 53633 primary records. [2025-10-28T22:17:26.646443] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-28T22:17:26.646384] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:26.729305] [DEBUG] [LOCAL ] RF: Derivative data saved (138 records). [2025-10-28T22:17:26.757982] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-28T22:17:26.758354] [DEBUG] [LOCAL ] RFM: Loaded 4077 existing records from primary storage. [2025-10-28T22:17:26.760847] [INFO ] [MAIN ] Derivative Progress: 1521/2046 symbols completed. RF took 1.3s. Estimated remaining: 3m 33s. Rate: 148.1 symbols/min [2025-10-28T22:17:26.775863] [INFO ] [MAIN ] RFM: Loaded 4077 primary data records. [2025-10-28T22:17:26.776011] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:27.084406] [DEBUG] [LOCAL ] RFMZ: Loaded 8852 existing records from primary storage. [2025-10-28T22:17:27.092945] [INFO ] [MAIN ] RFMZ: Loaded 8852 primary data records. [2025-10-28T22:17:27.608985] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:27.649282] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:27.691914] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:27.724511] [INFO ] [MAIN ] RFL: Generated 138 derivative records from 11399 primary records. [2025-10-28T22:17:27.726117] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-28T22:17:27.747033] [DEBUG] [LOCAL ] RFL: Derivative data saved (138 records). [2025-10-28T22:17:27.750492] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-28T22:17:27.755530] [INFO ] [MAIN ] Derivative Progress: 1522/2046 symbols completed. RFL took 1.2s. Estimated remaining: 3m 33s. Rate: 147.9 symbols/min [2025-10-28T22:17:27.758964] [INFO ] [MAIN ] RFM: Generated 138 derivative records from 4077 primary records. [2025-10-28T22:17:27.761986] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-28T22:17:27.762128] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:27.778500] [DEBUG] [LOCAL ] RFM: Derivative data saved (138 records). [2025-10-28T22:17:27.778857] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-28T22:17:27.778767] [INFO ] [MAIN ] RFMZ: Generated 138 derivative records from 8852 primary records. [2025-10-28T22:17:27.781358] [INFO ] [MAIN ] Derivative Progress: 1523/2046 symbols completed. RFM took 1.1s. Estimated remaining: 3m 32s. Rate: 148.0 symbols/min [2025-10-28T22:17:27.781573] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-28T22:17:27.782620] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:27.795768] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (138 records). [2025-10-28T22:17:27.796782] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-28T22:17:27.799415] [INFO ] [MAIN ] Derivative Progress: 1524/2046 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 31s. Rate: 148.1 symbols/min [2025-10-28T22:17:27.799619] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:27.811765] [DEBUG] [LOCAL ] RGT: Loaded 2621 existing records from primary storage. [2025-10-28T22:17:27.815826] [INFO ] [MAIN ] RGT: Loaded 2621 primary data records. [2025-10-28T22:17:27.926923] [DEBUG] [LOCAL ] RGR: Loaded 20750 existing records from primary storage. [2025-10-28T22:17:27.921348] [DEBUG] [LOCAL ] RGA: Loaded 28878 existing records from primary storage. [2025-10-28T22:17:27.927125] [INFO ] [MAIN ] RGR: Loaded 20750 primary data records. [2025-10-28T22:17:27.938396] [INFO ] [MAIN ] RGA: Loaded 28878 primary data records. [2025-10-28T22:17:28.746354] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:28.799448] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:28.800408] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:28.846590] [INFO ] [MAIN ] RGT: Generated 138 derivative records from 2621 primary records. [2025-10-28T22:17:28.849202] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-28T22:17:28.864240] [DEBUG] [LOCAL ] RGT: Derivative data saved (138 records). [2025-10-28T22:17:28.864341] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-28T22:17:28.868687] [INFO ] [MAIN ] Derivative Progress: 1525/2046 symbols completed. RGT took 1.1s. Estimated remaining: 3m 31s. Rate: 147.9 symbols/min [2025-10-28T22:17:28.869474] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:28.884879] [INFO ] [MAIN ] RGA: Generated 138 derivative records from 28878 primary records. [2025-10-28T22:17:28.885178] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-28T22:17:28.887409] [INFO ] [MAIN ] RGR: Generated 138 derivative records from 20750 primary records. [2025-10-28T22:17:28.887686] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-28T22:17:28.909904] [DEBUG] [LOCAL ] RGA: Derivative data saved (138 records). [2025-10-28T22:17:28.911613] [DEBUG] [LOCAL ] RGR: Derivative data saved (138 records). [2025-10-28T22:17:28.911783] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-28T22:17:28.911332] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-28T22:17:28.914283] [INFO ] [MAIN ] Derivative Progress: 1526/2046 symbols completed. RGR took 1.1s. Estimated remaining: 3m 31s. Rate: 148.0 symbols/min [2025-10-28T22:17:28.917191] [INFO ] [MAIN ] Derivative Progress: 1527/2046 symbols completed. RGA took 1.2s. Estimated remaining: 3m 30s. Rate: 148.1 symbols/min [2025-10-28T22:17:28.914448] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:28.917340] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:28.948192] [DEBUG] [LOCAL ] RHI: Loaded 49745 existing records from primary storage. [2025-10-28T22:17:28.948328] [INFO ] [MAIN ] RHI: Loaded 49745 primary data records. [2025-10-28T22:17:29.302803] [DEBUG] [LOCAL ] RHP: Loaded 39770 existing records from primary storage. [2025-10-28T22:17:29.303086] [INFO ] [MAIN ] RHP: Loaded 39770 primary data records. [2025-10-28T22:17:29.422062] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-28T22:17:29.427839] [INFO ] [MAIN ] RIG: Loaded 53675 primary data records. [2025-10-28T22:17:29.945967] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:29.987577] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:30.034262] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:30.059490] [INFO ] [MAIN ] RHI: Generated 138 derivative records from 49745 primary records. [2025-10-28T22:17:30.061391] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-28T22:17:30.077164] [DEBUG] [LOCAL ] RHI: Derivative data saved (138 records). [2025-10-28T22:17:30.078378] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-28T22:17:30.084387] [INFO ] [MAIN ] Derivative Progress: 1528/2046 symbols completed. RHI took 1.2s. Estimated remaining: 3m 30s. Rate: 148.0 symbols/min [2025-10-28T22:17:30.095427] [INFO ] [MAIN ] RHP: Generated 138 derivative records from 39770 primary records. [2025-10-28T22:17:30.097811] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-28T22:17:30.113243] [INFO ] [MAIN ] RIG: Generated 138 derivative records from 53675 primary records. [2025-10-28T22:17:30.113069] [DEBUG] [LOCAL ] RHP: Derivative data saved (138 records). [2025-10-28T22:17:30.113381] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-28T22:17:30.115356] [INFO ] [MAIN ] Derivative Progress: 1529/2046 symbols completed. RHP took 1.2s. Estimated remaining: 3m 30s. Rate: 148.0 symbols/min [2025-10-28T22:17:30.113455] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-28T22:17:30.127442] [DEBUG] [LOCAL ] RIG: Derivative data saved (138 records). [2025-10-28T22:17:30.127498] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-28T22:17:30.130259] [INFO ] [MAIN ] Derivative Progress: 1530/2046 symbols completed. RIG took 1.2s. Estimated remaining: 3m 29s. Rate: 148.1 symbols/min [2025-10-28T22:17:30.130741] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:30.130850] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:30.130680] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:30.148934] [DEBUG] [LOCAL ] RIV: Loaded 12416 existing records from primary storage. [2025-10-28T22:17:30.149169] [INFO ] [MAIN ] RIV: Loaded 12416 primary data records. [2025-10-28T22:17:30.321197] [DEBUG] [LOCAL ] RITM: Loaded 52926 existing records from primary storage. [2025-10-28T22:17:30.385677] [INFO ] [MAIN ] RITM: Loaded 52926 primary data records. [2025-10-28T22:17:30.569705] [DEBUG] [LOCAL ] RIO: Loaded 53401 existing records from primary storage. [2025-10-28T22:17:30.577704] [INFO ] [MAIN ] RIO: Loaded 53401 primary data records. [2025-10-28T22:17:31.184283] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:31.237914] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:31.277123] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:31.298905] [INFO ] [MAIN ] RIV: Generated 138 derivative records from 12416 primary records. [2025-10-28T22:17:31.301633] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-28T22:17:31.322243] [DEBUG] [LOCAL ] RIV: Derivative data saved (138 records). [2025-10-28T22:17:31.325200] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-28T22:17:31.328107] [INFO ] [MAIN ] Derivative Progress: 1531/2046 symbols completed. RIV took 1.2s. Estimated remaining: 3m 29s. Rate: 147.9 symbols/min [2025-10-28T22:17:31.334584] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:31.353134] [INFO ] [MAIN ] RITM: Generated 138 derivative records from 52926 primary records. [2025-10-28T22:17:31.354338] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-28T22:17:31.367303] [INFO ] [MAIN ] RIO: Generated 138 derivative records from 53401 primary records. [2025-10-28T22:17:31.370199] [DEBUG] [LOCAL ] RITM: Derivative data saved (138 records). [2025-10-28T22:17:31.370560] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-28T22:17:31.370483] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-28T22:17:31.373528] [INFO ] [MAIN ] Derivative Progress: 1532/2046 symbols completed. RITM took 1.2s. Estimated remaining: 3m 28s. Rate: 148.0 symbols/min [2025-10-28T22:17:31.373744] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:31.398790] [DEBUG] [LOCAL ] RIO: Derivative data saved (138 records). [2025-10-28T22:17:31.399212] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-28T22:17:31.401968] [INFO ] [MAIN ] Derivative Progress: 1533/2046 symbols completed. RIO took 1.3s. Estimated remaining: 3m 28s. Rate: 148.1 symbols/min [2025-10-28T22:17:31.402295] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:31.446452] [DEBUG] [LOCAL ] RJF: Loaded 46444 existing records from primary storage. [2025-10-28T22:17:31.456279] [INFO ] [MAIN ] RJF: Loaded 46444 primary data records. [2025-10-28T22:17:31.596087] [DEBUG] [LOCAL ] RL: Loaded 38681 existing records from primary storage. [2025-10-28T22:17:31.597019] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-28T22:17:31.597576] [INFO ] [MAIN ] RKT: Loaded 53729 primary data records. [2025-10-28T22:17:31.613305] [INFO ] [MAIN ] RL: Loaded 38681 primary data records. [2025-10-28T22:17:32.446813] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:32.481414] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:32.508507] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:32.567980] [INFO ] [MAIN ] RJF: Generated 138 derivative records from 46444 primary records. [2025-10-28T22:17:32.568724] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-28T22:17:32.589860] [DEBUG] [LOCAL ] RJF: Derivative data saved (138 records). [2025-10-28T22:17:32.590122] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-28T22:17:32.592805] [INFO ] [MAIN ] Derivative Progress: 1534/2046 symbols completed. RJF took 1.3s. Estimated remaining: 3m 28s. Rate: 147.9 symbols/min [2025-10-28T22:17:32.594475] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:32.599674] [INFO ] [MAIN ] RL: Generated 138 derivative records from 38681 primary records. [2025-10-28T22:17:32.597502] [INFO ] [MAIN ] RKT: Generated 138 derivative records from 53729 primary records. [2025-10-28T22:17:32.599945] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-28T22:17:32.599893] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-28T22:17:32.622907] [DEBUG] [LOCAL ] RKT: Derivative data saved (138 records). [2025-10-28T22:17:32.623946] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-28T22:17:32.627130] [INFO ] [MAIN ] Derivative Progress: 1535/2046 symbols completed. RKT took 1.3s. Estimated remaining: 3m 27s. Rate: 148.0 symbols/min [2025-10-28T22:17:32.628192] [DEBUG] [LOCAL ] RL: Derivative data saved (138 records). [2025-10-28T22:17:32.627345] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:32.628436] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-28T22:17:32.632248] [INFO ] [MAIN ] Derivative Progress: 1536/2046 symbols completed. RL took 1.2s. Estimated remaining: 3m 27s. Rate: 148.1 symbols/min [2025-10-28T22:17:32.632959] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:32.652789] [DEBUG] [LOCAL ] RLTY: Loaded 10826 existing records from primary storage. [2025-10-28T22:17:32.653395] [INFO ] [MAIN ] RLTY: Loaded 10826 primary data records. [2025-10-28T22:17:32.780061] [DEBUG] [LOCAL ] RLI: Loaded 34528 existing records from primary storage. [2025-10-28T22:17:32.780293] [INFO ] [MAIN ] RLI: Loaded 34528 primary data records. [2025-10-28T22:17:33.035619] [DEBUG] [LOCAL ] RLJ: Loaded 47701 existing records from primary storage. [2025-10-28T22:17:33.066062] [INFO ] [MAIN ] RLJ: Loaded 47701 primary data records. [2025-10-28T22:17:33.646188] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:33.680983] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:33.721155] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:33.753438] [INFO ] [MAIN ] RLTY: Generated 138 derivative records from 10826 primary records. [2025-10-28T22:17:33.756946] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-28T22:17:33.777403] [DEBUG] [LOCAL ] RLTY: Derivative data saved (138 records). [2025-10-28T22:17:33.778772] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-28T22:17:33.780909] [INFO ] [MAIN ] RLI: Generated 138 derivative records from 34528 primary records. [2025-10-28T22:17:33.781082] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-28T22:17:33.784340] [INFO ] [MAIN ] Derivative Progress: 1537/2046 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 26s. Rate: 147.9 symbols/min [2025-10-28T22:17:33.792111] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:33.797257] [DEBUG] [LOCAL ] RLI: Derivative data saved (138 records). [2025-10-28T22:17:33.800084] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-28T22:17:33.803142] [INFO ] [MAIN ] Derivative Progress: 1538/2046 symbols completed. RLI took 1.2s. Estimated remaining: 3m 26s. Rate: 148.0 symbols/min [2025-10-28T22:17:33.803739] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:33.806304] [INFO ] [MAIN ] RLJ: Generated 138 derivative records from 47701 primary records. [2025-10-28T22:17:33.806486] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-28T22:17:33.820133] [DEBUG] [LOCAL ] RLJ: Derivative data saved (138 records). [2025-10-28T22:17:33.820327] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-28T22:17:33.823157] [INFO ] [MAIN ] Derivative Progress: 1539/2046 symbols completed. RLJ took 1.2s. Estimated remaining: 3m 25s. Rate: 148.1 symbols/min [2025-10-28T22:17:33.823335] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:33.828227] [DEBUG] [LOCAL ] RM: Loaded 7302 existing records from primary storage. [2025-10-28T22:17:33.828480] [INFO ] [MAIN ] RM: Loaded 7302 primary data records. [2025-10-28T22:17:34.053008] [DEBUG] [LOCAL ] RMAX: Loaded 21340 existing records from primary storage. [2025-10-28T22:17:34.053206] [INFO ] [MAIN ] RMAX: Loaded 21340 primary data records. [2025-10-28T22:17:34.065520] [DEBUG] [LOCAL ] RLX: Loaded 47925 existing records from primary storage. [2025-10-28T22:17:34.193039] [INFO ] [MAIN ] RLX: Loaded 47925 primary data records. [2025-10-28T22:17:34.796548] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:34.845672] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:34.870592] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:34.902967] [INFO ] [MAIN ] RM: Generated 138 derivative records from 7302 primary records. [2025-10-28T22:17:34.903464] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-28T22:17:34.922496] [DEBUG] [LOCAL ] RM: Derivative data saved (138 records). [2025-10-28T22:17:34.923774] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-28T22:17:34.926408] [INFO ] [MAIN ] Derivative Progress: 1540/2046 symbols completed. RM took 1.1s. Estimated remaining: 3m 25s. Rate: 148.0 symbols/min [2025-10-28T22:17:34.926673] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:34.938341] [INFO ] [MAIN ] RLX: Generated 138 derivative records from 47925 primary records. [2025-10-28T22:17:34.941633] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-28T22:17:34.954019] [INFO ] [MAIN ] RMAX: Generated 138 derivative records from 21340 primary records. [2025-10-28T22:17:34.954214] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-28T22:17:34.965546] [DEBUG] [LOCAL ] RLX: Derivative data saved (138 records). [2025-10-28T22:17:34.967214] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-28T22:17:34.970079] [DEBUG] [LOCAL ] RMAX: Derivative data saved (138 records). [2025-10-28T22:17:34.972625] [INFO ] [MAIN ] Derivative Progress: 1541/2046 symbols completed. RLX took 1.2s. Estimated remaining: 3m 25s. Rate: 148.0 symbols/min [2025-10-28T22:17:34.981751] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-28T22:17:34.984464] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:34.984618] [INFO ] [MAIN ] Derivative Progress: 1542/2046 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 24s. Rate: 148.1 symbols/min [2025-10-28T22:17:34.985076] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:34.991260] [DEBUG] [LOCAL ] RMI: Loaded 4744 existing records from primary storage. [2025-10-28T22:17:34.991422] [INFO ] [MAIN ] RMI: Loaded 4744 primary data records. [2025-10-28T22:17:35.111454] [DEBUG] [LOCAL ] RMM: Loaded 10685 existing records from primary storage. [2025-10-28T22:17:35.112515] [DEBUG] [LOCAL ] RMD: Loaded 41643 existing records from primary storage. [2025-10-28T22:17:35.112935] [INFO ] [MAIN ] RMD: Loaded 41643 primary data records. [2025-10-28T22:17:35.123346] [INFO ] [MAIN ] RMM: Loaded 10685 primary data records. [2025-10-28T22:17:35.979712] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:36.037994] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:36.053770] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:36.092347] [INFO ] [MAIN ] RMI: Generated 138 derivative records from 4744 primary records. [2025-10-28T22:17:36.096204] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-28T22:17:36.115981] [DEBUG] [LOCAL ] RMI: Derivative data saved (138 records). [2025-10-28T22:17:36.117992] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-28T22:17:36.121185] [INFO ] [MAIN ] Derivative Progress: 1543/2046 symbols completed. RMI took 1.1s. Estimated remaining: 3m 24s. Rate: 148.0 symbols/min [2025-10-28T22:17:36.138101] [INFO ] [MAIN ] RMD: Generated 138 derivative records from 41643 primary records. [2025-10-28T22:17:36.138521] [INFO ] [MAIN ] RMM: Generated 138 derivative records from 10685 primary records. [2025-10-28T22:17:36.138702] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-28T22:17:36.139352] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-28T22:17:36.161313] [DEBUG] [LOCAL ] RMM: Derivative data saved (138 records). [2025-10-28T22:17:36.161395] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-28T22:17:36.165718] [INFO ] [MAIN ] Derivative Progress: 1544/2046 symbols completed. RMM took 1.2s. Estimated remaining: 3m 23s. Rate: 148.0 symbols/min [2025-10-28T22:17:36.165813] [DEBUG] [LOCAL ] RMD: Derivative data saved (138 records). [2025-10-28T22:17:36.166046] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-28T22:17:36.168724] [INFO ] [MAIN ] Derivative Progress: 1545/2046 symbols completed. RMD took 1.2s. Estimated remaining: 3m 23s. Rate: 148.1 symbols/min [2025-10-28T22:17:36.169083] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:36.169325] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:36.169227] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:36.176561] [DEBUG] [LOCAL ] RMMZ: Loaded 4731 existing records from primary storage. [2025-10-28T22:17:36.176870] [INFO ] [MAIN ] RMMZ: Loaded 4731 primary data records. [2025-10-28T22:17:36.301205] [DEBUG] [LOCAL ] RMT: Loaded 17002 existing records from primary storage. [2025-10-28T22:17:36.301851] [INFO ] [MAIN ] RMT: Loaded 17002 primary data records. [2025-10-28T22:17:36.624584] [DEBUG] [LOCAL ] RNG: Loaded 47856 existing records from primary storage. [2025-10-28T22:17:36.664042] [INFO ] [MAIN ] RNG: Loaded 47856 primary data records. [2025-10-28T22:17:37.202747] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:37.233229] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:37.278129] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:37.309503] [INFO ] [MAIN ] RMMZ: Generated 138 derivative records from 4731 primary records. [2025-10-28T22:17:37.311070] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-28T22:17:37.328619] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (138 records). [2025-10-28T22:17:37.328738] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-28T22:17:37.331119] [INFO ] [MAIN ] Derivative Progress: 1546/2046 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 23s. Rate: 148.0 symbols/min [2025-10-28T22:17:37.332288] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:37.337984] [INFO ] [MAIN ] RMT: Generated 138 derivative records from 17002 primary records. [2025-10-28T22:17:37.338315] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-28T22:17:37.359146] [DEBUG] [LOCAL ] RMT: Derivative data saved (138 records). [2025-10-28T22:17:37.359621] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-28T22:17:37.364617] [INFO ] [MAIN ] Derivative Progress: 1547/2046 symbols completed. RMT took 1.2s. Estimated remaining: 3m 22s. Rate: 148.1 symbols/min [2025-10-28T22:17:37.365084] [INFO ] [MAIN ] RNG: Generated 138 derivative records from 47856 primary records. [2025-10-28T22:17:37.365172] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-28T22:17:37.365249] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:37.385480] [DEBUG] [LOCAL ] RNGR: Loaded 20575 existing records from primary storage. [2025-10-28T22:17:37.385040] [DEBUG] [LOCAL ] RNG: Derivative data saved (138 records). [2025-10-28T22:17:37.385761] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-28T22:17:37.385613] [INFO ] [MAIN ] RNGR: Loaded 20575 primary data records. [2025-10-28T22:17:37.388566] [INFO ] [MAIN ] Derivative Progress: 1548/2046 symbols completed. RNG took 1.2s. Estimated remaining: 3m 22s. Rate: 148.1 symbols/min [2025-10-28T22:17:37.388742] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:37.499391] [DEBUG] [LOCAL ] RNP: Loaded 15768 existing records from primary storage. [2025-10-28T22:17:37.502811] [INFO ] [MAIN ] RNP: Loaded 15768 primary data records. [2025-10-28T22:17:37.849104] [DEBUG] [LOCAL ] RNR: Loaded 33055 existing records from primary storage. [2025-10-28T22:17:37.894831] [INFO ] [MAIN ] RNR: Loaded 33055 primary data records. [2025-10-28T22:17:38.348049] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:38.383282] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:38.427990] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:38.463272] [INFO ] [MAIN ] RNGR: Generated 138 derivative records from 20575 primary records. [2025-10-28T22:17:38.463782] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-28T22:17:38.487561] [DEBUG] [LOCAL ] RNGR: Derivative data saved (138 records). [2025-10-28T22:17:38.487901] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-28T22:17:38.487755] [INFO ] [MAIN ] RNP: Generated 138 derivative records from 15768 primary records. [2025-10-28T22:17:38.490213] [INFO ] [MAIN ] Derivative Progress: 1549/2046 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 22s. Rate: 148.0 symbols/min [2025-10-28T22:17:38.490713] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:38.493534] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-28T22:17:38.510528] [DEBUG] [LOCAL ] RNP: Derivative data saved (138 records). [2025-10-28T22:17:38.511038] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-28T22:17:38.513979] [INFO ] [MAIN ] Derivative Progress: 1550/2046 symbols completed. RNP took 1.1s. Estimated remaining: 3m 21s. Rate: 148.1 symbols/min [2025-10-28T22:17:38.514405] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:38.520970] [INFO ] [MAIN ] RNR: Generated 138 derivative records from 33055 primary records. [2025-10-28T22:17:38.521220] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-28T22:17:38.533897] [DEBUG] [LOCAL ] RNR: Derivative data saved (138 records). [2025-10-28T22:17:38.534150] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-28T22:17:38.536817] [INFO ] [MAIN ] Derivative Progress: 1551/2046 symbols completed. RNR took 1.1s. Estimated remaining: 3m 20s. Rate: 148.2 symbols/min [2025-10-28T22:17:38.542172] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:38.559480] [DEBUG] [LOCAL ] ROG: Loaded 20916 existing records from primary storage. [2025-10-28T22:17:38.569498] [INFO ] [MAIN ] ROG: Loaded 20916 primary data records. [2025-10-28T22:17:38.570258] [DEBUG] [LOCAL ] RNST: Loaded 35472 existing records from primary storage. [2025-10-28T22:17:38.601214] [INFO ] [MAIN ] RNST: Loaded 35472 primary data records. [2025-10-28T22:17:39.005287] [DEBUG] [LOCAL ] ROK: Loaded 42234 existing records from primary storage. [2025-10-28T22:17:39.030173] [INFO ] [MAIN ] ROK: Loaded 42234 primary data records. [2025-10-28T22:17:39.573904] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:39.609400] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:39.660252] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:39.699565] [INFO ] [MAIN ] ROG: Generated 138 derivative records from 20916 primary records. [2025-10-28T22:17:39.699904] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-28T22:17:39.717921] [INFO ] [MAIN ] RNST: Generated 138 derivative records from 35472 primary records. [2025-10-28T22:17:39.717453] [DEBUG] [LOCAL ] ROG: Derivative data saved (138 records). [2025-10-28T22:17:39.720702] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-28T22:17:39.723464] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-28T22:17:39.723334] [INFO ] [MAIN ] Derivative Progress: 1552/2046 symbols completed. ROG took 1.2s. Estimated remaining: 3m 20s. Rate: 148.0 symbols/min [2025-10-28T22:17:39.724239] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:39.748451] [DEBUG] [LOCAL ] RNST: Derivative data saved (138 records). [2025-10-28T22:17:39.749276] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-28T22:17:39.753752] [INFO ] [MAIN ] Derivative Progress: 1553/2046 symbols completed. RNST took 1.3s. Estimated remaining: 3m 20s. Rate: 148.1 symbols/min [2025-10-28T22:17:39.754291] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:39.761966] [INFO ] [MAIN ] ROK: Generated 138 derivative records from 42234 primary records. [2025-10-28T22:17:39.762190] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-28T22:17:39.776114] [DEBUG] [LOCAL ] ROK: Derivative data saved (138 records). [2025-10-28T22:17:39.781711] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-28T22:17:39.784509] [INFO ] [MAIN ] Derivative Progress: 1554/2046 symbols completed. ROK took 1.2s. Estimated remaining: 3m 19s. Rate: 148.1 symbols/min [2025-10-28T22:17:39.784740] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:39.803196] [DEBUG] [LOCAL ] RPT: Loaded 18664 existing records from primary storage. [2025-10-28T22:17:39.803419] [INFO ] [MAIN ] RPT: Loaded 18664 primary data records. [2025-10-28T22:17:39.956860] [DEBUG] [LOCAL ] RPM: Loaded 41739 existing records from primary storage. [2025-10-28T22:17:39.976135] [INFO ] [MAIN ] RPM: Loaded 41739 primary data records. [2025-10-28T22:17:40.014350] [DEBUG] [LOCAL ] RQI: Loaded 28424 existing records from primary storage. [2025-10-28T22:17:40.056688] [INFO ] [MAIN ] RQI: Loaded 28424 primary data records. [2025-10-28T22:17:40.787249] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:40.823072] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:40.859225] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:40.898777] [INFO ] [MAIN ] RPT: Generated 138 derivative records from 18664 primary records. [2025-10-28T22:17:40.900237] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-28T22:17:40.919296] [DEBUG] [LOCAL ] RPT: Derivative data saved (138 records). [2025-10-28T22:17:40.920017] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-28T22:17:40.922179] [INFO ] [MAIN ] Derivative Progress: 1555/2046 symbols completed. RPT took 1.2s. Estimated remaining: 3m 19s. Rate: 148.0 symbols/min [2025-10-28T22:17:40.924132] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:40.924687] [INFO ] [MAIN ] RPM: Generated 138 derivative records from 41739 primary records. [2025-10-28T22:17:40.924923] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-28T22:17:40.939748] [DEBUG] [LOCAL ] RPM: Derivative data saved (138 records). [2025-10-28T22:17:40.939881] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-28T22:17:40.943671] [INFO ] [MAIN ] Derivative Progress: 1556/2046 symbols completed. RPM took 1.2s. Estimated remaining: 3m 19s. Rate: 148.1 symbols/min [2025-10-28T22:17:40.944096] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:40.951686] [INFO ] [MAIN ] RQI: Generated 138 derivative records from 28424 primary records. [2025-10-28T22:17:40.951888] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-28T22:17:40.966613] [DEBUG] [LOCAL ] RQI: Derivative data saved (138 records). [2025-10-28T22:17:40.966764] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-28T22:17:40.969575] [INFO ] [MAIN ] Derivative Progress: 1557/2046 symbols completed. RQI took 1.2s. Estimated remaining: 3m 18s. Rate: 148.2 symbols/min [2025-10-28T22:17:40.969765] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:41.021862] [DEBUG] [LOCAL ] RS: Loaded 24224 existing records from primary storage. [2025-10-28T22:17:41.035381] [INFO ] [MAIN ] RS: Loaded 24224 primary data records. [2025-10-28T22:17:41.036554] [DEBUG] [LOCAL ] RRX: Loaded 40460 existing records from primary storage. [2025-10-28T22:17:41.048036] [INFO ] [MAIN ] RRX: Loaded 40460 primary data records. [2025-10-28T22:17:41.058399] [DEBUG] [LOCAL ] RRC: Loaded 52911 existing records from primary storage. [2025-10-28T22:17:41.081366] [INFO ] [MAIN ] RRC: Loaded 52911 primary data records. [2025-10-28T22:17:42.017033] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:42.055624] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:42.056117] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:42.142473] [INFO ] [MAIN ] RS: Generated 138 derivative records from 24224 primary records. [2025-10-28T22:17:42.145401] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-28T22:17:42.148455] [INFO ] [MAIN ] RRC: Generated 138 derivative records from 52911 primary records. [2025-10-28T22:17:42.149484] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-28T22:17:42.162277] [DEBUG] [LOCAL ] RS: Derivative data saved (138 records). [2025-10-28T22:17:42.162408] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-28T22:17:42.174509] [INFO ] [MAIN ] Derivative Progress: 1558/2046 symbols completed. RS took 1.2s. Estimated remaining: 3m 18s. Rate: 148.0 symbols/min [2025-10-28T22:17:42.179289] [INFO ] [MAIN ] RRX: Generated 138 derivative records from 40460 primary records. [2025-10-28T22:17:42.177036] [DEBUG] [LOCAL ] RRC: Derivative data saved (138 records). [2025-10-28T22:17:42.179397] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-28T22:17:42.179451] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-28T22:17:42.182051] [INFO ] [MAIN ] Derivative Progress: 1559/2046 symbols completed. RRC took 1.3s. Estimated remaining: 3m 17s. Rate: 148.1 symbols/min [2025-10-28T22:17:42.193790] [DEBUG] [LOCAL ] RRX: Derivative data saved (138 records). [2025-10-28T22:17:42.193846] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-28T22:17:42.195522] [INFO ] [MAIN ] Derivative Progress: 1560/2046 symbols completed. RRX took 1.3s. Estimated remaining: 3m 17s. Rate: 148.2 symbols/min [2025-10-28T22:17:42.195961] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:42.196024] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:42.196127] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:42.204214] [DEBUG] [LOCAL ] RSF: Loaded 4249 existing records from primary storage. [2025-10-28T22:17:42.204602] [INFO ] [MAIN ] RSF: Loaded 4249 primary data records. [2025-10-28T22:17:42.549391] [DEBUG] [LOCAL ] RSI: Loaded 46918 existing records from primary storage. [2025-10-28T22:17:42.561214] [INFO ] [MAIN ] RSI: Loaded 46918 primary data records. [2025-10-28T22:17:42.599845] [DEBUG] [LOCAL ] RSG: Loaded 47204 existing records from primary storage. [2025-10-28T22:17:42.629126] [INFO ] [MAIN ] RSG: Loaded 47204 primary data records. [2025-10-28T22:17:43.172540] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:43.223010] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:43.255261] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:43.278690] [INFO ] [MAIN ] RSF: Generated 138 derivative records from 4249 primary records. [2025-10-28T22:17:43.281543] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-28T22:17:43.298382] [DEBUG] [LOCAL ] RSF: Derivative data saved (138 records). [2025-10-28T22:17:43.301592] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-28T22:17:43.305771] [INFO ] [MAIN ] Derivative Progress: 1561/2046 symbols completed. RSF took 1.1s. Estimated remaining: 3m 17s. Rate: 148.0 symbols/min [2025-10-28T22:17:43.307603] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:43.326353] [INFO ] [MAIN ] RSI: Generated 138 derivative records from 46918 primary records. [2025-10-28T22:17:43.327601] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-28T22:17:43.339952] [INFO ] [MAIN ] RSG: Generated 138 derivative records from 47204 primary records. [2025-10-28T22:17:43.351181] [DEBUG] [LOCAL ] RSI: Derivative data saved (138 records). [2025-10-28T22:17:43.351394] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-28T22:17:43.351349] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-28T22:17:43.353346] [INFO ] [MAIN ] Derivative Progress: 1562/2046 symbols completed. RSI took 1.2s. Estimated remaining: 3m 16s. Rate: 148.1 symbols/min [2025-10-28T22:17:43.354310] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:43.383492] [DEBUG] [LOCAL ] RSG: Derivative data saved (138 records). [2025-10-28T22:17:43.382493] [DEBUG] [LOCAL ] RSKD: Loaded 33093 existing records from primary storage. [2025-10-28T22:17:43.383811] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-28T22:17:43.388769] [INFO ] [MAIN ] Derivative Progress: 1563/2046 symbols completed. RSG took 1.2s. Estimated remaining: 3m 16s. Rate: 148.2 symbols/min [2025-10-28T22:17:43.388874] [INFO ] [MAIN ] RSKD: Loaded 33093 primary data records. [2025-10-28T22:17:43.389146] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:43.736915] [DEBUG] [LOCAL ] RTO: Loaded 39664 existing records from primary storage. [2025-10-28T22:17:43.737238] [INFO ] [MAIN ] RTO: Loaded 39664 primary data records. [2025-10-28T22:17:43.855043] [DEBUG] [LOCAL ] RVLV: Loaded 47068 existing records from primary storage. [2025-10-28T22:17:43.881735] [INFO ] [MAIN ] RVLV: Loaded 47068 primary data records. [2025-10-28T22:17:44.362974] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:44.403306] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:44.438434] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:44.478867] [INFO ] [MAIN ] RSKD: Generated 138 derivative records from 33093 primary records. [2025-10-28T22:17:44.480621] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-28T22:17:44.499175] [DEBUG] [LOCAL ] RSKD: Derivative data saved (138 records). [2025-10-28T22:17:44.499282] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-28T22:17:44.501216] [INFO ] [MAIN ] RTO: Generated 138 derivative records from 39664 primary records. [2025-10-28T22:17:44.503832] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-28T22:17:44.503759] [INFO ] [MAIN ] Derivative Progress: 1564/2046 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 15s. Rate: 148.0 symbols/min [2025-10-28T22:17:44.504623] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:44.518704] [DEBUG] [LOCAL ] RTO: Derivative data saved (138 records). [2025-10-28T22:17:44.518986] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-28T22:17:44.522759] [INFO ] [MAIN ] Derivative Progress: 1565/2046 symbols completed. RTO took 1.2s. Estimated remaining: 3m 15s. Rate: 148.1 symbols/min [2025-10-28T22:17:44.523770] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:44.538473] [INFO ] [MAIN ] RVLV: Generated 138 derivative records from 47068 primary records. [2025-10-28T22:17:44.538727] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-28T22:17:44.551505] [DEBUG] [LOCAL ] RVLV: Derivative data saved (138 records). [2025-10-28T22:17:44.551661] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-28T22:17:44.554805] [INFO ] [MAIN ] Derivative Progress: 1566/2046 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 14s. Rate: 148.2 symbols/min [2025-10-28T22:17:44.563548] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:44.564182] [DEBUG] [LOCAL ] RVT: Loaded 25721 existing records from primary storage. [2025-10-28T22:17:44.564982] [INFO ] [MAIN ] RVT: Loaded 25721 primary data records. [2025-10-28T22:17:44.881030] [DEBUG] [LOCAL ] RVTY: Loaded 47719 existing records from primary storage. [2025-10-28T22:17:44.894829] [INFO ] [MAIN ] RVTY: Loaded 47719 primary data records. [2025-10-28T22:17:44.963464] [DEBUG] [LOCAL ] RWT: Loaded 40088 existing records from primary storage. [2025-10-28T22:17:44.978367] [INFO ] [MAIN ] RWT: Loaded 40088 primary data records. [2025-10-28T22:17:45.588851] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:45.627922] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:45.666540] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:45.698112] [INFO ] [MAIN ] RVT: Generated 138 derivative records from 25721 primary records. [2025-10-28T22:17:45.698576] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-28T22:17:45.718312] [DEBUG] [LOCAL ] RVT: Derivative data saved (138 records). [2025-10-28T22:17:45.719331] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-28T22:17:45.721910] [INFO ] [MAIN ] Derivative Progress: 1567/2046 symbols completed. RVT took 1.2s. Estimated remaining: 3m 14s. Rate: 148.0 symbols/min [2025-10-28T22:17:45.722505] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:45.740424] [INFO ] [MAIN ] RVTY: Generated 138 derivative records from 47719 primary records. [2025-10-28T22:17:45.743412] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-28T22:17:45.760401] [INFO ] [MAIN ] RWT: Generated 138 derivative records from 40088 primary records. [2025-10-28T22:17:45.760511] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-28T22:17:45.760071] [DEBUG] [LOCAL ] RVTY: Derivative data saved (138 records). [2025-10-28T22:17:45.761370] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-10-28T22:17:45.770050] [INFO ] [MAIN ] Derivative Progress: 1568/2046 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 14s. Rate: 148.1 symbols/min [2025-10-28T22:17:45.770189] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:45.784928] [DEBUG] [LOCAL ] RWT: Derivative data saved (138 records). [2025-10-28T22:17:45.785206] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-28T22:17:45.787999] [INFO ] [MAIN ] Derivative Progress: 1569/2046 symbols completed. RWT took 1.2s. Estimated remaining: 3m 13s. Rate: 148.2 symbols/min [2025-10-28T22:17:45.788315] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:45.815711] [DEBUG] [LOCAL ] RXO: Loaded 48288 existing records from primary storage. [2025-10-28T22:17:45.816027] [INFO ] [MAIN ] RXO: Loaded 48288 primary data records. [2025-10-28T22:17:45.901822] [DEBUG] [LOCAL ] RYAM: Loaded 34710 existing records from primary storage. [2025-10-28T22:17:45.919246] [INFO ] [MAIN ] RYAM: Loaded 34710 primary data records. [2025-10-28T22:17:46.075227] [DEBUG] [LOCAL ] RY: Loaded 47237 existing records from primary storage. [2025-10-28T22:17:46.099682] [INFO ] [MAIN ] RY: Loaded 47237 primary data records. [2025-10-28T22:17:46.779873] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:46.808886] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:46.844234] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:46.891296] [INFO ] [MAIN ] RXO: Generated 138 derivative records from 48288 primary records. [2025-10-28T22:17:46.895559] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-28T22:17:46.930061] [INFO ] [MAIN ] RYAM: Generated 138 derivative records from 34710 primary records. [2025-10-28T22:17:46.927704] [DEBUG] [LOCAL ] RXO: Derivative data saved (138 records). [2025-10-28T22:17:46.930469] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-28T22:17:46.932914] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-28T22:17:46.935750] [INFO ] [MAIN ] RY: Generated 138 derivative records from 47237 primary records. [2025-10-28T22:17:46.935213] [INFO ] [MAIN ] Derivative Progress: 1570/2046 symbols completed. RXO took 1.2s. Estimated remaining: 3m 13s. Rate: 148.0 symbols/min [2025-10-28T22:17:46.946671] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-28T22:17:46.946810] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:46.946613] [DEBUG] [LOCAL ] RYAM: Derivative data saved (138 records). [2025-10-28T22:17:46.947752] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-28T22:17:46.950889] [INFO ] [MAIN ] Derivative Progress: 1571/2046 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 12s. Rate: 148.1 symbols/min [2025-10-28T22:17:46.961119] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:46.963260] [DEBUG] [LOCAL ] RY: Derivative data saved (138 records). [2025-10-28T22:17:46.963774] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-28T22:17:46.966582] [INFO ] [MAIN ] Derivative Progress: 1572/2046 symbols completed. RY took 1.2s. Estimated remaining: 3m 12s. Rate: 148.2 symbols/min [2025-10-28T22:17:46.966992] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:46.995819] [DEBUG] [LOCAL ] RYI: Loaded 21393 existing records from primary storage. [2025-10-28T22:17:46.996022] [INFO ] [MAIN ] RYI: Loaded 21393 primary data records. [2025-10-28T22:17:47.124157] [DEBUG] [LOCAL ] RYAN: Loaded 44909 existing records from primary storage. [2025-10-28T22:17:47.141799] [INFO ] [MAIN ] RYAN: Loaded 44909 primary data records. [2025-10-28T22:17:47.177213] [DEBUG] [LOCAL ] RYN: Loaded 45650 existing records from primary storage. [2025-10-28T22:17:47.251094] [INFO ] [MAIN ] RYN: Loaded 45650 primary data records. [2025-10-28T22:17:47.994721] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:48.026207] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:48.057357] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:48.113612] [INFO ] [MAIN ] RYI: Generated 138 derivative records from 21393 primary records. [2025-10-28T22:17:48.114312] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-28T22:17:48.135620] [DEBUG] [LOCAL ] RYI: Derivative data saved (138 records). [2025-10-28T22:17:48.140216] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-28T22:17:48.142325] [INFO ] [MAIN ] Derivative Progress: 1573/2046 symbols completed. RYI took 1.2s. Estimated remaining: 3m 12s. Rate: 148.0 symbols/min [2025-10-28T22:17:48.145745] [INFO ] [MAIN ] RYAN: Generated 138 derivative records from 44909 primary records. [2025-10-28T22:17:48.145920] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-28T22:17:48.147925] [INFO ] [MAIN ] RYN: Generated 138 derivative records from 45650 primary records. [2025-10-28T22:17:48.148163] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-28T22:17:48.171091] [DEBUG] [LOCAL ] RYAN: Derivative data saved (138 records). [2025-10-28T22:17:48.171662] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-28T22:17:48.172950] [DEBUG] [LOCAL ] RYN: Derivative data saved (138 records). [2025-10-28T22:17:48.175512] [INFO ] [MAIN ] Derivative Progress: 1574/2046 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 11s. Rate: 148.1 symbols/min [2025-10-28T22:17:48.175606] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-28T22:17:48.178289] [INFO ] [MAIN ] Derivative Progress: 1575/2046 symbols completed. RYN took 1.2s. Estimated remaining: 3m 11s. Rate: 148.2 symbols/min [2025-10-28T22:17:48.178704] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:48.178872] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:48.178801] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:48.186949] [DEBUG] [LOCAL ] RZC: Loaded 6222 existing records from primary storage. [2025-10-28T22:17:48.187266] [INFO ] [MAIN ] RZC: Loaded 6222 primary data records. [2025-10-28T22:17:48.521807] [DEBUG] [LOCAL ] SA: Loaded 44474 existing records from primary storage. [2025-10-28T22:17:48.522528] [INFO ] [MAIN ] SA: Loaded 44474 primary data records. [2025-10-28T22:17:48.621260] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-28T22:17:48.644682] [INFO ] [MAIN ] S: Loaded 53536 primary data records. [2025-10-28T22:17:49.153913] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:49.196986] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:49.241740] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:49.244334] [INFO ] [MAIN ] RZC: Generated 138 derivative records from 6222 primary records. [2025-10-28T22:17:49.255468] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-28T22:17:49.272757] [DEBUG] [LOCAL ] RZC: Derivative data saved (138 records). [2025-10-28T22:17:49.273163] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-28T22:17:49.275959] [INFO ] [MAIN ] Derivative Progress: 1576/2046 symbols completed. RZC took 1.1s. Estimated remaining: 3m 11s. Rate: 148.0 symbols/min [2025-10-28T22:17:49.276110] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:49.297325] [INFO ] [MAIN ] SA: Generated 138 derivative records from 44474 primary records. [2025-10-28T22:17:49.295469] [DEBUG] [LOCAL ] SABA: Loaded 8968 existing records from primary storage. [2025-10-28T22:17:49.297743] [INFO ] [MAIN ] SABA: Loaded 8968 primary data records. [2025-10-28T22:17:49.297858] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-28T22:17:49.417034] [DEBUG] [LOCAL ] SA: Derivative data saved (138 records). [2025-10-28T22:17:49.422597] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-28T22:17:49.424991] [INFO ] [MAIN ] Derivative Progress: 1577/2046 symbols completed. SA took 1.2s. Estimated remaining: 3m 10s. Rate: 148.1 symbols/min [2025-10-28T22:17:49.436178] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:49.507141] [INFO ] [MAIN ] S: Generated 138 derivative records from 53536 primary records. [2025-10-28T22:17:49.703833] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-28T22:17:49.738181] [DEBUG] [LOCAL ] S: Derivative data saved (138 records). [2025-10-28T22:17:49.747429] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-28T22:17:49.754501] [INFO ] [MAIN ] Derivative Progress: 1578/2046 symbols completed. S took 1.6s. Estimated remaining: 3m 10s. Rate: 148.1 symbols/min [2025-10-28T22:17:49.756251] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:49.768409] [DEBUG] [LOCAL ] SAFE: Loaded 29374 existing records from primary storage. [2025-10-28T22:17:49.768972] [INFO ] [MAIN ] SAFE: Loaded 29374 primary data records. [2025-10-28T22:17:49.946191] [DEBUG] [LOCAL ] SAH: Loaded 20506 existing records from primary storage. [2025-10-28T22:17:49.952789] [INFO ] [MAIN ] SAH: Loaded 20506 primary data records. [2025-10-28T22:17:50.242620] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:50.511607] [INFO ] [MAIN ] SABA: Generated 138 derivative records from 8968 primary records. [2025-10-28T22:17:50.524979] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-28T22:17:50.526579] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:50.554902] [DEBUG] [LOCAL ] SABA: Derivative data saved (138 records). [2025-10-28T22:17:50.555209] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-28T22:17:50.559912] [INFO ] [MAIN ] Derivative Progress: 1579/2046 symbols completed. SABA took 1.3s. Estimated remaining: 3m 9s. Rate: 148.0 symbols/min [2025-10-28T22:17:50.560504] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:50.585321] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:50.623538] [DEBUG] [LOCAL ] SAM: Loaded 21247 existing records from primary storage. [2025-10-28T22:17:50.626419] [INFO ] [MAIN ] SAM: Loaded 21247 primary data records. [2025-10-28T22:17:50.685840] [INFO ] [MAIN ] SAFE: Generated 138 derivative records from 29374 primary records. [2025-10-28T22:17:50.713210] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-28T22:17:50.745048] [DEBUG] [LOCAL ] SAFE: Derivative data saved (138 records). [2025-10-28T22:17:50.748259] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-28T22:17:50.754054] [INFO ] [MAIN ] Derivative Progress: 1580/2046 symbols completed. SAFE took 1.3s. Estimated remaining: 3m 9s. Rate: 148.0 symbols/min [2025-10-28T22:17:50.754332] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:50.961542] [INFO ] [MAIN ] SAH: Generated 138 derivative records from 20506 primary records. [2025-10-28T22:17:50.961710] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-28T22:17:50.975083] [DEBUG] [LOCAL ] SAH: Derivative data saved (138 records). [2025-10-28T22:17:50.976763] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-28T22:17:50.979677] [INFO ] [MAIN ] Derivative Progress: 1581/2046 symbols completed. SAH took 1.2s. Estimated remaining: 3m 8s. Rate: 148.1 symbols/min [2025-10-28T22:17:50.980007] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:51.017057] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:51.046488] [DEBUG] [LOCAL ] SAN: Loaded 52938 existing records from primary storage. [2025-10-28T22:17:51.047907] [INFO ] [MAIN ] SAN: Loaded 52938 primary data records. [2025-10-28T22:17:51.240122] [DEBUG] [LOCAL ] SAP: Loaded 49816 existing records from primary storage. [2025-10-28T22:17:51.260109] [INFO ] [MAIN ] SAP: Loaded 49816 primary data records. [2025-10-28T22:17:51.689262] [INFO ] [MAIN ] SAM: Generated 138 derivative records from 21247 primary records. [2025-10-28T22:17:51.689441] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-28T22:17:51.703182] [DEBUG] [LOCAL ] SAM: Derivative data saved (138 records). [2025-10-28T22:17:51.703680] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-28T22:17:51.705814] [INFO ] [MAIN ] Derivative Progress: 1582/2046 symbols completed. SAM took 1.1s. Estimated remaining: 3m 8s. Rate: 148.0 symbols/min [2025-10-28T22:17:51.706414] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:51.731440] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:51.753218] [DEBUG] [LOCAL ] SAR: Loaded 16842 existing records from primary storage. [2025-10-28T22:17:51.756779] [INFO ] [MAIN ] SAR: Loaded 16842 primary data records. [2025-10-28T22:17:51.887905] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:52.163067] [INFO ] [MAIN ] SAN: Generated 138 derivative records from 52938 primary records. [2025-10-28T22:17:52.164383] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-28T22:17:52.182239] [DEBUG] [LOCAL ] SAN: Derivative data saved (138 records). [2025-10-28T22:17:52.183698] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-28T22:17:52.186856] [INFO ] [MAIN ] Derivative Progress: 1583/2046 symbols completed. SAN took 1.4s. Estimated remaining: 3m 8s. Rate: 148.0 symbols/min [2025-10-28T22:17:52.188040] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:52.199538] [INFO ] [MAIN ] SAP: Generated 138 derivative records from 49816 primary records. [2025-10-28T22:17:52.199960] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-28T22:17:52.214853] [DEBUG] [LOCAL ] SAP: Derivative data saved (138 records). [2025-10-28T22:17:52.215038] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-28T22:17:52.218048] [INFO ] [MAIN ] Derivative Progress: 1584/2046 symbols completed. SAP took 1.2s. Estimated remaining: 3m 7s. Rate: 148.1 symbols/min [2025-10-28T22:17:52.218284] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:52.231773] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:52.290825] [DEBUG] [LOCAL ] SARO: Loaded 48122 existing records from primary storage. [2025-10-28T22:17:52.303357] [INFO ] [MAIN ] SARO: Loaded 48122 primary data records. [2025-10-28T22:17:52.315911] [DEBUG] [LOCAL ] SB: Loaded 32180 existing records from primary storage. [2025-10-28T22:17:52.316145] [INFO ] [MAIN ] SB: Loaded 32180 primary data records. [2025-10-28T22:17:52.432014] [INFO ] [MAIN ] SAR: Generated 138 derivative records from 16842 primary records. [2025-10-28T22:17:52.480849] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-28T22:17:52.535766] [DEBUG] [LOCAL ] SAR: Derivative data saved (138 records). [2025-10-28T22:17:52.536292] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-28T22:17:52.545247] [INFO ] [MAIN ] Derivative Progress: 1585/2046 symbols completed. SAR took 0.8s. Estimated remaining: 3m 7s. Rate: 148.1 symbols/min [2025-10-28T22:17:52.555731] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:52.991722] [DEBUG] [LOCAL ] SBH: Loaded 49719 existing records from primary storage. [2025-10-28T22:17:52.992733] [INFO ] [MAIN ] SBH: Loaded 49719 primary data records. [2025-10-28T22:17:53.130954] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:53.170778] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:53.416917] [INFO ] [MAIN ] SARO: Generated 138 derivative records from 48122 primary records. [2025-10-28T22:17:53.417236] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-28T22:17:53.421964] [INFO ] [MAIN ] SB: Generated 138 derivative records from 32180 primary records. [2025-10-28T22:17:53.430910] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-28T22:17:53.434288] [DEBUG] [LOCAL ] SARO: Derivative data saved (138 records). [2025-10-28T22:17:53.434394] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-28T22:17:53.436917] [INFO ] [MAIN ] Derivative Progress: 1586/2046 symbols completed. SARO took 1.2s. Estimated remaining: 3m 7s. Rate: 148.0 symbols/min [2025-10-28T22:17:53.446799] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:53.452543] [DEBUG] [LOCAL ] SB: Derivative data saved (138 records). [2025-10-28T22:17:53.454856] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-28T22:17:53.458097] [INFO ] [MAIN ] Derivative Progress: 1587/2046 symbols completed. SB took 1.2s. Estimated remaining: 3m 6s. Rate: 148.1 symbols/min [2025-10-28T22:17:53.458491] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:53.478028] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:53.504017] [DEBUG] [LOCAL ] SBR: Loaded 7734 existing records from primary storage. [2025-10-28T22:17:53.509340] [DEBUG] [LOCAL ] SBI: Loaded 7363 existing records from primary storage. [2025-10-28T22:17:53.511477] [INFO ] [MAIN ] SBR: Loaded 7734 primary data records. [2025-10-28T22:17:53.517319] [INFO ] [MAIN ] SBI: Loaded 7363 primary data records. [2025-10-28T22:17:54.326503] [INFO ] [MAIN ] SBH: Generated 138 derivative records from 49719 primary records. [2025-10-28T22:17:54.327744] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-28T22:17:54.346352] [DEBUG] [LOCAL ] SBH: Derivative data saved (138 records). [2025-10-28T22:17:54.347738] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-28T22:17:54.353012] [INFO ] [MAIN ] Derivative Progress: 1588/2046 symbols completed. SBH took 1.8s. Estimated remaining: 3m 6s. Rate: 148.0 symbols/min [2025-10-28T22:17:54.374791] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:54.416272] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:54.449033] [INFO ] [MAIN ] SBR: Generated 138 derivative records from 7734 primary records. [2025-10-28T22:17:54.451905] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-28T22:17:54.465598] [DEBUG] [LOCAL ] SBR: Derivative data saved (138 records). [2025-10-28T22:17:54.465877] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-28T22:17:54.468127] [INFO ] [MAIN ] Derivative Progress: 1589/2046 symbols completed. SBR took 1.0s. Estimated remaining: 3m 5s. Rate: 148.0 symbols/min [2025-10-28T22:17:54.478173] [INFO ] [MAIN ] SBI: Generated 138 derivative records from 7363 primary records. [2025-10-28T22:17:54.478254] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-28T22:17:54.488833] [DEBUG] [LOCAL ] SBI: Derivative data saved (138 records). [2025-10-28T22:17:54.488893] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-28T22:17:54.491388] [INFO ] [MAIN ] Derivative Progress: 1590/2046 symbols completed. SBI took 1.0s. Estimated remaining: 3m 5s. Rate: 148.1 symbols/min [2025-10-28T22:17:54.492226] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:54.492147] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:54.492025] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:54.514110] [DEBUG] [LOCAL ] SBSI: Loaded 14601 existing records from primary storage. [2025-10-28T22:17:54.514448] [INFO ] [MAIN ] SBSI: Loaded 14601 primary data records. [2025-10-28T22:17:54.684764] [DEBUG] [LOCAL ] SBSW: Loaded 53185 existing records from primary storage. [2025-10-28T22:17:54.724282] [INFO ] [MAIN ] SBSW: Loaded 53185 primary data records. [2025-10-28T22:17:54.846829] [DEBUG] [LOCAL ] SBS: Loaded 49125 existing records from primary storage. [2025-10-28T22:17:54.978731] [INFO ] [MAIN ] SBS: Loaded 49125 primary data records. [2025-10-28T22:17:55.550544] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:55.590475] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:55.636586] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:55.682308] [INFO ] [MAIN ] SBSI: Generated 138 derivative records from 14601 primary records. [2025-10-28T22:17:55.682849] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-28T22:17:55.714211] [DEBUG] [LOCAL ] SBSI: Derivative data saved (138 records). [2025-10-28T22:17:55.711306] [INFO ] [MAIN ] SBSW: Generated 138 derivative records from 53185 primary records. [2025-10-28T22:17:55.716047] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-28T22:17:55.719869] [INFO ] [MAIN ] Derivative Progress: 1591/2046 symbols completed. SBSI took 1.2s. Estimated remaining: 3m 5s. Rate: 147.9 symbols/min [2025-10-28T22:17:55.720074] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-28T22:17:55.720811] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:55.743178] [INFO ] [MAIN ] SBS: Generated 138 derivative records from 49125 primary records. [2025-10-28T22:17:55.744078] [DEBUG] [LOCAL ] SBSW: Derivative data saved (138 records). [2025-10-28T22:17:55.744541] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-28T22:17:55.744455] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-28T22:17:55.748475] [INFO ] [MAIN ] Derivative Progress: 1592/2046 symbols completed. SBSW took 1.3s. Estimated remaining: 3m 4s. Rate: 148.0 symbols/min [2025-10-28T22:17:55.748680] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:55.763766] [DEBUG] [LOCAL ] SBS: Derivative data saved (138 records). [2025-10-28T22:17:55.763982] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-28T22:17:55.768483] [INFO ] [MAIN ] Derivative Progress: 1593/2046 symbols completed. SBS took 1.3s. Estimated remaining: 3m 4s. Rate: 148.1 symbols/min [2025-10-28T22:17:55.774017] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:55.782629] [DEBUG] [LOCAL ] SCD: Loaded 13651 existing records from primary storage. [2025-10-28T22:17:55.782938] [INFO ] [MAIN ] SCD: Loaded 13651 primary data records. [2025-10-28T22:17:55.987933] [DEBUG] [LOCAL ] SCCO: Loaded 49472 existing records from primary storage. [2025-10-28T22:17:56.013040] [INFO ] [MAIN ] SCCO: Loaded 49472 primary data records. [2025-10-28T22:17:56.241346] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-28T22:17:56.267384] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-28T22:17:56.889273] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:56.945558] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:56.967448] [INFO ] [MAIN ] SCD: Generated 138 derivative records from 13651 primary records. [2025-10-28T22:17:56.968032] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-28T22:17:57.000774] [DEBUG] [LOCAL ] SCD: Derivative data saved (138 records). [2025-10-28T22:17:57.001824] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:57.021107] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-28T22:17:57.024675] [INFO ] [MAIN ] Derivative Progress: 1594/2046 symbols completed. SCD took 1.3s. Estimated remaining: 3m 3s. Rate: 147.9 symbols/min [2025-10-28T22:17:57.026625] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:57.047366] [INFO ] [MAIN ] SCCO: Generated 138 derivative records from 49472 primary records. [2025-10-28T22:17:57.048028] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-28T22:17:57.079945] [DEBUG] [LOCAL ] SCCO: Derivative data saved (138 records). [2025-10-28T22:17:57.080688] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-28T22:17:57.087090] [INFO ] [MAIN ] Derivative Progress: 1595/2046 symbols completed. SCCO took 1.4s. Estimated remaining: 3m 3s. Rate: 148.0 symbols/min [2025-10-28T22:17:57.088180] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:57.094316] [INFO ] [MAIN ] SCHW: Generated 138 derivative records from 53685 primary records. [2025-10-28T22:17:57.094615] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-28T22:17:57.130003] [DEBUG] [LOCAL ] SCI: Loaded 45755 existing records from primary storage. [2025-10-28T22:17:57.128927] [DEBUG] [LOCAL ] SCHW: Derivative data saved (138 records). [2025-10-28T22:17:57.130221] [INFO ] [MAIN ] SCI: Loaded 45755 primary data records. [2025-10-28T22:17:57.130293] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-28T22:17:57.135851] [INFO ] [MAIN ] Derivative Progress: 1596/2046 symbols completed. SCHW took 1.4s. Estimated remaining: 3m 2s. Rate: 148.1 symbols/min [2025-10-28T22:17:57.136256] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:57.211979] [DEBUG] [LOCAL ] SCL: Loaded 15104 existing records from primary storage. [2025-10-28T22:17:57.224538] [INFO ] [MAIN ] SCL: Loaded 15104 primary data records. [2025-10-28T22:17:57.573123] [DEBUG] [LOCAL ] SCM: Loaded 19958 existing records from primary storage. [2025-10-28T22:17:57.594537] [INFO ] [MAIN ] SCM: Loaded 19958 primary data records. [2025-10-28T22:17:58.135270] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:58.170184] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:58.214594] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:58.268919] [INFO ] [MAIN ] SCI: Generated 138 derivative records from 45755 primary records. [2025-10-28T22:17:58.272096] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-28T22:17:58.288553] [DEBUG] [LOCAL ] SCI: Derivative data saved (138 records). [2025-10-28T22:17:58.291437] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-28T22:17:58.293918] [INFO ] [MAIN ] Derivative Progress: 1597/2046 symbols completed. SCI took 1.3s. Estimated remaining: 3m 2s. Rate: 147.9 symbols/min [2025-10-28T22:17:58.296122] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:58.296468] [INFO ] [MAIN ] SCL: Generated 138 derivative records from 15104 primary records. [2025-10-28T22:17:58.297768] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-28T22:17:58.317684] [DEBUG] [LOCAL ] SCL: Derivative data saved (138 records). [2025-10-28T22:17:58.317880] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-28T22:17:58.321255] [INFO ] [MAIN ] Derivative Progress: 1598/2046 symbols completed. SCL took 1.2s. Estimated remaining: 3m 2s. Rate: 148.0 symbols/min [2025-10-28T22:17:58.321710] [INFO ] [MAIN ] SCM: Generated 138 derivative records from 19958 primary records. [2025-10-28T22:17:58.321923] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-28T22:17:58.322908] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:58.337059] [DEBUG] [LOCAL ] SCM: Derivative data saved (138 records). [2025-10-28T22:17:58.337370] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-28T22:17:58.341972] [INFO ] [MAIN ] Derivative Progress: 1599/2046 symbols completed. SCM took 1.2s. Estimated remaining: 3m 1s. Rate: 148.1 symbols/min [2025-10-28T22:17:58.342209] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:58.369920] [DEBUG] [LOCAL ] SDHC: Loaded 10229 existing records from primary storage. [2025-10-28T22:17:58.370094] [INFO ] [MAIN ] SDHC: Loaded 10229 primary data records. [2025-10-28T22:17:58.469268] [DEBUG] [LOCAL ] SCS: Loaded 42961 existing records from primary storage. [2025-10-28T22:17:58.476755] [INFO ] [MAIN ] SCS: Loaded 42961 primary data records. [2025-10-28T22:17:58.569954] [DEBUG] [LOCAL ] SD: Loaded 27679 existing records from primary storage. [2025-10-28T22:17:58.604197] [INFO ] [MAIN ] SD: Loaded 27679 primary data records. [2025-10-28T22:17:59.498872] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:59.504415] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:59.557558] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:17:59.615161] [INFO ] [MAIN ] SDHC: Generated 138 derivative records from 10229 primary records. [2025-10-28T22:17:59.617562] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-28T22:17:59.617511] [INFO ] [MAIN ] SCS: Generated 138 derivative records from 42961 primary records. [2025-10-28T22:17:59.620432] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-28T22:17:59.645033] [DEBUG] [LOCAL ] SCS: Derivative data saved (138 records). [2025-10-28T22:17:59.645299] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-28T22:17:59.648337] [INFO ] [MAIN ] Derivative Progress: 1600/2046 symbols completed. SCS took 1.4s. Estimated remaining: 3m 1s. Rate: 147.9 symbols/min [2025-10-28T22:17:59.650528] [DEBUG] [LOCAL ] SDHC: Derivative data saved (138 records). [2025-10-28T22:17:59.650670] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-28T22:17:59.651035] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:59.653145] [INFO ] [MAIN ] Derivative Progress: 1601/2046 symbols completed. SDHC took 1.3s. Estimated remaining: 3m 0s. Rate: 148.0 symbols/min [2025-10-28T22:17:59.653304] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:59.656958] [INFO ] [MAIN ] SD: Generated 138 derivative records from 27679 primary records. [2025-10-28T22:17:59.657147] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-28T22:17:59.672705] [DEBUG] [LOCAL ] SD: Derivative data saved (138 records). [2025-10-28T22:17:59.672946] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-28T22:17:59.675915] [INFO ] [MAIN ] Derivative Progress: 1602/2046 symbols completed. SD took 1.4s. Estimated remaining: 2m 60s. Rate: 148.0 symbols/min [2025-10-28T22:17:59.676256] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:17:59.682634] [DEBUG] [LOCAL ] SDHY: Loaded 11122 existing records from primary storage. [2025-10-28T22:17:59.682824] [INFO ] [MAIN ] SDHY: Loaded 11122 primary data records. [2025-10-28T22:17:59.861213] [DEBUG] [LOCAL ] SDRL: Loaded 40863 existing records from primary storage. [2025-10-28T22:17:59.898146] [INFO ] [MAIN ] SDRL: Loaded 40863 primary data records. [2025-10-28T22:18:00.214579] [DEBUG] [LOCAL ] SEE: Loaded 47820 existing records from primary storage. [2025-10-28T22:18:00.221159] [INFO ] [MAIN ] SEE: Loaded 47820 primary data records. [2025-10-28T22:18:01.043024] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:01.106265] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:01.114035] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:01.154351] [INFO ] [MAIN ] SDHY: Generated 138 derivative records from 11122 primary records. [2025-10-28T22:18:01.158902] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-28T22:18:01.181154] [DEBUG] [LOCAL ] SDHY: Derivative data saved (138 records). [2025-10-28T22:18:01.187882] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-28T22:18:01.192971] [INFO ] [MAIN ] Derivative Progress: 1603/2046 symbols completed. SDHY took 1.5s. Estimated remaining: 2m 60s. Rate: 147.8 symbols/min [2025-10-28T22:18:01.205137] [INFO ] [MAIN ] SDRL: Generated 138 derivative records from 40863 primary records. [2025-10-28T22:18:01.205503] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-28T22:18:01.208694] [INFO ] [MAIN ] SEE: Generated 138 derivative records from 47820 primary records. [2025-10-28T22:18:01.208952] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-28T22:18:01.232692] [DEBUG] [LOCAL ] SEE: Derivative data saved (138 records). [2025-10-28T22:18:01.234363] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-28T22:18:01.234308] [DEBUG] [LOCAL ] SDRL: Derivative data saved (138 records). [2025-10-28T22:18:01.236700] [INFO ] [MAIN ] Derivative Progress: 1604/2046 symbols completed. SEE took 1.6s. Estimated remaining: 2m 59s. Rate: 147.9 symbols/min [2025-10-28T22:18:01.236807] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-28T22:18:01.239395] [INFO ] [MAIN ] Derivative Progress: 1605/2046 symbols completed. SDRL took 1.6s. Estimated remaining: 2m 59s. Rate: 148.0 symbols/min [2025-10-28T22:18:01.239759] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:01.240240] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:01.239874] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:01.253804] [DEBUG] [LOCAL ] SEG: Loaded 12210 existing records from primary storage. [2025-10-28T22:18:01.253934] [INFO ] [MAIN ] SEG: Loaded 12210 primary data records. [2025-10-28T22:18:01.602889] [DEBUG] [LOCAL ] SEI: Loaded 50023 existing records from primary storage. [2025-10-28T22:18:01.603190] [INFO ] [MAIN ] SEI: Loaded 50023 primary data records. [2025-10-28T22:18:01.603990] [DEBUG] [LOCAL ] SEM: Loaded 42966 existing records from primary storage. [2025-10-28T22:18:01.610129] [INFO ] [MAIN ] SEM: Loaded 42966 primary data records. [2025-10-28T22:18:02.274094] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:02.346174] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:02.358858] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:02.378536] [INFO ] [MAIN ] SEG: Generated 138 derivative records from 12210 primary records. [2025-10-28T22:18:02.380612] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-28T22:18:02.402087] [DEBUG] [LOCAL ] SEG: Derivative data saved (138 records). [2025-10-28T22:18:02.403765] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-28T22:18:02.406551] [INFO ] [MAIN ] Derivative Progress: 1606/2046 symbols completed. SEG took 1.2s. Estimated remaining: 2m 59s. Rate: 147.8 symbols/min [2025-10-28T22:18:02.409607] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:02.438739] [INFO ] [MAIN ] SEM: Generated 138 derivative records from 42966 primary records. [2025-10-28T22:18:02.438341] [INFO ] [MAIN ] SEI: Generated 138 derivative records from 50023 primary records. [2025-10-28T22:18:02.438960] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-28T22:18:02.439154] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-28T22:18:02.471636] [DEBUG] [LOCAL ] SEI: Derivative data saved (138 records). [2025-10-28T22:18:02.473609] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-28T22:18:02.473535] [DEBUG] [LOCAL ] SEM: Derivative data saved (138 records). [2025-10-28T22:18:02.473754] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-28T22:18:02.475878] [INFO ] [MAIN ] Derivative Progress: 1607/2046 symbols completed. SEM took 1.2s. Estimated remaining: 2m 58s. Rate: 147.9 symbols/min [2025-10-28T22:18:02.479398] [INFO ] [MAIN ] Derivative Progress: 1608/2046 symbols completed. SEI took 1.2s. Estimated remaining: 2m 58s. Rate: 148.0 symbols/min [2025-10-28T22:18:02.479324] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:02.479674] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:02.497505] [DEBUG] [LOCAL ] SEMR: Loaded 41938 existing records from primary storage. [2025-10-28T22:18:02.497842] [INFO ] [MAIN ] SEMR: Loaded 41938 primary data records. [2025-10-28T22:18:02.856598] [DEBUG] [LOCAL ] SF: Loaded 41065 existing records from primary storage. [2025-10-28T22:18:02.857504] [INFO ] [MAIN ] SF: Loaded 41065 primary data records. [2025-10-28T22:18:02.983678] [DEBUG] [LOCAL ] SES: Loaded 51656 existing records from primary storage. [2025-10-28T22:18:02.988024] [INFO ] [MAIN ] SES: Loaded 51656 primary data records. [2025-10-28T22:18:03.553544] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:03.601889] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:03.637410] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:03.639596] [INFO ] [MAIN ] SEMR: Generated 138 derivative records from 41938 primary records. [2025-10-28T22:18:03.642114] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-28T22:18:03.671727] [DEBUG] [LOCAL ] SEMR: Derivative data saved (138 records). [2025-10-28T22:18:03.672187] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-28T22:18:03.674962] [INFO ] [MAIN ] Derivative Progress: 1609/2046 symbols completed. SEMR took 1.3s. Estimated remaining: 2m 57s. Rate: 147.8 symbols/min [2025-10-28T22:18:03.675183] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:03.693672] [DEBUG] [LOCAL ] SFB: Loaded 3567 existing records from primary storage. [2025-10-28T22:18:03.697133] [INFO ] [MAIN ] SFB: Loaded 3567 primary data records. [2025-10-28T22:18:03.903987] [INFO ] [MAIN ] SF: Generated 138 derivative records from 41065 primary records. [2025-10-28T22:18:03.905330] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-28T22:18:04.040345] [INFO ] [MAIN ] SES: Generated 138 derivative records from 51656 primary records. [2025-10-28T22:18:04.042048] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-28T22:18:04.045879] [DEBUG] [LOCAL ] SF: Derivative data saved (138 records). [2025-10-28T22:18:04.057108] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-28T22:18:04.059617] [INFO ] [MAIN ] Derivative Progress: 1610/2046 symbols completed. SF took 1.6s. Estimated remaining: 2m 57s. Rate: 147.8 symbols/min [2025-10-28T22:18:04.057564] [DEBUG] [LOCAL ] SES: Derivative data saved (138 records). [2025-10-28T22:18:04.059805] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-28T22:18:04.062552] [INFO ] [MAIN ] Derivative Progress: 1611/2046 symbols completed. SES took 1.6s. Estimated remaining: 2m 56s. Rate: 147.9 symbols/min [2025-10-28T22:18:04.059973] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:04.062885] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:04.100960] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:04.126751] [DEBUG] [LOCAL ] SFBS: Loaded 21036 existing records from primary storage. [2025-10-28T22:18:04.127415] [INFO ] [MAIN ] SFBS: Loaded 21036 primary data records. [2025-10-28T22:18:04.271478] [DEBUG] [LOCAL ] SFL: Loaded 45012 existing records from primary storage. [2025-10-28T22:18:04.303132] [INFO ] [MAIN ] SFL: Loaded 45012 primary data records. [2025-10-28T22:18:04.779710] [INFO ] [MAIN ] SFB: Generated 138 derivative records from 3567 primary records. [2025-10-28T22:18:04.779897] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-28T22:18:04.792978] [DEBUG] [LOCAL ] SFB: Derivative data saved (138 records). [2025-10-28T22:18:04.793566] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-28T22:18:04.796315] [INFO ] [MAIN ] Derivative Progress: 1612/2046 symbols completed. SFB took 1.1s. Estimated remaining: 2m 56s. Rate: 147.8 symbols/min [2025-10-28T22:18:04.797298] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:04.816906] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:04.870796] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:04.911246] [DEBUG] [LOCAL ] SG: Loaded 53500 existing records from primary storage. [2025-10-28T22:18:04.914550] [INFO ] [MAIN ] SG: Loaded 53500 primary data records. [2025-10-28T22:18:04.964779] [INFO ] [MAIN ] SFBS: Generated 138 derivative records from 21036 primary records. [2025-10-28T22:18:05.018988] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-28T22:18:05.248996] [DEBUG] [LOCAL ] SFBS: Derivative data saved (138 records). [2025-10-28T22:18:05.249716] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-28T22:18:05.251950] [INFO ] [MAIN ] Derivative Progress: 1613/2046 symbols completed. SFBS took 1.2s. Estimated remaining: 2m 56s. Rate: 147.8 symbols/min [2025-10-28T22:18:05.253152] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:05.259831] [INFO ] [MAIN ] SFL: Generated 138 derivative records from 45012 primary records. [2025-10-28T22:18:05.260019] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-28T22:18:05.274006] [DEBUG] [LOCAL ] SFL: Derivative data saved (138 records). [2025-10-28T22:18:05.274499] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-28T22:18:05.277375] [INFO ] [MAIN ] Derivative Progress: 1614/2046 symbols completed. SFL took 1.2s. Estimated remaining: 2m 55s. Rate: 147.9 symbols/min [2025-10-28T22:18:05.277969] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:05.288150] [DEBUG] [LOCAL ] SGU: Loaded 6375 existing records from primary storage. [2025-10-28T22:18:05.289522] [INFO ] [MAIN ] SGU: Loaded 6375 primary data records. [2025-10-28T22:18:05.361885] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:05.418808] [DEBUG] [LOCAL ] SGHC: Loaded 47336 existing records from primary storage. [2025-10-28T22:18:05.452488] [INFO ] [MAIN ] SGHC: Loaded 47336 primary data records. [2025-10-28T22:18:06.015531] [INFO ] [MAIN ] SG: Generated 138 derivative records from 53500 primary records. [2025-10-28T22:18:06.016069] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-28T22:18:06.030340] [DEBUG] [LOCAL ] SG: Derivative data saved (138 records). [2025-10-28T22:18:06.030811] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-28T22:18:06.033065] [INFO ] [MAIN ] Derivative Progress: 1615/2046 symbols completed. SG took 1.2s. Estimated remaining: 2m 55s. Rate: 147.8 symbols/min [2025-10-28T22:18:06.033404] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:06.058544] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:06.092518] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:06.155419] [DEBUG] [LOCAL ] SHAK: Loaded 48515 existing records from primary storage. [2025-10-28T22:18:06.161251] [INFO ] [MAIN ] SHAK: Loaded 48515 primary data records. [2025-10-28T22:18:06.161548] [INFO ] [MAIN ] SGU: Generated 138 derivative records from 6375 primary records. [2025-10-28T22:18:06.165550] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-28T22:18:06.272634] [INFO ] [MAIN ] SGHC: Generated 138 derivative records from 47336 primary records. [2025-10-28T22:18:06.280448] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-28T22:18:06.272330] [DEBUG] [LOCAL ] SGU: Derivative data saved (138 records). [2025-10-28T22:18:06.284400] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-28T22:18:06.286479] [INFO ] [MAIN ] Derivative Progress: 1616/2046 symbols completed. SGU took 1.0s. Estimated remaining: 2m 55s. Rate: 147.8 symbols/min [2025-10-28T22:18:06.292305] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:06.377825] [DEBUG] [LOCAL ] SGHC: Derivative data saved (138 records). [2025-10-28T22:18:06.495039] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-28T22:18:06.498330] [INFO ] [MAIN ] Derivative Progress: 1617/2046 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 54s. Rate: 147.9 symbols/min [2025-10-28T22:18:06.498611] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:06.510567] [DEBUG] [LOCAL ] SHCO: Loaded 24825 existing records from primary storage. [2025-10-28T22:18:06.511122] [INFO ] [MAIN ] SHCO: Loaded 24825 primary data records. [2025-10-28T22:18:06.854589] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:06.870934] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-28T22:18:06.873626] [INFO ] [MAIN ] SHEL: Loaded 53675 primary data records. [2025-10-28T22:18:07.207244] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:07.209547] [INFO ] [MAIN ] SHAK: Generated 138 derivative records from 48515 primary records. [2025-10-28T22:18:07.209694] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-28T22:18:07.238366] [DEBUG] [LOCAL ] SHAK: Derivative data saved (138 records). [2025-10-28T22:18:07.238580] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-28T22:18:07.241063] [INFO ] [MAIN ] Derivative Progress: 1618/2046 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 54s. Rate: 147.8 symbols/min [2025-10-28T22:18:07.269696] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:07.289824] [INFO ] [MAIN ] SHCO: Generated 138 derivative records from 24825 primary records. [2025-10-28T22:18:07.290219] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-28T22:18:07.306638] [DEBUG] [LOCAL ] SHCO: Derivative data saved (138 records). [2025-10-28T22:18:07.309046] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-28T22:18:07.311637] [INFO ] [MAIN ] Derivative Progress: 1619/2046 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 53s. Rate: 147.9 symbols/min [2025-10-28T22:18:07.316802] [INFO ] [MAIN ] SHEL: Generated 138 derivative records from 53675 primary records. [2025-10-28T22:18:07.316873] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-28T22:18:07.328182] [DEBUG] [LOCAL ] SHEL: Derivative data saved (138 records). [2025-10-28T22:18:07.328238] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-28T22:18:07.330660] [INFO ] [MAIN ] Derivative Progress: 1620/2046 symbols completed. SHEL took 0.8s. Estimated remaining: 2m 53s. Rate: 148.0 symbols/min [2025-10-28T22:18:07.331076] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:07.331182] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:07.331433] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:07.336859] [DEBUG] [LOCAL ] SHOC: Loaded 2907 existing records from primary storage. [2025-10-28T22:18:07.337153] [INFO ] [MAIN ] SHOC: Loaded 2907 primary data records. [2025-10-28T22:18:07.523296] [DEBUG] [LOCAL ] SHG: Loaded 26435 existing records from primary storage. [2025-10-28T22:18:07.545622] [INFO ] [MAIN ] SHG: Loaded 26435 primary data records. [2025-10-28T22:18:07.769005] [DEBUG] [LOCAL ] SHO: Loaded 48792 existing records from primary storage. [2025-10-28T22:18:07.786683] [INFO ] [MAIN ] SHO: Loaded 48792 primary data records. [2025-10-28T22:18:08.361320] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:08.399163] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:08.452863] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:08.484152] [INFO ] [MAIN ] SHOC: Generated 138 derivative records from 2907 primary records. [2025-10-28T22:18:08.486698] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-28T22:18:08.506167] [DEBUG] [LOCAL ] SHOC: Derivative data saved (138 records). [2025-10-28T22:18:08.506675] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-28T22:18:08.510324] [INFO ] [MAIN ] Derivative Progress: 1621/2046 symbols completed. SHOC took 1.2s. Estimated remaining: 2m 53s. Rate: 147.8 symbols/min [2025-10-28T22:18:08.510896] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:08.517265] [INFO ] [MAIN ] SHG: Generated 138 derivative records from 26435 primary records. [2025-10-28T22:18:08.517887] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-28T22:18:08.535269] [DEBUG] [LOCAL ] SHG: Derivative data saved (138 records). [2025-10-28T22:18:08.536970] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-28T22:18:08.539534] [INFO ] [MAIN ] Derivative Progress: 1622/2046 symbols completed. SHG took 1.2s. Estimated remaining: 2m 52s. Rate: 147.9 symbols/min [2025-10-28T22:18:08.542623] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:08.547397] [INFO ] [MAIN ] SHO: Generated 138 derivative records from 48792 primary records. [2025-10-28T22:18:08.547566] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-28T22:18:08.562401] [DEBUG] [LOCAL ] SHO: Derivative data saved (138 records). [2025-10-28T22:18:08.562536] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-28T22:18:08.565348] [INFO ] [MAIN ] Derivative Progress: 1623/2046 symbols completed. SHO took 1.2s. Estimated remaining: 2m 52s. Rate: 148.0 symbols/min [2025-10-28T22:18:08.565804] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:08.621992] [DEBUG] [LOCAL ] SHW: Loaded 50365 existing records from primary storage. [2025-10-28T22:18:08.622673] [INFO ] [MAIN ] SHW: Loaded 50365 primary data records. [2025-10-28T22:18:08.719861] [DEBUG] [LOCAL ] SIG: Loaded 44739 existing records from primary storage. [2025-10-28T22:18:08.705014] [DEBUG] [LOCAL ] SID: Loaded 42915 existing records from primary storage. [2025-10-28T22:18:08.731508] [INFO ] [MAIN ] SIG: Loaded 44739 primary data records. [2025-10-28T22:18:08.751020] [INFO ] [MAIN ] SID: Loaded 42915 primary data records. [2025-10-28T22:18:09.679161] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:09.711495] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:09.745666] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:09.811221] [INFO ] [MAIN ] SHW: Generated 138 derivative records from 50365 primary records. [2025-10-28T22:18:09.813679] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-28T22:18:09.828874] [INFO ] [MAIN ] SID: Generated 138 derivative records from 42915 primary records. [2025-10-28T22:18:09.829825] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-28T22:18:09.841366] [DEBUG] [LOCAL ] SHW: Derivative data saved (138 records). [2025-10-28T22:18:09.843198] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-28T22:18:09.846375] [DEBUG] [LOCAL ] SID: Derivative data saved (138 records). [2025-10-28T22:18:09.848704] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-28T22:18:09.848521] [INFO ] [MAIN ] Derivative Progress: 1624/2046 symbols completed. SHW took 1.3s. Estimated remaining: 2m 51s. Rate: 147.8 symbols/min [2025-10-28T22:18:09.851408] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:09.853318] [INFO ] [MAIN ] Derivative Progress: 1625/2046 symbols completed. SID took 1.3s. Estimated remaining: 2m 51s. Rate: 147.9 symbols/min [2025-10-28T22:18:09.854103] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:09.854380] [INFO ] [MAIN ] SIG: Generated 138 derivative records from 44739 primary records. [2025-10-28T22:18:09.854488] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-28T22:18:09.867806] [DEBUG] [LOCAL ] SIG: Derivative data saved (138 records). [2025-10-28T22:18:09.868063] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-28T22:18:09.870887] [INFO ] [MAIN ] Derivative Progress: 1626/2046 symbols completed. SIG took 1.3s. Estimated remaining: 2m 50s. Rate: 147.9 symbols/min [2025-10-28T22:18:09.871232] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:09.898145] [DEBUG] [LOCAL ] SII: Loaded 23836 existing records from primary storage. [2025-10-28T22:18:09.898432] [INFO ] [MAIN ] SII: Loaded 23836 primary data records. [2025-10-28T22:18:10.037969] [DEBUG] [LOCAL ] SITC: Loaded 41657 existing records from primary storage. [2025-10-28T22:18:10.038201] [INFO ] [MAIN ] SITC: Loaded 41657 primary data records. [2025-10-28T22:18:10.037222] [DEBUG] [LOCAL ] SILA: Loaded 29405 existing records from primary storage. [2025-10-28T22:18:10.044152] [INFO ] [MAIN ] SILA: Loaded 29405 primary data records. [2025-10-28T22:18:10.865130] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:10.899501] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:10.936180] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:10.994117] [INFO ] [MAIN ] SII: Generated 138 derivative records from 23836 primary records. [2025-10-28T22:18:10.997468] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-28T22:18:11.014841] [DEBUG] [LOCAL ] SII: Derivative data saved (138 records). [2025-10-28T22:18:11.015128] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-28T22:18:11.017173] [INFO ] [MAIN ] Derivative Progress: 1627/2046 symbols completed. SII took 1.2s. Estimated remaining: 2m 50s. Rate: 147.8 symbols/min [2025-10-28T22:18:11.019350] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:11.024633] [INFO ] [MAIN ] SITC: Generated 138 derivative records from 41657 primary records. [2025-10-28T22:18:11.024859] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-28T22:18:11.038877] [DEBUG] [LOCAL ] SITC: Derivative data saved (138 records). [2025-10-28T22:18:11.041211] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-28T22:18:11.041116] [INFO ] [MAIN ] SILA: Generated 138 derivative records from 29405 primary records. [2025-10-28T22:18:11.043809] [INFO ] [MAIN ] Derivative Progress: 1628/2046 symbols completed. SITC took 1.2s. Estimated remaining: 2m 50s. Rate: 147.9 symbols/min [2025-10-28T22:18:11.044233] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-28T22:18:11.044383] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:11.057758] [DEBUG] [LOCAL ] SILA: Derivative data saved (138 records). [2025-10-28T22:18:11.066395] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-28T22:18:11.069000] [INFO ] [MAIN ] Derivative Progress: 1629/2046 symbols completed. SILA took 1.2s. Estimated remaining: 2m 49s. Rate: 147.9 symbols/min [2025-10-28T22:18:11.069338] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:11.092365] [DEBUG] [LOCAL ] SITE: Loaded 35338 existing records from primary storage. [2025-10-28T22:18:11.092689] [INFO ] [MAIN ] SITE: Loaded 35338 primary data records. [2025-10-28T22:18:11.209946] [DEBUG] [LOCAL ] SJT: Loaded 22327 existing records from primary storage. [2025-10-28T22:18:11.213932] [INFO ] [MAIN ] SJT: Loaded 22327 primary data records. [2025-10-28T22:18:11.511243] [DEBUG] [LOCAL ] SJM: Loaded 49994 existing records from primary storage. [2025-10-28T22:18:11.524544] [INFO ] [MAIN ] SJM: Loaded 49994 primary data records. [2025-10-28T22:18:12.099778] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:12.159489] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:12.173052] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:12.203842] [INFO ] [MAIN ] SITE: Generated 138 derivative records from 35338 primary records. [2025-10-28T22:18:12.208383] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-28T22:18:12.229873] [DEBUG] [LOCAL ] SITE: Derivative data saved (138 records). [2025-10-28T22:18:12.231297] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-28T22:18:12.238798] [INFO ] [MAIN ] Derivative Progress: 1630/2046 symbols completed. SITE took 1.2s. Estimated remaining: 2m 49s. Rate: 147.8 symbols/min [2025-10-28T22:18:12.239064] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:12.256122] [INFO ] [MAIN ] SJT: Generated 138 derivative records from 22327 primary records. [2025-10-28T22:18:12.256440] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-28T22:18:12.284481] [DEBUG] [LOCAL ] SJT: Derivative data saved (138 records). [2025-10-28T22:18:12.284971] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-28T22:18:12.284781] [INFO ] [MAIN ] SJM: Generated 138 derivative records from 49994 primary records. [2025-10-28T22:18:12.287572] [INFO ] [MAIN ] Derivative Progress: 1631/2046 symbols completed. SJT took 1.2s. Estimated remaining: 2m 48s. Rate: 147.9 symbols/min [2025-10-28T22:18:12.287931] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-28T22:18:12.288040] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:12.314133] [DEBUG] [LOCAL ] SJM: Derivative data saved (138 records). [2025-10-28T22:18:12.318197] [DEBUG] [LOCAL ] SKIL: Loaded 7092 existing records from primary storage. [2025-10-28T22:18:12.318518] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-28T22:18:12.318455] [INFO ] [MAIN ] SKIL: Loaded 7092 primary data records. [2025-10-28T22:18:12.323192] [DEBUG] [LOCAL ] SKE: Loaded 37297 existing records from primary storage. [2025-10-28T22:18:12.322224] [INFO ] [MAIN ] Derivative Progress: 1632/2046 symbols completed. SJM took 1.3s. Estimated remaining: 2m 48s. Rate: 147.9 symbols/min [2025-10-28T22:18:12.323426] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:12.328723] [INFO ] [MAIN ] SKE: Loaded 37297 primary data records. [2025-10-28T22:18:12.571109] [DEBUG] [LOCAL ] SKLZ: Loaded 11329 existing records from primary storage. [2025-10-28T22:18:12.581598] [INFO ] [MAIN ] SKLZ: Loaded 11329 primary data records. [2025-10-28T22:18:13.326427] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:13.355235] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:13.403918] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:13.462798] [INFO ] [MAIN ] SKE: Generated 138 derivative records from 37297 primary records. [2025-10-28T22:18:13.463339] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-28T22:18:13.466004] [INFO ] [MAIN ] SKIL: Generated 138 derivative records from 7092 primary records. [2025-10-28T22:18:13.467264] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-28T22:18:13.482066] [DEBUG] [LOCAL ] SKE: Derivative data saved (138 records). [2025-10-28T22:18:13.482528] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-28T22:18:13.485735] [INFO ] [MAIN ] Derivative Progress: 1633/2046 symbols completed. SKE took 1.2s. Estimated remaining: 2m 48s. Rate: 147.8 symbols/min [2025-10-28T22:18:13.502599] [DEBUG] [LOCAL ] SKIL: Derivative data saved (138 records). [2025-10-28T22:18:13.503870] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-28T22:18:13.506730] [INFO ] [MAIN ] Derivative Progress: 1634/2046 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 47s. Rate: 147.9 symbols/min [2025-10-28T22:18:13.508499] [INFO ] [MAIN ] SKLZ: Generated 138 derivative records from 11329 primary records. [2025-10-28T22:18:13.508627] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-28T22:18:13.520306] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (138 records). [2025-10-28T22:18:13.520372] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-28T22:18:13.523185] [INFO ] [MAIN ] Derivative Progress: 1635/2046 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 47s. Rate: 147.9 symbols/min [2025-10-28T22:18:13.523763] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:13.523678] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:13.523553] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:13.573117] [DEBUG] [LOCAL ] SKM: Loaded 35072 existing records from primary storage. [2025-10-28T22:18:13.584054] [INFO ] [MAIN ] SKM: Loaded 35072 primary data records. [2025-10-28T22:18:13.645355] [DEBUG] [LOCAL ] SKY: Loaded 38376 existing records from primary storage. [2025-10-28T22:18:13.664476] [DEBUG] [LOCAL ] SKT: Loaded 41814 existing records from primary storage. [2025-10-28T22:18:13.679440] [INFO ] [MAIN ] SKT: Loaded 41814 primary data records. [2025-10-28T22:18:13.679541] [INFO ] [MAIN ] SKY: Loaded 38376 primary data records. [2025-10-28T22:18:14.608167] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:14.632247] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:14.669415] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:14.727174] [INFO ] [MAIN ] SKM: Generated 138 derivative records from 35072 primary records. [2025-10-28T22:18:14.728677] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-28T22:18:14.742016] [DEBUG] [LOCAL ] SKM: Derivative data saved (138 records). [2025-10-28T22:18:14.742167] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-28T22:18:14.744261] [INFO ] [MAIN ] Derivative Progress: 1636/2046 symbols completed. SKM took 1.2s. Estimated remaining: 2m 46s. Rate: 147.8 symbols/min [2025-10-28T22:18:14.744509] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:14.748477] [INFO ] [MAIN ] SKY: Generated 138 derivative records from 38376 primary records. [2025-10-28T22:18:14.749089] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-28T22:18:14.748804] [INFO ] [MAIN ] SKT: Generated 138 derivative records from 41814 primary records. [2025-10-28T22:18:14.749192] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-28T22:18:14.775471] [DEBUG] [LOCAL ] SKT: Derivative data saved (138 records). [2025-10-28T22:18:14.776987] [DEBUG] [LOCAL ] SKY: Derivative data saved (138 records). [2025-10-28T22:18:14.777168] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-28T22:18:14.777110] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-28T22:18:14.779780] [INFO ] [MAIN ] Derivative Progress: 1637/2046 symbols completed. SKY took 1.3s. Estimated remaining: 2m 46s. Rate: 147.8 symbols/min [2025-10-28T22:18:14.782770] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:14.788261] [INFO ] [MAIN ] Derivative Progress: 1638/2046 symbols completed. SKT took 1.3s. Estimated remaining: 2m 45s. Rate: 147.9 symbols/min [2025-10-28T22:18:14.788993] [DEBUG] [LOCAL ] SKYH: Loaded 15303 existing records from primary storage. [2025-10-28T22:18:14.789192] [INFO ] [MAIN ] SKYH: Loaded 15303 primary data records. [2025-10-28T22:18:14.789290] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:15.136548] [DEBUG] [LOCAL ] SLF: Loaded 37723 existing records from primary storage. [2025-10-28T22:18:15.136899] [INFO ] [MAIN ] SLF: Loaded 37723 primary data records. [2025-10-28T22:18:15.137614] [DEBUG] [LOCAL ] SLG: Loaded 45710 existing records from primary storage. [2025-10-28T22:18:15.153018] [INFO ] [MAIN ] SLG: Loaded 45710 primary data records. [2025-10-28T22:18:15.817461] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:15.882311] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:15.882667] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:15.925375] [INFO ] [MAIN ] SKYH: Generated 138 derivative records from 15303 primary records. [2025-10-28T22:18:15.925814] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-28T22:18:15.943782] [DEBUG] [LOCAL ] SKYH: Derivative data saved (138 records). [2025-10-28T22:18:15.944113] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-28T22:18:15.950935] [INFO ] [MAIN ] Derivative Progress: 1639/2046 symbols completed. SKYH took 1.2s. Estimated remaining: 2m 45s. Rate: 147.8 symbols/min [2025-10-28T22:18:15.951086] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:15.967899] [INFO ] [MAIN ] SLG: Generated 138 derivative records from 45710 primary records. [2025-10-28T22:18:15.968465] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-28T22:18:15.971287] [INFO ] [MAIN ] SLF: Generated 138 derivative records from 37723 primary records. [2025-10-28T22:18:15.971557] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-28T22:18:15.983287] [DEBUG] [LOCAL ] SLG: Derivative data saved (138 records). [2025-10-28T22:18:15.990527] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-28T22:18:16.006255] [DEBUG] [LOCAL ] SLF: Derivative data saved (138 records). [2025-10-28T22:18:16.003530] [INFO ] [MAIN ] Derivative Progress: 1640/2046 symbols completed. SLG took 1.2s. Estimated remaining: 2m 45s. Rate: 147.8 symbols/min [2025-10-28T22:18:16.006760] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-28T22:18:16.006674] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:16.009173] [INFO ] [MAIN ] Derivative Progress: 1641/2046 symbols completed. SLF took 1.2s. Estimated remaining: 2m 44s. Rate: 147.9 symbols/min [2025-10-28T22:18:16.009514] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:16.023868] [DEBUG] [LOCAL ] SLGN: Loaded 40954 existing records from primary storage. [2025-10-28T22:18:16.023997] [INFO ] [MAIN ] SLGN: Loaded 40954 primary data records. [2025-10-28T22:18:16.202383] [DEBUG] [LOCAL ] SLVM: Loaded 27529 existing records from primary storage. [2025-10-28T22:18:16.242621] [INFO ] [MAIN ] SLVM: Loaded 27529 primary data records. [2025-10-28T22:18:16.367001] [DEBUG] [LOCAL ] SLQT: Loaded 43041 existing records from primary storage. [2025-10-28T22:18:16.398831] [INFO ] [MAIN ] SLQT: Loaded 43041 primary data records. [2025-10-28T22:18:17.033135] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:17.077180] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:17.108244] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:17.154363] [INFO ] [MAIN ] SLGN: Generated 138 derivative records from 40954 primary records. [2025-10-28T22:18:17.157967] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-28T22:18:17.178097] [DEBUG] [LOCAL ] SLGN: Derivative data saved (138 records). [2025-10-28T22:18:17.181240] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-28T22:18:17.184477] [INFO ] [MAIN ] Derivative Progress: 1642/2046 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 44s. Rate: 147.8 symbols/min [2025-10-28T22:18:17.184698] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:17.192108] [INFO ] [MAIN ] SLVM: Generated 138 derivative records from 27529 primary records. [2025-10-28T22:18:17.192307] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-28T22:18:17.207048] [DEBUG] [LOCAL ] SLVM: Derivative data saved (138 records). [2025-10-28T22:18:17.207212] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-28T22:18:17.209721] [INFO ] [MAIN ] Derivative Progress: 1643/2046 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 44s. Rate: 147.8 symbols/min [2025-10-28T22:18:17.210186] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:17.209972] [INFO ] [MAIN ] SLQT: Generated 138 derivative records from 43041 primary records. [2025-10-28T22:18:17.210738] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-28T22:18:17.227181] [DEBUG] [LOCAL ] SLQT: Derivative data saved (138 records). [2025-10-28T22:18:17.227452] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-28T22:18:17.230454] [INFO ] [MAIN ] Derivative Progress: 1644/2046 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 43s. Rate: 147.9 symbols/min [2025-10-28T22:18:17.230691] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:17.234993] [DEBUG] [LOCAL ] SMBK: Loaded 8154 existing records from primary storage. [2025-10-28T22:18:17.235498] [INFO ] [MAIN ] SMBK: Loaded 8154 primary data records. [2025-10-28T22:18:17.360806] [DEBUG] [LOCAL ] SMC: Loaded 10370 existing records from primary storage. [2025-10-28T22:18:17.399866] [INFO ] [MAIN ] SMC: Loaded 10370 primary data records. [2025-10-28T22:18:17.508418] [DEBUG] [LOCAL ] SM: Loaded 52333 existing records from primary storage. [2025-10-28T22:18:17.648291] [INFO ] [MAIN ] SM: Loaded 52333 primary data records. [2025-10-28T22:18:18.223449] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:18.262095] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:18.306498] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:18.335957] [INFO ] [MAIN ] SMBK: Generated 138 derivative records from 8154 primary records. [2025-10-28T22:18:18.340320] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-28T22:18:18.358010] [DEBUG] [LOCAL ] SMBK: Derivative data saved (138 records). [2025-10-28T22:18:18.363600] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-28T22:18:18.365722] [INFO ] [MAIN ] Derivative Progress: 1645/2046 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 43s. Rate: 147.8 symbols/min [2025-10-28T22:18:18.366359] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:18.371576] [INFO ] [MAIN ] SMC: Generated 138 derivative records from 10370 primary records. [2025-10-28T22:18:18.371803] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-28T22:18:18.386452] [DEBUG] [LOCAL ] SMC: Derivative data saved (138 records). [2025-10-28T22:18:18.386556] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-28T22:18:18.391517] [INFO ] [MAIN ] Derivative Progress: 1646/2046 symbols completed. SMC took 1.2s. Estimated remaining: 2m 42s. Rate: 147.8 symbols/min [2025-10-28T22:18:18.395410] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:18.399933] [INFO ] [MAIN ] SM: Generated 138 derivative records from 52333 primary records. [2025-10-28T22:18:18.400054] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-28T22:18:18.424447] [DEBUG] [LOCAL ] SM: Derivative data saved (138 records). [2025-10-28T22:18:18.424583] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-28T22:18:18.427800] [INFO ] [MAIN ] Derivative Progress: 1647/2046 symbols completed. SM took 1.2s. Estimated remaining: 2m 42s. Rate: 147.9 symbols/min [2025-10-28T22:18:18.428149] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:18.462741] [DEBUG] [LOCAL ] SMHI: Loaded 11974 existing records from primary storage. [2025-10-28T22:18:18.463806] [DEBUG] [LOCAL ] SMFG: Loaded 48067 existing records from primary storage. [2025-10-28T22:18:18.462916] [INFO ] [MAIN ] SMHI: Loaded 11974 primary data records. [2025-10-28T22:18:18.464007] [INFO ] [MAIN ] SMFG: Loaded 48067 primary data records. [2025-10-28T22:18:18.643617] [DEBUG] [LOCAL ] SMG: Loaded 42158 existing records from primary storage. [2025-10-28T22:18:18.678511] [INFO ] [MAIN ] SMG: Loaded 42158 primary data records. [2025-10-28T22:18:19.411817] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:19.423023] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:19.470202] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:19.515118] [INFO ] [MAIN ] SMHI: Generated 138 derivative records from 11974 primary records. [2025-10-28T22:18:19.517759] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-28T22:18:19.519361] [INFO ] [MAIN ] SMFG: Generated 138 derivative records from 48067 primary records. [2025-10-28T22:18:19.519709] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-28T22:18:19.543896] [DEBUG] [LOCAL ] SMFG: Derivative data saved (138 records). [2025-10-28T22:18:19.546778] [DEBUG] [LOCAL ] SMHI: Derivative data saved (138 records). [2025-10-28T22:18:19.547035] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-28T22:18:19.546951] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-28T22:18:19.550017] [INFO ] [MAIN ] Derivative Progress: 1648/2046 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 42s. Rate: 147.8 symbols/min [2025-10-28T22:18:19.553129] [INFO ] [MAIN ] Derivative Progress: 1649/2046 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 41s. Rate: 147.9 symbols/min [2025-10-28T22:18:19.555150] [INFO ] [MAIN ] SMG: Generated 138 derivative records from 42158 primary records. [2025-10-28T22:18:19.555304] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-28T22:18:19.566799] [DEBUG] [LOCAL ] SMG: Derivative data saved (138 records). [2025-10-28T22:18:19.566855] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-28T22:18:19.569242] [INFO ] [MAIN ] Derivative Progress: 1650/2046 symbols completed. SMG took 1.2s. Estimated remaining: 2m 41s. Rate: 147.9 symbols/min [2025-10-28T22:18:19.569571] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:19.569621] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:19.569943] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:19.587892] [DEBUG] [LOCAL ] SMP: Loaded 18315 existing records from primary storage. [2025-10-28T22:18:19.588024] [INFO ] [MAIN ] SMP: Loaded 18315 primary data records. [2025-10-28T22:18:19.717366] [DEBUG] [LOCAL ] SMWB: Loaded 31332 existing records from primary storage. [2025-10-28T22:18:19.739224] [INFO ] [MAIN ] SMWB: Loaded 31332 primary data records. [2025-10-28T22:18:19.980617] [DEBUG] [LOCAL ] SMRT: Loaded 43504 existing records from primary storage. [2025-10-28T22:18:20.016741] [INFO ] [MAIN ] SMRT: Loaded 43504 primary data records. [2025-10-28T22:18:20.564687] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:20.599042] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:20.636776] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:20.672164] [INFO ] [MAIN ] SMP: Generated 138 derivative records from 18315 primary records. [2025-10-28T22:18:20.673235] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-28T22:18:20.691722] [DEBUG] [LOCAL ] SMP: Derivative data saved (138 records). [2025-10-28T22:18:20.692015] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-28T22:18:20.694582] [INFO ] [MAIN ] Derivative Progress: 1651/2046 symbols completed. SMP took 1.1s. Estimated remaining: 2m 40s. Rate: 147.8 symbols/min [2025-10-28T22:18:20.697684] [INFO ] [MAIN ] SMWB: Generated 138 derivative records from 31332 primary records. [2025-10-28T22:18:20.697858] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-28T22:18:20.697944] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:20.712564] [DEBUG] [LOCAL ] SMWB: Derivative data saved (138 records). [2025-10-28T22:18:20.712763] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-28T22:18:20.715229] [INFO ] [MAIN ] Derivative Progress: 1652/2046 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 40s. Rate: 147.9 symbols/min [2025-10-28T22:18:20.717195] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:20.723311] [INFO ] [MAIN ] SMRT: Generated 138 derivative records from 43504 primary records. [2025-10-28T22:18:20.723435] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-28T22:18:20.742344] [DEBUG] [LOCAL ] SMRT: Derivative data saved (138 records). [2025-10-28T22:18:20.742606] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-28T22:18:20.745893] [INFO ] [MAIN ] Derivative Progress: 1653/2046 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 39s. Rate: 148.0 symbols/min [2025-10-28T22:18:20.746210] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:20.766619] [DEBUG] [LOCAL ] SNA: Loaded 25216 existing records from primary storage. [2025-10-28T22:18:20.766878] [INFO ] [MAIN ] SNA: Loaded 25216 primary data records. [2025-10-28T22:18:20.884590] [DEBUG] [LOCAL ] SN: Loaded 49838 existing records from primary storage. [2025-10-28T22:18:20.895394] [INFO ] [MAIN ] SN: Loaded 49838 primary data records. [2025-10-28T22:18:21.308521] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-28T22:18:21.421137] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-28T22:18:21.809285] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:21.842469] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:21.909255] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:21.931421] [INFO ] [MAIN ] SN: Generated 138 derivative records from 49838 primary records. [2025-10-28T22:18:21.933270] [INFO ] [MAIN ] SNA: Generated 138 derivative records from 25216 primary records. [2025-10-28T22:18:21.933355] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-28T22:18:21.933818] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-28T22:18:21.959383] [DEBUG] [LOCAL ] SNA: Derivative data saved (138 records). [2025-10-28T22:18:21.960130] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-28T22:18:21.962962] [INFO ] [MAIN ] Derivative Progress: 1654/2046 symbols completed. SNA took 1.2s. Estimated remaining: 2m 39s. Rate: 147.8 symbols/min [2025-10-28T22:18:21.963101] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:21.965093] [DEBUG] [LOCAL ] SN: Derivative data saved (138 records). [2025-10-28T22:18:21.965191] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-28T22:18:21.968119] [INFO ] [MAIN ] Derivative Progress: 1655/2046 symbols completed. SN took 1.3s. Estimated remaining: 2m 39s. Rate: 147.9 symbols/min [2025-10-28T22:18:21.969600] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:21.981499] [DEBUG] [LOCAL ] SNDA: Loaded 4370 existing records from primary storage. [2025-10-28T22:18:21.981788] [INFO ] [MAIN ] SNDA: Loaded 4370 primary data records. [2025-10-28T22:18:22.184222] [INFO ] [MAIN ] SNAP: Generated 138 derivative records from 53796 primary records. [2025-10-28T22:18:22.191740] [DEBUG] [LOCAL ] SNDR: Loaded 41435 existing records from primary storage. [2025-10-28T22:18:22.191069] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-28T22:18:22.191873] [INFO ] [MAIN ] SNDR: Loaded 41435 primary data records. [2025-10-28T22:18:22.377528] [DEBUG] [LOCAL ] SNAP: Derivative data saved (138 records). [2025-10-28T22:18:22.388806] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-28T22:18:22.403915] [INFO ] [MAIN ] Derivative Progress: 1656/2046 symbols completed. SNAP took 1.7s. Estimated remaining: 2m 38s. Rate: 147.9 symbols/min [2025-10-28T22:18:22.409409] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:22.694305] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-28T22:18:22.735216] [DEBUG] [LOCAL ] SNN: Loaded 44096 existing records from primary storage. [2025-10-28T22:18:22.737221] [INFO ] [MAIN ] SNN: Loaded 44096 primary data records. [2025-10-28T22:18:23.068427] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:23.071484] [INFO ] [MAIN ] SNDA: Generated 138 derivative records from 4370 primary records. [2025-10-28T22:18:23.084240] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-28T22:18:23.103939] [DEBUG] [LOCAL ] SNDA: Derivative data saved (138 records). [2025-10-28T22:18:23.104095] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-28T22:18:23.106810] [INFO ] [MAIN ] Derivative Progress: 1657/2046 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 38s. Rate: 147.8 symbols/min [2025-10-28T22:18:23.109959] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:23.138813] [INFO ] [MAIN ] SNDR: Generated 138 derivative records from 41435 primary records. [2025-10-28T22:18:23.144121] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:23.144193] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-28T22:18:23.185190] [DEBUG] [LOCAL ] SNDR: Derivative data saved (138 records). [2025-10-28T22:18:23.185505] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-28T22:18:23.188636] [INFO ] [MAIN ] Derivative Progress: 1658/2046 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 37s. Rate: 147.9 symbols/min [2025-10-28T22:18:23.189132] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:23.211830] [DEBUG] [LOCAL ] SNV: Loaded 48991 existing records from primary storage. [2025-10-28T22:18:23.212087] [INFO ] [MAIN ] SNV: Loaded 48991 primary data records. [2025-10-28T22:18:23.375981] [INFO ] [MAIN ] SNN: Generated 138 derivative records from 44096 primary records. [2025-10-28T22:18:23.396765] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-28T22:18:23.546872] [DEBUG] [LOCAL ] SNN: Derivative data saved (138 records). [2025-10-28T22:18:23.547320] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-28T22:18:23.549882] [INFO ] [MAIN ] Derivative Progress: 1659/2046 symbols completed. SNN took 1.1s. Estimated remaining: 2m 37s. Rate: 147.9 symbols/min [2025-10-28T22:18:23.550689] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:23.569672] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-28T22:18:23.570514] [INFO ] [MAIN ] SO: Loaded 53614 primary data records. [2025-10-28T22:18:23.914804] [DEBUG] [LOCAL ] SOBO: Loaded 39029 existing records from primary storage. [2025-10-28T22:18:23.915523] [INFO ] [MAIN ] SOBO: Loaded 39029 primary data records. [2025-10-28T22:18:23.952419] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:24.336173] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:24.365692] [INFO ] [MAIN ] SNV: Generated 138 derivative records from 48991 primary records. [2025-10-28T22:18:24.368720] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-28T22:18:24.386562] [DEBUG] [LOCAL ] SNV: Derivative data saved (138 records). [2025-10-28T22:18:24.386980] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-28T22:18:24.389315] [INFO ] [MAIN ] Derivative Progress: 1660/2046 symbols completed. SNV took 1.3s. Estimated remaining: 2m 37s. Rate: 147.8 symbols/min [2025-10-28T22:18:24.391289] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:24.411760] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:24.411916] [INFO ] [MAIN ] SO: Generated 138 derivative records from 53614 primary records. [2025-10-28T22:18:24.422431] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-28T22:18:24.439157] [DEBUG] [LOCAL ] SO: Derivative data saved (138 records). [2025-10-28T22:18:24.439417] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-28T22:18:24.444049] [INFO ] [MAIN ] Derivative Progress: 1661/2046 symbols completed. SO took 1.3s. Estimated remaining: 2m 36s. Rate: 147.9 symbols/min [2025-10-28T22:18:24.444314] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:24.467450] [DEBUG] [LOCAL ] SOJC: Loaded 4384 existing records from primary storage. [2025-10-28T22:18:24.469674] [INFO ] [MAIN ] SOJC: Loaded 4384 primary data records. [2025-10-28T22:18:24.596546] [DEBUG] [LOCAL ] SOC: Loaded 51237 existing records from primary storage. [2025-10-28T22:18:24.603698] [INFO ] [MAIN ] SOC: Loaded 51237 primary data records. [2025-10-28T22:18:24.890152] [INFO ] [MAIN ] SOBO: Generated 138 derivative records from 39029 primary records. [2025-10-28T22:18:24.909640] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-28T22:18:25.113483] [DEBUG] [LOCAL ] SOBO: Derivative data saved (138 records). [2025-10-28T22:18:25.121827] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-28T22:18:25.125103] [INFO ] [MAIN ] Derivative Progress: 1662/2046 symbols completed. SOBO took 1.6s. Estimated remaining: 2m 36s. Rate: 147.8 symbols/min [2025-10-28T22:18:25.125747] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:25.141329] [DEBUG] [LOCAL ] SOJD: Loaded 12374 existing records from primary storage. [2025-10-28T22:18:25.141716] [INFO ] [MAIN ] SOJD: Loaded 12374 primary data records. [2025-10-28T22:18:25.257835] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:25.479553] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:25.544260] [INFO ] [MAIN ] SOJC: Generated 138 derivative records from 4384 primary records. [2025-10-28T22:18:25.559862] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-28T22:18:25.560275] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:25.591264] [DEBUG] [LOCAL ] SOJC: Derivative data saved (138 records). [2025-10-28T22:18:25.590794] [INFO ] [MAIN ] SOC: Generated 138 derivative records from 51237 primary records. [2025-10-28T22:18:25.591483] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-28T22:18:25.591670] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-28T22:18:25.596841] [INFO ] [MAIN ] Derivative Progress: 1663/2046 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 35s. Rate: 147.8 symbols/min [2025-10-28T22:18:25.612707] [DEBUG] [LOCAL ] SOC: Derivative data saved (138 records). [2025-10-28T22:18:25.612806] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-28T22:18:25.616277] [INFO ] [MAIN ] Derivative Progress: 1664/2046 symbols completed. SOC took 1.2s. Estimated remaining: 2m 35s. Rate: 147.9 symbols/min [2025-10-28T22:18:25.622961] [INFO ] [MAIN ] SOJD: Generated 138 derivative records from 12374 primary records. [2025-10-28T22:18:25.623041] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-28T22:18:25.634518] [DEBUG] [LOCAL ] SOJD: Derivative data saved (138 records). [2025-10-28T22:18:25.634575] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-28T22:18:25.637149] [INFO ] [MAIN ] Derivative Progress: 1665/2046 symbols completed. SOJD took 0.5s. Estimated remaining: 2m 35s. Rate: 148.0 symbols/min [2025-10-28T22:18:25.637498] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:25.637691] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:25.637584] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:25.652037] [DEBUG] [LOCAL ] SOJE: Loaded 8575 existing records from primary storage. [2025-10-28T22:18:25.652286] [INFO ] [MAIN ] SOJE: Loaded 8575 primary data records. [2025-10-28T22:18:25.702226] [DEBUG] [LOCAL ] SOL: Loaded 13524 existing records from primary storage. [2025-10-28T22:18:25.728551] [INFO ] [MAIN ] SOL: Loaded 13524 primary data records. [2025-10-28T22:18:25.978757] [DEBUG] [LOCAL ] SOLV: Loaded 43064 existing records from primary storage. [2025-10-28T22:18:26.119760] [INFO ] [MAIN ] SOLV: Loaded 43064 primary data records. [2025-10-28T22:18:26.650389] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:26.684742] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:26.726295] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:26.779774] [INFO ] [MAIN ] SOJE: Generated 138 derivative records from 8575 primary records. [2025-10-28T22:18:26.781480] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-28T22:18:26.784978] [INFO ] [MAIN ] SOL: Generated 138 derivative records from 13524 primary records. [2025-10-28T22:18:26.797393] [DEBUG] [LOCAL ] SOJE: Derivative data saved (138 records). [2025-10-28T22:18:26.794545] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-28T22:18:26.798224] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-28T22:18:26.802671] [INFO ] [MAIN ] Derivative Progress: 1666/2046 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 34s. Rate: 147.8 symbols/min [2025-10-28T22:18:26.810251] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:26.816603] [DEBUG] [LOCAL ] SOL: Derivative data saved (138 records). [2025-10-28T22:18:26.816844] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-28T22:18:26.819838] [INFO ] [MAIN ] Derivative Progress: 1667/2046 symbols completed. SOL took 1.2s. Estimated remaining: 2m 34s. Rate: 147.9 symbols/min [2025-10-28T22:18:26.820288] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:26.822869] [INFO ] [MAIN ] SOLV: Generated 138 derivative records from 43064 primary records. [2025-10-28T22:18:26.823328] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-28T22:18:26.836441] [DEBUG] [LOCAL ] SOLV: Derivative data saved (138 records). [2025-10-28T22:18:26.836559] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-28T22:18:26.839318] [INFO ] [MAIN ] Derivative Progress: 1668/2046 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 33s. Rate: 148.0 symbols/min [2025-10-28T22:18:26.839535] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:26.844580] [DEBUG] [LOCAL ] SOR: Loaded 2788 existing records from primary storage. [2025-10-28T22:18:26.854200] [INFO ] [MAIN ] SOR: Loaded 2788 primary data records. [2025-10-28T22:18:26.992011] [DEBUG] [LOCAL ] SON: Loaded 43641 existing records from primary storage. [2025-10-28T22:18:27.018710] [INFO ] [MAIN ] SON: Loaded 43641 primary data records. [2025-10-28T22:18:27.284501] [DEBUG] [LOCAL ] SONY: Loaded 53356 existing records from primary storage. [2025-10-28T22:18:27.297086] [INFO ] [MAIN ] SONY: Loaded 53356 primary data records. [2025-10-28T22:18:27.827610] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:27.875334] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:27.918266] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:27.939686] [INFO ] [MAIN ] SOR: Generated 138 derivative records from 2788 primary records. [2025-10-28T22:18:27.944334] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-28T22:18:27.961591] [DEBUG] [LOCAL ] SOR: Derivative data saved (138 records). [2025-10-28T22:18:27.967283] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-28T22:18:27.971309] [INFO ] [MAIN ] Derivative Progress: 1669/2046 symbols completed. SOR took 1.1s. Estimated remaining: 2m 33s. Rate: 147.8 symbols/min [2025-10-28T22:18:27.973610] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:27.988326] [INFO ] [MAIN ] SON: Generated 138 derivative records from 43641 primary records. [2025-10-28T22:18:27.995831] [DEBUG] [LOCAL ] SOS: Loaded 9803 existing records from primary storage. [2025-10-28T22:18:27.994363] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-28T22:18:27.996556] [INFO ] [MAIN ] SOS: Loaded 9803 primary data records. [2025-10-28T22:18:28.067119] [DEBUG] [LOCAL ] SON: Derivative data saved (138 records). [2025-10-28T22:18:28.069377] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-28T22:18:28.069183] [INFO ] [MAIN ] SONY: Generated 138 derivative records from 53356 primary records. [2025-10-28T22:18:28.086136] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-28T22:18:28.080827] [INFO ] [MAIN ] Derivative Progress: 1670/2046 symbols completed. SON took 1.3s. Estimated remaining: 2m 33s. Rate: 147.9 symbols/min [2025-10-28T22:18:28.103747] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:28.139483] [DEBUG] [LOCAL ] SONY: Derivative data saved (138 records). [2025-10-28T22:18:28.155196] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-28T22:18:28.176533] [INFO ] [MAIN ] Derivative Progress: 1671/2046 symbols completed. SONY took 1.4s. Estimated remaining: 2m 32s. Rate: 147.9 symbols/min [2025-10-28T22:18:28.185484] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:28.382678] [DEBUG] [LOCAL ] SPB: Loaded 33376 existing records from primary storage. [2025-10-28T22:18:28.383224] [INFO ] [MAIN ] SPB: Loaded 33376 primary data records. [2025-10-28T22:18:28.589967] [DEBUG] [LOCAL ] SPCE: Loaded 50110 existing records from primary storage. [2025-10-28T22:18:28.590333] [INFO ] [MAIN ] SPCE: Loaded 50110 primary data records. [2025-10-28T22:18:28.848602] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:29.069997] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:29.092002] [INFO ] [MAIN ] SOS: Generated 138 derivative records from 9803 primary records. [2025-10-28T22:18:29.106271] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-28T22:18:29.108979] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:29.138833] [DEBUG] [LOCAL ] SOS: Derivative data saved (138 records). [2025-10-28T22:18:29.139719] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-28T22:18:29.142042] [INFO ] [MAIN ] Derivative Progress: 1672/2046 symbols completed. SOS took 1.2s. Estimated remaining: 2m 32s. Rate: 147.8 symbols/min [2025-10-28T22:18:29.142268] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:29.159444] [DEBUG] [LOCAL ] SPE: Loaded 5991 existing records from primary storage. [2025-10-28T22:18:29.162510] [INFO ] [MAIN ] SPE: Loaded 5991 primary data records. [2025-10-28T22:18:29.238894] [INFO ] [MAIN ] SPB: Generated 138 derivative records from 33376 primary records. [2025-10-28T22:18:29.256890] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-28T22:18:29.313986] [DEBUG] [LOCAL ] SPB: Derivative data saved (138 records). [2025-10-28T22:18:29.346771] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-28T22:18:29.374807] [INFO ] [MAIN ] Derivative Progress: 1673/2046 symbols completed. SPB took 1.3s. Estimated remaining: 2m 31s. Rate: 147.8 symbols/min [2025-10-28T22:18:29.382936] [INFO ] [MAIN ] SPCE: Generated 138 derivative records from 50110 primary records. [2025-10-28T22:18:29.383289] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-28T22:18:29.383070] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:29.516084] [DEBUG] [LOCAL ] SPCE: Derivative data saved (138 records). [2025-10-28T22:18:29.516859] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-28T22:18:29.519600] [INFO ] [MAIN ] Derivative Progress: 1674/2046 symbols completed. SPCE took 1.3s. Estimated remaining: 2m 31s. Rate: 147.9 symbols/min [2025-10-28T22:18:29.519909] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:29.554895] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:29.614675] [DEBUG] [LOCAL ] SPG: Loaded 49802 existing records from primary storage. [2025-10-28T22:18:29.615000] [INFO ] [MAIN ] SPG: Loaded 49802 primary data records. [2025-10-28T22:18:29.615591] [DEBUG] [LOCAL ] SPGI: Loaded 45742 existing records from primary storage. [2025-10-28T22:18:29.639934] [INFO ] [MAIN ] SPGI: Loaded 45742 primary data records. [2025-10-28T22:18:29.953062] [INFO ] [MAIN ] SPE: Generated 138 derivative records from 5991 primary records. [2025-10-28T22:18:30.083065] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-28T22:18:30.264600] [DEBUG] [LOCAL ] SPE: Derivative data saved (138 records). [2025-10-28T22:18:30.265571] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-28T22:18:30.267748] [INFO ] [MAIN ] Derivative Progress: 1675/2046 symbols completed. SPE took 1.1s. Estimated remaining: 2m 31s. Rate: 147.8 symbols/min [2025-10-28T22:18:30.268810] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:30.289849] [DEBUG] [LOCAL ] SPH: Loaded 16195 existing records from primary storage. [2025-10-28T22:18:30.291552] [INFO ] [MAIN ] SPH: Loaded 16195 primary data records. [2025-10-28T22:18:30.396292] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:30.419275] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:30.744582] [INFO ] [MAIN ] SPGI: Generated 138 derivative records from 45742 primary records. [2025-10-28T22:18:30.744763] [INFO ] [MAIN ] SPG: Generated 138 derivative records from 49802 primary records. [2025-10-28T22:18:30.745263] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-28T22:18:30.745326] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-28T22:18:30.769334] [DEBUG] [LOCAL ] SPG: Derivative data saved (138 records). [2025-10-28T22:18:30.770120] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-28T22:18:30.772659] [INFO ] [MAIN ] Derivative Progress: 1676/2046 symbols completed. SPG took 1.4s. Estimated remaining: 2m 30s. Rate: 147.8 symbols/min [2025-10-28T22:18:30.773044] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:30.791690] [DEBUG] [LOCAL ] SPGI: Derivative data saved (138 records). [2025-10-28T22:18:30.792086] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-28T22:18:30.795046] [INFO ] [MAIN ] Derivative Progress: 1677/2046 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 30s. Rate: 147.9 symbols/min [2025-10-28T22:18:30.792315] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:30.795379] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:30.844416] [INFO ] [MAIN ] SPH: Generated 138 derivative records from 16195 primary records. [2025-10-28T22:18:30.845411] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-28T22:18:30.868685] [DEBUG] [LOCAL ] SPHR: Loaded 40410 existing records from primary storage. [2025-10-28T22:18:30.879931] [INFO ] [MAIN ] SPHR: Loaded 40410 primary data records. [2025-10-28T22:18:30.879736] [DEBUG] [LOCAL ] SPH: Derivative data saved (138 records). [2025-10-28T22:18:30.892339] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-28T22:18:30.902618] [DEBUG] [LOCAL ] SPIR: Loaded 36972 existing records from primary storage. [2025-10-28T22:18:30.920476] [INFO ] [MAIN ] Derivative Progress: 1678/2046 symbols completed. SPH took 0.7s. Estimated remaining: 2m 29s. Rate: 147.9 symbols/min [2025-10-28T22:18:30.927766] [INFO ] [MAIN ] SPIR: Loaded 36972 primary data records. [2025-10-28T22:18:31.540632] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:31.553302] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:31.614278] [INFO ] [MAIN ] SPIR: Generated 138 derivative records from 36972 primary records. [2025-10-28T22:18:31.615522] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-28T22:18:31.624945] [INFO ] [MAIN ] SPHR: Generated 138 derivative records from 40410 primary records. [2025-10-28T22:18:31.626556] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-28T22:18:31.641583] [DEBUG] [LOCAL ] SPIR: Derivative data saved (138 records). [2025-10-28T22:18:31.641522] [DEBUG] [LOCAL ] SPHR: Derivative data saved (138 records). [2025-10-28T22:18:31.641698] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-28T22:18:31.643872] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-28T22:18:31.643790] [INFO ] [MAIN ] Derivative Progress: 1679/2046 symbols completed. SPIR took 0.8s. Estimated remaining: 2m 29s. Rate: 147.9 symbols/min [2025-10-28T22:18:31.646062] [INFO ] [MAIN ] Derivative Progress: 1680/2046 symbols completed. SPHR took 0.9s. Estimated remaining: 2m 28s. Rate: 148.0 symbols/min [2025-10-28T22:18:31.646570] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:31.647021] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:31.646694] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:31.654096] [DEBUG] [LOCAL ] SPMC: Loaded 5174 existing records from primary storage. [2025-10-28T22:18:31.654321] [INFO ] [MAIN ] SPMC: Loaded 5174 primary data records. [2025-10-28T22:18:31.814988] [DEBUG] [LOCAL ] SPXC: Loaded 22782 existing records from primary storage. [2025-10-28T22:18:31.883327] [DEBUG] [LOCAL ] SPNT: Loaded 33898 existing records from primary storage. [2025-10-28T22:18:31.883718] [INFO ] [MAIN ] SPNT: Loaded 33898 primary data records. [2025-10-28T22:18:31.883511] [INFO ] [MAIN ] SPXC: Loaded 22782 primary data records. [2025-10-28T22:18:32.684264] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:32.737191] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:32.768027] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:32.789051] [INFO ] [MAIN ] SPMC: Generated 138 derivative records from 5174 primary records. [2025-10-28T22:18:32.792362] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-28T22:18:32.810376] [DEBUG] [LOCAL ] SPMC: Derivative data saved (138 records). [2025-10-28T22:18:32.810551] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-28T22:18:32.812970] [INFO ] [MAIN ] Derivative Progress: 1681/2046 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 28s. Rate: 147.8 symbols/min [2025-10-28T22:18:32.814034] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:32.836304] [DEBUG] [LOCAL ] SPXX: Loaded 8894 existing records from primary storage. [2025-10-28T22:18:32.842408] [INFO ] [MAIN ] SPXC: Generated 138 derivative records from 22782 primary records. [2025-10-28T22:18:32.842506] [INFO ] [MAIN ] SPXX: Loaded 8894 primary data records. [2025-10-28T22:18:32.842753] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-28T22:18:32.949320] [DEBUG] [LOCAL ] SPXC: Derivative data saved (138 records). [2025-10-28T22:18:32.949448] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-28T22:18:32.970182] [INFO ] [MAIN ] Derivative Progress: 1682/2046 symbols completed. SPXC took 1.3s. Estimated remaining: 2m 28s. Rate: 147.9 symbols/min [2025-10-28T22:18:32.970887] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:33.050104] [INFO ] [MAIN ] SPNT: Generated 138 derivative records from 33898 primary records. [2025-10-28T22:18:33.168525] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-28T22:18:33.184465] [DEBUG] [LOCAL ] SPNT: Derivative data saved (138 records). [2025-10-28T22:18:33.185063] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-28T22:18:33.187945] [INFO ] [MAIN ] Derivative Progress: 1683/2046 symbols completed. SPNT took 1.5s. Estimated remaining: 2m 27s. Rate: 147.9 symbols/min [2025-10-28T22:18:33.188864] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:33.229305] [DEBUG] [LOCAL ] SQM: Loaded 48813 existing records from primary storage. [2025-10-28T22:18:33.229501] [INFO ] [MAIN ] SQM: Loaded 48813 primary data records. [2025-10-28T22:18:33.248214] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:33.374123] [DEBUG] [LOCAL ] SQNS: Loaded 28866 existing records from primary storage. [2025-10-28T22:18:33.423961] [INFO ] [MAIN ] SQNS: Loaded 28866 primary data records. [2025-10-28T22:18:33.894514] [INFO ] [MAIN ] SPXX: Generated 138 derivative records from 8894 primary records. [2025-10-28T22:18:33.895961] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-28T22:18:33.929843] [DEBUG] [LOCAL ] SPXX: Derivative data saved (138 records). [2025-10-28T22:18:33.930422] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-28T22:18:33.932537] [INFO ] [MAIN ] Derivative Progress: 1684/2046 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 27s. Rate: 147.8 symbols/min [2025-10-28T22:18:33.932683] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:33.930351] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:34.001550] [DEBUG] [LOCAL ] SR: Loaded 31980 existing records from primary storage. [2025-10-28T22:18:34.001879] [INFO ] [MAIN ] SR: Loaded 31980 primary data records. [2025-10-28T22:18:34.000943] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:34.127735] [INFO ] [MAIN ] SQM: Generated 138 derivative records from 48813 primary records. [2025-10-28T22:18:34.146046] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-28T22:18:34.327106] [DEBUG] [LOCAL ] SQM: Derivative data saved (138 records). [2025-10-28T22:18:34.338574] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-28T22:18:34.340850] [INFO ] [MAIN ] Derivative Progress: 1685/2046 symbols completed. SQM took 1.4s. Estimated remaining: 2m 27s. Rate: 147.8 symbols/min [2025-10-28T22:18:34.341001] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:34.355914] [INFO ] [MAIN ] SQNS: Generated 138 derivative records from 28866 primary records. [2025-10-28T22:18:34.356180] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-28T22:18:34.370057] [DEBUG] [LOCAL ] SQNS: Derivative data saved (138 records). [2025-10-28T22:18:34.370270] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-28T22:18:34.372473] [INFO ] [MAIN ] Derivative Progress: 1686/2046 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 26s. Rate: 147.9 symbols/min [2025-10-28T22:18:34.372675] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:34.407400] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:34.424226] [DEBUG] [LOCAL ] SREA: Loaded 9491 existing records from primary storage. [2025-10-28T22:18:34.426988] [INFO ] [MAIN ] SREA: Loaded 9491 primary data records. [2025-10-28T22:18:34.457916] [DEBUG] [LOCAL ] SRE: Loaded 53389 existing records from primary storage. [2025-10-28T22:18:34.516984] [INFO ] [MAIN ] SRE: Loaded 53389 primary data records. [2025-10-28T22:18:35.144728] [INFO ] [MAIN ] SR: Generated 138 derivative records from 31980 primary records. [2025-10-28T22:18:35.145420] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-28T22:18:35.158926] [DEBUG] [LOCAL ] SR: Derivative data saved (138 records). [2025-10-28T22:18:35.159190] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-28T22:18:35.161474] [INFO ] [MAIN ] Derivative Progress: 1687/2046 symbols completed. SR took 1.2s. Estimated remaining: 2m 26s. Rate: 147.8 symbols/min [2025-10-28T22:18:35.161845] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:35.180902] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:35.214304] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:35.262872] [DEBUG] [LOCAL ] SRFM: Loaded 40945 existing records from primary storage. [2025-10-28T22:18:35.265478] [INFO ] [MAIN ] SRFM: Loaded 40945 primary data records. [2025-10-28T22:18:35.379527] [INFO ] [MAIN ] SREA: Generated 138 derivative records from 9491 primary records. [2025-10-28T22:18:35.395560] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-28T22:18:35.589047] [INFO ] [MAIN ] SRE: Generated 138 derivative records from 53389 primary records. [2025-10-28T22:18:35.590323] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-28T22:18:35.602937] [DEBUG] [LOCAL ] SREA: Derivative data saved (138 records). [2025-10-28T22:18:35.603217] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-28T22:18:35.605100] [INFO ] [MAIN ] Derivative Progress: 1688/2046 symbols completed. SREA took 1.2s. Estimated remaining: 2m 25s. Rate: 147.8 symbols/min [2025-10-28T22:18:35.605448] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:35.609799] [DEBUG] [LOCAL ] SRE: Derivative data saved (138 records). [2025-10-28T22:18:35.610129] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-28T22:18:35.612441] [INFO ] [MAIN ] Derivative Progress: 1689/2046 symbols completed. SRE took 1.3s. Estimated remaining: 2m 25s. Rate: 147.9 symbols/min [2025-10-28T22:18:35.612746] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:35.625255] [DEBUG] [LOCAL ] SRG: Loaded 14344 existing records from primary storage. [2025-10-28T22:18:35.626847] [INFO ] [MAIN ] SRG: Loaded 14344 primary data records. [2025-10-28T22:18:35.713174] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:35.777771] [DEBUG] [LOCAL ] SRI: Loaded 25711 existing records from primary storage. [2025-10-28T22:18:35.800745] [INFO ] [MAIN ] SRI: Loaded 25711 primary data records. [2025-10-28T22:18:36.303609] [INFO ] [MAIN ] SRFM: Generated 138 derivative records from 40945 primary records. [2025-10-28T22:18:36.304118] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-28T22:18:36.316420] [DEBUG] [LOCAL ] SRFM: Derivative data saved (138 records). [2025-10-28T22:18:36.316554] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-28T22:18:36.318936] [INFO ] [MAIN ] Derivative Progress: 1690/2046 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 24s. Rate: 147.8 symbols/min [2025-10-28T22:18:36.319577] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:36.337289] [DEBUG] [LOCAL ] SRV: Loaded 7158 existing records from primary storage. [2025-10-28T22:18:36.342720] [INFO ] [MAIN ] SRV: Loaded 7158 primary data records. [2025-10-28T22:18:36.343004] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:36.490750] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:36.764817] [INFO ] [MAIN ] SRG: Generated 138 derivative records from 14344 primary records. [2025-10-28T22:18:36.767813] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-28T22:18:36.771743] [INFO ] [MAIN ] SRI: Generated 138 derivative records from 25711 primary records. [2025-10-28T22:18:36.778358] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-28T22:18:36.791572] [DEBUG] [LOCAL ] SRG: Derivative data saved (138 records). [2025-10-28T22:18:36.794554] [DEBUG] [LOCAL ] SRI: Derivative data saved (138 records). [2025-10-28T22:18:36.792775] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-28T22:18:36.796838] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-28T22:18:36.796756] [INFO ] [MAIN ] Derivative Progress: 1691/2046 symbols completed. SRG took 1.2s. Estimated remaining: 2m 24s. Rate: 147.8 symbols/min [2025-10-28T22:18:36.799194] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:36.799613] [INFO ] [MAIN ] Derivative Progress: 1692/2046 symbols completed. SRI took 1.2s. Estimated remaining: 2m 24s. Rate: 147.9 symbols/min [2025-10-28T22:18:36.802272] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:36.816213] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:36.864943] [DEBUG] [LOCAL ] SSD: Loaded 22119 existing records from primary storage. [2025-10-28T22:18:36.865477] [INFO ] [MAIN ] SSD: Loaded 22119 primary data records. [2025-10-28T22:18:36.985965] [INFO ] [MAIN ] SRV: Generated 138 derivative records from 7158 primary records. [2025-10-28T22:18:36.990312] [DEBUG] [LOCAL ] SSB: Loaded 42723 existing records from primary storage. [2025-10-28T22:18:36.990458] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-28T22:18:36.991103] [INFO ] [MAIN ] SSB: Loaded 42723 primary data records. [2025-10-28T22:18:37.261522] [DEBUG] [LOCAL ] SRV: Derivative data saved (138 records). [2025-10-28T22:18:37.273280] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-28T22:18:37.300130] [INFO ] [MAIN ] Derivative Progress: 1693/2046 symbols completed. SRV took 1.0s. Estimated remaining: 2m 23s. Rate: 147.9 symbols/min [2025-10-28T22:18:37.517142] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:37.563691] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:37.582309] [INFO ] [MAIN ] SSD: Generated 138 derivative records from 22119 primary records. [2025-10-28T22:18:37.583885] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-28T22:18:37.600192] [DEBUG] [LOCAL ] SSD: Derivative data saved (138 records). [2025-10-28T22:18:37.601741] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-28T22:18:37.604097] [INFO ] [MAIN ] Derivative Progress: 1694/2046 symbols completed. SSD took 0.8s. Estimated remaining: 2m 23s. Rate: 147.9 symbols/min [2025-10-28T22:18:37.614424] [INFO ] [MAIN ] SSB: Generated 138 derivative records from 42723 primary records. [2025-10-28T22:18:37.614502] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-28T22:18:37.625986] [DEBUG] [LOCAL ] SSB: Derivative data saved (138 records). [2025-10-28T22:18:37.626051] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-28T22:18:37.628207] [INFO ] [MAIN ] Derivative Progress: 1695/2046 symbols completed. SSB took 0.8s. Estimated remaining: 2m 22s. Rate: 148.0 symbols/min [2025-10-28T22:18:37.629108] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:37.628932] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:37.629009] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:37.649077] [DEBUG] [LOCAL ] SST: Loaded 11196 existing records from primary storage. [2025-10-28T22:18:37.649329] [INFO ] [MAIN ] SST: Loaded 11196 primary data records. [2025-10-28T22:18:37.734426] [DEBUG] [LOCAL ] SSTK: Loaded 24677 existing records from primary storage. [2025-10-28T22:18:37.751678] [INFO ] [MAIN ] SSTK: Loaded 24677 primary data records. [2025-10-28T22:18:37.931501] [DEBUG] [LOCAL ] SSL: Loaded 41158 existing records from primary storage. [2025-10-28T22:18:37.955243] [INFO ] [MAIN ] SSL: Loaded 41158 primary data records. [2025-10-28T22:18:38.666712] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:38.695493] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:38.739726] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:38.789283] [INFO ] [MAIN ] SST: Generated 138 derivative records from 11196 primary records. [2025-10-28T22:18:38.791763] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-28T22:18:38.794134] [INFO ] [MAIN ] SSTK: Generated 138 derivative records from 24677 primary records. [2025-10-28T22:18:38.794817] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-28T22:18:38.823775] [DEBUG] [LOCAL ] SSTK: Derivative data saved (138 records). [2025-10-28T22:18:38.823945] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-28T22:18:38.826237] [INFO ] [MAIN ] Derivative Progress: 1696/2046 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 22s. Rate: 147.8 symbols/min [2025-10-28T22:18:38.826511] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:38.828791] [DEBUG] [LOCAL ] SST: Derivative data saved (138 records). [2025-10-28T22:18:38.830998] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-28T22:18:38.833529] [INFO ] [MAIN ] Derivative Progress: 1697/2046 symbols completed. SST took 1.2s. Estimated remaining: 2m 22s. Rate: 147.9 symbols/min [2025-10-28T22:18:38.835096] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:38.838146] [INFO ] [MAIN ] SSL: Generated 138 derivative records from 41158 primary records. [2025-10-28T22:18:38.838624] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-28T22:18:38.850513] [DEBUG] [LOCAL ] SSL: Derivative data saved (138 records). [2025-10-28T22:18:38.850755] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-28T22:18:38.853054] [INFO ] [MAIN ] Derivative Progress: 1698/2046 symbols completed. SSL took 1.2s. Estimated remaining: 2m 21s. Rate: 148.0 symbols/min [2025-10-28T22:18:38.853280] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:38.870172] [DEBUG] [LOCAL ] STC: Loaded 17291 existing records from primary storage. [2025-10-28T22:18:38.870275] [INFO ] [MAIN ] STC: Loaded 17291 primary data records. [2025-10-28T22:18:39.101128] [DEBUG] [LOCAL ] STAG: Loaded 49968 existing records from primary storage. [2025-10-28T22:18:39.101220] [DEBUG] [LOCAL ] ST: Loaded 49565 existing records from primary storage. [2025-10-28T22:18:39.101435] [INFO ] [MAIN ] ST: Loaded 49565 primary data records. [2025-10-28T22:18:39.101524] [INFO ] [MAIN ] STAG: Loaded 49968 primary data records. [2025-10-28T22:18:39.846835] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:39.892991] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:39.915203] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:39.964637] [INFO ] [MAIN ] STC: Generated 138 derivative records from 17291 primary records. [2025-10-28T22:18:39.967099] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-28T22:18:39.989206] [DEBUG] [LOCAL ] STC: Derivative data saved (138 records). [2025-10-28T22:18:39.989976] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-28T22:18:39.992245] [INFO ] [MAIN ] Derivative Progress: 1699/2046 symbols completed. STC took 1.1s. Estimated remaining: 2m 21s. Rate: 147.8 symbols/min [2025-10-28T22:18:39.996342] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:39.996530] [INFO ] [MAIN ] STAG: Generated 138 derivative records from 49968 primary records. [2025-10-28T22:18:39.999374] [INFO ] [MAIN ] ST: Generated 138 derivative records from 49565 primary records. [2025-10-28T22:18:39.999519] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-28T22:18:39.999614] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-28T22:18:40.021614] [DEBUG] [LOCAL ] STAG: Derivative data saved (138 records). [2025-10-28T22:18:40.024385] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-28T22:18:40.026542] [INFO ] [MAIN ] Derivative Progress: 1700/2046 symbols completed. STAG took 1.2s. Estimated remaining: 2m 20s. Rate: 147.9 symbols/min [2025-10-28T22:18:40.027047] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:40.027351] [DEBUG] [LOCAL ] ST: Derivative data saved (138 records). [2025-10-28T22:18:40.027780] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-28T22:18:40.031007] [INFO ] [MAIN ] Derivative Progress: 1701/2046 symbols completed. ST took 1.2s. Estimated remaining: 2m 20s. Rate: 148.0 symbols/min [2025-10-28T22:18:40.031272] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:40.058705] [DEBUG] [LOCAL ] STEL: Loaded 21774 existing records from primary storage. [2025-10-28T22:18:40.058900] [INFO ] [MAIN ] STEL: Loaded 21774 primary data records. [2025-10-28T22:18:40.176402] [DEBUG] [LOCAL ] STE: Loaded 34715 existing records from primary storage. [2025-10-28T22:18:40.198634] [INFO ] [MAIN ] STE: Loaded 34715 primary data records. [2025-10-28T22:18:40.199887] [DEBUG] [LOCAL ] STEM: Loaded 38006 existing records from primary storage. [2025-10-28T22:18:40.230870] [INFO ] [MAIN ] STEM: Loaded 38006 primary data records. [2025-10-28T22:18:41.078727] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:41.116922] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:41.143463] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:41.190995] [INFO ] [MAIN ] STEL: Generated 138 derivative records from 21774 primary records. [2025-10-28T22:18:41.192707] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-28T22:18:41.211297] [DEBUG] [LOCAL ] STEL: Derivative data saved (138 records). [2025-10-28T22:18:41.211895] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-28T22:18:41.214721] [INFO ] [MAIN ] Derivative Progress: 1702/2046 symbols completed. STEL took 1.2s. Estimated remaining: 2m 20s. Rate: 147.8 symbols/min [2025-10-28T22:18:41.217577] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:41.222907] [INFO ] [MAIN ] STE: Generated 138 derivative records from 34715 primary records. [2025-10-28T22:18:41.223271] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-28T22:18:41.225784] [INFO ] [MAIN ] STEM: Generated 138 derivative records from 38006 primary records. [2025-10-28T22:18:41.225894] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-28T22:18:41.259859] [DEBUG] [LOCAL ] STEM: Derivative data saved (138 records). [2025-10-28T22:18:41.252024] [DEBUG] [LOCAL ] STE: Derivative data saved (138 records). [2025-10-28T22:18:41.260379] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-28T22:18:41.260183] [DEBUG] [LOCAL ] STEW: Loaded 14525 existing records from primary storage. [2025-10-28T22:18:41.262902] [INFO ] [MAIN ] Derivative Progress: 1703/2046 symbols completed. STE took 1.3s. Estimated remaining: 2m 19s. Rate: 147.9 symbols/min [2025-10-28T22:18:41.263062] [INFO ] [MAIN ] STEW: Loaded 14525 primary data records. [2025-10-28T22:18:41.263193] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-28T22:18:41.286276] [INFO ] [MAIN ] Derivative Progress: 1704/2046 symbols completed. STEM took 1.3s. Estimated remaining: 2m 19s. Rate: 148.0 symbols/min [2025-10-28T22:18:41.283967] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:41.300386] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:41.451318] [DEBUG] [LOCAL ] STK: Loaded 9462 existing records from primary storage. [2025-10-28T22:18:41.451549] [INFO ] [MAIN ] STK: Loaded 9462 primary data records. [2025-10-28T22:18:41.917358] [DEBUG] [LOCAL ] STLA: Loaded 53547 existing records from primary storage. [2025-10-28T22:18:41.918673] [INFO ] [MAIN ] STLA: Loaded 53547 primary data records. [2025-10-28T22:18:42.250880] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:42.286677] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:42.332635] [INFO ] [MAIN ] STEW: Generated 138 derivative records from 14525 primary records. [2025-10-28T22:18:42.333772] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-28T22:18:42.365670] [DEBUG] [LOCAL ] STEW: Derivative data saved (138 records). [2025-10-28T22:18:42.365463] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:42.376835] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-28T22:18:42.382959] [INFO ] [MAIN ] Derivative Progress: 1705/2046 symbols completed. STEW took 1.2s. Estimated remaining: 2m 18s. Rate: 147.8 symbols/min [2025-10-28T22:18:42.386021] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:42.392954] [INFO ] [MAIN ] STK: Generated 138 derivative records from 9462 primary records. [2025-10-28T22:18:42.396548] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-28T22:18:42.413978] [DEBUG] [LOCAL ] STK: Derivative data saved (138 records). [2025-10-28T22:18:42.414202] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-28T22:18:42.416951] [INFO ] [MAIN ] Derivative Progress: 1706/2046 symbols completed. STK took 1.1s. Estimated remaining: 2m 18s. Rate: 147.9 symbols/min [2025-10-28T22:18:42.417318] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:42.435577] [INFO ] [MAIN ] STLA: Generated 138 derivative records from 53547 primary records. [2025-10-28T22:18:42.447959] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-28T22:18:42.461022] [DEBUG] [LOCAL ] STLA: Derivative data saved (138 records). [2025-10-28T22:18:42.461251] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-28T22:18:42.463520] [INFO ] [MAIN ] Derivative Progress: 1707/2046 symbols completed. STLA took 1.2s. Estimated remaining: 2m 17s. Rate: 148.0 symbols/min [2025-10-28T22:18:42.471045] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:42.472092] [DEBUG] [LOCAL ] STN: Loaded 22015 existing records from primary storage. [2025-10-28T22:18:42.472874] [INFO ] [MAIN ] STN: Loaded 22015 primary data records. [2025-10-28T22:18:42.569703] [DEBUG] [LOCAL ] STM: Loaded 53571 existing records from primary storage. [2025-10-28T22:18:42.591472] [INFO ] [MAIN ] STM: Loaded 53571 primary data records. [2025-10-28T22:18:42.929508] [DEBUG] [LOCAL ] STNG: Loaded 42894 existing records from primary storage. [2025-10-28T22:18:42.940260] [INFO ] [MAIN ] STNG: Loaded 42894 primary data records. [2025-10-28T22:18:43.491600] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:43.532215] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:43.569718] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:43.608413] [INFO ] [MAIN ] STN: Generated 138 derivative records from 22015 primary records. [2025-10-28T22:18:43.610927] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-28T22:18:43.630485] [DEBUG] [LOCAL ] STN: Derivative data saved (138 records). [2025-10-28T22:18:43.632994] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-28T22:18:43.635363] [INFO ] [MAIN ] Derivative Progress: 1708/2046 symbols completed. STN took 1.2s. Estimated remaining: 2m 17s. Rate: 147.8 symbols/min [2025-10-28T22:18:43.648810] [INFO ] [MAIN ] STM: Generated 138 derivative records from 53571 primary records. [2025-10-28T22:18:43.650153] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-28T22:18:43.661280] [INFO ] [MAIN ] STNG: Generated 138 derivative records from 42894 primary records. [2025-10-28T22:18:43.663486] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-28T22:18:43.680494] [DEBUG] [LOCAL ] STNG: Derivative data saved (138 records). [2025-10-28T22:18:43.680424] [DEBUG] [LOCAL ] STM: Derivative data saved (138 records). [2025-10-28T22:18:43.680626] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-28T22:18:43.683514] [INFO ] [MAIN ] Derivative Progress: 1709/2046 symbols completed. STNG took 1.2s. Estimated remaining: 2m 17s. Rate: 147.9 symbols/min [2025-10-28T22:18:43.683681] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-28T22:18:43.686334] [INFO ] [MAIN ] Derivative Progress: 1710/2046 symbols completed. STM took 1.3s. Estimated remaining: 2m 16s. Rate: 148.0 symbols/min [2025-10-28T22:18:43.686807] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:43.686888] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:43.686747] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:43.699947] [DEBUG] [LOCAL ] STRV: Loaded 10231 existing records from primary storage. [2025-10-28T22:18:43.708309] [INFO ] [MAIN ] STRV: Loaded 10231 primary data records. [2025-10-28T22:18:43.848430] [DEBUG] [LOCAL ] STVN: Loaded 26335 existing records from primary storage. [2025-10-28T22:18:43.858995] [INFO ] [MAIN ] STVN: Loaded 26335 primary data records. [2025-10-28T22:18:44.145807] [DEBUG] [LOCAL ] STT: Loaded 51107 existing records from primary storage. [2025-10-28T22:18:44.158011] [INFO ] [MAIN ] STT: Loaded 51107 primary data records. [2025-10-28T22:18:44.689922] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:44.735032] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:44.771184] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:44.785279] [INFO ] [MAIN ] STRV: Generated 138 derivative records from 10231 primary records. [2025-10-28T22:18:44.788834] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-28T22:18:44.804423] [DEBUG] [LOCAL ] STRV: Derivative data saved (138 records). [2025-10-28T22:18:44.804528] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-28T22:18:44.810403] [INFO ] [MAIN ] Derivative Progress: 1711/2046 symbols completed. STRV took 1.1s. Estimated remaining: 2m 16s. Rate: 147.8 symbols/min [2025-10-28T22:18:44.813790] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:44.833672] [INFO ] [MAIN ] STVN: Generated 138 derivative records from 26335 primary records. [2025-10-28T22:18:44.834830] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-28T22:18:44.837766] [INFO ] [MAIN ] STT: Generated 138 derivative records from 51107 primary records. [2025-10-28T22:18:44.837933] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-28T22:18:44.860323] [DEBUG] [LOCAL ] STT: Derivative data saved (138 records). [2025-10-28T22:18:44.861266] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-28T22:18:44.864014] [INFO ] [MAIN ] Derivative Progress: 1712/2046 symbols completed. STT took 1.2s. Estimated remaining: 2m 15s. Rate: 147.9 symbols/min [2025-10-28T22:18:44.864703] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:44.879202] [DEBUG] [LOCAL ] STVN: Derivative data saved (138 records). [2025-10-28T22:18:44.879388] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-28T22:18:44.881403] [INFO ] [MAIN ] Derivative Progress: 1713/2046 symbols completed. STVN took 1.2s. Estimated remaining: 2m 15s. Rate: 148.0 symbols/min [2025-10-28T22:18:44.883487] [DEBUG] [LOCAL ] STXD: Loaded 1277 existing records from primary storage. [2025-10-28T22:18:44.883627] [INFO ] [MAIN ] STXD: Loaded 1277 primary data records. [2025-10-28T22:18:44.883763] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:45.004344] [DEBUG] [LOCAL ] STWD: Loaded 51924 existing records from primary storage. [2025-10-28T22:18:45.045991] [INFO ] [MAIN ] STWD: Loaded 51924 primary data records. [2025-10-28T22:18:45.033093] [DEBUG] [LOCAL ] STXE: Loaded 2010 existing records from primary storage. [2025-10-28T22:18:45.078332] [INFO ] [MAIN ] STXE: Loaded 2010 primary data records. [2025-10-28T22:18:45.842385] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:45.901046] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:45.900173] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:45.955667] [INFO ] [MAIN ] STXD: Generated 138 derivative records from 1277 primary records. [2025-10-28T22:18:45.956199] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-28T22:18:45.968189] [DEBUG] [LOCAL ] STXD: Derivative data saved (138 records). [2025-10-28T22:18:45.970423] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-28T22:18:45.972715] [INFO ] [MAIN ] Derivative Progress: 1714/2046 symbols completed. STXD took 1.1s. Estimated remaining: 2m 15s. Rate: 147.9 symbols/min [2025-10-28T22:18:45.972866] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:45.981359] [DEBUG] [LOCAL ] STXG: Loaded 2178 existing records from primary storage. [2025-10-28T22:18:45.981516] [INFO ] [MAIN ] STXG: Loaded 2178 primary data records. [2025-10-28T22:18:46.090791] [INFO ] [MAIN ] STWD: Generated 138 derivative records from 51924 primary records. [2025-10-28T22:18:46.091202] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-28T22:18:46.132065] [INFO ] [MAIN ] STXE: Generated 138 derivative records from 2010 primary records. [2025-10-28T22:18:46.140428] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-28T22:18:46.326113] [DEBUG] [LOCAL ] STWD: Derivative data saved (138 records). [2025-10-28T22:18:46.326269] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-28T22:18:46.324878] [DEBUG] [LOCAL ] STXE: Derivative data saved (138 records). [2025-10-28T22:18:46.328671] [INFO ] [MAIN ] Derivative Progress: 1715/2046 symbols completed. STWD took 1.5s. Estimated remaining: 2m 14s. Rate: 147.9 symbols/min [2025-10-28T22:18:46.328814] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:46.329326] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-28T22:18:46.332149] [INFO ] [MAIN ] Derivative Progress: 1716/2046 symbols completed. STXE took 1.4s. Estimated remaining: 2m 14s. Rate: 147.9 symbols/min [2025-10-28T22:18:46.332469] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:46.339927] [DEBUG] [LOCAL ] STXT: Loaded 2505 existing records from primary storage. [2025-10-28T22:18:46.337953] [DEBUG] [LOCAL ] STXV: Loaded 1421 existing records from primary storage. [2025-10-28T22:18:46.340069] [INFO ] [MAIN ] STXV: Loaded 1421 primary data records. [2025-10-28T22:18:46.340172] [INFO ] [MAIN ] STXT: Loaded 2505 primary data records. [2025-10-28T22:18:46.988612] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:47.033870] [INFO ] [MAIN ] STXG: Generated 138 derivative records from 2178 primary records. [2025-10-28T22:18:47.035668] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-28T22:18:47.060394] [DEBUG] [LOCAL ] STXG: Derivative data saved (138 records). [2025-10-28T22:18:47.060868] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-28T22:18:47.062980] [INFO ] [MAIN ] Derivative Progress: 1717/2046 symbols completed. STXG took 1.1s. Estimated remaining: 2m 13s. Rate: 147.9 symbols/min [2025-10-28T22:18:47.060780] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:47.086396] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:47.090629] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:18:47.155715] [INFO ] [MAIN ] STXV: Generated 138 derivative records from 1421 primary records. [2025-10-28T22:18:47.156041] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-28T22:18:47.158382] [INFO ] [MAIN ] STXT: Generated 138 derivative records from 2505 primary records. [2025-10-28T22:18:47.166086] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-28T22:18:47.192092] [DEBUG] [LOCAL ] STXT: Derivative data saved (138 records). [2025-10-28T22:18:47.192357] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-28T22:18:47.192182] [DEBUG] [LOCAL ] STXV: Derivative data saved (138 records). [2025-10-28T22:18:47.193360] [DEBUG] [LOCAL ] STZ: Loaded 52384 existing records from primary storage. [2025-10-28T22:18:47.195798] [INFO ] [MAIN ] Derivative Progress: 1718/2046 symbols completed. STXT took 0.9s. Estimated remaining: 2m 13s. Rate: 147.9 symbols/min [2025-10-28T22:18:47.196042] [INFO ] [MAIN ] STZ: Loaded 52384 primary data records. [2025-10-28T22:18:47.195973] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:47.196250] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-28T22:18:47.199258] [INFO ] [MAIN ] Derivative Progress: 1719/2046 symbols completed. STXV took 0.9s. Estimated remaining: 2m 13s. Rate: 148.0 symbols/min [2025-10-28T22:18:47.223426] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:47.572297] [DEBUG] [LOCAL ] SU: Loaded 53420 existing records from primary storage. [2025-10-28T22:18:47.572689] [INFO ] [MAIN ] SU: Loaded 53420 primary data records. [2025-10-28T22:18:47.573345] [DEBUG] [LOCAL ] SUI: Loaded 41481 existing records from primary storage. [2025-10-28T22:18:47.584792] [INFO ] [MAIN ] SUI: Loaded 41481 primary data records. [2025-10-28T22:18:48.198681] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:48.251498] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:48.289295] [INFO ] [MAIN ] STZ: Generated 138 derivative records from 52384 primary records. [2025-10-28T22:18:48.303112] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-28T22:18:48.307580] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:48.347557] [DEBUG] [LOCAL ] STZ: Derivative data saved (138 records). [2025-10-28T22:18:48.354944] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-28T22:18:48.363989] [INFO ] [MAIN ] Derivative Progress: 1720/2046 symbols completed. STZ took 1.3s. Estimated remaining: 2m 12s. Rate: 147.9 symbols/min [2025-10-28T22:18:48.366180] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:48.381097] [INFO ] [MAIN ] SU: Generated 138 derivative records from 53420 primary records. [2025-10-28T22:18:48.381308] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-28T22:18:48.397409] [DEBUG] [LOCAL ] SU: Derivative data saved (138 records). [2025-10-28T22:18:48.408079] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-28T22:18:48.410324] [INFO ] [MAIN ] Derivative Progress: 1721/2046 symbols completed. SU took 1.2s. Estimated remaining: 2m 12s. Rate: 147.9 symbols/min [2025-10-28T22:18:48.412637] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:48.412539] [INFO ] [MAIN ] SUI: Generated 138 derivative records from 41481 primary records. [2025-10-28T22:18:48.413282] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-28T22:18:48.425369] [DEBUG] [LOCAL ] SUI: Derivative data saved (138 records). [2025-10-28T22:18:48.426305] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-28T22:18:48.428911] [INFO ] [MAIN ] Derivative Progress: 1722/2046 symbols completed. SUI took 1.2s. Estimated remaining: 2m 11s. Rate: 148.0 symbols/min [2025-10-28T22:18:48.429196] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:48.441924] [DEBUG] [LOCAL ] SUN: Loaded 38673 existing records from primary storage. [2025-10-28T22:18:48.442224] [INFO ] [MAIN ] SUN: Loaded 38673 primary data records. [2025-10-28T22:18:48.782618] [DEBUG] [LOCAL ] SUPV: Loaded 48124 existing records from primary storage. [2025-10-28T22:18:48.783518] [INFO ] [MAIN ] SUPV: Loaded 48124 primary data records. [2025-10-28T22:18:48.825769] [DEBUG] [LOCAL ] SUZ: Loaded 45209 existing records from primary storage. [2025-10-28T22:18:48.837130] [INFO ] [MAIN ] SUZ: Loaded 45209 primary data records. [2025-10-28T22:18:49.515635] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:49.558734] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:49.602269] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:49.605777] [INFO ] [MAIN ] SUN: Generated 138 derivative records from 38673 primary records. [2025-10-28T22:18:49.617609] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-28T22:18:49.638474] [DEBUG] [LOCAL ] SUN: Derivative data saved (138 records). [2025-10-28T22:18:49.640687] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-28T22:18:49.643158] [INFO ] [MAIN ] Derivative Progress: 1723/2046 symbols completed. SUN took 1.3s. Estimated remaining: 2m 11s. Rate: 147.8 symbols/min [2025-10-28T22:18:49.668013] [INFO ] [MAIN ] SUPV: Generated 138 derivative records from 48124 primary records. [2025-10-28T22:18:49.668196] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-28T22:18:49.685337] [DEBUG] [LOCAL ] SUPV: Derivative data saved (138 records). [2025-10-28T22:18:49.685432] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-28T22:18:49.687440] [INFO ] [MAIN ] Derivative Progress: 1724/2046 symbols completed. SUPV took 1.3s. Estimated remaining: 2m 11s. Rate: 147.9 symbols/min [2025-10-28T22:18:49.690605] [INFO ] [MAIN ] SUZ: Generated 138 derivative records from 45209 primary records. [2025-10-28T22:18:49.690848] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-28T22:18:49.703478] [DEBUG] [LOCAL ] SUZ: Derivative data saved (138 records). [2025-10-28T22:18:49.703558] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-28T22:18:49.707338] [INFO ] [MAIN ] Derivative Progress: 1725/2046 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 10s. Rate: 148.0 symbols/min [2025-10-28T22:18:49.708162] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:49.708062] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:49.708244] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:49.768815] [DEBUG] [LOCAL ] SVV: Loaded 40038 existing records from primary storage. [2025-10-28T22:18:49.768960] [INFO ] [MAIN ] SVV: Loaded 40038 primary data records. [2025-10-28T22:18:49.900541] [DEBUG] [LOCAL ] SW: Loaded 53172 existing records from primary storage. [2025-10-28T22:18:49.900778] [INFO ] [MAIN ] SW: Loaded 53172 primary data records. [2025-10-28T22:18:49.947927] [DEBUG] [LOCAL ] SWK: Loaded 52301 existing records from primary storage. [2025-10-28T22:18:49.982390] [INFO ] [MAIN ] SWK: Loaded 52301 primary data records. [2025-10-28T22:18:50.775356] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:50.816469] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:50.850343] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:50.904517] [INFO ] [MAIN ] SVV: Generated 138 derivative records from 40038 primary records. [2025-10-28T22:18:50.911276] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-28T22:18:50.928260] [DEBUG] [LOCAL ] SVV: Derivative data saved (138 records). [2025-10-28T22:18:50.930047] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-28T22:18:50.932738] [INFO ] [MAIN ] Derivative Progress: 1726/2046 symbols completed. SVV took 1.2s. Estimated remaining: 2m 10s. Rate: 147.8 symbols/min [2025-10-28T22:18:50.937252] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:50.940929] [INFO ] [MAIN ] SW: Generated 138 derivative records from 53172 primary records. [2025-10-28T22:18:50.941210] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-28T22:18:50.959116] [DEBUG] [LOCAL ] SW: Derivative data saved (138 records). [2025-10-28T22:18:50.959763] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-28T22:18:50.959511] [INFO ] [MAIN ] SWK: Generated 138 derivative records from 52301 primary records. [2025-10-28T22:18:50.962134] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-28T22:18:50.961926] [INFO ] [MAIN ] Derivative Progress: 1727/2046 symbols completed. SW took 1.3s. Estimated remaining: 2m 9s. Rate: 147.9 symbols/min [2025-10-28T22:18:50.963230] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:50.976348] [DEBUG] [LOCAL ] SWK: Derivative data saved (138 records). [2025-10-28T22:18:50.976751] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-28T22:18:50.980906] [INFO ] [MAIN ] Derivative Progress: 1728/2046 symbols completed. SWK took 1.3s. Estimated remaining: 2m 9s. Rate: 148.0 symbols/min [2025-10-28T22:18:50.989254] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:50.993579] [DEBUG] [LOCAL ] SWZ: Loaded 5859 existing records from primary storage. [2025-10-28T22:18:50.993757] [INFO ] [MAIN ] SWZ: Loaded 5859 primary data records. [2025-10-28T22:18:51.108144] [DEBUG] [LOCAL ] SWX: Loaded 29970 existing records from primary storage. [2025-10-28T22:18:51.135490] [INFO ] [MAIN ] SWX: Loaded 29970 primary data records. [2025-10-28T22:18:51.464203] [DEBUG] [LOCAL ] SXC: Loaded 41215 existing records from primary storage. [2025-10-28T22:18:51.514870] [INFO ] [MAIN ] SXC: Loaded 41215 primary data records. [2025-10-28T22:18:51.983607] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:52.019250] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:52.073224] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:52.111301] [INFO ] [MAIN ] SWX: Generated 138 derivative records from 29970 primary records. [2025-10-28T22:18:52.114878] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-28T22:18:52.115114] [INFO ] [MAIN ] SWZ: Generated 138 derivative records from 5859 primary records. [2025-10-28T22:18:52.116174] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-28T22:18:52.138064] [DEBUG] [LOCAL ] SWX: Derivative data saved (138 records). [2025-10-28T22:18:52.140261] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-28T22:18:52.144852] [INFO ] [MAIN ] Derivative Progress: 1729/2046 symbols completed. SWX took 1.2s. Estimated remaining: 2m 9s. Rate: 147.8 symbols/min [2025-10-28T22:18:52.142772] [DEBUG] [LOCAL ] SWZ: Derivative data saved (138 records). [2025-10-28T22:18:52.145386] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-28T22:18:52.147444] [INFO ] [MAIN ] Derivative Progress: 1730/2046 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 8s. Rate: 147.9 symbols/min [2025-10-28T22:18:52.145282] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:52.147821] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:52.160625] [INFO ] [MAIN ] SXC: Generated 138 derivative records from 41215 primary records. [2025-10-28T22:18:52.160925] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-28T22:18:52.184705] [DEBUG] [LOCAL ] SXC: Derivative data saved (138 records). [2025-10-28T22:18:52.185064] [DEBUG] [LOCAL ] SXI: Loaded 11886 existing records from primary storage. [2025-10-28T22:18:52.185246] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-28T22:18:52.187893] [INFO ] [MAIN ] Derivative Progress: 1731/2046 symbols completed. SXC took 1.2s. Estimated remaining: 2m 8s. Rate: 148.0 symbols/min [2025-10-28T22:18:52.188056] [INFO ] [MAIN ] SXI: Loaded 11886 primary data records. [2025-10-28T22:18:52.188209] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:52.273935] [DEBUG] [LOCAL ] SXT: Loaded 29296 existing records from primary storage. [2025-10-28T22:18:52.290578] [INFO ] [MAIN ] SXT: Loaded 29296 primary data records. [2025-10-28T22:18:52.708229] [DEBUG] [LOCAL ] SYF: Loaded 53443 existing records from primary storage. [2025-10-28T22:18:52.818003] [INFO ] [MAIN ] SYF: Loaded 53443 primary data records. [2025-10-28T22:18:53.210280] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:53.246919] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:53.294100] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:53.318551] [INFO ] [MAIN ] SXI: Generated 138 derivative records from 11886 primary records. [2025-10-28T22:18:53.318735] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-28T22:18:53.339712] [DEBUG] [LOCAL ] SXI: Derivative data saved (138 records). [2025-10-28T22:18:53.342997] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-28T22:18:53.345122] [INFO ] [MAIN ] Derivative Progress: 1732/2046 symbols completed. SXI took 1.2s. Estimated remaining: 2m 7s. Rate: 147.8 symbols/min [2025-10-28T22:18:53.345380] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:53.363265] [INFO ] [MAIN ] SXT: Generated 138 derivative records from 29296 primary records. [2025-10-28T22:18:53.365382] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-28T22:18:53.365749] [INFO ] [MAIN ] SYF: Generated 138 derivative records from 53443 primary records. [2025-10-28T22:18:53.366428] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-28T22:18:53.389424] [DEBUG] [LOCAL ] SYF: Derivative data saved (138 records). [2025-10-28T22:18:53.391670] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-28T22:18:53.394176] [INFO ] [MAIN ] Derivative Progress: 1733/2046 symbols completed. SYF took 1.2s. Estimated remaining: 2m 7s. Rate: 147.9 symbols/min [2025-10-28T22:18:53.391499] [DEBUG] [LOCAL ] SXT: Derivative data saved (138 records). [2025-10-28T22:18:53.394388] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-28T22:18:53.394555] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:53.396943] [INFO ] [MAIN ] Derivative Progress: 1734/2046 symbols completed. SXT took 1.2s. Estimated remaining: 2m 6s. Rate: 148.0 symbols/min [2025-10-28T22:18:53.397988] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:53.429982] [DEBUG] [LOCAL ] SYK: Loaded 46629 existing records from primary storage. [2025-10-28T22:18:53.430290] [INFO ] [MAIN ] SYK: Loaded 46629 primary data records. [2025-10-28T22:18:53.759146] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-28T22:18:53.773127] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-28T22:18:53.794917] [DEBUG] [LOCAL ] SYY: Loaded 53196 existing records from primary storage. [2025-10-28T22:18:53.811010] [INFO ] [MAIN ] SYY: Loaded 53196 primary data records. [2025-10-28T22:18:54.423928] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:54.470905] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:54.505666] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:54.531424] [INFO ] [MAIN ] SYK: Generated 138 derivative records from 46629 primary records. [2025-10-28T22:18:54.536722] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-28T22:18:54.552886] [DEBUG] [LOCAL ] SYK: Derivative data saved (138 records). [2025-10-28T22:18:54.554359] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-28T22:18:54.556899] [INFO ] [MAIN ] Derivative Progress: 1735/2046 symbols completed. SYK took 1.2s. Estimated remaining: 2m 6s. Rate: 147.8 symbols/min [2025-10-28T22:18:54.557370] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:54.571371] [INFO ] [MAIN ] T: Generated 138 derivative records from 53798 primary records. [2025-10-28T22:18:54.572396] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-28T22:18:54.588236] [DEBUG] [LOCAL ] T: Derivative data saved (138 records). [2025-10-28T22:18:54.588388] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-28T22:18:54.590482] [INFO ] [MAIN ] Derivative Progress: 1736/2046 symbols completed. T took 1.2s. Estimated remaining: 2m 6s. Rate: 147.9 symbols/min [2025-10-28T22:18:54.590871] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:54.594532] [INFO ] [MAIN ] SYY: Generated 138 derivative records from 53196 primary records. [2025-10-28T22:18:54.604294] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-28T22:18:54.616429] [DEBUG] [LOCAL ] SYY: Derivative data saved (138 records). [2025-10-28T22:18:54.616499] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-28T22:18:54.619287] [INFO ] [MAIN ] Derivative Progress: 1737/2046 symbols completed. SYY took 1.2s. Estimated remaining: 2m 5s. Rate: 148.0 symbols/min [2025-10-28T22:18:54.619501] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:54.633816] [DEBUG] [LOCAL ] TAC: Loaded 43456 existing records from primary storage. [2025-10-28T22:18:54.633951] [INFO ] [MAIN ] TAC: Loaded 43456 primary data records. [2025-10-28T22:18:54.850947] [DEBUG] [LOCAL ] TAK: Loaded 50143 existing records from primary storage. [2025-10-28T22:18:54.969619] [INFO ] [MAIN ] TAK: Loaded 50143 primary data records. [2025-10-28T22:18:55.078856] [DEBUG] [LOCAL ] TAL: Loaded 51637 existing records from primary storage. [2025-10-28T22:18:55.090427] [INFO ] [MAIN ] TAL: Loaded 51637 primary data records. [2025-10-28T22:18:55.662597] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:55.713038] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:55.746709] [INFO ] [MAIN ] TAC: Generated 138 derivative records from 43456 primary records. [2025-10-28T22:18:55.744139] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:55.747003] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-28T22:18:55.778583] [DEBUG] [LOCAL ] TAC: Derivative data saved (138 records). [2025-10-28T22:18:55.781207] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-28T22:18:55.787725] [INFO ] [MAIN ] Derivative Progress: 1738/2046 symbols completed. TAC took 1.2s. Estimated remaining: 2m 5s. Rate: 147.8 symbols/min [2025-10-28T22:18:55.807170] [INFO ] [MAIN ] TAK: Generated 138 derivative records from 50143 primary records. [2025-10-28T22:18:55.807566] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-28T22:18:55.821119] [INFO ] [MAIN ] TAL: Generated 138 derivative records from 51637 primary records. [2025-10-28T22:18:55.822340] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-28T22:18:55.822598] [DEBUG] [LOCAL ] TAK: Derivative data saved (138 records). [2025-10-28T22:18:55.823134] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-28T22:18:55.825270] [INFO ] [MAIN ] Derivative Progress: 1739/2046 symbols completed. TAK took 1.2s. Estimated remaining: 2m 5s. Rate: 147.9 symbols/min [2025-10-28T22:18:55.837094] [DEBUG] [LOCAL ] TAL: Derivative data saved (138 records). [2025-10-28T22:18:55.837154] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-28T22:18:55.839569] [INFO ] [MAIN ] Derivative Progress: 1740/2046 symbols completed. TAL took 1.2s. Estimated remaining: 2m 4s. Rate: 148.0 symbols/min [2025-10-28T22:18:55.839946] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:55.840123] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:55.840013] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:55.852609] [DEBUG] [LOCAL ] TBB: Loaded 11036 existing records from primary storage. [2025-10-28T22:18:55.853122] [INFO ] [MAIN ] TBB: Loaded 11036 primary data records. [2025-10-28T22:18:56.173032] [DEBUG] [LOCAL ] TALO: Loaded 50889 existing records from primary storage. [2025-10-28T22:18:56.190494] [INFO ] [MAIN ] TALO: Loaded 50889 primary data records. [2025-10-28T22:18:56.303522] [DEBUG] [LOCAL ] TAP: Loaded 52933 existing records from primary storage. [2025-10-28T22:18:56.317834] [INFO ] [MAIN ] TAP: Loaded 52933 primary data records. [2025-10-28T22:18:56.863216] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:56.908379] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:56.941176] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:56.966102] [INFO ] [MAIN ] TBB: Generated 138 derivative records from 11036 primary records. [2025-10-28T22:18:56.971147] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-28T22:18:56.995386] [DEBUG] [LOCAL ] TBB: Derivative data saved (138 records). [2025-10-28T22:18:56.996293] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-28T22:18:56.998950] [INFO ] [MAIN ] Derivative Progress: 1741/2046 symbols completed. TBB took 1.2s. Estimated remaining: 2m 4s. Rate: 147.8 symbols/min [2025-10-28T22:18:57.001946] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:57.026737] [INFO ] [MAIN ] TAP: Generated 138 derivative records from 52933 primary records. [2025-10-28T22:18:57.026313] [INFO ] [MAIN ] TALO: Generated 138 derivative records from 50889 primary records. [2025-10-28T22:18:57.027034] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-28T22:18:57.026944] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-28T22:18:57.060376] [DEBUG] [LOCAL ] TALO: Derivative data saved (138 records). [2025-10-28T22:18:57.060841] [DEBUG] [LOCAL ] TAP: Derivative data saved (138 records). [2025-10-28T22:18:57.060978] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-28T22:18:57.063244] [INFO ] [MAIN ] Derivative Progress: 1742/2046 symbols completed. TALO took 1.2s. Estimated remaining: 2m 3s. Rate: 147.9 symbols/min [2025-10-28T22:18:57.063409] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-28T22:18:57.063527] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:57.066777] [INFO ] [MAIN ] Derivative Progress: 1743/2046 symbols completed. TAP took 1.2s. Estimated remaining: 2m 3s. Rate: 148.0 symbols/min [2025-10-28T22:18:57.076276] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:57.079171] [DEBUG] [LOCAL ] TBBB: Loaded 35261 existing records from primary storage. [2025-10-28T22:18:57.079404] [INFO ] [MAIN ] TBBB: Loaded 35261 primary data records. [2025-10-28T22:18:57.152432] [DEBUG] [LOCAL ] TBN: Loaded 4506 existing records from primary storage. [2025-10-28T22:18:57.163961] [INFO ] [MAIN ] TBN: Loaded 4506 primary data records. [2025-10-28T22:18:57.316908] [DEBUG] [LOCAL ] TBI: Loaded 22409 existing records from primary storage. [2025-10-28T22:18:57.384601] [INFO ] [MAIN ] TBI: Loaded 22409 primary data records. [2025-10-28T22:18:58.045786] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:58.075565] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:58.116553] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:58.164730] [INFO ] [MAIN ] TBBB: Generated 138 derivative records from 35261 primary records. [2025-10-28T22:18:58.166554] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-28T22:18:58.180984] [DEBUG] [LOCAL ] TBBB: Derivative data saved (138 records). [2025-10-28T22:18:58.186334] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-28T22:18:58.189530] [INFO ] [MAIN ] Derivative Progress: 1744/2046 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 3s. Rate: 147.8 symbols/min [2025-10-28T22:18:58.190091] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:58.192505] [INFO ] [MAIN ] TBN: Generated 138 derivative records from 4506 primary records. [2025-10-28T22:18:58.193882] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-28T22:18:58.210620] [DEBUG] [LOCAL ] TBN: Derivative data saved (138 records). [2025-10-28T22:18:58.212400] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-28T22:18:58.214737] [INFO ] [MAIN ] Derivative Progress: 1745/2046 symbols completed. TBN took 1.1s. Estimated remaining: 2m 2s. Rate: 147.9 symbols/min [2025-10-28T22:18:58.219140] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:58.219413] [DEBUG] [LOCAL ] TCBX: Loaded 9919 existing records from primary storage. [2025-10-28T22:18:58.219625] [INFO ] [MAIN ] TCBX: Loaded 9919 primary data records. [2025-10-28T22:18:58.222259] [INFO ] [MAIN ] TBI: Generated 138 derivative records from 22409 primary records. [2025-10-28T22:18:58.243558] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-28T22:18:58.343842] [DEBUG] [LOCAL ] TBI: Derivative data saved (138 records). [2025-10-28T22:18:58.344583] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-28T22:18:58.352711] [INFO ] [MAIN ] Derivative Progress: 1746/2046 symbols completed. TBI took 1.3s. Estimated remaining: 2m 2s. Rate: 148.0 symbols/min [2025-10-28T22:18:58.373683] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:58.576572] [DEBUG] [LOCAL ] TD: Loaded 52115 existing records from primary storage. [2025-10-28T22:18:58.576926] [INFO ] [MAIN ] TD: Loaded 52115 primary data records. [2025-10-28T22:18:58.794947] [DEBUG] [LOCAL ] TDC: Loaded 46254 existing records from primary storage. [2025-10-28T22:18:58.799821] [INFO ] [MAIN ] TDC: Loaded 46254 primary data records. [2025-10-28T22:18:58.800103] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:59.252474] [INFO ] [MAIN ] TCBX: Generated 138 derivative records from 9919 primary records. [2025-10-28T22:18:59.253141] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-28T22:18:59.267463] [DEBUG] [LOCAL ] TCBX: Derivative data saved (138 records). [2025-10-28T22:18:59.268487] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-28T22:18:59.271183] [INFO ] [MAIN ] Derivative Progress: 1747/2046 symbols completed. TCBX took 1.1s. Estimated remaining: 2m 1s. Rate: 147.9 symbols/min [2025-10-28T22:18:59.271575] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:59.287340] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:59.304714] [DEBUG] [LOCAL ] TDF: Loaded 6026 existing records from primary storage. [2025-10-28T22:18:59.305104] [INFO ] [MAIN ] TDF: Loaded 6026 primary data records. [2025-10-28T22:18:59.516924] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:59.712284] [INFO ] [MAIN ] TD: Generated 138 derivative records from 52115 primary records. [2025-10-28T22:18:59.713798] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-28T22:18:59.729930] [DEBUG] [LOCAL ] TD: Derivative data saved (138 records). [2025-10-28T22:18:59.730480] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-28T22:18:59.733395] [INFO ] [MAIN ] Derivative Progress: 1748/2046 symbols completed. TD took 1.5s. Estimated remaining: 2m 1s. Rate: 147.9 symbols/min [2025-10-28T22:18:59.735231] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:59.754274] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:18:59.756259] [INFO ] [MAIN ] TDC: Generated 138 derivative records from 46254 primary records. [2025-10-28T22:18:59.767815] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-28T22:18:59.792091] [DEBUG] [LOCAL ] TDC: Derivative data saved (138 records). [2025-10-28T22:18:59.792337] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-28T22:18:59.794766] [INFO ] [MAIN ] Derivative Progress: 1749/2046 symbols completed. TDC took 1.4s. Estimated remaining: 2m 0s. Rate: 147.9 symbols/min [2025-10-28T22:18:59.796718] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:18:59.808464] [DEBUG] [LOCAL ] TDG: Loaded 21518 existing records from primary storage. [2025-10-28T22:18:59.810122] [INFO ] [MAIN ] TDG: Loaded 21518 primary data records. [2025-10-28T22:19:00.115886] [INFO ] [MAIN ] TDF: Generated 138 derivative records from 6026 primary records. [2025-10-28T22:19:00.138882] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-28T22:19:00.165568] [DEBUG] [LOCAL ] TDF: Derivative data saved (138 records). [2025-10-28T22:19:00.166766] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-28T22:19:00.168904] [INFO ] [MAIN ] Derivative Progress: 1750/2046 symbols completed. TDF took 0.9s. Estimated remaining: 2m 0s. Rate: 147.9 symbols/min [2025-10-28T22:19:00.166614] [DEBUG] [LOCAL ] TDOC: Loaded 53369 existing records from primary storage. [2025-10-28T22:19:00.170361] [INFO ] [MAIN ] TDOC: Loaded 53369 primary data records. [2025-10-28T22:19:00.169125] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:00.511518] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:00.525073] [DEBUG] [LOCAL ] TDS: Loaded 41639 existing records from primary storage. [2025-10-28T22:19:00.527062] [INFO ] [MAIN ] TDS: Loaded 41639 primary data records. [2025-10-28T22:19:00.864684] [INFO ] [MAIN ] TDG: Generated 138 derivative records from 21518 primary records. [2025-10-28T22:19:00.864959] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:00.876808] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-28T22:19:00.897017] [DEBUG] [LOCAL ] TDG: Derivative data saved (138 records). [2025-10-28T22:19:00.897542] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-28T22:19:00.900938] [INFO ] [MAIN ] Derivative Progress: 1751/2046 symbols completed. TDG took 1.2s. Estimated remaining: 1m 60s. Rate: 147.9 symbols/min [2025-10-28T22:19:00.901762] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:00.925531] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:00.947177] [INFO ] [MAIN ] TDOC: Generated 138 derivative records from 53369 primary records. [2025-10-28T22:19:00.957451] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-28T22:19:00.977100] [DEBUG] [LOCAL ] TDOC: Derivative data saved (138 records). [2025-10-28T22:19:00.991067] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-28T22:19:00.993486] [INFO ] [MAIN ] Derivative Progress: 1752/2046 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 59s. Rate: 147.9 symbols/min [2025-10-28T22:19:00.993716] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:00.994780] [DEBUG] [LOCAL ] TDW: Loaded 44631 existing records from primary storage. [2025-10-28T22:19:00.995094] [INFO ] [MAIN ] TDW: Loaded 44631 primary data records. [2025-10-28T22:19:01.139440] [INFO ] [MAIN ] TDS: Generated 138 derivative records from 41639 primary records. [2025-10-28T22:19:01.139254] [DEBUG] [LOCAL ] TDY: Loaded 21796 existing records from primary storage. [2025-10-28T22:19:01.150004] [INFO ] [MAIN ] TDY: Loaded 21796 primary data records. [2025-10-28T22:19:01.149908] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-28T22:19:01.447461] [DEBUG] [LOCAL ] TDS: Derivative data saved (138 records). [2025-10-28T22:19:01.457998] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-28T22:19:01.471304] [INFO ] [MAIN ] Derivative Progress: 1753/2046 symbols completed. TDS took 1.3s. Estimated remaining: 1m 59s. Rate: 147.9 symbols/min [2025-10-28T22:19:01.700081] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:01.742949] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:01.767149] [INFO ] [MAIN ] TDW: Generated 138 derivative records from 44631 primary records. [2025-10-28T22:19:01.769675] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-28T22:19:01.787793] [DEBUG] [LOCAL ] TDW: Derivative data saved (138 records). [2025-10-28T22:19:01.787986] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-28T22:19:01.790248] [INFO ] [MAIN ] Derivative Progress: 1754/2046 symbols completed. TDW took 0.9s. Estimated remaining: 1m 58s. Rate: 147.9 symbols/min [2025-10-28T22:19:01.795819] [INFO ] [MAIN ] TDY: Generated 138 derivative records from 21796 primary records. [2025-10-28T22:19:01.795904] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-28T22:19:01.807949] [DEBUG] [LOCAL ] TDY: Derivative data saved (138 records). [2025-10-28T22:19:01.808051] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-28T22:19:01.810288] [INFO ] [MAIN ] Derivative Progress: 1755/2046 symbols completed. TDY took 0.8s. Estimated remaining: 1m 58s. Rate: 148.0 symbols/min [2025-10-28T22:19:01.810867] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:01.810811] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:01.810930] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:01.822183] [DEBUG] [LOCAL ] TEAF: Loaded 7221 existing records from primary storage. [2025-10-28T22:19:01.822439] [INFO ] [MAIN ] TEAF: Loaded 7221 primary data records. [2025-10-28T22:19:01.996664] [DEBUG] [LOCAL ] TEF: Loaded 36416 existing records from primary storage. [2025-10-28T22:19:02.057680] [INFO ] [MAIN ] TEF: Loaded 36416 primary data records. [2025-10-28T22:19:02.221247] [DEBUG] [LOCAL ] TECK: Loaded 53429 existing records from primary storage. [2025-10-28T22:19:02.239883] [INFO ] [MAIN ] TECK: Loaded 53429 primary data records. [2025-10-28T22:19:02.859829] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:02.898766] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:02.940015] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:02.980782] [INFO ] [MAIN ] TEAF: Generated 138 derivative records from 7221 primary records. [2025-10-28T22:19:02.984972] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-28T22:19:03.003157] [DEBUG] [LOCAL ] TEAF: Derivative data saved (138 records). [2025-10-28T22:19:03.007015] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-28T22:19:03.010899] [INFO ] [MAIN ] Derivative Progress: 1756/2046 symbols completed. TEAF took 1.2s. Estimated remaining: 1m 58s. Rate: 147.9 symbols/min [2025-10-28T22:19:03.013110] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:03.023854] [INFO ] [MAIN ] TECK: Generated 138 derivative records from 53429 primary records. [2025-10-28T22:19:03.026052] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-28T22:19:03.025952] [INFO ] [MAIN ] TEF: Generated 138 derivative records from 36416 primary records. [2025-10-28T22:19:03.026882] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-28T22:19:03.051968] [DEBUG] [LOCAL ] TECK: Derivative data saved (138 records). [2025-10-28T22:19:03.054907] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-28T22:19:03.058623] [INFO ] [MAIN ] Derivative Progress: 1757/2046 symbols completed. TECK took 1.2s. Estimated remaining: 1m 57s. Rate: 147.9 symbols/min [2025-10-28T22:19:03.060075] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:03.060892] [DEBUG] [LOCAL ] TEF: Derivative data saved (138 records). [2025-10-28T22:19:03.061214] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-28T22:19:03.063317] [INFO ] [MAIN ] Derivative Progress: 1758/2046 symbols completed. TEF took 1.3s. Estimated remaining: 1m 57s. Rate: 148.0 symbols/min [2025-10-28T22:19:03.063536] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:03.073682] [DEBUG] [LOCAL ] TEI: Loaded 20993 existing records from primary storage. [2025-10-28T22:19:03.073855] [INFO ] [MAIN ] TEI: Loaded 20993 primary data records. [2025-10-28T22:19:03.293764] [DEBUG] [LOCAL ] TEN: Loaded 29647 existing records from primary storage. [2025-10-28T22:19:03.409995] [INFO ] [MAIN ] TEN: Loaded 29647 primary data records. [2025-10-28T22:19:03.528039] [DEBUG] [LOCAL ] TEL: Loaded 51000 existing records from primary storage. [2025-10-28T22:19:03.531832] [INFO ] [MAIN ] TEL: Loaded 51000 primary data records. [2025-10-28T22:19:04.075323] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:04.121234] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:04.160174] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:04.181517] [INFO ] [MAIN ] TEI: Generated 138 derivative records from 20993 primary records. [2025-10-28T22:19:04.183000] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-28T22:19:04.202506] [DEBUG] [LOCAL ] TEI: Derivative data saved (138 records). [2025-10-28T22:19:04.202733] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-28T22:19:04.205401] [INFO ] [MAIN ] Derivative Progress: 1759/2046 symbols completed. TEI took 1.2s. Estimated remaining: 1m 56s. Rate: 147.9 symbols/min [2025-10-28T22:19:04.205915] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:04.238283] [INFO ] [MAIN ] TEN: Generated 138 derivative records from 29647 primary records. [2025-10-28T22:19:04.240507] [INFO ] [MAIN ] TEL: Generated 138 derivative records from 51000 primary records. [2025-10-28T22:19:04.240321] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-28T22:19:04.240615] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-28T22:19:04.273111] [DEBUG] [LOCAL ] TEL: Derivative data saved (138 records). [2025-10-28T22:19:04.273302] [DEBUG] [LOCAL ] TEN: Derivative data saved (138 records). [2025-10-28T22:19:04.273213] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-28T22:19:04.271181] [DEBUG] [LOCAL ] TEO: Loaded 23229 existing records from primary storage. [2025-10-28T22:19:04.275722] [INFO ] [MAIN ] Derivative Progress: 1760/2046 symbols completed. TEL took 1.2s. Estimated remaining: 1m 56s. Rate: 147.9 symbols/min [2025-10-28T22:19:04.275859] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-28T22:19:04.278223] [INFO ] [MAIN ] Derivative Progress: 1761/2046 symbols completed. TEN took 1.2s. Estimated remaining: 1m 56s. Rate: 148.0 symbols/min [2025-10-28T22:19:04.275977] [INFO ] [MAIN ] TEO: Loaded 23229 primary data records. [2025-10-28T22:19:04.278417] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:04.276089] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:04.613150] [DEBUG] [LOCAL ] TEX: Loaded 43319 existing records from primary storage. [2025-10-28T22:19:04.614291] [INFO ] [MAIN ] TEX: Loaded 43319 primary data records. [2025-10-28T22:19:04.733028] [DEBUG] [LOCAL ] TEVA: Loaded 53616 existing records from primary storage. [2025-10-28T22:19:04.749128] [INFO ] [MAIN ] TEVA: Loaded 53616 primary data records. [2025-10-28T22:19:05.241192] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:05.282418] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:05.336426] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:05.350508] [INFO ] [MAIN ] TEO: Generated 138 derivative records from 23229 primary records. [2025-10-28T22:19:05.351862] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-28T22:19:05.371071] [DEBUG] [LOCAL ] TEO: Derivative data saved (138 records). [2025-10-28T22:19:05.372564] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-28T22:19:05.378025] [INFO ] [MAIN ] Derivative Progress: 1762/2046 symbols completed. TEO took 1.2s. Estimated remaining: 1m 55s. Rate: 147.9 symbols/min [2025-10-28T22:19:05.378591] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:05.391186] [INFO ] [MAIN ] TEX: Generated 138 derivative records from 43319 primary records. [2025-10-28T22:19:05.393155] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-28T22:19:05.407956] [DEBUG] [LOCAL ] TEX: Derivative data saved (138 records). [2025-10-28T22:19:05.410439] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-28T22:19:05.413363] [INFO ] [MAIN ] Derivative Progress: 1763/2046 symbols completed. TEX took 1.1s. Estimated remaining: 1m 55s. Rate: 147.9 symbols/min [2025-10-28T22:19:05.413997] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:05.416407] [INFO ] [MAIN ] TEVA: Generated 138 derivative records from 53616 primary records. [2025-10-28T22:19:05.416605] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-28T22:19:05.442932] [DEBUG] [LOCAL ] TEVA: Derivative data saved (138 records). [2025-10-28T22:19:05.443016] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-28T22:19:05.445299] [INFO ] [MAIN ] Derivative Progress: 1764/2046 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 54s. Rate: 148.0 symbols/min [2025-10-28T22:19:05.445434] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:05.487329] [DEBUG] [LOCAL ] TFII: Loaded 31672 existing records from primary storage. [2025-10-28T22:19:05.495274] [INFO ] [MAIN ] TFII: Loaded 31672 primary data records. [2025-10-28T22:19:05.488346] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-28T22:19:05.496434] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-28T22:19:05.496836] [DEBUG] [LOCAL ] TFIN: Loaded 23203 existing records from primary storage. [2025-10-28T22:19:05.582315] [INFO ] [MAIN ] TFIN: Loaded 23203 primary data records. [2025-10-28T22:19:06.467321] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:06.468407] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:06.518502] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:06.581216] [INFO ] [MAIN ] TFII: Generated 138 derivative records from 31672 primary records. [2025-10-28T22:19:06.581992] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-28T22:19:06.584394] [INFO ] [MAIN ] TFC: Generated 138 derivative records from 53667 primary records. [2025-10-28T22:19:06.587446] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-28T22:19:06.600435] [DEBUG] [LOCAL ] TFII: Derivative data saved (138 records). [2025-10-28T22:19:06.601696] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-28T22:19:06.610828] [INFO ] [MAIN ] Derivative Progress: 1765/2046 symbols completed. TFII took 1.2s. Estimated remaining: 1m 54s. Rate: 147.9 symbols/min [2025-10-28T22:19:06.611105] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:06.615962] [DEBUG] [LOCAL ] TFC: Derivative data saved (138 records). [2025-10-28T22:19:06.617472] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-28T22:19:06.618316] [INFO ] [MAIN ] TFIN: Generated 138 derivative records from 23203 primary records. [2025-10-28T22:19:06.618417] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-28T22:19:06.620340] [INFO ] [MAIN ] Derivative Progress: 1766/2046 symbols completed. TFC took 1.2s. Estimated remaining: 1m 54s. Rate: 147.9 symbols/min [2025-10-28T22:19:06.621114] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:06.633291] [DEBUG] [LOCAL ] TFIN: Derivative data saved (138 records). [2025-10-28T22:19:06.633490] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-28T22:19:06.635882] [INFO ] [MAIN ] Derivative Progress: 1767/2046 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 53s. Rate: 148.0 symbols/min [2025-10-28T22:19:06.636136] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:06.646679] [DEBUG] [LOCAL ] TG: Loaded 10498 existing records from primary storage. [2025-10-28T22:19:06.656004] [INFO ] [MAIN ] TG: Loaded 10498 primary data records. [2025-10-28T22:19:06.767962] [DEBUG] [LOCAL ] TFPM: Loaded 39874 existing records from primary storage. [2025-10-28T22:19:06.785568] [INFO ] [MAIN ] TFPM: Loaded 39874 primary data records. [2025-10-28T22:19:06.789411] [DEBUG] [LOCAL ] TFX: Loaded 35051 existing records from primary storage. [2025-10-28T22:19:06.831881] [INFO ] [MAIN ] TFX: Loaded 35051 primary data records. [2025-10-28T22:19:07.670760] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:07.671759] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:07.725698] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:07.783854] [INFO ] [MAIN ] TFPM: Generated 138 derivative records from 39874 primary records. [2025-10-28T22:19:07.785023] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-28T22:19:07.790843] [INFO ] [MAIN ] TG: Generated 138 derivative records from 10498 primary records. [2025-10-28T22:19:07.800967] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-28T22:19:07.803920] [DEBUG] [LOCAL ] TFPM: Derivative data saved (138 records). [2025-10-28T22:19:07.804864] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-28T22:19:07.807146] [INFO ] [MAIN ] Derivative Progress: 1768/2046 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 53s. Rate: 147.9 symbols/min [2025-10-28T22:19:07.821182] [DEBUG] [LOCAL ] TG: Derivative data saved (138 records). [2025-10-28T22:19:07.821511] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-28T22:19:07.824302] [INFO ] [MAIN ] Derivative Progress: 1769/2046 symbols completed. TG took 1.2s. Estimated remaining: 1m 52s. Rate: 147.9 symbols/min [2025-10-28T22:19:07.826203] [INFO ] [MAIN ] TFX: Generated 138 derivative records from 35051 primary records. [2025-10-28T22:19:07.826505] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-28T22:19:07.838345] [DEBUG] [LOCAL ] TFX: Derivative data saved (138 records). [2025-10-28T22:19:07.838417] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-28T22:19:07.841502] [INFO ] [MAIN ] Derivative Progress: 1770/2046 symbols completed. TFX took 1.2s. Estimated remaining: 1m 52s. Rate: 148.0 symbols/min [2025-10-28T22:19:07.842059] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:07.841882] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:07.841967] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:07.874735] [DEBUG] [LOCAL ] TGLS: Loaded 27228 existing records from primary storage. [2025-10-28T22:19:07.885636] [INFO ] [MAIN ] TGLS: Loaded 27228 primary data records. [2025-10-28T22:19:07.980831] [DEBUG] [LOCAL ] TGS: Loaded 34021 existing records from primary storage. [2025-10-28T22:19:08.000546] [INFO ] [MAIN ] TGS: Loaded 34021 primary data records. [2025-10-28T22:19:08.077811] [DEBUG] [LOCAL ] TGNA: Loaded 48233 existing records from primary storage. [2025-10-28T22:19:08.135720] [INFO ] [MAIN ] TGNA: Loaded 48233 primary data records. [2025-10-28T22:19:09.060736] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:09.116095] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:09.194417] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:09.196684] [INFO ] [MAIN ] TGLS: Generated 138 derivative records from 27228 primary records. [2025-10-28T22:19:09.217441] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-28T22:19:09.248935] [INFO ] [MAIN ] TGS: Generated 138 derivative records from 34021 primary records. [2025-10-28T22:19:09.248460] [DEBUG] [LOCAL ] TGLS: Derivative data saved (138 records). [2025-10-28T22:19:09.249504] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-28T22:19:09.249606] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-28T22:19:09.252747] [INFO ] [MAIN ] Derivative Progress: 1771/2046 symbols completed. TGLS took 1.4s. Estimated remaining: 1m 52s. Rate: 147.8 symbols/min [2025-10-28T22:19:09.254202] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:09.274612] [DEBUG] [LOCAL ] TGS: Derivative data saved (138 records). [2025-10-28T22:19:09.276754] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-28T22:19:09.279112] [INFO ] [MAIN ] Derivative Progress: 1772/2046 symbols completed. TGS took 1.4s. Estimated remaining: 1m 51s. Rate: 147.9 symbols/min [2025-10-28T22:19:09.279345] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:09.300487] [INFO ] [MAIN ] TGNA: Generated 138 derivative records from 48233 primary records. [2025-10-28T22:19:09.300815] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-28T22:19:09.320108] [DEBUG] [LOCAL ] TGNA: Derivative data saved (138 records). [2025-10-28T22:19:09.320497] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-28T22:19:09.323963] [INFO ] [MAIN ] Derivative Progress: 1773/2046 symbols completed. TGNA took 1.5s. Estimated remaining: 1m 51s. Rate: 148.0 symbols/min [2025-10-28T22:19:09.324278] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:09.384918] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-28T22:19:09.385087] [INFO ] [MAIN ] TGT: Loaded 53777 primary data records. [2025-10-28T22:19:09.409293] [DEBUG] [LOCAL ] THG: Loaded 21094 existing records from primary storage. [2025-10-28T22:19:09.409384] [INFO ] [MAIN ] THG: Loaded 21094 primary data records. [2025-10-28T22:19:09.408887] [DEBUG] [LOCAL ] THC: Loaded 46597 existing records from primary storage. [2025-10-28T22:19:09.416470] [INFO ] [MAIN ] THC: Loaded 46597 primary data records. [2025-10-28T22:19:10.375067] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:10.413152] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:10.413663] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:10.491399] [INFO ] [MAIN ] THG: Generated 138 derivative records from 21094 primary records. [2025-10-28T22:19:10.492024] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-28T22:19:10.508879] [INFO ] [MAIN ] THC: Generated 138 derivative records from 46597 primary records. [2025-10-28T22:19:10.495756] [INFO ] [MAIN ] TGT: Generated 138 derivative records from 53777 primary records. [2025-10-28T22:19:10.508997] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-28T22:19:10.509347] [DEBUG] [LOCAL ] THG: Derivative data saved (138 records). [2025-10-28T22:19:10.509064] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-28T22:19:10.510268] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-28T22:19:10.519307] [INFO ] [MAIN ] Derivative Progress: 1774/2046 symbols completed. THG took 1.2s. Estimated remaining: 1m 50s. Rate: 147.8 symbols/min [2025-10-28T22:19:10.532421] [DEBUG] [LOCAL ] TGT: Derivative data saved (138 records). [2025-10-28T22:19:10.528070] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:10.535028] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-28T22:19:10.537927] [DEBUG] [LOCAL ] THC: Derivative data saved (138 records). [2025-10-28T22:19:10.537219] [INFO ] [MAIN ] Derivative Progress: 1775/2046 symbols completed. TGT took 1.3s. Estimated remaining: 1m 50s. Rate: 147.9 symbols/min [2025-10-28T22:19:10.538073] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-28T22:19:10.538256] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:10.540630] [INFO ] [MAIN ] Derivative Progress: 1776/2046 symbols completed. THC took 1.3s. Estimated remaining: 1m 49s. Rate: 148.0 symbols/min [2025-10-28T22:19:10.540968] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:10.545149] [DEBUG] [LOCAL ] THLV: Loaded 1454 existing records from primary storage. [2025-10-28T22:19:10.547006] [INFO ] [MAIN ] THLV: Loaded 1454 primary data records. [2025-10-28T22:19:10.547137] [DEBUG] [LOCAL ] THIR: Loaded 2483 existing records from primary storage. [2025-10-28T22:19:10.567586] [INFO ] [MAIN ] THIR: Loaded 2483 primary data records. [2025-10-28T22:19:11.152232] [DEBUG] [LOCAL ] THO: Loaded 40379 existing records from primary storage. [2025-10-28T22:19:11.152396] [INFO ] [MAIN ] THO: Loaded 40379 primary data records. [2025-10-28T22:19:11.497639] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-28T22:19:11.526089] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:19:11.595582] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:11.625099] [INFO ] [MAIN ] THIR: Generated 138 derivative records from 2483 primary records. [2025-10-28T22:19:11.630090] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-28T22:19:11.630917] [INFO ] [MAIN ] THLV: Generated 138 derivative records from 1454 primary records. [2025-10-28T22:19:11.632390] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-28T22:19:11.655050] [DEBUG] [LOCAL ] THIR: Derivative data saved (138 records). [2025-10-28T22:19:11.655754] [DEBUG] [LOCAL ] THLV: Derivative data saved (138 records). [2025-10-28T22:19:11.655957] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-28T22:19:11.656141] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-28T22:19:11.658391] [INFO ] [MAIN ] Derivative Progress: 1777/2046 symbols completed. THLV took 1.1s. Estimated remaining: 1m 49s. Rate: 147.8 symbols/min [2025-10-28T22:19:11.665185] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:11.665277] [INFO ] [MAIN ] Derivative Progress: 1778/2046 symbols completed. THIR took 1.1s. Estimated remaining: 1m 49s. Rate: 147.9 symbols/min [2025-10-28T22:19:11.666384] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:11.675993] [INFO ] [MAIN ] THO: Generated 138 derivative records from 40379 primary records. [2025-10-28T22:19:11.676208] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-28T22:19:11.699639] [DEBUG] [LOCAL ] THO: Derivative data saved (138 records). [2025-10-28T22:19:11.699907] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-28T22:19:11.702427] [INFO ] [MAIN ] Derivative Progress: 1779/2046 symbols completed. THO took 1.2s. Estimated remaining: 1m 48s. Rate: 148.0 symbols/min [2025-10-28T22:19:11.702787] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:11.711504] [DEBUG] [LOCAL ] THR: Loaded 19219 existing records from primary storage. [2025-10-28T22:19:11.720533] [INFO ] [MAIN ] THR: Loaded 19219 primary data records. [2025-10-28T22:19:11.721376] [DEBUG] [LOCAL ] THQ: Loaded 25194 existing records from primary storage. [2025-10-28T22:19:11.743048] [INFO ] [MAIN ] THQ: Loaded 25194 primary data records. [2025-10-28T22:19:12.357346] [DEBUG] [LOCAL ] THS: Loaded 38319 existing records from primary storage. [2025-10-28T22:19:12.365816] [INFO ] [MAIN ] THS: Loaded 38319 primary data records. [2025-10-28T22:19:12.719958] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:12.720240] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:12.781013] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:12.813403] [INFO ] [MAIN ] THR: Generated 138 derivative records from 19219 primary records. [2025-10-28T22:19:12.814940] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-28T22:19:12.833780] [DEBUG] [LOCAL ] THR: Derivative data saved (138 records). [2025-10-28T22:19:12.833979] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-28T22:19:12.836520] [INFO ] [MAIN ] Derivative Progress: 1780/2046 symbols completed. THR took 1.2s. Estimated remaining: 1m 48s. Rate: 147.8 symbols/min [2025-10-28T22:19:12.839661] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:12.846006] [INFO ] [MAIN ] THQ: Generated 138 derivative records from 25194 primary records. [2025-10-28T22:19:12.848294] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-28T22:19:12.867109] [DEBUG] [LOCAL ] THQ: Derivative data saved (138 records). [2025-10-28T22:19:12.867430] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-28T22:19:12.869605] [INFO ] [MAIN ] Derivative Progress: 1781/2046 symbols completed. THQ took 1.2s. Estimated remaining: 1m 47s. Rate: 147.9 symbols/min [2025-10-28T22:19:12.871683] [INFO ] [MAIN ] THS: Generated 138 derivative records from 38319 primary records. [2025-10-28T22:19:12.877548] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:12.878597] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-28T22:19:12.878918] [DEBUG] [LOCAL ] THW: Loaded 19494 existing records from primary storage. [2025-10-28T22:19:12.879447] [INFO ] [MAIN ] THW: Loaded 19494 primary data records. [2025-10-28T22:19:12.928721] [DEBUG] [LOCAL ] THS: Derivative data saved (138 records). [2025-10-28T22:19:12.928922] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-28T22:19:12.952390] [INFO ] [MAIN ] Derivative Progress: 1782/2046 symbols completed. THS took 1.2s. Estimated remaining: 1m 47s. Rate: 148.0 symbols/min [2025-10-28T22:19:12.975585] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:13.071784] [DEBUG] [LOCAL ] TISI: Loaded 3108 existing records from primary storage. [2025-10-28T22:19:13.090626] [INFO ] [MAIN ] TISI: Loaded 3108 primary data records. [2025-10-28T22:19:13.221481] [DEBUG] [LOCAL ] TIMB: Loaded 34324 existing records from primary storage. [2025-10-28T22:19:13.289023] [INFO ] [MAIN ] TIMB: Loaded 34324 primary data records. [2025-10-28T22:19:13.840595] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:13.884261] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:13.920348] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:13.944300] [INFO ] [MAIN ] THW: Generated 138 derivative records from 19494 primary records. [2025-10-28T22:19:13.951256] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-28T22:19:13.964577] [DEBUG] [LOCAL ] THW: Derivative data saved (138 records). [2025-10-28T22:19:13.967219] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-28T22:19:13.972806] [INFO ] [MAIN ] Derivative Progress: 1783/2046 symbols completed. THW took 1.1s. Estimated remaining: 1m 47s. Rate: 147.9 symbols/min [2025-10-28T22:19:13.987528] [INFO ] [MAIN ] TISI: Generated 138 derivative records from 3108 primary records. [2025-10-28T22:19:13.989829] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-28T22:19:14.001233] [DEBUG] [LOCAL ] TISI: Derivative data saved (138 records). [2025-10-28T22:19:14.002888] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-28T22:19:14.005280] [INFO ] [MAIN ] Derivative Progress: 1784/2046 symbols completed. TISI took 1.0s. Estimated remaining: 1m 46s. Rate: 147.9 symbols/min [2025-10-28T22:19:14.003046] [INFO ] [MAIN ] TIMB: Generated 138 derivative records from 34324 primary records. [2025-10-28T22:19:14.005528] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-28T22:19:14.017506] [DEBUG] [LOCAL ] TIMB: Derivative data saved (138 records). [2025-10-28T22:19:14.017573] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-28T22:19:14.019976] [INFO ] [MAIN ] Derivative Progress: 1785/2046 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 46s. Rate: 148.0 symbols/min [2025-10-28T22:19:14.020445] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:14.020559] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:14.020675] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:14.051397] [DEBUG] [LOCAL ] TIXT: Loaded 32240 existing records from primary storage. [2025-10-28T22:19:14.051524] [INFO ] [MAIN ] TIXT: Loaded 32240 primary data records. [2025-10-28T22:19:14.219487] [DEBUG] [LOCAL ] TK: Loaded 38646 existing records from primary storage. [2025-10-28T22:19:14.248833] [INFO ] [MAIN ] TK: Loaded 38646 primary data records. [2025-10-28T22:19:14.483708] [DEBUG] [LOCAL ] TJX: Loaded 53660 existing records from primary storage. [2025-10-28T22:19:14.522097] [INFO ] [MAIN ] TJX: Loaded 53660 primary data records. [2025-10-28T22:19:15.093547] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:15.141686] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:15.184054] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:15.208922] [INFO ] [MAIN ] TIXT: Generated 138 derivative records from 32240 primary records. [2025-10-28T22:19:15.214315] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-28T22:19:15.233198] [DEBUG] [LOCAL ] TIXT: Derivative data saved (138 records). [2025-10-28T22:19:15.236588] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-28T22:19:15.239554] [INFO ] [MAIN ] Derivative Progress: 1786/2046 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 46s. Rate: 147.8 symbols/min [2025-10-28T22:19:15.242038] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:15.259595] [INFO ] [MAIN ] TK: Generated 138 derivative records from 38646 primary records. [2025-10-28T22:19:15.264437] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-28T22:19:15.287756] [DEBUG] [LOCAL ] TK: Derivative data saved (138 records). [2025-10-28T22:19:15.287914] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-28T22:19:15.290274] [INFO ] [MAIN ] Derivative Progress: 1787/2046 symbols completed. TK took 1.3s. Estimated remaining: 1m 45s. Rate: 147.9 symbols/min [2025-10-28T22:19:15.305240] [INFO ] [MAIN ] TJX: Generated 138 derivative records from 53660 primary records. [2025-10-28T22:19:15.304966] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:15.306788] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-28T22:19:15.306325] [DEBUG] [LOCAL ] TKC: Loaded 40031 existing records from primary storage. [2025-10-28T22:19:15.308111] [INFO ] [MAIN ] TKC: Loaded 40031 primary data records. [2025-10-28T22:19:15.357413] [DEBUG] [LOCAL ] TJX: Derivative data saved (138 records). [2025-10-28T22:19:15.389102] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-28T22:19:15.422669] [INFO ] [MAIN ] Derivative Progress: 1788/2046 symbols completed. TJX took 1.4s. Estimated remaining: 1m 45s. Rate: 148.0 symbols/min [2025-10-28T22:19:15.426903] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:15.646566] [DEBUG] [LOCAL ] TKO: Loaded 43297 existing records from primary storage. [2025-10-28T22:19:15.646894] [INFO ] [MAIN ] TKO: Loaded 43297 primary data records. [2025-10-28T22:19:15.966045] [DEBUG] [LOCAL ] TKR: Loaded 38881 existing records from primary storage. [2025-10-28T22:19:15.966969] [INFO ] [MAIN ] TKR: Loaded 38881 primary data records. [2025-10-28T22:19:16.367024] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:16.414181] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:16.474713] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:16.475173] [INFO ] [MAIN ] TKC: Generated 138 derivative records from 40031 primary records. [2025-10-28T22:19:16.493754] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-28T22:19:16.518785] [DEBUG] [LOCAL ] TKC: Derivative data saved (138 records). [2025-10-28T22:19:16.520551] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-28T22:19:16.525176] [INFO ] [MAIN ] Derivative Progress: 1789/2046 symbols completed. TKC took 1.3s. Estimated remaining: 1m 44s. Rate: 147.8 symbols/min [2025-10-28T22:19:16.526154] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:16.543525] [INFO ] [MAIN ] TKO: Generated 138 derivative records from 43297 primary records. [2025-10-28T22:19:16.543978] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-28T22:19:16.574155] [DEBUG] [LOCAL ] TKO: Derivative data saved (138 records). [2025-10-28T22:19:16.575841] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-28T22:19:16.578854] [INFO ] [MAIN ] TKR: Generated 138 derivative records from 38881 primary records. [2025-10-28T22:19:16.579040] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-28T22:19:16.578571] [INFO ] [MAIN ] Derivative Progress: 1790/2046 symbols completed. TKO took 1.3s. Estimated remaining: 1m 44s. Rate: 147.9 symbols/min [2025-10-28T22:19:16.579609] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:16.592994] [DEBUG] [LOCAL ] TKR: Derivative data saved (138 records). [2025-10-28T22:19:16.593196] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-28T22:19:16.595807] [INFO ] [MAIN ] Derivative Progress: 1791/2046 symbols completed. TKR took 1.2s. Estimated remaining: 1m 43s. Rate: 148.0 symbols/min [2025-10-28T22:19:16.596083] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:16.616066] [DEBUG] [LOCAL ] TLK: Loaded 38522 existing records from primary storage. [2025-10-28T22:19:16.616473] [INFO ] [MAIN ] TLK: Loaded 38522 primary data records. [2025-10-28T22:19:16.684751] [DEBUG] [LOCAL ] TLYS: Loaded 16473 existing records from primary storage. [2025-10-28T22:19:16.699524] [INFO ] [MAIN ] TLYS: Loaded 16473 primary data records. [2025-10-28T22:19:16.936757] [DEBUG] [LOCAL ] TM: Loaded 35490 existing records from primary storage. [2025-10-28T22:19:16.958722] [INFO ] [MAIN ] TM: Loaded 35490 primary data records. [2025-10-28T22:19:17.647200] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:17.676122] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:19:17.728309] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:17.781475] [INFO ] [MAIN ] TLK: Generated 138 derivative records from 38522 primary records. [2025-10-28T22:19:17.783590] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-28T22:19:17.803358] [DEBUG] [LOCAL ] TLK: Derivative data saved (138 records). [2025-10-28T22:19:17.805290] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-28T22:19:17.807952] [INFO ] [MAIN ] TLYS: Generated 138 derivative records from 16473 primary records. [2025-10-28T22:19:17.811843] [INFO ] [MAIN ] Derivative Progress: 1792/2046 symbols completed. TLK took 1.3s. Estimated remaining: 1m 43s. Rate: 147.8 symbols/min [2025-10-28T22:19:17.812024] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-28T22:19:17.812174] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:17.831159] [DEBUG] [LOCAL ] TLYS: Derivative data saved (138 records). [2025-10-28T22:19:17.834629] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-28T22:19:17.837632] [INFO ] [MAIN ] Derivative Progress: 1793/2046 symbols completed. TLYS took 1.3s. Estimated remaining: 1m 43s. Rate: 147.9 symbols/min [2025-10-28T22:19:17.840535] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:17.843524] [INFO ] [MAIN ] TM: Generated 138 derivative records from 35490 primary records. [2025-10-28T22:19:17.843777] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-28T22:19:17.858992] [DEBUG] [LOCAL ] TM: Derivative data saved (138 records). [2025-10-28T22:19:17.859194] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-28T22:19:17.861671] [INFO ] [MAIN ] Derivative Progress: 1794/2046 symbols completed. TM took 1.3s. Estimated remaining: 1m 42s. Rate: 148.0 symbols/min [2025-10-28T22:19:17.861988] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:17.942602] [DEBUG] [LOCAL ] TME: Loaded 53187 existing records from primary storage. [2025-10-28T22:19:17.944120] [INFO ] [MAIN ] TME: Loaded 53187 primary data records. [2025-10-28T22:19:17.943967] [DEBUG] [LOCAL ] TMHC: Loaded 45679 existing records from primary storage. [2025-10-28T22:19:17.944455] [INFO ] [MAIN ] TMHC: Loaded 45679 primary data records. [2025-10-28T22:19:18.216602] [DEBUG] [LOCAL ] TMO: Loaded 52298 existing records from primary storage. [2025-10-28T22:19:18.348701] [INFO ] [MAIN ] TMO: Loaded 52298 primary data records. [2025-10-28T22:19:19.011422] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:19.023347] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:19.092710] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:19.108985] [INFO ] [MAIN ] TME: Generated 138 derivative records from 53187 primary records. [2025-10-28T22:19:19.114781] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-28T22:19:19.133868] [DEBUG] [LOCAL ] TME: Derivative data saved (138 records). [2025-10-28T22:19:19.139200] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-28T22:19:19.142413] [INFO ] [MAIN ] TMHC: Generated 138 derivative records from 45679 primary records. [2025-10-28T22:19:19.141976] [INFO ] [MAIN ] Derivative Progress: 1795/2046 symbols completed. TME took 1.3s. Estimated remaining: 1m 42s. Rate: 147.8 symbols/min [2025-10-28T22:19:19.143030] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:19.143296] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-28T22:19:19.165233] [DEBUG] [LOCAL ] TMHC: Derivative data saved (138 records). [2025-10-28T22:19:19.173455] [DEBUG] [LOCAL ] TNC: Loaded 13618 existing records from primary storage. [2025-10-28T22:19:19.174329] [INFO ] [MAIN ] TNC: Loaded 13618 primary data records. [2025-10-28T22:19:19.174197] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-28T22:19:19.197248] [INFO ] [MAIN ] Derivative Progress: 1796/2046 symbols completed. TMHC took 1.4s. Estimated remaining: 1m 41s. Rate: 147.9 symbols/min [2025-10-28T22:19:19.245091] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:19.316865] [INFO ] [MAIN ] TMO: Generated 138 derivative records from 52298 primary records. [2025-10-28T22:19:19.332529] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-28T22:19:19.508921] [DEBUG] [LOCAL ] TMO: Derivative data saved (138 records). [2025-10-28T22:19:19.509208] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-28T22:19:19.520555] [INFO ] [MAIN ] Derivative Progress: 1797/2046 symbols completed. TMO took 1.7s. Estimated remaining: 1m 41s. Rate: 147.9 symbols/min [2025-10-28T22:19:19.522779] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:19.525238] [DEBUG] [LOCAL ] TNET: Loaded 28070 existing records from primary storage. [2025-10-28T22:19:19.525777] [INFO ] [MAIN ] TNET: Loaded 28070 primary data records. [2025-10-28T22:19:19.865975] [DEBUG] [LOCAL ] TNK: Loaded 35047 existing records from primary storage. [2025-10-28T22:19:19.866331] [INFO ] [MAIN ] TNK: Loaded 35047 primary data records. [2025-10-28T22:19:20.047688] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:20.249483] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:20.287639] [INFO ] [MAIN ] TNC: Generated 138 derivative records from 13618 primary records. [2025-10-28T22:19:20.289445] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-28T22:19:20.323960] [DEBUG] [LOCAL ] TNC: Derivative data saved (138 records). [2025-10-28T22:19:20.324912] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-28T22:19:20.327408] [INFO ] [MAIN ] Derivative Progress: 1798/2046 symbols completed. TNC took 1.2s. Estimated remaining: 1m 41s. Rate: 147.8 symbols/min [2025-10-28T22:19:20.324712] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:20.364833] [INFO ] [MAIN ] TNET: Generated 138 derivative records from 28070 primary records. [2025-10-28T22:19:20.366579] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-28T22:19:20.384276] [DEBUG] [LOCAL ] TNET: Derivative data saved (138 records). [2025-10-28T22:19:20.386873] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-28T22:19:20.390948] [INFO ] [MAIN ] Derivative Progress: 1799/2046 symbols completed. TNET took 1.1s. Estimated remaining: 1m 40s. Rate: 147.9 symbols/min [2025-10-28T22:19:20.393899] [INFO ] [MAIN ] TNK: Generated 138 derivative records from 35047 primary records. [2025-10-28T22:19:20.394050] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-28T22:19:20.405832] [DEBUG] [LOCAL ] TNK: Derivative data saved (138 records). [2025-10-28T22:19:20.405895] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-28T22:19:20.408547] [INFO ] [MAIN ] Derivative Progress: 1800/2046 symbols completed. TNK took 0.9s. Estimated remaining: 1m 40s. Rate: 147.9 symbols/min [2025-10-28T22:19:20.409008] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:20.409545] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:20.409186] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:20.469708] [DEBUG] [LOCAL ] TNL: Loaded 41528 existing records from primary storage. [2025-10-28T22:19:20.469963] [INFO ] [MAIN ] TNL: Loaded 41528 primary data records. [2025-10-28T22:19:20.608495] [DEBUG] [LOCAL ] TOST: Loaded 53686 existing records from primary storage. [2025-10-28T22:19:20.622306] [INFO ] [MAIN ] TOST: Loaded 53686 primary data records. [2025-10-28T22:19:20.628355] [DEBUG] [LOCAL ] TOL: Loaded 50278 existing records from primary storage. [2025-10-28T22:19:20.665323] [INFO ] [MAIN ] TOL: Loaded 50278 primary data records. [2025-10-28T22:19:21.511336] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:21.551577] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:21.580400] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:21.643943] [INFO ] [MAIN ] TNL: Generated 138 derivative records from 41528 primary records. [2025-10-28T22:19:21.647592] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-28T22:19:21.667812] [DEBUG] [LOCAL ] TNL: Derivative data saved (138 records). [2025-10-28T22:19:21.670374] [INFO ] [MAIN ] TOL: Generated 138 derivative records from 50278 primary records. [2025-10-28T22:19:21.670012] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-28T22:19:21.668040] [INFO ] [MAIN ] TOST: Generated 138 derivative records from 53686 primary records. [2025-10-28T22:19:21.672234] [INFO ] [MAIN ] Derivative Progress: 1801/2046 symbols completed. TNL took 1.3s. Estimated remaining: 1m 39s. Rate: 147.8 symbols/min [2025-10-28T22:19:21.670475] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-28T22:19:21.672612] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:21.672488] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-28T22:19:21.693546] [DEBUG] [LOCAL ] TOL: Derivative data saved (138 records). [2025-10-28T22:19:21.695617] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-28T22:19:21.700172] [INFO ] [MAIN ] Derivative Progress: 1802/2046 symbols completed. TOL took 1.3s. Estimated remaining: 1m 39s. Rate: 147.8 symbols/min [2025-10-28T22:19:21.700917] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:21.702172] [DEBUG] [LOCAL ] TOST: Derivative data saved (138 records). [2025-10-28T22:19:21.702464] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-28T22:19:21.705164] [INFO ] [MAIN ] Derivative Progress: 1803/2046 symbols completed. TOST took 1.3s. Estimated remaining: 1m 39s. Rate: 147.9 symbols/min [2025-10-28T22:19:21.705514] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:21.726817] [DEBUG] [LOCAL ] TPB: Loaded 26133 existing records from primary storage. [2025-10-28T22:19:21.727045] [INFO ] [MAIN ] TPB: Loaded 26133 primary data records. [2025-10-28T22:19:21.881276] [DEBUG] [LOCAL ] TPC: Loaded 38915 existing records from primary storage. [2025-10-28T22:19:21.881396] [INFO ] [MAIN ] TPC: Loaded 38915 primary data records. [2025-10-28T22:19:22.171909] [DEBUG] [LOCAL ] TPH: Loaded 44724 existing records from primary storage. [2025-10-28T22:19:22.183263] [INFO ] [MAIN ] TPH: Loaded 44724 primary data records. [2025-10-28T22:19:22.739337] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:22.780397] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:22.816413] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:22.843200] [INFO ] [MAIN ] TPB: Generated 138 derivative records from 26133 primary records. [2025-10-28T22:19:22.843705] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-28T22:19:22.860024] [DEBUG] [LOCAL ] TPB: Derivative data saved (138 records). [2025-10-28T22:19:22.860414] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-28T22:19:22.866067] [INFO ] [MAIN ] Derivative Progress: 1804/2046 symbols completed. TPB took 1.2s. Estimated remaining: 1m 38s. Rate: 147.8 symbols/min [2025-10-28T22:19:22.866335] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:22.890273] [DEBUG] [LOCAL ] TPL: Loaded 11820 existing records from primary storage. [2025-10-28T22:19:22.891746] [INFO ] [MAIN ] TPL: Loaded 11820 primary data records. [2025-10-28T22:19:22.893560] [INFO ] [MAIN ] TPH: Generated 138 derivative records from 44724 primary records. [2025-10-28T22:19:22.898886] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-28T22:19:22.932598] [INFO ] [MAIN ] TPC: Generated 138 derivative records from 38915 primary records. [2025-10-28T22:19:22.970233] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-28T22:19:23.016282] [DEBUG] [LOCAL ] TPH: Derivative data saved (138 records). [2025-10-28T22:19:23.019440] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-28T22:19:23.023437] [INFO ] [MAIN ] Derivative Progress: 1805/2046 symbols completed. TPH took 1.3s. Estimated remaining: 1m 38s. Rate: 147.8 symbols/min [2025-10-28T22:19:23.023593] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:23.054140] [DEBUG] [LOCAL ] TPC: Derivative data saved (138 records). [2025-10-28T22:19:23.067088] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-28T22:19:23.101743] [INFO ] [MAIN ] Derivative Progress: 1806/2046 symbols completed. TPC took 1.4s. Estimated remaining: 1m 37s. Rate: 147.9 symbols/min [2025-10-28T22:19:23.117834] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:23.259620] [DEBUG] [LOCAL ] TPVG: Loaded 26630 existing records from primary storage. [2025-10-28T22:19:23.260547] [INFO ] [MAIN ] TPVG: Loaded 26630 primary data records. [2025-10-28T22:19:23.345745] [DEBUG] [LOCAL ] TPR: Loaded 53344 existing records from primary storage. [2025-10-28T22:19:23.353447] [INFO ] [MAIN ] TPR: Loaded 53344 primary data records. [2025-10-28T22:19:23.682546] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:23.926295] [INFO ] [MAIN ] TPL: Generated 138 derivative records from 11820 primary records. [2025-10-28T22:19:23.926578] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-28T22:19:23.949137] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:23.968081] [DEBUG] [LOCAL ] TPL: Derivative data saved (138 records). [2025-10-28T22:19:23.971170] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-28T22:19:23.973569] [INFO ] [MAIN ] Derivative Progress: 1807/2046 symbols completed. TPL took 1.1s. Estimated remaining: 1m 37s. Rate: 147.8 symbols/min [2025-10-28T22:19:23.973842] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:23.990304] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:24.017126] [DEBUG] [LOCAL ] TPYP: Loaded 7729 existing records from primary storage. [2025-10-28T22:19:24.017609] [INFO ] [MAIN ] TPYP: Loaded 7729 primary data records. [2025-10-28T22:19:24.354566] [INFO ] [MAIN ] TPVG: Generated 138 derivative records from 26630 primary records. [2025-10-28T22:19:24.357608] [INFO ] [MAIN ] TPR: Generated 138 derivative records from 53344 primary records. [2025-10-28T22:19:24.357951] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-28T22:19:24.357858] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-28T22:19:24.388556] [DEBUG] [LOCAL ] TPVG: Derivative data saved (138 records). [2025-10-28T22:19:24.389996] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-28T22:19:24.394189] [INFO ] [MAIN ] Derivative Progress: 1808/2046 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 37s. Rate: 147.8 symbols/min [2025-10-28T22:19:24.394585] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:24.396995] [DEBUG] [LOCAL ] TPR: Derivative data saved (138 records). [2025-10-28T22:19:24.397330] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-28T22:19:24.400403] [INFO ] [MAIN ] Derivative Progress: 1809/2046 symbols completed. TPR took 1.4s. Estimated remaining: 1m 36s. Rate: 147.9 symbols/min [2025-10-28T22:19:24.402374] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:24.408943] [DEBUG] [LOCAL ] TPZ: Loaded 4477 existing records from primary storage. [2025-10-28T22:19:24.409339] [INFO ] [MAIN ] TPZ: Loaded 4477 primary data records. [2025-10-28T22:19:24.441935] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:24.570866] [DEBUG] [LOCAL ] TR: Loaded 19387 existing records from primary storage. [2025-10-28T22:19:24.575945] [INFO ] [MAIN ] TR: Loaded 19387 primary data records. [2025-10-28T22:19:25.159260] [INFO ] [MAIN ] TPYP: Generated 138 derivative records from 7729 primary records. [2025-10-28T22:19:25.159878] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-28T22:19:25.191227] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:19:25.191037] [DEBUG] [LOCAL ] TPYP: Derivative data saved (138 records). [2025-10-28T22:19:25.202100] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-28T22:19:25.205194] [INFO ] [MAIN ] Derivative Progress: 1810/2046 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 36s. Rate: 147.8 symbols/min [2025-10-28T22:19:25.205358] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:25.228873] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:25.250981] [DEBUG] [LOCAL ] TRAK: Loaded 9271 existing records from primary storage. [2025-10-28T22:19:25.251359] [INFO ] [MAIN ] TRAK: Loaded 9271 primary data records. [2025-10-28T22:19:25.577019] [INFO ] [MAIN ] TPZ: Generated 138 derivative records from 4477 primary records. [2025-10-28T22:19:25.578926] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-28T22:19:25.579159] [INFO ] [MAIN ] TR: Generated 138 derivative records from 19387 primary records. [2025-10-28T22:19:25.580916] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-28T22:19:25.591833] [DEBUG] [LOCAL ] TPZ: Derivative data saved (138 records). [2025-10-28T22:19:25.592290] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-28T22:19:25.602793] [INFO ] [MAIN ] Derivative Progress: 1811/2046 symbols completed. TPZ took 1.2s. Estimated remaining: 1m 35s. Rate: 147.8 symbols/min [2025-10-28T22:19:25.603884] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:25.608816] [DEBUG] [LOCAL ] TR: Derivative data saved (138 records). [2025-10-28T22:19:25.608902] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-28T22:19:25.611485] [INFO ] [MAIN ] Derivative Progress: 1812/2046 symbols completed. TR took 1.2s. Estimated remaining: 1m 35s. Rate: 147.9 symbols/min [2025-10-28T22:19:25.611764] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:25.632072] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:25.650890] [DEBUG] [LOCAL ] TRC: Loaded 14971 existing records from primary storage. [2025-10-28T22:19:25.652290] [INFO ] [MAIN ] TRC: Loaded 14971 primary data records. [2025-10-28T22:19:25.845298] [DEBUG] [LOCAL ] TREX: Loaded 49672 existing records from primary storage. [2025-10-28T22:19:25.867909] [INFO ] [MAIN ] TREX: Loaded 49672 primary data records. [2025-10-28T22:19:26.295732] [INFO ] [MAIN ] TRAK: Generated 138 derivative records from 9271 primary records. [2025-10-28T22:19:26.296353] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-28T22:19:26.313817] [DEBUG] [LOCAL ] TRAK: Derivative data saved (138 records). [2025-10-28T22:19:26.314018] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-28T22:19:26.317820] [INFO ] [MAIN ] Derivative Progress: 1813/2046 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 35s. Rate: 147.8 symbols/min [2025-10-28T22:19:26.339062] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:26.382244] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:26.411588] [INFO ] [MAIN ] TRC: Generated 138 derivative records from 14971 primary records. [2025-10-28T22:19:26.414934] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-28T22:19:26.433451] [DEBUG] [LOCAL ] TRC: Derivative data saved (138 records). [2025-10-28T22:19:26.435094] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-28T22:19:26.438414] [INFO ] [MAIN ] Derivative Progress: 1814/2046 symbols completed. TRC took 0.8s. Estimated remaining: 1m 34s. Rate: 147.9 symbols/min [2025-10-28T22:19:26.446594] [INFO ] [MAIN ] TREX: Generated 138 derivative records from 49672 primary records. [2025-10-28T22:19:26.446813] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-28T22:19:26.459533] [DEBUG] [LOCAL ] TREX: Derivative data saved (138 records). [2025-10-28T22:19:26.459700] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-28T22:19:26.462241] [INFO ] [MAIN ] Derivative Progress: 1815/2046 symbols completed. TREX took 0.9s. Estimated remaining: 1m 34s. Rate: 148.0 symbols/min [2025-10-28T22:19:26.463131] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:26.463249] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:26.462993] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:26.537279] [DEBUG] [LOCAL ] TRNO: Loaded 43159 existing records from primary storage. [2025-10-28T22:19:26.538245] [INFO ] [MAIN ] TRNO: Loaded 43159 primary data records. [2025-10-28T22:19:26.537911] [DEBUG] [LOCAL ] TRN: Loaded 35737 existing records from primary storage. [2025-10-28T22:19:26.593831] [INFO ] [MAIN ] TRN: Loaded 35737 primary data records. [2025-10-28T22:19:26.687536] [DEBUG] [LOCAL ] TRGP: Loaded 50599 existing records from primary storage. [2025-10-28T22:19:26.738886] [INFO ] [MAIN ] TRGP: Loaded 50599 primary data records. [2025-10-28T22:19:27.571087] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:27.615734] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:27.629371] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:27.716342] [INFO ] [MAIN ] TRGP: Generated 138 derivative records from 50599 primary records. [2025-10-28T22:19:27.719446] [INFO ] [MAIN ] TRNO: Generated 138 derivative records from 43159 primary records. [2025-10-28T22:19:27.720048] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-28T22:19:27.720184] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-28T22:19:27.745620] [DEBUG] [LOCAL ] TRNO: Derivative data saved (138 records). [2025-10-28T22:19:27.748832] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-28T22:19:27.750679] [INFO ] [MAIN ] Derivative Progress: 1816/2046 symbols completed. TRNO took 1.3s. Estimated remaining: 1m 33s. Rate: 147.8 symbols/min [2025-10-28T22:19:27.750951] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:27.748717] [DEBUG] [LOCAL ] TRGP: Derivative data saved (138 records). [2025-10-28T22:19:27.754021] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-28T22:19:27.754297] [INFO ] [MAIN ] TRN: Generated 138 derivative records from 35737 primary records. [2025-10-28T22:19:27.759170] [INFO ] [MAIN ] Derivative Progress: 1817/2046 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 33s. Rate: 147.9 symbols/min [2025-10-28T22:19:27.759823] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:27.759696] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-28T22:19:27.774341] [DEBUG] [LOCAL ] TRN: Derivative data saved (138 records). [2025-10-28T22:19:27.774564] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-28T22:19:27.777326] [INFO ] [MAIN ] Derivative Progress: 1818/2046 symbols completed. TRN took 1.3s. Estimated remaining: 1m 32s. Rate: 147.9 symbols/min [2025-10-28T22:19:27.777704] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:27.846597] [DEBUG] [LOCAL ] TRTX: Loaded 36305 existing records from primary storage. [2025-10-28T22:19:27.846785] [INFO ] [MAIN ] TRTX: Loaded 36305 primary data records. [2025-10-28T22:19:27.847599] [DEBUG] [LOCAL ] TROX: Loaded 52155 existing records from primary storage. [2025-10-28T22:19:27.891276] [INFO ] [MAIN ] TROX: Loaded 52155 primary data records. [2025-10-28T22:19:28.031424] [DEBUG] [LOCAL ] TRP: Loaded 52105 existing records from primary storage. [2025-10-28T22:19:28.070087] [INFO ] [MAIN ] TRP: Loaded 52105 primary data records. [2025-10-28T22:19:28.845224] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:28.845625] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:28.895768] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:28.976253] [INFO ] [MAIN ] TROX: Generated 138 derivative records from 52155 primary records. [2025-10-28T22:19:28.979180] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-28T22:19:28.979560] [INFO ] [MAIN ] TRTX: Generated 138 derivative records from 36305 primary records. [2025-10-28T22:19:28.995257] [DEBUG] [LOCAL ] TROX: Derivative data saved (138 records). [2025-10-28T22:19:28.995377] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-28T22:19:28.980240] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-28T22:19:28.998804] [INFO ] [MAIN ] Derivative Progress: 1819/2046 symbols completed. TROX took 1.2s. Estimated remaining: 1m 32s. Rate: 147.8 symbols/min [2025-10-28T22:19:28.998965] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:29.003820] [INFO ] [MAIN ] TRP: Generated 138 derivative records from 52105 primary records. [2025-10-28T22:19:29.014869] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-28T22:19:29.016237] [DEBUG] [LOCAL ] TRTX: Derivative data saved (138 records). [2025-10-28T22:19:29.017087] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-28T22:19:29.019416] [INFO ] [MAIN ] Derivative Progress: 1820/2046 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 32s. Rate: 147.8 symbols/min [2025-10-28T22:19:29.019625] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:29.035418] [DEBUG] [LOCAL ] TRP: Derivative data saved (138 records). [2025-10-28T22:19:29.036046] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-28T22:19:29.040196] [INFO ] [MAIN ] Derivative Progress: 1821/2046 symbols completed. TRP took 1.3s. Estimated remaining: 1m 31s. Rate: 147.9 symbols/min [2025-10-28T22:19:29.040717] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:29.088742] [DEBUG] [LOCAL ] TRU: Loaded 51402 existing records from primary storage. [2025-10-28T22:19:29.088983] [INFO ] [MAIN ] TRU: Loaded 51402 primary data records. [2025-10-28T22:19:29.218226] [DEBUG] [LOCAL ] TRV: Loaded 47438 existing records from primary storage. [2025-10-28T22:19:29.221874] [INFO ] [MAIN ] TRV: Loaded 47438 primary data records. [2025-10-28T22:19:29.541957] [DEBUG] [LOCAL ] TS: Loaded 51612 existing records from primary storage. [2025-10-28T22:19:29.560139] [INFO ] [MAIN ] TS: Loaded 51612 primary data records. [2025-10-28T22:19:30.118394] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:30.155804] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:30.187630] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:30.274339] [INFO ] [MAIN ] TRV: Generated 138 derivative records from 47438 primary records. [2025-10-28T22:19:30.276966] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-28T22:19:30.279336] [INFO ] [MAIN ] TRU: Generated 138 derivative records from 51402 primary records. [2025-10-28T22:19:30.282720] [INFO ] [MAIN ] TS: Generated 138 derivative records from 51612 primary records. [2025-10-28T22:19:30.282450] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-28T22:19:30.290375] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-28T22:19:30.305338] [DEBUG] [LOCAL ] TRV: Derivative data saved (138 records). [2025-10-28T22:19:30.313124] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-28T22:19:30.324297] [INFO ] [MAIN ] Derivative Progress: 1822/2046 symbols completed. TRV took 1.3s. Estimated remaining: 1m 31s. Rate: 147.7 symbols/min [2025-10-28T22:19:30.324540] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:30.320419] [DEBUG] [LOCAL ] TS: Derivative data saved (138 records). [2025-10-28T22:19:30.326423] [DEBUG] [LOCAL ] TRU: Derivative data saved (138 records). [2025-10-28T22:19:30.327299] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-28T22:19:30.331392] [INFO ] [MAIN ] Derivative Progress: 1823/2046 symbols completed. TS took 1.3s. Estimated remaining: 1m 31s. Rate: 147.8 symbols/min [2025-10-28T22:19:30.331752] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:30.331876] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-28T22:19:30.334818] [INFO ] [MAIN ] Derivative Progress: 1824/2046 symbols completed. TRU took 1.3s. Estimated remaining: 1m 30s. Rate: 147.9 symbols/min [2025-10-28T22:19:30.335072] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:30.353503] [DEBUG] [LOCAL ] TSI: Loaded 7963 existing records from primary storage. [2025-10-28T22:19:30.353875] [INFO ] [MAIN ] TSI: Loaded 7963 primary data records. [2025-10-28T22:19:30.483180] [DEBUG] [LOCAL ] TSE: Loaded 27795 existing records from primary storage. [2025-10-28T22:19:30.484176] [INFO ] [MAIN ] TSE: Loaded 27795 primary data records. [2025-10-28T22:19:30.594012] [DEBUG] [LOCAL ] TSLX: Loaded 35543 existing records from primary storage. [2025-10-28T22:19:30.635758] [INFO ] [MAIN ] TSLX: Loaded 35543 primary data records. [2025-10-28T22:19:31.401383] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:31.436306] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:31.475219] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:31.535496] [INFO ] [MAIN ] TSI: Generated 138 derivative records from 7963 primary records. [2025-10-28T22:19:31.539744] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-28T22:19:31.554217] [DEBUG] [LOCAL ] TSI: Derivative data saved (138 records). [2025-10-28T22:19:31.554443] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-28T22:19:31.556364] [INFO ] [MAIN ] TSLX: Generated 138 derivative records from 35543 primary records. [2025-10-28T22:19:31.558777] [INFO ] [MAIN ] Derivative Progress: 1825/2046 symbols completed. TSI took 1.2s. Estimated remaining: 1m 30s. Rate: 147.7 symbols/min [2025-10-28T22:19:31.558924] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:31.558997] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-28T22:19:31.562797] [INFO ] [MAIN ] TSE: Generated 138 derivative records from 27795 primary records. [2025-10-28T22:19:31.572487] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-28T22:19:31.574637] [DEBUG] [LOCAL ] TSLX: Derivative data saved (138 records). [2025-10-28T22:19:31.575296] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-28T22:19:31.577889] [INFO ] [MAIN ] Derivative Progress: 1826/2046 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 29s. Rate: 147.8 symbols/min [2025-10-28T22:19:31.578263] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:31.590353] [DEBUG] [LOCAL ] TSE: Derivative data saved (138 records). [2025-10-28T22:19:31.590604] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-28T22:19:31.593180] [INFO ] [MAIN ] Derivative Progress: 1827/2046 symbols completed. TSE took 1.3s. Estimated remaining: 1m 29s. Rate: 147.9 symbols/min [2025-10-28T22:19:31.593396] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:31.607125] [DEBUG] [LOCAL ] TSQ: Loaded 11754 existing records from primary storage. [2025-10-28T22:19:31.607275] [INFO ] [MAIN ] TSQ: Loaded 11754 primary data records. [2025-10-28T22:19:31.961106] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-28T22:19:31.961426] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-28T22:19:31.962036] [DEBUG] [LOCAL ] TSN: Loaded 53087 existing records from primary storage. [2025-10-28T22:19:31.962251] [INFO ] [MAIN ] TSN: Loaded 53087 primary data records. [2025-10-28T22:19:32.596249] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:32.632352] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:32.676672] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:32.714549] [INFO ] [MAIN ] TSQ: Generated 138 derivative records from 11754 primary records. [2025-10-28T22:19:32.716482] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-28T22:19:32.736927] [DEBUG] [LOCAL ] TSQ: Derivative data saved (138 records). [2025-10-28T22:19:32.738010] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-28T22:19:32.741389] [INFO ] [MAIN ] Derivative Progress: 1828/2046 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 29s. Rate: 147.8 symbols/min [2025-10-28T22:19:32.744165] [INFO ] [MAIN ] TSM: Generated 138 derivative records from 53819 primary records. [2025-10-28T22:19:32.746333] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-28T22:19:32.761829] [DEBUG] [LOCAL ] TSM: Derivative data saved (138 records). [2025-10-28T22:19:32.763201] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-28T22:19:32.765358] [INFO ] [MAIN ] Derivative Progress: 1829/2046 symbols completed. TSM took 1.2s. Estimated remaining: 1m 28s. Rate: 147.8 symbols/min [2025-10-28T22:19:32.766968] [INFO ] [MAIN ] TSN: Generated 138 derivative records from 53087 primary records. [2025-10-28T22:19:32.767032] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-28T22:19:32.778434] [DEBUG] [LOCAL ] TSN: Derivative data saved (138 records). [2025-10-28T22:19:32.778487] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-28T22:19:32.780966] [INFO ] [MAIN ] Derivative Progress: 1830/2046 symbols completed. TSN took 1.2s. Estimated remaining: 1m 28s. Rate: 147.9 symbols/min [2025-10-28T22:19:32.781305] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:32.781405] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:32.781720] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:32.839309] [DEBUG] [LOCAL ] TTC: Loaded 41050 existing records from primary storage. [2025-10-28T22:19:32.851101] [INFO ] [MAIN ] TTC: Loaded 41050 primary data records. [2025-10-28T22:19:32.884834] [DEBUG] [LOCAL ] TT: Loaded 46798 existing records from primary storage. [2025-10-28T22:19:32.897670] [INFO ] [MAIN ] TT: Loaded 46798 primary data records. [2025-10-28T22:19:32.986980] [DEBUG] [LOCAL ] TTE: Loaded 51441 existing records from primary storage. [2025-10-28T22:19:33.031018] [INFO ] [MAIN ] TTE: Loaded 51441 primary data records. [2025-10-28T22:19:33.826960] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:33.859080] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:33.894367] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:33.948536] [INFO ] [MAIN ] TTC: Generated 138 derivative records from 41050 primary records. [2025-10-28T22:19:33.950070] [INFO ] [MAIN ] TT: Generated 138 derivative records from 46798 primary records. [2025-10-28T22:19:33.950209] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-28T22:19:33.953766] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-28T22:19:33.974340] [DEBUG] [LOCAL ] TTC: Derivative data saved (138 records). [2025-10-28T22:19:33.980834] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-28T22:19:33.983570] [INFO ] [MAIN ] Derivative Progress: 1831/2046 symbols completed. TTC took 1.2s. Estimated remaining: 1m 27s. Rate: 147.7 symbols/min [2025-10-28T22:19:33.983941] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:33.981720] [DEBUG] [LOCAL ] TT: Derivative data saved (138 records). [2025-10-28T22:19:33.985689] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-28T22:19:33.988168] [INFO ] [MAIN ] Derivative Progress: 1832/2046 symbols completed. TT took 1.2s. Estimated remaining: 1m 27s. Rate: 147.8 symbols/min [2025-10-28T22:19:33.988385] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:33.991073] [INFO ] [MAIN ] TTE: Generated 138 derivative records from 51441 primary records. [2025-10-28T22:19:33.991223] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-28T22:19:34.003488] [DEBUG] [LOCAL ] TTE: Derivative data saved (138 records). [2025-10-28T22:19:34.003725] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-28T22:19:34.006166] [INFO ] [MAIN ] Derivative Progress: 1833/2046 symbols completed. TTE took 1.2s. Estimated remaining: 1m 26s. Rate: 147.9 symbols/min [2025-10-28T22:19:34.006417] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:34.057724] [DEBUG] [LOCAL ] TTI: Loaded 46706 existing records from primary storage. [2025-10-28T22:19:34.057976] [INFO ] [MAIN ] TTI: Loaded 46706 primary data records. [2025-10-28T22:19:34.185174] [DEBUG] [LOCAL ] TUYA: Loaded 45512 existing records from primary storage. [2025-10-28T22:19:34.184517] [DEBUG] [LOCAL ] TU: Loaded 49672 existing records from primary storage. [2025-10-28T22:19:34.185675] [INFO ] [MAIN ] TU: Loaded 49672 primary data records. [2025-10-28T22:19:34.196122] [INFO ] [MAIN ] TUYA: Loaded 45512 primary data records. [2025-10-28T22:19:34.998985] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:35.039789] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:35.064208] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:35.113197] [INFO ] [MAIN ] TTI: Generated 138 derivative records from 46706 primary records. [2025-10-28T22:19:35.115141] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-28T22:19:35.135115] [DEBUG] [LOCAL ] TTI: Derivative data saved (138 records). [2025-10-28T22:19:35.137261] [INFO ] [MAIN ] TU: Generated 138 derivative records from 49672 primary records. [2025-10-28T22:19:35.137010] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-28T22:19:35.137565] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-28T22:19:35.141793] [INFO ] [MAIN ] Derivative Progress: 1834/2046 symbols completed. TTI took 1.2s. Estimated remaining: 1m 26s. Rate: 147.8 symbols/min [2025-10-28T22:19:35.142601] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:35.156613] [DEBUG] [LOCAL ] TU: Derivative data saved (138 records). [2025-10-28T22:19:35.158403] [INFO ] [MAIN ] TUYA: Generated 138 derivative records from 45512 primary records. [2025-10-28T22:19:35.158161] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-28T22:19:35.158517] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-28T22:19:35.160854] [INFO ] [MAIN ] Derivative Progress: 1835/2046 symbols completed. TU took 1.2s. Estimated remaining: 1m 26s. Rate: 147.8 symbols/min [2025-10-28T22:19:35.161841] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:35.177012] [DEBUG] [LOCAL ] TUYA: Derivative data saved (138 records). [2025-10-28T22:19:35.177162] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-28T22:19:35.179620] [INFO ] [MAIN ] Derivative Progress: 1836/2046 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 25s. Rate: 147.9 symbols/min [2025-10-28T22:19:35.179795] [DEBUG] [LOCAL ] TVC: Loaded 3010 existing records from primary storage. [2025-10-28T22:19:35.189176] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:35.189288] [INFO ] [MAIN ] TVC: Loaded 3010 primary data records. [2025-10-28T22:19:35.262859] [DEBUG] [LOCAL ] TVE: Loaded 2491 existing records from primary storage. [2025-10-28T22:19:35.286078] [INFO ] [MAIN ] TVE: Loaded 2491 primary data records. [2025-10-28T22:19:35.377560] [DEBUG] [LOCAL ] TV: Loaded 41054 existing records from primary storage. [2025-10-28T22:19:35.400209] [INFO ] [MAIN ] TV: Loaded 41054 primary data records. [2025-10-28T22:19:36.148204] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:36.173475] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:36.209896] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:36.266665] [INFO ] [MAIN ] TVC: Generated 138 derivative records from 3010 primary records. [2025-10-28T22:19:36.267054] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-28T22:19:36.272182] [INFO ] [MAIN ] TVE: Generated 138 derivative records from 2491 primary records. [2025-10-28T22:19:36.272453] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-28T22:19:36.282614] [DEBUG] [LOCAL ] TVC: Derivative data saved (138 records). [2025-10-28T22:19:36.296434] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-28T22:19:36.298708] [INFO ] [MAIN ] Derivative Progress: 1837/2046 symbols completed. TVC took 1.1s. Estimated remaining: 1m 25s. Rate: 147.8 symbols/min [2025-10-28T22:19:36.299521] [DEBUG] [LOCAL ] TVE: Derivative data saved (138 records). [2025-10-28T22:19:36.300632] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-28T22:19:36.300880] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:36.303311] [INFO ] [MAIN ] Derivative Progress: 1838/2046 symbols completed. TVE took 1.1s. Estimated remaining: 1m 24s. Rate: 147.9 symbols/min [2025-10-28T22:19:36.304326] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:36.306324] [INFO ] [MAIN ] TV: Generated 138 derivative records from 41054 primary records. [2025-10-28T22:19:36.306800] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-28T22:19:36.319418] [DEBUG] [LOCAL ] TV: Derivative data saved (138 records). [2025-10-28T22:19:36.319728] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-28T22:19:36.322237] [INFO ] [MAIN ] Derivative Progress: 1839/2046 symbols completed. TV took 1.2s. Estimated remaining: 1m 24s. Rate: 147.9 symbols/min [2025-10-28T22:19:36.322584] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:36.335535] [DEBUG] [LOCAL ] TWN: Loaded 3121 existing records from primary storage. [2025-10-28T22:19:36.335789] [INFO ] [MAIN ] TWN: Loaded 3121 primary data records. [2025-10-28T22:19:36.457705] [DEBUG] [LOCAL ] TWI: Loaded 33243 existing records from primary storage. [2025-10-28T22:19:36.461149] [INFO ] [MAIN ] TWI: Loaded 33243 primary data records. [2025-10-28T22:19:36.775072] [DEBUG] [LOCAL ] TWLO: Loaded 52744 existing records from primary storage. [2025-10-28T22:19:36.797592] [INFO ] [MAIN ] TWLO: Loaded 52744 primary data records. [2025-10-28T22:19:37.332327] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:37.367434] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:37.399815] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:37.462216] [INFO ] [MAIN ] TWN: Generated 138 derivative records from 3121 primary records. [2025-10-28T22:19:37.464585] [INFO ] [MAIN ] TWI: Generated 138 derivative records from 33243 primary records. [2025-10-28T22:19:37.464831] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-28T22:19:37.464915] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-28T22:19:37.477546] [INFO ] [MAIN ] TWLO: Generated 138 derivative records from 52744 primary records. [2025-10-28T22:19:37.479045] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-28T22:19:37.481034] [DEBUG] [LOCAL ] TWI: Derivative data saved (138 records). [2025-10-28T22:19:37.481380] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-28T22:19:37.490501] [INFO ] [MAIN ] Derivative Progress: 1840/2046 symbols completed. TWI took 1.2s. Estimated remaining: 1m 24s. Rate: 147.8 symbols/min [2025-10-28T22:19:37.491391] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:37.505132] [DEBUG] [LOCAL ] TWLO: Derivative data saved (138 records). [2025-10-28T22:19:37.505720] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-28T22:19:37.505635] [DEBUG] [LOCAL ] TWN: Derivative data saved (138 records). [2025-10-28T22:19:37.508152] [INFO ] [MAIN ] Derivative Progress: 1841/2046 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 23s. Rate: 147.9 symbols/min [2025-10-28T22:19:37.508276] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-28T22:19:37.510907] [INFO ] [MAIN ] Derivative Progress: 1842/2046 symbols completed. TWN took 1.2s. Estimated remaining: 1m 23s. Rate: 147.9 symbols/min [2025-10-28T22:19:37.508391] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:37.511168] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:37.533475] [DEBUG] [LOCAL ] TX: Loaded 22682 existing records from primary storage. [2025-10-28T22:19:37.543096] [INFO ] [MAIN ] TX: Loaded 22682 primary data records. [2025-10-28T22:19:37.696491] [DEBUG] [LOCAL ] TWO: Loaded 48394 existing records from primary storage. [2025-10-28T22:19:37.690695] [DEBUG] [LOCAL ] TXNM: Loaded 42528 existing records from primary storage. [2025-10-28T22:19:37.701896] [INFO ] [MAIN ] TWO: Loaded 48394 primary data records. [2025-10-28T22:19:37.707310] [INFO ] [MAIN ] TXNM: Loaded 42528 primary data records. [2025-10-28T22:19:38.485700] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:38.531399] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:38.566034] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:38.615909] [INFO ] [MAIN ] TX: Generated 138 derivative records from 22682 primary records. [2025-10-28T22:19:38.620456] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-28T22:19:38.645068] [INFO ] [MAIN ] TWO: Generated 138 derivative records from 48394 primary records. [2025-10-28T22:19:38.645453] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-28T22:19:38.644854] [DEBUG] [LOCAL ] TX: Derivative data saved (138 records). [2025-10-28T22:19:38.647164] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-28T22:19:38.651346] [INFO ] [MAIN ] Derivative Progress: 1843/2046 symbols completed. TX took 1.1s. Estimated remaining: 1m 22s. Rate: 147.8 symbols/min [2025-10-28T22:19:38.666984] [DEBUG] [LOCAL ] TWO: Derivative data saved (138 records). [2025-10-28T22:19:38.667110] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-28T22:19:38.671831] [INFO ] [MAIN ] Derivative Progress: 1844/2046 symbols completed. TWO took 1.2s. Estimated remaining: 1m 22s. Rate: 147.9 symbols/min [2025-10-28T22:19:38.672278] [INFO ] [MAIN ] TXNM: Generated 138 derivative records from 42528 primary records. [2025-10-28T22:19:38.672340] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-28T22:19:38.683992] [DEBUG] [LOCAL ] TXNM: Derivative data saved (138 records). [2025-10-28T22:19:38.684048] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-28T22:19:38.686443] [INFO ] [MAIN ] Derivative Progress: 1845/2046 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 22s. Rate: 147.9 symbols/min [2025-10-28T22:19:38.686790] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:38.686845] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:38.686935] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:38.702789] [DEBUG] [LOCAL ] TY: Loaded 7397 existing records from primary storage. [2025-10-28T22:19:38.703028] [INFO ] [MAIN ] TY: Loaded 7397 primary data records. [2025-10-28T22:19:38.795910] [DEBUG] [LOCAL ] TXO: Loaded 19939 existing records from primary storage. [2025-10-28T22:19:38.819701] [INFO ] [MAIN ] TXO: Loaded 19939 primary data records. [2025-10-28T22:19:39.225553] [DEBUG] [LOCAL ] TXT: Loaded 49496 existing records from primary storage. [2025-10-28T22:19:39.247796] [INFO ] [MAIN ] TXT: Loaded 49496 primary data records. [2025-10-28T22:19:39.709192] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:39.736972] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:39.787422] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:39.824973] [INFO ] [MAIN ] TY: Generated 138 derivative records from 7397 primary records. [2025-10-28T22:19:39.825297] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-28T22:19:39.839756] [DEBUG] [LOCAL ] TY: Derivative data saved (138 records). [2025-10-28T22:19:39.840215] [INFO ] [MAIN ] TXO: Generated 138 derivative records from 19939 primary records. [2025-10-28T22:19:39.839863] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-28T22:19:39.840317] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-28T22:19:39.842356] [INFO ] [MAIN ] Derivative Progress: 1846/2046 symbols completed. TY took 1.2s. Estimated remaining: 1m 21s. Rate: 147.8 symbols/min [2025-10-28T22:19:39.842487] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:39.859106] [DEBUG] [LOCAL ] TXO: Derivative data saved (138 records). [2025-10-28T22:19:39.859267] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-28T22:19:39.864188] [INFO ] [MAIN ] Derivative Progress: 1847/2046 symbols completed. TXO took 1.2s. Estimated remaining: 1m 21s. Rate: 147.9 symbols/min [2025-10-28T22:19:39.864472] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:39.872353] [INFO ] [MAIN ] TXT: Generated 138 derivative records from 49496 primary records. [2025-10-28T22:19:39.872803] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-28T22:19:39.878212] [DEBUG] [LOCAL ] TYG: Loaded 13650 existing records from primary storage. [2025-10-28T22:19:39.878450] [INFO ] [MAIN ] TYG: Loaded 13650 primary data records. [2025-10-28T22:19:39.915577] [DEBUG] [LOCAL ] TXT: Derivative data saved (138 records). [2025-10-28T22:19:39.931840] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-28T22:19:39.940408] [INFO ] [MAIN ] Derivative Progress: 1848/2046 symbols completed. TXT took 1.3s. Estimated remaining: 1m 20s. Rate: 147.9 symbols/min [2025-10-28T22:19:39.960364] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:39.986316] [DEBUG] [LOCAL ] TYL: Loaded 21703 existing records from primary storage. [2025-10-28T22:19:40.013005] [INFO ] [MAIN ] TYL: Loaded 21703 primary data records. [2025-10-28T22:19:40.545973] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-28T22:19:40.546956] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-28T22:19:40.732883] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:40.918891] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:40.947359] [INFO ] [MAIN ] TYG: Generated 138 derivative records from 13650 primary records. [2025-10-28T22:19:40.947870] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-28T22:19:40.973727] [DEBUG] [LOCAL ] TYG: Derivative data saved (138 records). [2025-10-28T22:19:40.979129] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-28T22:19:40.979038] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:40.995705] [INFO ] [MAIN ] Derivative Progress: 1849/2046 symbols completed. TYG took 1.2s. Estimated remaining: 1m 20s. Rate: 147.8 symbols/min [2025-10-28T22:19:40.996013] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:41.015068] [INFO ] [MAIN ] TYL: Generated 138 derivative records from 21703 primary records. [2025-10-28T22:19:41.017665] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-28T22:19:41.045393] [DEBUG] [LOCAL ] TYL: Derivative data saved (138 records). [2025-10-28T22:19:41.046820] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-28T22:19:41.049567] [INFO ] [MAIN ] Derivative Progress: 1850/2046 symbols completed. TYL took 1.2s. Estimated remaining: 1m 20s. Rate: 147.9 symbols/min [2025-10-28T22:19:41.053281] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:41.069094] [DEBUG] [LOCAL ] UA: Loaded 50396 existing records from primary storage. [2025-10-28T22:19:41.069571] [INFO ] [MAIN ] UA: Loaded 50396 primary data records. [2025-10-28T22:19:41.103912] [INFO ] [MAIN ] U: Generated 138 derivative records from 53799 primary records. [2025-10-28T22:19:41.128292] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-28T22:19:41.200086] [DEBUG] [LOCAL ] U: Derivative data saved (138 records). [2025-10-28T22:19:41.200270] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-28T22:19:41.213207] [INFO ] [MAIN ] Derivative Progress: 1851/2046 symbols completed. U took 1.3s. Estimated remaining: 1m 19s. Rate: 147.9 symbols/min [2025-10-28T22:19:41.240019] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:41.403138] [DEBUG] [LOCAL ] UAN: Loaded 5045 existing records from primary storage. [2025-10-28T22:19:41.403758] [INFO ] [MAIN ] UAN: Loaded 5045 primary data records. [2025-10-28T22:19:41.523271] [DEBUG] [LOCAL ] UAA: Loaded 53496 existing records from primary storage. [2025-10-28T22:19:41.523607] [INFO ] [MAIN ] UAA: Loaded 53496 primary data records. [2025-10-28T22:19:42.086226] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:42.133443] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:19:42.148295] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:42.182853] [INFO ] [MAIN ] UA: Generated 138 derivative records from 50396 primary records. [2025-10-28T22:19:42.183520] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-28T22:19:42.199214] [DEBUG] [LOCAL ] UA: Derivative data saved (138 records). [2025-10-28T22:19:42.200126] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-28T22:19:42.202723] [INFO ] [MAIN ] Derivative Progress: 1852/2046 symbols completed. UA took 1.2s. Estimated remaining: 1m 19s. Rate: 147.8 symbols/min [2025-10-28T22:19:42.205424] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:42.231686] [INFO ] [MAIN ] UAN: Generated 138 derivative records from 5045 primary records. [2025-10-28T22:19:42.231338] [INFO ] [MAIN ] UAA: Generated 138 derivative records from 53496 primary records. [2025-10-28T22:19:42.231946] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-28T22:19:42.231912] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-28T22:19:42.268571] [DEBUG] [LOCAL ] UAA: Derivative data saved (138 records). [2025-10-28T22:19:42.268749] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-28T22:19:42.271185] [DEBUG] [LOCAL ] UAN: Derivative data saved (138 records). [2025-10-28T22:19:42.273727] [INFO ] [MAIN ] Derivative Progress: 1853/2046 symbols completed. UAA took 1.2s. Estimated remaining: 1m 18s. Rate: 147.9 symbols/min [2025-10-28T22:19:42.273923] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:42.273998] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-28T22:19:42.276516] [INFO ] [MAIN ] Derivative Progress: 1854/2046 symbols completed. UAN took 1.0s. Estimated remaining: 1m 18s. Rate: 148.0 symbols/min [2025-10-28T22:19:42.276902] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:42.296334] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-28T22:19:42.296607] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-28T22:19:42.621966] [DEBUG] [LOCAL ] UCB: Loaded 37299 existing records from primary storage. [2025-10-28T22:19:42.635535] [INFO ] [MAIN ] UCB: Loaded 37299 primary data records. [2025-10-28T22:19:42.702746] [DEBUG] [LOCAL ] UBS: Loaded 52223 existing records from primary storage. [2025-10-28T22:19:42.715296] [INFO ] [MAIN ] UBS: Loaded 52223 primary data records. [2025-10-28T22:19:43.253994] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:43.303548] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:43.331310] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:43.362053] [INFO ] [MAIN ] UBER: Generated 138 derivative records from 53806 primary records. [2025-10-28T22:19:43.363535] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-28T22:19:43.383678] [DEBUG] [LOCAL ] UBER: Derivative data saved (138 records). [2025-10-28T22:19:43.384337] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-28T22:19:43.386551] [INFO ] [MAIN ] Derivative Progress: 1855/2046 symbols completed. UBER took 1.2s. Estimated remaining: 1m 18s. Rate: 147.8 symbols/min [2025-10-28T22:19:43.389483] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:43.414549] [INFO ] [MAIN ] UCB: Generated 138 derivative records from 37299 primary records. [2025-10-28T22:19:43.416811] [INFO ] [MAIN ] UBS: Generated 138 derivative records from 52223 primary records. [2025-10-28T22:19:43.417189] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-28T22:19:43.417132] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-28T22:19:43.452836] [DEBUG] [LOCAL ] UCB: Derivative data saved (138 records). [2025-10-28T22:19:43.453032] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-28T22:19:43.454509] [DEBUG] [LOCAL ] UBS: Derivative data saved (138 records). [2025-10-28T22:19:43.456962] [INFO ] [MAIN ] Derivative Progress: 1856/2046 symbols completed. UCB took 1.2s. Estimated remaining: 1m 17s. Rate: 147.9 symbols/min [2025-10-28T22:19:43.457190] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:43.457524] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-28T22:19:43.460334] [INFO ] [MAIN ] Derivative Progress: 1857/2046 symbols completed. UBS took 1.2s. Estimated remaining: 1m 17s. Rate: 148.0 symbols/min [2025-10-28T22:19:43.460716] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:43.479810] [DEBUG] [LOCAL ] UDR: Loaded 52104 existing records from primary storage. [2025-10-28T22:19:43.479979] [INFO ] [MAIN ] UDR: Loaded 52104 primary data records. [2025-10-28T22:19:43.537832] [DEBUG] [LOCAL ] UFI: Loaded 8027 existing records from primary storage. [2025-10-28T22:19:43.546617] [INFO ] [MAIN ] UFI: Loaded 8027 primary data records. [2025-10-28T22:19:43.761488] [DEBUG] [LOCAL ] UE: Loaded 42209 existing records from primary storage. [2025-10-28T22:19:43.940172] [INFO ] [MAIN ] UE: Loaded 42209 primary data records. [2025-10-28T22:19:44.441379] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:44.469432] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:44.514732] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:44.550132] [INFO ] [MAIN ] UDR: Generated 138 derivative records from 52104 primary records. [2025-10-28T22:19:44.550728] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-28T22:19:44.567013] [DEBUG] [LOCAL ] UDR: Derivative data saved (138 records). [2025-10-28T22:19:44.569121] [INFO ] [MAIN ] UFI: Generated 138 derivative records from 8027 primary records. [2025-10-28T22:19:44.569391] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-28T22:19:44.568849] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-28T22:19:44.571755] [INFO ] [MAIN ] Derivative Progress: 1858/2046 symbols completed. UDR took 1.2s. Estimated remaining: 1m 16s. Rate: 147.8 symbols/min [2025-10-28T22:19:44.586208] [DEBUG] [LOCAL ] UFI: Derivative data saved (138 records). [2025-10-28T22:19:44.586611] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-28T22:19:44.591178] [INFO ] [MAIN ] Derivative Progress: 1859/2046 symbols completed. UFI took 1.1s. Estimated remaining: 1m 16s. Rate: 147.9 symbols/min [2025-10-28T22:19:44.593546] [INFO ] [MAIN ] UE: Generated 138 derivative records from 42209 primary records. [2025-10-28T22:19:44.593615] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-28T22:19:44.604935] [DEBUG] [LOCAL ] UE: Derivative data saved (138 records). [2025-10-28T22:19:44.604988] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-28T22:19:44.607442] [INFO ] [MAIN ] Derivative Progress: 1860/2046 symbols completed. UE took 1.2s. Estimated remaining: 1m 15s. Rate: 148.0 symbols/min [2025-10-28T22:19:44.608094] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:44.608021] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:44.608223] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:44.624814] [DEBUG] [LOCAL ] UHAL: Loaded 16728 existing records from primary storage. [2025-10-28T22:19:44.625167] [INFO ] [MAIN ] UHAL: Loaded 16728 primary data records. [2025-10-28T22:19:44.834323] [DEBUG] [LOCAL ] UGP: Loaded 43031 existing records from primary storage. [2025-10-28T22:19:44.963847] [INFO ] [MAIN ] UGP: Loaded 43031 primary data records. [2025-10-28T22:19:44.970187] [DEBUG] [LOCAL ] UGI: Loaded 50293 existing records from primary storage. [2025-10-28T22:19:44.975830] [INFO ] [MAIN ] UGI: Loaded 50293 primary data records. [2025-10-28T22:19:45.620423] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:45.663912] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:45.700344] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:45.735908] [INFO ] [MAIN ] UHAL: Generated 138 derivative records from 16728 primary records. [2025-10-28T22:19:45.736503] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-28T22:19:45.765291] [DEBUG] [LOCAL ] UHAL: Derivative data saved (138 records). [2025-10-28T22:19:45.767625] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-28T22:19:45.769814] [INFO ] [MAIN ] Derivative Progress: 1861/2046 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 15s. Rate: 147.8 symbols/min [2025-10-28T22:19:45.773000] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:45.782773] [INFO ] [MAIN ] UGP: Generated 138 derivative records from 43031 primary records. [2025-10-28T22:19:45.784340] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-28T22:19:45.786334] [INFO ] [MAIN ] UGI: Generated 138 derivative records from 50293 primary records. [2025-10-28T22:19:45.787200] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-28T22:19:45.812207] [DEBUG] [LOCAL ] UGI: Derivative data saved (138 records). [2025-10-28T22:19:45.812377] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-28T22:19:45.811510] [DEBUG] [LOCAL ] UGP: Derivative data saved (138 records). [2025-10-28T22:19:45.815494] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-28T22:19:45.815274] [INFO ] [MAIN ] Derivative Progress: 1862/2046 symbols completed. UGI took 1.2s. Estimated remaining: 1m 15s. Rate: 147.9 symbols/min [2025-10-28T22:19:45.818146] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:45.818591] [INFO ] [MAIN ] Derivative Progress: 1863/2046 symbols completed. UGP took 1.2s. Estimated remaining: 1m 14s. Rate: 148.0 symbols/min [2025-10-28T22:19:45.818913] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:45.837191] [DEBUG] [LOCAL ] UHT: Loaded 10149 existing records from primary storage. [2025-10-28T22:19:45.840618] [INFO ] [MAIN ] UHT: Loaded 10149 primary data records. [2025-10-28T22:19:45.963777] [DEBUG] [LOCAL ] UI: Loaded 14354 existing records from primary storage. [2025-10-28T22:19:45.964463] [DEBUG] [LOCAL ] UHS: Loaded 39503 existing records from primary storage. [2025-10-28T22:19:45.965021] [INFO ] [MAIN ] UHS: Loaded 39503 primary data records. [2025-10-28T22:19:45.980727] [INFO ] [MAIN ] UI: Loaded 14354 primary data records. [2025-10-28T22:19:46.764907] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:46.825097] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:46.824583] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:46.862512] [INFO ] [MAIN ] UHT: Generated 138 derivative records from 10149 primary records. [2025-10-28T22:19:46.865799] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-28T22:19:46.878144] [DEBUG] [LOCAL ] UHT: Derivative data saved (138 records). [2025-10-28T22:19:46.879228] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-28T22:19:46.883982] [INFO ] [MAIN ] Derivative Progress: 1864/2046 symbols completed. UHT took 1.1s. Estimated remaining: 1m 14s. Rate: 147.8 symbols/min [2025-10-28T22:19:46.884467] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:46.916281] [INFO ] [MAIN ] UI: Generated 138 derivative records from 14354 primary records. [2025-10-28T22:19:46.917880] [INFO ] [MAIN ] UHS: Generated 138 derivative records from 39503 primary records. [2025-10-28T22:19:46.918070] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-28T22:19:46.918022] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-28T22:19:46.940600] [DEBUG] [LOCAL ] UHS: Derivative data saved (138 records). [2025-10-28T22:19:46.940924] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-28T22:19:46.950143] [INFO ] [MAIN ] Derivative Progress: 1865/2046 symbols completed. UHS took 1.2s. Estimated remaining: 1m 13s. Rate: 147.9 symbols/min [2025-10-28T22:19:46.951065] [DEBUG] [LOCAL ] UIS: Loaded 36132 existing records from primary storage. [2025-10-28T22:19:46.951183] [INFO ] [MAIN ] UIS: Loaded 36132 primary data records. [2025-10-28T22:19:46.951285] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:46.976142] [DEBUG] [LOCAL ] UI: Derivative data saved (138 records). [2025-10-28T22:19:46.991301] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-28T22:19:46.994075] [INFO ] [MAIN ] Derivative Progress: 1866/2046 symbols completed. UI took 1.2s. Estimated remaining: 1m 13s. Rate: 148.0 symbols/min [2025-10-28T22:19:47.033862] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:47.308246] [DEBUG] [LOCAL ] UL: Loaded 53059 existing records from primary storage. [2025-10-28T22:19:47.306967] [DEBUG] [LOCAL ] ULS: Loaded 38017 existing records from primary storage. [2025-10-28T22:19:47.308580] [INFO ] [MAIN ] UL: Loaded 53059 primary data records. [2025-10-28T22:19:47.308791] [INFO ] [MAIN ] ULS: Loaded 38017 primary data records. [2025-10-28T22:19:47.941395] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:47.989272] [INFO ] [MAIN ] UIS: Generated 138 derivative records from 36132 primary records. [2025-10-28T22:19:47.991680] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-28T22:19:48.028726] [DEBUG] [LOCAL ] UIS: Derivative data saved (138 records). [2025-10-28T22:19:48.029313] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:48.029601] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-28T22:19:48.031792] [INFO ] [MAIN ] Derivative Progress: 1867/2046 symbols completed. UIS took 1.1s. Estimated remaining: 1m 13s. Rate: 147.9 symbols/min [2025-10-28T22:19:48.031956] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:48.032371] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:48.107666] [INFO ] [MAIN ] UL: Generated 138 derivative records from 53059 primary records. [2025-10-28T22:19:48.108286] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-28T22:19:48.112176] [INFO ] [MAIN ] ULS: Generated 138 derivative records from 38017 primary records. [2025-10-28T22:19:48.119757] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-28T22:19:48.139080] [DEBUG] [LOCAL ] UMC: Loaded 52655 existing records from primary storage. [2025-10-28T22:19:48.138314] [DEBUG] [LOCAL ] UL: Derivative data saved (138 records). [2025-10-28T22:19:48.139465] [INFO ] [MAIN ] UMC: Loaded 52655 primary data records. [2025-10-28T22:19:48.139544] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-28T22:19:48.162983] [INFO ] [MAIN ] Derivative Progress: 1868/2046 symbols completed. UL took 1.2s. Estimated remaining: 1m 12s. Rate: 147.9 symbols/min [2025-10-28T22:19:48.163423] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:48.191166] [DEBUG] [LOCAL ] ULS: Derivative data saved (138 records). [2025-10-28T22:19:48.246137] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-28T22:19:48.259822] [INFO ] [MAIN ] Derivative Progress: 1869/2046 symbols completed. ULS took 1.2s. Estimated remaining: 1m 12s. Rate: 148.0 symbols/min [2025-10-28T22:19:48.260325] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:48.466891] [DEBUG] [LOCAL ] UNF: Loaded 11776 existing records from primary storage. [2025-10-28T22:19:48.467435] [INFO ] [MAIN ] UNF: Loaded 11776 primary data records. [2025-10-28T22:19:48.571166] [DEBUG] [LOCAL ] UMH: Loaded 33879 existing records from primary storage. [2025-10-28T22:19:48.582296] [INFO ] [MAIN ] UMH: Loaded 33879 primary data records. [2025-10-28T22:19:49.103098] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:49.151737] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:49.183996] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:49.218280] [INFO ] [MAIN ] UMC: Generated 138 derivative records from 52655 primary records. [2025-10-28T22:19:49.222182] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-28T22:19:49.237716] [DEBUG] [LOCAL ] UMC: Derivative data saved (138 records). [2025-10-28T22:19:49.242749] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-28T22:19:49.246040] [INFO ] [MAIN ] Derivative Progress: 1870/2046 symbols completed. UMC took 1.2s. Estimated remaining: 1m 11s. Rate: 147.9 symbols/min [2025-10-28T22:19:49.249159] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:49.266129] [INFO ] [MAIN ] UNF: Generated 138 derivative records from 11776 primary records. [2025-10-28T22:19:49.266338] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-28T22:19:49.269418] [INFO ] [MAIN ] UMH: Generated 138 derivative records from 33879 primary records. [2025-10-28T22:19:49.278678] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-28T22:19:49.281485] [DEBUG] [LOCAL ] UNF: Derivative data saved (138 records). [2025-10-28T22:19:49.281889] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-28T22:19:49.284763] [INFO ] [MAIN ] Derivative Progress: 1871/2046 symbols completed. UNF took 1.0s. Estimated remaining: 1m 11s. Rate: 147.9 symbols/min [2025-10-28T22:19:49.292195] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:49.306947] [DEBUG] [LOCAL ] UMH: Derivative data saved (138 records). [2025-10-28T22:19:49.307171] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-28T22:19:49.310378] [INFO ] [MAIN ] Derivative Progress: 1872/2046 symbols completed. UMH took 1.1s. Estimated remaining: 1m 11s. Rate: 148.0 symbols/min [2025-10-28T22:19:49.310508] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:49.328408] [DEBUG] [LOCAL ] UNFI: Loaded 42371 existing records from primary storage. [2025-10-28T22:19:49.328679] [INFO ] [MAIN ] UNFI: Loaded 42371 primary data records. [2025-10-28T22:19:49.708942] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-28T22:19:49.711165] [INFO ] [MAIN ] UNH: Loaded 53819 primary data records. [2025-10-28T22:19:49.710953] [DEBUG] [LOCAL ] UNM: Loaded 47710 existing records from primary storage. [2025-10-28T22:19:49.723115] [INFO ] [MAIN ] UNM: Loaded 47710 primary data records. [2025-10-28T22:19:50.330488] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:50.394074] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:50.393914] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:50.426132] [INFO ] [MAIN ] UNFI: Generated 138 derivative records from 42371 primary records. [2025-10-28T22:19:50.426476] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-28T22:19:50.446164] [DEBUG] [LOCAL ] UNFI: Derivative data saved (138 records). [2025-10-28T22:19:50.448317] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-28T22:19:50.451107] [INFO ] [MAIN ] Derivative Progress: 1873/2046 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 10s. Rate: 147.9 symbols/min [2025-10-28T22:19:50.472144] [INFO ] [MAIN ] UNM: Generated 138 derivative records from 47710 primary records. [2025-10-28T22:19:50.473886] [INFO ] [MAIN ] UNH: Generated 138 derivative records from 53819 primary records. [2025-10-28T22:19:50.473969] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-28T22:19:50.474033] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-28T22:19:50.497889] [DEBUG] [LOCAL ] UNH: Derivative data saved (138 records). [2025-10-28T22:19:50.497961] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-28T22:19:50.500747] [INFO ] [MAIN ] Derivative Progress: 1874/2046 symbols completed. UNH took 1.2s. Estimated remaining: 1m 10s. Rate: 147.9 symbols/min [2025-10-28T22:19:50.497587] [DEBUG] [LOCAL ] UNM: Derivative data saved (138 records). [2025-10-28T22:19:50.501012] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-28T22:19:50.502793] [INFO ] [MAIN ] Derivative Progress: 1875/2046 symbols completed. UNM took 1.2s. Estimated remaining: 1m 9s. Rate: 148.0 symbols/min [2025-10-28T22:19:50.503149] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:50.503266] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:50.503961] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:50.508973] [DEBUG] [LOCAL ] UNMA: Loaded 3353 existing records from primary storage. [2025-10-28T22:19:50.509248] [INFO ] [MAIN ] UNMA: Loaded 3353 primary data records. [2025-10-28T22:19:50.836777] [DEBUG] [LOCAL ] UP: Loaded 44754 existing records from primary storage. [2025-10-28T22:19:50.837701] [INFO ] [MAIN ] UP: Loaded 44754 primary data records. [2025-10-28T22:19:50.960908] [DEBUG] [LOCAL ] UNP: Loaded 53355 existing records from primary storage. [2025-10-28T22:19:50.966512] [INFO ] [MAIN ] UNP: Loaded 53355 primary data records. [2025-10-28T22:19:51.467117] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:51.522253] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:51.539381] [INFO ] [MAIN ] UNMA: Generated 138 derivative records from 3353 primary records. [2025-10-28T22:19:51.540294] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-28T22:19:51.566987] [DEBUG] [LOCAL ] UNMA: Derivative data saved (138 records). [2025-10-28T22:19:51.569830] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-28T22:19:51.564313] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:51.572451] [INFO ] [MAIN ] Derivative Progress: 1876/2046 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 9s. Rate: 147.9 symbols/min [2025-10-28T22:19:51.590309] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:51.612951] [INFO ] [MAIN ] UP: Generated 138 derivative records from 44754 primary records. [2025-10-28T22:19:51.615200] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-28T22:19:51.642000] [DEBUG] [LOCAL ] UP: Derivative data saved (138 records). [2025-10-28T22:19:51.644569] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-28T22:19:51.646975] [INFO ] [MAIN ] Derivative Progress: 1877/2046 symbols completed. UP took 1.1s. Estimated remaining: 1m 9s. Rate: 147.9 symbols/min [2025-10-28T22:19:51.648846] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:51.665513] [INFO ] [MAIN ] UNP: Generated 138 derivative records from 53355 primary records. [2025-10-28T22:19:51.666623] [DEBUG] [LOCAL ] UPS: Loaded 53721 existing records from primary storage. [2025-10-28T22:19:51.666825] [INFO ] [MAIN ] UPS: Loaded 53721 primary data records. [2025-10-28T22:19:51.667034] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-28T22:19:51.756861] [DEBUG] [LOCAL ] UNP: Derivative data saved (138 records). [2025-10-28T22:19:51.773543] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-28T22:19:51.795481] [INFO ] [MAIN ] Derivative Progress: 1878/2046 symbols completed. UNP took 1.3s. Estimated remaining: 1m 8s. Rate: 148.0 symbols/min [2025-10-28T22:19:51.795836] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:51.919705] [DEBUG] [LOCAL ] URI: Loaded 34110 existing records from primary storage. [2025-10-28T22:19:52.031320] [INFO ] [MAIN ] URI: Loaded 34110 primary data records. [2025-10-28T22:19:52.232910] [DEBUG] [LOCAL ] USA: Loaded 36113 existing records from primary storage. [2025-10-28T22:19:52.347938] [INFO ] [MAIN ] USA: Loaded 36113 primary data records. [2025-10-28T22:19:52.527888] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:52.719843] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:52.756305] [INFO ] [MAIN ] UPS: Generated 138 derivative records from 53721 primary records. [2025-10-28T22:19:52.760071] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-28T22:19:52.783270] [DEBUG] [LOCAL ] UPS: Derivative data saved (138 records). [2025-10-28T22:19:52.788452] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:52.788874] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-28T22:19:52.806464] [INFO ] [MAIN ] Derivative Progress: 1879/2046 symbols completed. UPS took 1.2s. Estimated remaining: 1m 8s. Rate: 147.9 symbols/min [2025-10-28T22:19:52.807423] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:52.819737] [INFO ] [MAIN ] URI: Generated 138 derivative records from 34110 primary records. [2025-10-28T22:19:52.820081] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-28T22:19:52.843397] [DEBUG] [LOCAL ] URI: Derivative data saved (138 records). [2025-10-28T22:19:52.843540] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-28T22:19:52.845761] [INFO ] [MAIN ] Derivative Progress: 1880/2046 symbols completed. URI took 1.2s. Estimated remaining: 1m 7s. Rate: 147.9 symbols/min [2025-10-28T22:19:52.845909] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:52.858249] [DEBUG] [LOCAL ] USAC: Loaded 21458 existing records from primary storage. [2025-10-28T22:19:52.859534] [INFO ] [MAIN ] USAC: Loaded 21458 primary data records. [2025-10-28T22:19:52.882815] [INFO ] [MAIN ] USA: Generated 138 derivative records from 36113 primary records. [2025-10-28T22:19:52.906133] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-28T22:19:52.980430] [DEBUG] [LOCAL ] USA: Derivative data saved (138 records). [2025-10-28T22:19:52.980670] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-28T22:19:52.983242] [INFO ] [MAIN ] Derivative Progress: 1881/2046 symbols completed. USA took 1.2s. Estimated remaining: 1m 7s. Rate: 148.0 symbols/min [2025-10-28T22:19:52.983375] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:53.207854] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-28T22:19:53.209102] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-28T22:19:53.528572] [DEBUG] [LOCAL ] USFD: Loaded 51008 existing records from primary storage. [2025-10-28T22:19:53.528956] [INFO ] [MAIN ] USFD: Loaded 51008 primary data records. [2025-10-28T22:19:53.624453] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:53.929619] [INFO ] [MAIN ] USAC: Generated 138 derivative records from 21458 primary records. [2025-10-28T22:19:53.934736] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-28T22:19:53.935665] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:53.958598] [DEBUG] [LOCAL ] USAC: Derivative data saved (138 records). [2025-10-28T22:19:53.958911] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-28T22:19:53.962952] [INFO ] [MAIN ] Derivative Progress: 1882/2046 symbols completed. USAC took 1.2s. Estimated remaining: 1m 7s. Rate: 147.9 symbols/min [2025-10-28T22:19:53.963179] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:53.995159] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:54.002110] [DEBUG] [LOCAL ] USNA: Loaded 17994 existing records from primary storage. [2025-10-28T22:19:54.015832] [INFO ] [MAIN ] USNA: Loaded 17994 primary data records. [2025-10-28T22:19:54.201461] [INFO ] [MAIN ] USB: Generated 138 derivative records from 53688 primary records. [2025-10-28T22:19:54.201616] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-28T22:19:54.335074] [DEBUG] [LOCAL ] USB: Derivative data saved (138 records). [2025-10-28T22:19:54.335729] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-28T22:19:54.339632] [INFO ] [MAIN ] Derivative Progress: 1883/2046 symbols completed. USB took 1.5s. Estimated remaining: 1m 6s. Rate: 147.9 symbols/min [2025-10-28T22:19:54.342504] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:54.347473] [INFO ] [MAIN ] USFD: Generated 138 derivative records from 51008 primary records. [2025-10-28T22:19:54.347719] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-28T22:19:54.360271] [DEBUG] [LOCAL ] USFD: Derivative data saved (138 records). [2025-10-28T22:19:54.360488] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-28T22:19:54.362926] [INFO ] [MAIN ] Derivative Progress: 1884/2046 symbols completed. USFD took 1.4s. Estimated remaining: 1m 6s. Rate: 148.0 symbols/min [2025-10-28T22:19:54.363227] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:54.388744] [DEBUG] [LOCAL ] USPH: Loaded 16679 existing records from primary storage. [2025-10-28T22:19:54.389132] [INFO ] [MAIN ] USPH: Loaded 16679 primary data records. [2025-10-28T22:19:54.389335] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:54.522080] [DEBUG] [LOCAL ] UTF: Loaded 31077 existing records from primary storage. [2025-10-28T22:19:54.543504] [INFO ] [MAIN ] UTF: Loaded 31077 primary data records. [2025-10-28T22:19:55.052782] [INFO ] [MAIN ] USNA: Generated 138 derivative records from 17994 primary records. [2025-10-28T22:19:55.053342] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-28T22:19:55.069127] [DEBUG] [LOCAL ] USNA: Derivative data saved (138 records). [2025-10-28T22:19:55.069537] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-28T22:19:55.071615] [INFO ] [MAIN ] Derivative Progress: 1885/2046 symbols completed. USNA took 1.1s. Estimated remaining: 1m 5s. Rate: 147.9 symbols/min [2025-10-28T22:19:55.072133] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:55.089980] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:55.122452] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:55.183013] [DEBUG] [LOCAL ] UTI: Loaded 40099 existing records from primary storage. [2025-10-28T22:19:55.187808] [INFO ] [MAIN ] UTI: Loaded 40099 primary data records. [2025-10-28T22:19:55.316636] [INFO ] [MAIN ] USPH: Generated 138 derivative records from 16679 primary records. [2025-10-28T22:19:55.316976] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-28T22:19:55.416961] [INFO ] [MAIN ] UTF: Generated 138 derivative records from 31077 primary records. [2025-10-28T22:19:55.418391] [DEBUG] [LOCAL ] USPH: Derivative data saved (138 records). [2025-10-28T22:19:55.503970] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-28T22:19:55.540721] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-28T22:19:55.555701] [INFO ] [MAIN ] Derivative Progress: 1886/2046 symbols completed. USPH took 1.2s. Estimated remaining: 1m 5s. Rate: 147.9 symbols/min [2025-10-28T22:19:55.556807] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:55.575477] [DEBUG] [LOCAL ] UTF: Derivative data saved (138 records). [2025-10-28T22:19:55.576466] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-28T22:19:55.580084] [INFO ] [MAIN ] Derivative Progress: 1887/2046 symbols completed. UTF took 1.2s. Estimated remaining: 1m 4s. Rate: 148.0 symbols/min [2025-10-28T22:19:55.581122] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:55.593751] [DEBUG] [LOCAL ] UTL: Loaded 11825 existing records from primary storage. [2025-10-28T22:19:55.594244] [INFO ] [MAIN ] UTL: Loaded 11825 primary data records. [2025-10-28T22:19:55.811104] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:56.166379] [DEBUG] [LOCAL ] UTZ: Loaded 43998 existing records from primary storage. [2025-10-28T22:19:56.167841] [INFO ] [MAIN ] UTZ: Loaded 43998 primary data records. [2025-10-28T22:19:56.469556] [INFO ] [MAIN ] UTI: Generated 138 derivative records from 40099 primary records. [2025-10-28T22:19:56.592514] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-28T22:19:56.618590] [DEBUG] [LOCAL ] UTI: Derivative data saved (138 records). [2025-10-28T22:19:56.619746] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-28T22:19:56.628265] [INFO ] [MAIN ] Derivative Progress: 1888/2046 symbols completed. UTI took 1.6s. Estimated remaining: 1m 4s. Rate: 147.8 symbols/min [2025-10-28T22:19:56.643346] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:56.685086] [INFO ] [MAIN ] UTL: Generated 138 derivative records from 11825 primary records. [2025-10-28T22:19:56.697432] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-28T22:19:56.698252] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:56.724305] [DEBUG] [LOCAL ] UTL: Derivative data saved (138 records). [2025-10-28T22:19:56.725592] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-28T22:19:56.728287] [INFO ] [MAIN ] Derivative Progress: 1889/2046 symbols completed. UTL took 1.2s. Estimated remaining: 1m 4s. Rate: 147.9 symbols/min [2025-10-28T22:19:56.742303] [INFO ] [MAIN ] UTZ: Generated 138 derivative records from 43998 primary records. [2025-10-28T22:19:56.742394] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-28T22:19:56.754004] [DEBUG] [LOCAL ] UTZ: Derivative data saved (138 records). [2025-10-28T22:19:56.754070] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-28T22:19:56.756331] [INFO ] [MAIN ] Derivative Progress: 1890/2046 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 3s. Rate: 148.0 symbols/min [2025-10-28T22:19:56.756882] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:56.756826] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:56.757267] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:56.790486] [DEBUG] [LOCAL ] UVV: Loaded 22552 existing records from primary storage. [2025-10-28T22:19:56.790122] [DEBUG] [LOCAL ] UVE: Loaded 21949 existing records from primary storage. [2025-10-28T22:19:56.790683] [INFO ] [MAIN ] UVV: Loaded 22552 primary data records. [2025-10-28T22:19:56.790916] [INFO ] [MAIN ] UVE: Loaded 21949 primary data records. [2025-10-28T22:19:57.090465] [DEBUG] [LOCAL ] UWMC: Loaded 52956 existing records from primary storage. [2025-10-28T22:19:57.151662] [INFO ] [MAIN ] UWMC: Loaded 52956 primary data records. [2025-10-28T22:19:57.760338] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:57.773066] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:57.827418] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:57.858032] [INFO ] [MAIN ] UVV: Generated 138 derivative records from 22552 primary records. [2025-10-28T22:19:57.858837] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-28T22:19:57.870900] [INFO ] [MAIN ] UVE: Generated 138 derivative records from 21949 primary records. [2025-10-28T22:19:57.872517] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-28T22:19:57.876717] [DEBUG] [LOCAL ] UVV: Derivative data saved (138 records). [2025-10-28T22:19:57.883735] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-28T22:19:57.886075] [INFO ] [MAIN ] Derivative Progress: 1891/2046 symbols completed. UVV took 1.1s. Estimated remaining: 1m 3s. Rate: 147.8 symbols/min [2025-10-28T22:19:57.890352] [DEBUG] [LOCAL ] UVE: Derivative data saved (138 records). [2025-10-28T22:19:57.890667] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-28T22:19:57.890454] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:57.892901] [INFO ] [MAIN ] Derivative Progress: 1892/2046 symbols completed. UVE took 1.1s. Estimated remaining: 1m 2s. Rate: 147.9 symbols/min [2025-10-28T22:19:57.893402] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:57.907159] [DEBUG] [LOCAL ] UZD: Loaded 5591 existing records from primary storage. [2025-10-28T22:19:57.911061] [DEBUG] [LOCAL ] UZE: Loaded 6710 existing records from primary storage. [2025-10-28T22:19:57.911173] [INFO ] [MAIN ] UZD: Loaded 5591 primary data records. [2025-10-28T22:19:57.911260] [INFO ] [MAIN ] UZE: Loaded 6710 primary data records. [2025-10-28T22:19:58.212783] [INFO ] [MAIN ] UWMC: Generated 138 derivative records from 52956 primary records. [2025-10-28T22:19:58.244104] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-28T22:19:58.551990] [DEBUG] [LOCAL ] UWMC: Derivative data saved (138 records). [2025-10-28T22:19:58.552268] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-28T22:19:58.555113] [INFO ] [MAIN ] Derivative Progress: 1893/2046 symbols completed. UWMC took 1.8s. Estimated remaining: 1m 2s. Rate: 147.9 symbols/min [2025-10-28T22:19:58.556004] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:58.580862] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:58.624873] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:58.671467] [DEBUG] [LOCAL ] V: Loaded 53745 existing records from primary storage. [2025-10-28T22:19:58.672216] [INFO ] [MAIN ] V: Loaded 53745 primary data records. [2025-10-28T22:19:58.863445] [INFO ] [MAIN ] UZD: Generated 138 derivative records from 5591 primary records. [2025-10-28T22:19:58.963128] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-28T22:19:58.992279] [INFO ] [MAIN ] UZE: Generated 138 derivative records from 6710 primary records. [2025-10-28T22:19:58.994719] [DEBUG] [LOCAL ] UZD: Derivative data saved (138 records). [2025-10-28T22:19:58.995262] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-28T22:19:58.995007] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-28T22:19:58.997756] [INFO ] [MAIN ] Derivative Progress: 1894/2046 symbols completed. UZD took 1.1s. Estimated remaining: 1m 2s. Rate: 147.9 symbols/min [2025-10-28T22:19:58.998445] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:59.010424] [DEBUG] [LOCAL ] UZE: Derivative data saved (138 records). [2025-10-28T22:19:59.010675] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-28T22:19:59.012983] [INFO ] [MAIN ] Derivative Progress: 1895/2046 symbols completed. UZE took 1.1s. Estimated remaining: 1m 1s. Rate: 147.9 symbols/min [2025-10-28T22:19:59.013185] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:59.042975] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:59.077820] [DEBUG] [LOCAL ] VAC: Loaded 33295 existing records from primary storage. [2025-10-28T22:19:59.080883] [INFO ] [MAIN ] VAC: Loaded 33295 primary data records. [2025-10-28T22:19:59.207311] [DEBUG] [LOCAL ] VAL: Loaded 49675 existing records from primary storage. [2025-10-28T22:19:59.282416] [INFO ] [MAIN ] VAL: Loaded 49675 primary data records. [2025-10-28T22:19:59.532337] [INFO ] [MAIN ] V: Generated 138 derivative records from 53745 primary records. [2025-10-28T22:19:59.543173] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-28T22:19:59.746216] [DEBUG] [LOCAL ] V: Derivative data saved (138 records). [2025-10-28T22:19:59.746538] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-28T22:19:59.749321] [INFO ] [MAIN ] Derivative Progress: 1896/2046 symbols completed. V took 1.2s. Estimated remaining: 1m 1s. Rate: 147.9 symbols/min [2025-10-28T22:19:59.749501] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:59.769402] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:59.815052] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:19:59.854196] [INFO ] [MAIN ] VAC: Generated 138 derivative records from 33295 primary records. [2025-10-28T22:19:59.857030] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-28T22:19:59.875593] [DEBUG] [LOCAL ] VAC: Derivative data saved (138 records). [2025-10-28T22:19:59.876677] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-28T22:19:59.880107] [INFO ] [MAIN ] Derivative Progress: 1897/2046 symbols completed. VAC took 0.9s. Estimated remaining: 1m 0s. Rate: 147.9 symbols/min [2025-10-28T22:19:59.881092] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:19:59.899835] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-28T22:19:59.900361] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-28T22:19:59.995272] [DEBUG] [LOCAL ] VATE: Loaded 4983 existing records from primary storage. [2025-10-28T22:20:00.010002] [INFO ] [MAIN ] VATE: Loaded 4983 primary data records. [2025-10-28T22:20:00.042203] [INFO ] [MAIN ] VAL: Generated 138 derivative records from 49675 primary records. [2025-10-28T22:20:00.080887] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-28T22:20:00.359504] [DEBUG] [LOCAL ] VAL: Derivative data saved (138 records). [2025-10-28T22:20:00.379890] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-28T22:20:00.393248] [INFO ] [MAIN ] Derivative Progress: 1898/2046 symbols completed. VAL took 1.4s. Estimated remaining: 1m 0s. Rate: 147.9 symbols/min [2025-10-28T22:20:00.415964] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:00.576186] [DEBUG] [LOCAL ] VBF: Loaded 7093 existing records from primary storage. [2025-10-28T22:20:00.576742] [INFO ] [MAIN ] VBF: Loaded 7093 primary data records. [2025-10-28T22:20:00.898043] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:00.944087] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:00.981320] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:01.015331] [INFO ] [MAIN ] VALE: Generated 138 derivative records from 53693 primary records. [2025-10-28T22:20:01.016340] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-28T22:20:01.033501] [DEBUG] [LOCAL ] VALE: Derivative data saved (138 records). [2025-10-28T22:20:01.034149] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-28T22:20:01.036573] [INFO ] [MAIN ] Derivative Progress: 1899/2046 symbols completed. VALE took 1.3s. Estimated remaining: 59.7s. Rate: 147.9 symbols/min [2025-10-28T22:20:01.036826] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:01.060990] [INFO ] [MAIN ] VATE: Generated 138 derivative records from 4983 primary records. [2025-10-28T22:20:01.060767] [DEBUG] [LOCAL ] VCV: Loaded 13088 existing records from primary storage. [2025-10-28T22:20:01.061170] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-28T22:20:01.061313] [INFO ] [MAIN ] VCV: Loaded 13088 primary data records. [2025-10-28T22:20:01.127480] [DEBUG] [LOCAL ] VATE: Derivative data saved (138 records). [2025-10-28T22:20:01.141618] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-28T22:20:01.157401] [INFO ] [MAIN ] VBF: Generated 138 derivative records from 7093 primary records. [2025-10-28T22:20:01.156909] [INFO ] [MAIN ] Derivative Progress: 1900/2046 symbols completed. VATE took 1.3s. Estimated remaining: 59.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:01.169435] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:01.180236] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-28T22:20:01.273291] [DEBUG] [LOCAL ] VBF: Derivative data saved (138 records). [2025-10-28T22:20:01.273453] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-28T22:20:01.382777] [INFO ] [MAIN ] Derivative Progress: 1901/2046 symbols completed. VBF took 1.0s. Estimated remaining: 58.8s. Rate: 147.9 symbols/min [2025-10-28T22:20:01.391066] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:01.416573] [DEBUG] [LOCAL ] VEL: Loaded 11691 existing records from primary storage. [2025-10-28T22:20:01.417028] [INFO ] [MAIN ] VEL: Loaded 11691 primary data records. [2025-10-28T22:20:01.536805] [DEBUG] [LOCAL ] VEEV: Loaded 46787 existing records from primary storage. [2025-10-28T22:20:01.563071] [INFO ] [MAIN ] VEEV: Loaded 46787 primary data records. [2025-10-28T22:20:01.762285] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:02.153397] [INFO ] [MAIN ] VCV: Generated 138 derivative records from 13088 primary records. [2025-10-28T22:20:02.154351] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-28T22:20:02.180006] [DEBUG] [LOCAL ] VCV: Derivative data saved (138 records). [2025-10-28T22:20:02.178634] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:02.180860] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-28T22:20:02.237998] [INFO ] [MAIN ] Derivative Progress: 1902/2046 symbols completed. VCV took 1.2s. Estimated remaining: 58.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:02.247167] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:02.264671] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:02.330448] [INFO ] [MAIN ] VEL: Generated 138 derivative records from 11691 primary records. [2025-10-28T22:20:02.334012] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-28T22:20:02.348524] [DEBUG] [LOCAL ] VEL: Derivative data saved (138 records). [2025-10-28T22:20:02.351409] [INFO ] [MAIN ] VEEV: Generated 138 derivative records from 46787 primary records. [2025-10-28T22:20:02.364804] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-28T22:20:02.364704] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-28T22:20:02.368991] [INFO ] [MAIN ] Derivative Progress: 1903/2046 symbols completed. VEL took 1.0s. Estimated remaining: 58.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:02.366786] [DEBUG] [LOCAL ] VET: Loaded 43759 existing records from primary storage. [2025-10-28T22:20:02.378358] [INFO ] [MAIN ] VET: Loaded 43759 primary data records. [2025-10-28T22:20:02.381661] [DEBUG] [LOCAL ] VEEV: Derivative data saved (138 records). [2025-10-28T22:20:02.381820] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-28T22:20:02.384533] [INFO ] [MAIN ] Derivative Progress: 1904/2046 symbols completed. VEEV took 1.2s. Estimated remaining: 57.6s. Rate: 148.0 symbols/min [2025-10-28T22:20:02.695188] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:02.721743] [INFO ] [MAIN ] VET: Generated 138 derivative records from 43759 primary records. [2025-10-28T22:20:02.721919] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-28T22:20:02.733593] [DEBUG] [LOCAL ] VET: Derivative data saved (138 records). [2025-10-28T22:20:02.733730] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-28T22:20:02.736022] [INFO ] [MAIN ] Derivative Progress: 1905/2046 symbols completed. VET took 0.5s. Estimated remaining: 57.2s. Rate: 148.0 symbols/min [2025-10-28T22:20:02.736456] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:02.736542] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:02.736710] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:02.744249] [DEBUG] [LOCAL ] VGI: Loaded 5015 existing records from primary storage. [2025-10-28T22:20:02.744545] [INFO ] [MAIN ] VGI: Loaded 5015 primary data records. [2025-10-28T22:20:02.848536] [DEBUG] [LOCAL ] VGM: Loaded 18339 existing records from primary storage. [2025-10-28T22:20:02.866235] [INFO ] [MAIN ] VGM: Loaded 18339 primary data records. [2025-10-28T22:20:03.269345] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-10-28T22:20:03.302161] [INFO ] [MAIN ] VFC: Loaded 53610 primary data records. [2025-10-28T22:20:03.811319] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:03.855324] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:03.896311] [INFO ] [MAIN ] VGI: Generated 138 derivative records from 5015 primary records. [2025-10-28T22:20:03.897016] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-28T22:20:03.922915] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:03.926276] [DEBUG] [LOCAL ] VGI: Derivative data saved (138 records). [2025-10-28T22:20:03.926471] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-28T22:20:03.940046] [INFO ] [MAIN ] Derivative Progress: 1906/2046 symbols completed. VGI took 1.2s. Estimated remaining: 56.8s. Rate: 147.8 symbols/min [2025-10-28T22:20:03.940185] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:03.952110] [DEBUG] [LOCAL ] VHI: Loaded 2592 existing records from primary storage. [2025-10-28T22:20:03.952496] [INFO ] [MAIN ] VHI: Loaded 2592 primary data records. [2025-10-28T22:20:04.098127] [INFO ] [MAIN ] VGM: Generated 138 derivative records from 18339 primary records. [2025-10-28T22:20:04.119587] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-28T22:20:04.300124] [DEBUG] [LOCAL ] VGM: Derivative data saved (138 records). [2025-10-28T22:20:04.303793] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-28T22:20:04.307311] [INFO ] [MAIN ] Derivative Progress: 1907/2046 symbols completed. VGM took 1.6s. Estimated remaining: 56.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:04.308824] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:04.313919] [INFO ] [MAIN ] VFC: Generated 138 derivative records from 53610 primary records. [2025-10-28T22:20:04.314912] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-28T22:20:04.329216] [DEBUG] [LOCAL ] VFC: Derivative data saved (138 records). [2025-10-28T22:20:04.329503] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-28T22:20:04.332457] [INFO ] [MAIN ] Derivative Progress: 1908/2046 symbols completed. VFC took 1.6s. Estimated remaining: 56.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:04.333324] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:04.353435] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:04.432456] [DEBUG] [LOCAL ] VICI: Loaded 53650 existing records from primary storage. [2025-10-28T22:20:04.436171] [INFO ] [MAIN ] VHI: Generated 138 derivative records from 2592 primary records. [2025-10-28T22:20:04.433535] [INFO ] [MAIN ] VICI: Loaded 53650 primary data records. [2025-10-28T22:20:04.436383] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-28T22:20:04.515614] [DEBUG] [LOCAL ] VIK: Loaded 52233 existing records from primary storage. [2025-10-28T22:20:04.536316] [INFO ] [MAIN ] VIK: Loaded 52233 primary data records. [2025-10-28T22:20:04.545819] [DEBUG] [LOCAL ] VHI: Derivative data saved (138 records). [2025-10-28T22:20:04.545926] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-28T22:20:04.565114] [INFO ] [MAIN ] Derivative Progress: 1909/2046 symbols completed. VHI took 0.6s. Estimated remaining: 55.6s. Rate: 148.0 symbols/min [2025-10-28T22:20:04.590419] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:05.200439] [DEBUG] [LOCAL ] VIPS: Loaded 51174 existing records from primary storage. [2025-10-28T22:20:05.201136] [INFO ] [MAIN ] VIPS: Loaded 51174 primary data records. [2025-10-28T22:20:05.365080] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:05.598108] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:05.666902] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:05.665943] [INFO ] [MAIN ] VICI: Generated 138 derivative records from 53650 primary records. [2025-10-28T22:20:05.667140] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-28T22:20:05.699728] [DEBUG] [LOCAL ] VICI: Derivative data saved (138 records). [2025-10-28T22:20:05.699845] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-28T22:20:05.705371] [INFO ] [MAIN ] Derivative Progress: 1910/2046 symbols completed. VICI took 1.4s. Estimated remaining: 55.2s. Rate: 147.8 symbols/min [2025-10-28T22:20:05.705613] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:05.709921] [INFO ] [MAIN ] VIK: Generated 138 derivative records from 52233 primary records. [2025-10-28T22:20:05.711622] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-28T22:20:05.730790] [DEBUG] [LOCAL ] VIK: Derivative data saved (138 records). [2025-10-28T22:20:05.734101] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-28T22:20:05.737541] [INFO ] [MAIN ] Derivative Progress: 1911/2046 symbols completed. VIK took 1.4s. Estimated remaining: 54.8s. Rate: 147.9 symbols/min [2025-10-28T22:20:05.739580] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:05.746818] [INFO ] [MAIN ] VIPS: Generated 138 derivative records from 51174 primary records. [2025-10-28T22:20:05.747217] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-28T22:20:05.772120] [DEBUG] [LOCAL ] VIPS: Derivative data saved (138 records). [2025-10-28T22:20:05.772905] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-28T22:20:05.775584] [INFO ] [MAIN ] Derivative Progress: 1912/2046 symbols completed. VIPS took 1.2s. Estimated remaining: 54.3s. Rate: 148.0 symbols/min [2025-10-28T22:20:05.775887] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:05.790952] [DEBUG] [LOCAL ] VIRT: Loaded 46227 existing records from primary storage. [2025-10-28T22:20:05.791374] [INFO ] [MAIN ] VIRT: Loaded 46227 primary data records. [2025-10-28T22:20:05.994326] [DEBUG] [LOCAL ] VIST: Loaded 46686 existing records from primary storage. [2025-10-28T22:20:06.027522] [INFO ] [MAIN ] VIST: Loaded 46686 primary data records. [2025-10-28T22:20:06.174997] [DEBUG] [LOCAL ] VIV: Loaded 44356 existing records from primary storage. [2025-10-28T22:20:06.192919] [INFO ] [MAIN ] VIV: Loaded 44356 primary data records. [2025-10-28T22:20:06.830905] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:06.894257] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:06.894586] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:06.942074] [INFO ] [MAIN ] VIRT: Generated 138 derivative records from 46227 primary records. [2025-10-28T22:20:06.943340] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-28T22:20:06.961373] [DEBUG] [LOCAL ] VIRT: Derivative data saved (138 records). [2025-10-28T22:20:06.961575] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-28T22:20:06.969397] [INFO ] [MAIN ] Derivative Progress: 1913/2046 symbols completed. VIRT took 1.3s. Estimated remaining: 54.0s. Rate: 147.8 symbols/min [2025-10-28T22:20:06.969879] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:06.992582] [INFO ] [MAIN ] VIST: Generated 138 derivative records from 46686 primary records. [2025-10-28T22:20:06.999748] [DEBUG] [LOCAL ] VKQ: Loaded 17621 existing records from primary storage. [2025-10-28T22:20:06.999851] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-28T22:20:06.999954] [INFO ] [MAIN ] VKQ: Loaded 17621 primary data records. [2025-10-28T22:20:07.061261] [DEBUG] [LOCAL ] VIST: Derivative data saved (138 records). [2025-10-28T22:20:07.085508] [INFO ] [MAIN ] VIV: Generated 138 derivative records from 44356 primary records. [2025-10-28T22:20:07.097388] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-28T22:20:07.076172] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-28T22:20:07.110158] [INFO ] [MAIN ] Derivative Progress: 1914/2046 symbols completed. VIST took 1.4s. Estimated remaining: 53.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:07.127856] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:07.156442] [DEBUG] [LOCAL ] VIV: Derivative data saved (138 records). [2025-10-28T22:20:07.179377] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-28T22:20:07.192155] [INFO ] [MAIN ] Derivative Progress: 1915/2046 symbols completed. VIV took 1.4s. Estimated remaining: 53.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:07.192470] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:07.364214] [DEBUG] [LOCAL ] VLN: Loaded 31227 existing records from primary storage. [2025-10-28T22:20:07.378831] [INFO ] [MAIN ] VLN: Loaded 31227 primary data records. [2025-10-28T22:20:07.501000] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:07.541303] [DEBUG] [LOCAL ] VLO: Loaded 52916 existing records from primary storage. [2025-10-28T22:20:07.586989] [INFO ] [MAIN ] VLO: Loaded 52916 primary data records. [2025-10-28T22:20:08.072413] [INFO ] [MAIN ] VKQ: Generated 138 derivative records from 17621 primary records. [2025-10-28T22:20:08.074962] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-28T22:20:08.088325] [DEBUG] [LOCAL ] VKQ: Derivative data saved (138 records). [2025-10-28T22:20:08.101525] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-28T22:20:08.101990] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:08.115383] [INFO ] [MAIN ] Derivative Progress: 1916/2046 symbols completed. VKQ took 1.1s. Estimated remaining: 52.8s. Rate: 147.8 symbols/min [2025-10-28T22:20:08.118150] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:08.151017] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:08.196610] [DEBUG] [LOCAL ] VLRS: Loaded 39119 existing records from primary storage. [2025-10-28T22:20:08.199567] [INFO ] [MAIN ] VLN: Generated 138 derivative records from 31227 primary records. [2025-10-28T22:20:08.201113] [INFO ] [MAIN ] VLRS: Loaded 39119 primary data records. [2025-10-28T22:20:08.201265] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-28T22:20:08.331998] [DEBUG] [LOCAL ] VLN: Derivative data saved (138 records). [2025-10-28T22:20:08.337858] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-28T22:20:08.361219] [INFO ] [MAIN ] Derivative Progress: 1917/2046 symbols completed. VLN took 1.2s. Estimated remaining: 52.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:08.396112] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:08.564737] [DEBUG] [LOCAL ] VLT: Loaded 4102 existing records from primary storage. [2025-10-28T22:20:08.567727] [INFO ] [MAIN ] VLT: Loaded 4102 primary data records. [2025-10-28T22:20:08.635456] [INFO ] [MAIN ] VLO: Generated 138 derivative records from 52916 primary records. [2025-10-28T22:20:08.664212] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-28T22:20:08.744198] [DEBUG] [LOCAL ] VLO: Derivative data saved (138 records). [2025-10-28T22:20:08.749985] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-28T22:20:08.781059] [INFO ] [MAIN ] Derivative Progress: 1918/2046 symbols completed. VLO took 1.6s. Estimated remaining: 51.9s. Rate: 147.8 symbols/min [2025-10-28T22:20:08.956105] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:09.006765] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:09.025343] [INFO ] [MAIN ] VLRS: Generated 138 derivative records from 39119 primary records. [2025-10-28T22:20:09.027639] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-28T22:20:09.045998] [DEBUG] [LOCAL ] VLRS: Derivative data saved (138 records). [2025-10-28T22:20:09.046363] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-28T22:20:09.048544] [INFO ] [MAIN ] Derivative Progress: 1919/2046 symbols completed. VLRS took 0.9s. Estimated remaining: 51.5s. Rate: 147.9 symbols/min [2025-10-28T22:20:09.054112] [INFO ] [MAIN ] VLT: Generated 138 derivative records from 4102 primary records. [2025-10-28T22:20:09.054182] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-28T22:20:09.065191] [DEBUG] [LOCAL ] VLT: Derivative data saved (138 records). [2025-10-28T22:20:09.065249] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-28T22:20:09.067540] [INFO ] [MAIN ] Derivative Progress: 1920/2046 symbols completed. VLT took 0.7s. Estimated remaining: 51.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:09.068048] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:09.068154] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:09.068581] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:09.084025] [DEBUG] [LOCAL ] VMI: Loaded 14687 existing records from primary storage. [2025-10-28T22:20:09.084159] [INFO ] [MAIN ] VMI: Loaded 14687 primary data records. [2025-10-28T22:20:09.427830] [DEBUG] [LOCAL ] VLTO: Loaded 45929 existing records from primary storage. [2025-10-28T22:20:09.430385] [INFO ] [MAIN ] VLTO: Loaded 45929 primary data records. [2025-10-28T22:20:09.436599] [DEBUG] [LOCAL ] VMC: Loaded 41822 existing records from primary storage. [2025-10-28T22:20:09.468891] [INFO ] [MAIN ] VMC: Loaded 41822 primary data records. [2025-10-28T22:20:10.077308] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:10.114331] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:10.151068] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:10.187704] [INFO ] [MAIN ] VMI: Generated 138 derivative records from 14687 primary records. [2025-10-28T22:20:10.190530] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-28T22:20:10.207309] [DEBUG] [LOCAL ] VMI: Derivative data saved (138 records). [2025-10-28T22:20:10.207611] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-28T22:20:10.210258] [INFO ] [MAIN ] Derivative Progress: 1921/2046 symbols completed. VMI took 1.1s. Estimated remaining: 50.7s. Rate: 147.8 symbols/min [2025-10-28T22:20:10.214564] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:10.216161] [INFO ] [MAIN ] VLTO: Generated 138 derivative records from 45929 primary records. [2025-10-28T22:20:10.216401] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-28T22:20:10.231725] [DEBUG] [LOCAL ] VLTO: Derivative data saved (138 records). [2025-10-28T22:20:10.231991] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-28T22:20:10.234310] [INFO ] [MAIN ] Derivative Progress: 1922/2046 symbols completed. VLTO took 1.2s. Estimated remaining: 50.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:10.235358] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:10.243112] [INFO ] [MAIN ] VMC: Generated 138 derivative records from 41822 primary records. [2025-10-28T22:20:10.243234] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-28T22:20:10.255452] [DEBUG] [LOCAL ] VMC: Derivative data saved (138 records). [2025-10-28T22:20:10.255580] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-28T22:20:10.258400] [INFO ] [MAIN ] Derivative Progress: 1923/2046 symbols completed. VMC took 1.2s. Estimated remaining: 49.9s. Rate: 148.0 symbols/min [2025-10-28T22:20:10.258577] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:10.266586] [DEBUG] [LOCAL ] VMO: Loaded 20252 existing records from primary storage. [2025-10-28T22:20:10.266896] [INFO ] [MAIN ] VMO: Loaded 20252 primary data records. [2025-10-28T22:20:10.619695] [DEBUG] [LOCAL ] VNO: Loaded 48605 existing records from primary storage. [2025-10-28T22:20:10.619996] [INFO ] [MAIN ] VNO: Loaded 48605 primary data records. [2025-10-28T22:20:10.620519] [DEBUG] [LOCAL ] VNT: Loaded 43681 existing records from primary storage. [2025-10-28T22:20:10.620727] [INFO ] [MAIN ] VNT: Loaded 43681 primary data records. [2025-10-28T22:20:11.283516] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:11.347431] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:11.363600] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:11.386421] [INFO ] [MAIN ] VMO: Generated 138 derivative records from 20252 primary records. [2025-10-28T22:20:11.390671] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-28T22:20:11.407106] [DEBUG] [LOCAL ] VMO: Derivative data saved (138 records). [2025-10-28T22:20:11.407561] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-28T22:20:11.410011] [INFO ] [MAIN ] Derivative Progress: 1924/2046 symbols completed. VMO took 1.2s. Estimated remaining: 49.5s. Rate: 147.8 symbols/min [2025-10-28T22:20:11.412973] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:11.438608] [DEBUG] [LOCAL ] VOC: Loaded 9015 existing records from primary storage. [2025-10-28T22:20:11.439734] [INFO ] [MAIN ] VOC: Loaded 9015 primary data records. [2025-10-28T22:20:11.501574] [INFO ] [MAIN ] VNO: Generated 138 derivative records from 48605 primary records. [2025-10-28T22:20:11.510361] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-28T22:20:11.562941] [DEBUG] [LOCAL ] VNO: Derivative data saved (138 records). [2025-10-28T22:20:11.568430] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-28T22:20:11.580692] [INFO ] [MAIN ] VNT: Generated 138 derivative records from 43681 primary records. [2025-10-28T22:20:11.580846] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-28T22:20:11.588000] [INFO ] [MAIN ] Derivative Progress: 1925/2046 symbols completed. VNO took 1.4s. Estimated remaining: 49.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:11.593281] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:11.785488] [DEBUG] [LOCAL ] VNT: Derivative data saved (138 records). [2025-10-28T22:20:11.795201] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-28T22:20:11.798175] [INFO ] [MAIN ] Derivative Progress: 1926/2046 symbols completed. VNT took 1.5s. Estimated remaining: 48.7s. Rate: 147.9 symbols/min [2025-10-28T22:20:11.798496] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:11.822689] [DEBUG] [LOCAL ] VPG: Loaded 16530 existing records from primary storage. [2025-10-28T22:20:11.832469] [INFO ] [MAIN ] VPG: Loaded 16530 primary data records. [2025-10-28T22:20:11.886111] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:20:11.964504] [DEBUG] [LOCAL ] VOYA: Loaded 41240 existing records from primary storage. [2025-10-28T22:20:11.984863] [INFO ] [MAIN ] VOYA: Loaded 41240 primary data records. [2025-10-28T22:20:12.514207] [INFO ] [MAIN ] VOC: Generated 138 derivative records from 9015 primary records. [2025-10-28T22:20:12.515098] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-28T22:20:12.530978] [DEBUG] [LOCAL ] VOC: Derivative data saved (138 records). [2025-10-28T22:20:12.531840] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-28T22:20:12.534315] [INFO ] [MAIN ] Derivative Progress: 1927/2046 symbols completed. VOC took 1.1s. Estimated remaining: 48.3s. Rate: 147.8 symbols/min [2025-10-28T22:20:12.534867] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:12.548730] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:12.569498] [DEBUG] [LOCAL ] VPV: Loaded 5028 existing records from primary storage. [2025-10-28T22:20:12.571707] [INFO ] [MAIN ] VPV: Loaded 5028 primary data records. [2025-10-28T22:20:12.599754] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:13.013475] [INFO ] [MAIN ] VPG: Generated 138 derivative records from 16530 primary records. [2025-10-28T22:20:13.015878] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-28T22:20:13.030113] [INFO ] [MAIN ] VOYA: Generated 138 derivative records from 41240 primary records. [2025-10-28T22:20:13.032944] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-28T22:20:13.034276] [DEBUG] [LOCAL ] VPG: Derivative data saved (138 records). [2025-10-28T22:20:13.034882] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-28T22:20:13.037206] [INFO ] [MAIN ] Derivative Progress: 1928/2046 symbols completed. VPG took 1.2s. Estimated remaining: 47.9s. Rate: 147.8 symbols/min [2025-10-28T22:20:13.037420] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:13.051109] [DEBUG] [LOCAL ] VOYA: Derivative data saved (138 records). [2025-10-28T22:20:13.051262] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-28T22:20:13.053857] [INFO ] [MAIN ] Derivative Progress: 1929/2046 symbols completed. VOYA took 1.5s. Estimated remaining: 47.5s. Rate: 147.9 symbols/min [2025-10-28T22:20:13.054279] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:13.071746] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:13.136486] [DEBUG] [LOCAL ] VRE: Loaded 35018 existing records from primary storage. [2025-10-28T22:20:13.136749] [INFO ] [MAIN ] VPV: Generated 138 derivative records from 5028 primary records. [2025-10-28T22:20:13.137066] [INFO ] [MAIN ] VRE: Loaded 35018 primary data records. [2025-10-28T22:20:13.137266] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-28T22:20:13.259151] [DEBUG] [LOCAL ] VPV: Derivative data saved (138 records). [2025-10-28T22:20:13.270543] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-28T22:20:13.271254] [DEBUG] [LOCAL ] VRT: Loaded 53754 existing records from primary storage. [2025-10-28T22:20:13.279442] [INFO ] [MAIN ] Derivative Progress: 1930/2046 symbols completed. VPV took 0.7s. Estimated remaining: 47.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:13.300208] [INFO ] [MAIN ] VRT: Loaded 53754 primary data records. [2025-10-28T22:20:13.300453] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:13.607038] [DEBUG] [LOCAL ] VRTS: Loaded 9382 existing records from primary storage. [2025-10-28T22:20:13.622772] [INFO ] [MAIN ] VRTS: Loaded 9382 primary data records. [2025-10-28T22:20:14.102270] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:14.148118] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:14.177392] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:14.206983] [INFO ] [MAIN ] VRE: Generated 138 derivative records from 35018 primary records. [2025-10-28T22:20:14.207397] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-28T22:20:14.222219] [DEBUG] [LOCAL ] VRE: Derivative data saved (138 records). [2025-10-28T22:20:14.228175] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-28T22:20:14.231099] [INFO ] [MAIN ] Derivative Progress: 1931/2046 symbols completed. VRE took 1.2s. Estimated remaining: 46.7s. Rate: 147.8 symbols/min [2025-10-28T22:20:14.232867] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:14.251701] [INFO ] [MAIN ] VRT: Generated 138 derivative records from 53754 primary records. [2025-10-28T22:20:14.254456] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-28T22:20:14.268174] [DEBUG] [LOCAL ] VRT: Derivative data saved (138 records). [2025-10-28T22:20:14.270132] [INFO ] [MAIN ] VRTS: Generated 138 derivative records from 9382 primary records. [2025-10-28T22:20:14.270184] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-28T22:20:14.272165] [INFO ] [MAIN ] Derivative Progress: 1932/2046 symbols completed. VRT took 1.2s. Estimated remaining: 46.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:14.272236] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-28T22:20:14.273195] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:14.298418] [DEBUG] [LOCAL ] VRTS: Derivative data saved (138 records). [2025-10-28T22:20:14.298584] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-28T22:20:14.301026] [INFO ] [MAIN ] Derivative Progress: 1933/2046 symbols completed. VRTS took 1.0s. Estimated remaining: 45.8s. Rate: 148.0 symbols/min [2025-10-28T22:20:14.318280] [DEBUG] [LOCAL ] VSCO: Loaded 52630 existing records from primary storage. [2025-10-28T22:20:14.318456] [INFO ] [MAIN ] VSCO: Loaded 52630 primary data records. [2025-10-28T22:20:14.605058] [DEBUG] [LOCAL ] VSH: Loaded 48207 existing records from primary storage. [2025-10-28T22:20:14.636820] [INFO ] [MAIN ] VSH: Loaded 48207 primary data records. [2025-10-28T22:20:14.954399] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:15.003170] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:15.021136] [INFO ] [MAIN ] VSCO: Generated 138 derivative records from 52630 primary records. [2025-10-28T22:20:15.021629] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-28T22:20:15.037588] [DEBUG] [LOCAL ] VSCO: Derivative data saved (138 records). [2025-10-28T22:20:15.037860] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-28T22:20:15.041090] [INFO ] [MAIN ] Derivative Progress: 1934/2046 symbols completed. VSCO took 0.8s. Estimated remaining: 45.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:15.051860] [INFO ] [MAIN ] VSH: Generated 138 derivative records from 48207 primary records. [2025-10-28T22:20:15.052006] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-28T22:20:15.064809] [DEBUG] [LOCAL ] VSH: Derivative data saved (138 records). [2025-10-28T22:20:15.064879] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-28T22:20:15.066950] [INFO ] [MAIN ] Derivative Progress: 1935/2046 symbols completed. VSH took 0.8s. Estimated remaining: 45.0s. Rate: 148.0 symbols/min [2025-10-28T22:20:15.067466] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:15.067734] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:15.067548] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:15.126436] [DEBUG] [LOCAL ] VTEX: Loaded 42681 existing records from primary storage. [2025-10-28T22:20:15.127116] [INFO ] [MAIN ] VTEX: Loaded 42681 primary data records. [2025-10-28T22:20:15.229086] [DEBUG] [LOCAL ] VSTS: Loaded 48663 existing records from primary storage. [2025-10-28T22:20:15.262319] [INFO ] [MAIN ] VSTS: Loaded 48663 primary data records. [2025-10-28T22:20:15.329307] [DEBUG] [LOCAL ] VST: Loaded 53708 existing records from primary storage. [2025-10-28T22:20:15.371072] [INFO ] [MAIN ] VST: Loaded 53708 primary data records. [2025-10-28T22:20:16.104744] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:16.142143] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:16.153424] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:16.229692] [INFO ] [MAIN ] VTEX: Generated 138 derivative records from 42681 primary records. [2025-10-28T22:20:16.230141] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-28T22:20:16.232447] [INFO ] [MAIN ] VSTS: Generated 138 derivative records from 48663 primary records. [2025-10-28T22:20:16.233199] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-28T22:20:16.255599] [DEBUG] [LOCAL ] VSTS: Derivative data saved (138 records). [2025-10-28T22:20:16.253048] [INFO ] [MAIN ] VST: Generated 138 derivative records from 53708 primary records. [2025-10-28T22:20:16.258294] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-28T22:20:16.260614] [INFO ] [MAIN ] Derivative Progress: 1936/2046 symbols completed. VSTS took 1.2s. Estimated remaining: 44.7s. Rate: 147.8 symbols/min [2025-10-28T22:20:16.258128] [DEBUG] [LOCAL ] VTEX: Derivative data saved (138 records). [2025-10-28T22:20:16.260859] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:16.258250] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-28T22:20:16.261090] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-28T22:20:16.264064] [INFO ] [MAIN ] Derivative Progress: 1937/2046 symbols completed. VTEX took 1.2s. Estimated remaining: 44.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:16.271916] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:16.276807] [DEBUG] [LOCAL ] VST: Derivative data saved (138 records). [2025-10-28T22:20:16.277022] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-28T22:20:16.279697] [INFO ] [MAIN ] Derivative Progress: 1938/2046 symbols completed. VST took 1.2s. Estimated remaining: 43.8s. Rate: 148.0 symbols/min [2025-10-28T22:20:16.279966] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:16.293089] [DEBUG] [LOCAL ] VTN: Loaded 7104 existing records from primary storage. [2025-10-28T22:20:16.293255] [INFO ] [MAIN ] VTN: Loaded 7104 primary data records. [2025-10-28T22:20:16.385171] [DEBUG] [LOCAL ] VTMX: Loaded 17635 existing records from primary storage. [2025-10-28T22:20:16.412942] [INFO ] [MAIN ] VTMX: Loaded 17635 primary data records. [2025-10-28T22:20:16.665330] [DEBUG] [LOCAL ] VTLE: Loaded 47054 existing records from primary storage. [2025-10-28T22:20:16.687725] [INFO ] [MAIN ] VTLE: Loaded 47054 primary data records. [2025-10-28T22:20:17.280931] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:17.317915] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:17.363002] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:17.390507] [INFO ] [MAIN ] VTN: Generated 138 derivative records from 7104 primary records. [2025-10-28T22:20:17.393536] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-28T22:20:17.411069] [DEBUG] [LOCAL ] VTN: Derivative data saved (138 records). [2025-10-28T22:20:17.411207] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-28T22:20:17.415691] [INFO ] [MAIN ] Derivative Progress: 1939/2046 symbols completed. VTN took 1.1s. Estimated remaining: 43.4s. Rate: 147.8 symbols/min [2025-10-28T22:20:17.418319] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:17.421067] [INFO ] [MAIN ] VTMX: Generated 138 derivative records from 17635 primary records. [2025-10-28T22:20:17.423368] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-28T22:20:17.436932] [DEBUG] [LOCAL ] VTMX: Derivative data saved (138 records). [2025-10-28T22:20:17.444402] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-28T22:20:17.446592] [INFO ] [MAIN ] Derivative Progress: 1940/2046 symbols completed. VTMX took 1.2s. Estimated remaining: 43.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:17.446837] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:17.450598] [INFO ] [MAIN ] VTLE: Generated 138 derivative records from 47054 primary records. [2025-10-28T22:20:17.451145] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-28T22:20:17.458480] [DEBUG] [LOCAL ] VTOL: Loaded 19046 existing records from primary storage. [2025-10-28T22:20:17.467612] [INFO ] [MAIN ] VTOL: Loaded 19046 primary data records. [2025-10-28T22:20:17.470533] [DEBUG] [LOCAL ] VTLE: Derivative data saved (138 records). [2025-10-28T22:20:17.491062] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-28T22:20:17.515460] [INFO ] [MAIN ] Derivative Progress: 1941/2046 symbols completed. VTLE took 1.3s. Estimated remaining: 42.6s. Rate: 148.0 symbols/min [2025-10-28T22:20:17.547924] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:17.809419] [DEBUG] [LOCAL ] VTR: Loaded 52634 existing records from primary storage. [2025-10-28T22:20:17.809692] [INFO ] [MAIN ] VTR: Loaded 52634 primary data records. [2025-10-28T22:20:17.913384] [DEBUG] [LOCAL ] VTS: Loaded 29441 existing records from primary storage. [2025-10-28T22:20:17.965295] [INFO ] [MAIN ] VTS: Loaded 29441 primary data records. [2025-10-28T22:20:18.331056] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:18.501121] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:18.529787] [INFO ] [MAIN ] VTOL: Generated 138 derivative records from 19046 primary records. [2025-10-28T22:20:18.531721] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-28T22:20:18.551193] [DEBUG] [LOCAL ] VTOL: Derivative data saved (138 records). [2025-10-28T22:20:18.554319] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-28T22:20:18.567440] [INFO ] [MAIN ] Derivative Progress: 1942/2046 symbols completed. VTOL took 1.1s. Estimated remaining: 42.2s. Rate: 147.8 symbols/min [2025-10-28T22:20:18.576243] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:18.577255] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:18.605094] [INFO ] [MAIN ] VTR: Generated 138 derivative records from 52634 primary records. [2025-10-28T22:20:18.605758] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-28T22:20:18.629535] [DEBUG] [LOCAL ] VTR: Derivative data saved (138 records). [2025-10-28T22:20:18.631684] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-28T22:20:18.637239] [INFO ] [MAIN ] Derivative Progress: 1943/2046 symbols completed. VTR took 1.2s. Estimated remaining: 41.8s. Rate: 147.9 symbols/min [2025-10-28T22:20:18.646352] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:18.651106] [DEBUG] [LOCAL ] VVR: Loaded 30651 existing records from primary storage. [2025-10-28T22:20:18.654600] [INFO ] [MAIN ] VVR: Loaded 30651 primary data records. [2025-10-28T22:20:18.856198] [INFO ] [MAIN ] VTS: Generated 138 derivative records from 29441 primary records. [2025-10-28T22:20:18.872307] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-28T22:20:19.008767] [DEBUG] [LOCAL ] VVV: Loaded 50036 existing records from primary storage. [2025-10-28T22:20:19.009739] [DEBUG] [LOCAL ] VTS: Derivative data saved (138 records). [2025-10-28T22:20:19.010142] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-28T22:20:19.012724] [INFO ] [MAIN ] Derivative Progress: 1944/2046 symbols completed. VTS took 1.5s. Estimated remaining: 41.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:19.013085] [INFO ] [MAIN ] VVV: Loaded 50036 primary data records. [2025-10-28T22:20:19.013700] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:19.389496] [DEBUG] [LOCAL ] VVX: Loaded 22872 existing records from primary storage. [2025-10-28T22:20:19.390582] [INFO ] [MAIN ] VVX: Loaded 22872 primary data records. [2025-10-28T22:20:19.533915] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:19.808720] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:19.808923] [INFO ] [MAIN ] VVR: Generated 138 derivative records from 30651 primary records. [2025-10-28T22:20:19.825040] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-28T22:20:19.855866] [DEBUG] [LOCAL ] VVR: Derivative data saved (138 records). [2025-10-28T22:20:19.857077] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:19.857322] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-28T22:20:19.871673] [INFO ] [MAIN ] Derivative Progress: 1945/2046 symbols completed. VVR took 1.3s. Estimated remaining: 41.0s. Rate: 147.8 symbols/min [2025-10-28T22:20:19.872881] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:19.914599] [INFO ] [MAIN ] VVV: Generated 138 derivative records from 50036 primary records. [2025-10-28T22:20:19.917930] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-28T22:20:19.931340] [DEBUG] [LOCAL ] VVV: Derivative data saved (138 records). [2025-10-28T22:20:19.931512] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-28T22:20:19.933743] [INFO ] [MAIN ] Derivative Progress: 1946/2046 symbols completed. VVV took 1.3s. Estimated remaining: 40.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:19.938175] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:19.954995] [DEBUG] [LOCAL ] VYX: Loaded 48034 existing records from primary storage. [2025-10-28T22:20:19.957131] [INFO ] [MAIN ] VVX: Generated 138 derivative records from 22872 primary records. [2025-10-28T22:20:19.957337] [INFO ] [MAIN ] VYX: Loaded 48034 primary data records. [2025-10-28T22:20:19.957383] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-28T22:20:20.046874] [DEBUG] [LOCAL ] VVX: Derivative data saved (138 records). [2025-10-28T22:20:20.057308] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-28T22:20:20.059821] [INFO ] [MAIN ] Derivative Progress: 1947/2046 symbols completed. VVX took 1.0s. Estimated remaining: 40.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:20.065568] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:20.313803] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-28T22:20:20.314516] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-28T22:20:20.474006] [DEBUG] [LOCAL ] W: Loaded 53407 existing records from primary storage. [2025-10-28T22:20:20.518768] [INFO ] [MAIN ] W: Loaded 53407 primary data records. [2025-10-28T22:20:20.752737] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:21.004883] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:21.033999] [INFO ] [MAIN ] VYX: Generated 138 derivative records from 48034 primary records. [2025-10-28T22:20:21.035919] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-28T22:20:21.066639] [DEBUG] [LOCAL ] VYX: Derivative data saved (138 records). [2025-10-28T22:20:21.067214] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-28T22:20:21.066984] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:21.080217] [INFO ] [MAIN ] Derivative Progress: 1948/2046 symbols completed. VYX took 1.2s. Estimated remaining: 39.8s. Rate: 147.8 symbols/min [2025-10-28T22:20:21.106475] [INFO ] [MAIN ] VZ: Generated 138 derivative records from 53791 primary records. [2025-10-28T22:20:21.108901] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-28T22:20:21.125200] [DEBUG] [LOCAL ] VZ: Derivative data saved (138 records). [2025-10-28T22:20:21.126390] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-28T22:20:21.130006] [INFO ] [MAIN ] Derivative Progress: 1949/2046 symbols completed. VZ took 1.2s. Estimated remaining: 39.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:21.130774] [INFO ] [MAIN ] W: Generated 138 derivative records from 53407 primary records. [2025-10-28T22:20:21.130844] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-28T22:20:21.142767] [DEBUG] [LOCAL ] W: Derivative data saved (138 records). [2025-10-28T22:20:21.142826] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-28T22:20:21.145431] [INFO ] [MAIN ] Derivative Progress: 1950/2046 symbols completed. W took 1.1s. Estimated remaining: 38.9s. Rate: 148.0 symbols/min [2025-10-28T22:20:21.145870] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:21.146000] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:21.146426] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:21.195875] [DEBUG] [LOCAL ] WAT: Loaded 35265 existing records from primary storage. [2025-10-28T22:20:21.196060] [INFO ] [MAIN ] WAT: Loaded 35265 primary data records. [2025-10-28T22:20:21.322787] [DEBUG] [LOCAL ] WAL: Loaded 45529 existing records from primary storage. [2025-10-28T22:20:21.323396] [DEBUG] [LOCAL ] WAB: Loaded 43602 existing records from primary storage. [2025-10-28T22:20:21.323561] [INFO ] [MAIN ] WAL: Loaded 45529 primary data records. [2025-10-28T22:20:21.323859] [INFO ] [MAIN ] WAB: Loaded 43602 primary data records. [2025-10-28T22:20:22.199905] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:22.251424] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:22.253854] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:22.324702] [INFO ] [MAIN ] WAT: Generated 138 derivative records from 35265 primary records. [2025-10-28T22:20:22.325179] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-28T22:20:22.345036] [DEBUG] [LOCAL ] WAT: Derivative data saved (138 records). [2025-10-28T22:20:22.347053] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-28T22:20:22.350864] [INFO ] [MAIN ] Derivative Progress: 1951/2046 symbols completed. WAT took 1.2s. Estimated remaining: 38.6s. Rate: 147.8 symbols/min [2025-10-28T22:20:22.351198] [INFO ] [MAIN ] WAB: Generated 138 derivative records from 43602 primary records. [2025-10-28T22:20:22.354241] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:22.355011] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-28T22:20:22.371208] [DEBUG] [LOCAL ] WAB: Derivative data saved (138 records). [2025-10-28T22:20:22.371625] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-28T22:20:22.374996] [INFO ] [MAIN ] Derivative Progress: 1952/2046 symbols completed. WAB took 1.2s. Estimated remaining: 38.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:22.375269] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:22.371412] [INFO ] [MAIN ] WAL: Generated 138 derivative records from 45529 primary records. [2025-10-28T22:20:22.375891] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-28T22:20:22.388445] [DEBUG] [LOCAL ] WAL: Derivative data saved (138 records). [2025-10-28T22:20:22.388612] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-28T22:20:22.390824] [INFO ] [MAIN ] Derivative Progress: 1953/2046 symbols completed. WAL took 1.2s. Estimated remaining: 37.7s. Rate: 148.0 symbols/min [2025-10-28T22:20:22.393666] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:22.399270] [DEBUG] [LOCAL ] WBX: Loaded 9240 existing records from primary storage. [2025-10-28T22:20:22.410307] [INFO ] [MAIN ] WBX: Loaded 9240 primary data records. [2025-10-28T22:20:22.547094] [DEBUG] [LOCAL ] WBS: Loaded 48792 existing records from primary storage. [2025-10-28T22:20:22.562876] [INFO ] [MAIN ] WBS: Loaded 48792 primary data records. [2025-10-28T22:20:22.818984] [DEBUG] [LOCAL ] WCC: Loaded 38015 existing records from primary storage. [2025-10-28T22:20:22.836373] [INFO ] [MAIN ] WCC: Loaded 38015 primary data records. [2025-10-28T22:20:23.416272] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:23.453061] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:23.494669] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:23.533254] [INFO ] [MAIN ] WBX: Generated 138 derivative records from 9240 primary records. [2025-10-28T22:20:23.537295] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-28T22:20:23.551933] [INFO ] [MAIN ] WBS: Generated 138 derivative records from 48792 primary records. [2025-10-28T22:20:23.551620] [DEBUG] [LOCAL ] WBX: Derivative data saved (138 records). [2025-10-28T22:20:23.552216] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-28T22:20:23.554313] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-28T22:20:23.556690] [INFO ] [MAIN ] Derivative Progress: 1954/2046 symbols completed. WBX took 1.2s. Estimated remaining: 37.3s. Rate: 147.8 symbols/min [2025-10-28T22:20:23.557667] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:23.571320] [DEBUG] [LOCAL ] WBS: Derivative data saved (138 records). [2025-10-28T22:20:23.574176] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-28T22:20:23.576486] [INFO ] [MAIN ] Derivative Progress: 1955/2046 symbols completed. WBS took 1.2s. Estimated remaining: 36.9s. Rate: 147.9 symbols/min [2025-10-28T22:20:23.576663] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:23.580892] [INFO ] [MAIN ] WCC: Generated 138 derivative records from 38015 primary records. [2025-10-28T22:20:23.581016] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-28T22:20:23.599199] [DEBUG] [LOCAL ] WCC: Derivative data saved (138 records). [2025-10-28T22:20:23.599320] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-28T22:20:23.601811] [INFO ] [MAIN ] Derivative Progress: 1956/2046 symbols completed. WCC took 1.2s. Estimated remaining: 36.5s. Rate: 148.0 symbols/min [2025-10-28T22:20:23.602096] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:23.620017] [DEBUG] [LOCAL ] WD: Loaded 22021 existing records from primary storage. [2025-10-28T22:20:23.620188] [INFO ] [MAIN ] WD: Loaded 22021 primary data records. [2025-10-28T22:20:23.745758] [DEBUG] [LOCAL ] WCN: Loaded 47779 existing records from primary storage. [2025-10-28T22:20:23.746260] [INFO ] [MAIN ] WCN: Loaded 47779 primary data records. [2025-10-28T22:20:23.746944] [DEBUG] [LOCAL ] WDH: Loaded 17859 existing records from primary storage. [2025-10-28T22:20:23.831429] [INFO ] [MAIN ] WDH: Loaded 17859 primary data records. [2025-10-28T22:20:24.578153] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:24.613351] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:24.651781] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:24.697907] [INFO ] [MAIN ] WD: Generated 138 derivative records from 22021 primary records. [2025-10-28T22:20:24.698682] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-28T22:20:24.712888] [INFO ] [MAIN ] WCN: Generated 138 derivative records from 47779 primary records. [2025-10-28T22:20:24.717156] [DEBUG] [LOCAL ] WD: Derivative data saved (138 records). [2025-10-28T22:20:24.718286] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-28T22:20:24.717229] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-28T22:20:24.720068] [INFO ] [MAIN ] Derivative Progress: 1957/2046 symbols completed. WD took 1.1s. Estimated remaining: 36.1s. Rate: 147.8 symbols/min [2025-10-28T22:20:24.720901] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:24.732563] [DEBUG] [LOCAL ] WCN: Derivative data saved (138 records). [2025-10-28T22:20:24.732978] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-28T22:20:24.738115] [INFO ] [MAIN ] Derivative Progress: 1958/2046 symbols completed. WCN took 1.2s. Estimated remaining: 35.7s. Rate: 147.9 symbols/min [2025-10-28T22:20:24.738837] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:24.742666] [INFO ] [MAIN ] WDH: Generated 138 derivative records from 17859 primary records. [2025-10-28T22:20:24.742807] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-28T22:20:24.759603] [DEBUG] [LOCAL ] WDH: Derivative data saved (138 records). [2025-10-28T22:20:24.759757] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-28T22:20:24.762284] [INFO ] [MAIN ] Derivative Progress: 1959/2046 symbols completed. WDH took 1.2s. Estimated remaining: 35.3s. Rate: 148.0 symbols/min [2025-10-28T22:20:24.762606] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:24.771242] [DEBUG] [LOCAL ] WDI: Loaded 20799 existing records from primary storage. [2025-10-28T22:20:24.771370] [INFO ] [MAIN ] WDI: Loaded 20799 primary data records. [2025-10-28T22:20:24.859071] [DEBUG] [LOCAL ] WEA: Loaded 7781 existing records from primary storage. [2025-10-28T22:20:24.879843] [INFO ] [MAIN ] WEA: Loaded 7781 primary data records. [2025-10-28T22:20:25.209228] [DEBUG] [LOCAL ] WDS: Loaded 42723 existing records from primary storage. [2025-10-28T22:20:25.225639] [INFO ] [MAIN ] WDS: Loaded 42723 primary data records. [2025-10-28T22:20:25.744844] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:25.779280] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:25.825506] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:25.845089] [INFO ] [MAIN ] WDI: Generated 138 derivative records from 20799 primary records. [2025-10-28T22:20:25.846261] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-28T22:20:25.870284] [DEBUG] [LOCAL ] WDI: Derivative data saved (138 records). [2025-10-28T22:20:25.870598] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-28T22:20:25.875173] [INFO ] [MAIN ] Derivative Progress: 1960/2046 symbols completed. WDI took 1.2s. Estimated remaining: 34.9s. Rate: 147.8 symbols/min [2025-10-28T22:20:25.876122] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:25.885120] [INFO ] [MAIN ] WEA: Generated 138 derivative records from 7781 primary records. [2025-10-28T22:20:25.888523] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-28T22:20:25.901496] [DEBUG] [LOCAL ] WEA: Derivative data saved (138 records). [2025-10-28T22:20:25.901621] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-28T22:20:25.907174] [INFO ] [MAIN ] Derivative Progress: 1961/2046 symbols completed. WEA took 1.1s. Estimated remaining: 34.5s. Rate: 147.9 symbols/min [2025-10-28T22:20:25.907495] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:25.912323] [INFO ] [MAIN ] WDS: Generated 138 derivative records from 42723 primary records. [2025-10-28T22:20:25.912483] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-28T22:20:25.940160] [DEBUG] [LOCAL ] WDS: Derivative data saved (138 records). [2025-10-28T22:20:25.940435] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-28T22:20:25.944010] [INFO ] [MAIN ] Derivative Progress: 1962/2046 symbols completed. WDS took 1.2s. Estimated remaining: 34.1s. Rate: 148.0 symbols/min [2025-10-28T22:20:25.944221] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:25.958336] [DEBUG] [LOCAL ] WEAV: Loaded 42139 existing records from primary storage. [2025-10-28T22:20:25.958468] [INFO ] [MAIN ] WEAV: Loaded 42139 primary data records. [2025-10-28T22:20:26.301450] [DEBUG] [LOCAL ] WEC: Loaded 52106 existing records from primary storage. [2025-10-28T22:20:26.301731] [INFO ] [MAIN ] WEC: Loaded 52106 primary data records. [2025-10-28T22:20:26.439137] [DEBUG] [LOCAL ] WELL: Loaded 52273 existing records from primary storage. [2025-10-28T22:20:26.439379] [INFO ] [MAIN ] WELL: Loaded 52273 primary data records. [2025-10-28T22:20:26.967980] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:27.012479] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:27.056394] [INFO ] [MAIN ] WEAV: Generated 138 derivative records from 42139 primary records. [2025-10-28T22:20:27.055495] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:27.066921] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-28T22:20:27.085545] [DEBUG] [LOCAL ] WEAV: Derivative data saved (138 records). [2025-10-28T22:20:27.085671] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-28T22:20:27.089686] [INFO ] [MAIN ] Derivative Progress: 1963/2046 symbols completed. WEAV took 1.2s. Estimated remaining: 33.7s. Rate: 147.8 symbols/min [2025-10-28T22:20:27.108615] [INFO ] [MAIN ] WEC: Generated 138 derivative records from 52106 primary records. [2025-10-28T22:20:27.111908] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-28T22:20:27.122322] [INFO ] [MAIN ] WELL: Generated 138 derivative records from 52273 primary records. [2025-10-28T22:20:27.124660] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-28T22:20:27.126540] [DEBUG] [LOCAL ] WEC: Derivative data saved (138 records). [2025-10-28T22:20:27.127002] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-28T22:20:27.129712] [INFO ] [MAIN ] Derivative Progress: 1964/2046 symbols completed. WEC took 1.2s. Estimated remaining: 33.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:27.141564] [DEBUG] [LOCAL ] WELL: Derivative data saved (138 records). [2025-10-28T22:20:27.141627] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-28T22:20:27.144112] [INFO ] [MAIN ] Derivative Progress: 1965/2046 symbols completed. WELL took 1.2s. Estimated remaining: 32.8s. Rate: 148.0 symbols/min [2025-10-28T22:20:27.144574] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:27.144751] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:27.145247] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:27.156355] [DEBUG] [LOCAL ] WF: Loaded 10420 existing records from primary storage. [2025-10-28T22:20:27.156711] [INFO ] [MAIN ] WF: Loaded 10420 primary data records. [2025-10-28T22:20:27.305091] [DEBUG] [LOCAL ] WEX: Loaded 31660 existing records from primary storage. [2025-10-28T22:20:27.366633] [INFO ] [MAIN ] WEX: Loaded 31660 primary data records. [2025-10-28T22:20:27.630538] [DEBUG] [LOCAL ] WES: Loaded 48613 existing records from primary storage. [2025-10-28T22:20:27.636322] [INFO ] [MAIN ] WES: Loaded 48613 primary data records. [2025-10-28T22:20:28.168238] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:28.210178] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:28.244698] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:28.287177] [INFO ] [MAIN ] WF: Generated 138 derivative records from 10420 primary records. [2025-10-28T22:20:28.289723] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-28T22:20:28.305158] [DEBUG] [LOCAL ] WF: Derivative data saved (138 records). [2025-10-28T22:20:28.306533] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-28T22:20:28.310838] [INFO ] [MAIN ] Derivative Progress: 1966/2046 symbols completed. WF took 1.2s. Estimated remaining: 32.5s. Rate: 147.8 symbols/min [2025-10-28T22:20:28.311393] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:28.327116] [INFO ] [MAIN ] WES: Generated 138 derivative records from 48613 primary records. [2025-10-28T22:20:28.325033] [INFO ] [MAIN ] WEX: Generated 138 derivative records from 31660 primary records. [2025-10-28T22:20:28.327304] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-28T22:20:28.327374] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-28T22:20:28.349487] [DEBUG] [LOCAL ] WES: Derivative data saved (138 records). [2025-10-28T22:20:28.349875] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-28T22:20:28.352766] [INFO ] [MAIN ] Derivative Progress: 1967/2046 symbols completed. WES took 1.2s. Estimated remaining: 32.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:28.353313] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:28.356090] [DEBUG] [LOCAL ] WEX: Derivative data saved (138 records). [2025-10-28T22:20:28.370541] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-28T22:20:28.373059] [INFO ] [MAIN ] Derivative Progress: 1968/2046 symbols completed. WEX took 1.2s. Estimated remaining: 31.6s. Rate: 148.0 symbols/min [2025-10-28T22:20:28.373317] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:28.399078] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-28T22:20:28.399276] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-28T22:20:28.493174] [DEBUG] [LOCAL ] WFG: Loaded 24220 existing records from primary storage. [2025-10-28T22:20:28.528880] [INFO ] [MAIN ] WFG: Loaded 24220 primary data records. [2025-10-28T22:20:28.544364] [DEBUG] [LOCAL ] WGO: Loaded 37836 existing records from primary storage. [2025-10-28T22:20:28.580922] [INFO ] [MAIN ] WGO: Loaded 37836 primary data records. [2025-10-28T22:20:29.386370] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:29.429198] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:29.449714] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:29.517364] [INFO ] [MAIN ] WFC: Generated 138 derivative records from 53748 primary records. [2025-10-28T22:20:29.523522] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-28T22:20:29.526168] [INFO ] [MAIN ] WFG: Generated 138 derivative records from 24220 primary records. [2025-10-28T22:20:29.528139] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-28T22:20:29.528541] [INFO ] [MAIN ] WGO: Generated 138 derivative records from 37836 primary records. [2025-10-28T22:20:29.540568] [DEBUG] [LOCAL ] WFC: Derivative data saved (138 records). [2025-10-28T22:20:29.540762] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-28T22:20:29.541669] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-28T22:20:29.550451] [INFO ] [MAIN ] Derivative Progress: 1969/2046 symbols completed. WFC took 1.2s. Estimated remaining: 31.3s. Rate: 147.8 symbols/min [2025-10-28T22:20:29.552339] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:29.555224] [DEBUG] [LOCAL ] WFG: Derivative data saved (138 records). [2025-10-28T22:20:29.562549] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-28T22:20:29.567067] [INFO ] [MAIN ] Derivative Progress: 1970/2046 symbols completed. WFG took 1.2s. Estimated remaining: 30.8s. Rate: 147.9 symbols/min [2025-10-28T22:20:29.567316] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:29.570945] [DEBUG] [LOCAL ] WGO: Derivative data saved (138 records). [2025-10-28T22:20:29.571209] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-28T22:20:29.574028] [INFO ] [MAIN ] Derivative Progress: 1971/2046 symbols completed. WGO took 1.2s. Estimated remaining: 30.4s. Rate: 148.0 symbols/min [2025-10-28T22:20:29.574338] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:29.579455] [DEBUG] [LOCAL ] WHG: Loaded 2977 existing records from primary storage. [2025-10-28T22:20:29.579626] [INFO ] [MAIN ] WHG: Loaded 2977 primary data records. [2025-10-28T22:20:29.726291] [DEBUG] [LOCAL ] WHD: Loaded 39651 existing records from primary storage. [2025-10-28T22:20:29.749578] [INFO ] [MAIN ] WHD: Loaded 39651 primary data records. [2025-10-28T22:20:30.051312] [DEBUG] [LOCAL ] WH: Loaded 45328 existing records from primary storage. [2025-10-28T22:20:30.054973] [INFO ] [MAIN ] WH: Loaded 45328 primary data records. [2025-10-28T22:20:30.574995] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:30.610801] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:30.643980] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:30.685473] [INFO ] [MAIN ] WHG: Generated 138 derivative records from 2977 primary records. [2025-10-28T22:20:30.687194] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-28T22:20:30.706063] [DEBUG] [LOCAL ] WHG: Derivative data saved (138 records). [2025-10-28T22:20:30.706424] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-28T22:20:30.712574] [INFO ] [MAIN ] Derivative Progress: 1972/2046 symbols completed. WHG took 1.1s. Estimated remaining: 30.0s. Rate: 147.8 symbols/min [2025-10-28T22:20:30.716687] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:30.723610] [INFO ] [MAIN ] WHD: Generated 138 derivative records from 39651 primary records. [2025-10-28T22:20:30.725039] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-28T22:20:30.736384] [INFO ] [MAIN ] WH: Generated 138 derivative records from 45328 primary records. [2025-10-28T22:20:30.736820] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-28T22:20:30.739860] [DEBUG] [LOCAL ] WHD: Derivative data saved (138 records). [2025-10-28T22:20:30.740011] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-28T22:20:30.749147] [INFO ] [MAIN ] Derivative Progress: 1973/2046 symbols completed. WHD took 1.2s. Estimated remaining: 29.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:30.750827] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:30.753524] [DEBUG] [LOCAL ] WH: Derivative data saved (138 records). [2025-10-28T22:20:30.753869] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-28T22:20:30.756943] [INFO ] [MAIN ] Derivative Progress: 1974/2046 symbols completed. WH took 1.2s. Estimated remaining: 29.2s. Rate: 148.0 symbols/min [2025-10-28T22:20:30.757345] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:30.762505] [DEBUG] [LOCAL ] WIA: Loaded 4973 existing records from primary storage. [2025-10-28T22:20:30.762667] [INFO ] [MAIN ] WIA: Loaded 4973 primary data records. [2025-10-28T22:20:30.882753] [DEBUG] [LOCAL ] WINN: Loaded 10926 existing records from primary storage. [2025-10-28T22:20:30.893737] [INFO ] [MAIN ] WINN: Loaded 10926 primary data records. [2025-10-28T22:20:31.023874] [DEBUG] [LOCAL ] WHR: Loaded 48857 existing records from primary storage. [2025-10-28T22:20:31.073480] [INFO ] [MAIN ] WHR: Loaded 48857 primary data records. [2025-10-28T22:20:31.765715] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:31.806880] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:20:31.852125] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:31.901937] [INFO ] [MAIN ] WIA: Generated 138 derivative records from 4973 primary records. [2025-10-28T22:20:31.902443] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-28T22:20:31.920148] [DEBUG] [LOCAL ] WIA: Derivative data saved (138 records). [2025-10-28T22:20:31.920846] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-28T22:20:31.924223] [INFO ] [MAIN ] WINN: Generated 138 derivative records from 10926 primary records. [2025-10-28T22:20:31.926398] [INFO ] [MAIN ] Derivative Progress: 1975/2046 symbols completed. WIA took 1.2s. Estimated remaining: 28.8s. Rate: 147.8 symbols/min [2025-10-28T22:20:31.926918] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:31.927664] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-28T22:20:31.946232] [DEBUG] [LOCAL ] WINN: Derivative data saved (138 records). [2025-10-28T22:20:31.946448] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-28T22:20:31.949312] [INFO ] [MAIN ] Derivative Progress: 1976/2046 symbols completed. WINN took 1.2s. Estimated remaining: 28.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:31.949535] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:31.950311] [INFO ] [MAIN ] WHR: Generated 138 derivative records from 48857 primary records. [2025-10-28T22:20:31.950540] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-28T22:20:31.966276] [DEBUG] [LOCAL ] WHR: Derivative data saved (138 records). [2025-10-28T22:20:31.966503] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-28T22:20:31.969359] [INFO ] [MAIN ] Derivative Progress: 1977/2046 symbols completed. WHR took 1.3s. Estimated remaining: 28.0s. Rate: 148.0 symbols/min [2025-10-28T22:20:31.969632] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:31.999180] [DEBUG] [LOCAL ] WIW: Loaded 20011 existing records from primary storage. [2025-10-28T22:20:31.999384] [INFO ] [MAIN ] WIW: Loaded 20011 primary data records. [2025-10-28T22:20:32.150824] [DEBUG] [LOCAL ] WIT: Loaded 52545 existing records from primary storage. [2025-10-28T22:20:32.163097] [INFO ] [MAIN ] WIT: Loaded 52545 primary data records. [2025-10-28T22:20:32.232688] [DEBUG] [LOCAL ] WK: Loaded 36643 existing records from primary storage. [2025-10-28T22:20:32.281914] [INFO ] [MAIN ] WK: Loaded 36643 primary data records. [2025-10-28T22:20:32.965812] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:33.006395] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:33.046217] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:33.068204] [INFO ] [MAIN ] WIW: Generated 138 derivative records from 20011 primary records. [2025-10-28T22:20:33.068422] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-28T22:20:33.089334] [DEBUG] [LOCAL ] WIW: Derivative data saved (138 records). [2025-10-28T22:20:33.089445] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-28T22:20:33.093038] [INFO ] [MAIN ] Derivative Progress: 1978/2046 symbols completed. WIW took 1.1s. Estimated remaining: 27.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:33.103148] [INFO ] [MAIN ] WIT: Generated 138 derivative records from 52545 primary records. [2025-10-28T22:20:33.103371] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-28T22:20:33.118317] [DEBUG] [LOCAL ] WIT: Derivative data saved (138 records). [2025-10-28T22:20:33.118754] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-28T22:20:33.122127] [INFO ] [MAIN ] Derivative Progress: 1979/2046 symbols completed. WIT took 1.2s. Estimated remaining: 27.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:33.122684] [INFO ] [MAIN ] WK: Generated 138 derivative records from 36643 primary records. [2025-10-28T22:20:33.122866] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-28T22:20:33.134132] [DEBUG] [LOCAL ] WK: Derivative data saved (138 records). [2025-10-28T22:20:33.134188] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-28T22:20:33.136507] [INFO ] [MAIN ] Derivative Progress: 1980/2046 symbols completed. WK took 1.2s. Estimated remaining: 26.8s. Rate: 148.0 symbols/min [2025-10-28T22:20:33.137070] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:33.137168] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:33.137008] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:33.146396] [DEBUG] [LOCAL ] WLKP: Loaded 7234 existing records from primary storage. [2025-10-28T22:20:33.146604] [INFO ] [MAIN ] WLKP: Loaded 7234 primary data records. [2025-10-28T22:20:33.464394] [DEBUG] [LOCAL ] WKC: Loaded 34159 existing records from primary storage. [2025-10-28T22:20:33.464663] [INFO ] [MAIN ] WKC: Loaded 34159 primary data records. [2025-10-28T22:20:33.588326] [DEBUG] [LOCAL ] WLK: Loaded 45671 existing records from primary storage. [2025-10-28T22:20:33.592550] [INFO ] [MAIN ] WLK: Loaded 45671 primary data records. [2025-10-28T22:20:34.125475] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:34.189027] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:34.217938] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:34.218682] [INFO ] [MAIN ] WLKP: Generated 138 derivative records from 7234 primary records. [2025-10-28T22:20:34.233583] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-28T22:20:34.250287] [DEBUG] [LOCAL ] WLKP: Derivative data saved (138 records). [2025-10-28T22:20:34.250504] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-28T22:20:34.253173] [INFO ] [MAIN ] Derivative Progress: 1981/2046 symbols completed. WLKP took 1.1s. Estimated remaining: 26.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:34.253361] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:34.292526] [INFO ] [MAIN ] WLK: Generated 138 derivative records from 45671 primary records. [2025-10-28T22:20:34.293146] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-28T22:20:34.306803] [DEBUG] [LOCAL ] WLK: Derivative data saved (138 records). [2025-10-28T22:20:34.315470] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-28T22:20:34.316003] [DEBUG] [LOCAL ] WLY: Loaded 29564 existing records from primary storage. [2025-10-28T22:20:34.316702] [INFO ] [MAIN ] WLY: Loaded 29564 primary data records. [2025-10-28T22:20:34.321218] [INFO ] [MAIN ] Derivative Progress: 1982/2046 symbols completed. WLK took 1.2s. Estimated remaining: 26.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:34.318513] [INFO ] [MAIN ] WKC: Generated 138 derivative records from 34159 primary records. [2025-10-28T22:20:34.321424] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:34.321549] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-28T22:20:34.387012] [DEBUG] [LOCAL ] WKC: Derivative data saved (138 records). [2025-10-28T22:20:34.417872] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-28T22:20:34.425916] [INFO ] [MAIN ] Derivative Progress: 1983/2046 symbols completed. WKC took 1.3s. Estimated remaining: 25.5s. Rate: 148.0 symbols/min [2025-10-28T22:20:34.438547] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:34.683985] [DEBUG] [LOCAL ] WM: Loaded 50814 existing records from primary storage. [2025-10-28T22:20:34.684500] [INFO ] [MAIN ] WM: Loaded 50814 primary data records. [2025-10-28T22:20:34.850993] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-28T22:20:34.879793] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-28T22:20:34.915796] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:35.371932] [INFO ] [MAIN ] WLY: Generated 138 derivative records from 29564 primary records. [2025-10-28T22:20:35.372581] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-28T22:20:35.395366] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:35.398249] [DEBUG] [LOCAL ] WLY: Derivative data saved (138 records). [2025-10-28T22:20:35.398533] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-28T22:20:35.412540] [INFO ] [MAIN ] Derivative Progress: 1984/2046 symbols completed. WLY took 1.2s. Estimated remaining: 25.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:35.416039] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:35.442215] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:35.468603] [DEBUG] [LOCAL ] WMK: Loaded 14414 existing records from primary storage. [2025-10-28T22:20:35.471636] [INFO ] [MAIN ] WMK: Loaded 14414 primary data records. [2025-10-28T22:20:35.570050] [INFO ] [MAIN ] WM: Generated 138 derivative records from 50814 primary records. [2025-10-28T22:20:35.590594] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-28T22:20:35.625570] [DEBUG] [LOCAL ] WM: Derivative data saved (138 records). [2025-10-28T22:20:35.625726] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-28T22:20:35.633758] [INFO ] [MAIN ] Derivative Progress: 1985/2046 symbols completed. WM took 1.3s. Estimated remaining: 24.7s. Rate: 147.9 symbols/min [2025-10-28T22:20:35.657900] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:35.849824] [INFO ] [MAIN ] WMB: Generated 138 derivative records from 53672 primary records. [2025-10-28T22:20:35.850509] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-28T22:20:35.864248] [DEBUG] [LOCAL ] WMB: Derivative data saved (138 records). [2025-10-28T22:20:35.864442] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-28T22:20:35.867176] [INFO ] [MAIN ] Derivative Progress: 1986/2046 symbols completed. WMB took 1.4s. Estimated remaining: 24.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:35.867412] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:35.895006] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:35.920289] [DEBUG] [LOCAL ] WMS: Loaded 39116 existing records from primary storage. [2025-10-28T22:20:35.921932] [INFO ] [MAIN ] WMS: Loaded 39116 primary data records. [2025-10-28T22:20:36.113210] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-28T22:20:36.253144] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-28T22:20:36.549288] [INFO ] [MAIN ] WMK: Generated 138 derivative records from 14414 primary records. [2025-10-28T22:20:36.557875] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-28T22:20:36.573130] [DEBUG] [LOCAL ] WMK: Derivative data saved (138 records). [2025-10-28T22:20:36.574369] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-28T22:20:36.576663] [INFO ] [MAIN ] Derivative Progress: 1987/2046 symbols completed. WMK took 1.2s. Estimated remaining: 23.9s. Rate: 147.9 symbols/min [2025-10-28T22:20:36.576828] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:36.592991] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:36.646560] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:36.673583] [DEBUG] [LOCAL ] WNC: Loaded 37547 existing records from primary storage. [2025-10-28T22:20:36.674807] [INFO ] [MAIN ] WNC: Loaded 37547 primary data records. [2025-10-28T22:20:36.739786] [INFO ] [MAIN ] WMS: Generated 138 derivative records from 39116 primary records. [2025-10-28T22:20:36.748872] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-28T22:20:36.837271] [DEBUG] [LOCAL ] WMS: Derivative data saved (138 records). [2025-10-28T22:20:36.870220] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-28T22:20:36.895300] [INFO ] [MAIN ] Derivative Progress: 1988/2046 symbols completed. WMS took 1.2s. Estimated remaining: 23.5s. Rate: 147.9 symbols/min [2025-10-28T22:20:36.897210] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:37.021763] [INFO ] [MAIN ] WMT: Generated 138 derivative records from 53800 primary records. [2025-10-28T22:20:37.021900] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-28T22:20:37.036242] [DEBUG] [LOCAL ] WMT: Derivative data saved (138 records). [2025-10-28T22:20:37.036752] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-28T22:20:37.039441] [INFO ] [MAIN ] Derivative Progress: 1989/2046 symbols completed. WMT took 1.2s. Estimated remaining: 23.1s. Rate: 148.0 symbols/min [2025-10-28T22:20:37.039617] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:37.086905] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:37.087304] [DEBUG] [LOCAL ] WOR: Loaded 22960 existing records from primary storage. [2025-10-28T22:20:37.099157] [INFO ] [MAIN ] WOR: Loaded 22960 primary data records. [2025-10-28T22:20:37.187486] [DEBUG] [LOCAL ] WOLF: Loaded 52877 existing records from primary storage. [2025-10-28T22:20:37.210282] [INFO ] [MAIN ] WOLF: Loaded 52877 primary data records. [2025-10-28T22:20:37.771198] [INFO ] [MAIN ] WNC: Generated 138 derivative records from 37547 primary records. [2025-10-28T22:20:37.771549] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-28T22:20:37.785349] [DEBUG] [LOCAL ] WNC: Derivative data saved (138 records). [2025-10-28T22:20:37.785455] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-28T22:20:37.787691] [INFO ] [MAIN ] Derivative Progress: 1990/2046 symbols completed. WNC took 1.2s. Estimated remaining: 22.7s. Rate: 147.9 symbols/min [2025-10-28T22:20:37.788062] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:37.806107] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:37.861753] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:37.874913] [DEBUG] [LOCAL ] WOW: Loaded 30812 existing records from primary storage. [2025-10-28T22:20:37.875230] [INFO ] [MAIN ] WOW: Loaded 30812 primary data records. [2025-10-28T22:20:38.188557] [INFO ] [MAIN ] WOR: Generated 138 derivative records from 22960 primary records. [2025-10-28T22:20:38.189099] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-28T22:20:38.205381] [DEBUG] [LOCAL ] WOR: Derivative data saved (138 records). [2025-10-28T22:20:38.207610] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-28T22:20:38.209804] [INFO ] [MAIN ] Derivative Progress: 1991/2046 symbols completed. WOR took 1.2s. Estimated remaining: 22.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:38.209967] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:38.207850] [INFO ] [MAIN ] WOLF: Generated 138 derivative records from 52877 primary records. [2025-10-28T22:20:38.210406] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-28T22:20:38.223921] [DEBUG] [LOCAL ] WOLF: Derivative data saved (138 records). [2025-10-28T22:20:38.224323] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-28T22:20:38.226906] [INFO ] [MAIN ] Derivative Progress: 1992/2046 symbols completed. WOLF took 1.3s. Estimated remaining: 21.9s. Rate: 148.0 symbols/min [2025-10-28T22:20:38.227217] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:38.249062] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:38.315500] [DEBUG] [LOCAL ] WPC: Loaded 47948 existing records from primary storage. [2025-10-28T22:20:38.315899] [INFO ] [MAIN ] WPC: Loaded 47948 primary data records. [2025-10-28T22:20:38.374110] [INFO ] [MAIN ] WOW: Generated 138 derivative records from 30812 primary records. [2025-10-28T22:20:38.407183] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-28T22:20:38.436049] [DEBUG] [LOCAL ] WPM: Loaded 52786 existing records from primary storage. [2025-10-28T22:20:38.436441] [INFO ] [MAIN ] WPM: Loaded 52786 primary data records. [2025-10-28T22:20:38.532060] [DEBUG] [LOCAL ] WOW: Derivative data saved (138 records). [2025-10-28T22:20:38.590402] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-28T22:20:38.727692] [INFO ] [MAIN ] Derivative Progress: 1993/2046 symbols completed. WOW took 0.9s. Estimated remaining: 21.5s. Rate: 147.9 symbols/min [2025-10-28T22:20:38.949016] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:38.985754] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:39.015469] [INFO ] [MAIN ] WPC: Generated 138 derivative records from 47948 primary records. [2025-10-28T22:20:39.016748] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-28T22:20:39.030928] [DEBUG] [LOCAL ] WPC: Derivative data saved (138 records). [2025-10-28T22:20:39.031151] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-28T22:20:39.033889] [INFO ] [MAIN ] Derivative Progress: 1994/2046 symbols completed. WPC took 0.8s. Estimated remaining: 21.1s. Rate: 148.0 symbols/min [2025-10-28T22:20:39.038452] [INFO ] [MAIN ] WPM: Generated 138 derivative records from 52786 primary records. [2025-10-28T22:20:39.038522] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-28T22:20:39.050084] [DEBUG] [LOCAL ] WPM: Derivative data saved (138 records). [2025-10-28T22:20:39.050139] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-28T22:20:39.052211] [INFO ] [MAIN ] Derivative Progress: 1995/2046 symbols completed. WPM took 0.8s. Estimated remaining: 20.7s. Rate: 148.0 symbols/min [2025-10-28T22:20:39.052875] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:39.052940] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:39.053572] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:39.108426] [DEBUG] [LOCAL ] WPP: Loaded 33958 existing records from primary storage. [2025-10-28T22:20:39.108681] [INFO ] [MAIN ] WPP: Loaded 33958 primary data records. [2025-10-28T22:20:39.241317] [DEBUG] [LOCAL ] WRB: Loaded 50772 existing records from primary storage. [2025-10-28T22:20:39.252172] [INFO ] [MAIN ] WRB: Loaded 50772 primary data records. [2025-10-28T22:20:39.284171] [DEBUG] [LOCAL ] WRBY: Loaded 50593 existing records from primary storage. [2025-10-28T22:20:39.327431] [INFO ] [MAIN ] WRBY: Loaded 50593 primary data records. [2025-10-28T22:20:40.087496] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:40.147250] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:40.146819] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:40.208039] [INFO ] [MAIN ] WPP: Generated 138 derivative records from 33958 primary records. [2025-10-28T22:20:40.213088] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-28T22:20:40.231258] [DEBUG] [LOCAL ] WPP: Derivative data saved (138 records). [2025-10-28T22:20:40.231455] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-28T22:20:40.233859] [INFO ] [MAIN ] Derivative Progress: 1996/2046 symbols completed. WPP took 1.2s. Estimated remaining: 20.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:40.236381] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:40.244608] [INFO ] [MAIN ] WRBY: Generated 138 derivative records from 50593 primary records. [2025-10-28T22:20:40.246467] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-28T22:20:40.267505] [DEBUG] [LOCAL ] WRBY: Derivative data saved (138 records). [2025-10-28T22:20:40.267851] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-28T22:20:40.270291] [INFO ] [MAIN ] Derivative Progress: 1997/2046 symbols completed. WRBY took 1.2s. Estimated remaining: 19.9s. Rate: 148.0 symbols/min [2025-10-28T22:20:40.272089] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:40.274716] [INFO ] [MAIN ] WRB: Generated 138 derivative records from 50772 primary records. [2025-10-28T22:20:40.274862] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-28T22:20:40.287998] [DEBUG] [LOCAL ] WRB: Derivative data saved (138 records). [2025-10-28T22:20:40.288200] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-28T22:20:40.296372] [INFO ] [MAIN ] Derivative Progress: 1998/2046 symbols completed. WRB took 1.2s. Estimated remaining: 19.5s. Rate: 148.0 symbols/min [2025-10-28T22:20:40.297701] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:40.298511] [DEBUG] [LOCAL ] WS: Loaded 23025 existing records from primary storage. [2025-10-28T22:20:40.298859] [INFO ] [MAIN ] WS: Loaded 23025 primary data records. [2025-10-28T22:20:40.645767] [DEBUG] [LOCAL ] WSO: Loaded 26119 existing records from primary storage. [2025-10-28T22:20:40.646864] [INFO ] [MAIN ] WSO: Loaded 26119 primary data records. [2025-10-28T22:20:40.659166] [DEBUG] [LOCAL ] WSM: Loaded 48417 existing records from primary storage. [2025-10-28T22:20:40.680534] [INFO ] [MAIN ] WSM: Loaded 48417 primary data records. [2025-10-28T22:20:41.268388] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:41.310038] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:41.334020] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:41.383527] [INFO ] [MAIN ] WS: Generated 138 derivative records from 23025 primary records. [2025-10-28T22:20:41.386897] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-28T22:20:41.406097] [DEBUG] [LOCAL ] WS: Derivative data saved (138 records). [2025-10-28T22:20:41.412054] [INFO ] [MAIN ] WSO: Generated 138 derivative records from 26119 primary records. [2025-10-28T22:20:41.411758] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-28T22:20:41.414253] [INFO ] [MAIN ] Derivative Progress: 1999/2046 symbols completed. WS took 1.2s. Estimated remaining: 19.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:41.414578] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:41.416161] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-28T22:20:41.419379] [INFO ] [MAIN ] WSM: Generated 138 derivative records from 48417 primary records. [2025-10-28T22:20:41.419707] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-28T22:20:41.432512] [DEBUG] [LOCAL ] WSO: Derivative data saved (138 records). [2025-10-28T22:20:41.442830] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-28T22:20:41.445151] [INFO ] [MAIN ] Derivative Progress: 2000/2046 symbols completed. WSO took 1.1s. Estimated remaining: 18.7s. Rate: 148.0 symbols/min [2025-10-28T22:20:41.445975] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:41.454394] [DEBUG] [LOCAL ] WSM: Derivative data saved (138 records). [2025-10-28T22:20:41.454616] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-28T22:20:41.457142] [INFO ] [MAIN ] Derivative Progress: 2001/2046 symbols completed. WSM took 1.2s. Estimated remaining: 18.2s. Rate: 148.0 symbols/min [2025-10-28T22:20:41.457353] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:41.466342] [DEBUG] [LOCAL ] WSR: Loaded 22015 existing records from primary storage. [2025-10-28T22:20:41.466709] [INFO ] [MAIN ] WSR: Loaded 22015 primary data records. [2025-10-28T22:20:41.815722] [DEBUG] [LOCAL ] WST: Loaded 36472 existing records from primary storage. [2025-10-28T22:20:41.815879] [INFO ] [MAIN ] WST: Loaded 36472 primary data records. [2025-10-28T22:20:41.924006] [DEBUG] [LOCAL ] WT: Loaded 48131 existing records from primary storage. [2025-10-28T22:20:41.935172] [INFO ] [MAIN ] WT: Loaded 48131 primary data records. [2025-10-28T22:20:42.492173] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:42.542305] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:42.586158] [INFO ] [MAIN ] WSR: Generated 138 derivative records from 22015 primary records. [2025-10-28T22:20:42.591522] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-28T22:20:42.624489] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:42.638178] [DEBUG] [LOCAL ] WSR: Derivative data saved (138 records). [2025-10-28T22:20:42.641457] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-28T22:20:42.644044] [INFO ] [MAIN ] Derivative Progress: 2002/2046 symbols completed. WSR took 1.2s. Estimated remaining: 17.9s. Rate: 147.9 symbols/min [2025-10-28T22:20:42.647743] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:42.665014] [INFO ] [MAIN ] WST: Generated 138 derivative records from 36472 primary records. [2025-10-28T22:20:42.665337] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-28T22:20:42.683800] [DEBUG] [LOCAL ] WST: Derivative data saved (138 records). [2025-10-28T22:20:42.684033] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-28T22:20:42.689960] [INFO ] [MAIN ] Derivative Progress: 2003/2046 symbols completed. WST took 1.2s. Estimated remaining: 17.4s. Rate: 148.0 symbols/min [2025-10-28T22:20:42.690396] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:42.714291] [INFO ] [MAIN ] WT: Generated 138 derivative records from 48131 primary records. [2025-10-28T22:20:42.714549] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-28T22:20:42.729365] [DEBUG] [LOCAL ] WT: Derivative data saved (138 records). [2025-10-28T22:20:42.729737] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-28T22:20:42.733875] [INFO ] [MAIN ] Derivative Progress: 2004/2046 symbols completed. WT took 1.3s. Estimated remaining: 17.0s. Rate: 148.0 symbols/min [2025-10-28T22:20:42.748149] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:42.750472] [DEBUG] [LOCAL ] WTI: Loaded 44676 existing records from primary storage. [2025-10-28T22:20:42.751244] [INFO ] [MAIN ] WTI: Loaded 44676 primary data records. [2025-10-28T22:20:42.898378] [DEBUG] [LOCAL ] WTS: Loaded 16854 existing records from primary storage. [2025-10-28T22:20:42.925369] [INFO ] [MAIN ] WTS: Loaded 16854 primary data records. [2025-10-28T22:20:42.964522] [DEBUG] [LOCAL ] WTRG: Loaded 50870 existing records from primary storage. [2025-10-28T22:20:43.017065] [INFO ] [MAIN ] WTRG: Loaded 50870 primary data records. [2025-10-28T22:20:43.792370] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:43.842976] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:43.876705] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:43.928906] [INFO ] [MAIN ] WTI: Generated 138 derivative records from 44676 primary records. [2025-10-28T22:20:43.931363] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-28T22:20:43.957696] [DEBUG] [LOCAL ] WTI: Derivative data saved (138 records). [2025-10-28T22:20:43.960194] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-28T22:20:43.962258] [INFO ] [MAIN ] Derivative Progress: 2005/2046 symbols completed. WTI took 1.3s. Estimated remaining: 16.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:43.962620] [INFO ] [MAIN ] WTRG: Generated 138 derivative records from 50870 primary records. [2025-10-28T22:20:43.965788] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:43.965280] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-28T22:20:43.983302] [INFO ] [MAIN ] WTS: Generated 138 derivative records from 16854 primary records. [2025-10-28T22:20:43.983891] [DEBUG] [LOCAL ] WTRG: Derivative data saved (138 records). [2025-10-28T22:20:43.983985] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-28T22:20:43.984411] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-28T22:20:43.987194] [INFO ] [MAIN ] Derivative Progress: 2006/2046 symbols completed. WTRG took 1.3s. Estimated remaining: 16.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:43.987618] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:44.000775] [DEBUG] [LOCAL ] WTS: Derivative data saved (138 records). [2025-10-28T22:20:44.000981] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-28T22:20:44.003354] [INFO ] [MAIN ] Derivative Progress: 2007/2046 symbols completed. WTS took 1.3s. Estimated remaining: 15.8s. Rate: 148.0 symbols/min [2025-10-28T22:20:44.003751] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:44.066849] [DEBUG] [LOCAL ] WTTR: Loaded 44193 existing records from primary storage. [2025-10-28T22:20:44.067065] [INFO ] [MAIN ] WTTR: Loaded 44193 primary data records. [2025-10-28T22:20:44.206712] [DEBUG] [LOCAL ] WWW: Loaded 49139 existing records from primary storage. [2025-10-28T22:20:44.207897] [INFO ] [MAIN ] WWW: Loaded 49139 primary data records. [2025-10-28T22:20:44.207776] [DEBUG] [LOCAL ] WU: Loaded 53487 existing records from primary storage. [2025-10-28T22:20:44.219628] [INFO ] [MAIN ] WU: Loaded 53487 primary data records. [2025-10-28T22:20:45.071679] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:45.101052] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:45.132176] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:45.196392] [INFO ] [MAIN ] WTTR: Generated 138 derivative records from 44193 primary records. [2025-10-28T22:20:45.193997] [INFO ] [MAIN ] WWW: Generated 138 derivative records from 49139 primary records. [2025-10-28T22:20:45.196610] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-28T22:20:45.199119] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-28T22:20:45.224865] [DEBUG] [LOCAL ] WTTR: Derivative data saved (138 records). [2025-10-28T22:20:45.222262] [DEBUG] [LOCAL ] WWW: Derivative data saved (138 records). [2025-10-28T22:20:45.225153] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-28T22:20:45.225031] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-28T22:20:45.229976] [INFO ] [MAIN ] WU: Generated 138 derivative records from 53487 primary records. [2025-10-28T22:20:45.227778] [INFO ] [MAIN ] Derivative Progress: 2008/2046 symbols completed. WWW took 1.2s. Estimated remaining: 15.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:45.231811] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-28T22:20:45.232036] [INFO ] [MAIN ] Derivative Progress: 2009/2046 symbols completed. WTTR took 1.3s. Estimated remaining: 15.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:45.244796] [DEBUG] [LOCAL ] WU: Derivative data saved (138 records). [2025-10-28T22:20:45.244929] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-28T22:20:45.247402] [INFO ] [MAIN ] Derivative Progress: 2010/2046 symbols completed. WU took 1.3s. Estimated remaining: 14.6s. Rate: 148.0 symbols/min [2025-10-28T22:20:45.247839] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:45.248245] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:45.248294] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:45.284719] [DEBUG] [LOCAL ] XFLT: Loaded 29526 existing records from primary storage. [2025-10-28T22:20:45.284939] [INFO ] [MAIN ] XFLT: Loaded 29526 primary data records. [2025-10-28T22:20:45.413751] [DEBUG] [LOCAL ] XHR: Loaded 42865 existing records from primary storage. [2025-10-28T22:20:45.434679] [INFO ] [MAIN ] XHR: Loaded 42865 primary data records. [2025-10-28T22:20:45.702603] [DEBUG] [LOCAL ] WY: Loaded 53202 existing records from primary storage. [2025-10-28T22:20:45.716010] [INFO ] [MAIN ] WY: Loaded 53202 primary data records. [2025-10-28T22:20:46.310276] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:46.350190] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:46.374893] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:46.431097] [INFO ] [MAIN ] XFLT: Generated 138 derivative records from 29526 primary records. [2025-10-28T22:20:46.431753] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-28T22:20:46.451690] [DEBUG] [LOCAL ] XFLT: Derivative data saved (138 records). [2025-10-28T22:20:46.453520] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-28T22:20:46.457305] [INFO ] [MAIN ] Derivative Progress: 2011/2046 symbols completed. XFLT took 1.2s. Estimated remaining: 14.2s. Rate: 147.9 symbols/min [2025-10-28T22:20:46.460897] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:46.464197] [INFO ] [MAIN ] WY: Generated 138 derivative records from 53202 primary records. [2025-10-28T22:20:46.463949] [INFO ] [MAIN ] XHR: Generated 138 derivative records from 42865 primary records. [2025-10-28T22:20:46.464360] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-28T22:20:46.464461] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-28T22:20:46.489955] [DEBUG] [LOCAL ] XHR: Derivative data saved (138 records). [2025-10-28T22:20:46.490796] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-28T22:20:46.492801] [INFO ] [MAIN ] Derivative Progress: 2012/2046 symbols completed. XHR took 1.2s. Estimated remaining: 13.8s. Rate: 147.9 symbols/min [2025-10-28T22:20:46.493019] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:46.490696] [DEBUG] [LOCAL ] WY: Derivative data saved (138 records). [2025-10-28T22:20:46.493611] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-28T22:20:46.496405] [INFO ] [MAIN ] Derivative Progress: 2013/2046 symbols completed. WY took 1.2s. Estimated remaining: 13.4s. Rate: 148.0 symbols/min [2025-10-28T22:20:46.496811] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:46.536419] [DEBUG] [LOCAL ] XPER: Loaded 30362 existing records from primary storage. [2025-10-28T22:20:46.536544] [INFO ] [MAIN ] XPER: Loaded 30362 primary data records. [2025-10-28T22:20:46.647719] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-28T22:20:46.672473] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-28T22:20:47.015637] [DEBUG] [LOCAL ] XPEV: Loaded 53614 existing records from primary storage. [2025-10-28T22:20:47.021430] [INFO ] [MAIN ] XPEV: Loaded 53614 primary data records. [2025-10-28T22:20:47.546324] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:47.583720] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:47.623815] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:47.653365] [INFO ] [MAIN ] XPER: Generated 138 derivative records from 30362 primary records. [2025-10-28T22:20:47.659020] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-28T22:20:47.681288] [DEBUG] [LOCAL ] XPER: Derivative data saved (138 records). [2025-10-28T22:20:47.682872] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-28T22:20:47.687218] [INFO ] [MAIN ] Derivative Progress: 2014/2046 symbols completed. XPER took 1.2s. Estimated remaining: 13.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:47.688525] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:47.690978] [INFO ] [MAIN ] XOM: Generated 138 derivative records from 53793 primary records. [2025-10-28T22:20:47.692887] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-28T22:20:47.708122] [DEBUG] [LOCAL ] XOM: Derivative data saved (138 records). [2025-10-28T22:20:47.709081] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-28T22:20:47.713372] [INFO ] [MAIN ] Derivative Progress: 2015/2046 symbols completed. XOM took 1.3s. Estimated remaining: 12.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:47.711316] [INFO ] [MAIN ] XPEV: Generated 138 derivative records from 53614 primary records. [2025-10-28T22:20:47.713609] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:47.713693] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-28T22:20:47.726896] [DEBUG] [LOCAL ] XPEV: Derivative data saved (138 records). [2025-10-28T22:20:47.727051] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-28T22:20:47.729393] [INFO ] [MAIN ] Derivative Progress: 2016/2046 symbols completed. XPEV took 1.2s. Estimated remaining: 12.2s. Rate: 148.0 symbols/min [2025-10-28T22:20:47.729782] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:47.788020] [DEBUG] [LOCAL ] XPOF: Loaded 36466 existing records from primary storage. [2025-10-28T22:20:47.788255] [INFO ] [MAIN ] XPOF: Loaded 36466 primary data records. [2025-10-28T22:20:47.789127] [DEBUG] [LOCAL ] XPO: Loaded 47298 existing records from primary storage. [2025-10-28T22:20:47.820111] [INFO ] [MAIN ] XPO: Loaded 47298 primary data records. [2025-10-28T22:20:47.987029] [DEBUG] [LOCAL ] XPRO: Loaded 45612 existing records from primary storage. [2025-10-28T22:20:48.009143] [INFO ] [MAIN ] XPRO: Loaded 45612 primary data records. [2025-10-28T22:20:48.920134] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:49.000046] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:49.057239] [INFO ] [MAIN ] XPOF: Generated 138 derivative records from 36466 primary records. [2025-10-28T22:20:49.072162] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:49.075245] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-28T22:20:49.111970] [DEBUG] [LOCAL ] XPOF: Derivative data saved (138 records). [2025-10-28T22:20:49.117349] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-28T22:20:49.123715] [INFO ] [MAIN ] Derivative Progress: 2017/2046 symbols completed. XPOF took 1.4s. Estimated remaining: 11.8s. Rate: 147.8 symbols/min [2025-10-28T22:20:49.126820] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:49.133871] [INFO ] [MAIN ] XPO: Generated 138 derivative records from 47298 primary records. [2025-10-28T22:20:49.135422] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-28T22:20:49.159099] [DEBUG] [LOCAL ] XPO: Derivative data saved (138 records). [2025-10-28T22:20:49.166965] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-28T22:20:49.169795] [INFO ] [MAIN ] XPRO: Generated 138 derivative records from 45612 primary records. [2025-10-28T22:20:49.172545] [INFO ] [MAIN ] Derivative Progress: 2018/2046 symbols completed. XPO took 1.5s. Estimated remaining: 11.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:49.172836] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-28T22:20:49.172984] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:49.206339] [DEBUG] [LOCAL ] XYF: Loaded 27113 existing records from primary storage. [2025-10-28T22:20:49.207847] [INFO ] [MAIN ] XYF: Loaded 27113 primary data records. [2025-10-28T22:20:49.207610] [DEBUG] [LOCAL ] XPRO: Derivative data saved (138 records). [2025-10-28T22:20:49.231195] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-28T22:20:49.260971] [INFO ] [MAIN ] Derivative Progress: 2019/2046 symbols completed. XPRO took 1.5s. Estimated remaining: 11.0s. Rate: 147.9 symbols/min [2025-10-28T22:20:49.268324] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:49.569530] [DEBUG] [LOCAL ] XYL: Loaded 47437 existing records from primary storage. [2025-10-28T22:20:49.569798] [INFO ] [MAIN ] XYL: Loaded 47437 primary data records. [2025-10-28T22:20:49.684818] [DEBUG] [LOCAL ] YALA: Loaded 35715 existing records from primary storage. [2025-10-28T22:20:49.706056] [INFO ] [MAIN ] YALA: Loaded 35715 primary data records. [2025-10-28T22:20:50.202267] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:50.250542] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:50.286516] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:50.313974] [INFO ] [MAIN ] XYF: Generated 138 derivative records from 27113 primary records. [2025-10-28T22:20:50.317535] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-28T22:20:50.343450] [DEBUG] [LOCAL ] XYF: Derivative data saved (138 records). [2025-10-28T22:20:50.345454] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-28T22:20:50.349769] [INFO ] [MAIN ] XYL: Generated 138 derivative records from 47437 primary records. [2025-10-28T22:20:50.349338] [INFO ] [MAIN ] Derivative Progress: 2020/2046 symbols completed. XYF took 1.2s. Estimated remaining: 10.6s. Rate: 147.8 symbols/min [2025-10-28T22:20:50.349928] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-28T22:20:50.352893] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:50.366285] [DEBUG] [LOCAL ] XYL: Derivative data saved (138 records). [2025-10-28T22:20:50.367876] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-28T22:20:50.373066] [INFO ] [MAIN ] Derivative Progress: 2021/2046 symbols completed. XYL took 1.2s. Estimated remaining: 10.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:50.374624] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:50.378452] [INFO ] [MAIN ] YALA: Generated 138 derivative records from 35715 primary records. [2025-10-28T22:20:50.378632] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-28T22:20:50.391912] [DEBUG] [LOCAL ] YALA: Derivative data saved (138 records). [2025-10-28T22:20:50.401476] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-28T22:20:50.404775] [INFO ] [MAIN ] Derivative Progress: 2022/2046 symbols completed. YALA took 1.1s. Estimated remaining: 9.7s. Rate: 148.0 symbols/min [2025-10-28T22:20:50.405207] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:50.435792] [DEBUG] [LOCAL ] YELP: Loaded 44850 existing records from primary storage. [2025-10-28T22:20:50.436043] [INFO ] [MAIN ] YELP: Loaded 44850 primary data records. [2025-10-28T22:20:50.575676] [DEBUG] [LOCAL ] YETI: Loaded 52423 existing records from primary storage. [2025-10-28T22:20:50.650584] [INFO ] [MAIN ] YETI: Loaded 52423 primary data records. [2025-10-28T22:20:50.788571] [DEBUG] [LOCAL ] YEXT: Loaded 42599 existing records from primary storage. [2025-10-28T22:20:50.797390] [INFO ] [MAIN ] YEXT: Loaded 42599 primary data records. [2025-10-28T22:20:51.423102] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:51.484425] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:51.522452] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:51.542000] [INFO ] [MAIN ] YELP: Generated 138 derivative records from 44850 primary records. [2025-10-28T22:20:51.545665] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-28T22:20:51.561039] [DEBUG] [LOCAL ] YELP: Derivative data saved (138 records). [2025-10-28T22:20:51.564207] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-28T22:20:51.566280] [INFO ] [MAIN ] Derivative Progress: 2023/2046 symbols completed. YELP took 1.2s. Estimated remaining: 9.3s. Rate: 147.8 symbols/min [2025-10-28T22:20:51.597800] [INFO ] [MAIN ] YETI: Generated 138 derivative records from 52423 primary records. [2025-10-28T22:20:51.598346] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-28T22:20:51.616270] [DEBUG] [LOCAL ] YETI: Derivative data saved (138 records). [2025-10-28T22:20:51.614974] [INFO ] [MAIN ] YEXT: Generated 138 derivative records from 42599 primary records. [2025-10-28T22:20:51.616451] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-28T22:20:51.618894] [INFO ] [MAIN ] Derivative Progress: 2024/2046 symbols completed. YETI took 1.2s. Estimated remaining: 8.9s. Rate: 147.9 symbols/min [2025-10-28T22:20:51.619122] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-28T22:20:51.631574] [DEBUG] [LOCAL ] YEXT: Derivative data saved (138 records). [2025-10-28T22:20:51.631692] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-28T22:20:51.634225] [INFO ] [MAIN ] Derivative Progress: 2025/2046 symbols completed. YEXT took 1.2s. Estimated remaining: 8.5s. Rate: 148.0 symbols/min [2025-10-28T22:20:51.634735] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:51.634863] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:51.634676] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:51.703316] [DEBUG] [LOCAL ] YMM: Loaded 52564 existing records from primary storage. [2025-10-28T22:20:51.703579] [INFO ] [MAIN ] YMM: Loaded 52564 primary data records. [2025-10-28T22:20:51.839606] [DEBUG] [LOCAL ] YPF: Loaded 50752 existing records from primary storage. [2025-10-28T22:20:51.855234] [INFO ] [MAIN ] YPF: Loaded 50752 primary data records. [2025-10-28T22:20:51.861064] [DEBUG] [LOCAL ] YOU: Loaded 49295 existing records from primary storage. [2025-10-28T22:20:51.882550] [INFO ] [MAIN ] YOU: Loaded 49295 primary data records. [2025-10-28T22:20:52.683046] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:52.733730] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:52.813397] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:52.872518] [INFO ] [MAIN ] YMM: Generated 138 derivative records from 52564 primary records. [2025-10-28T22:20:52.877679] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-28T22:20:52.901011] [DEBUG] [LOCAL ] YMM: Derivative data saved (138 records). [2025-10-28T22:20:52.901235] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-28T22:20:52.903044] [INFO ] [MAIN ] Derivative Progress: 2026/2046 symbols completed. YMM took 1.3s. Estimated remaining: 8.1s. Rate: 147.8 symbols/min [2025-10-28T22:20:52.904254] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:52.908365] [INFO ] [MAIN ] YPF: Generated 138 derivative records from 50752 primary records. [2025-10-28T22:20:52.910353] [INFO ] [MAIN ] YOU: Generated 138 derivative records from 49295 primary records. [2025-10-28T22:20:52.910564] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-28T22:20:52.910440] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-28T22:20:52.935270] [DEBUG] [LOCAL ] YOU: Derivative data saved (138 records). [2025-10-28T22:20:52.941049] [DEBUG] [LOCAL ] YPF: Derivative data saved (138 records). [2025-10-28T22:20:52.941169] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-28T22:20:52.943620] [INFO ] [MAIN ] Derivative Progress: 2027/2046 symbols completed. YOU took 1.3s. Estimated remaining: 7.7s. Rate: 147.9 symbols/min [2025-10-28T22:20:52.944093] [DEBUG] [LOCAL ] YRD: Loaded 10806 existing records from primary storage. [2025-10-28T22:20:52.943778] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-28T22:20:52.944330] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:52.946460] [INFO ] [MAIN ] Derivative Progress: 2028/2046 symbols completed. YPF took 1.3s. Estimated remaining: 7.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:52.944239] [INFO ] [MAIN ] YRD: Loaded 10806 primary data records. [2025-10-28T22:20:52.947133] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:53.147194] [DEBUG] [LOCAL ] YSG: Loaded 25659 existing records from primary storage. [2025-10-28T22:20:53.197737] [INFO ] [MAIN ] YSG: Loaded 25659 primary data records. [2025-10-28T22:20:53.410478] [DEBUG] [LOCAL ] YUM: Loaded 51007 existing records from primary storage. [2025-10-28T22:20:53.448470] [INFO ] [MAIN ] YUM: Loaded 51007 primary data records. [2025-10-28T22:20:53.928272] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:53.976210] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:54.007713] [INFO ] [MAIN ] YRD: Generated 138 derivative records from 10806 primary records. [2025-10-28T22:20:54.012094] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-28T22:20:54.044349] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:54.047165] [DEBUG] [LOCAL ] YRD: Derivative data saved (138 records). [2025-10-28T22:20:54.047602] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-28T22:20:54.050540] [INFO ] [MAIN ] Derivative Progress: 2029/2046 symbols completed. YRD took 1.1s. Estimated remaining: 6.9s. Rate: 147.8 symbols/min [2025-10-28T22:20:54.071437] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:54.091233] [INFO ] [MAIN ] YSG: Generated 138 derivative records from 25659 primary records. [2025-10-28T22:20:54.095462] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-28T22:20:54.113664] [DEBUG] [LOCAL ] YSG: Derivative data saved (138 records). [2025-10-28T22:20:54.114036] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-28T22:20:54.129268] [INFO ] [MAIN ] Derivative Progress: 2030/2046 symbols completed. YSG took 1.2s. Estimated remaining: 6.5s. Rate: 147.9 symbols/min [2025-10-28T22:20:54.132927] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:54.133220] [INFO ] [MAIN ] YUM: Generated 138 derivative records from 51007 primary records. [2025-10-28T22:20:54.133514] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-28T22:20:54.146909] [DEBUG] [LOCAL ] YUM: Derivative data saved (138 records). [2025-10-28T22:20:54.147187] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-28T22:20:54.149706] [INFO ] [MAIN ] Derivative Progress: 2031/2046 symbols completed. YUM took 1.2s. Estimated remaining: 6.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:54.149890] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:54.166968] [DEBUG] [LOCAL ] YUMC: Loaded 52538 existing records from primary storage. [2025-10-28T22:20:54.167304] [INFO ] [MAIN ] YUMC: Loaded 52538 primary data records. [2025-10-28T22:20:54.299606] [DEBUG] [LOCAL ] ZEPP: Loaded 20203 existing records from primary storage. [2025-10-28T22:20:54.328183] [INFO ] [MAIN ] ZEPP: Loaded 20203 primary data records. [2025-10-28T22:20:54.615185] [DEBUG] [LOCAL ] ZBH: Loaded 50545 existing records from primary storage. [2025-10-28T22:20:54.626039] [INFO ] [MAIN ] ZBH: Loaded 50545 primary data records. [2025-10-28T22:20:55.164300] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:55.205755] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:55.239921] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:55.265894] [INFO ] [MAIN ] YUMC: Generated 138 derivative records from 52538 primary records. [2025-10-28T22:20:55.266876] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-28T22:20:55.285686] [DEBUG] [LOCAL ] YUMC: Derivative data saved (138 records). [2025-10-28T22:20:55.285797] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-28T22:20:55.287693] [INFO ] [MAIN ] Derivative Progress: 2032/2046 symbols completed. YUMC took 1.2s. Estimated remaining: 5.7s. Rate: 147.8 symbols/min [2025-10-28T22:20:55.287834] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:55.307058] [INFO ] [MAIN ] ZEPP: Generated 138 derivative records from 20203 primary records. [2025-10-28T22:20:55.308072] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-28T22:20:55.310980] [INFO ] [MAIN ] ZBH: Generated 138 derivative records from 50545 primary records. [2025-10-28T22:20:55.311216] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-28T22:20:55.329551] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (138 records). [2025-10-28T22:20:55.329867] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-28T22:20:55.346044] [INFO ] [MAIN ] Derivative Progress: 2033/2046 symbols completed. ZEPP took 1.2s. Estimated remaining: 5.3s. Rate: 147.9 symbols/min [2025-10-28T22:20:55.347720] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:55.349559] [DEBUG] [LOCAL ] ZBH: Derivative data saved (138 records). [2025-10-28T22:20:55.349930] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-28T22:20:55.353208] [INFO ] [MAIN ] Derivative Progress: 2034/2046 symbols completed. ZBH took 1.2s. Estimated remaining: 4.9s. Rate: 147.9 symbols/min [2025-10-28T22:20:55.353582] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:55.391497] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-28T22:20:55.392774] [INFO ] [MAIN ] ZETA: Loaded 53618 primary data records. [2025-10-28T22:20:55.393275] [DEBUG] [LOCAL ] ZH: Loaded 23903 existing records from primary storage. [2025-10-28T22:20:55.405012] [INFO ] [MAIN ] ZH: Loaded 23903 primary data records. [2025-10-28T22:20:55.623298] [DEBUG] [LOCAL ] ZGN: Loaded 40510 existing records from primary storage. [2025-10-28T22:20:55.628967] [INFO ] [MAIN ] ZGN: Loaded 40510 primary data records. [2025-10-28T22:20:56.343598] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:56.371325] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:56.414043] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:56.466314] [INFO ] [MAIN ] ZH: Generated 138 derivative records from 23903 primary records. [2025-10-28T22:20:56.469498] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-28T22:20:56.473127] [INFO ] [MAIN ] ZETA: Generated 138 derivative records from 53618 primary records. [2025-10-28T22:20:56.473708] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-28T22:20:56.499126] [DEBUG] [LOCAL ] ZH: Derivative data saved (138 records). [2025-10-28T22:20:56.504486] [DEBUG] [LOCAL ] ZETA: Derivative data saved (138 records). [2025-10-28T22:20:56.504570] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-28T22:20:56.507052] [INFO ] [MAIN ] Derivative Progress: 2035/2046 symbols completed. ZH took 1.2s. Estimated remaining: 4.5s. Rate: 147.8 symbols/min [2025-10-28T22:20:56.507258] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:56.508997] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-28T22:20:56.511232] [INFO ] [MAIN ] Derivative Progress: 2036/2046 symbols completed. ZETA took 1.2s. Estimated remaining: 4.1s. Rate: 147.9 symbols/min [2025-10-28T22:20:56.511372] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:56.512051] [INFO ] [MAIN ] ZGN: Generated 138 derivative records from 40510 primary records. [2025-10-28T22:20:56.512402] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-28T22:20:56.525071] [DEBUG] [LOCAL ] ZGN: Derivative data saved (138 records). [2025-10-28T22:20:56.525419] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-28T22:20:56.527804] [INFO ] [MAIN ] Derivative Progress: 2037/2046 symbols completed. ZGN took 1.2s. Estimated remaining: 3.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:56.527995] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:56.580712] [DEBUG] [LOCAL ] ZIP: Loaded 43145 existing records from primary storage. [2025-10-28T22:20:56.580960] [INFO ] [MAIN ] ZIP: Loaded 43145 primary data records. [2025-10-28T22:20:56.714144] [DEBUG] [LOCAL ] ZK: Loaded 38439 existing records from primary storage. [2025-10-28T22:20:56.718755] [INFO ] [MAIN ] ZK: Loaded 38439 primary data records. [2025-10-28T22:20:56.719435] [DEBUG] [LOCAL ] ZIM: Loaded 53434 existing records from primary storage. [2025-10-28T22:20:56.730426] [INFO ] [MAIN ] ZIM: Loaded 53434 primary data records. [2025-10-28T22:20:57.579789] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:57.632133] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:57.639820] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:57.686755] [INFO ] [MAIN ] ZIP: Generated 138 derivative records from 43145 primary records. [2025-10-28T22:20:57.690015] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-28T22:20:57.705338] [DEBUG] [LOCAL ] ZIP: Derivative data saved (138 records). [2025-10-28T22:20:57.705500] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-28T22:20:57.711906] [INFO ] [MAIN ] Derivative Progress: 2038/2046 symbols completed. ZIP took 1.2s. Estimated remaining: 3.2s. Rate: 147.8 symbols/min [2025-10-28T22:20:57.733245] [INFO ] [MAIN ] ZK: Generated 138 derivative records from 38439 primary records. [2025-10-28T22:20:57.734779] [INFO ] [MAIN ] ZIM: Generated 138 derivative records from 53434 primary records. [2025-10-28T22:20:57.734928] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-28T22:20:57.734877] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-28T22:20:57.758280] [DEBUG] [LOCAL ] ZK: Derivative data saved (138 records). [2025-10-28T22:20:57.758397] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-28T22:20:57.761008] [INFO ] [MAIN ] Derivative Progress: 2039/2046 symbols completed. ZK took 1.2s. Estimated remaining: 2.8s. Rate: 147.9 symbols/min [2025-10-28T22:20:57.762674] [DEBUG] [LOCAL ] ZIM: Derivative data saved (138 records). [2025-10-28T22:20:57.762742] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-28T22:20:57.765114] [INFO ] [MAIN ] Derivative Progress: 2040/2046 symbols completed. ZIM took 1.3s. Estimated remaining: 2.4s. Rate: 147.9 symbols/min [2025-10-28T22:20:57.765463] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:57.765665] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:57.765568] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:57.776895] [DEBUG] [LOCAL ] ZKH: Loaded 7202 existing records from primary storage. [2025-10-28T22:20:57.777117] [INFO ] [MAIN ] ZKH: Loaded 7202 primary data records. [2025-10-28T22:20:57.896176] [DEBUG] [LOCAL ] ZTR: Loaded 16249 existing records from primary storage. [2025-10-28T22:20:57.907396] [INFO ] [MAIN ] ZTR: Loaded 16249 primary data records. [2025-10-28T22:20:58.231449] [DEBUG] [LOCAL ] ZTO: Loaded 48890 existing records from primary storage. [2025-10-28T22:20:58.237320] [INFO ] [MAIN ] ZTO: Loaded 48890 primary data records. [2025-10-28T22:20:58.729889] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-28T22:20:58.770160] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:58.818617] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:58.831103] [INFO ] [MAIN ] ZKH: Generated 138 derivative records from 7202 primary records. [2025-10-28T22:20:58.833817] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-28T22:20:58.851105] [DEBUG] [LOCAL ] ZKH: Derivative data saved (138 records). [2025-10-28T22:20:58.851394] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-28T22:20:58.853870] [INFO ] [MAIN ] Derivative Progress: 2041/2046 symbols completed. ZKH took 1.1s. Estimated remaining: 2.0s. Rate: 147.8 symbols/min [2025-10-28T22:20:58.856537] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:58.861741] [INFO ] [MAIN ] ZTR: Generated 138 derivative records from 16249 primary records. [2025-10-28T22:20:58.862148] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-28T22:20:58.877994] [DEBUG] [LOCAL ] ZTR: Derivative data saved (138 records). [2025-10-28T22:20:58.881085] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-28T22:20:58.885321] [INFO ] [MAIN ] Derivative Progress: 2042/2046 symbols completed. ZTR took 1.1s. Estimated remaining: 1.6s. Rate: 147.9 symbols/min [2025-10-28T22:20:58.888984] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:58.892558] [INFO ] [MAIN ] ZTO: Generated 138 derivative records from 48890 primary records. [2025-10-28T22:20:58.892661] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-28T22:20:58.904879] [DEBUG] [LOCAL ] ZTO: Derivative data saved (138 records). [2025-10-28T22:20:58.917723] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-28T22:20:58.920426] [INFO ] [MAIN ] Derivative Progress: 2043/2046 symbols completed. ZTO took 1.2s. Estimated remaining: 1.2s. Rate: 148.0 symbols/min [2025-10-28T22:20:58.920796] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-28T22:20:58.958537] [DEBUG] [LOCAL ] ZTS: Loaded 53082 existing records from primary storage. [2025-10-28T22:20:58.959689] [INFO ] [MAIN ] ZTS: Loaded 53082 primary data records. [2025-10-28T22:20:58.971430] [DEBUG] [LOCAL ] ZVIA: Loaded 35817 existing records from primary storage. [2025-10-28T22:20:58.991968] [INFO ] [MAIN ] ZVIA: Loaded 35817 primary data records. [2025-10-28T22:20:59.190251] [DEBUG] [LOCAL ] ZWS: Loaded 41897 existing records from primary storage. [2025-10-28T22:20:59.196170] [INFO ] [MAIN ] ZWS: Loaded 41897 primary data records. [2025-10-28T22:20:59.915819] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:59.941710] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:20:59.977568] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-28T22:21:00.036706] [INFO ] [MAIN ] ZTS: Generated 138 derivative records from 53082 primary records. [2025-10-28T22:21:00.039984] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-28T22:21:00.040189] [INFO ] [MAIN ] ZVIA: Generated 138 derivative records from 35817 primary records. [2025-10-28T22:21:00.040984] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-28T22:21:00.069422] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (138 records). [2025-10-28T22:21:00.070822] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-28T22:21:00.067016] [DEBUG] [LOCAL ] ZTS: Derivative data saved (138 records). [2025-10-28T22:21:00.073087] [INFO ] [MAIN ] Derivative Progress: 2044/2046 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.8s. Rate: 147.8 symbols/min [2025-10-28T22:21:00.074011] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-28T22:21:00.076070] [INFO ] [MAIN ] Derivative Progress: 2045/2046 symbols completed. ZTS took 1.2s. Estimated remaining: 0.4s. Rate: 147.9 symbols/min [2025-10-28T22:21:00.078033] [INFO ] [MAIN ] ZWS: Generated 138 derivative records from 41897 primary records. [2025-10-28T22:21:00.078117] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-28T22:21:00.089821] [DEBUG] [LOCAL ] ZWS: Derivative data saved (138 records). [2025-10-28T22:21:00.089929] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-28T22:21:00.092523] [INFO ] [MAIN ] Derivative Progress: 2046/2046 symbols completed. ZWS took 1.2s. Estimated remaining: 0.0s. Rate: 148.0 symbols/min [2025-10-28T22:21:00.093271] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 50s [2025-10-28T22:21:00.093376] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2046/2046 symbols) [2025-10-28T22:21:01.707083] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2046/2046 @ 100.00%)' [2025-10-28T22:21:01.707692] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-28T22:21:01.707971] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-28T22:21:01.708146] [INFO ] [STATE ] Last completion updated: 2025-10-28T22:21:01.708045